JP2015204988A - Needle tip image display device for displaying needle tip in body on image, cancer treatment device using same, and needle tip image display method for displaying needle tip in body on image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a needle tip image display device that displays a needle tip in a body on an image.SOLUTION: The needle tip image display device for displaying a needle tip in a body on an image comprises three-dimensional body image acquisition means 1, measured image acquisition means 2, needle information acquisition means 3, positional information acquisition means 4, three-dimensional body image extraction means 5, needle image generation means 6, image superimposition means 7, and image display means 8, the positional information acquisition means acquiring positional information of a measurement position of the measured image and positional information of the needle, the three-dimensional body image extraction means extracting, as an extracted three-dimensional body image, a region of a three-dimensional body image corresponding to a measured region of the measured image, the needle image generation means generating an image of a needle on the basis of the positional information of the measurement position of the measured image, the positional information of the needle, and the needle information, and the image superimposition means superimposing the extracted three-dimensional body image, the measured image, and the generated image of the needle to generate a superimposition image and display the superimposition image.

Description

  The present invention relates to a needle tip image display device that displays a needle tip in the body on an image, a cancer treatment device, and a needle tip image display method that displays a needle tip in the body on an image.

  In the treatment of liver cancer, a needle such as a monopolar electrode or bipolar electrode is placed in or around the liver cancer, a voltage is applied to the electrode, and the cancer cells are cauterized by the heat generated thereby. Treatment is performed using invasive methods. Moreover, when using a bipolar electrode, the treatment which cauterizes a cancer cell by arrange | positioning the said several bipolar electrode around the said liver cancer is performed (nonpatent literature 1).

Seror. O et.al., Radiology, 2008, 248, 288-296

  When placing the needle in or around the liver cancer, the doctor uses, for example, an ultrasonic measurement device to grasp the position of the structure, organ, organ, tissue, needle, etc. in the body and their positional relationship. The needle or the like is arranged with reference to the measured measurement image. However, since the image obtained by the ultrasonic measurement device is a two-dimensional image, the positional relationship is not clear, and it is difficult to place the needle at a desired position in the body. In addition, even when the image obtained by the ultrasonic measurement device is displayed as a three-dimensional image by image processing, it is difficult to specify the positional relationship of the needle and the like in the body because there is a lot of noise. There has been a problem that it is difficult to place the needle at a desired position.

  Furthermore, when arranging the plurality of needles, it is necessary to grasp the positional relationship between the plurality of needles in the body. However, as described above, since it is difficult to specify the positional relationship of the needles and the like, naturally it is also very difficult to specify the positional relationship between the plurality of needles. For this reason, when arranging a plurality of needles, it is very difficult to arrange the plurality of needles at a desired position.

  Therefore, the present invention provides a needle tip image display device that displays the needle tip in the body on the image, a cancer treatment device using the same, and a needle tip image display method that displays the needle tip in the body on the image. The purpose is to do.

In order to achieve the above object, a needle tip image display device for displaying a needle tip in the body of the present invention on an image includes a three-dimensional body image acquisition unit, a measurement image acquisition unit, a needle information acquisition unit, and a position information acquisition unit. Including a three-dimensional body image extracting means, a needle image generating means, an image superimposing means and an image display means,
The three-dimensional body image acquisition means acquires a three-dimensional body image of the subject,
The measurement image acquisition means acquires a measurement image in the body of the subject,
The needle information acquisition means acquires needle information,
The position information acquisition means acquires the position information of the measurement position of the measurement image and the position information of the needle;
The three-dimensional body image extracting means extracts a three-dimensional body image region corresponding to the measurement region of the measurement image as an extracted three-dimensional body image based on the position information of the measurement position of the measurement image,
The needle image generation means generates a generated needle image of an area corresponding to the measurement area of the measurement image based on the position information of the measurement position of the measurement image, the position information of the needle and the needle information,
The image superimposing means generates a superimposed image by superimposing the extracted three-dimensional body image, the measurement image, and the generated needle image;
The image display means displays the superimposed image.

The cancer treatment device of the present invention comprises:
Including a needle, a voltage application device and an image display device,
The voltage application device heats the needle by applying a voltage to the needle,
The image display device is a needle tip image display device that displays a needle tip in the body of the present invention on an image.

The needle tip image display method for displaying the needle tip in the first body of the present invention on an image,
A three-dimensional body image acquisition means for acquiring a three-dimensional body image of the subject;
A measurement image acquisition step, wherein the measurement image acquisition means acquires a measurement image in the body of the subject;
Needle information acquisition means for acquiring needle information, needle information acquisition step,
A position information acquisition step in which the position information acquisition means acquires the position information of the measurement position of the measurement image and the position information of the needle;
A three-dimensional body image extraction step in which the three-dimensional body image extraction means extracts a region of the three-dimensional body image corresponding to the measurement region of the measurement image as an extraction three-dimensional body image based on the position information of the measurement position of the measurement image. ,
A needle image generation step in which a needle image generation unit generates a generated needle image of an area corresponding to the measurement area of the measurement image based on the position information of the measurement position of the measurement image, the position information of the needle, and the needle information;
The image superimposing means generates an superimposed image by superimposing the extracted three-dimensional body image, the measurement image, and the generated needle image, and the image display means displays an image displaying step of displaying the superimposed image. It is characterized by including.

The needle tip image display method for displaying the needle tip in the second body of the present invention on an image,
A 3D body image acquisition step of acquiring a 3D body image of the subject;
A measurement image acquisition step of acquiring a measurement image in the body of the subject;
Needle information acquisition process for acquiring needle information;
A position information acquisition step of acquiring position information of the measurement position of the measurement image and position information of the needle;
A three-dimensional body image extraction step of extracting, as an extracted three-dimensional body image, a region of a three-dimensional body image corresponding to the measurement region of the measurement image based on position information of the measurement position of the measurement image;
A needle image generation step of generating a generated needle image of an area corresponding to the measurement area of the measurement image based on the position information of the measurement position of the measurement image, the position information of the needle and the needle information;
The method includes an image superimposing step of generating a superimposed image by superimposing the extracted three-dimensional body image, the measurement image, and the generated needle image, and an image display step of displaying the superimposed image.

  ADVANTAGE OF THE INVENTION According to this invention, the needle tip image display apparatus which displays the needle tip in a body on an image, the cancer treatment apparatus using the same, and the needle tip image display method which displays the needle tip in a body on an image are provided. it can.

FIG. 1 is a block diagram showing a configuration of an example (embodiment 1) of a needle tip image display device that displays a needle tip in the body of the present invention on an image. FIG. 2 is a flowchart illustrating an example (Embodiment 1) of a needle tip image display method for displaying a needle tip in the body of the present invention on an image. FIG. 3 is a block diagram illustrating a configuration of an example (second embodiment) of a needle tip image display device that displays a needle tip in the body of the present invention on an image. FIG. 4 is a flowchart showing an example (second embodiment) of a needle tip image display method for displaying the needle tip in the body of the present invention on an image. FIG. 5 is a diagram illustrating an example of a method for associating position information of a three-dimensional body image and position information of a measurement position of the measurement image in the second embodiment. FIG. 6 is a schematic perspective view showing an example of the cancer treatment apparatus of the present invention.

  In the present invention, the “needle tip” means, for example, a region including at least one region of the needle tip, the needle body, and the needle base.

  The present invention will be described in detail by way of example with reference to the drawings. However, the present invention is not limited to the following examples. In addition, in the following FIGS. 1-6, the same code | symbol is attached | subjected to the same part. In the drawings, for convenience of explanation, the structure of each part may be simplified as appropriate, and the dimensional ratio of each part may be schematically shown, unlike the actual case.

<Needle tip image display device and needle tip image display method for displaying needle tip in body on image>
First, a needle tip image display device (hereinafter also referred to as “image display device”) and a needle tip image display method (hereinafter also referred to as “image display method”) for displaying the needle tip of the present invention on an image. explain. However, the present invention is not limited to the following examples.

(Embodiment 1)
FIG. 1 is a block diagram showing the configuration of the image display apparatus of this embodiment. FIG. 2 is a flowchart of the image display method in the present embodiment. As shown in FIG. 1, the image display apparatus 100 of this embodiment includes a three-dimensional (3D) body image acquisition unit 1, a measurement image acquisition unit 2, a needle information acquisition unit 3, a position information acquisition unit 4, and a three-dimensional (3D). ) The body image extracting means 5, the needle image generating means 6, the image superimposing means 7 and the image display means 8 are included as main components. As shown in FIG. 1, in the image display device 100 of the present embodiment, the 3D body image extraction unit 5 includes the 3D body image acquisition unit 1 and the position information acquisition unit 4, and the needle image generation unit 6 includes the position information acquisition unit. 4 and the needle information acquisition means 3, the image superimposing means 7, the measurement image acquisition means 2, the 3D body image extraction means 5 and the needle image generation means 6, and the image display means 8 are electrically connected to the image superimposing means 7, respectively. It is connected to the. In the present embodiment, each component of the image display apparatus 100 is connected in a wired manner, but is not limited thereto, and may be connected wirelessly.

  The 3D body image acquisition unit 1 acquires a 3D body image of the subject. For example, the 3D body image acquisition unit 1 may acquire a 3D body image of the subject acquired in advance, or may acquire a 3D body image of the subject being photographed. In the former case, the 3D body image acquisition means 1 is, for example, a storage medium. The storage medium is not particularly limited and a known one can be used. Specifically, for example, random access memory (RAM), read-only memory (ROM), hard disk (HD), optical disk, floppy (registered trademark) A disk (FD) etc. are mention | raise | lifted. In the latter case, the 3D body image acquisition means 1 is a 3D examination such as a nuclear magnetic resonance imaging (MRI) apparatus, a computed tomography (CT) apparatus, a positron tomography (PET) apparatus, or a PET-CT apparatus. Examples thereof include devices that can image a person's body, and connectors such as input terminals that connect these devices and the image display device 100. In the latter case, the image display device 100 is connected to the imaging device via the 3D body image acquisition unit 1. The subject is not particularly limited, and examples thereof include humans, non-human animals other than humans, and the non-human animals include, for example, mice, rats, guinea pigs, dogs, cats, monkeys, rabbits, sheep, Examples include mammals such as horses and pigs. The 3D body image is not particularly limited, and can be appropriately determined according to the types of organs, organs, tissues, etc. (hereinafter also referred to as “organs”) displayed on the image display device 100. Examples of the 3D body image include an MRI image, a CT image, and a PET image. As the 3D body image, one type of the 3D body image may be used alone, or a fused 3D body image obtained by fusing two or more types of the images may be used. Examples of the fused 3D body image include a PET-CT image. The organ or the like is not particularly limited, and examples thereof include liver, kidney, lung, bone, adrenal gland, lymph node, prostate, thyroid gland, muscle, pancreas and the like. When the organ or the like is a liver, the 3D body image is preferably a CT image.

  The measurement image acquisition unit 2 acquires a measurement image in the body of the subject (hereinafter also referred to as “in-vivo image”). The measurement image acquisition unit 2 only needs to be able to capture in-vivo images of the subject in real time, for example. The body may include, for example, a body surface of the subject. The measurement image acquisition unit 2 may acquire, for example, the two-dimensional (2D) in-vivo image, or may acquire the 3D in-vivo image. In the former case, the measurement image acquisition unit 2 includes, for example, an ultrasonic (echo) measurement device and the like, and a connection tool such as an input terminal that connects these devices and the image display device 100. In the latter case, the measurement image acquisition unit 2 includes, for example, an MRI apparatus, a CT apparatus, a PET apparatus, and the like, and a connection tool such as an input terminal that connects these apparatuses to the image display apparatus 100. When the measurement image acquisition unit 2 is the connection tool or the like, the image display device 100 is connected to the imaging device via the measurement image acquisition unit 2. The in-vivo image may be, for example, a discontinuous image or a continuous video. Examples of the 2D in-vivo image include an echo image. Examples of the 3D in-vivo image include an MRI image, a CT image, and a PET image.

  The needle information acquisition unit 3 acquires needle information. For example, the needle information acquisition unit 3 may acquire needle information input in advance, or may acquire the needle information input during use. In the former case, the needle information acquisition unit 3 is, for example, the storage medium described above. In the latter case, the needle information acquisition unit 3 includes, for example, a known input unit such as a keyboard, a mouse, and a touch panel, and a connection tool such as an input terminal that connects the input unit and the image display device 100. In the latter case, the image display device 100 is connected to the input unit via the needle information acquisition unit 3. Further, when an image display unit 8 to be described later is a touch panel that also serves as the input unit, for example, the image display unit 8 may be the needle information acquisition unit 3 and the needle information may be acquired. The needle may be a medical instrument inserted into a needle-like body, and examples thereof include a medical needle. Examples of the medical needle include a therapeutic needle and a diagnostic needle. Examples of the therapeutic needle include a monopolar electrode, a bipolar electrode, and a puncture needle. Examples of the diagnostic needle include a puncture needle and a biopsy needle. The number of the needles is not particularly limited, and the lower limit is, for example, one, preferably two, more preferably three, and the upper limit is, for example, three. The needle information is not particularly limited and can be appropriately determined according to the type of the needle. Examples thereof include needle shape, length, diameter, gauge, electrode position, and needle tip position information. When the needle is gripped by the gripping means, the needle information acquisition means 3 may acquire information of the gripping means in addition to the needle information. Examples of the information on the gripping means include the shape, length, width, height, depth, and the like of the gripping means.

  The position information acquisition means 4 acquires the position information of the measurement position of the measurement image and the position information of the needle. The position information acquisition unit 4 only needs to be able to acquire the position information of the measurement position of the measurement image and the position information of the needle in real time, for example. Examples of the position information acquisition unit 4 include known position measuring devices and the like, and connecting devices such as input terminals for connecting these devices and the image display device 100. In the latter case, the image display device 100 is connected to the position measurement device via the position information acquisition unit 4. The position information includes, for example, the position information of the measurement position of the measurement image and the position information of the needle in the coordinate system centered on the reference position in 3D space, the inclination information of the measurement position of the measurement image, and the distance between the needle and the needle. Information on the distance interval. When the measurement image is the echo image, examples of the measurement position include position information and inclination information of an ultrasonic probe of an ultrasonic measurement apparatus. Examples of the position information of the needle include position information on the outer side end of the needle, inclination information, and the like. The acquisition of the position information will be described later.

  The 3D body image extraction means 5 extracts a 3D body image region corresponding to the measurement region of the measurement image as an extracted 3D body image based on the position information of the measurement position of the measurement image. As the 3D body image extraction unit 5, for example, a known calculation unit can be used. Examples of the computing means include a central processing unit (CPU), a microprocessor, and a GPU (Graphics Processing Unit). The extraction of the extracted three-dimensional body image will be described later.

  The needle image generation means 6 generates a generated needle image of an area corresponding to the measurement area of the measurement image based on the position information of the measurement position of the measurement image, the position information of the needle, and the needle information. The needle image generation means 6 is, for example, the aforementioned known calculation means. The generation of the generated needle image will be described later. The needle image generation means 6 may generate a generated needle image in which an area corresponding to the electrode is displayed in a color different from other areas based on the needle information. Thus, by displaying the area corresponding to the electrode in a color different from that of the other areas, for example, the position of the electrode becomes clear and the electrode can be arranged at a desired position.

  The image superimposing means 7 generates a superimposed image by superimposing the extracted three-dimensional body image, the measurement image, and the generated needle image. The image superimposing means 7 includes, for example, the above-described known arithmetic means. The generation of the superimposed image will be described later.

  The image display means 8 displays the superimposed image. As the image display means 8, for example, a known image display means such as a liquid crystal display can be used. The image display means 8 may display the entire superimposed image or a part thereof. The image display means 8 may further display the 3D body image, the measurement image, the extracted 3D body image, the generated needle image, the position information, and the like.

  In the image display method of the present embodiment, for example, the following steps are performed using the image display device 100 of FIG. 1 as shown in the flowchart of FIG. As shown in FIG. 2, the image display method of the present embodiment includes an acquisition step S10, an image extraction generation step S20, an image superimposition step S30, and an image display step S40 as main steps.

  First, the acquisition step S10 is performed. The acquisition step S10 acquires, for example, the 3D body image, the measurement image, the position information of the measurement position of the measurement image, the position information of the needle, and the needle information. As shown in FIG. 2, in the image display method of the present embodiment, the acquisition step S10 includes a three-dimensional (3D) body image acquisition step S11, a measurement image acquisition step S12, a needle information acquisition step S13, and a position information acquisition step S14. Including these steps in this order, the present invention is not limited to this example. In the present invention, the acquisition step S10 may be performed by performing all the steps of the 3D body image acquisition step S11, the measurement image acquisition step S12, the needle information acquisition step S13, and the position information acquisition step S14. Not limited.

  In the 3D body image acquisition step S11, a 3D body image of the subject is acquired. The 3D body image acquisition step S11 may be performed by the 3D body image acquisition unit.

  In the measurement image acquisition step S12, a measurement image in the body of the subject is acquired. The measurement image acquisition step S12 may be performed by the measurement image acquisition unit.

  The needle information acquisition step S13 acquires the needle information and the needle position information. The needle information acquisition unit S13 may be performed by the needle information acquisition unit.

  In the position information acquisition step S14, the position information of the measurement position of the measurement image and the position information of the needle are acquired. The position information acquisition step S14 may be performed by the position information acquisition unit. When acquiring the position information of the measurement position of the measurement image and the position information of the needle using the position measurement device, the position measurement device as the position information acquisition unit is, for example, a three-dimensional (3D) space. A reference position device serving as a reference position of the coordinate system and a position sensor are included. The reference position device transmits a signal in 3D space, for example. The position sensor is installed, for example, on the measurement image acquisition unit and the needle, detects the signal, and detects the position and inclination of the measurement image acquisition unit and the needle in the coordinates of the 3D space. Then, the position sensor is, for example, based on the measurement image acquisition means (for example, an ultrasonic probe of an ultrasonic measurement device) and the position and inclination of the measurement image in the coordinates of the 3D space. The position information and the position information of the needle are calculated and acquired. Note that the calculation and acquisition of the position information may be performed using, for example, the calculation unit, instead of the position sensor.

  Next, an image extraction generation step S20 is performed. The image extraction and generation step S20 includes, for example, the extraction 3D based on the 3D body image acquired in the acquisition step S10, the measurement image, the position information of the measurement position of the measurement image, the position information of the needle, and the needle information. A body image is extracted and the generated needle image is generated. As shown in FIG. 2, in the image display method of the present embodiment, the image extraction generation step S20 includes a 3D body image extraction step S21 and a needle image generation step S22, and these steps are performed in this order. The present invention is not limited to this example. In the present invention, the image extraction generation step S20 may be performed by both the 3D body image extraction step S21 and the needle image generation step S22, and the order of the steps is not particularly limited.

  The 3D body image extraction step S21 extracts a 3D body image region corresponding to the measurement region of the measurement image as an extracted 3D body image based on the position information of the measurement position of the measurement image. The 3D body image extraction step S21 may be performed by the 3D body image extraction unit. 3D body image extraction process S21 calculates the measurement area | region of the said measurement image based on the positional information on the measurement position of the said measurement image, for example. Then, the 3D body image extraction step 21 is performed based on, for example, the calculated measurement region of the measurement image so that the cross-sectional image of the 3D body image corresponding to the measurement image has the same position and inclination as the measurement image. The 3D body image is processed and extracted as an extracted 3D body image.

  The needle image generation step S22 generates a generated needle image of an area corresponding to the measurement area of the measurement image based on the position information of the measurement position of the measurement image, the position information of the needle, and the needle information. The needle image generation step S22 may be performed by the needle image generation unit. In the needle image generation step S22, for example, a three-dimensional (3D) needle image is generated based on the needle information. In the 3D needle image, for example, the entire needle may be generated as a 3D needle image, or a part of the needle may be generated as a 3D needle image. In the 3D needle image, the positional relationship with the organ or the like in the body of the subject becomes clear, and when the needle is operated, the contact of the needle with the organ or the like can be reduced. Since damage can be reduced, it is preferable that the entire needle existing in a region corresponding to the body of the subject is generated as the 3D needle image. In the needle image generation step S22, for example, based on the position information of the measurement position of the measurement image and the position information of the needle, the cross-sectional image of the 3D needle image corresponding to the measurement image has the same position and inclination as the measurement image. The 3D needle image is processed so that the processed 3D needle image is generated as a generated needle image. In the needle image generation step S22, based on the needle information, a generated needle image in which an area corresponding to the electrode is displayed in a color different from other areas may be generated. Thus, by displaying the area corresponding to the electrode in a color different from that of the other areas, the position of the electrode becomes clear, and the electrode can be arranged at a desired position.

  Next, the image superimposing step S30 is performed. The image superimposing step S30 generates a superimposed image by superimposing the extracted 3D body image, the measurement image, and the generated needle image. The image superimposing step S30 may be performed by the image superimposing means. In the image superimposing step S30, for example, the extracted 3D body image, the measurement image, and the generated needle image are overlapped with the cross-sectional image of the 3D body image and the generated needle image corresponding to the measurement image, and the measurement image. Superimpose and generate a superimposed image. In the image superimposing step S30, as the extracted 3D body image, the measurement image, and the generated needle image, for example, an image subjected to a semi-transmission process may be used. When an image obtained by performing the translucent image is used, it is preferable that the superimposed image is easily visible in the depth direction. The translucent processing is not particularly limited, and can be performed by a known method such as surface rendering or volume rendering.

  Next, image display process S40 is implemented. The image display step S40 displays the superimposed image. The image display step S40 may be performed by the image display means.

  Thus, according to this embodiment, since the tip of the needle can be displayed on the image in the body, for example, the position of the needle tip is grasped three-dimensionally in the body of the subject. This allows the needle to be placed in the desired position. Further, according to the present embodiment, the generated needle image is generated based on the needle information and needle position information described later. For example, even when a plurality of needles are used, The tip can be displayed on the image, whereby a plurality of the needles can be arranged at a desired position.

(Embodiment 2)
The image display apparatus of this embodiment may further include position information conversion means 9. FIG. 3 is a block diagram illustrating a configuration of the image display apparatus according to the present embodiment. FIG. 4 is a flowchart of the image display method in this embodiment. The image display apparatus 200 according to the present embodiment includes a position information conversion unit 9. The position information acquisition unit 4 is connected to the position information conversion unit 9 instead of the 3D body image extraction unit 5. The 3D body image extraction means 5 is connected. Except for this point, the image display apparatus of the present embodiment has the same configuration as the image display apparatus 100 shown in FIG.

  For example, the position information conversion unit 9 converts the position information of the measurement region of the measurement image in the 3D body image based on the relationship between the position information of the 3D body image associated in advance and the position information of the measurement position of the measurement image. Convert to position information of the corresponding area. An example of the position information conversion means 9 is the above-described calculation means. A method of previously associating the position information of the 3D body image and the position information of the measurement position of the measurement image will be described later.

  In the present embodiment, the 3D body image extraction unit 5 extracts, for example, a 3D body image region corresponding to the measurement region of the measurement image as an extraction 3D body image based on position information of the corresponding region in the 3D body image. To do.

  The image display method of this embodiment performs the following steps as shown in the flowchart of FIG. 4 using the image display apparatus of FIG. 3, for example. In the image display method of the present embodiment, the image extraction generation step S20 further includes a position information conversion step S23, and the 3D body image extraction step S21 is based on the position information of the corresponding region in the 3D body image. The third embodiment is performed in the same manner as in the first embodiment except that a 3D body image region corresponding to the image measurement region is extracted as an extracted 3D body image.

  First, the acquisition step S10 is performed in the same manner as in the first embodiment. Next, an image extraction generation step S20 is performed. The image extraction generation step S20 converts, for example, the position information of the measurement position of the measurement image acquired in the acquisition step S10 into the position information of the corresponding region in the 3D body image, and the acquired information in the acquisition step S10. Based on the 3D body image, the measurement image, the position information and the needle information of the needle, and the position information of the corresponding region in the 3D body image, the extracted three-dimensional body image and the generated needle image are generated.

  As shown in FIG. 4, in the image display method of the present embodiment, the image extraction generation step S20 includes a position information conversion step S23, a 3D body image extraction step S21, and a needle image generation step S22. Although it implements in this order, this invention is not limited to this example. In the present invention, the position information conversion step S23 may be performed before the 3D body image extraction step S21, and the order of other steps is not particularly limited.

  In the position information conversion step S23, for example, based on the relationship between the position information of the 3D body image associated in advance and the position information of the measurement position of the measurement image, the position information of the measurement region of the measurement image is associated with the 3D body image. To position information of the area to be used. The position information conversion step S23 may be performed by the position information conversion means. A method for previously associating the position information of the 3D body image and the position information of the measurement position of the measurement image is not particularly limited. For example, a reference point is set in the 3D body image and the measurement image, and the reference point By associating position information, there is a method of previously associating the position information of the 3D body image and the position information of the measurement position of the measurement image. Examples of the position information of the 3D body image include position information in a coordinate system of the 3D body image. Examples of the reference point include the lower sternum, xiphoid process, vascular branch, occupied lesion, and the like. The number of the reference points to be set is not particularly limited, and the lower limit thereof is, for example, 1, preferably 2, and more preferably 3, and the upper limit thereof is, for example, 3. . The number of reference points may be the number at one reference point or the total number of the numbers at two or more reference points. In the image superimposing step S30 to be described later, it is preferable to set the reference points to 1 to 3 because displacement of the image when the extracted 3D body image and the measurement image are superimposed can be suppressed. The combination of the reference points is preferably a combination of the lower sternum and the vascular branch because there is no respiratory movement and since the sternum is on the body surface and is easy to identify. In addition, since the accuracy of associating the positional information of the 3D body image and the positional information of the measurement position of the measurement image is further improved, the vascular branch is more preferably a combination of a plurality of vascular branches.

  For a method of associating the position information of the 3D body image and the position information of the measurement position of the measurement image in advance, as an example, when the reference point is set and associated with the lower sternum and the blood vessel branch, refer to FIG. explain. However, the present invention is not limited to the following examples. In FIG. 5, the upper stage is an image including the lower sternum, the lower stage is an image including the blood vessel branch, and (A) and (C) are the 3D body images (for example, CT images), (B) and (D) are the measurement images (for example, echo images). First, in the 3D body image acquired by the 3D body image acquisition unit, a reference point (P1) is set at the lower end of the sternum by an input unit, and the reference point (P1) in the coordinate system of the 3D body image is set. Store location information. Examples of the input means include the aforementioned input means. Next, in the measurement image acquired by the measurement image acquisition means, similarly, a reference point (P1 ′) is set at the lower sternum by the input means, and the measurement image in the coordinate system of the position information input means is set. The position information of the reference point (P1 ′) is calculated from the position information of the measurement position and stored. Then, the positional information of the reference point (P1) is associated with the positional information of the reference point (P1 '). Similarly, in the 3D body image, a reference point (P2) is set to the blood vessel branch by the input means, and the position information of the reference point (P2) in the coordinate system of the 3D body image is stored. Next, in the measurement image, similarly, a reference point (P2 ′) is set on the blood vessel branch by the input unit, and the position information of the measurement position of the measurement image in the coordinate system of the position information acquisition unit is The position information of the reference point (P2 ′) is calculated and stored. Then, the positional information of the reference point (P2) is associated with the positional information of the reference point (P2 '). In this way, the position information of the 3D body image and the position information of the measurement position of the measurement image can be associated in advance.

  Next, 3D body image extraction process S21 is implemented. In the 3D body image extraction step S21, for example, based on the position information of the corresponding region in the 3D body image, the region of the 3D body image corresponding to the measurement region of the measurement image is extracted as the extracted 3D body image.

  And needle image generation process S22, image superimposition process S30, and image display process S40 are implemented like the said Embodiment 1. FIG.

  Thus, according to this embodiment, since the relationship between the position information of the 3D body image and the position information of the measurement position of the measurement image is associated, the measurement image of the measurement image can be simply calculated from the 3D body image. The extracted 3D body image corresponding to the measurement region can be extracted.

<Cancer treatment device>
Next, the cancer treatment apparatus (hereinafter also referred to as “treatment apparatus”) of the present invention will be described. However, the present invention is not limited to the following examples. In the cancer treatment apparatus of the present invention, for example, the description of the image display apparatus of the present invention can be cited.

  In the present embodiment, for example, the description of the needle in the needle information acquisition unit or the like can be used for the needle. Moreover, the image display apparatus should just be the image display apparatus of the said this invention, for example, and can use the description.

  FIG. 6 is a schematic perspective view showing the configuration of the cancer treatment apparatus of this embodiment. In FIG. 6, a cancer treatment apparatus 900 according to this embodiment is shown in a region surrounded by a two-dot chain line. As shown in FIG. 6, the cancer treatment apparatus 900 of this embodiment includes a bipolar electrode 700 that is the needle, the voltage application apparatus (not shown), and the image display apparatus 100 as main components. In addition, the image display device 100 includes an ultrasonic measurement device 500 that is the measurement image acquisition unit and a position information acquisition device 600 that is the position information acquisition unit. The ultrasonic measurement device 500 moves the ultrasonic probe 510 to a position. The information acquisition device 600 includes a magnetic field generation device 610, a position sensor 620, and a position sensor 630, which are the reference position devices. In addition, the subject X is sleeping on the bed 800 in the supine position. As shown in FIG. 6, in the cancer treatment apparatus 900 of this embodiment, the image display apparatus 100 is electrically connected to the ultrasonic measurement apparatus 500, the position sensor 620, and the position sensor 630. The ultrasonic measurement device 500 is electrically connected to the ultrasonic probe 510. The position sensor 620 and the position sensor 630 are installed on the ultrasonic probe 510 and the bipolar electrode 700, respectively. In the present embodiment, although not shown, the three-dimensional body image acquisition device that is the three-dimensional image acquisition means and the needle information acquisition device that is the needle information acquisition means are the storage medium, and an image display device 100. Although not shown, the voltage application device is connected to the bipolar electrode 700 so that a voltage can be applied. In the present embodiment, the image display device 100 is connected to the ultrasonic measurement device 500 and the position sensor 620 in a wired manner, but is not limited to this, and may be connected wirelessly.

  In the cancer treatment apparatus of the present embodiment, the type of cancer to be treated is not particularly limited, and for example, liver cancer, kidney cancer, lung cancer, adrenal cancer, metastatic lymph node tumor, metastatic bone tumor And prostate cancer.

  In the cancer treatment apparatus 900 of the present embodiment, the needle is a bipolar electrode, but instead of this, for example, the treatment needle, the diagnostic needle, or the like may be used. When the diagnostic needle is used, the cancer treatment apparatus of the present invention can also be referred to as a diagnostic apparatus, for example. The organs, organs, tissues, and the like that are the targets of the diagnostic apparatus are not particularly limited, and examples thereof include liver, kidney, lung, bone, adrenal gland, lymph node, prostate, thyroid gland, muscle, pancreas, and the like.

  In the cancer treatment apparatus 900 of this embodiment, the number of bipolar electrodes 700 is one, but is not limited to this example. For example, the cancer to be treated can be treated three-dimensionally. It is preferable that there is a plurality. The plurality is not particularly limited. For example, since the bipolar electrode 700 can be arranged around the cancer to be treated, the cancer to be treated between the bipolar electrodes 700 can be effectively cauterized. Since the damage to other organs and the like can be suppressed and the burden on the subject can be reduced, for example, the number of the cancers to be treated between the bipolar electrodes 700 is three-dimensional and more effective. The number is preferably 3 because it can be cauterized, and damage to other organs can be suppressed and the burden on the subject can be further reduced.

  The voltage application device heats the needle, for example, by applying a voltage to the needle. The voltage application device is not particularly limited, and a known voltage application device can be used. The voltage applied by the voltage application device is not particularly limited, and can be determined as appropriate depending on, for example, the type of cancer to be treated.

  Next, a cancer treatment method using the cancer treatment apparatus 900 of the present embodiment will be described with reference to FIG.

  First, for example, by measuring the inside of the subject X with the ultrasonic probe 510 of the ultrasonic measurement device 500, the image display device 100 acquires the measurement image inside the body.

  The magnetic field generator 610 transmits a magnetic signal to 3D space, for example. The position sensors 620 and 630 detect the magnetic signal, for example. The position sensors 620 and 630 are, for example, based on the position of the ultrasonic probe 510 and the bipolar electrode 700 in the coordinates of the 3D space and the inclination, respectively, and the position information of the ultrasonic probe 510 and the position of the bipolar electrode 700. Information is calculated, and the image display apparatus 100 acquires the position information.

  The image display device 100 displays a superimposed image based on, for example, the 3D body image and the needle information acquired from the storage medium, the measurement image, the position information of the ultrasonic probe 510, and the position information of the bipolar electrode 700. Generated and displayed on the image display device 100.

  Next, while confirming the superimposed image displayed on the image display device 100, for example, the bipolar electrode 700 is moved into the body of the subject X, and the bipolar electrode 700 is placed in the cancer. And the said voltage application apparatus heats the bipolar electrode 700 by applying a voltage to the bipolar electrode 700, for example, and cauterizes the said cancer. Then, after the cauterization, for example, the bipolar electrode 700 is moved outside the body of the subject X while confirming the superimposed image displayed on the image display device 100.

  Thus, according to the present embodiment, since the tip of the needle in the body can be displayed on the image, for example, the position of the tip of the needle in the body of the subject is grasped three-dimensionally. This allows the needle to be placed at a desired position. According to the present embodiment, since the positional relationship between the organ and the needle is clear in the superimposed image, it is possible to sufficiently reduce the possibility of damaging other organs and the like when the needle moves. . In addition, according to the present embodiment, the generated needle image is generated based on the needle information and the position information of the needle described above. For example, even when a plurality of the needles are used, The tip of the needle can be displayed on the image, whereby a plurality of the needles can be arranged at a desired position. In addition, since a plurality of needles can be arranged at desired positions, for example, when a bipolar electrode is used as the needle, it is possible to perform treatment only in a necessary range. Therefore, according to the present embodiment, the burden on the subject can be reduced and effective treatment or diagnosis can be performed.

<Program and storage medium>
The program of the present invention is characterized in that the needle tip image display method for displaying the needle tip in the body of the present invention on an image can be executed on a computer. The computer-readable recording medium of the present invention stores the program of the present invention. In the program and storage medium of the present invention, for example, the description of the image display device of the present invention can be cited.

  ADVANTAGE OF THE INVENTION According to this invention, the needle tip image display apparatus which displays the needle tip in a body on an image can be provided.

DESCRIPTION OF SYMBOLS 1 Three-dimensional (3D) body image acquisition means 2 Measurement image acquisition means 3 Needle information acquisition means 4 Position information acquisition means 5 Three-dimensional (3D) body image extraction means 6 Needle image generation means 7 Image superimposition means 8 Image display means 9 Position Information conversion means 100, 200 Image display device 500 Ultrasonic measurement device 510 Ultrasonic probe 600 Position information acquisition device 610 Magnetic field generation device 620, 630 Position sensor 700 Bipolar electrode 900 Cancer treatment device

Claims (17)

3D body image acquisition means, measurement image acquisition means, needle information acquisition means, position information acquisition means, 3D body image extraction means, needle image generation means, image superimposition means and image display means,
The three-dimensional body image acquisition means acquires a three-dimensional body image of the subject,
The measurement image acquisition means acquires a measurement image in the body of the subject,
The needle information acquisition means acquires needle information,
The position information acquisition means acquires the position information of the measurement position of the measurement image and the position information of the needle;
The three-dimensional body image extracting means extracts a three-dimensional body image region corresponding to the measurement region of the measurement image as an extracted three-dimensional body image based on the position information of the measurement position of the measurement image,
The needle image generation means generates a generated needle image of an area corresponding to the measurement area of the measurement image based on the position information of the measurement position of the measurement image, the position information of the needle and the needle information,
The image superimposing means generates a superimposed image by superimposing the extracted three-dimensional body image, the measurement image, and the generated needle image;
The needle tip image display device for displaying the tip of the needle in the body on the image, wherein the image display means displays the superimposed image. Further, the image display device includes position information conversion means,
The position information conversion means converts the position information of the measurement region of the measurement image in the three-dimensional body image based on the relationship between the position information of the three-dimensional body image associated in advance and the position information of the measurement position of the measurement image. Convert it to location information of the corresponding area,
The three-dimensional body image extraction unit extracts a region of a three-dimensional body image corresponding to a measurement region of the measurement image as an extracted three-dimensional body image based on position information of a corresponding region in the three-dimensional body image. Item 2. A needle tip image display device for displaying the tip of a needle in the body on the image according to Item 1. The relationship between the positional information of the associated three-dimensional body image and the positional information of the measurement position of the measurement image is such that a reference point is set in the 3D body image and the measurement image, and the positional information of the reference point is associated. , The relationship between the positional information of the associated three-dimensional body image and the positional information of the measurement position of the measurement image,
The needle tip image displaying the needle tip in the body according to claim 2, wherein the reference point is at least one selected from the group consisting of a lower sternum, a xiphoid process, a vascular branch, and an occupying lesion. Display device. The needle tip in the body according to any one of claims 1 to 3, wherein the needle is at least one selected from the group consisting of a monopolar electrode, a bipolar electrode, a puncture needle, and a biopsy needle. Needle tip image display device to display on top. 5. The needle tip in the body according to claim 4, wherein the needle image generation unit generates a generated needle image in which a region corresponding to the electrode is displayed in a color different from other regions based on the needle information. Needle tip image display device to display on the screen. The three-dimensional body image is at least one selected from the group consisting of a nuclear magnetic resonance image (MRI) image, a computed tomography (CT) image, and a positron tomography (PET) image. The needle tip image display apparatus which displays the needle tip in the body according to any one of the above items on an image. The measurement image is a measurement image acquired by an ultrasonic measurement device,
The needle tip in the body according to any one of claims 1 to 6, wherein the position information of the measurement position of the measurement image is position information of an ultrasonic probe of the ultrasonic measurement device is displayed on the image. Needle tip image display device. Including a needle, a voltage application device and an image display device,
The voltage application device heats the needle by applying a voltage to the needle,
A cancer treatment device, wherein the image display device is a needle tip image display device that displays a needle tip inside the body on an image according to any one of claims 1 to 7. The cancer treatment apparatus according to claim 8, wherein the needle is a bipolar electrode. The cancer treatment apparatus according to claim 9, wherein the number of the bipolar electrodes is plural. A three-dimensional body image acquisition means for acquiring a three-dimensional body image of the subject;
A measurement image acquisition step, wherein the measurement image acquisition means acquires a measurement image in the body of the subject;
Needle information acquisition means for acquiring needle information, needle information acquisition step,
A position information acquisition step in which the position information acquisition means acquires the position information of the measurement position of the measurement image and the position information of the needle;
Three-dimensional body image extraction means for extracting, as an extracted three-dimensional body image, a three-dimensional body image region corresponding to the measurement region of the measurement image based on position information of the measurement position of the measurement image Process,
A needle image generation step in which a needle image generation unit generates a generated needle image of an area corresponding to the measurement area of the measurement image based on the position information of the measurement position of the measurement image, the position information of the needle, and the needle information;
The image superimposing means generates an superimposed image by superimposing the extracted three-dimensional body image, the measurement image, and the generated needle image, and the image display means displays an image displaying step of displaying the superimposed image. A needle tip image display method for displaying a needle tip in the body on an image, comprising: Further, the position information conversion means converts the position information of the measurement region of the measurement image into the three-dimensional body image based on the relationship between the position information of the three-dimensional body image associated in advance and the position information of the measurement position of the measurement image. Including a position information conversion step of converting into position information of a corresponding region in
In the three-dimensional body image extraction step, the three-dimensional body image extraction unit extracts a region of the three-dimensional body image corresponding to the measurement region of the measurement image based on position information of the corresponding region in the three-dimensional body image. The needle tip image display method for displaying a needle tip in the body on the image according to claim 11, which is a three-dimensional body image extraction step of extracting as a three-dimensional body image. The relationship between the positional information of the associated three-dimensional body image and the positional information of the measurement position of the measurement image is such that a reference point is set in the 3D body image and the measurement image, and the positional information of the reference point is associated. , The relationship between the positional information of the associated three-dimensional body image and the positional information of the measurement position of the measurement image,
The needle tip image displaying the needle tip in the body according to claim 12, wherein the reference point is at least one selected from the group consisting of a sternum lower end, a xiphoid process, a vascular branch, and an occupying lesion. Display method. The needle tip in the body according to any one of claims 11 to 13, wherein the needle is at least one selected from the group consisting of a monopolar electrode, a bipolar electrode, a puncture needle, and a biopsy needle. Needle tip image display method. In the needle image generation step, the needle image generation unit generates a generated needle image in which a region corresponding to the electrode is displayed in a color different from other regions based on the needle information. The needle tip image display method for displaying a needle tip in the body according to claim 14 on an image. The needle tip in the body according to any one of claims 11 to 15, wherein the three-dimensional body image is at least one selected from the group consisting of an MRI image, a CT image, and a PET image. How to display the needle tip image to be displayed. The measurement image is a measurement image acquired by an ultrasonic measurement device,
The needle tip in the body according to any one of claims 11 to 16, wherein the position information of the measurement position of the measurement image is position information of an ultrasonic probe of the ultrasonic measurement device. Needle tip image display method.

Images