JP2013022098A - Blood vessel visualization device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a blood vessel visualization device which eliminates operator's troublesomeness of separately looking at a display surface and an injection object part of a person to be treated, has no device arranged to obstruct treatment between the operator and the injection object part, and accurately and easily matches positions, sizes and angles among a (near) infrared image, a visible light image and a naked eye image.SOLUTION: The blood vessel visualization device is mounted on the head of an operator, and includes: a means for acquiring the (near) infrared image; a display means for displaying the acquired image; and a reference mark matching means for enabling simultaneous viewing of display and a substance by superimposing and simultaneously looking at a display image and the naked eye image by looking at a treatment part with naked eyes through the display surface of the display means, calculating the display image and outputting it so as to match the position, the size and the direction (angle) between the display image and the naked eye image through a reference mark on the treatment part.

Description

  The present invention relates to a blood vessel visualization device that allows medical personnel to see a blood vessel that is hidden under the skin and difficult to see when a needle is inserted by injection or infusion.

  Conventionally, in the medical field, when inserting an injection needle or a drip needle into a blood vessel of a patient, the blood vessel is normally inflated by winding a tourniquet around an arm or the like so that the blood vessel can be seen with the naked eye. However, blood vessels are difficult to see in many patients, such as infants, elderly people, and those with a lot of subcutaneous fat, and medical workers rely on the feeling of touching with their fingers to insert and remove the needle tip several times and conduct a search. Many things can be seen. Since there are nerves around the blood vessels, it is desirable to insert the needle once without damaging them.

Many proposals have been made for devices that perform blood vessel search from this point of view and assist needle insertion.
In Patent Document 1, light is emitted from a light emitting unit, and reflected light is received by a light receiving unit. In the reflection at the blood vessel portion, the reflected light intensity is reduced, so that the lamp is turned on when this is below the threshold value. I can see that there is a blood vessel at that point, but I don't know the width, direction, depth, etc. of the blood vessel. The troubles and uncertainties that occur while checking the lamp lighting and location at the time of injection are disadvantages.

In Patent Document 2, a light source and an infrared camera are arranged on the back surface of a display device, and an integrated configuration and a half mirror that reflects infrared light and transmits visible light as a light reflecting means are arranged, so that a display image and the naked eye are arranged. It is suggested to try combining images. In the former case, when the practitioner checks the treatment site with the naked eye, the display device provided with the light source and the infrared camera needs to be moved to another position, or the practitioner needs to move to a position where the treatment site can be seen. Viewing the display device with the line of sight removed from the treatment site leads to the uncertainty of the treatment. In the latter case, since the display image and the naked eye image appear to be synthesized, the former drawback is avoided, but a half mirror is arranged between the practitioner and the affected part of the patient, and the display device is located horizontally (see FIG. 2). 2) or between the half mirror and the practitioner (example of FIG. 3 of Patent Document 2), which is a hindrance to the practitioner.
Further, the reference for aligning the display image with the target object is the arm image, which is not a flat surface but a curved surface with a rounded cross section, so the size and the external shape are unclear. In particular, the position in the longitudinal direction of the arm is uncertain as to the position in the longitudinal direction because the arm whose thickness changes is seen. For this reason, it is difficult to match the blood vessel image with the naked eye image, and there is a drawback that the treatment with the anxiety is hidden because there is not enough confidence that the naked eye image and the blood vessel image match. There are also almost no wrinkles on the surface of the arm that can be used as a guide for alignment, so they are not available.
The wording “in patients with very thick arms and patients with thin arms” described in the fourth line from the bottom of paragraph number 0011 of Patent Document 2 assumes that the standard of size and position is other than the outline of the arm. The thickness of the arm, etc. indicates that it is difficult to be a reliable reference, and in addition to the position of the naked eye image and blood vessel image, it becomes a problem in matching with magnification, and the distance It is written to measure and adjust.

Patent Document 3 discloses an apparatus that displays a blood vessel image with near-infrared light and a syringe image with visible light, and displays the tip position of the punctured needle at the blood vessel position to be synthesized and displayed. Although it is a good point that the tip that is not visible with visible light of the needle inside the blood vessel is displayed by calculation, it has the following drawbacks. As shown in paragraphs 0079 to 0081 of Patent Document 3, first, in order to obtain the tip of the needle by calculation, the length of the needle is once adjusted with the injection needle brought near the blood vessel before being inserted into the blood vessel. In order to take a desired image, a button is pressed to perform a calibration operation. For example, the left hand is lightly attached to the patient's arm, the syringe is moved closer to the patient's arm with the right hand, and the button is pressed. Thereafter, as a normal mode, the syringe is released (no syringe) and a near-infrared blood vessel image is taken. After that, if you switch between visible light and near-infrared light alternately and move the injection needle to be inserted, the tip position of the needle will be shown on the blood vessel image that was previously taken, so you can see the positional relationship. insert. The displayed blood vessel image is the first photographed image, and the needle focuses on showing the tip position. Since the actual arm and needle are usually moved from the initial position, this difference in movement is adjusted by detecting the motion vector, so the positional relationship between the blood vessel and the needle tip there is no problem. However, first, the procedure leading to the injection is complicated and troublesome, and it is a feature that does not require much effort in implementation. In addition, even when the injection needle is combined with the blood vessel image, there is a problem in alignment accuracy because only the shape of the arm is used to adjust the position and magnification. In addition, the positional relationship between the blood vessel image on the display surface and the injection needle is searched (without looking at the actual relationship between the needle and the arm), and the operation is not practical and takes a long time to search. In this technique, since it is important to correct that the needle and arm later move, it is essential to take a motion vector.
This is because the display image does not indicate an image taken every time in real time.
Furthermore, it is troublesome to attach and detach this device (FIGS. 2 and 3 of Patent Document 3) for each patient, and the contact surface becomes dirty due to use, which is unsanitary. From the practitioner's point of view, there is something that interferes with the treatment between the patient's arm and the practitioner. Further, there are many drawbacks such as troublesome operations such as viewing the display surface, viewing the actual arm surface, and moving the line of sight.

Patent Document 4 proposes a blood vessel visual recognition system comprising an infrared image input means, an image display means for displaying the image, a fixing means for fixing the display means to the practitioner's head, and a means for controlling the display of image data. Yes. Among them, the head mount indicator corresponds to one eye, and the other eye sees the treatment surface with the naked eye. This is preferable in that the treatment can be performed while comparing the display image and the macroscopic image of the treatment surface in the same viewing direction. However, unlike seeing through the real image from the display surface, the right eye and the left eye share the display surface and the treatment surface, so the observation angle is different and the images of both eyes do not essentially match. In addition, it is inconvenient to apply the injection needle because the stereoscopic effect (depth and depth) cannot be grasped by monocular vision during the treatment. As with other documents, there is no correction standard for the position, magnification, and angle between the infrared image and other images, here, the naked eye image. It can be said that it is a rough combination for a device that keeps human health and life. This is the same in other examples, but since the photographic image is shown in this document, this situation is easy to understand. FIG. 6 of Patent Document 4 is an image of blood vessels and arms by an infrared image as shown below. Yes, FIG. 7 is an image of the arm when viewed with the naked eye. What can be understood by comparing the two is that the infrared display image must have a position, a magnification, an angle, and the like as seen with the naked eye. If they are uncertain, they are looking at different positions, sizes, and angles with both eyes, and only confirmation is performed using a common medium called a needle, which is inconvenient in terms of confirmation accuracy and time required for alignment. However, when the images of both arms are compared, the outline is blurred and it is not known at all whether the longitudinal direction of the arms matches. The contours look like this because the arms are not flat and the camera is out of focus, and the longitudinal direction originally has no signs of character, so it's impossible to tell if both images are present. The relative relationship can be understood only after adding the injection needle here, and it can be said that the alignment of the position and the like was extremely rough. This point is the same as Patent Document 4 regarding Patent Document 1 to Patent Document 3 and other prior documents.

JP 7-255847 A JP 2004-267534 A JP 2006-130201 A JP 2009-89876 A

The problem of the present invention is that the practitioner does not have the trouble of separately viewing the display surface and the injection target portion of the treatment subject, and therefore has a certainty of treatment in a short time, and between the practitioner and the injection target portion. It does not result in an arrangement that interferes with the procedure, and the procedure of the procedure is complicated and does not require time and effort, and the position and size between the (near) infrared light image, visible light image, and naked eye image. It is an object of the present invention to provide a blood vessel visualization device that avoids the fact that the angle adjustment is rough and the adjustment labor and accuracy are inconvenient.

  The blood vessel visualization device of the present invention is mounted on a practitioner's head, acquires a (near) infrared light image (a visible light image may be added), display means for displaying the acquired image, and display Through the display surface of the means, by viewing the treatment part that has taken the image of the subject with the naked eye, it is possible to simultaneously superimpose the display image and the naked eye image of the entity, and the reference on the treatment part Reference mark alignment means for calculating and outputting the display image so that the position, size, and orientation (angle) are matched between the display image and the naked eye via the mark is provided.

The invention according to claim 1 is a blood vessel visualization device,
An illumination light source that irradiates infrared rays toward the treatment site of the person to be treated, an image acquisition unit that obtains reflected light including a blood vessel image of the treatment portion reflected from the treatment portion by light of the illumination light source, and processes the image An image processor, a head-mounted fluoroscopic display capable of displaying the image output of the image processor on a display surface, and viewing the display surface through the display surface, and performing these operations. The image processing unit includes an image operation unit including an image matching unit and an image memory for storing image data, and the image matching unit is configured to perform the treatment obtained from the image acquisition unit. The position and size of the display image so that the display image when the image of the part is displayed on the fluoroscopic display matches the macroscopic image that the practitioner sees the surgical part through the fluoroscopic display Create an image with the orientation adjusted And butterflies.

The invention according to claim 2 is the blood vessel visualization device according to claim 1,
The image aligning means includes a fiducial mark displayed on the display surface of the fluoroscopic display with a reference mark that is provided in the surgical section and is recognizable by reflecting or absorbing at least visible light from the surgical section. A reference mark aligning means for aligning the reference mark displayed on the display surface and the image of the treatment section including the blood vessel image so as to match a reference mark obtained by visual inspection through a vessel. To do.

According to a third aspect of the present invention, in the blood vessel visualization device according to the first or second aspect, the reference mark includes at least one of a person to be treated or a recognition sign of the person to be treated.

According to a fourth aspect of the present invention, in the blood vessel visualization device according to any one of the first to third aspects, is the reference mark provided in the treatment section a mark seal that can be attached and removed? Alternatively, it is a mark light pattern that is light-projected by providing the blood vessel visualization device with a mark projector.

According to a fifth aspect of the present invention, in the blood vessel visualization device according to any one of the first to fourth aspects, the image matching unit stores the correction value of the adjustment in a numerical table of the image memory, The image processing device applies the correction value to the image data acquired by the image acquisition device, processes the correction value, and enables display on the fluoroscopic display device.

According to a sixth aspect of the present invention, in the blood vessel visualization device according to any one of the first to fifth aspects, the image alignment means is configured to look at the size of the reference mark obtained by the image acquisition unit. The display image can be automatically adjusted based on the data for the size of the reference mark based on the difference in distance from the treatment section stored in advance in the numerical table of the image memory.

The invention according to claim 7 is the blood vessel visualization device according to any one of claims 1 to 6, wherein the image alignment unit has an external correction input for the adjustment, and the correction value is It can be stored in a numerical table of an image memory.

The invention according to claim 8 is the blood vessel visualization device according to any one of claims 1 to 7, wherein the fluoroscopic display includes an image display unit that displays an image on the display surface and a back side of the display surface. The transmission window portions that transmit the reflected light of the object in the screen are alternately distributed on the display surface, so that the display image and the perspective image on the back surface overlap when viewed from the front side of the display surface. It is characterized by making it visible.

According to a ninth aspect of the present invention, in the blood vessel visualization device according to any one of the first to eighth aspects, the image display unit and the transmission window unit are exchanged for each frame of a video or for each of a plurality of frames. It is characterized by.

A tenth aspect of the present invention is the blood vessel visualization device according to any one of the first to ninth aspects, wherein a diffuse reflector is placed on the back side of the display surface of the fluoroscopic display (the side where the treatment portion is present). Then, once the visible light from the treatment part is received by this irregular reflector, the light transmitted through the irregular reflector can be seen through the fluoroscopic display.

The invention according to claim 11 is the blood vessel visualization device according to any one of claims 1 to 10, wherein the treatment section is stored as an image file by distinguishing the subject as a blood vessel image of the subject. The image is collated with data of the same part of the person to be treated at the time of the next treatment, thereby outputting a result of collation that prevents the patient from being mistaken in advance.

Since it is configured as described above, in the blood vessel visualization device of the present invention,
There is no need for the practitioner to look at the display surface and the treatment area of the treatment person separately, so that the treatment can be performed in a short time, and the treatment is reliable, and the treatment is not disturbed between the practitioner and the treatment area. There is no device to be arranged, the procedure of the procedure is complicated and there is no troublesome time, and the position, size, orientation, etc. are aligned between the displayed blood vessel image from the acquired image and the macroscopic image of the treatment part Observe and perform treatment with confidence quickly.
The result can also be left as an image. When a number for identifying a patient is entered in the reference mark, there is an advantage that tracing can be performed later.

It is a figure which shows one embodiment of the blood vessel visualization apparatus by this invention. It is a figure explaining one embodiment of the reference mark matching of the blood vessel visualization apparatus by this invention. It is a figure which shows the example of the image of the treatment scene of the blood vessel visualization apparatus by this invention.

In the blood vessel visualization device according to the present invention, an illumination light source that irradiates infrared rays toward a treatment portion of a patient, an image acquisition device that obtains reflected light reflected from the treatment portion with the light of the illumination light source, and processes the image Head mounted fluoroscopic display capable of displaying image processing device and image output of image processing device on display surface, and viewing treatment surface by seeing through the display surface, and controller for controlling these operations In the image processing device, the fiducial mark provided in the treatment section included in the image obtained from the image acquisition device and displayed on the display surface of the fluoroscopic display device is obtained visually through the fluoroscopic display device. By aligning to match the fiducial mark to be obtained, it is possible to align the image of the surgical part including the blood vessel image including this fiducial mark obtained by image acquisition, and see the display image and the visual image in agreement with each other Blood vessel visualization device There will now be described in the Examples.

FIG. 1 is a diagram showing an embodiment of a blood vessel visualization device according to the present invention.
1-A shows a blood vessel visualization device 100, a treatment portion 101 (here, an arm) and a treatment tool 102 (here, a syringe) of a patient. The blood vessel visualization device 100 is mounted on the head 103 of a practitioner (doctor or nurse), and illuminates a light source 104 that emits infrared light, preferably near infrared light (wavelength 760 to 2000 nm). (A visible light source may also be included if necessary), an image acquisition unit 105 that captures the reflected light of the light treatment unit 101 as an image, an image processing unit 106 that processes this image, and an image processing unit 106 It has a head mounted fluoroscopic display 107 capable of displaying an image output on a display surface and seeing through the display surface and viewing the treatment portion, and a controller 108 for controlling these operations, The processing device 106
The image calculation unit 109 and the image memory 112 include an image matching unit 110, and the image matching unit 110 displays the image on the display surface of the fluoroscopic display 107 (from the image acquisition unit 105). The image of the surgical part including the blood vessel image obtained by the image acquisition is obtained by aligning the obtained surgical part image with the (visual) surgical part image obtained visually through the fluoroscopic display 107. Thus, it is possible to perform the treatment while the display image and the visual image are matched.
Further, the image alignment means 110 aligns the reference mark provided in the treatment part included in the image displayed on the display surface so as to match the reference mark obtained by visual inspection through the fluoroscopic display, It is a preferable feature that it is a reference mark aligning means for aligning an image of a treatment portion including a blood vessel image including the reference mark obtained by image acquisition.

1-B shows a block diagram of a configuration example of the blood vessel visualization device according to the present invention. The operation will be described using this. As the illumination light source 104, there is at least an infrared light lamp 104 </ b> A, preferably a near infrared light (wavelength 760 to 2000 nm) lamp, which is applied to the treatment portion 101 of the patient. The treatment unit 101 reflects the irradiation light and is acquired as an image by the image acquisition unit 105. The image acquisition unit 105 is a camera having sensitivity to at least infrared light or infrared light transmission that transmits infrared light. It has a camera with a filter.
The reflected light from the treatment part 101 of the infrared light lamp or the near-infrared light lamp is darker because the portion with blood vessels is absorbed compared to the other part without blood vessels, and is inside the skin of the treatment portion 101. A certain blood vessel image can be obtained. When the reference mark can be identified by infrared light or near-infrared light (has reflection or absorption), a clear reference mark and blood vessel image can be obtained on the treatment portion 101 having a blurred outline in the obtained image. .
In addition, when a visible light camera is added to the image acquisition unit 105, it is better to switch between an infrared light transmission filter and a visible light transmission filter at a high speed with one camera, rather than providing each, The scale, orientation, etc. are consistent and convenient.
In the case where no visible light camera is added, it is necessary to be able to be identified by both infrared light and visible light (having reflection or absorption) considering that the reference mark can be identified with the naked eye. When a visible light camera is added, an infrared light image with a blood vessel image and a visible light camera image (approximately the same as the naked eye image) are obtained, and the reference mark is also reflected in the visible light camera image. . If a visible light image and an infrared light image are taken with a single camera, the two images are matched, so they are superimposed and integrated as they are, and the display image is easy to see. In this case, it is only necessary to identify the reference mark with visible light (having reflection or absorption). And since it can be seen with the naked eye, it is sufficient that the reference mark can be identified with visible light (having reflection or absorption) at a minimum. Thus, although a visible light camera is not essential, there are advantages in that an image close to the naked eye can be taken and the display can be easily seen, and the reference mark only needs to be identified with visible light.

The image obtained by the image acquisition unit 105 is processed by the image processing unit 106 and is displayed on the fluoroscopic display unit 107 that can see through the display surface and visually observe the treatment part. In this case, in the image processor 106, the image calculation unit 109 in the image processing unit 109 includes the image matching unit 110 and the image processing unit 111. When displaying the image of the treated part on the fluoroscopic display 107, the position and size (scale) of the image are set in order for the practitioner to see through the fluoroscopic display 107 and match the macroscopic image of the surgical part. Then, an image in which the orientation is adjusted is created, or a numerical value to be corrected is determined, stored in the image memory 112, and displayed on the fluoroscopic display 107. As an example of the operation of the image aligning means 110, an infrared light image or a visible light image of the treatment portion may be matched with a naked eye image seen through the fluoroscopic display 107, but as described above, the treatment portion is like an arm. Since the outline is unclear, the clear image of the mark and the fluoroscopic display are temporarily placed on the treatment part with the normal space between the blood vessel visualization device mounted on the practitioner and the treatment part. The position, size (scale), and orientation are adjusted so that the images of the landmarks seen through the eyes 107 coincide with each other, and the correction values are stored in the numerical table of the image memory 112. If so, since it is often used in the same state with the patient, it can always be corrected by applying this numerical value. In this case, the correction numerical value input may include a distance and a prescribed value obtained from the theoretical calculation of the camera image system, but it is convenient if the adjustment input 113 is provided so that the numerical value can be adjusted from the outside. However, such a temporary correction can be made accurately, but there is no guarantee that the correction is still present even after several uses after the correction. There are still shortcomings that you don't know until you see the part or just hit the needle.

Correspondingly, as the most suitable one of the present application, a reference mark 114 is attached to the treatment part and an image is acquired by the image acquisition unit 105, and the image alignment unit 110 correspondingly corresponds to the fluoroscopic display 107. An image is created by adjusting the position, size (scale), and orientation of the image so that the image of the reference mark 114 displayed on the image and the image of the reference mark 114 with the naked eye seen through the fluoroscopic display 107 are matched. There is one that is stored in the memory 112 or that determines a numerical value to be corrected and stores it in a numerical table of the image memory 112 and displays it on the fluoroscopic display 107. The reference mark 114 attached to the treatment unit 101 may be a seal that is attached to and removed from the treatment unit 101 for each treatment, such as a mark seal 115a, but most preferably, the mark light is projected as a configuration of the blood vessel visualization device. A mark projector 115b. In this way, during the treatment (while the practitioner is looking at the treatment portion through the blood vessel visualization device), the image of the mark light is present in the treatment portion. It can be confirmed that the image of the mark light displayed on 107 coincides, and the blood vessel image and the mark position can be observed with certainty before the needle is applied, and the treatment can be performed. In the case of the mark projector 115b, there is no need to worry about contamination and dirt because there is no need for a sticking / peeling operation like the mark seal 115a, and there is no contact portion. In the mark projector 115b, it is preferable that the light does not diverge (do not spread) so that the size does not change depending on the distance from the treatment unit 101. For this reason, a collimator lens is used to place a light source at the focal point to produce a parallel light beam, or a laser light source can be used because there is little light divergence.
The reference mark 114 is a reference standard for adjusting the position, size (scale), and orientation of the image acquired by the image acquirer 105. I can not cope. This is because the circle is symmetric in any direction. However, it is convenient as a reference mark because it can correspond to a direction with two points even in the shape of a circle.
If the shape is not symmetrical even at one point, it can correspond to the direction and becomes a reference mark. For example, triangles and crosses can be used.
If an identification symbol 116 for identifying the person to be treated is placed on the reference mark 114, it is possible to trace the image when it is applied to the person when the treatment record image is viewed later. The trace image can be filed in recorded data for each patient such as a patient file.
The mark projector 115b uses a liquid crystal display, and a reference mark 114 and an identification symbol 116 previously stored in the image memory can be displayed on the mark projector 115b, and parallel images can be irradiated to project these images onto the treatment section. It is also possible to share a part of the fluoroscopic display 107 with the same usage.

In the matching of the image matching unit 110, the numerical values entered in the numerical value table may include distances and specified values obtained from the theoretical calculation of the camera image system, but if there is an adjustment input 113 so that the numerical values can be adjusted from the outside. As mentioned above, it is convenient. Whether the reference mark is present or not, considering that the operator's hand is blocked, the adjustment input 113 preferably has a configuration that does not use a hand, such as a foot switch. Up / down / left / right movement (position), scale (size), direction (tilt angle) are corrected by the switch and the number of steps and the time of stepping, and the reference mark image data is corrected (for example, pressing the right turn switch once) And the like, and the final correction value is stored in a numerical value table. In particular, when the correction input is fixed without moving, the same data is applied every time. Since the practitioner can always see the fiducial mark and the fiducial mark on the image, there is no concern. It is only necessary to adjust when there is an accidental shift.
In addition, when the distance between the practitioner and the treatment site is large, both the image taken with the camera and the naked eye image are small, but there is a certain relationship between the distance and the size of the image. If a correction numerical value is obtained from the size of the mark or actually adjusted to enter a numerical value table, the correction can be automatically made with reference to this data.

The image processing unit 111 is a commonly-known image processing unit and is convenient if not necessary. In order to make it easy to see the blood vessel image of the image acquired by the image acquisition unit 105, processing to increase the contrast or colorization (infrared light image itself is black and white, for example, the blood vessel image is made red). Or contour emphasis processing (to make the contour darker or black) to clarify the contour of the blood vessel image, or to adjust the contrast of the naked eye image and display image viewed through the fluoroscopic display 107 in an easy-to-see manner, or The obtained image can be displayed in a transparent manner, and many commercially available programs can be used.

The controller 108 controls the operation of the illumination light source 104, the image acquisition unit 105, the image processing unit 106, the fluoroscopic display unit 107 (including the mark projector 115b, if any), Has a processing program.
Although the power supply is not shown, it is assumed that it is included as a device.

The fluoroscopic display 107 has an image display portion and a transmission window portion through which reflected light of an object on the back side of the display surface is alternately distributed on the display plane, so that it can be viewed from the front side of the display surface. In this case, the display image and the transparent image on the back surface can be seen overlapping. In addition, it is possible to apply an image processing such as α blending so that the display portion itself can be transparently displayed so that it can be seen through from here, and a transparent window is not specially formed. As an example of the former, a suitable transmissive window always transmits light, and a display unit is arranged around it, which is alternately repeated. For example, when a liquid crystal display is used, the liquid crystal electrode interferes with the transmissive window. It is possible to use a structure in which the transparent window is arranged using a conductive transparent film such as an ITO film or the like so as not to become distorted. Further, the display pixels of the liquid crystal are divided into a display portion and a transmission window portion, which are configured by alternately arranged portions. The display unit displays an image. The transmissive window is in a state where the liquid crystal pixels are always fully open so that the light on the back side passes. For example, this may be as follows. Corresponding to one screen of the image memory, a white portion for alternately inserting a display data portion and complete white data is created. The image replaces only the data part. The white part is not always changed.
When this is displayed on the liquid crystal display, the data portion becomes the display portion, and the white portion is in a state where the switch is fully opened and the transmitted light from the back is completely passed.
In this way, a transmissive display 107 can be realized by using a transmissive liquid crystal (in this case, the meaning is different from the transmissive window (meaning that the back side can be seen through) in the sense that the backlight is transmitted). In addition, the data part and the white part are exchanged for each frame or a plurality of frames (for example, in the case of 30 frames / second for normal image broadcasting, 15 frames per second, the data part and the white part for each frame). Since the screen with the exchanged can be alternated, the display and the fluoroscopic image of the naked eye appear to overlap the entire display surface to the eyes. Even if it corresponds to a window, it can be made easy to see by making the data pixel only the part where it is outlined.

FIG. 2 is a diagram illustrating an embodiment of fiducial mark alignment of the blood vessel visualization device according to the present invention. (A) shows a (near) infrared camera image, and shows a blood vessel image 201 and a reference mark 202a (when there is absorption or reflection so that it can be recognized by infrared light). In (b), it is a visible light image at the time of providing a visible light camera, and the reference mark 202b is reflected on the surface of the treatment part. When there is no visible light camera, there is no image of (b).
When both cameras are supported by a single camera, both images have a relationship of position, size, and orientation. (C) is an image obtained by combining the two. (D) is the image of the naked eye of the treatment part seen through the fluoroscopic display 107. FIG. In (c) and (d), the positions, scales (sizes), and orientations of the reference marks are different, so that they are greatly shifted for easy understanding. Originally, the fiducial mark is the same because it looks at one thing. (E) shows the result of alignment by the image alignment unit 110 as the reference mark alignment unit that aligns via the reference mark. The image of (c) is aligned so that the reference mark matches the reference mark of the naked eye image (d). The fiducial mark and blood vessel image can be seen with the position, size, and orientation as they appear, and (f) shows an image in which a syringe is inserted and treatment is performed. This image can be stored as an image file by distinguishing the patient or the operator by performing image storage. As described above, if the reference mark of the patient or practitioner is included in the reference mark, this can be reliably performed.

Note that the image displayed on the fluoroscopic display 107 can also be displayed on the external display monitor 117.
It is preferable that at least the fluoroscopic display 107 is mounted on the practitioner's head. However, it is preferable that the illuminating light source 104, the image acquisition unit 105, the mark projector 115b, and the like be moved together with the practitioner. A similarly mounted configuration, particularly an integrated configuration is preferred.
Of course, it is most preferred that everything is mounted in an integral configuration.
Finally, FIG. 3 shows an example of an operation scene image of the blood vessel visualization device according to the present invention.
There is nothing interfering with the treatment part between the treatment part and the practitioner, and the practitioner sees only the treatment part through the fluoroscopy indicator and sees the reference mark (image), blood vessel image and injection needle. Can be treated.

Place a diffuse reflector on the back side of the display surface of the fluoroscopic display (the side with the treatment area), receive the visible light coming from the treatment area with this irregular reflector, and transmit the light that passes through it through the fluoroscopic display. It is also possible to see it. In this case, it is possible to see through the same image as the treatment part image on the irregular reflector.

The treatment part image acquired by this blood vessel visualization device is stored as an image file by distinguishing the treatment person or the treatment person as a blood vessel image of the treatment person, so this data is referred to or shared between treatment persons at the next treatment. Can also be used. In addition, by attaching information such as which part of the user's data to this data, the previous data and the current data stored in the image file are automatically used when performing the same part of the patient. By collating, it becomes possible to output (display, alarm, etc.) a collation result for preventing a patient from being mistaken.

  As described above, the blood vessel visualization device according to the present invention can perform a procedure because a blood vessel image can be observed at the same time in a state in which the reference mark of the treatment portion and the reference mark of the display surface are aligned through the fluoroscopic display. There is no need to see the treatment surface separately, there is no obstacle to the treatment, and the treatment can be performed with peace of mind while always seeing the treatment surface, so the industrial applicability is extremely high.

DESCRIPTION OF SYMBOLS 100 Blood vessel visualization apparatus 101 The treatment part 102 The treatment tool 103 The head 104 Illumination light source 105 The image acquisition device 106 The image processing device 107 The fluoroscopic display 108 The controller 109 The image calculation part 110 The image matching means 111 The image processing means 112 The image memory 113 The adjustment input 114 , 202a, 202b, 202d Reference mark 115a Mark sticker 115b Mark projector 116 Identification symbol 117 External display monitor

Claims (11)

An illumination light source that irradiates infrared rays toward the treatment site of the person to be treated, an image acquisition unit that obtains reflected light including a blood vessel image of the treatment portion reflected from the treatment portion by light of the illumination light source, and processes the image An image processor, a head-mounted fluoroscopic display capable of displaying the image output of the image processor on a display surface, and viewing the display surface through the display surface, and performing these operations. The image processing unit includes an image operation unit including an image matching unit and an image memory for storing image data, and the image matching unit is configured to perform the treatment obtained from the image acquisition unit. The position and size of the display image so that the display image when the image of the part is displayed on the fluoroscopic display matches the macroscopic image that the practitioner sees the surgical part through the fluoroscopic display Create an image with the orientation adjusted Vascular visualization device according to symptoms. The image aligning means includes a fiducial mark displayed on the display surface of the fluoroscopic display with a reference mark that is provided in the surgical section and is recognizable by reflecting or absorbing at least visible light from the surgical section. A reference mark aligning means for aligning the reference mark displayed on the display surface and the image of the treatment section including the blood vessel image so as to match a reference mark obtained by visual inspection through a vessel. The blood vessel visualization device according to claim 1. The blood vessel visualization device according to claim 1, wherein the reference mark includes at least one of a person to be treated or a recognition symbol of the person to be treated. The reference mark provided in the treatment section is a mark sticker that can be attached and removed, or a mark light pattern that is light-projected by providing a mark projector in the blood vessel visualization device. The blood vessel visualization device according to any one of claims 1 to 3. The image alignment unit stores the correction value of the adjustment in a numerical table of the image memory, the image processor applies the correction value to the image data acquired by the image acquirer, processes the image, and the perspective display The blood vessel visualization device according to any one of claims 1 to 4, wherein the blood vessel visualization is possible. The image matching means looks at the size of the reference mark obtained by the image acquisition unit, and uses the data for the size of the reference mark due to the difference in distance from the treatment portion stored in the numerical table of the image memory in advance. The blood vessel visualization device according to any one of claims 1 to 5, wherein the display image can be automatically adjusted based on the display image. 7. The image alignment unit according to claim 1, wherein the image matching unit has an external correction input for the adjustment, and the correction value can be stored in a numerical table of the image memory. The blood vessel visualization device described. In the fluoroscopic display, an image display unit that displays an image on the display surface and a transmission window portion that transmits reflected light of an object on the back side of the display surface are alternately distributed on the display surface. The blood vessel visualization device according to any one of claims 1 to 7, wherein when viewed from the front side of the display surface, the display image and the perspective image of the back surface are seen to overlap each other. The blood vessel visualization device according to any one of claims 1 to 8, wherein the image display unit and the transmission window unit are exchanged for each frame of a video or for each of a plurality of frames. A diffuse reflector is placed on the back side of the display surface of the fluoroscopic display (the side where the treatment portion is located), and the diffuse reflector once receives visible light from the treatment portion and transmits the light transmitted through the diffuse reflector. The blood vessel visualization device according to any one of claims 1 to 9, wherein the blood vessel display device can be viewed through the fluoroscopic display. The treatment portion image stored as an image file by distinguishing the treatment subject as a blood vessel image of the treatment subject is compared with data of the same portion of the treatment subject at the time of the next treatment, so that the treatment subject is mistaken. The blood vessel visualization device according to any one of claims 1 to 10, wherein a collation result to be prevented is output.

Images