WO2012117721A1

WO2012117721A1 - Three-dimensional image display device and three-dimensional image display method

Info

Publication number: WO2012117721A1
Application number: PCT/JP2012/001345
Authority: WO
Inventors: 弘毅中山
Original assignee: 富士フイルム株式会社
Priority date: 2011-02-28
Filing date: 2012-02-28
Publication date: 2012-09-07
Also published as: JP2012179125A

Abstract

[Problem] To enable an observer to recognize whether or not a three-dimensional cursor is indicating an intended target in a three-dimensional image display device. [Solution] The three-dimensional image display device is provided with: a display unit that displays a three-dimensionally viewable three-dimensional image using a left-eye radiation image and a right eye radiation image acquired by means of radiating radiation towards a subject from differing imaging directions; and a three-dimensional cursor display control unit that, using a left-eye cursor image and a right-eye cursor image, causes the display unit to display a three-dimensional cursor that can be moved in an in-plane direction and a depth direction of a three-dimensional image displayed by the display unit. The three-dimensional image display device detects pixel values for pixels indicating the left-eye cursor image in the left-eye radiation image and pixel values for pixels indicating the right-eye cursor image in the right-eye radiation image, and displays the detected pixel values at the display unit at which the three-dimensional image is displayed.

Description

Stereoscopic image display device and stereoscopic image display method

The present invention relates to a stereoscopic image display device that detects a radiographic image for each imaging direction by irradiating a subject with radiation from two different imaging directions, and displays a stereoscopic image using the two detected radiographic images. The present invention relates to a stereoscopic image display method.

Conventionally, it is known that stereoscopic viewing can be performed using parallax by displaying a combination of a plurality of images. Such a stereoscopically viewable image (hereinafter referred to as a stereoscopic image or a stereo image) is generated based on a plurality of images with parallax obtained by photographing the same subject from different directions. Such stereoscopic image generation is used not only in the fields of digital cameras and televisions but also in the field of radiographic imaging. That is, the patient is irradiated with radiation from different directions, the radiation transmitted through the subject is detected by a radiation image detector, and a plurality of radiation images having parallax are obtained, and these radiations are acquired. A stereoscopic image is generated based on the image. By generating a stereoscopic image in this way, the observer can observe a radiological image with a sense of depth, which is more suitable for diagnosis. A radiographic image can be observed.

On the other hand, tissue specimens around the lesion may be collected in hospital examinations. Recently, as a method of collecting tissue pieces without imposing a heavy burden on the patient, a hollow tissue sampling needle (hereinafter referred to as a living tissue) is used. A biopsy that punctures a patient (referred to as a meter reading) and collects tissue embedded in the needle cavity has attracted attention. A stereo biopsy device has been proposed as a device for performing such a biopsy.

This stereo biopsy device irradiates a subject with radiation from two different imaging directions, detects the irradiated radiation with a radiation detector, and obtains a radiation image with a parallax, and these two radiation images A stereo image is displayed using, and a desired position, in particular, a position displayed in white due to calcification in a radiographic image of a breast is indicated by a three-dimensional target while observing the stereo image. A tissue piece is collected from a desired position by acquiring three-dimensional position coordinates using the two radiation images for the indicated position. Patent Document 1 proposes a technique for acquiring a three-dimensional coordinate position of a target using a radiation image having parallax with a convergence angle of about 30 °.

JP 2010-75316 A JP 2007-275196 A JP 2007-000250 A Japanese Patent Laying-Open No. 2005-073817

However, in a stereoscopic image display device, particularly in a perspective image such as a radiographic image, a stereoscopic cursor for designating a target is displayed in a subject image overlapping in the depth direction. It is extremely difficult to recognize the position of the three-dimensional cursor in the depth direction, and it is difficult for an observer to confirm whether the three-dimensional cursor correctly indicates the intended target.

Patent Documents 2 to 4 disclose that a pixel value of a pixel selected by a user is displayed on a monitor, but there is no description regarding a three-dimensional cursor.

The present invention has been made in view of the above circumstances, and provides a stereoscopic image display device and a stereoscopic image display method by which an observer can confirm whether or not a stereoscopic cursor indicates an intended target. It is intended.

The stereoscopic image display apparatus of the present invention displays a stereoscopic image that can be stereoscopically viewed using a left-eye radiological image and a right-eye radiographic image acquired by irradiating a subject with radiation from different imaging directions. When,
A stereoscopic cursor display control unit for displaying a stereoscopic cursor movable in the depth direction and in-plane direction of the stereoscopic image displayed on the display unit using the left-eye cursor image and the right-eye cursor image;
A pixel value detection unit that detects a pixel value of a pixel indicated by the left-eye cursor image in the left-eye radiographic image and a pixel value indicated by the right-eye cursor image in the right-eye radiographic image;
And a pixel value display control unit configured to display the pixel value detected by the pixel value detection unit on the display unit on which the stereoscopic image is displayed.

Here, the “stereoscopic image” means an image that allows the observer to recognize the stereoscopic effect of the subject.
Further, the pixels indicated by the left-eye cursor image and the right-eye cursor image are, for example, the pixel indicated by the tip of the arrow when the cursor image has an arrow shape, and when the cursor image is a rectangle. Means a pixel in which rectangles overlap. In addition, when the cursor image has a cross shape, it means a pixel indicated by the center. In this manner, the pixels shown above can be different depending on the shape of the cursor image, and these can be arbitrarily changed by the observer.

In the stereoscopic image display device of the present invention, the pixel value detected by the pixel value detection unit in the left-eye radiographic image and the pixel value detected by the pixel value detection unit in the right-eye radiographic image are set in advance. A warning output unit may be provided that issues a warning when the distance is more than the threshold value.

In the stereoscopic image display apparatus of the present invention, the pixel value display control unit replaces the pixel value detected by the pixel value detection unit with the pixel value detected by the pixel value detection unit in the left-eye radiographic image. You may display the total value of the pixel value detected by the pixel value detection part in the radiographic image for right eyes.

In the stereoscopic image display apparatus of the present invention, the pixel value display control unit replaces the pixel value detected by the pixel value detection unit with the pixel value detected by the pixel value detection unit in the left-eye radiographic image. The average value of the pixel values around the pixel indicating the pixel value, the pixel value detected by the pixel value detection unit in the radiographic image for the right eye, and the pixel values of the pixels around the pixel indicating the pixel value May be displayed.

In the stereoscopic image display device of the present invention, the pixel value display control unit replaces the pixel value detected by the pixel value detection unit with the pixel value detected by the pixel value detection unit in the left-eye radiographic image. An average value of pixel values of pixels around the pixel to be displayed and an average value of pixel values of pixels around the pixel indicating the pixel value detected by the pixel value detection unit in the radiographic image for the right eye Also good.

The stereoscopic image display method of the present invention includes a display unit that displays a stereoscopic image that can be stereoscopically viewed using a left-eye radiation image and a right-eye radiation image acquired by irradiating a subject with radiation from different imaging directions. When,
A stereoscopic cursor display control unit that displays a stereoscopic cursor that can be moved in the depth direction and the in-plane direction of the stereoscopic image displayed on the display unit using the left-eye cursor image and the right-eye cursor image; In the stereoscopic image display method using the stereoscopic image display device,
Detecting the pixel value of the pixel indicated by the left-eye cursor image in the left-eye radiographic image and the pixel value indicated by the right-eye cursor image in the right-eye radiographic image;
The detected pixel value is displayed on a display unit on which a stereoscopic image is displayed.

In the stereoscopic image display method of the present invention, a warning is issued when the pixel value detected in the left-eye radiographic image is separated from the pixel value detected in the right-eye radiographic image by a predetermined threshold or more. It can be carried out.

In the stereoscopic image display method of the present invention, instead of the detected pixel value, the sum of the pixel value detected in the left-eye radiographic image and the pixel value detected in the right-eye radiographic image is displayed. be able to.

In the stereoscopic image display method of the present invention, instead of the detected pixel value, an average value of the pixel value detected in the left-eye radiographic image and the pixel values of the pixels around the pixel indicating the pixel value And the average value of the pixel value detected in the radiographic image for the right eye and the pixel values of the pixels around the pixel indicating the pixel value can be displayed.

In the stereoscopic image display method of the present invention, instead of the detected pixel value, the average value of the pixel values around the pixel indicating the pixel value detected in the left-eye radiographic image, and the right-eye image display method It is possible to display an average value of pixel values of pixels around the pixel indicating the pixel value detected in the radiation image.

According to the stereoscopic image display apparatus and stereoscopic image display method of the present invention, stereoscopic viewing is possible using the left-eye radiological image and the right-eye radiological image acquired by irradiating the subject with radiation from different imaging directions. Using the display unit that displays the stereoscopic image, the cursor image for the left eye, and the cursor image for the right eye, a stereoscopic cursor that can move in the depth direction and the in-plane direction of the stereoscopic image displayed on the display unit is used as the display unit. In the stereoscopic image display device including the stereoscopic cursor display control unit to be displayed, the pixel value of the pixel indicated by the left-eye cursor image in the left-eye radiographic image and the pixel value indicated by the right-eye cursor image in the right-eye radiographic image Since the detected pixel value is displayed on the display unit on which the stereoscopic image is displayed, the left-eye radiation image and the stereoscopic image are stereoscopically viewed. In each eye radiation image can be confirmed pixel values of pixels corresponding to the three-dimensional cursor.

As a result, the lesion, that is, the target included in the stereoscopic image is usually displayed in white or black on the radiographic image, and therefore the pixel value of the pixel corresponding to the target in the left-eye radiographic image and the right-eye radiographic image is the other pixel. Compared with the pixel value, the value is greatly different, and the observer confirms the pixel value to determine whether the pixel indicated by the left-eye cursor image and the right-eye cursor image constituting the stereoscopic cursor indicates the target. A visual image can be confirmed while stereoscopically viewed. For example, if the subject is a breast and the target included in the stereoscopic image is calcification, the calcification is displayed white on the left and right radiographic images, so the pixel value of the pixel corresponding to the calcification is the other pixel. Compared with the pixel value, the observer confirms the pixel value to determine whether the pixel indicated by the three-dimensional cursor, that is, the left-eye cursor image and the right-eye cursor image indicates calcification. A visual image can be confirmed while stereoscopically viewed.

Schematic configuration diagram of stereo biopsy device The figure which shows a part of front view of the stereo biopsy apparatus of FIG. View of compression plate from above 1 is a diagram showing the internal configuration of the computer of the stereo biopsy device of FIG. The flowchart which shows the effect | action of the stereo biopsy apparatus of FIG. Schematic diagram of stereo image display and 2D image display Other schematic diagrams of stereo image display and two-dimensional image display The figure which shows the pixel around the corresponding pixel in a two-dimensional image display Still another schematic diagram of stereo image display and two-dimensional image display Internal configuration diagram of a computer of the stereo biopsy device of the second embodiment Flowchart showing the operation of the stereo biopsy device of FIG.

Hereinafter, a stereo biopsy device for breasts, which is a breast image photographing display device (mammography device) to which a detachable biopsy unit 2 is attached, will be described as an embodiment of a stereoscopic image display device of the present invention with reference to the drawings. . First, a schematic configuration of the stereo biopsy device 1 of the present embodiment will be described. FIG. 1 is a schematic configuration diagram of a stereo biopsy device 1, and FIG. 2 shows a part of a front view of the stereo biopsy device 1.

As shown in FIG. 1, the stereo biopsy device 1 includes a mammography device 10 with the biopsy unit 2 attached thereto, a computer 8 connected to the mammography device 10, and a monitor 9 connected to the computer 8. And an input unit 7.

As shown in FIG. 1, the mammography apparatus 10 includes a base 11, a rotary shaft 12 that can move in the vertical direction (Z direction) with respect to the base 11, and can be rotated. The arm part 13 connected with the base 11 is provided.

The arm section 13 has an alphabet C shape, and a radiation table 16 is attached to one end of the arm section 13 so as to face the imaging table 14 at the other end. The rotation and vertical movement of the arm unit 13 are controlled by an arm controller 31 incorporated in the base 11.

Inside the imaging table 14 are provided a radiation detector 15 such as a flat panel detector and a detector controller 33 that controls reading of a charge signal from the radiation detector 15. The imaging table 14 includes a charge amplifier that converts a charge signal read from the radiation detector 15 into a voltage signal, a correlated double sampling circuit that samples a voltage signal output from the charge amplifier, a voltage A circuit board provided with an AD conversion unit for converting a signal into a digital signal is also installed.

In addition, the imaging table 14 is configured to be rotatable with respect to the arm unit 13, and even when the arm unit 13 rotates with respect to the base 11, the direction of the imaging table 14 is fixed to the base 11. can do.

The radiation detector 15 can repeatedly perform recording and reading of a radiation image, and may use a so-called direct type radiation image detector that directly receives radiation and generates a charge, A so-called indirect radiation image detector that converts radiation once into visible light and converts the visible light into a charge signal may be used.

As a radiation image signal readout method, a radiation image signal is read out by turning on and off a TFT (thin film transistor) switch, or a radiation image is emitted by irradiating reading light. It is desirable to use a so-called optical readout system in which a signal is read out, but the present invention is not limited to this, and other systems may be used.

A radiation source 17 and a radiation source controller 32 are accommodated in the radiation irradiation unit 16. The radiation source controller 32 irradiates the radiation from the radiation source 17 and the radiation generation conditions (tube current (mA), irradiation time (ms), tube current time product (mAs), tube voltage (kV) in the radiation source 17. Etc.).

Further, in the central portion of the arm portion 13, a compression plate 18 that is disposed above the imaging table 14 and presses and compresses the breast M, a support portion 20 that supports the compression plate 18, and a support portion 20 that extends in the vertical direction. A moving mechanism 19 for moving in the (Z direction) is provided. The position of the compression plate 18 and the compression pressure are controlled by the compression plate controller 34. FIG. 3 is a view of the compression plate 18 as viewed from above. As shown in FIG. 3, the compression plate 18 is about 10 so that biopsy can be performed with the breast fixed by the imaging table 14 and the compression plate 18. An opening 5 having a size of 10 cm square is provided.

The biopsy unit 2 is mechanically and electrically connected to the stereo biopsy device 1 by inserting the base portion of the biopsy unit 2 into the opening 5 of the support portion 20 of the compression plate 18 and attaching the lower end of the base portion to the arm portion 13. It is what is done.

The biopsy unit 2 includes a biopsy needle 21 that punctures the breast. The biopsy needle unit 22 is configured to be detachable, a needle support portion 23 that supports the biopsy needle unit 22, and the needle support portion 23 along the rail. A moving mechanism 24 that moves the biopsy needle unit 22 in the X, Y, and Z directions shown in FIGS. 1 to 3 by moving the needle support portion 23 in or out is provided.

The position of the tip of the biopsy needle 21 of the biopsy needle unit 22 is recognized and controlled as a three-dimensional coordinate position (x, y, z) by a needle position controller 35 provided in the moving mechanism 24. 1 is the X direction, the paper vertical direction in FIG. 2 is the Y direction, and the paper vertical direction in FIG. 3 is the Z direction.

The computer 8 includes a central processing unit (CPU), a semiconductor memory, a storage device such as a hard disk and an SSD, and the like. With these hardware, a control unit 8a, a radiation image storage unit 8b, a three-dimensional image, and the like are illustrated. A cursor display control unit 8c, a pixel value detection unit 8d, a pixel value display control unit 8e, and a position acquisition unit 8f are configured.

The control unit 8a outputs predetermined control signals to the various controllers 31 to 35 to control the entire system. A specific control method will be described in detail later.

The radiation image storage unit 8b stores a radiation image signal for each imaging direction acquired by the radiation detector 15 in advance.

The three-dimensional cursor display control unit 8c generates a left-eye cursor image M2 and a right-eye cursor image M3 constituting the three-dimensional cursor M1, as shown in FIG. By displaying the left-eye radiographic image and the right-eye radiographic image superimposed on each other, the stereoscopic cursor M1 that can be stereoscopically viewed is displayed as shown in FIG. In the present embodiment, the left-eye cursor image M2 and the right-eye cursor image M3 have an arrow shape. The left-eye cursor image M2 and the right-eye cursor image M3 are generated so as to have a relative shift amount in the left-right direction, that is, in the X direction, and are relative to each other according to an input from the input unit 7 described later. The three-dimensional cursor M1 is moved in the depth direction (Z direction) by changing the shift amount. Further, in the state where the relative left and right shift amounts of the left eye cursor image M2 and the right eye cursor image M3 are maintained according to the input from the input unit 7, their display positions are set in the horizontal direction (X direction) and the vertical direction. By changing to (Y direction), the three-dimensional cursor is moved in the in-plane direction (XY direction).

In each of the left-eye radiographic image and the right-eye radiographic image, the pixel value detecting unit 8d has a pixel value corresponding to a pixel indicated by the stereoscopic cursor M1 in the stereo image, that is, a pixel indicated by the left-eye cursor image M2 in the left-eye radiographic image. The pixel value of the pixel indicated by the right-eye cursor image M3 is detected in the pixel value and the right-eye radiographic image.

The pixel value display control unit 8e displays the pixel value detected by the pixel value detection unit 8d on the monitor 9 on which the stereo image is displayed. Specifically, a pixel value image in which pixel values are described is generated, and these are superimposed on corresponding positions of a left-eye radiographic image and a right-eye radiographic image that form a stereo image displayed on a monitor 9 described later, for example. Thus, when the observer observes the monitor 9, the pixel value can be confirmed while stereoscopically viewing the stereo image. Note that the present invention is not limited to this. For example, a region for displaying a two-dimensional image separately from the stereo image on the monitor 9 may be used as long as the pixel value can be confirmed while stereoscopically viewing the stereo image. The pixel value may be displayed in this area and may be changed as appropriate.

The position acquisition unit 8f indicates the position information of the pixel indicated by the three-dimensional cursor M1 in the stereo image displayed on the monitor 9, that is, the left-eye radio image and the right-eye radio image constituting the stereo image indicate the left-eye cursor image M2. By acquiring the position information of the pixel and the pixel indicated by the right-eye cursor image M3, the position information of the three-dimensional target such as an abnormal shadow, calcification, or lesion indicated by the three-dimensional cursor M1 is acquired, and the position information is transmitted to the control unit 8a. Is output.

The input unit 7 accepts input of imaging conditions and observation conditions by the observer, input of operation instructions, and the like, and is configured by an input device such as a keyboard and a mouse, for example. In the present embodiment, a general wheel mouse having a rotating wheel is used to move the position in the depth direction (Z direction) of the three-dimensional cursor M1. The position of the three-dimensional cursor M1 in the depth direction (Z direction) can be changed by rotating the rotating wheel by the observer.

The monitor 9 is configured to display a stereo image by using the two radiographic image signals output from the computer 8 to display the radiographic image for each imaging direction as a two-dimensional image.

As a configuration for displaying a stereo image, for example, a radiographic image based on two radiographic image signals is displayed using two screens, and one of the radiographic images is observed by using a half mirror or a polarizing glass. It is possible to adopt a configuration in which a stereo image is displayed by being incident on the right eye of the observer and the other radiation image is incident on the left eye of the observer.

Alternatively, for example, two radiographic images may be displayed in a superimposed manner while being shifted by a predetermined amount of parallax, and a stereo image may be generated by observing the images with a polarizing glass, or a parallax barrier method and a lenticular method As described above, a stereo image may be generated by displaying two radiation images on a stereoscopically viewable 3D liquid crystal. In addition, the device that displays a stereo image and the device that displays a two-dimensional image may be configured separately, or may be configured as the same device if they can be displayed on the same screen.

Next, the operation of the stereo biopsy device 1 will be described with reference to the flowchart shown in FIG.

First, the breast M is installed on the imaging table 14, and the breast M is compressed with a predetermined pressure by the compression plate 18 (S1).

Next, in the input unit 7, after various shooting conditions are input by the photographer, an instruction to start shooting is input (S2). At this time, the biopsy needle unit 22 is retracted upward, and the breast M has not been punctured yet.

When there is an instruction to start imaging in the input unit 7 (S2), the first radiographic image out of the two radiographic images constituting the stereo image of the breast M is captured (S3). Specifically, first, the control unit 8a reads an angle θ (hereinafter referred to as a convergence angle θ) formed by two different shooting directions in order to capture a preset stereo image, and the read convergence angle θ. Is output to the arm controller 31. In the present embodiment, as the information of the convergence angle θ at this time, the imaging angle θ ′ = ± 2 ° that constitutes the convergence angle θ, that is, the convergence angle θ = 4 ° is stored in advance. The convergence angle θ is not limited to this, and may be any angle that allows the observer to recognize the breast M displayed as a stereo image on the monitor 9 as a stereoscopic image having a stereoscopic effect. Any angle may be used as long as it is present.

Then, the arm controller 31 receives the information on the convergence angle θ output from the control unit 8a. The arm controller 31 captures the image of the arm unit 13 based on the information on the convergence angle θ as shown in FIG. A control signal is output so as to rotate + θ ′ with respect to the direction perpendicular to the table 14. That is, in the present embodiment, a control signal is output so that the arm unit 13 is rotated + 2 ° with respect to a direction perpendicular to the imaging table 14.

Then, in the state where the arm unit 13 is rotated by + 2 ° in accordance with the control signal output from the arm controller 31, the control unit 8a applies radiation to the radiation source controller 32 and the detector controller 33 and the radiation. A control signal is output so as to read out the image signal. In response to this control signal, radiation is emitted from the radiation source 17, a radiation image obtained by imaging the breast M from the + 2 ° direction is detected by the radiation detector 15, and a radiation image signal is read by the detector controller 33. After predetermined signal processing is performed on the radiographic image signal, the radiographic image signal is stored in the radiographic image storage unit 8 b of the computer 8.

Next, the second radiographic image of the two radiographic images constituting the stereo image of the breast M is taken (S4). Specifically, the arm controller 31 outputs a control signal so as to rotate the arm unit 13 by −θ ′ with respect to a direction perpendicular to the imaging table 14 as shown in FIG. That is, in the present embodiment, a control signal is output so that the arm unit 13 is rotated by −2 ° with respect to a direction perpendicular to the imaging table 14.

Then, in a state where the arm unit 13 is rotated by −2 ° according to the control signal output from the arm controller 31, the control unit 8a performs radiation irradiation on the radiation source controller 32 and the detector controller 33. A control signal is output so as to read out the radiation image. In response to this control signal, radiation is emitted from the radiation source 17, a radiation image obtained by imaging the breast M from the −2 ° direction is detected by the radiation detector 15, and a radiation image signal is read by the detector controller 33, After the predetermined signal processing, the radiation image storage unit 8b of the computer 8 stores the signal.

Next, the image signals of the two radiographic images stored in the radiographic image storage unit 8b as described above, and the left-eye cursor image M2 and the right-eye cursor image M3 generated in advance by the stereoscopic cursor display control unit 51 are displayed. The signal is read out from the radiation image storage unit 8b, is subjected to predetermined signal processing and is output to the monitor 9, and a breast stereo image and a three-dimensional cursor M1 are displayed as shown in FIG. 6 (S5). . Here, the display position of the three-dimensional cursor M1 is determined according to the input from the input unit 7 by the observer.

In the monitor 9 of the present embodiment, based on the two radiographic image signals and the image signals of the left-eye cursor image M2 and the right-eye cursor image M3, the radiographic image for each imaging direction, and the left-eye cursor image M2 and the right-eye cursor image M3. By displaying the cursor image M3 as a two-dimensional image, a stereo image is displayed, and the breast M and the stereoscopic cursor M1 are stereoscopically displayed. Here, the stereoscopic display is to display so that the observer can recognize the stereoscopic effect. FIG. 6 is a schematic diagram of stereo image display and two-dimensional image display.

As the breast M is stereoscopically displayed in this way, the observer discovers calcification or a mass in the breast M. Further, when the biopsy unit 2 wants to collect the tissues, the observer moves the stereoscopic cursor M1 so that the stereoscopic cursor M1 indicates the position where the biopsy needle 21 should be punctured in the breast M displayed stereoscopically. Thus, for example, a three-dimensional target can be specified by pressing the enter key of the keyboard or by left-clicking the mouse.

However, as shown in FIG. 6, particularly in a fluoroscopic image such as a radiographic image, a stereoscopic cursor M <b> 1 for designating a three-dimensional target is displayed in a subject image overlapping in the depth direction (Z direction). It is extremely difficult to recognize M1 three-dimensionally and to recognize the position of the three-dimensional cursor M1 in the depth direction (Z direction), and the observer determines whether or not the three-dimensional cursor M1 correctly indicates the intended three-dimensional target. It is difficult to confirm.

Therefore, in this embodiment, next, the three-dimensional cursor display control unit 8c determines whether or not there is an instruction to move the three-dimensional cursor M1 (S6). When there is a movement instruction (S6; YES), the three-dimensional cursor M1 is moved as described above based on the movement instruction and displayed on the monitor 9 (S7). In each of the left-eye radiation image and the right-eye radiation image, the pixel value of the pixel corresponding to the pixel indicated by the stereoscopic cursor M1 in the stereo image, that is, the pixel value of the pixel indicated by the left-eye cursor image M2 in the left-eye radiation image and the right-eye radiation. In the image, the pixel value of the pixel indicated by the right-eye cursor image M3 is detected (S8). Then, the pixel value display control unit 8e displays the pixel value detected by the pixel value detection unit 8d on the monitor 9 on which the stereo image is displayed as shown in FIG. 6 (S9).

By doing so, it is possible to confirm the pixel value of the pixel corresponding to the pixel indicated by the stereoscopic cursor M1 in each of the left-eye radiographic image and the right-eye radiographic image while stereoscopically viewing the stereo image.

Thus, normally, when the three-dimensional target included in the stereo image is, for example, calcification, the three-dimensional target is displayed white on the left and right radiographic images, so that the pixel value of the pixel corresponding to calcification is other than Compared with the pixel value of the pixel, the observer confirms the pixel value so that the stereoscopic cursor M1, that is, the pixel indicated by the left-eye cursor image M2 and the right-eye cursor image M3 indicates calcification. It is possible to confirm whether or not the stereoscopic image is stereoscopically viewed.

The observer then displays the left and right pixel values displayed on the monitor, that is, the pixel value of the pixel indicated by the left-eye cursor image M2 in the left-eye radiological image and the pixel of the pixel indicated by the right-eye cursor image M3 in the right-eye radiographic image. When the values are significantly different, it can be determined that the position in the depth direction (Z direction) indicated by the three-dimensional cursor M1 does not coincide with the position of the three-dimensional target, so that the observer rotates the rotating wheel. By doing so, the position in the depth direction (Z direction) indicated by the three-dimensional cursor M1 can be changed so that the left pixel value and the right pixel value substantially coincide.

For example, when the observer determines that the right pixel value is greatly different from the left pixel value and the right pixel value is highly likely to indicate calcification, the observer uses the input unit 7. By inputting the instruction, the three-dimensional cursor display control unit 8c keeps the position of the right-eye cursor image M3 in the right-eye radiographic image fixed, and the relative position in the X direction between the left-eye cursor image M2 and the right-eye cursor image M3. Control is performed so that the shift amount is changed, that is, only the X direction of the left cursor image M2 is moved.

In the present embodiment, as described above, the pixel value display control unit 8e displays the pixel values of the pixels indicated by the left-eye cursor image M2 and the right-eye cursor image M3 in each of the left-eye radiation image and the right-eye radiation image. Although displayed on the monitor 9, the present invention is not limited to this.

Here, FIG. 7 shows another schematic diagram of the stereo image display and the two-dimensional image display, and FIG. 8 shows a diagram showing pixels around the corresponding pixels in the two-dimensional image display. FIG. 9 shows still another schematic diagram of stereo image display and two-dimensional image display.

The pixel value display control unit 8e detects the pixel values of the pixels indicated by the left-eye cursor image M2 and the right-eye cursor image M3 in each of the left-eye radiation image and the right-eye radiation image detected by the pixel value detection unit 8d. The total value may be displayed on the monitor 9 on which the stereo image is displayed as shown in FIG.

Thus, normally, when the three-dimensional target included in the stereo image is, for example, calcification, the three-dimensional target is displayed white on the left and right radiographic images, so that the pixel value of the pixel corresponding to calcification is other than Therefore, the total value of the pixel values of the pixels indicated by the left-eye cursor image M2 and the right-eye cursor image M3 is the sum of the pixel values of the other pixels. In the case where it is smaller, the pixels indicated by the left-eye cursor image M2 and the right-eye cursor image M3 are likely to indicate calcification, and the observer confirms the total value of the pixel values to confirm the three-dimensional cursor. Whether or not the pixel indicated by M1, that is, the left-eye cursor image M2 and the right-eye cursor image M3 indicates calcification can be confirmed while stereoscopically viewing the stereo image.

Further, as shown in FIG. 8, the pixel value control unit 8e includes a left-eye cursor image M2 and a right-eye cursor image M3 in each of the left-eye radiation image and the right-eye radiation image detected by the pixel value detection unit 8d. The average value of the pixel values of the pixels shown and the surrounding pixels G1 to G8 may be displayed on the monitor 9 on which the stereo image is displayed as shown in FIG.

Usually, when the three-dimensional target included in the stereo image is, for example, calcification, the pixels corresponding to the calcification are represented by a set of a plurality of pixels. Therefore, the average value of the pixel values of the pixels indicated by the left-eye cursor image M2 and the right-eye cursor image M3 and the pixels G1 to G8 around the pixels is the average value of the pixel values of the other pixels and the pixels around the pixels. That is, in the case where the average value of the pixels that are highly likely not to be calcified and the pixel values around the pixels is small, the pixels indicated by the left-eye cursor image M2 and the right-eye cursor image M3, respectively, and the pixels It is highly possible that the pixels around the image of the three-dimensional cursor M1, that is, the pixels indicated by the left-eye cursor image M2 and the right-eye cursor image M3 indicate calcification by checking the average value. It is possible to confirm whether or not a stereo image is stereoscopically viewed.

The pixel values to be averaged are not limited to the pixel values of nine pixels as described above, and may be pixel values of nine or more pixels, or the left-eye cursor image M2 and the right-eye cursor. The pixel values of the eight pixels of the surrounding pixels G1 to G8 excluding the pixels indicated by the image M3 may be used or may be changed as appropriate.

On the other hand, if there is no movement instruction in step S6 (S6; NO), the process of step S6 is repeated until there is a movement instruction.

Next, the position acquisition unit 8f determines whether or not the three-dimensional target has been determined by pressing the enter key of the keyboard by the observer or by left-clicking the mouse (S10). If it is determined that a three-dimensional target has not been determined (S10; NO), the process proceeds to step S6, and the processes after step S6 are repeated.

On the other hand, when it is determined that the three-dimensional target has been determined (S10; YES), the position acquisition unit 8f acquires the determined position coordinates of the three-dimensional target, that is, the position coordinates of the pixel indicated by the three-dimensional cursor M1 (S11). .

The position acquisition unit 8f corresponds to the coordinate positions (x2, y2) of the corresponding pixels indicated by the left-eye cursor image M2 and the right-eye cursor image M3 in the left-eye radiation image and the right-eye radiation image corresponding to the pixel indicated by the stereoscopic cursor M1. ), (X3, y3), and based on the coordinate positions (x2, y2) and (x3, y3) of the corresponding pixels indicated by the acquired left-eye cursor image M2 and right-eye cursor image M3, for example, triangulation By the method, the three-dimensional position coordinates (x1, y1, z1) of the pixel indicated by the three-dimensional cursor M1 are acquired.

The position acquisition unit 8f obtains the three-dimensional position coordinates (x1, y1, z1) of the pixel indicated by the acquired three-dimensional cursor M1, that is, the three-dimensional position (x1, y1, z1) of the three-dimensional target, as the needle position controller of the biopsy unit 2. 35.

When a predetermined operation button is pressed in the input unit 7, a control signal for moving the biopsy needle 21 is output from the control unit 8 a to the needle position controller 35. Based on the previously input three-dimensional coordinate position (x1, y1, z1), the needle position controller 35 is arranged so that the tip of the biopsy needle 21 is arranged at the three-dimensional coordinate position (x1, y1, z1 + α). The biopsy needle 21 is moved. Here, α is set to a sufficiently large value such that the biopsy needle 21 does not pierce the breast M. Thereby, the biopsy needle 21 is set above the target.

When a predetermined operation for instructing the biopsy needle 21 to be punctured by the observer is performed on the input unit 7, the tip of the biopsy needle 21 is controlled by the three-dimensional coordinate position (x1) under the control of the control unit 8a and the needle position controller 35. , Y1, z1), and the biopsy needle 21 punctures the breast M (S12). In this way, the stereo biopsy device 1 performs biopsy.

As described above, according to the stereo biopsy apparatus 1, the pixel value of the pixel corresponding to the pixel indicated by the stereoscopic cursor M1 is confirmed in each of the left-eye radiographic image and the right-eye radiographic image while stereoscopically viewing the stereoscopic image. be able to. Usually, a lesion included in a stereoscopic image, that is, a three-dimensional target, is displayed in white or black on a radiographic image, so that the pixel values of pixels corresponding to the three-dimensional target in the left-eye radiographic image and the right-eye radiographic image The value is greatly different compared to the pixel. The observer can confirm the pixel value of the pixel corresponding to the pixel indicated by the stereoscopic cursor M1, so that the pixel indicated by the stereoscopic cursor M1, that is, the pixel indicated by the left-eye cursor image M2 and the right-eye cursor image M3 indicates the target. This can be confirmed while viewing the stereoscopic image stereoscopically.

Next, a stereo biopsy device 1 'according to the second embodiment will be described. Note that the stereo biopsy device 1 ′ of the present embodiment has a configuration substantially similar to that of the stereo biopsy device 1 of the above embodiment, and therefore similar portions are denoted by the same reference numerals and description thereof is omitted, and only different portions will be described in detail. . FIG. 10 is an internal configuration diagram of a computer of the stereo biopsy device 1 ′ of this embodiment, and FIG. 11 is a flowchart showing the operation of the stereo biopsy device 1 ′ of FIG. 10.

As shown in FIG. 10, the stereo biopsy device 1 ′ of this embodiment is obtained by adding a warning output unit 8 g to the configuration of the computer 8 of the stereo biopsy device 1 of the above embodiment.

The warning output unit 8g includes the pixel value detected by the pixel value detection unit 8d in the left-eye radiographic image and the pixel value detected by the pixel value detection unit 8d in the right-eye radiographic image, that is, the left-eye cursor image in the left-eye radiographic image. A warning is issued when the pixel value of the pixel indicated by M2 and the pixel value of the pixel indicated by the right-eye cursor image M3 in the right-eye radiographic image are separated by a predetermined threshold or more. As a warning method, the fact that the pixel values are separated may be displayed on the monitor 50, sound may be output by a speaker (not shown), or other appropriate changes may be made.

In this embodiment, it is assumed that a 14-bit radiographic image is used, and the predetermined threshold is 2000, but the present invention is not limited to this. When a 14-bit radiographic image is used, the predetermined threshold is preferably 1000 to 2000, and can be appropriately changed by the observer according to the number of bits of the radiographic image.
Next, the operation of the stereo biopsy device 1 ′ will be described with reference to the flowchart shown in FIG. Note that this embodiment is similar to the flowchart of FIG. 5 because the processing of step S20 and step S21 is added between the processing of step S9 and step S10 of the flowchart shown in FIG. 5 described in the above embodiment. These processes are denoted by the same reference numerals and description thereof is omitted.

As shown in FIG. 11, the stereo biopsy device 1 ′ of the present embodiment, when the pixel value is displayed on the monitor 9 by the pixel value display control unit 8 e, the left and right pixel values displayed by the warning output unit 8 g, that is, the left eye It is determined whether or not the pixel value of the pixel indicated by the left-eye cursor image M2 in the radiographic image is separated from the pixel value of the pixel indicated by the right-eye cursor image M3 in the right-eye radiographic image by a predetermined threshold (2000) or more (S20). ), If it is away (S20; YES), the warning output unit 8g displays on the monitor 50 that the pixel value is away, or outputs a sound through a speaker (not shown) to give a warning (S21). ).

When the pixel value is more than a predetermined threshold, the pixel indicated by the left-eye cursor image M2 in the left-eye radiological image and the pixel indicated by the right-eye cursor image M3 in the right-eye radiographic image may be the same three-dimensional target. By giving the above warning to the observer, the observer can know that there is a high possibility that the three-dimensional cursor M1 does not indicate the three-dimensional target intended by the observer. M1 can be moved and retargeted.

After that, the position acquisition unit 8f performs the process of step S10 for determining whether or not the three-dimensional target is determined by the observer, and subsequently performs the processes after step S10.

On the other hand, in step S20, when the pixel value is not separated by a predetermined threshold (2000) or more (S20; NO), the pixel indicated by the left-eye cursor image M2 in the left-eye radiation image and the right-eye radiation image in the right-eye radiation image. There is a possibility that the pixels indicated by the cursor image M3 are the same three-dimensional target, and the processing proceeds to step S10 without performing the warning by the warning output unit 8g, and the processing after step S10 is subsequently performed. In this way, the stereo biopsy device 1 ′ of the present embodiment performs biopsy.

In the above description, the present invention has been described as a stereoscopic image display apparatus that displays pixel values. However, the present invention may be a stereoscopic image display apparatus that displays a normalized pixel value. .
Note that the present invention is not limited to a stereoscopic image display device that captures the breast M as a subject, but, for example, a stereo biopsy device that captures a chest, a head, or the like as a subject and punctures a biopsy needle at a position that is most whitely displayed. It is also applicable to.

In the above embodiment, the stereo biopsy device has been described. However, the present invention is not limited to this, and the present invention is also applicable to a stereoscopic image display device that is not equipped with a biopsy function. In the stereoscopic image display apparatus of the present invention that is not equipped with a biopsy function, it is confirmed whether or not the stereoscopic cursor is positioned on the region of interest when the observer targets the region of interest such as a lesion in the stereoscopic image. be able to.

The present invention can also be applied to a radiographic imaging display device that images a breast or head, for example, without limiting the subject to a breast.

Further, the present invention is not limited to the contents of the above-described embodiments, and can be appropriately changed without departing from the spirit of the invention.

Claims

A display unit that displays a stereoscopic image that can be stereoscopically viewed using a radiographic image for the left eye and a radiographic image for the right eye acquired by irradiating the subject with radiation from different imaging directions;
A stereoscopic cursor display control unit that displays a stereoscopic cursor that can be moved in the depth direction and the in-plane direction of the stereoscopic image displayed on the display unit using the left-eye cursor image and the right-eye cursor image on the display unit. When,
A pixel value detection unit that detects a pixel value of a pixel indicated by the left-eye cursor image in the left-eye radiographic image and a pixel value of a pixel indicated by the right-eye cursor image in the right-eye radiographic image;
A stereoscopic image display device, comprising: a pixel value display control unit configured to display the pixel value detected by the pixel value detection unit on the display unit on which the stereoscopic image is displayed.
When the pixel value detected by the pixel value detection unit in the left-eye radiographic image and the pixel value detected by the pixel value detection unit in the right-eye radiographic image are separated from each other by a predetermined threshold or more The stereoscopic image display apparatus according to claim 1, further comprising a warning output unit that issues a warning to the display.
The pixel value display control unit replaces the pixel value detected by the pixel value detection unit with the pixel value detected by the pixel value detection unit in the left-eye radiation image and the radiation image for the right eye. The stereoscopic image display device according to claim 1, wherein a total value of the pixel values detected by a pixel value detection unit is displayed.
The pixel value display control unit replaces the pixel value detected by the pixel value detection unit with the pixel value detected by the pixel value detection unit and the pixel value indicating the pixel value in the left-eye radiation image. An average value of pixel values of surrounding pixels, and an average value of the pixel values detected by the pixel value detection unit in the radiographic image for the right eye and the pixel values of pixels around the pixel indicating the pixel value The stereoscopic image display device according to claim 1, wherein the stereoscopic image display device is displayed.
The pixel value display control unit replaces the pixel value detected by the pixel value detection unit with a pixel around the pixel indicating the pixel value detected by the pixel value detection unit in the left-eye radiation image. An average value of pixel values and an average value of pixel values of pixels around the pixel indicating the pixel value detected by the pixel value detection unit in the right-eye radiographic image are displayed. The stereoscopic image display apparatus according to claim 1.
A display unit that displays a stereoscopic image that can be stereoscopically viewed using a radiographic image for the left eye and a radiographic image for the right eye acquired by irradiating the subject with radiation from different imaging directions;
A stereoscopic cursor display control unit that displays a stereoscopic cursor that can be moved in the depth direction and the in-plane direction of the stereoscopic image displayed on the display unit using the left-eye cursor image and the right-eye cursor image on the display unit. In a stereoscopic image display method using a stereoscopic image display device comprising:
Detecting the pixel value of the pixel indicated by the left-eye cursor image in the left-eye radiographic image and the pixel value of the pixel indicated by the right-eye cursor image in the right-eye radiographic image;
A stereoscopic image display method, comprising: displaying the detected pixel value on the display unit on which the stereoscopic image is displayed.
The warning is performed when the pixel value detected in the left-eye radiographic image is separated from the pixel value detected in the right-eye radiographic image by a predetermined threshold or more. The described stereoscopic image display method.
7. The total value of the pixel value detected in the left-eye radiographic image and the pixel value detected in the right-eye radiographic image is displayed instead of the detected pixel value. The described stereoscopic image display method.
Instead of the detected pixel value, an average value of the pixel value detected in the left-eye radiographic image and pixel values of pixels around the pixel indicating the pixel value, and detection in the right-eye radiographic image The stereoscopic image display method according to claim 6, wherein an average value of the pixel value thus obtained and a pixel value of a pixel surrounding the pixel indicating the pixel value is displayed.
Instead of the detected pixel value, an average value of pixel values around pixels indicating the pixel value detected in the left-eye radiographic image, and the pixel value detected in the right-eye radiographic image The stereoscopic image display method according to claim 6, further comprising: displaying an average value of pixel values of pixels around the pixel indicating the above.