JP2014113325A - Image display apparatus and medical image diagnostic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly display location information indicating a location in a stereoscopic image.SOLUTION: An image display apparatus includes a display control unit and a location information control unit. The display control unit three-dimensionally displays a stereoscopic image on a display part by using a parallax image group generated from three-dimensional image data and also location information indicating a location in the stereoscopic image on the display part. The location information control unit moves the location information in each parallax image included in the parallax image group according to a travel amount received from an operator when receiving an instruction to move the location information towards the depth direction in the stereoscopic image from the operator.

Description

  Embodiments described herein relate generally to an image display apparatus and a medical image diagnostic apparatus.

  Conventionally, in endovascular treatment using an X-ray diagnostic apparatus, the procedure is often advanced by two or more doctors. For example, there are a case where a plurality of doctors jointly advance a procedure in the operating room, a case where a training doctor stands in front of a subject in the operating room, and a senior doctor gives guidance outside the operating room. For example, these doctors talk while looking at the same image on a monitor provided individually, and proceed carefully with agreement.

  For example, these doctors communicate with each other by pointing a desired position with a cursor on an image displayed on a 2D monitor. For example, when one doctor instructs to place a stent 3 mm ahead of this blood vessel branch at the branch point of the blood vessel, the doctor moves the cursor on the image displayed on the 2D monitor. Then, since the image displayed on the 2D monitor is two-dimensional, the position indicated by the cursor in the image is uniquely determined.

JP 2006-239253 A

  The problem to be solved by the present invention is to provide an image display apparatus and a medical image diagnostic apparatus capable of appropriately displaying position information indicating a position in a stereoscopic image.

  The image display apparatus according to the embodiment includes a display control unit and a position information control unit. The display control unit three-dimensionally displays a stereoscopic image on the display unit using the parallax image group generated from the three-dimensional image data, and three-dimensionally displays position information indicating a position in the stereoscopic image on the display unit. indicate. The position information control unit receives position information in each parallax image included in the parallax image group from the operator when receiving an instruction from the operator to move the position information in the depth direction in the stereoscopic image. It moves within each parallax image according to the received movement amount.

FIG. 1 is a diagram for explaining a configuration example of the X-ray diagnostic apparatus according to the first embodiment. FIG. 2 is a diagram illustrating an example for explaining the display unit according to the first embodiment. FIG. 3 is a diagram illustrating another example for explaining the display unit according to the first embodiment. FIG. 4 is a diagram illustrating another example for explaining the display unit according to the first embodiment. FIG. 5 is a diagram illustrating an example of a processing operation performed by the position information control unit according to the first embodiment. FIG. 6 is a diagram illustrating another example of the processing operation performed by the position information control unit according to the first embodiment. FIG. 7 is a diagram illustrating an example of the shift amount control operation performed by the position information control unit according to the first embodiment. FIG. 8 is a diagram illustrating another example of the shift amount control operation performed by the position information control unit according to the first embodiment. FIG. 9 is a flowchart illustrating a procedure of position information control processing by the X-ray diagnostic apparatus according to the first embodiment. FIG. 10 is a diagram illustrating an example of an automatic tracing method performed by the position information control unit according to the second embodiment. FIG. 11 is a flowchart illustrating a procedure of position information control processing by the X-ray diagnostic apparatus according to the second embodiment. FIG. 12 shows an example of the processing operation of the position information control unit when the position information reaches the blood vessel branch point. FIG. 13 is a diagram illustrating an example of the processing operation of the position information control unit when the function of automatically focusing on an object with high contrast is set. FIG. 14 is a flowchart illustrating a procedure of position information control processing by the X-ray diagnostic apparatus according to the second embodiment.

  Hereinafter, an image display apparatus and a medical image diagnostic apparatus according to an embodiment will be described with reference to the drawings.

(First embodiment)
In the first embodiment, an X-ray diagnostic apparatus will be described as an example of a medical image diagnostic apparatus. FIG. 1 is a diagram for explaining a configuration example of an X-ray diagnostic apparatus 100 according to the first embodiment. As shown in FIG. 1, the X-ray diagnostic apparatus 100 includes a gantry unit 10 and a computer system 20. As shown in FIG. 1, the gantry unit 10 includes a bed 11, a gantry 12, a C arm 13, an X-ray source 14, an X-ray detector 15, and a display unit 16. The X-ray diagnostic apparatus 100 does not include the subject P.

  The bed 11 is movable in the vertical direction and the horizontal direction, and the subject P is placed thereon. The gantry 12 supports the C arm 13. The C arm 13 can rotate in the direction of arrow R about the Z axis, and holds the X-ray source 14 and the X-ray detector 15 facing each other. The X-ray source 14 includes an X-ray tube that emits X-rays and a collimator. The X-ray detector 15 detects X-rays irradiated from the X-ray source 14 and transmitted through the subject P. The display unit 16 displays a stereoscopically visible image. In the first embodiment, a stereoscopically viewable image is referred to as a “stereoscopic image”. As will be described later, the stereoscopic image is a virtual image that is stereoscopically recognized by an observer (for example, an operator) by displaying a plurality of parallax images on the display unit 16.

  Here, the display unit 16 according to the first embodiment is a 3D monitor that allows the operator to recognize an image in three dimensions. For example, the display unit 16 displays an image three-dimensionally using a shutter method. In addition, although the example which has one display part 16 is shown in FIG. 1, the number of the display parts 16 is not limited to the number shown in FIG.

  FIG. 2 is a diagram illustrating an example for explaining the display unit 16 according to the first embodiment. FIG. 2 shows a case where two adjacent operators observe the display unit 16 provided individually. Note that the operator includes a doctor and an engineer. The same image is displayed on the display unit 16 shown in FIG. 2, and the two operators observe the same image displayed on the display unit 16 provided individually. For example, one doctor observes the display unit 16 and sends an instruction to the other doctor, and the doctor who receives the instruction works on the subject P.

  As shown in FIG. 2, a doctor observing the display unit 16 wears shutter glasses as stereoscopic glasses that can also be used as X-ray protective glasses. In this case, the display unit 16 alternately displays an image for the right eye (hereinafter, the right eye image) and an image for the left eye (hereinafter, the left eye image) at 120 Hz, for example. The display unit 16 includes an infrared emitting unit, and the infrared emitting unit controls the emission of infrared rays in accordance with the timing for switching between the right eye image and the left eye image. On the other hand, the shutter glasses have an infrared light receiving unit, and the infrared light receiving unit receives infrared light emitted from the infrared light emitting unit, and alternately switches between a transmission state and a light shielding state of a shutter attached to each of the left and right sides of the shutter glasses. .

  Note that the 3D monitor is not limited to the shutter system, and may be, for example, a polarizing glasses system or a system capable of stereoscopic viewing with the naked eye by using a light controller such as a lenticular lens.

  Moreover, as shown in FIG. 3, you may make it each observe the display part 16 provided individually, facing two operators. FIG. 3 is a diagram illustrating another example for explaining the display unit 16 according to the first embodiment. In the example illustrated in FIG. 3, for example, two doctors from different medical departments work on the subject P independently while observing the display unit 16.

  Moreover, as shown in FIG. 4, two operators may be in different places. FIG. 4 is a diagram illustrating another example for explaining the display unit 16 according to the first embodiment. In the example shown in FIG. 4, a senior doctor in another room gives instructions to a junior doctor in the operating room while observing the display unit 16. Then, the junior doctor in the operating room observes the display unit 16 to confirm the instruction of the senior doctor, and works on the subject P. Note that the separate room and the operating room may be provided in the same hospital. Further, a separate room may be provided in a remote place away from the operating room.

  Returning to FIG. 1, the computer system 20 includes an operation unit 21, a medical image data storage unit 22, a control unit 23, a medical image data collection unit 24, a C arm control unit 25, and a parallax image group generation unit 26. The display control unit 27 is provided.

  The operation unit 21 is a control panel, a foot switch, a joystick, a mouse, a kinect or the like, and receives input of various operations on the X-ray diagnostic apparatus 100 from an operator. Specifically, the operation unit 21 according to the first embodiment receives an instruction to collect image data such as three-dimensional image data, an instruction to display a stereoscopic image, and the like. The medical image data storage unit 22 stores three-dimensional image data used for displaying stereoscopic images. The control unit 23 performs overall control of the X-ray diagnostic apparatus 100.

  The medical image data collection unit 24 collects image data such as three-dimensional image data. For example, when receiving a three-dimensional image data collection instruction, the medical image data collection unit 24 controls the X-ray source 14, the X-ray detection device 15, and the C-arm control unit 25 to collect three-dimensional image data. The medical image data collection unit 24 stores the collected three-dimensional image data in the medical image data storage unit 22. In the first embodiment, the example in which the three-dimensional image data is collected by rotating the C-arm 13 of the X-ray diagnostic apparatus 100 has been described. However, the embodiment is not limited to this, and for example, Three-dimensional image data collected in advance by an X-ray CT (Computed Tomography) apparatus different from the X-ray diagnostic apparatus 100 may be used.

  The parallax image group generation unit 26 generates a right eye image and a left eye image that are parallax image groups from the three-dimensional image data. Specifically, when the parallax image group generation unit 26 receives an instruction to generate a parallax image group from the display control unit 27, the parallax image group generation unit 26 refers to the medical image data storage unit 22 and acquires three-dimensional image data collected in advance. Then, the parallax image group generation unit 26 generates a right eye image and a left eye image from the acquired three-dimensional image data, and sends the generated right eye image and left eye image to the display control unit 27. Upon receiving a stereoscopic image display instruction via the operation unit 21, the display control unit 27 sends a parallax image group generation instruction to the parallax image group generation unit 26, and the generated parallax image group is transmitted to the parallax image group generation unit. 26, the stereoscopic image is three-dimensionally displayed on the display unit 16 using the parallax image group.

  In this way, the operator performs work while viewing the stereoscopic image displayed on the display unit 16 by the display control unit 27. Here, when there are two or more operators, there are objects in the depth direction, so there is a risk of miscommunication depending on the difference in the viewing angle and the recognition distance of the depth. Therefore, the computer system 20 according to the first embodiment displays position information (for example, a cursor represented by an arrow symbol or the like) indicating a position in the stereoscopic image in the stereoscopic image. Specifically, the display control unit 27 and the position information control unit 28 shown in FIG. 1 execute processing for controlling the display of the position information.

  The display control unit 27 displays a stereoscopic image on the display unit 16 using the parallax image group generated from the three-dimensional image data, and three-dimensionally displays position information indicating a position in the stereoscopic image on the display unit 16. indicate.

  When the position information control unit 28 receives an instruction to move the position information in the depth direction in the stereoscopic image from the operator, the position information control unit 28 receives the position information in each parallax image included in the parallax image group from the operator. It moves within each parallax image according to quantity. The display control unit 27 uses the parallax image group after the position information is moved by the position information control unit 28 to three-dimensionally display a stereoscopic image on which the stereoscopically visible position information is superimposed on the display unit 16. Then, the operator recognizes that the position information has moved in the depth direction in the virtual stereoscopic image. Details of the position information control unit 28 will be described later.

  Next, processing operations performed by the position information control unit 28 according to the first embodiment will be described with reference to FIG. FIG. 5 is a diagram illustrating an example of a processing operation performed by the position information control unit 28 according to the first embodiment. In FIG. 5, blood vessels are depicted in the left eye image and the right eye image in a state slightly shifted so as to be stereoscopically viewed. As illustrated in FIG. 5, when the position information control unit 28 receives a stereoscopic image display instruction via the operation unit 21, the position information control unit 28 sets the position information to a predetermined position (for example, an initial position) in each parallax image. Position.

  In the example illustrated in FIG. 5, a case will be described in which the position information control unit 28 displays position information as a reference point as an initial position. Here, the “reference point” is a point where no parallax occurs between the left and right eyes in the stereoscopic image, and is positioned on the display surface of the display unit 16, for example. A surface on the stereoscopic image on which the reference point is positioned is referred to as a “reference surface”. For example, when the position of the reference point is on the display surface of the display unit 16, the reference surface corresponds to the display surface of the display unit 16. The position of the reference point is not limited to the display surface of the display unit 16.

  As illustrated in FIG. 5, the position information control unit 28 positions the position information at the L1 coordinate of the left eye image and positions the position information at the R1 coordinate of the right eye image. Here, the L1 coordinate of the left eye image is the same as the R1 coordinate of the right eye image. That is, no shift amount is generated between the left eye image and the right eye image. In the stereoscopic image, the position information is imaged at the intersection of a line connecting L indicating the left eye of the operator and the coordinate L1 and a line connecting R indicating the right eye of the operator and the coordinate R1. That is, the position information is imaged at the reference point in the stereoscopic image shown in FIG. 5 (the position of the arrow in the stereoscopic image of FIG. 5). Note that the position of the position information positioned as the initial position by the position information control unit 28 is not limited to the position illustrated in FIG.

  Next, processing operations performed by the position information control unit 28 according to the first embodiment will be described with reference to FIG. FIG. 6 is a diagram illustrating another example of the processing operation performed by the position information control unit 28 according to the first embodiment. FIG. 6 shows an example of moving the position information imaged on the reference point from the reference point to the near side in the depth direction.

  When the position information control unit 28 receives an operation from the operator to move the position information to the near side in the depth direction in the stereoscopic image illustrated in FIG. 5, the position information control unit 28 performs the following processing. That is, as shown in FIG. 6, the position information control unit 28 moves the position information for the left eye image to L2 which is a coordinate on the right side of L1. Further, as shown in FIG. 6, the position information control unit 28 moves the position information to R2 which is a coordinate on the left side of R1 for the right eye image. Thereby, a shift amount of the position information is generated between the right eye image and the left eye image. In this case, position information moves to the near side in the depth direction in the stereoscopic image. In the stereoscopic image, the position information is imaged at the intersection of a line connecting L indicating the left eye of the operator and the coordinate L2, and a line connecting R indicating the right eye of the operator and the coordinate R2. That is, in the stereoscopic image shown in FIG. 5, the position information is imaged at a position closer to the front side in the depth direction than the reference point (the position of the arrow in the stereoscopic image of FIG. 6).

  For example, the left / right / up / down movement of the mouse retains the conventional mechanism, and by moving the wheel, position information with the shift amount changed is displayed. The operation unit 21 that receives the operation of the position information is not limited to the mouse, and may be, for example, a device that detects the gesture or voice of the operator and receives the operation based on the detected content (for example, The operation of moving the position information to the depth side in the depth direction is detected by a gesture that the operator pushes out by hand).

  Thus, for example, the position information control unit 28 generates a shift amount of the position information between the right eye image and the left eye image, and the display control unit 27 sets the right eye image after the shift amount is generated. By displaying the stereoscopic image three-dimensionally using the left eye image, the position information moves in the depth direction in the stereoscopic image.

  Here, when the position information control unit 28 causes the shift amount of the position information to be equal to the right eye image and the left eye image, the position information includes the viewpoint position of the operator who observes the position information and the coordinates of the position information. Depending on the situation, there is a case in which it does not move to the rear side or the front side in the depth direction but moves in an oblique direction.

  For this reason, in the first embodiment, the position information control unit 28 determines the viewpoint position of the operator, the amount of movement received from the operator, and the coordinates where the position information is positioned in each parallax image. Based on the above, an appropriate shift amount is obtained by calculating coordinates as a movement destination of the position information in each parallax image. The viewpoint position can be detected using a known technique. For example, the position information control unit 28 includes a camera, and pattern matching between an image photographed by the camera and a face model image (for example, a position relative to the display unit 16). Etc.) can be specified. The shift amount control operation by the position information control unit 28 according to the first embodiment will be described with reference to FIGS. 7 and 8. 7 and 8 illustrate a case where the operator is standing in front of the display unit 16.

  FIG. 7 is a diagram illustrating an example of a shift amount control operation performed by the position information control unit 28 according to the first embodiment. In FIG. 7, L indicates the left eye of the operator, and R indicates the right eye of the operator. In FIG. 7, the position information is positioned in the middle of the display unit 16. In other words, the position information is positioned at a reference point substantially in the center between the operator's left eye and the operator's right eye. Specifically, the position information control unit 28 positions the position information at the coordinates L1 (X1, Y1) with respect to the left eye image generated by the parallax image group generation unit 26, and the position information is the coordinates L1 (X1, X1). A new left eye image positioned at Y1) is generated. Further, the position information control unit 28 positions the position information at the coordinates R1 (X1, Y1) with respect to the right eye image generated by the parallax image group generation unit 26, and the position information is at the coordinates R1 (X1, Y1). A new right eye image positioned is generated. In this case, there is no positional information shift amount between the right eye image and the left eye image.

  Here, the case where the position information positioned on the reference plane is moved to the near side in the depth direction will be described. In this case, the position information control unit 28 moves the position information to the coordinate L2 intersecting the reference plane on the line connecting the position where the position information is imaged on the near side in the depth direction and the viewpoint position of the left eye. The position information is moved to a coordinate R2 that intersects the reference plane on the line connecting the position where the position information is imaged on the near side in the depth direction (indicated by a dotted circle in FIG. 7) and the viewpoint position of the right eye. . For example, the position information control unit 28 detects the viewpoint position of the operator. Further, the position information control unit 28 obtains a position at which the position information after movement corresponding to the movement amount received from the operator is imaged. Subsequently, the position information control unit 28 obtains coordinates that intersect the reference plane on a straight line connecting the detected viewpoint position and the position where the position information after movement in the virtual space of the stereoscopic image is imaged. . Then, the position information control unit 28 performs control so that the position information is positioned at the obtained coordinates for each parallax image. For example, the position information control unit 28 positions position information at coordinates L2 (X1 + ΔX, Y1) with respect to the current left eye image, and a new left eye image in which position information is positioned at coordinates L2 (X1 + ΔX, Y1). Is generated. Further, the position information control unit 28 positions the position information at the coordinate R2 (X1-ΔX, Y1) with respect to the current right eye image, and the position information is positioned at the coordinate R2 (X1-ΔX, Y1). A right-eye image is generated. In this case, a positional information shift amount occurs between the right eye image and the left eye image. Accordingly, in the virtual stereoscopic image, the position information moves from the reference plane to the near side.

  Next, a case where position information positioned on the reference plane is moved to the back side in the depth direction will be described. In this case, the position information control unit 28 moves the position information to the coordinate L3 intersecting the reference plane on the line connecting the position where the position information is imaged on the far side in the depth direction and the viewpoint position of the left eye. The position information is moved to a coordinate R3 intersecting the reference plane on a line connecting the position where the position information is imaged on the far side in the depth direction and the viewpoint position of the right eye. For example, the position information control unit 28 positions the position information at coordinates L3 (X1-ΔX ′, Y1) with respect to the current left-eye image, and the position information is positioned at coordinates L3 (X1-ΔX ′, Y1). A new left eye image is generated. In addition, the position information control unit 28 positions the position information at the coordinate R3 (X1 + ΔX ′, Y1) with respect to the current right eye image, and the position information is positioned at the coordinate R3 (X1 + ΔX ′, Y1). An eye image is generated. In this case, a positional information shift amount occurs between the right eye image and the left eye image. Accordingly, in the virtual stereoscopic image, the position information moves from the reference plane to the back side.

  FIG. 8 is a diagram illustrating another example of the shift amount control operation by the position information control unit 28 according to the first embodiment. In FIG. 8, L indicates the left eye of the operator, and R indicates the right eye of the operator. In FIG. 8, the position information is positioned from the right eye of the display unit 16. That is, the position information is positioned on the extension line of the operator's right eye. Specifically, the position information control unit 28 positions the position information at coordinates L1 (X1 + ΔX, Y1) with respect to the left-eye image generated by the parallax image group generation unit 26, and the position information is coordinates L1 (X1 + ΔX, A new left eye image positioned at Y1) is generated. In addition, the position information control unit 28 positions the position information at coordinates R1 (X1 + ΔX, Y1) with respect to the right eye image generated by the parallax image group generation unit 26, and the position information is at coordinates R1 (X1 + ΔX, Y1). A new right eye image positioned is generated. In this case, there is no positional information shift amount between the right eye image and the left eye image.

  Here, the case where the position information positioned on the reference plane is moved to the near side in the depth direction will be described. In this case, the position information control unit 28 intersects the reference plane on the line connecting the position where the position information is imaged on the near side in the depth direction (indicated by a dotted circle in FIG. 8) and the viewpoint position of the left eye. The position information is moved to the coordinate L2 to be moved, and the position information is moved to the coordinate R2 intersecting the reference plane on the line connecting the position where the position information is imaged on the near side in the depth direction and the viewpoint position of the right eye. . For example, the position information control unit 28 positions the position information at the coordinate L2 (X1 + ΔX + α, Y1) with respect to the current left eye image, and the new left eye image at which the position information is positioned at the coordinate L2 (X1 + ΔX + α, Y1). Is generated. Also, the position information control unit 28 does not change the position information for the current right eye image (the coordinate R2 is the same as the coordinate R1). In this case, a positional information shift amount occurs between the right eye image and the left eye image. Accordingly, in the virtual stereoscopic image, the position information moves from the reference plane to the near side.

  Next, a case where position information positioned on the reference plane is moved to the back side in the depth direction will be described. In this case, the position information control unit 28 moves the position information to the coordinate L3 intersecting the reference plane on the line connecting the position where the position information is imaged on the far side in the depth direction and the viewpoint position of the left eye. The position information is moved to a coordinate R3 intersecting the reference plane on a line connecting the position where the position information is imaged on the far side in the depth direction and the viewpoint position of the right eye. For example, the position information control unit 28 positions the position information at coordinates L3 (X1 + ΔX−α, Y1) with respect to the current left eye image, and the position information is positioned at the coordinates L3 (X1 + ΔX−α, Y1). An eye image is generated. Further, the position information control unit 28 does not change the position information for the current right eye image (the coordinate R3 is the same as the coordinate R1). In this case, a positional information shift amount occurs between the right eye image and the left eye image. Accordingly, in the virtual stereoscopic image, the position information moves from the reference plane to the back side.

  As described above, in the first embodiment, the position information control unit 28 coordinates the position information to be moved in each parallax image based on the viewpoint position of the operator and the movement amount received from the operator. Therefore, an appropriate shift amount can be obtained. In the first embodiment, the example in which the viewpoint position of the operator is detected and the above process is performed has been described. However, the embodiment is not limited thereto. For example, assuming that the operator is standing in front of the display unit 16, the position information control unit 28 can obtain an appropriate shift amount without detecting the operator's viewpoint position.

  Next, a procedure of position information control processing by the X-ray diagnostic apparatus 100 according to the first embodiment will be described with reference to FIG. FIG. 9 is a flowchart showing a procedure of position information control processing by the X-ray diagnostic apparatus 100 according to the first embodiment. As shown in FIG. 9, the X-ray diagnostic apparatus 100 according to the first embodiment determines whether or not an operation in the depth direction has been received from the operator (step S101).

  If the X-ray diagnostic apparatus 100 according to the first embodiment determines that an operation in the depth direction has been received from the operator (step S101, Yes), the operator's viewpoint position is acquired (step S102).

  In addition, the X-ray diagnostic apparatus 100 according to the first embodiment calculates a position at which the moved position information corresponding to the movement amount received from the operator is imaged (step S103). For example, in the X-ray diagnostic apparatus 100 according to the first embodiment, the position information is imaged when the position information is moved to the near side in the depth direction according to the amount of movement received from the operator. A position where the position information is imaged when the position information is moved to the back side in the depth direction is calculated.

  Subsequently, the X-ray diagnostic apparatus 100 according to the first embodiment obtains coordinates intersecting the reference plane on a straight line connecting the detected viewpoint position and the position where the position information after movement is imaged (step) S104). Then, the position information control unit 28 generates each parallax image in which the position information is positioned at the obtained coordinates (step S105). For example, the X-ray diagnostic apparatus 100 according to the first embodiment generates a left eye image and a right eye image in which position information is moved to the obtained coordinates.

  The X-ray diagnostic apparatus 100 according to the first embodiment ends the position information control process after the process of step S103 ends. If the X-ray diagnostic apparatus 100 according to the first embodiment does not determine that an operation in the depth direction has been received from the operator (No in step S101), the determination in step S101 is repeated.

(Effects of the first embodiment)
As described above, according to the first embodiment, when an instruction to move the position information in the depth direction is received from the operator, the position information in each parallax image included in the parallax image group is received from the operator. By moving within each parallax image according to the received movement amount, the position information is moved in the depth direction in the stereoscopic image. Thereby, according to 1st Embodiment, the positional information which points to a position in a stereoscopic vision image can be displayed appropriately. The operator can correctly recognize the position indicated by the position information not only in the vertical and horizontal directions but also in the depth direction.

  Further, according to the first embodiment, in each parallax image, based on the viewpoint position of the operator, the movement amount received from the operator, and the coordinates where the position information is positioned in each parallax image. An appropriate shift amount is obtained by calculating the coordinates to which the position information is moved. Thereby, according to the first embodiment, position information can be appropriately moved in the depth direction in the stereoscopic image.

(Second Embodiment)
In the first embodiment, the example in which the position information is moved according to the operation by the operator has been described. By the way, for example, when endovascular treatment is assumed, it is considered that the operator has many opportunities to point to blood vessels and stents. Here, when the operator tries to move position information in the depth direction while pointing to a blood vessel or a stent, it is considered that a two-step operation is performed. For example, there are a first stage in which the position information is moved in the depth direction and a second stage in which the position information is moved in the left-right direction after the position information is moved in the depth direction. For this reason, in the second embodiment, a method for moving position information along an object such as a blood vessel or a stent will be described. In addition, as a method for moving position information along the object, there are “method A1 for automatically tracing” and “method A2 for automatically focusing on an object with high contrast”.

(Method A1 for automatic tracing)
In endovascular treatment, thin blood vessels and thin devices such as catheters, wires, leads, and stents are often displayed. For this reason, an operator may perform an operation of moving position information along a blood vessel or a device. Therefore, the position information control unit 28 according to the second embodiment further has a function of automatically tracing blood vessels and devices.

  The position information control unit 28 according to the second embodiment performs, for example, thinning processing on the parallax image group so that the line width of the line image is one pixel. Subsequently, the position information control unit 28 according to the second embodiment limits the movement on the thinned pixels (or the vicinity thereof) in the thinned parallax image group, and accepts a mouse operation. Then, the position information control unit 28 according to the second embodiment moves the position information in the depth direction along the blood vessel according to the received movement amount. Note that the position information control unit 28 according to the second embodiment generates and holds in advance information that associates coordinates between parallax image groups by pattern matching. For example, it is assumed that blood vessels are depicted in the left eye image and the right eye image in a state slightly shifted so as to be stereoscopically viewed. In this case, by performing pattern matching between the left eye image and the right eye image, a certain position on the blood vessel depicted in the left eye image can be specified on the blood vessel depicted in the right eye image. That is, coordinates can be associated between the left eye image and the right eye image. Note that the position information control unit 28 according to the second embodiment may specify a certain position on the blood vessel depicted in the right eye image on the blood vessel depicted in the left eye image.

  A specific example of a method of automatic tracing by the position information control unit 28 according to the second embodiment will be described with reference to FIG. FIG. 10 is a diagram illustrating an example of an automatic tracing method performed by the position information control unit 28 according to the second embodiment. As illustrated in FIG. 10, the position information control unit 28 according to the second embodiment thins the left eye image and the right eye image. Then, the position information control unit 28 according to the second embodiment generates, for example, a left eye image in which position information is positioned in L1 of the left eye image, and a right eye image in which position information is positioned in R1 of the right eye image. Is generated. Here, L1 of the left eye image and R1 of the right eye image indicate the same position. Then, the position information control unit 28 according to the second embodiment indicates the position information in the depth direction while the position information of the left eye image and the position information of the right eye image indicate the same position according to the received movement amount. An image is generated by moving.

  For example, when the position information control unit 28 according to the second embodiment receives an operation to move the position information to the near side from the operator in the stereoscopic image shown in FIG. An image moved in the direction along the blood vessel center line is generated. Specifically, the position information control unit 28 according to the second embodiment positions the position information at the coordinate L2 obtained according to the movement amount received from the operator in the left eye image. Subsequently, the position information control unit 28 according to the second embodiment specifies the coordinate R2 of the right eye image corresponding to the coordinate L2 of the left eye image by pattern matching. Then, the position information control unit 28 according to the second embodiment positions the position information at the coordinate R2 in the right eye image. Further, when the position information control unit 28 according to the second embodiment receives an operation for moving the position information to the back side in the stereoscopic image shown in FIG. An image moved in the direction along the blood vessel center line is generated. Specifically, the position information control unit 28 according to the second embodiment positions the position information at the coordinate L3 obtained according to the movement amount received from the operator in the left eye image. Subsequently, the position information control unit 28 according to the second embodiment specifies the coordinate R3 of the right eye image corresponding to the coordinate L3 of the left eye image by pattern matching. Then, the position information control unit 28 according to the second embodiment positions the position information at the coordinate R3 in the right eye image.

  Further, the position information control unit 28 according to the second embodiment receives position information along any blood vessel by accepting an operation of moving the mouse in the horizontal and vertical directions from the operator, for example, at a branch point of the blood vessel. Determine whether to move. For example, when the position information control unit 28 according to the second embodiment determines that the operation of moving the mouse to the right is accepted when the blood vessel branch point X is reached, an image in which the position information is moved in the C direction is generated. If it is determined that the operation of moving the mouse downward is accepted, an image in which position information is moved in the D direction is generated.

  Next, a procedure of position information control processing by the X-ray diagnostic apparatus 100 according to the second embodiment will be described with reference to FIG. FIG. 11 is a flowchart showing a procedure of position information control processing by the X-ray diagnostic apparatus 100 according to the second embodiment.

  As shown in FIG. 11, the X-ray diagnostic apparatus 100 according to the second embodiment determines whether or not the setting of the trace mode is accepted (step S201). And when it determines with the X-ray diagnostic apparatus 100 which concerns on 2nd Embodiment having received the setting of trace mode (step S201, Yes), it performs a thinning process with respect to a parallax image group (step S202). Thereby, the X-ray diagnostic apparatus 100 according to the second embodiment extracts blood vessels from, for example, a parallax image group. Note that, when the X-ray diagnostic apparatus 100 according to the second embodiment does not determine that the setting of the trace mode has been accepted (No at Step S201), the determination at Step S201 is repeated.

  Then, the X-ray diagnostic apparatus 100 according to the second embodiment receives an operation in the depth direction from the operator (step S203). Subsequently, the X-ray diagnostic apparatus 100 according to the second embodiment generates an image in which the position information is moved along the object according to the received movement amount (step S204). For example, when the X-ray diagnostic apparatus 100 according to the second embodiment receives an operation to the back side in the depth direction, the X-ray diagnostic apparatus 100 generates an image in which the position information is moved to the back side in the depth direction along the object. . Further, for example, when the X-ray diagnostic apparatus 100 according to the second embodiment receives an operation to the near side in the depth direction, an image obtained by moving the position information to the near side in the depth direction along the object is displayed. Generate.

  The X-ray diagnostic apparatus 100 according to the second embodiment determines whether or not the branch point has been reached (step S205). For example, when the target object is a blood vessel, the X-ray diagnostic apparatus 100 according to the second embodiment determines whether the branch point of the blood vessel has been reached.

  If the X-ray diagnostic apparatus 100 according to the second embodiment determines that the branch point has been reached (step S205, Yes), the selection from the operator is accepted (step S206). For example, when the X-ray diagnostic apparatus 100 according to the second embodiment reaches a blood vessel branch point, the X-ray diagnostic apparatus 100 receives an operation of moving the mouse to the left, right, up, or down from the operator and is positioned in the blood vessel that branches in the received direction. Generate an image with the information moved.

  The X-ray diagnostic apparatus 100 according to the second embodiment determines whether or not the end of the operation has been accepted when it is not determined that the branch point has been reached (No at Step S205) or after the end of Step S206. (Step S207). When the X-ray diagnostic apparatus 100 according to the second embodiment does not determine that the operation has been completed (No in Step S207), the X-ray diagnostic apparatus 100 proceeds to Step S203.

  On the other hand, if the X-ray diagnostic apparatus 100 according to the second embodiment determines that the end of the operation has been accepted (step S207, Yes), the process in the trace mode ends. The X-ray diagnostic apparatus 100 according to the second embodiment performs the same process as the X-ray diagnostic apparatus 100 according to the first embodiment after the process in the trace mode is completed. That is, the X-ray diagnostic apparatus 100 according to the second embodiment receives the position information of each image included in the parallax image group when receiving an instruction from the operator to move the position information in the depth direction in the stereoscopic image. The image is moved in each image according to the amount of movement received from the operator.

(Modification of method A1 for automatic tracing)
The position information control unit 28 according to the second embodiment pops up a candidate blood vessel that can be operated, for example, at a branch point of the blood vessel, and selects the blood vessel candidate selected by the operator from the displayed blood vessel candidates. The position information may be moved along.

  FIG. 12 shows an example of the processing operation of the position information control unit 28 when the position information reaches the blood vessel branch point. FIG. 12 is a diagram illustrating an example of the processing operation of the position information control unit 28 when the position information reaches the branch point of the blood vessel. In the stereoscopic image shown in FIG. 12, when the position information reaches the branch point X of the blood vessel, the position information control unit 28 according to the second embodiment pops up “right click” and “left click”. When the position information control unit 28 according to the second embodiment receives a right click operation from the operator, the position information control unit 28 moves the position information in the direction A in FIG. 12 along the blood vessel center line. Further, the position information control unit 28 according to the second embodiment moves the position information in the B direction in FIG. 12 along the blood vessel center line when the left lick operation is received from the operator.

  Further, the position information control unit 28 according to the second embodiment may be displayed by changing the color of the candidate blood vessel, for example, at the branch point of the blood vessel.

  In addition, for example, the position information control unit 28 according to the second embodiment may select one of the blood vessels at the branch point of the blood vessel and move the position information along the selected blood vessel. In this case, when the operator selects a blood vessel different from the blood vessel to be observed, the position information control unit 28 according to the second embodiment accepts the blood vessel to be observed from the operator.

  Further, the position information control unit 28 according to the second embodiment has described the case where blood vessels and devices are extracted from a parallax image group by thinning processing, but blood vessels and devices are extracted from the parallax image group by binarization processing. May be.

  As described above, the position information control unit 28 according to the second embodiment moves the position information in the parallax image along the blood vessel extracted by thinning (along the blood vessel center line). Thereby, the operator can easily perform an operation of moving the position information in the depth direction along the blood vessel.

(Method A2 for automatically focusing on an object with high contrast)
In many cases, both angiographic images and images of devices such as stents are images of long and thin objects with high contrast on a flat background. Therefore, the position information control unit 28 according to the second embodiment further has a function of automatically adjusting the depth to a nearby high-contrast object (blood vessel) in the method A2 for automatically focusing on a high-contrast object. Have.

  For example, the position information control unit 28 according to the second embodiment automatically adjusts the position information for a high-contrast object (blood vessel or device) in the parallax image group when the function for automatically focusing on a high-contrast object is set. To do. Then, the position information control unit 28 according to the second embodiment receives a mouse operation from the operator, and moves the position information in the depth direction along the blood vessel or the device according to the received movement amount. Note that the position information control unit 28 according to the second embodiment generates and holds in advance information that associates coordinates between parallax image groups by pattern matching.

  The processing operation of the position information control unit 28 when the function of automatically focusing on an object with high contrast is set will be described with reference to FIG. FIG. 13 is a diagram illustrating an example of the processing operation of the position information control unit 28 when the function of automatically focusing on an object with high contrast is set. FIG. 13 shows a group of parallax images obtained by photographing the coronary artery after administration of the angiographic agent.

  As illustrated in FIG. 13, the position information control unit 28 according to the second embodiment determines the contrast based on the image value in the parallax image when the function of automatically focusing on an object with high contrast is set, The position information is adjusted to the blood vessel having high contrast in the parallax image by administration of the angiographic contrast agent. For example, the position information control unit 28 according to the second embodiment generates a left eye image in which position information is positioned at L1 of the left eye image that is closest to the position information initially placed by the operator, and the right eye A right eye image in which position information is positioned at R1 of the image is generated. Here, L1 of the left eye image and R1 of the right eye image indicate the same position. Then, the position information control unit 28 according to the second embodiment indicates the position information in the depth direction while the position information of the left eye image and the position information of the right eye image indicate the same position according to the received movement amount. An image is generated by moving.

  In the stereoscopic image shown in FIG. 13, when an operation for moving the position information to the near side is received from the operator, an image is generated in which the position information is moved in the direction A in FIG. 13 along the blood vessel center line. Specifically, the position information control unit 28 according to the second embodiment positions the position information at the coordinate L2 obtained according to the movement amount received from the operator in the left eye image. Subsequently, the position information control unit 28 according to the second embodiment specifies the coordinate R2 of the right eye image corresponding to the coordinate L2 of the left eye image by pattern matching. Then, the position information control unit 28 according to the second embodiment positions the position information at the coordinate R2 in the right eye image. In addition, when the position information control unit 28 according to the second embodiment receives an operation for moving the position information to the back side from the operator in the stereoscopic image illustrated in FIG. An image moved in the direction along the blood vessel center line is generated. Specifically, the position information control unit 28 according to the second embodiment positions the position information at the coordinate L3 obtained according to the movement amount received from the operator in the left eye image. Subsequently, the position information control unit 28 according to the second embodiment specifies the coordinate R3 of the right eye image corresponding to the coordinate L3 of the left eye image by pattern matching. Then, the position information control unit 28 according to the second embodiment positions the position information at the coordinate R3 in the right eye image.

  In addition, the position information control unit 28 according to the second embodiment restricts the movement range of the position information to an object having a high contrast when the position information is likely to be separated from the object having a high contrast.

  Next, a procedure of position information control processing by the X-ray diagnostic apparatus 100 according to the second embodiment will be described with reference to FIG. FIG. 14 is a flowchart illustrating a procedure of position information control processing by the X-ray diagnostic apparatus 100 according to the second embodiment.

  As illustrated in FIG. 14, the X-ray diagnostic apparatus 100 according to the second embodiment determines whether or not the setting of a function for automatically focusing on an object with high contrast has been received (step S301). If the X-ray diagnostic apparatus 100 according to the second embodiment determines that the setting of a function for automatically focusing an object with high contrast has been accepted (Yes in step S301), the X-ray diagnostic apparatus 100 determines contrast (step S302). For example, the X-ray diagnostic apparatus 100 according to the second embodiment extracts devices such as blood vessels and stents from the parallax image group. Note that the X-ray diagnostic apparatus 100 according to the second embodiment repeats the determination of Step S301 when it is not determined that the setting of the function of automatically focusing on an object with high contrast has been received (No at Step S301). Note that the processing procedure from step S303 to step S307 is the same as the processing procedure from step S203 to step S207 shown in FIG.

  As described above, the position information control unit 28 according to the second embodiment moves the position information in the parallax image along the blood vessel extracted based on the contrast (along the blood vessel center line). Thereby, the operator can easily perform an operation of moving the position information in the depth direction along the blood vessel.

  As described above, according to the second embodiment, position information can be moved in the depth direction along an object such as a blood vessel or a stent.

(Third embodiment)
As shown in FIG. 4, a doctor or engineer located away from the operating room may give an instruction to the monitor observed by the doctor in the operating room by operating the monitor. Even when a 3D monitor is used as a monitor to be observed by a doctor in the operating room, a 2D monitor may be used as a monitor used by a doctor or an engineer located away from the operating room. Therefore, as a third embodiment, an example in which position information is instructed to a 3D monitor used by a doctor in an operating room when a doctor or an engineer who is away from the operating room uses the 2D monitor will be described.

  The position information control unit 28 according to the third embodiment is configured such that when an engineer who views a 2D monitor installed in a separate room operates the mouse to specify position information in the parallax image group, the 3D installed in the operating room. The position information is automatically displayed on the stereoscopic image displayed on the monitor. An example will be described in which the parallax image group is a right eye image and a left eye image.

  For example, when the position information control unit 28 according to the third embodiment receives an operation for moving the position information so as to indicate the position of the object in the right eye image from an operator in another room, the position information control unit 28 performs the left by pattern matching. The position information is moved to a corresponding position in the eye image. As a result, the position information control unit 28 according to the third embodiment moves the position information to the position designated by the 2D monitor and displays it on the 3D monitor installed in the operating room. That is, in the position information control unit 28 according to the third embodiment, the right eye image in which the position information is positioned so as to indicate the position where the object is located and the position information are positioned so as to indicate the position where the object is present. Using the left eye image, position information positioned to indicate the position of the object in the stereoscopic image is displayed on the 3D monitor installed in the operating room. When the position information control unit 28 according to the third embodiment receives an operation for moving the position information so as to indicate the position of the object in the left eye image from an operator in another room, the position information control unit 28 performs the right by pattern matching. The position information may be moved to a corresponding position in the eye image. In addition, the position information control unit 28 according to the third embodiment does not perform pattern matching, and there is an operation in the position of moving the position information so as to indicate the position of the object in the right eye image and the object in the left eye image. An operation for moving the position information so as to indicate the position may be received from the operator.

  Further, the position information control unit 28 according to the third embodiment uses the “method A1 for automatically tracing” described in the second embodiment and the method A2 for automatically focusing on an object with high contrast in combination. Is possible. For example, when the position information control unit 28 according to the third embodiment receives the setting of the trace mode from an operator observing a 2D monitor installed in a separate room, the parallax image group is thinned and the 2D in the separate room is displayed. Display on the monitor. Then, the position information control unit 28 according to the third embodiment is installed in the operating room when an operation for moving the position information in the parallax image group so as to point to a position where the object is present is received from an operator in another room. In the 3D monitor, the position information is moved to a position designated by the 2D monitor and displayed. In addition, when the position information control unit 28 according to the third embodiment receives an operation of moving the position information from an operator in the operating room, the position information control unit 28 moves the position information in the vicinity of the object.

  In addition, when the position information control unit 28 according to the third embodiment receives a setting for automatically focusing an object with high contrast from an operator observing a 2D monitor installed in a separate room, the position information control unit 28 in the parallax image group The position information is automatically adjusted to objects with high height (blood vessels and devices). The position information control unit 28 according to the third embodiment is installed in the operating room when receiving an operation for displaying the position information by moving the operator so as to point to a position where the object is located from an operator in another room. In the 3D monitor, the position information is moved to a position designated by the 2D monitor and displayed.

  As described above, according to the third embodiment, when a doctor or engineer who is away from the operating room uses the 2D monitor, the position information is instructed to the 3D monitor used by the doctor in the operating room. can do.

  In the second embodiment, an example of moving along a blood vessel has been described. However, the movement is not limited to a blood vessel, and may be performed along other organs.

  Although the example which moves the positional information on the stereoscopic image which the X-ray diagnostic apparatus 100 displays was demonstrated, embodiment is not limited to this. For example, when a medical image diagnostic apparatus such as an ultrasonic diagnostic apparatus, an X-ray CT apparatus, or MRI (Magnetic Resonance Imaging) displays a stereoscopic image using three-dimensional image data collected by itself, the stereoscopic image The position information may be moved. The medical image diagnostic apparatus may transfer the three-dimensional image data collected by the own apparatus to the image display apparatus. That is, the medical image diagnostic apparatus collects three-dimensional image data. The medical image diagnostic apparatus displays a stereoscopic image on the display unit using the parallax image group generated from the three-dimensional image data, and displays position information indicating a position in the stereoscopic image on the display unit. To do. Subsequently, when the medical image diagnostic apparatus receives an instruction to move the position information in the depth direction in the stereoscopic image from the operator, the movement received from the operator is the position information of each image included in the parallax image group. By moving within each parallax image according to the amount, the position information is moved in the depth direction on the display unit. Thereby, the medical image diagnostic apparatus can appropriately display the position information indicating the position in the stereoscopic image.

  The image display device displays a stereoscopic image on the display unit using the parallax image group generated from the three-dimensional image data, and displays position information indicating a position in the stereoscopic image on the display unit. . For example, the image display device three-dimensionally displays a stereoscopic image on the display unit using a parallax image group generated from three-dimensional medical image data collected by the medical image diagnostic device, and positions the position in the stereoscopic image. The indicated position information is displayed on the display unit. Then, when receiving an instruction from the operator to move the position information in the depth direction in the stereoscopic image, the image display device sets the position information of each image included in the parallax image group to the amount of movement received from the operator. Accordingly, the position information is moved in the depth direction on the display unit by being moved within each parallax image. Thereby, the image display apparatus can appropriately display position information indicating a position in the stereoscopic image. Note that the three-dimensional image data is not limited to the three-dimensional medical image data collected by the medical image diagnostic apparatus, and may be non-medical image data.

  According to the image display device and the medical image diagnostic device of at least one embodiment described above, position information indicating a position in a stereoscopic image can be appropriately displayed.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

27 Display Control Unit 28 Position Information Control Unit 100 X-ray Diagnostic Device

Claims (5)

A display control unit that three-dimensionally displays a stereoscopic image on a display unit using a parallax image group generated from three-dimensional image data, and three-dimensionally displays position information indicating a position in the stereoscopic image on the display unit; ,
When an instruction to move the position information in the depth direction in the stereoscopic image is received from an operator, the position information in each parallax image included in the parallax image group depends on the amount of movement received from the operator. An image display device comprising: a position information control unit that moves within each parallax image. The position information control unit moves the position information in each parallax image based on the viewpoint position of the operator, the movement amount received from the operator, and the coordinates where the position information is positioned in each parallax image. The image display device according to claim 1, wherein the coordinates to be used are calculated. The position information control unit extracts an object from the parallax image by thinning at least one parallax image in the parallax image group, and the position on the extracted object or in the vicinity of the object The image display apparatus according to claim 1, wherein the information is moved. The position information control unit extracts an object from the parallax image based on a contrast in at least one parallax image in the parallax image group, and obtains the position information on the extracted object or in the vicinity of the object. The image display device according to claim 1, wherein the image display device is moved. A collection unit for collecting three-dimensional image data;
A display control unit that three-dimensionally displays a stereoscopic image on a display unit using a parallax image group generated from the three-dimensional image data, and displays position information indicating a position in the stereoscopic image on the display unit;
When an instruction to move the position information in the depth direction in the stereoscopic image is received from an operator, the position information in each parallax image included in the parallax image group depends on the amount of movement received from the operator. And a position information control unit that moves within each parallax image.

Images