JP2002101428A - Image stereoscopic vision display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image stereoscopic vision display device that can efficiently refer to three-dimensional image data. SOLUTION: This invention provides the image stereoscopic vision display device that generates a right eye projection image and a left eye projection image based on three-dimensional image data in existence in a set display range and stereoscopically displays an object based on each projection image. By moving a relative position of the display range with respect to the three- dimensional image data and executing change of a size of the display range, stereoscopic vision of a desired image can be attained. A user can easily make operations with respect to the movement and the change by using a user interface section displayed on a display section.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device for displaying an image stereoscopically.

[0002]

2. Description of the Related Art Diagnostic imaging in medicine provides a great deal of information about a subject in the form of an image, and plays an important role in many medical activities such as diagnosis, treatment and surgical planning of diseases. I have. At present, ultrasonic diagnostic equipment, X-ray CT equipment, magnetic resonance imaging (MR
I) It is possible to collect image data by various methods using main medical imaging devices such as an apparatus and a nuclear medicine diagnostic apparatus.
In particular, in recent years, multi-slice CT and cone beam C
With the advent of T, volume data collection with high spatial resolution in the body axis direction has become possible. As a result, a large amount of high-resolution image data for image diagnosis can be easily obtained. The three-dimensional image data of the subject collected by these medical imaging devices is displayed in various display forms (for example, two-dimensional cross-section display, projection display, volume rendering and surface rendering, binocular parallax, It is displayed in stereoscopic display using motion parallax, and used for diagnosis.

[0003]

However, when a large amount of image data obtained by, for example, multi-slice CT is displayed by various conventional methods, the following problems exist.

[0004] In the case of performing image reading in two-dimensional cross-section display, the image reading load increases as the number of images increases. Projection display and M
IP (Mnximum Intensity Proj)
In the (action) display, information in the depth direction is lost, and the advantage of three-dimensional high spatial resolution data cannot be utilized.

Further, volume rendering, surface rendering, and the like require time and labor for setting parameters for image creation and time for image creation processing, and require diagnostic capability for image creation, increasing the burden on doctors who interpret images. May lead to

Also, in stereoscopic display using a projected image, if the width of the image data in the depth direction is large, the data in the depth direction may overlap and the depth information may be lost.

[0007]

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and has as its object to provide an image stereoscopic display device capable of efficiently referring to three-dimensional image data.

[0008] A first viewpoint of the present invention is based on setting means for setting a display range for three-dimensional image data of a subject, and based on the three-dimensional image data present in the set display range. An image generating means for generating a right-eye projection image and a left-eye projection image; and a display means for stereoscopically displaying the subject based on the right-eye projection image and the left-eye projection image. It is a stereoscopic display device.

According to a second aspect of the present invention, in the apparatus according to the first aspect, the apparatus further comprises display range moving means for moving a relative position of the display range with respect to the three-dimensional image data. Things.

A third viewpoint of the present invention is the device according to the first viewpoint, further comprising a display range changing means for changing the size of the display range.

According to a fourth aspect of the present invention, in the apparatus according to the second or third aspect, when the display range moving means continuously operates, the image generating means includes the right-eye projection image or the right-eye projection image. One of the left-eye projection images is generated, and the display unit stereoscopically displays the subject based on the one image.

According to a fifth aspect of the present invention, in the apparatus according to the first aspect, the image generation means generates direction information capable of determining correspondence between the direction of the projection image and the direction of the subject, The display means stereoscopically displays the direction information and each of the projection images simultaneously.

According to a sixth aspect of the present invention, in the device according to the fifth aspect, the direction information is provided at a position corresponding to the display range, and the display means displays the direction information in a stereoscopic display. It is characterized by doing.

According to such a configuration, it is possible to realize an image display device capable of efficiently referring to three-dimensional image data.

[0015]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a first embodiment and a second embodiment of the present invention will be described with reference to the drawings. In the following description, components having substantially the same functions and configurations are denoted by the same reference numerals, and repeated description will be made only when necessary.

[First Embodiment] First, a block configuration of a stereoscopic display device according to the present invention will be described with reference to FIG.

FIG. 1 shows a block diagram of a stereoscopic display device according to the present invention.

The three-dimensional display device 1 includes a user interface unit 10, a CRT monitor 12, and a screen switching control unit 2.
0, image processing unit 30, polarizing glasses 40, polarizing shutter 4
2. It has a mouse device 44. Hereinafter, each component will be described in detail.

<Image Processing Unit> Next, the schematic configuration of the image processing unit 30 will be described with reference to FIG.

The image processing unit 30 includes an image data storage unit 30
0, image data selection list creation unit 302, image data reading unit 304, memory 306, projection image creation unit 30
8, an image data coordinate conversion unit 310, an image direction display creation unit 312, a screen data creation unit 314, a left-eye screen video memory 316, a right-eye screen video memory 318, an operation input processing unit 320, and a CPU 322.

The image data storage section 300 stores image data captured by the medical image diagnostic apparatus.

The image data selection list creation unit 302 reads out the patient ID, loyalty name, examination date and time, modality name, and imaging conditions from the supplementary information of the image data stored in the image data storage unit and creates a list.

The image data reading section 304 reads the image data selected by the operator in the image data selecting section into the memory.

The memory 306 holds image data.
The image data is managed so that pixels can be designated by three-dimensional coordinates in the image data coordinate system (FIG. 10).

The projection image creation unit 308 performs processing according to the projection method (perspective projection or parallel projection) in the projection image creation selected by the operator in the projection method selection unit. Specific processing by each projection method will be described later in detail.

The image data coordinate conversion unit 310 performs default coordinate conversion and conversion processing according to the image data moving operation as described later.

The image direction display creating unit 312 performs the following processing on the image data after the coordinate return.

The image data has the direction of the image corresponding to the subject as in the example shown in FIG. The image direction display creation unit 312 represents a three-dimensional figure (referred to as image direction display) shown in FIG. A projection image creation unit 30 is arranged in a coordinate system stereoscopically viewable image data display range and projects the figure on a projection plane.
Fit into the projection image created in step 8. By viewing the three-dimensional figure three-dimensionally, the observer can grasp the direction of the image data with a more three-dimensional effect. The image direction display (three-dimensional figure) is coordinate-transformed together with the image data, and is then moved parallel to the position shown in FIG. 13, for example.

As shown in FIG. 13, by arranging the image direction display at a position close to the stereoscopically viewable area in the depth (y direction) in the virtual view coordinate system, the stereoscopic view of the image data is reduced by the stereoscopic characteristics. There is an advantage that the transition to the stereoscopic viewing of the image direction display can be easily performed.

The screen data creation unit 314 includes a left-view image display unit 104 for displaying left and right-view projection image data created by the projection image creation unit and the image direction display creation unit. Create screen data,
They are registered in the left-eye screen video memory 310 and the right-eye screen video memory 318, respectively.

The left-eye screen video memory 316 holds the left-eye screen data created by the screen data creation unit.

The right-eye screen video memory 318 holds the right-eye screen data created by the screen data creation unit.

The operation input processing section 320 performs input processing of operation of the mouse device.

The CPU 322 controls each component.

<User Interface Unit> The user interface unit 10 is a characteristic part of the image stereoscopic display device displayed on the screen of the CRT monitor 12, and has each operation means shown in FIGS. 2 and 3. . That is, FIG.
And the user interface unit 10 as shown in FIG.
Are the image data selection unit 100 and the image data information display unit 1
02, image display unit 104, virtual field setting parameter setting unit 106, image data display range width setting unit 108, image data depth direction movement amount setting unit 110, image data depth direction movement operation unit 112, image display gradation setting unit 114 Image magnification ratio setting unit 116, projected image type selection unit 118, image data parallel movement amount setting unit 120, image data parallel movement operation unit 122, image data rotation movement amount setting unit 124, image data rotation movement operation unit 126, projection Method selection unit 128,
A default image observation direction selection unit 130.
The stereoscopic display device is operated by an input unit such as a mouse device 40 or a keyboard (not shown) via the user interface unit 10.

The image data selection section 100 displays a list created by an image data selection list creation section 302 described later. Image data to be stereoscopically displayed is selected from the list.

The image data information display section 102 displays information (patient ID, patient name, examination date and time, modality name (CT, MRI) of the image data selected from the image data selecting section 100.
, Etc., and photographing conditions) are displayed.

The image display unit 104 simultaneously displays a left-eye projection image, a left-eye projection image, and an image direction display for indicating the direction of the displayed image. This image direction display will be described later.

The virtual view setting parameter setting section (see FIG. 3) 106 is an operation section for setting parameters for defining the virtual view. The virtual view setting parameter setting unit 106 displays the content shown in FIG. 3 by clicking “option” displayed at the upper left of the user interface unit 10 shown in FIG.
The screen is displayed by selecting "ramper".
In this embodiment, the “virtual view setting parameter” for defining the virtual view includes a distance de between the left and right virtual viewpoints, a distance dr from the virtual viewpoint to the center of the image data display range, and a display range width of the image data. wr, a distance dp from the virtual viewpoint to the projection plane, a height hp of the projection plane, and a width wp of the projection plane are introduced. The operator controls the virtual view setting parameter setting unit 106 to control the distance de between the left and right virtual viewpoints and the distance dr from the virtual viewpoint to the center of the image data display range.

The image data display range width setting unit 108 is an operation unit for setting a display range width (hereinafter, referred to as a variable wr) of image data which is stereoscopically viewed by the operator (for example, FIG. 4).
(A)).

Image data depth direction movement amount setting unit 110
Is an operation unit for setting a moving amount of image data to be moved by one moving operation from the image data depth direction moving operation unit 112.

Image data depth direction moving operation unit 112
Is an operation unit for performing a moving operation of moving image data in the depth direction with respect to the screen. The operator moves the cursor to the arrow in the front direction or the depth direction and clicks the button of the mouse device 44 to move the image data forward (or backward) by the moving amount set by the image data depth direction moving amount setting unit 110. ) Can be moved.

The image display gradation setting section 114 is an operation section for setting the display gradation of the projected image displayed on the image display section 104. The operator can set the gradation to a desired level, for example, by moving the cursor to a predetermined level and clicking a button of the mouse device 44.

The image enlargement ratio setting unit 116 is an operation unit for the operator to set the enlargement ratio of the projected image displayed on the image display unit 104. The enlargement ratio can be determined by determining the value of the parameter a corresponding to the enlargement ratio. This will be described later.

The projection image type selection section 118 allows the operator to select the type of projection image (simple projection, MIP (maximum value projection), Min
-IP (minimum value projection) or the like.

The image data parallel movement amount setting section 120 is an operation section for setting a parallel movement step amount of a projection image to be moved by one movement operation from the image data parallel movement operation section 122.

The image data translation operation unit 122 is an operation unit for performing a translation operation for translating the projection image displayed on the image display unit 104 in parallel. Here, the parallel movement refers to a movement in a direction along the screen. Here, the amount of data movement by one operation follows the amount set by the image data parallel movement amount setting unit 120.

The image data rotation / movement amount setting section 124 is an operation section for setting the rotation / movement step amount of the projection image to be moved by one movement operation from the image data parallel movement operation section 122. Note that the rotation means a rotation in a virtual view coordinate system. This rotation will be described later in detail.

The image data rotation / movement operation unit 126 is an operation unit for performing a movement operation for rotating / moving the projection image displayed on the image display unit 104.

The projection method selection unit 128 (see FIG. 3) is an operation unit for selecting a projection method (perspective projection or parallel projection) in the projection image creation performed by the projection image creation unit 308.

The default image observation direction selection unit 130 (see FIG. 3) is an operation unit for the operator to select a default image data observation direction (Axial / Sagittal / Coronal).

<Screen Switching Control Unit> The screen switching control unit 20 alternately switches the screen displayed on the CRT monitor by one frame at a time between the screens held by the left-eye screen video memory and the right-eye screen video memory (frame rate). Is preferably 60 times / second or more). In synchronism therewith, the deflection shutter is switched to 90 degrees when the right-eye screen is displayed, and to 0 degrees when the left-eye screen is displayed.

<Others> The deflection glasses 40 are set to 0 for the left eye.
The right and left eyes are glasses with a 90-degree deflection filter.
The observer can stereoscopically view the image data by wearing the glasses and observing the screen of the CRT monitor.

The deflecting shutter 42 has a deflecting filter of 0 degree, 9 deg.
It has a function of alternately switching at 0 degrees. Place it on the front of the CRT monitor.

The CRT monitor 12 alternately displays the screens stored in the left-eye and right-eye screen video memories under the control of the screen switching control unit.

The mouse device 44 is input means for inputting instruction information from an operator to the device.

Next, image processing executed by the stereoscopic display device will be described. A feature of the image stereoscopic display device according to the present embodiment is that the range of image data to be stereoscopically viewed can be arbitrarily set / changed, and has a user interface that facilitates operations related to the setting / change. That is.

<Projection Image Creation Processing> The projection image creation processing is executed in the projection image creation unit 308. The projection image is created for the right eye and the left eye for stereoscopic display. Hereinafter, the cases of the perspective projection and the parallel projection will be described in detail.

(1) In the case of perspective projection First, the range of image data to be projected will be described.

FIG. 4A shows an xy plane of a three-dimensional virtual visual field coordinate system set in creating a projection image. FIG. 4B shows a zy plane of the same coordinate system.

The range of image data to be projected is shown in FIG.
The distance d between the left and right virtual viewpoints in the virtual view coordinate system shown in FIG.
e, the distance dr from the virtual viewpoint to the center of the image data display range, the value of each parameter (de, dr, wr) of the display range wr of the image data stereoscopically viewed by the operator, and the distance from the virtual viewpoint to the projection plane Are uniquely determined by determining the value of the parameter dp indicating the height, the height hp (see FIG. 4B) of the projection plane, and the width wp.

In the present embodiment, the height hp of the projection plane
The vertical matrix size Ih of the image data (see FIG. 10) and the width wp of the projection plane are set as the horizontal matrix size Iw of the image data (see FIG. 10).

In this embodiment, as shown in FIG. 4A, the center of the image data is set to (x,
y, z) = (0, dr, 0). The projection plane is set such that a straight line connecting the center of the image data and the virtual viewpoint passes through the center of the projection plane.

Further, dp is changed in accordance with the enlargement ratio of the image displayed on the image display unit set by the operator in the image enlargement ratio setting unit 116. In the present embodiment, when the image enlargement ratio is a times, dp = (dr−wr) × a. Therefore, when the magnification is one, a = 1 and dp = d
r-wr.

<Projection Table Creation Processing> Next, creation of a projection table will be described. The projection table is defined as coordinates (xc, yc, zc) in the image data display range.
Is a table for associating a pixel with a pixel with coordinates (xcp, ycp) in the projection plane coordinate system.

In the present embodiment, the pixel (FIGS. 5A and 5B) at the coordinates (xc, yc, zc) in the image data display range of the virtual viewpoint coordinate system is calculated by the following equation (1). ,
Based on (2), the image is projected onto the pixel (FIG. 6A) at the coordinates (xcp, ycp) in the projection plane coordinate system.

Xcp = (xc-xl) / (xh-xl) × wp Expression (1) ycp = (zc-zl) / (zh-zl) × hp Expression (2) where xl = de / 2 (Yc / dp × wp / 2 + yc / dr × de / 2) xh = de / 2 + (yc / dp × wp / 2−yc / dr × de / 2) zl = −yc / dp × hp / 2 zh = yc / Dp × hp / 2 The correspondence of projection based on the formulas (1) and (2) is stored as a projection table for each pixel as shown in FIG.
Note that the projection table shown in FIG. 7 stores coordinates on the projection plane of the projection destination using, as an index, numbers assigned in the x, y, and z directions to pixels in the image data display range. By doing so, the load of the calculation processing can be reduced.

As can be seen from equations (1) and (2), the contents of the projection table (ie, the coordinates of each pixel on the projection plane on which each pixel in the image data display range is projected)
Does not change unless the values of the parameters de, dr, wr, dp, hp, wp are changed. Therefore, it is preferable that the projection table is calculated and stored each time the parameters defining the range of the image data are changed. With such a configuration, the calculation of creating a new projection table is not executed unless each parameter is changed. Therefore, even when the image data is translated or rotated to re-create the projected image, the current projection table is not calculated. Only the projection calculation of the pixel values of the image needs to be performed using the table.

<Projection of Image Data> Next, the projection of image data will be described.

The type of the projection image selected by the operator via the projection image type selection unit 118 (simple projection, MIP, etc.)
, A projection process is executed based on the projection table. The coordinates (xc, y) in the virtual view coordinate system
The pixel value of the pixel corresponding to (c, zc) is represented by coordinates (xc,
yc, zc) The coordinates (Ix) in the image data coordinate system (see FIG. 10) converted by the inverse matrix Mn ^-1 of the coordinate conversion matrix Mn (see equation (5)) calculated by the image data coordinate conversion unit.
The pixel value of the pixel of (c, Iyc, Izc) is referred to.

Next, generation of a projection image will be described separately for a case where the type of the projection image is a simple projection and a case where the type of the projection image is a MIP.

(In the case of simple projection) First, the projection image creation unit 308 sequentially reads out the pixels in the image data display range from the memory 306 in the order of the x direction, the y direction, and the z direction. Is added to the pixel value of the pixel at the coordinates (xcpi, ycpi) on the projection plane stored in the table with the index number of the projection table i. This addition process is executed for all pixels within the range of image data to be projected.

When the above processing is completed for all the pixels in the image data display range, the current pixel value (added pixel value) is divided by the number of additions for each pixel on the projection plane, and an averaging is performed. The obtained image of the projection plane is a projection image. A projection image is created for each of the left and right eyes.

(In the case of MIP) The pixels in the image data display range are sequentially read out in the x, y, and z directions, and the pixel value of the i-th pixel and the index number of the projection table are stored in the table of i. Coordinates (x
cpi, ycpi) are compared, and if the former value is larger, the former value is set to the latter value. This is performed for all pixels in the image data display range. The obtained image of the projection plane is a projection image. A projection image is created for each of the left and right eyes.

<Gradation Conversion of Projected Image> With the parameters WL and WW set by the image display gradation setting unit 114,
The pixel values of the projected images (WL-WW / 2) to (WL + WW / 2) are linearly converted into 0 to 255 gradations. (WL-W
Pixel values below (W / 2) are converted to 0, and pixel values above (WL + WW / 2) are converted to 255.

(2) Case of Parallel Projection Next, the projection processing by parallel projection will be described.

First, the range of image data to be projected will be described. The range of the image data to be projected is the distance d between the left and right virtual viewpoints in the virtual view coordinate system shown in FIG.
e, the distance dr from the virtual viewpoint to the center of the image data display range, the value of each parameter (de, dr, wr) of the display range wr of the image data stereoscopically viewed by the operator, and the size of the projection plane. It is determined. The size of the projection plane is equal to the display image size (that is, the height hp and the width wp). This is because in the case of parallel projection, the distance from the virtual viewpoint to the projection plane is not relevant.

In the present embodiment, the center of the image data is defined as (x, y, z) = (0, dr, 0) in the virtual view coordinate system.
Set to. The projection plane is set such that a straight line connecting the center of the image data and the virtual viewpoint passes through the center of the projection plane.

Next, the creation of the projection table will be described.

A pixel at coordinates (xc, yc, zc) in the image data display range of the virtual viewpoint coordinate system (FIG. 9A,
(B)) is projected onto the pixel (FIG. 6A) at the coordinates (xcp, ycp) in the projection plane coordinate system calculated by the following equations (3) and (4).

Xcp = xc-xl Expression (3) ycp = zc-zl Expression (4) where xl is the smallest x-coordinate of the image data display range at y = yc. Zl is the image data display at y = yc. The z-coordinate of the smallest range The contents of the projection table (that is, the coordinates of each pixel on the projection plane onto which each pixel of the image data display range is projected) are determined by the values of the parameters de, dr, wr, dp, hp, and wp. It does not change unless it is changed. Therefore, as in the case of the above-described perspective projection, it is preferable that the projection table be calculated and stored every time each parameter that defines the range of image data is changed. With such a configuration, the calculation of creating a new projection table is not executed unless each parameter is changed. Therefore, even when the image data is translated or rotated to re-create the projected image, the current projection table is not calculated. Only the projection calculation of the pixel values of the image needs to be performed using the table.

As shown in FIG. 7, the projection table stores the coordinates on the projection plane of the projection destination using, as an index, the numbers assigned in the x, y, and z directions to the pixels in the image data display range. . By doing so, the load of the calculation processing can be reduced.

Next, the projection of image data is the same as in the case of perspective projection.

Next, the enlargement of the projected image will be described.

The enlargement / reduction of the projected image in the case of the parallel projection is performed by one of the above-described methods according to the enlargement ratio of the image displayed on the image display unit set by the operator in the image enlargement ratio setting unit 116. Is enlarged / reduced with respect to the projection image created by the above.

Next, the gradation conversion of the projected image will be described.

According to the parameters WL and WW set by the image display gradation setting section 114, (WL-WW / 2) to (W
(L + WW / 2) linearly from 0 to 255
Convert to gradation. Pixel values below (WL-WW / 2) are converted to 0, and pixel values above (WL + WW / 2) are converted to 255.

<Coordinate Conversion According to Image Data Movement Operation> According to the present stereoscopic display device, data corresponding to a displayed image is moved in a virtual view coordinate system.
Stereoscopic viewing from a desired line of sight is possible. Hereinafter, a coordinate conversion process performed by the image data coordinate conversion unit 310 in accordance with the moving operation of the operator will be described.

First, an instruction to move image data is input through the user interface unit 10 as follows.

(Parallel movement of image data in the depth direction)
Every time the key of the image data depth direction movement operation unit 112 is clicked once, the image data depth direction movement amount setting unit 1
The image data is translated in the depth direction, that is, in the y-axis direction of the virtual visual field coordinate system, forward (or backward) by the movement amount set in step 10. If the key is continuously pressed, the movement is repeated.

(Parallel movement of image data on a plane parallel to the screen) When the operator performs a parallel movement operation of the image displayed on the image display unit in the image data parallel movement operation unit,
When the UP key is operated, the vertical and horizontal directions of the screen, that is, the Z axis direction of the virtual view coordinate system,
Further, parallel movement is performed in the X-axis direction by the movement amount set by the image data parallel movement amount setting unit. If the key is continuously pressed, the movement is repeated.

(Rotation and Movement of Image Data) In the image data rotation and movement operation unit 126, when an operator performs a rotation and movement operation of an image displayed on the image display unit, the virtual view coordinate system is moved in the direction of the operated UP key. (0, dr, 0) is the rotation center, and the image data is rotated by the rotation step amount set by the image data rotation amount setting unit 124.

Next, coordinate conversion according to each movement will be described. This coordinate conversion is executed by the image data coordinate conversion unit 310 based on the above-mentioned moving operation.

The coordinate transformation matrix Mn of the image data is generally represented by equation (5).

Mn = Mc (coordinate transformation matrix according to current movement operation) × Mo (Mn before current operation) Expression (5) Hereinafter, the expression of Mn according to each movement operation is shown.

(In the case of parallel movement: for example, default coordinate transformation, movement of image data in the depth direction, movement of image data on a plane parallel to the screen)

[0097]

(Equation 1)

(In the case of rotational movement with the origin of the virtual visual field coordinate system as the center of rotation: for example, rotational movement at the time of default coordinate transformation)

[0099]

(Equation 2)

(Case of Rotation with (0, dr, 0) of Virtual View Coordinate System as Rotation Center) In this case, it can be realized by combining the above-described linear transformation. The coordinate conversion procedure is as follows.

(1) Translate in the y-axis direction by -dr and move the center of rotation to the origin.

(2) Rotation about the origin (x axis, y
(Rotation about axis and z-axis) (3) Translate + dr in the y-axis direction and set the center of rotation to (0,
dr, 0).

Accordingly, the coordinate transformation matrix Mc is expressed as follows: Mc = (formula (6): dy = + dr) × (formula (7) or (8) or (9)) × (formula (6): dy = −dr) <Basic operation> Next, a basic operation example of the stereoscopic display device having the above configuration will be described.

The activation of the display system realized by the stereoscopic display device is performed by the image data selection list creation unit 302.
The image data storage unit 300
Patient ID from the supplementary information of the image data stored in
The patient name, examination date and time, modality name, and imaging conditions are read out to create a list. Image data selection list creation unit 30
The list created by the image data selection unit 10
0 indicates it on the monitor.

When the operator selects image data from the image data selection unit 100, the selected image data is read from the image data storage unit 300 by the image data reading unit 304, and is temporarily stored in the memory 306. You. The image data information display unit 102 displays information on the selected image data in the memory (for example, patient ID, examination date and time, modality, etc.) on the monitor 12 as described above.

Next, the image data coordinate conversion section 310 performs default coordinate conversion processing on the selected image data. That is, the image data coordinate conversion unit 310 selects image data by the operator, and the image data reading unit 304 stores the selected image data in the memory 306.
At the time of reading into the default image observation direction selection unit 1
The default coordinate transformation is performed according to the default image data observation direction selected at 30. For example, when the default image data observation direction is an axial section, the image data stored in the memory 306 is:
2) + dp translation in y-axis direction, -Iw / 2 translation in x-axis direction, + Ih / 2 translation in z-axis direction, virtual view coordinate system In FIG. 11, the image data is placed as shown in FIG.

Subsequently, the projection image creation unit 308 performs a process according to the projection method (perspective projection or parallel projection) in the projection image creation selected by the operator in the projection method selection unit 128, and performs the processing for the right eye and the left eye. Generate each projection image.
The image direction display created by the image direction display creation unit 312 is combined with each projection image in the projection image creation unit 308. The screen data creation unit 314 creates left-eye screen data and right-eye screen data to be displayed on the image display unit 104, and registers the respective data in the left-eye screen video memory 316 and the right-eye screen video memory 318.

The stereoscopic apparatus switches and displays the registered left-eye screen data and right-eye screen data on the image display unit 104 under the control of the screen switching control unit 20. At this time, stereoscopic display is performed by synchronizing the deflecting shutters of the deflecting glasses 40.

This stereoscopic display device can execute the following functions during the basic operation described above. These functions, for example, by manual operation of the operator,
It is executed at any timing.

(Change of Image Data Display Range Width) First, when the operator inputs the changed value of the display range wr of the image data to be stereoscopically viewed from the image data display range width setting unit 108, the projection image creation unit 308 Is the display range w after the change
A new projection image is created based on r.

The image direction display creating section 312 creates an image direction display based on the current viewpoint position and synthesizes it with the projection image.

(Moving in the image data depth direction) The operator moves the cursor to the image data depth direction moving operation unit 112 and clicks the mouse device 44 to input the moving amount in the depth direction. It should be noted that this movement amount is input in units of the amount set by the image data depth direction movement amount setting unit 110. Image data coordinate conversion unit 310
Performs the above-described coordinate conversion on the image data so as to correspond to the input movement amount.

The projection image creation unit 308 creates a projection image based on the image data after the coordinate transformation. The image direction display creation unit 312 creates an image direction display and combines it with a projected image.

The image direction display creating section 312 creates an image direction display based on the current viewpoint position and combines it with the projected image.

(Translation / Rotation of Image Data) When the image data is translated, the cursor is moved to the arrow corresponding to the moving direction of the image data translation operation unit 122 and the mouse device 44 is clicked. Enter the amount of translation. To rotate the image data, the cursor is moved to an arrow corresponding to the moving direction of the image data rotation and movement operation unit 126, and the mouse device 44 is moved.
Click to enter the amount of rotational movement. The translation amount is determined by the image data translation amount setting unit 120,
The rotation amount is input in units of the movement amount set by the image data rotation / movement amount setting unit 124. The image data coordinate conversion unit 310 performs the above-described coordinate conversion on the image data so as to correspond to the input movement amount.

The projection image creation unit 308 creates a projection image based on the image data after the coordinate transformation. The image direction display creation unit 312 creates an image direction display and combines it with a projected image. Further, the image direction display creating unit 312 creates an image direction display based on the current position of the viewpoint and combines it with the projected image.

(Change of Image Enlargement Ratio) When changing the display enlargement ratio of an image, the image enlargement ratio setting unit 116 changes the value of the image enlargement ratio to a predetermined value. , A new distance dp 'from the virtual viewpoint to the projection plane is defined. The projection image creation unit 308 creates a projection image based on the dp ′, and the image direction display creation unit 312 creates an image direction display based on the current viewpoint position and combines it with the projection image.

(Change / Selection of Projection Image Type) When changing the type of projection image, the projection image type selection unit 118 selects a new projection image type. For example, it is assumed that a projection image by simple projection is currently displayed. If the operator selects, for example, “MIP” in the projection image type selection unit 118, the projection image creation unit 308 creates a projection image by the MIP method.

(Change of Projection Method) According to the present stereoscopic display device, the projection method can be changed. If the projection method is changed in the projection method selection unit 128, switching between perspective projection, parallel projection, and the like is possible.

(Change of Virtual View Setting Parameter) The present stereoscopic display device can change the range of image data to be projected by changing the virtual view setting parameter according to the following procedure.

That is, when changing the virtual view setting parameter, the virtual view setting parameter setting unit 106 changes the distance de between the left and right virtual viewpoints and the distance dr from the virtual viewpoint to the center of the image data display range. ,
A new image data range can be defined. The projection image creation unit 312 creates a projection image in the range of the newly set image data.

(Change of Image Display Gradation) To change the image display gradation, the image display gradation setting section 114 may manually set the display gradation.

According to the configuration described above, the following effects can be obtained.

First, the present image stereoscopic display device can limit the image display range to an arbitrary size. As a result, the overlap of the image data can be suppressed, and the observer can more easily understand the information in the depth direction of the display. In addition, since the display range can be stepped by one operation, the image data can be efficiently observed.

As a specific example, conventionally, an image having a thickness of 10 mm (resolution in the depth direction is 10 mm) is read one by one as a two-dimensional cross-sectional image. In the present embodiment, the width of the image display range is set to 10 mm. When observing with setting to, with the same load (gaze shift amount) as reading a two-dimensional cross-sectional image,
Information in the depth direction can also be obtained. Therefore, according to the present embodiment, three-dimensional image data can be referred to efficiently.

Second, the present image stereoscopic display device can arbitrarily set and change the range of image data to be stereoscopically viewed.
It has a user interface that facilitates operations related to the setting / change. Therefore, the operator can obtain a desired image by a simple operation, and the operability can be improved.

Third, in the present image stereoscopic display device,
By arranging the figure indicating the direction of the displayed image in the same virtual space as the image data, projecting the figure, and displaying the image in a stereoscopic view together with the image, it is easy to grasp the direction of the image. In addition, by arranging the image direction display at a position close to the stereoscopically viewable area in the direction of the line of sight (the y direction), the shift of the line of sight from the stereoscopic view of the image data to the stereoscopic view of the image direction display due to the stereoscopic characteristics Has the merit that it can be easily performed.

[Second Embodiment] In the second embodiment, a stereoscopic display device in which a continuous image data moving operation determination unit 324 is added to the image processing unit 30 in the configuration shown in the first embodiment is shown. . The stereoscopic display device according to the second embodiment realizes a quicker response in displaying images than the stereoscopic display device according to the first embodiment. In the following description, the image data rotation and movement operation unit 126
The following describes an example of a continuous movement operation performed by
For example, a configuration in which a 360-degree rotation button or the like is separately provided and a continuous movement operation is performed by one operation may be employed.

That is, the continuous image data moving operation determination unit 324 determines the time during which the moving operation key in the image data depth direction moving operation unit 112, the image data parallel movement operation unit 122, and the image data rotation movement operation unit 126 is pressed. Is measured, and if it is longer than a certain time, it is determined that a continuous moving operation is being performed. In addition, the continuous image data moving operation determination unit 324 includes the image data depth direction moving operation unit 112.
Similarly, when the key is pressed multiple times continuously at a time interval equal to or less than a predetermined time, the time during which the key of each movement operation is pressed is measured, and if it is longer than a certain time, the continuous movement operation is performed. It is determined that it is inside.

When the continuous image data moving operation determining unit 324 determines that the continuous moving operation is being performed, the projected image creating unit 308 creates only one of the left and right eye projected images. This projected image is displayed on the image display unit 104 as a projected image for the left and right eyes.

Further, when the continuous movement operation is completed (that is, the image data depth direction movement operation unit 112, the image data parallel movement operation unit 12
2. When all of the image data rotation / movement operation units 126 are no longer operated), the projection image creation unit 308 creates projection images for the left and right eyes, and the same stereoscopic display as in the first embodiment is executed. You.

According to the configuration described above, in the stereoscopic display device using binocular parallax, during continuous operation of moving image data, that is, during movement of the visual line of observation, switching to stereoscopic display using motion parallax is performed. In the actual processing, one of the left and right projection images is created, and the other is copied and used, while enabling stereoscopic viewing, so that the load of the image creation processing is reduced by half, and as a result, the image The display response is improved. Further, not only the image creation but also the image display processing may be performed on either the left or the right.

Although the present invention has been described based on the embodiments, various changes and modifications may be made by those skilled in the art within the scope of the concept of the present invention. It is understood that examples also fall within the scope of the present invention. For example, as shown in (1) and (2) below, various modifications can be made without changing the gist of the invention.

(1) In the embodiment described above, a simple projection image and a MIP image are described as examples of the projection image. However, the present invention is not limited to this. Volume rendering images, surface rendering images, MIN-MIP (minimum value projection)
It can be an image.

(2) The stereoscopic device is not limited to the above embodiment, but may be a stereoscopic monitor using a lenticular lens or the like. Further, a configuration may be adopted in which images for the left eye and the right eye are displayed side by side and observed with stereoscopic glasses.

Note that the present invention is not limited to the above-described embodiment, and various modifications can be made in the implementation stage without departing from the spirit of the invention. In addition, the embodiments may be implemented in appropriate combinations as much as possible, in which case the combined effects can be obtained. Furthermore, the above-described embodiment includes various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some components are deleted from all the components shown in the embodiment, the problem described in the column of the problem to be solved by the invention can be solved, and the effects described in the column of the effect of the invention can be solved. When at least one of the above is obtained, a configuration from which this configuration requirement is deleted can be extracted as an invention.

[0137]

As described above, according to the present invention, an image stereoscopic display device capable of efficiently referring to three-dimensional image data can be realized.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a stereoscopic display device according to the present invention.

FIG. 2 is a diagram illustrating a user interface unit 10;

FIG. 3 is a diagram illustrating a user interface unit 10;

FIGS. 4A and 4B are diagrams for explaining a projection image creation process; FIG.

FIG. 5A and FIG. 5B are diagrams for explaining a projection image creation process.

FIGS. 6A and 6B are diagrams for explaining a projection image creation process. FIG.

FIG. 7 is a diagram showing a projection table.

FIGS. 8A and 8B are diagrams for explaining a projection image creation process.

FIGS. 9A and 9B are diagrams for explaining a projection image creation process.

FIG. 10 shows image data on a memory, and shows a matrix size of a data image, Axial,
It is a figure for explaining each section of Coronal and Sagittal.

FIG. 11 is a diagram illustrating an arrangement of image data in a virtual view coordinate system based on default.

FIG. 12A is a diagram for explaining the correspondence between the image data and the direction of the subject, and FIG.
FIG. 3 is a diagram illustrating an example of a three-dimensional figure indicating a direction of image data.

FIG. 13 is a diagram showing an arrangement of an image direction display in the case of perspective projection.

FIG. 14 is a diagram illustrating an arrangement of an image direction display in the case of parallel projection;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 ... User interface part 20 ... Screen switching control part 30 ... Image processing part 40 Mouse apparatus 100 ... Image data selection part 102 ... Image data information display part 104 ... Image display part 106 ... Virtual field setting parameter setting part 108 ... Image data display Range width setting unit 110: image data depth direction movement amount setting unit 112: image data depth direction movement operation unit 114: image display gradation setting unit 116: image enlargement ratio setting unit 118: projection image type selection unit 120: image data parallel Movement amount setting unit 122 ... Image data parallel movement operation unit 124 ... Image data rotation movement amount setting unit 126 ... Image data rotation movement operation unit 128 ... Projection method selection unit 130 ... Default image observation direction selection unit 300 ... Image data storage unit 302 … Image data selection list creation unit 304… image data reading unit 306: Memory 308: Projected image creation unit 310: Image data coordinate conversion unit 312: Image direction display creation unit 314: Screen data creation unit 316 ... Left-eye screen video memory 318 ... Right-eye screen video memory 320 ... Operation input processing unit 322 ... CPU

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G09G 5/36 510 G09G 5/36 510V F term (Reference) 2H059 AA35 AA38 5B050 AA02 BA09 CA07 EA12 EA27 FA02 FA06 FA09 FA13 5C061 AA03 AB12 AB14 AB20 AB21 5C082 AA04 AA14 BA20 BA35 BA47 CA52 CA62 CB01 MM02 MM08 MM09 MM10

Claims (6)

[Claims] 1. A setting means for setting a display range for three-dimensional image data of a subject, and a right-eye projection image and a left-eye projection image based on the three-dimensional image data present in the set display range. An image stereoscopic display device comprising: an image generating unit that generates a projection image; and a display unit that stereoscopically displays the subject based on the right-eye projection image and the left-eye projection image. 2. The image stereoscopic display apparatus according to claim 1, further comprising a display range moving means for moving a relative position of the display range with respect to the three-dimensional image data. 3. An image stereoscopic display apparatus according to claim 1, further comprising a display range changing means for changing a size of said display range. 4. The image generating means generates one of the right-eye projection image and the left-eye projection image when the display range moving means operates continuously. The image stereoscopic display apparatus according to claim 2, wherein the subject is stereoscopically displayed based on the one image. 5. The image generating means generates direction information capable of determining a correspondence between the direction of the projection image and the direction of the subject, and the display means simultaneously displays the direction information and each of the projection images. The image stereoscopic display device according to claim 1, wherein stereoscopic display is performed. 6. The image stereoscopic display according to claim 5, wherein the direction information is provided at a position corresponding to the display range, and the display means displays the direction information stereoscopically. apparatus.