JP2013038467A - Image processing system, image processor, medical image diagnostic apparatus, image processing method, and image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To change an image group to be displayed on a stereoscopic monitor.SOLUTION: An image processing system includes a storage part 134 and a control part 135 in a work station 130. The storage part 134 stores multiple kinds of image information for assigning images based on volume data being three-dimensional medical image data as a predetermined number of images on the basis of correspondence between the viewpoint positions of an observer with respect to a stereoscopic display device for simultaneously displaying a predetermined number of images and images to be visually recognized by the observer at the viewpoint positions. The control part 135 performs control to allow the stereoscopic display device to display a predetermined number of images that coincide with image information selected among the multiple kinds of image information.

Description

  Embodiments described herein relate generally to an image processing system, an image processing apparatus, a medical image diagnostic apparatus, an image processing method, and an image processing program.

  Conventionally, a monitor capable of stereoscopically viewing a two-parallax image taken from two viewpoints using a dedicated device such as stereoscopic glasses has been put into practical use. In recent years, monitors that can stereoscopically view multi-parallax images (for example, 9 parallax images) taken from a plurality of viewpoints using a light beam controller such as a lenticular lens have been put into practical use. Note that a 2-parallax image or a 9-parallax image displayed on a stereoscopically viewable monitor may be generated by estimating the depth information of an image taken from one viewpoint and performing image processing using the estimated information. .

  On the other hand, a medical image diagnostic apparatus such as an X-ray CT (Computed Tomography) apparatus, an MRI (Magnetic Resonance Imaging) apparatus, or an ultrasonic diagnostic apparatus is practically capable of generating three-dimensional medical image data (hereinafter referred to as volume data). It has become. Conventionally, volume data generated by such a medical image diagnostic apparatus is converted into a two-dimensional image by various image processing and displayed two-dimensionally on a general-purpose monitor. For example, volume data generated by a medical image diagnostic apparatus is converted into a two-dimensional image reflecting three-dimensional information by volume rendering processing, and is displayed two-dimensionally on a general-purpose monitor.

  In addition, it has been studied that a two-dimensional image generated from volume data is displayed three-dimensionally on a stereoscopically visible monitor that has recently been put into practical use. However, the image group displayed on the stereoscopic monitor is, for example, a 2 parallax image with a parallax angle of 2 degrees, a 9 parallax image with a parallax angle of 1 degree interval, or the like.

JP 2005-84414 A

  The problem to be solved by the present invention is to provide an image processing system, an image processing apparatus, a medical image diagnostic apparatus, an image processing method, and an image processing program capable of changing an image group displayed on a stereoscopically viewable monitor. It is to be.

  The image processing system according to the embodiment includes a storage unit and a control unit. The storage unit 3 as the predetermined number of images based on a correspondence relationship between the viewpoint position of the observer with respect to the stereoscopic display device that simultaneously displays the predetermined number of images and the image viewed by the observer at the viewpoint position. A plurality of types of image information for allocating images based on volume data that is three-dimensional medical image data are stored. The control unit performs control so that a predetermined number of images that match image information selected from the plurality of types of image information are displayed on the stereoscopic display device.

FIG. 1 is a diagram for explaining a configuration example of an image processing system according to the first embodiment. FIG. 2 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using two parallax images. FIG. 3 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using nine parallax images. FIG. 4 is a diagram for explaining a configuration example of the workstation according to the first embodiment. FIG. 5 is a diagram for explaining a configuration example of the rendering processing unit shown in FIG. FIG. 6 is a diagram for explaining an example of volume rendering processing according to the first embodiment. FIG. 7 is a diagram for explaining a configuration example of the terminal device according to the first embodiment. FIG. 8 is a diagram for explaining an example of a parallax image group displayed on a conventional nine-parallax monitor. FIG. 9 is a diagram for explaining an example of a correspondence relationship between a viewpoint position and an image visually recognized by an observer at the viewpoint position. FIG. 10 is a diagram for explaining the image information. FIG. 11 is a diagram (1) for explaining a specific example of processing using parallax angle information. FIG. 12 is a diagram (2) for explaining a specific example of the process using the parallax angle information. FIG. 13 is a diagram (3) for explaining a specific example of the process using the parallax angle information. FIG. 14 is a diagram (1) for explaining a specific example of the process using the type information. FIG. 15 is a diagram (2) for explaining a specific example of the process using the type information. FIG. 16 is a diagram for explaining a specific example of processing using opacity information. FIG. 17 is a flowchart for explaining processing of the workstation according to the first embodiment. FIG. 18 is a flowchart for explaining processing of the terminal device according to the first embodiment. FIG. 19 is a diagram for explaining an image group generated in advance by the rendering processing unit according to the second embodiment. FIG. 20 is a diagram for explaining an image group generated in advance by the rendering processing unit according to the second embodiment. FIG. 21 is a flowchart for explaining processing of the terminal device according to the second embodiment. FIG. 22 is a flowchart for explaining processing of the terminal device according to the second embodiment. FIG. 23 is a diagram for explaining a modification.

  Hereinafter, embodiments of an image processing system and an image processing apparatus will be described in detail with reference to the accompanying drawings. In the following, an image processing system including a workstation having a function as an image processing apparatus will be described as an embodiment. Here, the terms used in the following embodiments will be described. The “parallax image group” is an image generated by performing volume rendering processing by moving the viewpoint position by a predetermined parallax angle with respect to volume data. It is a group. That is, the “parallax image group” includes a plurality of “parallax images” having different “viewpoint positions”. The “parallax angle” is an adjacent viewpoint position among the viewpoint positions set for generating the “parallax image group” and a predetermined position in the space represented by the volume data (for example, the center of the space). ). The “parallax number” is the number of “parallax images” necessary for stereoscopic viewing on the stereoscopic display monitor. The “9 parallax images” described below is a “parallax image group” composed of nine “parallax images”. The “two-parallax image” described below is a “parallax image group” composed of two “parallax images”.

(First embodiment)
First, a configuration example of the image processing system according to the first embodiment will be described. FIG. 1 is a diagram for explaining a configuration example of an image processing system according to the first embodiment.

  As shown in FIG. 1, the image processing system 1 according to the first embodiment includes a medical image diagnostic apparatus 110, an image storage apparatus 120, a workstation 130, and a terminal apparatus 140. Each apparatus illustrated in FIG. 1 is in a state where it can communicate with each other directly or indirectly by, for example, an in-hospital LAN (Local Area Network) 2 installed in a hospital. For example, when a PACS (Picture Archiving and Communication System) is introduced into the image processing system 1, each apparatus transmits and receives medical images and the like according to DICOM (Digital Imaging and Communications in Medicine) standards.

  The image processing system 1 generates a parallax image group from volume data that is three-dimensional medical image data generated by the medical image diagnostic apparatus 110, and displays the parallax image group on a stereoscopically viewable monitor. Provide medical images that can be viewed stereoscopically to doctors and laboratory technicians working in hospitals. Specifically, in the first embodiment, the workstation 130 performs various image processing on the volume data to generate a parallax image group. In addition, the workstation 130 and the terminal device 140 have a monitor that can be viewed stereoscopically, and displays a parallax image group generated by the workstation 130 on the monitor. Further, the image storage device 120 stores the volume data generated by the medical image diagnostic device 110 and the parallax image group generated by the workstation 130. That is, the workstation 130 and the terminal device 140 acquire volume data and a parallax image group from the image storage device 120, process them, and display them on a monitor. Hereinafter, each device will be described in order.

  The medical image diagnostic apparatus 110 includes an X-ray diagnostic apparatus, an X-ray CT (Computed Tomography) apparatus, an MRI (Magnetic Resonance Imaging) apparatus, an ultrasonic diagnostic apparatus, a SPECT (Single Photon Emission Computed Tomography) apparatus, and a PET (Positron Emission computed Tomography). ) Apparatus, a SPECT-CT apparatus in which a SPECT apparatus and an X-ray CT apparatus are integrated, a PET-CT apparatus in which a PET apparatus and an X-ray CT apparatus are integrated, or a group of these apparatuses. Further, the medical image diagnostic apparatus 110 according to the first embodiment can generate three-dimensional medical image data (volume data).

  Specifically, the medical image diagnostic apparatus 110 according to the first embodiment generates volume data by imaging a subject. For example, the medical image diagnostic apparatus 110 collects data such as projection data and MR signals by imaging the subject, and medical image data of a plurality of axial surfaces along the body axis direction of the subject from the collected data. By reconfiguring, volume data is generated. For example, the medical image diagnostic apparatus 110 reconstructs 500 pieces of medical image data on the axial plane. The 500 axial medical image data groups are volume data. In addition, the projection data of the subject imaged by the medical image diagnostic apparatus 110, the MR signal, or the like may be used as the volume data.

  Further, the medical image diagnostic apparatus 110 according to the first embodiment transmits the generated volume data to the image storage apparatus 120. The medical image diagnostic apparatus 110 identifies, for example, a patient ID for identifying a patient, an examination ID for identifying an examination, and the medical image diagnostic apparatus 110 as supplementary information when transmitting volume data to the image storage apparatus 120. A device ID, a series ID for identifying one shot by the medical image diagnostic device 110, and the like are transmitted.

  The image storage device 120 is a database that stores medical images. Specifically, the image storage device 120 according to the first embodiment stores the volume data transmitted from the medical image diagnostic device 110 in a storage unit and stores it. Further, the image storage device 120 according to the first embodiment can store a parallax image group generated from the volume data by the workstation 130 in a storage unit and store the parallax image group. In such a case, the workstation 130 transmits the generated parallax image group to the image storage device 120, and the image storage device 120 stores the parallax image group transmitted from the workstation 130 in the storage unit and stores it. In the present embodiment, the workstation 130 illustrated in FIG. 1 and the image storage device 120 may be integrated by using the workstation 130 that can store a large-capacity image. That is, this embodiment may be a case where volume data or a parallax image group is stored in the workstation 130 itself.

  In the first embodiment, the volume data and the parallax image group stored in the image storage device 120 are stored in association with the patient ID, examination ID, device ID, series ID, and the like. Therefore, the workstation 130 and the terminal device 140 acquire necessary volume data and a parallax image group from the image storage device 120 by performing a search using a patient ID, an examination ID, a device ID, a series ID, and the like.

  The workstation 130 is an image processing apparatus that performs image processing on medical images. Specifically, the workstation 130 according to the first embodiment performs various rendering processes on the volume data acquired from the image storage device 120 to generate a parallax image group. A parallax image group is a plurality of parallax images taken from a plurality of viewpoints. For example, a parallax image group displayed on a monitor capable of stereoscopically viewing nine parallax images with the naked eye has a viewpoint position. It is nine different parallax images.

  In addition, the workstation 130 according to the first embodiment includes a stereoscopically visible monitor (hereinafter, stereoscopic display monitor) as a display unit. The workstation 130 generates a parallax image group and displays the generated parallax image group on the stereoscopic display monitor. As a result, the operator of the workstation 130 can perform an operation for generating a parallax image group while confirming a stereoscopically visible medical image displayed on the stereoscopic display monitor.

  Further, the workstation 130 transmits the generated parallax image group to the image storage device 120. In addition, when transmitting the parallax image group to the image storage device 120, the workstation 130 transmits, for example, a patient ID, an examination ID, a device ID, a series ID, and the like as incidental information. Further, the incidental information transmitted when transmitting the parallax image group to the image storage device 120 includes incidental information regarding the parallax image group. The incidental information regarding the parallax image group includes the number of parallax images (for example, “9”), the resolution of the parallax images (for example, “466 pixels × 350 pixels”), and the like. The workstation 130 can also transmit the generated parallax image group to the terminal device 140 in response to a display request from the terminal device 140.

  Here, the workstation 130 according to the first embodiment has not only a parallax image group that is a stereoscopic image group as an image group displayed on the stereoscopic display monitor, but also conditions relating to various rendering processes (hereinafter, referred to as a stereoscopic image group). Image group based on rendering conditions). Specifically, the workstation 130 according to the first embodiment generates an image group composed of images with the number of parallaxes output for stereoscopic viewing on the stereoscopic display monitor based on various rendering conditions. This will be described in detail later.

  The terminal device 140 is a device that allows a doctor or laboratory technician working in a hospital to view a medical image. For example, the terminal device 140 is a PC (Personal Computer), a tablet PC, a PDA (Personal Digital Assistant), a mobile phone, or the like operated by a doctor or laboratory technician working in a hospital. Specifically, the terminal device 140 according to the first embodiment includes a stereoscopic display monitor as a display unit. Further, the terminal device 140 acquires a parallax image group from the workstation 130 or the image storage device 120, and displays the acquired parallax image group on the stereoscopic display monitor. As a result, a doctor or laboratory technician who is an observer can view a medical image that can be viewed stereoscopically.

  Here, the stereoscopic display monitor included in the workstation 130 and the terminal device 140 will be described. A general-purpose monitor that is most popular at present displays a two-dimensional image in two dimensions, and cannot display a two-dimensional image in three dimensions. If an observer requests stereoscopic viewing on a general-purpose monitor, an apparatus that outputs an image to the general-purpose monitor needs to display two parallax images that can be viewed stereoscopically by the observer in parallel by the parallel method or the intersection method. is there. Alternatively, an apparatus that outputs an image to a general-purpose monitor, for example, uses an after-color method with an eyeglass that has a red cellophane attached to the left eye portion and a blue cellophane attached to the right eye portion. It is necessary to display a stereoscopically viewable image.

  On the other hand, as a stereoscopic display monitor, there is a stereoscopic display monitor that enables a stereoscopic view of a two-parallax image (also referred to as a binocular parallax image) by using dedicated equipment such as stereoscopic glasses.

  FIG. 2 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using two parallax images. An example shown in FIG. 2 is a stereoscopic display monitor that performs stereoscopic display by a shutter method, and shutter glasses are used as stereoscopic glasses worn by an observer who observes the monitor. Such a stereoscopic display monitor emits two parallax images alternately on the monitor. For example, the monitor shown in FIG. 2A alternately emits a left-eye image and a right-eye image at 120 Hz. Here, as shown in FIG. 2A, the monitor is provided with an infrared emitting unit, and the infrared emitting unit controls the emission of infrared rays in accordance with the timing at which the image is switched.

  Moreover, the infrared rays emitted from the infrared ray emitting portion are received by the infrared ray receiving portion of the shutter glasses shown in FIG. A shutter is attached to each of the left and right frames of the shutter glasses, and the shutter glasses alternately switch the transmission state and the light shielding state of the left and right shutters according to the timing when the infrared light receiving unit receives the infrared rays. Hereinafter, the switching process between the transmission state and the light shielding state in the shutter will be described.

  As shown in FIG. 2B, each shutter has an incident-side polarizing plate and an output-side polarizing plate, and a liquid crystal layer between the incident-side polarizing plate and the output-side polarizing plate. Have Further, as shown in FIG. 2B, the incident-side polarizing plate and the outgoing-side polarizing plate are orthogonal to each other. Here, as shown in FIG. 2B, in the “OFF” state where no voltage is applied, the light that has passed through the polarizing plate on the incident side is rotated by 90 ° by the action of the liquid crystal layer, and is emitted on the outgoing side. Is transmitted through the polarizing plate. That is, a shutter to which no voltage is applied is in a transmissive state.

  On the other hand, as shown in FIG. 2B, in the “ON” state where a voltage is applied, the polarization rotation action caused by the liquid crystal molecules in the liquid crystal layer disappears. It will be blocked by the polarizing plate on the exit side. That is, the shutter to which the voltage is applied is in a light shielding state.

  Therefore, for example, the infrared emitting unit emits infrared rays during a period in which an image for the left eye is displayed on the monitor. The infrared light receiving unit applies a voltage to the right-eye shutter without applying a voltage to the left-eye shutter during a period of receiving the infrared light. Accordingly, as shown in FIG. 2A, the right-eye shutter is in a light-shielding state and the left-eye shutter is in a transmissive state, so that an image for the left eye is incident on the left eye of the observer. On the other hand, the infrared ray emitting unit stops emitting infrared rays while the right-eye image is displayed on the monitor. The infrared light receiving unit applies a voltage to the left-eye shutter without applying a voltage to the right-eye shutter during a period in which no infrared light is received. Accordingly, the left-eye shutter is in a light-shielding state and the right-eye shutter is in a transmissive state, so that an image for the right eye is incident on the right eye of the observer. As described above, the stereoscopic display monitor illustrated in FIG. 2 displays an image that can be viewed stereoscopically by the observer by switching the image displayed on the monitor and the state of the shutter in conjunction with each other. As a stereoscopic display monitor capable of stereoscopically viewing a two-parallax image, a monitor adopting a polarized glasses method is also known in addition to the shutter method described above.

  Furthermore, as a stereoscopic display monitor that has been put into practical use in recent years, there is a stereoscopic display monitor that allows a viewer to stereoscopically view a multi-parallax image such as a 9-parallax image with the naked eye by using a light controller such as a lenticular lens. . Such a stereoscopic display monitor enables stereoscopic viewing based on binocular parallax, and also enables stereoscopic viewing based on motion parallax that also changes the image observed in accordance with the viewpoint movement of the observer.

  FIG. 3 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using nine parallax images. In the stereoscopic display monitor shown in FIG. 3, a light beam controller is arranged on the front surface of a flat display surface 200 such as a liquid crystal panel. For example, in the stereoscopic display monitor shown in FIG. 3, a vertical lenticular sheet 201 whose optical aperture extends in the vertical direction is attached to the front surface of the display surface 200 as a light beam controller. In the example shown in FIG. 3, the vertical lenticular sheet 201 is pasted so that the convex portion of the vertical lenticular sheet 201 becomes the front surface, but the convex portion of the vertical lenticular sheet 201 is pasted so as to face the display surface 200. There may be.

  As shown in FIG. 3, the display surface 200 has an aspect ratio of 3: 1 and pixels in which three sub-pixels, red (R), green (G), and blue (B), are arranged in the vertical direction. 202 are arranged in a matrix. The stereoscopic display monitor shown in FIG. 3 converts a nine-parallax image composed of nine images into an intermediate image arranged in a predetermined format (for example, a lattice shape), and then outputs it to the display surface 200. For example, a nine-parallax image is converted into an intermediate image in a grid-like format in which nine images are arranged in “3 rows and 3 columns” and output to the display surface 200. That is, the stereoscopic display monitor shown in FIG. 3 assigns and outputs nine pixels at the same position in nine parallax images to nine columns of pixels 202. The nine columns of pixels 202 constitute a unit pixel group 203 that simultaneously displays nine images with different viewpoint positions.

  The nine parallax images simultaneously output as the unit pixel group 203 on the display surface 200 are emitted as parallel light by, for example, an LED (Light Emitting Diode) backlight, and further emitted in multiple directions by the vertical lenticular sheet 201. As the light of each pixel of the nine-parallax image is emitted in multiple directions, the light incident on the right eye and the left eye of the observer changes in conjunction with the position of the observer (viewpoint position). That is, the parallax angle between the parallax image incident on the right eye and the parallax image incident on the left eye differs depending on the viewing angle of the observer. Thereby, the observer can visually recognize the photographing object in three dimensions at each of the nine positions shown in FIG. 3, for example. In addition, for example, the observer can view the image three-dimensionally in a state of facing the object to be imaged at the position “5” shown in FIG. 3, and at each position other than “5” shown in FIG. It can be visually recognized in a three-dimensional manner with the direction of the object changed. Note that the stereoscopic display monitor shown in FIG. 3 is merely an example. As shown in FIG. 3, the stereoscopic display monitor that displays a nine-parallax image may be a horizontal stripe liquid crystal of “RRR..., GGG..., BBB. .. ”” May be used. The stereoscopic display monitor shown in FIG. 3 may be a vertical lens system in which the lenticular sheet is vertical as shown in FIG. 3 or a diagonal lens system in which the lenticular sheet is diagonal. There may be. Further, the format of the intermediate image is not limited to the “3 rows × 3 columns” grid. For example, the format of the intermediate image may be an arbitrary format according to the monitor specification, such as “1 row 9 column” or “9 row 1 column”.

  Hereinafter, the stereoscopic display monitor described with reference to FIG. 2 is referred to as a two-parallax monitor. Hereinafter, the stereoscopic display monitor described with reference to FIG. 3 is referred to as a 9-parallax monitor. That is, the two-parallax monitor is a stereoscopic display device that enables stereoscopic viewing with binocular parallax. In addition, the 9-parallax monitor enables stereoscopic viewing by binocular parallax, and further displays the 9 images (9-parallax images) at the same time so that the observer can respond according to the “observer's viewpoint movement (motion parallax)”. This is a stereoscopic display device capable of changing an image to be observed.

  So far, the configuration example of the image processing system 1 according to the first embodiment has been briefly described. Note that the application of the image processing system 1 described above is not limited when PACS is introduced. For example, the image processing system 1 is similarly applied when an electronic medical chart system that manages an electronic medical chart to which a medical image is attached is introduced. In this case, the image storage device 120 is a database that stores electronic medical records. Further, for example, the image processing system 1 is similarly applied when a HIS (Hospital Information System) and a RIS (Radiology Information System) are introduced. The image processing system 1 is not limited to the configuration example described above. The functions and sharing of each device may be appropriately changed according to the operation mode.

  Next, a configuration example of the workstation according to the first embodiment will be described with reference to FIG. FIG. 4 is a diagram for explaining a configuration example of the workstation according to the first embodiment. In the following, the “parallax image group” is a group of stereoscopic images (volume rendering image group) generated by performing volume rendering processing on volume data. Further, the “parallax image” is an individual image constituting the “parallax image group”. That is, the “parallax image group” includes a plurality of “parallax images” having different viewpoint positions.

  The workstation 130 according to the first embodiment is a high-performance computer suitable for image processing and the like, and as illustrated in FIG. 4, an input unit 131, a display unit 132, a communication unit 133, and a storage unit 134. And a control unit 135 and a rendering processing unit 136. In the following, a case where the workstation 130 is a high-performance computer suitable for image processing or the like will be described. However, the present invention is not limited to this, and may be any information processing apparatus. For example, any personal computer may be used.

  The input unit 131 is a mouse, a keyboard, a trackball, or the like, and receives input of various operations on the workstation 130 from an operator. Specifically, the input unit 131 according to the first embodiment receives input of information for acquiring volume data to be subjected to rendering processing from the image storage device 120. For example, the input unit 131 receives input of a patient ID, an examination ID, a device ID, a series ID, and the like. Further, the input unit 131 according to the first embodiment receives an input of a condition (rendering condition) related to rendering processing.

  The display unit 132 is a liquid crystal panel or the like as a stereoscopic display monitor, and displays various information. Specifically, the display unit 132 according to the first embodiment displays a GUI (Graphical User Interface) for receiving various operations from the operator, a parallax image group, and the like. For example, the display unit 132 is a 2-parallax monitor or a 9-parallax monitor. Below, the case where the display part 132 is a 9 parallax monitor is demonstrated. The communication unit 133 is a NIC (Network Interface Card) or the like, and performs communication with other devices.

  The storage unit 134 is a hard disk, a semiconductor memory element, or the like, and stores various types of information. Specifically, the storage unit 134 according to the first embodiment stores volume data acquired from the image storage device 120 via the communication unit 133. In addition, the storage unit 134 according to the first embodiment stores volume data during rendering processing, a group of parallax images generated by the rendering processing, and the like.

  The control unit 135 is an electronic circuit such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit), an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array), and the entire workstation 130. Take control.

  For example, the control unit 135 according to the first embodiment controls the display of the GUI and the display of the parallax image group on the display unit 132. For example, the control unit 135 controls transmission / reception of volume data and a parallax image group performed with the image storage device 120 via the communication unit 133. For example, the control unit 135 controls the rendering process performed by the rendering processing unit 136. For example, the control unit 135 controls reading of volume data from the storage unit 134 and storage of the parallax image group in the storage unit 134.

  The rendering processing unit 136 performs various rendering processes on the volume data acquired from the image storage device 120 under the control of the control unit 135 to generate a parallax image group. Specifically, the rendering processing unit 136 according to the first embodiment reads volume data from the storage unit 134 and first performs preprocessing on the volume data. Next, the rendering processing unit 136 performs volume rendering processing on the pre-processed volume data to generate a parallax image group. Subsequently, the rendering processing unit 136 generates a two-dimensional image in which various kinds of information (scale, patient name, examination item, etc.) are drawn, and superimposes it on each of the parallax image groups, thereby outputting 2 for output. Generate a dimensional image. Then, the rendering processing unit 136 stores the generated parallax image group and the output two-dimensional image in the storage unit 134. In the first embodiment, the rendering process is the entire image process performed on the volume data. The volume rendering process is a two-dimensional image reflecting three-dimensional information in the rendering process. It is a process to generate. For example, a parallax image corresponds to the medical image generated by the rendering process.

  FIG. 5 is a diagram for explaining a configuration example of the rendering processing unit shown in FIG. As illustrated in FIG. 5, the rendering processing unit 136 includes a preprocessing unit 1361, a 3D image processing unit 1362, and a 2D image processing unit 1363. The preprocessing unit 1361 performs preprocessing on the volume data, the 3D image processing unit 1362 generates a parallax image group from the preprocessed volume data, and the 2D image processing unit 1363 stores various information on the parallax image group. A two-dimensional image for output on which is superimposed is generated. Hereinafter, each part is demonstrated in order.

  The preprocessing unit 1361 is a processing unit that performs various types of preprocessing when rendering processing is performed on volume data, and includes an image correction processing unit 1361a, a three-dimensional object fusion unit 1361e, and a three-dimensional object display area setting. Part 1361f.

  The image correction processing unit 1361a is a processing unit that performs image correction processing when processing two types of volume data as one volume data, and as shown in FIG. 5, a distortion correction processing unit 1361b, a body motion correction processing unit, 1361c and an inter-image registration processing unit 1361d. For example, the image correction processing unit 1361a performs image correction processing when processing volume data of a PET image generated by a PET-CT apparatus and volume data of an X-ray CT image as one volume data. Alternatively, the image correction processing unit 1361a performs image correction processing when processing the volume data of the T1-weighted image and the volume data of the T2-weighted image generated by the MRI apparatus as one volume data.

  In addition, the distortion correction processing unit 1361b corrects the data distortion caused by the collection conditions at the time of data collection by the medical image diagnostic apparatus 110 in each volume data. Further, the body motion correction processing unit 1361c corrects the movement caused by the body motion of the subject at the time of collecting the data used for generating the individual volume data. Further, the inter-image registration processing unit 1361d performs registration (Registration) using, for example, a cross-correlation method between the two volume data subjected to the correction processing by the distortion correction processing unit 1361b and the body motion correction processing unit 1361c. ).

  The three-dimensional object fusion unit 1363e fuses a plurality of volume data that has been aligned by the inter-image registration processing unit 1361d. Note that the processing of the image correction processing unit 1361a and the three-dimensional object fusion unit 1361e is omitted when rendering processing is performed on single volume data.

  The three-dimensional object display region setting unit 1361f is a processing unit that sets a display region corresponding to the display target organ designated by the operator, and includes a segmentation processing unit 1361g. The segmentation processing unit 1361g is a processing unit that extracts organs such as the heart, lungs, and blood vessels designated by the operator by, for example, a region expansion method based on pixel values (voxel values) of volume data.

  Note that the segmentation processing unit 1361g does not perform the segmentation process when the display target organ is not designated by the operator. The segmentation processing unit 1361g extracts a plurality of corresponding organs when a plurality of display target organs are designated by the operator. Further, the processing of the segmentation processing unit 1361g may be executed again in response to an operator fine adjustment request referring to the rendered image.

  The 3D image processing unit 1362 performs volume rendering processing on the pre-processed volume data processed by the preprocessing unit 1361. As a processing unit that performs volume rendering processing, a three-dimensional image processing unit 1362 includes a projection method setting unit 1362a, a three-dimensional geometric transformation processing unit 1362b, a three-dimensional object appearance processing unit 1362f, and a three-dimensional virtual space rendering unit 1362k. Have

  The projection method setting unit 1362a determines a projection method for generating a parallax image group. For example, the projection method setting unit 1362a determines whether to execute the volume rendering process by the parallel projection method or the perspective projection method.

  The three-dimensional geometric transformation processing unit 1362b is a processing unit that determines information for transforming volume data on which volume rendering processing is performed into a three-dimensional geometrical structure. The three-dimensional geometric transformation processing unit 1362b includes a parallel movement processing unit 1362c, a rotation processing unit 1362d, and an enlargement unit. A reduction processing unit 1362e is included. The parallel movement processing unit 1362c is a processing unit that determines the amount of movement to translate the volume data when the viewpoint position when performing the volume rendering processing is translated, and the rotation processing unit 1362d performs the volume rendering processing. This is a processing unit that determines the amount of movement by which the volume data is rotationally moved when the viewpoint position during the rotation is rotationally moved. The enlargement / reduction processing unit 1362e is a processing unit that determines the enlargement rate or reduction rate of the volume data when enlargement or reduction of the parallax image group is requested.

  The three-dimensional object appearance processing unit 1362f includes a three-dimensional object color processing unit 1362g, a three-dimensional object opacity processing unit 1362h, a three-dimensional object material processing unit 1362i, and a three-dimensional virtual space light source processing unit 1362j. The three-dimensional object appearance processing unit 1362f performs a process of determining the display state of the displayed parallax image group in response to an operator's request, for example.

  The three-dimensional object color processing unit 1362g is a processing unit that determines a color to be colored for each region segmented by the volume data. The three-dimensional object opacity processing unit 1362h is a processing unit that determines the opacity (Opacity) of each voxel constituting each region segmented by volume data. It should be noted that the area behind the area having the opacity of “100%” in the volume data is not drawn in the parallax image group. In addition, an area in which the opacity is “0%” in the volume data is not drawn in the parallax image group.

  The three-dimensional object material processing unit 1362i is a processing unit that determines the material of each region segmented by volume data and adjusts the texture when the region is rendered. The three-dimensional virtual space light source processing unit 1362j is a processing unit that determines the position of the virtual light source installed in the three-dimensional virtual space and the type of the virtual light source when performing volume rendering processing on the volume data. Examples of the virtual light source include a light source that emits parallel light rays from infinity and a light source that emits radial light rays from the viewpoint.

  The three-dimensional virtual space rendering unit 1362k performs volume rendering processing on the volume data to generate a parallax image group. The three-dimensional virtual space rendering unit 1362k performs various types of information determined by the projection method setting unit 1362a, the three-dimensional geometric transformation processing unit 1362b, and the three-dimensional object appearance processing unit 1362f as necessary when performing the volume rendering process. Is used.

  Here, the volume rendering process by the three-dimensional virtual space rendering unit 1362k is performed according to the rendering conditions. For example, the rendering condition is “parallel projection method” or “perspective projection method”. For example, the rendering condition is “reference viewpoint position and parallax angle”. Further, for example, the rendering conditions are “translation of viewpoint position”, “rotational movement of viewpoint position”, “enlargement of parallax image group”, and “reduction of parallax image group”. Further, for example, the rendering conditions are “color to be colored”, “transparency”, “texture”, “position of virtual light source”, and “type of virtual light source”. Such a rendering condition may be accepted from the operator via the input unit 131 or may be initially set. In any case, the three-dimensional virtual space rendering unit 1362k receives a rendering condition from the control unit 135, and performs volume rendering processing on the volume data according to the rendering condition. At this time, the projection method setting unit 1362a, the three-dimensional geometric transformation processing unit 1362b, and the three-dimensional object appearance processing unit 1362f determine various pieces of necessary information according to the rendering conditions, so the three-dimensional virtual space rendering unit 1362k. Generates a parallax image group using the determined various pieces of information.

  FIG. 6 is a diagram for explaining an example of volume rendering processing according to the first embodiment. For example, as shown in FIG. 6A, the three-dimensional virtual space rendering unit 1362k accepts the parallel projection method as a rendering condition, and further sets the reference viewpoint position (5) and the parallax angle “1 degree”. Suppose you accept. In such a case, the three-dimensional virtual space rendering unit 1362k sets a light source that emits parallel light rays from infinity along the line-of-sight direction, as shown in FIG. Then, the three-dimensional virtual space rendering unit 1362k translates the position of the viewpoint from (1) to (9) so that the parallax angle is every “1 degree”, and the parallax angle (gaze direction) by the parallel projection method. Nine parallax images with different angles are generated by 1 degree.

  Alternatively, as shown in FIG. 6B, the three-dimensional virtual space rendering unit 1362k accepts a perspective projection method as a rendering condition, and further sets the reference viewpoint position (5) and the parallax angle “1 degree”. Suppose you accept. In such a case, as shown in FIG. 6B, the three-dimensional virtual space rendering unit 1362k sets a point light source and a surface light source that irradiates light three-dimensionally radially around the line-of-sight direction at each viewpoint. . For example, the three-dimensional virtual space rendering unit 1362k sets the position of the viewpoint (1) to (9) so that the parallax angle is every “one degree” around the center (center of gravity) of the cut surface of the volume data. Nine parallax images having different parallax angles by 1 degree are generated by the perspective projection method. When performing the perspective projection method, the viewpoints (1) to (9) may be translated depending on the rendering conditions. As shown in FIGS. 6A and 6B, the line-of-sight direction is a direction from the viewpoint toward the center (center of gravity) of the cut surface of the volume data.

  Alternatively, as shown in FIG. 6C, the three-dimensional virtual space rendering unit 1362k radiates light in a two-dimensional manner centering on the line-of-sight direction with respect to the vertical direction of the displayed volume rendering image. For the horizontal direction of the volume rendering image to be displayed, a volume rendering process that uses both the parallel projection method and the perspective projection method by setting a light source that emits parallel light rays from infinity along the viewing direction. May be performed.

  The nine parallax images generated in this way are a parallax image group. In the first embodiment, the nine parallax images are converted into intermediate images arranged in a predetermined format (for example, a lattice shape) by the control unit 135, for example, and are output to the display unit 132 as a stereoscopic display monitor. Then, the operator of the workstation 130 can perform an operation for generating a parallax image group while confirming a stereoscopically viewable medical image displayed on the stereoscopic display monitor.

  In the example of FIG. 6, the case where the projection method, the reference viewpoint position, and the parallax angle are received as the rendering conditions has been described. However, the three-dimensional virtual space is similarly applied when other conditions are received as the rendering conditions. The rendering unit 1362k generates a parallax image group while reflecting each rendering condition.

  The three-dimensional virtual space rendering unit 1362k has a function of reconstructing an MPR image from volume data by performing not only volume rendering but also a cross-section reconstruction method (MPR: Multi Planer Reconstruction). The three-dimensional virtual space rendering unit 1362k also has a function of performing “Curved MPR” and a function of performing “Intensity Projection”.

  Subsequently, the parallax image group generated from the volume data by the three-dimensional image processing unit 1362 is set as an underlay. Then, an overlay (Overlay) on which various types of information (scale, patient name, examination item, etc.) are drawn is superimposed on the underlay, thereby obtaining a two-dimensional image for output. The two-dimensional image processing unit 1363 is a processing unit that generates an output two-dimensional image by performing image processing on the overlay and the underlay. As illustrated in FIG. 5, the two-dimensional object drawing unit 1363a, A two-dimensional geometric transformation processing unit 1363b and a luminance adjustment unit 1363c are included. For example, the two-dimensional image processing unit 1363 superimposes one overlay on each of nine parallax images (underlays) in order to reduce the load required to generate a two-dimensional image for output. Thus, nine output two-dimensional images are generated.

  The two-dimensional object drawing unit 1363a is a processing unit that draws various information drawn on the overlay, and the two-dimensional geometric transformation processing unit 1363b performs parallel movement processing or rotational movement processing on the position of the various information drawn on the overlay. Or a processing unit that performs an enlargement process or a reduction process of various types of information drawn on the overlay.

  The luminance adjustment unit 1363c is a processing unit that performs luminance conversion processing. For example, the gradation of an output destination stereoscopic display monitor, an image such as a window width (WW: Window Width), a window level (WL: Window Level), or the like. This is a processing unit that adjusts the brightness of the overlay and the underlay according to the processing parameters.

  The output two-dimensional image generated in this way is temporarily stored in the storage unit 134 by the control unit 135, for example, and then transmitted to the image storage device 120 via the communication unit 133. For example, when the terminal device 140 acquires the two-dimensional image for output from the image storage device 120, converts it to an intermediate image arranged in a predetermined format (for example, a lattice shape), and displays it on a stereoscopic display monitor, A doctor or a laboratory technician can view a stereoscopically viewable medical image in a state where various types of information (scale, patient name, examination item, etc.) are drawn. Alternatively, the output two-dimensional image is directly transmitted to the terminal device 140 by the control unit 135 via the communication unit 133, for example.

  As described above, the terminal device 140 according to the first embodiment is a device that allows a doctor or laboratory technician working in a hospital to view a medical image, and is rendered from the image storage device 120 or the workstation 130. The parallax image group (two-dimensional image for output) generated by the processing unit 136 is acquired. FIG. 7 is a diagram for explaining a configuration example of the terminal device according to the first embodiment.

  As illustrated in FIG. 7, the terminal device 140 according to the first embodiment includes an input unit 141, a display unit 142, a communication unit 143, a storage unit 144, and a control unit 145.

  The input unit 141 is a mouse, a keyboard, a trackball, or the like, and receives input of various operations on the terminal device 140 from an operator. Specifically, the input unit 141 according to the first embodiment receives a display request such as a stereoscopic request from the operator. For example, the input unit 141 accepts an input such as a patient ID, an examination ID, a device ID, and a series ID for designating volume data that the operator desires to display for interpretation as a display request. The input unit 141 receives a rendering condition for the volume data from the operator as a display request.

  The display unit 142 is a liquid crystal panel or the like as a stereoscopic display monitor, and displays various types of information. Specifically, the display unit 142 according to the first embodiment displays a GUI (Graphical User Interface) for receiving various operations from the operator, a stereoscopic image, and the like. For example, the display unit 142 is a 2-parallax monitor or a 9-parallax monitor. Below, the case where the display part 142 is a 9 parallax monitor is demonstrated.

  The communication unit 143 is a NIC (Network Interface Card) or the like, and performs communication with other devices. For example, the communication unit 143 according to the first embodiment transmits a display request received by the input unit 141 to the image storage device 120 or the workstation 130. Further, the communication unit 133 according to the first embodiment receives a parallax image group or the like transmitted by the image storage device 120 or the workstation 130 in response to a display request.

  The storage unit 144 is a hard disk, a semiconductor memory element, or the like, and stores various types of information. Specifically, the storage unit 144 according to the first embodiment stores a parallax image group acquired from the image storage device 120 or the workstation 130 via the communication unit 143. The storage unit 144 also stores incidental information (the number of parallaxes, resolution, and the like) of the parallax image group acquired from the image storage device 120 or the workstation 130 via the communication unit 143.

  The control unit 145 is an electronic circuit such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array). Take control.

  For example, the control unit 145 uses the communication unit 143 to communicate with the image storage device 120 or the workstation 130 via the communication unit 143 or information about a display request made to the image storage device 120 or the workstation 130. The transmission / reception of the parallax image group and the like performed in this manner is controlled. For example, the control unit 145 controls storage of the parallax image group or the like in the storage unit 144 and reading of the parallax image group or the like from the storage unit 144.

  In addition, the control unit 145 according to the first embodiment controls the display of the GUI and the display of the parallax image group on the display unit 142. The control unit 145 according to the first embodiment converts the parallax image group into an intermediate image arranged in a predetermined format (for example, a lattice shape), and displays the intermediate image on the display unit 142 which is a 9-parallax monitor.

  As described above, the rendering processing unit 136 generates a parallax image group from the volume data under the control of the control unit 135. In addition, the terminal device 140 acquires a parallax image group and displays it on the display unit 142. As a result, a doctor or laboratory technician who is an operator of the terminal device 140 can browse a stereoscopically viewable medical image in a state where various information (scale, patient name, examination item, etc.) is drawn.

  Here, at present, the parallax image group displayed on the stereoscopic monitor is an image group generated under conditions set in advance according to the specifications of the stereoscopic monitor. For example, the group of parallax images displayed on the two-parallax monitor is, for example, a two-parallax image having a parallax angle of 6 degrees. As a result, the observer of the 2-parallax monitor can always stereoscopically view the same 2-parallax image even if the field of view deviates from the front of the screen. However, when the observer of the 2-parallax monitor wants to observe the side surface of the volume data, the rendering processing unit 136 needs to generate a 2-parallax image by volume rendering processing in which the viewpoint position is changed.

  The group of parallax images displayed on the 9-parallax monitor is, for example, 9-parallax images with a parallax angle of 1 degree interval. FIG. 8 is a diagram for explaining an example of a parallax image group displayed on a conventional nine-parallax monitor.

  For example, under the control of the control unit 135, the rendering processing unit 136 (segmentation processing unit 1361g) extracts a subject portion that is a region to be rendered of volume data. Then, under the control of the control unit 135, the rendering processing unit 136, for example, along the circumference of a perfect circle set on a cut surface passing through the center of gravity of the subject portion, as shown in FIG. Nine viewpoints are set so that the parallax angle is 1 degree. In the example illustrated in FIG. 8A, the control unit 135 sets a “0 degree” viewpoint that serves as a reference to the “position facing the subject portion”. In the example illustrated in FIG. 8A, the control unit 135 sets the viewpoints “−1 degree, −2 degrees, −3 degrees, −4 degrees” clockwise from the viewpoint “0 degrees”. Further, the viewpoints “+1 degree, +2 degrees, +3 degrees, +4 degrees” are set counterclockwise from the viewpoint “0 degrees”.

  Here, the “position facing the subject portion” is set based on the incidental information of the volume data stored as DICOM data in the image storage device 120, for example. In the DICOM standard, the contents set from which direction to observe and observe at the time of photographing are recorded as incidental information of the photographed volume data. For example, the operator of the X-ray CT apparatus captures the volume data obtained by capturing the auxiliary information, which is an image obtained by observing the volume data in the direction from the ventral side to the back side of the patient as the reference image that is initially displayed during interpretation. Set as incidental information. Further, the volume data is provided with supplementary information related to the patient's posture at the time of imaging and supplementary information related to the coordinate system in the medical image diagnostic apparatus that has performed imaging.

  The control unit 135 can refer to the supplementary information to identify “a position directly facing the subject portion” in the volume data to be processed, and set a reference “0 degree” viewpoint. That is, the “position facing the subject portion” can be arbitrarily changed according to the orientation of the patient who is designated by the operator who has performed the imaging or the observer (for example, an interpreting doctor).

  The rendering processing unit 136 generates a nine-parallax image by performing volume rendering processing on the subject portion by using, for example, the perspective projection method, using each of the nine viewpoints set by such processing. The generated 9-parallax image is converted into an intermediate image of 3 rows and 3 columns and displayed on the 9-parallax monitor, for example, as shown in FIG.

  That is, the control unit 135 converts the nine parallax images into a “−4 degree” parallax image, a “−3 degree” parallax image, a “−2 degree” parallax image, and a “−1 degree” parallax image. , “0 degree” parallax image, “+1 degree parallax image” and “+2 degree” parallax image, “+3” parallax image, “+4 degree” parallax image ”are arranged in 3 rows and 3 columns. Convert to an intermediate image. As a result, the “−4 degrees” parallax image is output to the first column of the unit pixel group 203 shown in FIG. 3, and the “−3 degrees” parallax image is the two columns of the unit pixel group 203 shown in FIG. 3. The parallax image of “−2 degrees” is output to the third column of the unit pixel group 203 shown in FIG. Further, the “−1 degree” parallax image is output to the fourth column of the unit pixel group 203 illustrated in FIG. 3, and the “0 degree” parallax image is output to the fifth column of the unit pixel group 203 illustrated in FIG. 3. The output “+1 degree” parallax image is output in the sixth column of the unit pixel group 203 shown in FIG. 3. Also, the “+2 degree” parallax image is output to the seventh column of the unit pixel group 203 shown in FIG. 3, and the “+3 degree” parallax image is output to the eighth column of the unit pixel group 203 shown in FIG. Then, the “+4 degree” parallax image is output in the ninth column of the unit pixel group 203 shown in FIG. 3.

  Thereby, the observer can observe volume data three-dimensionally from various angles according to motion parallax. For example, as shown in (B) of FIG. 8, the observer can select “−1 degree, 0 degree” or “0 degree” in the vicinity of the position facing the 9 parallax monitor (see “5” in the figure). By simultaneously viewing the +1 degree parallax image, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “0 degree”.

  Further, for example, as shown in FIG. 8B, the observer has “−2” in the vicinity of a position (see “7” in the figure) that has moved 15 degrees to the left from the position facing the 9-parallax monitor. By simultaneously viewing a parallax image of “degree, −1 degree”, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “−2 degrees”. Further, for example, as shown in FIG. 8B, the observer is “−4” in the vicinity of a position (see “9” in the figure) that is moved 30 degrees to the left from the position facing the 9-parallax monitor. By simultaneously viewing the parallax image of “degree, −3 degrees”, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “−4 degrees”.

  In addition, for example, as shown in FIG. 8B, the observer is “+2 degrees near a position moved 15 degrees to the right from the position facing the 9-parallax monitor (see“ 3 ”in the figure). , +1 degree ”parallax images can be viewed at the same time, thereby making it possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint“ +2 degrees ”. In addition, for example, as shown in FIG. 8B, the observer is “+4 degrees” in the vicinity of a position (see “1” in the figure) that is moved 30 degrees to the right from the position facing the 9-parallax monitor. , +3 degrees "parallax images can be viewed at the same time, so that it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint" +4 degrees ". Alternatively, the nine-parallax monitor can be used as a general-purpose monitor that displays the same two-dimensional image regardless of motion parallax, for example, by simultaneously displaying nine parallax images of the viewpoint “0”.

  Hereinafter, “the position moved“ X degrees ”to the left from the position facing the 9-parallax monitor (display unit 132 or display unit 142)” is simply referred to as “position moved“ −X degrees ””. . In the following, “the position moved“ X degrees ”to the right from the position facing the 9-parallax monitor (display unit 132 or display unit 142)” is simply described as “position moved“ + X degrees ””. To do.

  However, there is a limit to the displayable range of volume data on the 9-parallax monitor. That is, from the position “90 degrees” from the position facing the 9-parallax monitor, the observer cannot view the two images and cannot perform stereoscopic viewing using the parallax image. Also, in general, the 9 parallax images have a parallax angle of, for example, an interval of “0.1 degree” to “1 degree” so that stereoscopic viewing is possible using image pairs at adjacent viewpoint positions. It is generated by the condition fixed to. For this reason, the angle at which the observer can observe volume data in three dimensions is also limited due to limitations on the number of parallaxes and the parallax angle.

  Therefore, in the first embodiment, processing using the characteristics of the stereoscopic display monitor is performed. That is, the stereoscopic display monitor is a device that can change the image observed by the observer according to “observer position movement (motion parallax)” by simultaneously displaying a predetermined number of images. In addition, as described with reference to FIG. 8, the viewpoint position of the observer with respect to the stereoscopic display monitor and the image that is visually recognized by the observer at the viewpoint position are associated with each other.

  Using the description described above, the “correspondence between the observer's viewpoint position with respect to the stereoscopic display monitor and the image visually recognized by the observer at the viewpoint position” is shown in FIG. Can be summarized as shown. FIG. 9 is a diagram for explaining an example of a correspondence relationship between a viewpoint position and an image visually recognized by an observer at the viewpoint position.

  That is, in the example shown in FIG. 8, an image visually recognized by the observer at a position of “0 degree” which is a position directly facing the 9 parallax monitor (see “5” in FIG. 8B) is shown in FIG. 9. As shown, the images are output in the fourth to sixth columns of the unit pixel group 203, respectively. Further, in the example shown in FIG. 8B, the image visually recognized by the observer at the position “−15 degrees” (see “7” in FIG. 8B) is as shown in FIG. These are images output in the third and fourth columns of the unit pixel group 203, respectively.

  In the example shown in FIG. 8B, an image visually recognized by the observer at the position “−30 degrees” (see “9” in FIG. 8B) is as shown in FIG. These are images output to the first and second columns of the unit pixel group 203, respectively. In the example shown in FIG. 8B, an image visually recognized by the observer at the position “+15 degrees” (see “3” in FIG. 8B) is as shown in FIG. These are images output in the sixth and seventh columns of the unit pixel group 203, respectively. Further, in the example shown in FIG. 8B, the image visually recognized by the observer at the position “+30 degrees” (see “1” in FIG. 8B) is a unit as shown in FIG. The images are output in the eighth and ninth columns of the pixel group 203, respectively.

  Although not described above, an image visually recognized by an observer at a position of “−7.5 degrees” (see “6” in FIG. 8B) is a unit as shown in FIG. The images are output in the fourth and fifth columns of the pixel group 203, respectively. Although not described above, an image visually recognized by an observer at a position of “−22.5 degrees” (see “8” in FIG. 8B) is a unit as shown in FIG. The images are output to the second and third columns of the pixel group 203, respectively.

  Although not described above, the image visually recognized by the observer at the position of “+7.5 degrees” (see “4” in FIG. 8B) is a unit as shown in FIG. The images are output to the fifth and sixth columns of the pixel group 203, respectively. Although not described above, the image visually recognized by the observer at the position of “+22.5 degrees” (see “2” in FIG. 8B) is a unit as shown in FIG. The images are output in the seventh and eighth columns of the pixel group 203, respectively.

  The correspondence shown in FIG. 9 is information that can be specified by the specifications of the stereoscopic display monitor. For example, the correspondence shown in FIG. 9 is information specified by the specifications of the display unit 132 and the display unit 142 that are nine-parallax monitors.

  In the first embodiment, information based on the correspondence relationship of the display unit 132 and information based on the correspondence relationship of the display unit 142 are stored in advance in the storage unit 134 of the workstation 130, for example. That is, the storage unit 134 of the workstation 130 according to the first embodiment stores the viewpoint position of the observer and the viewpoint position with respect to the stereoscopic display device (stereoscopic display monitor) that simultaneously displays a predetermined number (predetermined number of parallaxes) of images. A plurality of types of image information for allocating an image based on volume data, which is three-dimensional medical image data, is stored as a predetermined number of images based on the correspondence relationship with the image visually recognized by the observer.

  In the present embodiment, the storage unit 134 stores a plurality of types of image information based on the correspondence between the display unit 132 of the own device and the stereoscopic display monitor included in the device connected to the workstation 130. For example, since the correspondence relationship between the display unit 132 and the display unit 142 is the same, the storage unit 134 stores a plurality of types of image information based on the correspondence relationship between the display unit 132 and the display unit 142.

  FIG. 10 is a diagram for explaining the image information. For example, as shown in FIG. 10, the image information is information specifying “images 1 to 9” as images to be assigned to the first to ninth columns of the unit pixel group 203. For example, the storage unit 134 stores multiple sets of information specifying rendering conditions for generating each image of “images 1 to 9” from volume data as image information of the display unit 132 and the display unit 142. To do.

  Then, the control unit 135 of the workstation 130 according to the first embodiment performs control so that a predetermined number of images that match image information selected from a plurality of types of image information are displayed on the stereoscopic display monitor. Specifically, the control unit 135 of the workstation 130 controls the rendering processing unit 136 that performs rendering processing on the volume data so as to generate an image group that matches the image information. Then, the control unit 135 performs control so that the image group generated by the rendering processing unit 136 is displayed on the stereoscopic display monitor.

  Below, the case where the operator of the terminal device 140 which has a 9 parallax monitor as the display part 142 selects the image information of the image group displayed on the display part 142 is demonstrated. In such a case, the operator of the terminal device 140 inputs the accompanying information of the volume data via the input unit 141. In addition, the operator of the terminal device 140 inputs a selection request for image information via the input unit 141. Information received by the input unit 141 is transmitted to the communication unit 133 via the communication unit 143 under the control of the control unit 145, and the communication unit 133 notifies the control unit 135 of the received information.

  Then, the control unit 135 acquires volume data associated with the notified supplementary information from the image storage device 120. The control unit 135 that has received the image information selection request transmits a list of a plurality of types of image information based on the correspondence relationship of the display unit 142 stored in the storage unit 134 to the communication unit 143 via the communication unit 133. To do. The communication unit 143 notifies the control unit 145 of the received list of image information. The control unit 145 causes the display unit 142 to display the notified list. The operator of the terminal device 140 uses the input unit 141 to select image information that has been determined to be the optimal display pattern when interpreting the volume data specified by the user from the displayed list. Note that the list of image information may be stored in advance in the storage unit 144 of the terminal device 140.

  The control unit 145 transmits the selected image information to the communication unit 133 via the communication unit 143, and the communication unit 133 notifies the control unit 135 of the received image information. The control unit 135 controls the rendering processing unit 136 to generate an image group that matches the notified image information with respect to the acquired volume data. Then, the control unit 135 transmits the image group generated by the rendering processing unit 136 to the communication unit 143 of the terminal device 140 via the communication unit 135, and the control unit 145 transmits the image group received by the communication unit 143. The image is converted into an intermediate image and output to the display unit 142.

  Accordingly, in the first embodiment, an image group displayed on a monitor capable of stereoscopic viewing, that is, a monitor capable of changing an image observed in accordance with motion parallax, according to various requests of an operator. Can be changed.

  Hereinafter, specific examples of a plurality of types of image information stored in the storage unit 134 will be described. For example, the image information is parallax angle information that is information in which a parallax image group generated by volume rendering processing from volume data is assigned as a predetermined number of images and that specifies parallax angles between parallax images. 11 to 13 are diagrams for explaining specific examples of processing using the parallax angle information.

  The parallax angle information used in the processing of FIG. 11 is information specifying a parallax angle for generating a parallax image group in which volume data is observed at an angle close to the relative movement angle of the observer with respect to the stereoscopic display monitor. is there. For example, in the parallax angle information, “Image 1” is “−30 degrees” parallax image, “Image 2” is “−29 degrees” parallax image, and “Image 3” is “ The information is designated as “−15 degree parallax image”. Further, for example, in the parallax angle information, “Image 4” is “−14 degrees” parallax image, “Image 5” is “0 degree” parallax image, and “Image 6” is “ This is information specified as “+14 degree parallax image”. Further, for example, in the parallax angle information, “Image 7” is “+15 degree parallax image”, “Image 8” is “+29 degree parallax image”, and “Image 9” is ““ +30 degree parallax image ”.

  First, the parallax angle information used in the processing of FIG. 11 is image information selected by an operator (corresponding to an observer) of the terminal device 140 who desires the following interpretation. That is, the operator of the terminal device 140 (corresponding to the observer) observes the volume data three-dimensionally from the viewpoint “−30 degrees” and moves “−15 degrees” in the vicinity of the position moved “−30 degrees”. In the vicinity of the position, the volume data is requested to be stereoscopically observed from the viewpoint “−15 degrees”. Further, the operator of the terminal device 140 observes the volume data stereoscopically from the viewpoint “+30 degrees” in the vicinity of the position moved “+30 degrees”, and the volume data is viewed from the viewpoint “ It is requested to observe stereoscopically from “+15 degrees”.

  For example, as shown in FIG. 11A, the control unit 135 notified of the selection of the image information sets a reference “0 degree” viewpoint at a position facing the front of the subject portion. In the example shown in FIG. 11A, the control unit 135 sets the viewpoints “−14 degrees, −15 degrees, −29 degrees, −30 degrees” clockwise from the viewpoint “0 degrees”, Further, the viewpoints “+14 degrees, +15 degrees, +29 degrees, +30 degrees” are set counterclockwise from the viewpoint “0 degrees”.

  Then, the rendering processing unit 136 performs volume rendering processing on the subject portion by using, for example, the perspective projection method using each of the nine viewpoints set by the control unit 135, thereby generating nine parallaxes as illustrated in FIG. Generate an image. The generated 9-parallax image is converted into, for example, an intermediate image with 3 rows and 3 columns and displayed on the 9-parallax monitor.

  Thereby, for example, as shown in FIG. 11B, the observer has “−14 degrees, −15 degrees” in the vicinity of the position moved by “−15 degrees” (see “7” in the figure). By simultaneously viewing the parallax images, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “−15 degrees”. In addition, as shown in FIG. 11B, the observer has a parallax image of “−29 degrees, −30 degrees” in the vicinity of the position moved by “−30 degrees” (see “9” in the figure). Are simultaneously viewed, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “−30 degrees”.

  Further, for example, as shown in FIG. 11B, the observer displays a parallax image of “+14 degrees, +15 degrees” in the vicinity of the position moved by “+15 degrees” (see “3” in the figure). By viewing at the same time, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “+15 degrees”. Further, for example, as shown in FIG. 11B, the observer displays a parallax image of “+29 degrees, +30 degrees” in the vicinity of the position moved by “+30 degrees” (see “1” in the figure). By viewing at the same time, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “+30 degrees”.

  However, as shown in FIG. 11B, the observer, as the two-dimensional image, only the parallax image of “0 degree” is near the position facing the display unit 142 (see “5” in the figure). Visually check. In addition, at the positions “2” and “8” shown in FIG. 11B, the parallax angle of the image pair incident on both eyes is large, and stereoscopic viewing by the observer is impossible.

  Next, the parallax angle information used in the processing of FIG. 12 is a parallax for generating a parallax image group in which volume data is observed at an angle larger than an angle close to the relative movement angle of the observer with respect to the stereoscopic display monitor. Information specifying a corner. For example, in the parallax angle information, “Image 1” is “−60 degrees” parallax image, “Image 2” is “−59 degrees” parallax image, and “Image 3” is ““ The information is designated as “−30 degree parallax image”. Further, for example, in the parallax angle information, “Image 4” is “−29 degrees” parallax image, “Image 5” is “0 degree” parallax image, and “Image 6” is “ This is information specified as “+44 degree parallax image”. Further, for example, in the parallax angle information, “Image 7” is “+45 degree parallax image”, “Image 8” is “+89 degree parallax image”, and “Image 9” is ““ +90 degree parallax image ”.

  The disparity angle information used in the processing of FIG. 12 is image information selected by an operator (corresponding to an observer) of the terminal device 140 who desires the following interpretation. That is, the operator of the terminal device 140 observes the volume data stereoscopically from the viewpoint “−30 degrees” near the position moved “−15 degrees”, and the volume data near the positions moved “−30 degrees”. Is desired to be observed three-dimensionally from the viewpoint “−60 degrees”. That is, the operator desires that the angle for observation should be an angle twice the relative movement angle on the left side from the position facing the stereoscopic monitor.

  Further, for example, the operator of the terminal device 140 observes the volume data stereoscopically from the viewpoint “+45 degrees” near the position moved “+15 degrees”, and the volume data near the positions moved “+30 degrees”. It is desired to observe stereoscopically from the viewpoint “+90 degrees”. That is, the operator desires that the angle for observation is an angle three times the relative movement angle on the right side from the position facing the stereoscopic monitor.

  For example, as illustrated in FIG. 12A, the control unit 135 notified of the selection of the image information sets a reference “0 degree” viewpoint at a position facing the front of the rendering area. In the example illustrated in FIG. 12A, the control unit 135 sets the viewpoints “−29 degrees, −30 degrees, −59 degrees, −60 degrees” clockwise from the viewpoint “0 degrees”. Further, the viewpoints “+44 degrees, +45 degrees, +89 degrees, +90 degrees” are set counterclockwise from the viewpoint “0 degrees”.

  Then, the rendering processing unit 136 performs the volume rendering process on the rendering area by using, for example, the perspective projection method using each of the nine viewpoints set by the control unit 135, as illustrated in FIG. Generate an image. The generated 9-parallax image is converted into, for example, an intermediate image with 3 rows and 3 columns and displayed on the 9-parallax monitor.

  Thereby, for example, as shown in FIG. 12B, the observer has “−29 degrees, −30 degrees” in the vicinity of the position moved by “−15 degrees” (see “7” in the figure). By simultaneously viewing the parallax images, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “−30 degrees”. In addition, as shown in FIG. 12B, the observer has a parallax image of “−59 degrees and −60 degrees” in the vicinity of the position moved by “−30 degrees” (see “9” in the figure). Are simultaneously viewed, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “−60 degrees”.

  In addition, for example, as shown in FIG. 12B, the observer displays a parallax image of “+44 degrees, +45 degrees” in the vicinity of the position moved by “+15 degrees” (see “3” in the figure). By viewing at the same time, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “+45 degrees”. Further, for example, as shown in FIG. 12B, the observer displays a parallax image of “+89 degrees, +90 degrees” in the vicinity of the position moved by “+30 degrees” (see “1” in the figure). By viewing at the same time, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “+90 degrees”.

  However, as shown in FIG. 12B, the observer, as the two-dimensional image, only the parallax image of “0 degree” is located near the position facing the display unit 142 (see “5” in the figure). Visually check. In addition, at the positions “2” and “8” shown in FIG. 12B, the parallax angle of the image pair incident on both eyes is large, and stereoscopic viewing by the observer is impossible.

  The operator can not only select a plurality of types of image information stored in advance, but can further change the selected image information. That is, in the present embodiment, the input unit 141 receives a change in image information. Then, the control unit 135 controls the display unit 142 to display a predetermined number of images that match the changed image information received by the input unit 141. For example, the parallax angle information described in FIG. 12 is changed so that “image 8” is a “+59 degree parallax image” and “image 9” is a “+60 degree parallax image”. It may be the case.

  Alternatively, for example, the above-described parallax angle information is executed by a virtual endoscopy (VE) display method widely used as a display method (CTC: CT Colonography) of a three-dimensional X-ray CT image obtained by imaging the large intestine. Can be changed by the operator. However, the parallax angle information described below can be applied not only to the virtual endoscope display in the large intestine but also to the virtual endoscope display in various organs such as blood vessels, bronchi, pharynx and pancreatic duct.

  For example, the segmentation processing unit 1361 g extracts a lumen region of the large intestine. Further, the segmentation processing unit 1361 g extracts the core line of the lumen region. Then, the segmentation processing unit 1361g further sets a reference point for the extracted core line. Here, for example, the operator of the terminal device 140 selects the selected parallax so that a parallax image group capable of stereoscopically observing the inner wall of the lumen in the traveling direction of the core line is generated in the vicinity of the position facing the display unit 142. Change the corner information. Further, for example, in the vicinity of the position moved by “+30 degrees”, the operator of the terminal device 140 has a parallax image group that can stereoscopically observe the inner wall of the lumen in the direction of “+30 degrees” with respect to the traveling direction of the core wire. The selected parallax angle information is changed so as to be generated.

  The control unit 135 that has received the changed parallax angle information has the reference point and two points adjacent to the reference point as viewpoints, and the line-of-sight direction is the traveling direction of the core line. The rendering processing unit 136 is controlled to generate “images (parallax images a, b, c)”. Further, the control unit 135 sets the reference point and one point adjacent to the reference point as the viewpoint, and sets the line-of-sight direction to “+30 degrees” with respect to the traveling direction of the core line. The rendering processing unit 136 is controlled to generate a “parallax image (parallax images d, e)”.

  Thereby, for example, as shown in FIG. 13, the observer can select “parallax images a and b” or “parallax images b and c” in the vicinity of the position facing the display unit 142 (see “0” in the figure). ”At the same time, it is possible to refer to an image as if the inner wall of the lumen was observed three-dimensionally in the traveling direction of the core wire. Further, as shown in FIG. 13, the observer can simultaneously view the “parallax images d and e” near the position moved by “+30 degrees” (see “1” in the figure) to thereby obtain the inner wall of the lumen. Can be referred to as a three-dimensional observation in a direction of “+30 degrees” with respect to the traveling direction of the core wire. That is, to explain using the image information shown in FIG. 10, the operator changes “images 4, 5, and 6” to rendering conditions for generating “parallax images a, b, and c” and “image 8”. , 9 ”is changed to a rendering condition for generating“ parallax images d, e ”. The operator changes “images 1 to 3, 7”, for example, without outputting an image. By performing such display, the observer can simultaneously observe a place such as the back side of a wall where a lesion is easily overlooked. The changed image information may be additionally stored in the storage unit 134. By performing such processing, variations in image information that can be selected by the radiogram interpreter can be increased.

  In addition to the parallax angle information, the image information selected by the operator is type information specifying the type of each image constituting a predetermined number of images based on the volume data. 14 and 15 are diagrams for explaining a specific example of processing using type information.

  The type information used in the processing of FIG. 14 includes a parallax image displayed for stereoscopic viewing on a stereoscopic display monitor and a plane image obtained by cutting volume data with a reference plane used for generating the parallax image as a predetermined number of images. It is the assigned information. For example, in the type information, “Image 2” is a “−60 degree” parallax image, and “Image 3” is a “−59 degree” parallax image. Further, for example, the type information includes “image 4” being “−1 degree parallax image”, “image 5” being “0 degree parallax image”, and “image 6” being ““ +1 degree “parallax image”. Further, for example, in the type information, “Image 7” is a “+89 degree parallax image”, and “Image 8” is a “+90 degree parallax image”. The type information includes, for example, “Image 1” is “MPR image of reference plane of parallax image of“ −60 degrees ””, and “Image 9” is MPR of reference plane of parallax image of “+90 degrees”. Image ".

  The type information used in the processing of FIG. 14 is image information selected by an operator (corresponding to an observer) of the terminal device 140 who desires the following interpretation. That is, the operator of the terminal device 140 observes volume data three-dimensionally from the viewpoint “−60 degrees” in the vicinity of the position moved “−15 degrees”, and “+15 degrees to the right from the position facing the display unit 142. In the vicinity of the moved position, it is desired to observe the volume data stereoscopically from the viewpoint “+90 degrees”.

  Further, for example, the operator of the terminal device 140 observes three-dimensionally in the vicinity of the position moved “−15 degrees” in the vicinity of the position moved “−30 degrees”, and in the vicinity of the position moved “+30 degrees”, “ It is desired to observe three-dimensionally in the vicinity of the position moved by “+15 degrees”.

  For example, as shown in FIG. 14A, the control unit 135 notified of the selection of the image information sets a reference “0 degree” viewpoint at a position facing the front of the rendering area. In the example illustrated in FIG. 14A, the control unit 135 sets the viewpoints “−1 degree, −59 degrees, −60 degrees” clockwise from the viewpoint “0 degrees”, and further the viewpoint “ A viewpoint of “+1 degree, +89 degree, +90 degree” is set counterclockwise from “0 degree”. The rendering processing unit 136 generates seven parallax images by performing volume rendering processing on the rendering area by using, for example, a perspective projection method, using each of the seven viewpoints set by the control unit 135.

  Further, for example, as illustrated in FIG. 14A, the control unit 135 generates a reference plane (projection plane) used to generate a parallax image with a viewpoint “−60 degrees” and a parallax image with a viewpoint “+90 degrees”. ) Location information. That is, as shown in FIG. 14A, the control unit 135 uses a vertical plane perpendicular to a straight line from the viewpoint “−60 degrees” to the center of gravity of the rendering area as a reference plane, and renders the reference plane with the vertical plane. The rendering processing unit 136 generates the “MPR image (−60 degrees)” obtained by cutting the region. Similarly, as shown in FIG. 14A, the control unit 135 uses a vertical plane that is perpendicular to a straight line from the viewpoint “+90 degrees” to the center of gravity of the rendering area as a reference plane, and renders the reference plane. The rendering processing unit 136 generates the “MPR image (+90 degrees)” obtained by cutting the region.

  The nine images generated by the rendering processing unit 136 are converted into intermediate images under the control of the control unit 145. That is, the control unit 145 converts the nine images into “MPR image (−60 degrees), parallax image (−60 degrees), parallax image (−59 degrees)”, “parallax image (−1 degree), and parallax image ( 0 degree), parallax image (1 degree) "and" parallax image (+89 degree), parallax image (+90 degree), MPR image (+90 degree) "are converted into intermediate images arranged in 3 rows and 3 columns. Then, the control unit 145 causes the display unit 142 to display the intermediate image.

  Thereby, for example, as shown in FIG. 14B, the observer can select “−1, 0 degree” or “0” in the vicinity of the position facing the display unit 142 (see “5” in the figure). By simultaneously viewing the parallax image of “degree, +1 degree”, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “0 degree”.

  In addition, as shown in FIG. 14B, the observer has a parallax image of “−59 degrees and −60 degrees” in the vicinity of the position moved by “−15 degrees” (see “7” in the figure). Are simultaneously viewed, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “−60 degrees”. Further, as shown in FIG. 14B, the observer has an MPR image corresponding to the parallax image “−60 degrees” in the vicinity of the position moved “−30 degrees” (see “9” in the figure). (-60 degrees) can be observed.

  Further, as shown in FIG. 14B, the observer visually recognizes the parallax images of “+89 degrees and +90 degrees” at the same time in the vicinity of the position moved by “+15 degrees” (see “3” in the figure). By doing this, it is possible to refer to an image as if the volume data was stereoscopically observed from the viewpoint “+90 degrees”. Further, as shown in FIG. 14B, the observer has an MPR image (+90) corresponding to the parallax image “+90 degrees” in the vicinity of the position moved by “+30 degrees” (see “1” in the figure). Degree) can be observed. The type information can also be changed by the operator. For example, the operator can change “images 4, 5, 6” to “MPR image of the reference plane of the parallax image of“ 0 degree ””. Further, as described above, the changed type information may be additionally stored in the storage unit 134.

  The type information used in the processing of FIG. 15 is information in which a group of plane images obtained by cutting volume data along different planes is assigned to a predetermined number of images.

  The type information used in the processing of FIG. 15 is, for example, image information in which five MPR images obtained by cutting volume data at intervals of 10 mm are assigned to “images 2, 4, 5, 6, 8”. The type information used in the process of FIG. 15 is, for example, the same image as “Image 2” is assigned to “Image 1”, the same image as “Image 4” is assigned to “Image 3”, and “Image This is image information in which the same image as “6” is assigned to “image 7” and the same image as “image 8” is assigned to “image 9”.

  The type information used in the processing of FIG. 15 is image information selected by an operator (corresponding to an observer) of the terminal device 140 who requests the following interpretation, for example. That is, the operator of the terminal device 140 requests observation of five MPR images obtained by cutting the lumen region of the large intestine described with reference to FIG. 13 along five planes. Specifically, the operator of the terminal device 140 has five MPR images obtained by cutting the lumen region at intervals of “10 mm” around the reference point along each of the traveling direction of the core wire and the opposite direction of the traveling direction. Request observation. The designation of the reference point is set by the operator along with the selection of the type information.

  The control unit 135 that has received the type information sets a plane that passes through the reference point (0 mm) on the core line and goes straight to the core line, as shown in FIG. Further, as shown in FIG. 15, the control unit 135 sets a plane perpendicular to the core wire at each point moved “−10 mm” and “−20 mm” along the opposite direction of the traveling direction from the reference point. Further, as shown in FIG. 15, the control unit 135 sets a plane perpendicular to the core wire at each point moved by “+10 mm” and “+20 mm” along the traveling direction from the reference point. Then, as illustrated in FIG. 15, the control unit 135 causes the rendering processing unit 136 to generate MPR images of “−20 mm”, “−10 mm”, “0 mm”, “+10 mm”, and “+20 mm”. However, the control unit 135 may, for example, render processing units so as to generate two “−20 mm” MPR images, “−10 mm” MPR images, “+10 mm” MPR images, and “+20 mm” MPR images. 136 is controlled.

  The nine images generated by the rendering processing unit 136 are converted into intermediate images under the control of the control unit 145. That is, the control unit 145 displays nine images as “MPR image (−20 mm), MPR image (−20 mm), MPR image (−10 mm)”, “MPR image (−10 mm), MPR image (0 mm), and MPR. "Image (+10 mm)" and "MPR image (+10 mm), MPR image (+20 mm), MPR image (+20 mm)" are converted into intermediate images arranged in three rows and three columns. Then, the control unit 145 causes the display unit 142 to display the intermediate image.

  Thereby, for example, the observer displays the “−20 mm MPR image” near the position moved “−30 degrees”, and the “−10 mm MPR image” near the position moved “−15 degrees”. Observe the “0 mm MPR image” in the vicinity of the position directly opposite to “+15 mm”, the “+10 mm MPR image” in the vicinity of the position moved “+15 degrees”, and the “+20 mm MPR image” in the vicinity of the position moved “+30 degrees”. can do.

  The type information for displaying the MRP image can also be changed by the operator. For example, the operator can change the nine MPR images obtained by cutting the volume data at intervals of 10 mm to the type information respectively assigned to “images 1 to 9”. Further, as described above, the changed type information may be additionally stored in the storage unit 134.

  Here, the type information used in the processing of FIG. 15 is image information for displaying a plane image group (MPR image group) obtained by cutting the volume data along different planes. However, the storage unit 134 further stores, as type information, type information that is information obtained by allocating slice image groups used to reconstruct volume data to a predetermined number of images. Specifically, the type information is used for interpretation of a plane image group (slice image group) obtained by scan reconstruction of a multi-slice X-ray CT apparatus or an MRI apparatus.

  In other words, the above type information includes, for example, five slice positions in “slices 2, 4, 5, 6, 8” in the slice image group used to reconstruct the volume data. The assigned image information. For example, the type information described above assigns the same image as “Image 2” to “Image 1”, assigns the same image as “Image 4” to “Image 3”, and the same image as “Image 6”. Is assigned to “image 7” and the same image as “image 8” is assigned to “image 9”.

  More specifically, in the above type information, “slice at the scan center position” is assigned to “image 5”, and “slice 2 before the slice at the scan center position and“ image 4 ”are assigned to“ image 2 ”and“ image 4 ”, respectively. This is information to which “two slices one slice before” is assigned. The type information is information in which “two slices after one slice and one slice after the slice at the scan center position” are assigned to “image 6” and “image 8”, respectively.

  Receiving such type information, the rendering processing unit 136 or the control unit 135 selects planar images (slice images) at five slice positions.

  Then, the control unit 135 determines that “a flat image (2 slices before the scan center), a flat image (2 slices before the scan center), a flat image (1 slice before the scan center)”, “a flat image (1 from the scan center). Pre-slice), plane image (scan center slice), plane image (after 1 slice from scan center), “plane image (after 1 slice from scan center), plane image (after 2 slices from scan center), plane image ( The image is converted into an intermediate image arranged in 3 rows and 3 columns "after 2 slices from the scan center)". Then, the intermediate image is displayed on the display unit 142.

  Thus, for example, the observer can display “a plane image two slices before the scan center” in the vicinity of the position moved “−30 degrees”, and “one slice before the scan center” in the vicinity of the position moved “-15 degrees”. Move the “planar image” by “+30 degrees” in the vicinity of the position facing the display unit 142, “planar image at the scan center” and “planar image one slice after the scan center” in the vicinity of the position moved by “+15 degrees”. In the vicinity of the position, the “planar image after two slices from the scan center” can be observed.

  The type information for displaying the slice image can also be changed by the operator. For example, the operator can change nine slice images to type information assigned to “images 1 to 9”. Further, as described above, the changed type information may be additionally stored in the storage unit 134.

  In addition to the parallax angle information and the type information, the image information selected by the operator is opacity information that specifies opacity when two volume data are superimposed. For example, the opacity information is information in which opacity when two volume data generated by different medical image diagnostic apparatuses are superimposed is designated. FIG. 16 is a diagram for explaining a specific example of processing using opacity information.

  For example, the operator of the terminal device 140 may display an image of the axial surface (X-ray CT image) of the X-ray CT volume data generated by the PET-CT apparatus and an image of the axial surface (PET image) of the PET volume data. ) Is selected when the image with the superimposed display is interpreted. In the opacity information, ““ X-ray CT image opacity: PET image opacity ”=“ 100: 0 ”” is designated for “Image 1” and “Image 2”. In the opacity information, ““ X-ray CT image opacity: PET image opacity ”=“ 75:25 ”” is designated for “Image 3” and “Image 4”. Further, in the opacity information, ““ X-ray CT image opacity: PET image opacity ”=“ 50:50 ”” is designated in “Image 5”. In the opacity information, “image 6” and “image 7” are designated as ““ X-ray CT image opacity: PET image opacity ”=“ 25:75 ””. In this opacity information, ““ X-ray CT image opacity: PET image opacity ”=“ 0: 100 ”” is designated for “Image 8” and “Image 9”.

  The control unit 135 that has received such information instructs the rendering processing unit 136 to generate a superimposed image with the received ratio. As illustrated in FIG. 16, the rendering processing unit 136 performs a superimposed image of “100: 0”, a superimposed image of “75:25”, a superimposed image of “50:50”, a superimposed image of “25:75”, and “ A superimposed image of “0: 100” is generated. However, the control unit 135 generates, for example, two images each of “100: 0” superimposed image, “75:25” superimposed image, “25:75” superimposed image, and “0: 100” superimposed image. Thus, the rendering processing unit 136 is controlled.

  The nine images generated by the rendering processing unit 136 are converted into intermediate images under the control of the control unit 145. That is, the control unit 145 converts the nine images into a “100: 0” superimposed image, a “100: 0” superimposed image, a “75:25” superimposed image, and a “75:25” superimposed image. , “50:50” superimposed image, “25:75” superimposed image ”,“ 25:75 ”superimposed image,“ 0: 100 ”superimposed image,“ 0: 100 ”superimposed image” Convert to an intermediate image arranged in three rows. Then, the control unit 145 causes the display unit 142 to display the intermediate image.

  Thereby, for example, the observer displays a superimposed image of “100: 0” near the position moved “−30 degrees” and a superimposed image of “75:25” near the position moved “-15 degrees”. The superimposed image of “50:50” is near the position facing the portion 142, the superimposed image of “25:75” is near the position moved “+15 degrees”, and “0: 100” is near the position moved “+30 degrees”. Can be observed respectively. That is, the observer can refer to the RI accumulation portion depicted in the PET image and the tissue structure depicted in the X-ray CT image at various ratios by simply moving the viewpoint with respect to the monitor in the lateral direction. it can.

  Here, the case where opacity information is selected when two volume data generated by different medical image diagnostic apparatuses are superimposed has been described above. However, the opacity information stored in the storage unit 134 is a case where the opacity information stored in the storage unit 134 is selected to specify opacity when two volume data generated at different times by the same type of medical image diagnostic apparatus are superimposed. Also good.

  For example, the operator of the terminal device 140 uses an image obtained by superimposing two X-ray CT images in which a site to be treated is depicted by X-ray CT volume data before and after treatment generated by the X-ray CT apparatus. When performing comparative interpretation, the opacity information is selected. In the opacity information for comparative interpretation, “Image 1” and “Image 2” include ““ Opacity of X-ray CT image (before treatment): Opacity of X-ray CT image (after treatment) ”=“ 100: 0. "" Is specified. Further, in the opacity information, “Image 3” and “Image 4” include ““ Opacity of X-ray CT image (before treatment): Opacity of X-ray CT image (after treatment) ”=“ 75:25 ”. Is specified. In the opacity information, ““ X-ray CT image (before treatment) opacity: X-ray CT image (after treatment) opacity ”=“ 50:50 ”” is designated in “image 5”. . Further, in the opacity information, “Image 6” and “Image 7” include ““ Opacity of X-ray CT image (before treatment): Opacity of X-ray CT image (after treatment) ”=“ 25:75 ”. Is specified. Further, in the opacity information, “image 8” and “image 9” include ““ Opacity of X-ray CT image (before treatment): Opacity of X-ray CT image (after treatment) ”=“ 0: 100 ”. Is specified.

  Under the control of the control unit 135 that has received the selection of opacity information for comparative interpretation, the rendering processing unit 136 performs alignment between the X-ray CT volume data before treatment and the X-ray CT volume data after treatment. Thereafter, an X-ray CT image of the axial surface of the treatment target site is generated. For example, the rendering processing unit 136 performs the same processing described in the example illustrated in FIG. Thereby, for example, the observer displays a superimposed image of “100: 0” near the position moved “−30 degrees” and a superimposed image of “75:25” near the position moved “-15 degrees”. The superimposed image of “50:50” is near the position facing the portion 142, the superimposed image of “25:75” is near the position moved “+15 degrees”, and “0: 100” is near the position moved “+30 degrees”. Can be observed respectively. That is, the observer moves the viewpoint with respect to the monitor in the horizontal direction between the appearance of the treatment target region depicted on the X-ray CT before the treatment and the appearance of the treatment target portion depicted on the X-ray CT after the treatment. Just refer to various ratios.

  Next, processing of the image processing system 1 according to the first embodiment will be described with reference to FIGS. 17 and 18. FIG. 17 is a flowchart for explaining processing of the workstation according to the first embodiment. FIG. 18 is a flowchart for explaining processing of the terminal device according to the first embodiment.

  As illustrated in FIG. 17, the workstation 130 of the image processing system 1 according to the first embodiment determines whether volume data to be processed is specified by the operator of the terminal device 140 (Step S <b> 101). ). Here, when the volume data is not designated (No at Step S101), the workstation 130 waits until the volume data is designated.

  On the other hand, when the volume data is designated (Yes at Step S101), the control unit 135 acquires the designated volume data from the image storage device 120 (Step S102). And the control part 135 determines whether selection of image information was received from the operator of the terminal device 140 (step S103). Here, as described above, the image information is parallax angle information, type information, opacity information, and the like.

  When the selection of image information is not accepted (No at Step S103), the control unit 135 waits until the selection of image information is accepted. On the other hand, when selection of image information is accepted (Yes at Step S103), the rendering processing unit 136 generates an image group corresponding to the number of parallaxes from the volume data based on the selected image information under the control of the control unit 135. (Step S104).

  And the communication part 133 transmits the image group for the number of parallaxes to the terminal device 140 by control of the control part 135 (step S105), and complete | finishes a process.

  Thereafter, as illustrated in FIG. 17, the terminal device 140 of the image processing system 1 according to the first embodiment determines whether the communication unit 143 has received an image group from the workstation 130 (step S201). . Here, when the image group is not received (No at Step S201), the terminal device 140 stands by until the image group is received.

  On the other hand, when the image group is received (Yes at Step S201), the control unit 145 converts the received image group into an intermediate image (Step S202), displays the image group on the display unit 142 (Step S203), and ends the process. . Note that the image information received by the control unit 135 in step S103 may be image information changed by an operator of the terminal device 140 as described above.

  As described above, in the first embodiment, the image group displayed on the stereoscopically visible monitor can be changed according to the image information selected by the observer. That is, in the example shown in FIG. 11, the observer can refer to an image as if the volume data was stereoscopically observed from the viewpoint whose position was moved in accordance with the movement amount with respect to the stereoscopic monitor. In the example shown in FIG. 12, the observer can refer to an image as if the volume data was stereoscopically observed from a viewpoint whose position was moved more than the movement amount relative to the stereoscopic monitor. That is, in the example shown in FIG. 12, an observer who has referred to an image as if the coronal plane of volume data was observed stereoscopically only moves the viewpoint with respect to the monitor in the horizontal direction, and sagittal of the volume data. An image as if the surface was observed stereoscopically can be referred to.

  In the example shown in FIG. 13, the observer can stereoscopically view the virtual endoscopic image from the same viewpoint in various directions only by moving the viewpoint with respect to the monitor in the horizontal direction. In the example illustrated in FIG. 14, the observer can observe the MPR image corresponding to the parallax image group that has been stereoscopically viewed by simply moving the viewpoint with respect to the monitor in the horizontal direction.

  In the example illustrated in FIG. 15, the observer can continuously refer to the MPR image group along the core line direction simply by moving the viewpoint with respect to the monitor in the horizontal direction. Further, the example shown in FIG. 15 can also be applied to, for example, an axial image along the opposite axis direction of a subject imaged by an X-ray CT apparatus. In such a case, the observer can continuously refer to the X-ray CT image group on the axial plane along the opposite axis direction by simply moving the viewpoint with respect to the monitor in the horizontal direction.

  Further, in the example shown in FIG. 16, the RI accumulation portion depicted in the PET image and the tissue structure depicted in the X-ray CT image are referred to at various ratios by simply moving the viewpoint relative to the monitor in the horizontal direction. can do. For example, in the example shown in FIG. 16, the observer can roughly observe the accumulation site and the tissue structure at a position facing the monitor. In addition, as the observer moves the viewpoint in the left direction, the tissue structure gradually becomes clear, and as the viewpoint moves in the right direction, the accumulation site gradually becomes clear. In addition, the shape, size, and the like of the accumulation site can be grasped only by a simple operation of moving the viewpoint.

  Further, processing using the opacity information shown in FIG. 16, that is, processing executed using two volume data generated by continuously imaging the same part of the same subject by different medical image diagnostic apparatuses. May be applied to two volume data generated by imaging the same part of the same subject at different times by the same type of medical image diagnostic apparatus. By such processing, the following effects can be obtained. That is, the observer moves the viewpoint with respect to the monitor in the horizontal direction between the appearance of the treatment target region depicted on the X-ray CT before the treatment and the appearance of the treatment target portion depicted on the X-ray CT after the treatment. Just refer to various ratios. For example, the observer can simultaneously perform comparative observation of the shape change and the like of the treatment target site before and after treatment at a position facing the monitor. In addition, as the observer moves the viewpoint in the left direction, the aspect of the treatment target part before treatment gradually becomes clear, and as the viewpoint moves in the right direction, the aspect of the treatment target part gradually becomes clear. Therefore, it is possible to grasp the effect of treatment and the follow-up of the lesion only by a simple operation of moving the viewpoint.

  Further, the plurality of types of image information may be image information in which there are a plurality of observers referring to the stereoscopic display monitor, and the plurality of observers are in positions corresponding to the stereoscopic display monitor. For example, when a plurality of observers observe a stereoscopic display monitor in a narrow range (for example, a range of −7.5 degrees to +7.5 degrees), and a plurality of observers have a wide range (for example, −30 degrees to +30). It may be a case where image information adapted to the case of observing the stereoscopic display monitor in the range of degrees is stored in the storage unit 134. For example, in the case of a narrow range, image information in which a parallax image of “0 degree” and a parallax image of “+1 degree” are alternately assigned to the images 3 to 7 is selected. The image information in which “0 degree” parallax images and “+1 degree” parallax images are alternately assigned to the images 1 to 9 may be selected.

  This embodiment is applicable even when an operator of a workstation 130 having a nine-parallax monitor as the display unit 132 selects and sets image information of an image group displayed on the display unit 132 or the display unit 142. Is possible.

  In the above-described embodiment, a case has been described in which selection of image information for one volume data is received and control is performed so that an image group that matches the received image information is displayed on the stereoscopic display monitor. However, the above embodiment may be a case where selection of image information for each of a plurality of volume data is accepted. That is, in the above embodiment, image information for each of a plurality of volume data is received as image information, and the control unit 135 displays an image group that matches the received image information for each of the plurality of volume data on the stereoscopic display monitor. It may be a case where control is performed as described above.

  In the following, as an example, three volume data generated by imaging the same part of the same subject at different times by the same type of medical image diagnostic apparatus (before treatment, after the first treatment, after the second treatment) ) Will be described. Hereinafter, volume data before treatment is described as “first data”, volume data after the first treatment is described as “second data”, and volume data after the second treatment is referred to as “third data”. It describes.

  For example, the operator selects parallax angle information for displaying a parallax image group in which each of the first data to the third data can be stereoscopically observed from the viewpoint “0 degree”. The parallax angle information includes “parallax image of“ −1 degree ”of the first data” and “parallax image of“ 0 degree ”of the first data for each of“ image 1 ”,“ image 2 ”, and“ image 3 ”. ”And“ + 1-degree parallax image of the first data ”. In addition, the parallax angle information includes “the parallax image of“ −1 degree ”of the second data” and “0 degree of the second data” for “image 4”, “image 5”, and “image 6”, respectively. The parallax image ”and the“ +1 degree parallax image of the second data ”are assigned to the image information. In addition, the parallax angle information includes “-1 degree parallax image of the third data” and “0 degree” of the third data for each of “image 7”, “image 8”, and “image 9”. This is the image information to which the “parallax image” and “the“ +1 degree parallax image of the third data ”” are assigned.

  The control unit 135 that has received the selection of the parallax angle information and the specification of the three volume data sets, for example, a reference “0 degree” viewpoint at a position facing the rendering area of each of the first data to the third data. To do. Then, the control unit 135 sets viewpoints of “−1 degree, +1 degree” around the viewpoint “0 degree” in each of the first data to the third data.

  Then, the rendering processing unit 136 generates three sets of three parallax images by performing volume rendering processing on each of the rendering regions of the first data to the third data using each of the three viewpoints set by the control unit 135. . The generated nine parallax images are converted into, for example, an intermediate image of 3 rows and 3 columns and displayed on the display unit 142.

  Thereby, for example, the observer can stereoscopically observe each of the second data and the third data from the viewpoint “0 degree” in order from the first data by simply moving the display unit 142 from left to right. Become.

  Alternatively, for example, the operator can view each of the first data to the third data stereoscopically from the viewpoint “0 degree” and the first data to the third data observed at the viewpoint “0 degree”. The type information for simultaneously displaying the MPR image corresponding to is selected. Such type information includes “MPR image of the reference plane of the parallax image of“ 0 degree ”in the first data” and “0 degree of the first data” for each of “image 1”, “image 2”, and “image 3”. “Parallax image” and “+1 degree parallax image of the first data” are assigned to the image information. The type information includes “MPR image of the reference plane of the parallax image of“ 0 degree ”in the second data” and ““ of the second data ”for“ image 4 ”,“ image 5 ”, and“ image 6 ”, respectively. This is image information to which “0 degree” parallax image ”and“ second degree “+1 degree parallax image” ”are assigned. Further, the type information includes “image 7”, “image 8”, and “image 9”, “MPR image of the reference plane of the parallax image of“ 0 degree ”in the third data”, “ This is image information to which “0 degree” parallax image ”and“ third data “+1 degree” parallax image ”are assigned.

  The control unit 135 that has received the selection of the type information and the designation of the three volume data sets, for example, the viewpoints “0 degree, +1 degree” in each of the first data to the third data. Further, the control unit 135 acquires position information of a reference plane (projection plane) used to generate each parallax image of the viewpoint “0 degree” in each of the first data to the third data.

  Then, the rendering processing unit 136 performs volume rendering processing on each of the rendering areas of the first data to the third data using each of the two viewpoints set for each data set by the control unit 135, thereby providing two parallax images. 3 sets are generated. Furthermore, the rendering processing unit 135 uses the reference planes set for each data set by the control unit 135 to use the MPR image (0 degree) of the first data, the MPR image (0 degree) of the second data, and the third data. An MPR image (0 degree) of data is generated. The generated nine parallax images are converted into, for example, an intermediate image of 3 rows and 3 columns and displayed on the display unit 142.

  Thereby, for example, the observer simply moves the display unit 142 from left to right, and sequentially, the MPR image (0 degree) of the first data and the first data from the viewpoint “0 degree” are three-dimensionally sequentially. Observed image, MPR image of second data (0 degree), image in which second data is stereoscopically observed from viewpoint “0 degree”, MPR image of third data (0 degree), viewpoint “0 degree” Thus, an image in which the third data is observed stereoscopically can be referred to.

  Alternatively, for example, the operator selects type information for simultaneously displaying a planar image group at each of the three slice positions of the first data to the third data. Such type information includes “image 1”, “image 2”, and “image 3”, respectively, “a planar image one slice before the slice at the scan center position” in the first data, and “scan in the first data”. This is image information to which “planar image at the center position” and “planar image after one slice from the slice at the scan center position” in the first data are assigned. Further, the type information includes “image 4”, “image 5”, and “image 6”, “the planar image one slice before the slice at the scan center position” in the second data, This is image information to which “planar image at the scan center position” and “planar image after one slice from the slice at the scan center position” in the second data are assigned. Further, the type information includes “image 7”, “image 8”, and “image 9”, “a planar image one slice before the slice at the scan center position” in the third data, This is image information to which “planar image at the scan center position” and “planar image after one slice from the slice at the scan center position” in the third data are assigned.

  By the output control of the control unit 135 that has received the selection of the parallax angle information and the designation of the three volume data, for example, the observer simply moves the display unit 142 from the left to the right, in order, the first data “Plane image one slice before the slice at the scan center position”, “Plane image of the slice at the scan center position” in the first data, and “Plane image one slice after the slice at the scan center position” in the first data. Observe. In addition, the observer further moves the display unit 142 from left to right, in order, “planar image one slice before the slice at the scan center position” in the second data, and “scan” in the second data. The “planar image of the slice at the center position” and the “planar image after one slice from the slice at the scan center position” in the second data can be observed. Further, the observer further moves the display unit 142 from left to right, in order, “planar image one slice before the slice at the scan center position” in the third data, and “scan” in the third data in order. The “planar image of the slice at the center position” and the “planar image after one slice from the slice at the scan center position” in the third data can be observed.

  In the above description, the number of volume data preset in the image information may be two, or may be four or more. For example, two pieces of volume data set in the image information are set, and rendering conditions for one volume data are specified for the images 1 to 4, and the other volume is set for the images 5 to 9. When image information in which rendering conditions for data are specified is selected, the control unit 135 causes the image group generated from one volume data to be observed on the left side of the display unit 142 and generated from the other volume data. Output control is performed so that the image group is observed on the right side of the display unit 142.

  As described above, the control unit 135 displays an image group that matches the image information for each of the plurality of volume data, so that the observer can easily perform the progress observation of the lesioned part particularly with one monitor. . The image information for each of the plurality of volume data can be changed after being selected by the operator.

(Second Embodiment)
In the second embodiment, a case where an image group that matches image information is selected will be described.

  In the second embodiment, for example, the control unit 145 of the terminal device 140 selects an image group that matches the received image information from the image group generated by the rendering processing unit 136 that performs the rendering process on the volume data. Then, control is performed so that the selected image group is displayed on the stereoscopic display monitor.

  In order to execute such control processing, first, the control unit 135 according to the second embodiment performs rendering so that a parallax image group and an MPR image group are generated in advance from volume data according to various rendering conditions. The processing unit 136 is instructed. 19 and 20 are diagrams for explaining an image group generated in advance by the rendering processing unit according to the second embodiment.

  For example, in order to allow the parallax angle between parallax images to be arbitrarily changed according to the desires of the observer, the control unit 135 is arranged on a cut surface passing through the center of gravity of the subject portion as shown in FIG. Is set to 360, and 360 viewpoints are set along the entire circumference of the circle so that the parallax angles are 1 degree apart. In FIG. 19A, only 42 viewpoints are drawn for convenience of drawing, but 360 viewpoints are actually set. Then, the rendering processing unit 136 generates a parallax image group composed of 360 parallax images using the set 360 viewpoints. Hereinafter, as shown in FIG. 19A, the all-around parallax image generated for the rendering target is referred to as all-around data. The control unit 135 may set a plurality of perfect circles within the same plane by setting a plurality of true circle radii. Further, the control unit 135 may generate all-around data composed of 720 parallax images by setting “parallax angle: 0.5 degree”, for example.

  Alternatively, the control unit 135 sets a plurality of reference points on a perfect circle as shown in FIG. 19B in order to arbitrarily change the parallax angle between the parallax images according to the request of the observer. Nine viewpoints are set so that the parallax angle is 1 degree apart along each of the tangent lines passing through the plurality of set reference points. Then, the rendering processing unit 136 generates nine parallax images for each reference point by the parallel projection method described with reference to FIG. 6A using the nine viewpoints set for each tangent. The reference points are set at 1 degree intervals or 0.5 degree intervals. Further, similarly to the above, the control unit 135 may set a plurality of perfect circles in the same plane by setting a plurality of true circle radii.

  Further, for example, as shown in FIG. 19C, the control unit 135 sets a plurality of rotation axes that pass through the center of gravity of the subject portion, thereby setting a plurality of perfect circles, and a parallax image group in each perfect circle. Control is performed so that (all surrounding data) is generated.

  Furthermore, as shown in FIG. 20, the control unit 135 controls the rendering processing unit 136 so as to generate an MPR image corresponding to the reference plane of the viewpoint used for generating all-around data for each rotation axis. By such control, the rendering processing unit 136, as shown in FIG. 18, displays “MPR image (−179 degrees),..., MPR image (MPR image (−179 °),..., MPR image ( −1 degree), MPR image (0 degree), MPR image (+1 degree),..., MPR image (+179 degree), MPR image (+180 degree) ”. Similarly, as shown in FIG. 18, the rendering processing unit 136 generates an MPR image group corresponding to all-around data of the rotation axis (2) and an MPR image group corresponding to all-around data of the rotation axis (3). To do.

  Then, the control unit 135 stores the parallax image group and the MPR image group generated by the rendering processing unit 136 in the storage unit 134 or the image storage device 120 in association with the generation source volume data. Hereinafter, a case where a parallax image group and an MPR image group are stored in the image storage device 120 via the communication unit 133 will be described.

  The operator of the terminal device 140 inputs volume data designation and image information selection via the input unit 141 as in the first embodiment. Then, the control unit 145 acquires an image group associated with the volume data received by the input unit 141 from the image storage device 120. Specifically, the communication unit 143 transmits the auxiliary information of the volume data input by the operator to the image storage device 120 under the control of the control unit 145. The image storage device 120 searches for volume data associated with the received supplementary information, and transmits an image group associated with the retrieved volume data to the terminal device 140.

  The control unit 145 selects an image group (images corresponding to the number of parallaxes) that matches the selected image information from the image group received by the communication unit 143, converts the selected image group into an intermediate image, and then displays the display unit. 142 is displayed.

  Next, processing of the image processing system 1 according to the second embodiment will be described with reference to FIGS. 21 and 22. FIG. 21 is a flowchart for explaining processing of the workstation according to the second embodiment. FIG. 22 is a flowchart for explaining processing of the terminal device according to the second embodiment.

  As shown in FIG. 21, the workstation 130 of the image processing system 1 according to the second embodiment determines whether or not volume data to be processed has been designated by the operator of the workstation 130 (step S301). ). Here, when the volume data is not designated (No at Step S301), the workstation 130 waits until the volume data is designated.

  On the other hand, when the volume data is designated (Yes at Step S301), the control unit 135 acquires the designated volume data from the image storage device 120 (Step S302). Then, the control unit 135 determines whether a rendering condition for volume data has been received from the operator of the workstation 130 (step S303). As described with reference to FIGS. 19 and 20, the rendering condition in step S <b> 303 is a condition for generating an image group equal to or greater than the number of parallaxes, and an image that matches a plurality of types of image information stored in the storage unit 134. This is a rendering condition for generating all groups. Furthermore, the rendering condition in step S303 may be a rendering condition that is accepted so as to cover an image group to be generated when a plurality of types of image information are changed.

  When the rendering condition is not accepted (No at Step S303), the control unit 135 waits until the rendering condition is accepted. On the other hand, when the rendering condition is received (Yes at step S303), the rendering processing unit 136 generates an image group such as a parallax image group or an MPR image group from the volume data based on the rendering condition under the control of the control unit 135. (Step S304).

  Then, the communication unit 133 stores the image group by transmitting the image group to the image storage device 120 under the control of the control unit 135 (step S305), and ends the process. The workstation 130 repeatedly executes the processing described with reference to FIG. 21 every time volume data is newly stored in the image storage device 120, for example.

  Thereafter, as illustrated in FIG. 22, the terminal device 140 of the image processing system 1 according to the second embodiment receives selection of image information together with designation of volume data to be processed by the operator of the terminal device 140. It is determined whether or not (step S401). Here, when the designation of volume data and the selection of image information are not accepted (No in step S401), the terminal device 140 waits until the designation of volume data and the selection of image information are accepted.

  On the other hand, when the designation of volume data and the selection of image information are received (Yes at step S401), the control unit 145 transmits an image group associated with the volume data designated from the image storage device 120 via the communication unit 143. Is acquired (step S402). Then, the control unit 145 selects an image group corresponding to the number of parallaxes that matches the image information selected from the acquired image group (step S403).

  Then, the control unit 145 converts the selected image group into an intermediate image (step S404), causes the display unit 142 to display the image group (step S405), and ends the process.

  As described above, in the second embodiment, an image group that matches the image information estimated to be required by the observer is generated in advance, and displayed on a stereoscopically viewable monitor. The image group can be changed easily. In addition, a plurality of volumes generated by photographing the same part of the same subject at different times by sequentially generating a parallax image group and an MPR image group matching the image information for new volume data Even when selection of image information for data is accepted, the group of images displayed on a stereoscopically visible monitor can be easily changed.

  In the above description, the case where an image group is acquired from the image storage device 120 has been described. However, the acquisition destination of the image group may be the workstation 130. In the above description, a case has been described in which the control unit 145 performs the process of selecting an image group that matches the selected image information. However, the process of selecting an image group that matches the selected image information may be executed by the control unit 135 that has received the image information input by the operator of the terminal device 140. In such a case, the control unit 145 converts the received selected image group into an intermediate image and outputs the intermediate image to the display unit 142.

  Further, the present embodiment is applicable even when an operator of a workstation 130 having a nine-parallax monitor as the display unit 132 selects and sets image information of an image group displayed on the display unit 132 or the display unit 142. Is possible.

  In the above embodiment, the case where the monitor that can change the image observed by the observer according to the motion parallax is the 9-parallax monitor has been described. However, the above embodiment can also be applied to a dual display in which images observed by an observer are switched according to motion parallax. FIG. 23 is a diagram for explaining a modification.

  For example, as shown in FIG. 23A, the dual display is a display device configured such that an image observed in the right direction is different from an image observed in the left direction. When such a display device is connected to the terminal device 140, for example, the operator of the terminal device 140 displays a volume rendering image of “+90 degrees” on the right side and a volume rendering image of “−60 degrees” on the left side. Select image information to display. Upon receiving the selection of the image information, the control unit 135 causes the rendering processing unit 136 to generate a “+90 degree” volume rendering image and a “−60 degree” volume rendering image that can also be used as a parallax image. Alternatively, the control unit 145 selects a “+90 degree” volume rendering image and a “−60 degree” volume rendering image stored as a parallax image group. Then, as illustrated in FIG. 21B, the control unit 145 outputs the volume rendering image of “+90 degrees” and the volume rendering image of “−60 degrees” to the dual display.

  Also according to the above modification, the image group displayed on the monitor can be changed according to the request of the observer.

  In the above description, an MPR image is used as a planar image. However, a “Cuved MPR image”, a MIP image, a thick MIP image, or the like may be used as the planar image.

  Note that the image group generation control by the control unit 135 described in the first embodiment may be executed by the control unit 145 of the terminal device 140 that is the reception source of the image information selection. In such a case, a control instruction from the control unit 145 is sent to the rendering processing unit 136. Further, the image group generation processing according to the image information selection of the observer may be executed by the medical image diagnostic apparatus 110 having the function of the rendering processing unit 136. In such a case, the reception source of the image information selection may be any of the medical image diagnostic apparatus 110, the workstation 130, and the terminal device 140. In addition, the generation control of the image group that matches the image information selected by the observer may be performed by the apparatus that receives the image information selection, or may be performed by the apparatus that performs the image group generation process. It is also possible to use a device other than these devices.

  Moreover, even when the image group generation control performed in advance by the control unit 135 described in the second embodiment is executed by the control unit 145 of the terminal device 140 that is the reception source of the image information selection. good. In such a case, a control instruction from the control unit 145 is sent to the rendering processing unit 136. The image group generation processing performed in advance may be executed by the medical image diagnostic apparatus 110 having the function of the rendering processing unit 136. In such a case, the reception source of the image information selection may be any of the medical image diagnostic apparatus 110, the workstation 130, and the terminal device 140. Further, the selection control of the image group that matches the request of the observer may be performed by a device that receives an image information selection, or may be performed by a device that performs an image group generation process. Alternatively, it may be performed by a device other than these devices.

  That is, the processing of the rendering processing unit 136, the control unit 135, the control unit 145, and the like described in the above embodiment is performed in an arbitrary unit according to various loads and usage conditions of each device included in the image processing system 1. Can be configured functionally or physically distributed and integrated. For example, the processing of the rendering processing unit 136, the control unit 135, the control unit 145, and the like described in the above embodiment may be performed by the medical image diagnostic apparatus 110 alone. Further, all or any part of each processing function performed in each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware by wired logic.

  The image processing method described in the above embodiment can be realized by executing an image processing program prepared in advance on a computer such as a personal computer or a workstation. This image processing program can be distributed via a network such as the Internet. The program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, a DVD, or a Blu-ray Disc (registered trademark), and is read from the recording medium by the computer. Can also be implemented.

  As described above, according to the first embodiment, the second embodiment, and the modification, it is possible to change the image group displayed on the stereoscopically visible monitor.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

1 Image processing system 2 Hospital LAN (Local Area Network)
DESCRIPTION OF SYMBOLS 110 Medical diagnostic imaging apparatus 120 Image storage apparatus 130 Workstation 131 Input part 132 Display part 133 Communication part 134 Storage part 135 Control part 136 Rendering process part 140 Terminal apparatus 141 Input part 142 Display part 143 Communication part 144 Storage part 145 Control part

Claims (16)

A three-dimensional medical image as the predetermined number of images based on the correspondence between the observer's viewpoint position with respect to the stereoscopic display device that simultaneously displays the predetermined number of images and the image viewed by the observer at the viewpoint position. A storage unit for storing a plurality of types of image information for assigning images based on volume data that is data;
A control unit that controls a predetermined number of images that match image information selected from the plurality of types of image information to be displayed on the stereoscopic display device;
An image processing system comprising: An input unit for receiving a change in the image information;
Further comprising
The image processing system according to claim 1, wherein the control unit performs control so that a predetermined number of images that match the changed image information received by the input unit are displayed on the stereoscopic display device. .   The image information is information in which a parallax image group generated by volume rendering processing from the volume data is assigned as the predetermined number of images, and is parallax angle information that is information specifying a parallax angle between parallax images. The image processing system according to claim 1, wherein the image processing system is an image processing system.   The parallax angle information is information specifying a parallax angle for generating a parallax image group in which volume data is observed at an angle close to a relative movement angle of an observer with respect to the stereoscopic display device. The image processing system according to claim 3.   The parallax angle information is information specifying a parallax angle for generating a parallax image group in which volume data is observed at an angle larger than an angle close to a relative movement angle of an observer with respect to the stereoscopic display device. The image processing system according to claim 3.   The image processing system according to claim 1, wherein the image information is type information specifying a type of each image constituting a predetermined number of images based on the volume data.   The type information is information in which a parallax image displayed for stereoscopic vision on the stereoscopic display device and a plane image obtained by cutting the volume data with a reference plane used for generating the parallax image are allocated to the predetermined number of images. The image processing system according to claim 6, wherein:   The image processing system according to claim 6, wherein the type information is information in which a group of plane images obtained by cutting the volume data along different planes is assigned to the predetermined number of images.   The image processing system according to claim 6, wherein the type information is information in which a slice image group used to reconstruct the volume data is assigned to the predetermined number of images.   The image processing system according to claim 1, wherein the image information is opacity information that specifies an opacity when two volume data are superimposed.   The control unit controls a rendering processing unit that performs a rendering process on the volume data so as to generate an image group that matches the image information, and the image group generated by the rendering processing unit The image processing system according to claim 1, wherein the image processing system is controlled so as to be displayed on a stereoscopic display device.   The control unit selects an image group that matches the image information from an image group generated by a rendering processing unit that performs a rendering process on the volume data, and the selected image group is displayed on the stereoscopic display device. The image processing system according to claim 1, wherein the image processing system is controlled so as to be performed. A three-dimensional medical image as the predetermined number of images based on the correspondence between the observer's viewpoint position with respect to the stereoscopic display device that simultaneously displays the predetermined number of images and the image viewed by the observer at the viewpoint position. A storage unit for storing a plurality of types of image information for assigning images based on volume data that is data;
A control unit that controls a predetermined number of images that match image information selected from the plurality of types of image information to be displayed on the stereoscopic display device;
An image processing apparatus comprising: A three-dimensional medical image as the predetermined number of images based on the correspondence between the observer's viewpoint position with respect to the stereoscopic display device that simultaneously displays the predetermined number of images and the image viewed by the observer at the viewpoint position. A storage unit for storing a plurality of types of image information for assigning images based on volume data that is data;
A control unit that controls a predetermined number of images that match image information selected from the plurality of types of image information to be displayed on the stereoscopic display device;
A medical image diagnostic apparatus comprising: A three-dimensional medical image as the predetermined number of images based on the correspondence between the observer's viewpoint position with respect to the stereoscopic display device that simultaneously displays the predetermined number of images and the image viewed by the observer at the viewpoint position. A control step for controlling a predetermined number of images that match image information selected from a plurality of types of image information for allocating images based on volume data as data to be displayed on the stereoscopic display device;
An image processing method comprising: A three-dimensional medical image as the predetermined number of images based on the correspondence between the observer's viewpoint position with respect to the stereoscopic display device that simultaneously displays the predetermined number of images and the image viewed by the observer at the viewpoint position. A control procedure for controlling so that a predetermined number of images matching image information selected from a plurality of types of image information for allocating images based on volume data that is data are displayed on the stereoscopic display device;
An image processing program for causing a computer to execute.

Images