JP5974235B2 - Image processing apparatus, image processing method, image processing system, and medical image diagnostic apparatus - Google Patents

Description

  Embodiments described herein relate generally to an image processing apparatus, an image processing method, an image processing system, and a medical image diagnostic apparatus.

  Conventionally, there is a technique for displaying a stereoscopic image to a user using a dedicated device such as stereoscopic glasses by displaying two parallax images taken from two viewpoints on a monitor. In recent years, a multi-parallax image (for example, nine parallax images) captured from a plurality of viewpoints is displayed on a monitor by using a light controller such as a lenticular lens, thereby displaying a stereoscopic image to a naked-eye user. There is technology to do.

  Further, medical image diagnostic apparatuses such as an X-ray CT (Computed Tomography) apparatus, an MRI (Magnetic Resonance Imaging) apparatus, and an ultrasonic diagnostic apparatus include apparatuses capable of generating a three-dimensional medical image (hereinafter referred to as volume data). . In addition, the medical image diagnostic apparatus generates a planar image for display by executing various image processing on the volume data, and displays it on a general-purpose monitor. For example, the medical image diagnostic apparatus performs a volume rendering process on the volume data, thereby generating a planar image for an arbitrary cross section in which three-dimensional information about the subject is reflected. Display on a general-purpose monitor.

JP 2005-84414 A

  The problem to be solved by the present invention is to provide an image processing apparatus, an image processing method, an image processing system, and a medical image diagnostic apparatus capable of easily displaying an appropriate stereoscopic image.

The image processing apparatus of the embodiment, the specific information for specifying a region of a subject, a receiving unit that receives the application of the inspection object or the subject of the image, and the specific information, the inspection purpose or of the subject A rendering condition used when generating a stereoscopic image of a part specified by the specific information and the use of the image, and including rendering information indicating the stereoscopic effect of the stereoscopic image displayed stereoscopically From the specific information storage device that stores the conditions and the display conditions for displaying the stereoscopic image generated based on the rendering conditions in association with each other, the specific information received by the receiving unit, and the inspection purpose or the Gets the rendering condition stored in association with the use of the subject image based on the obtained the rendering conditions, solid contained in the rendering conditions A parallax image generator for generating stereoscopic images in the intensity of the stereoscopic effect indicated by the information, the the specific information accepted by the accepting unit, the display which is stored in association with the use of the inspection object or the subject of the image get the condition from the specific information storage device, a three-dimensional image generated by the parallax image generator, characterized by comprising a display control unit for displaying on the display unit based on the acquired said display condition.

FIG. 1 is a diagram for explaining a configuration example of an image processing system in the first embodiment. FIG. 2 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using two parallax images. FIG. 3 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display with nine parallax images. FIG. 4 is a diagram for explaining a configuration example of the workstation in the first embodiment. FIG. 5 is a diagram for explaining a configuration example of the rendering processing unit shown in FIG. FIG. 6 is a diagram for explaining an example of the volume rendering process in the first embodiment. FIG. 7 is an example of a diagram illustrating details of the control unit according to the first embodiment. FIG. 8 is a diagram illustrating an example of information stored in the specific information table according to the first embodiment. FIG. 9A is a diagram for illustrating an example of specific information indicating from which position the stereoscopic image is viewed from the subject indicated by the volume data. FIG. 9-2 is a diagram for illustrating an example of specific information indicating from which position the stereoscopic image is viewed from the subject indicated by the volume data. FIG. 10 is a diagram for explaining stereoscopic image coordinates and volume data coordinates in the first embodiment. FIG. 11 is a diagram for describing stereoscopic image coordinates and volume data coordinates in the first embodiment. FIG. 12 is a diagram illustrating a change in stereoscopic effect according to a change in the parallax angle formed by the viewpoint of each parallax image. FIG. 13 is a flowchart illustrating an example of a flow of processing by the control unit in the first embodiment. FIG. 14 is an example of a diagram illustrating details of the control unit in the second embodiment. FIG. 15 is a diagram illustrating an example of a screen for receiving specific information and rendering conditions. FIG. 16 is a diagram illustrating an example of a screen for receiving specific information. FIG. 17 is a diagram illustrating an example of specific information stored by the storage unit according to the second embodiment. FIG. 18 is a diagram illustrating an example of specific information stored by the storage unit according to the second embodiment. FIG. 19 is a diagram for illustrating the parallax image output processing according to the first embodiment. FIG. 20 is a diagram illustrating an example of a screen that accepts selection of specific information. FIG. 21 is a diagram illustrating an example of a configuration of a control unit capable of reproducing specific information editing work.

  Hereinafter, embodiments of an image processing apparatus, an image processing method, an image processing system, and a medical image diagnostic apparatus will be described in detail with reference to the accompanying drawings. In the following, an image processing system including a workstation having a function as an image processing apparatus will be described as an embodiment.

(First embodiment)
First, a configuration example of an image processing system having an image processing apparatus according to the first embodiment will be described. FIG. 1 is a diagram for explaining a configuration example of an image processing system in the first embodiment.

  As shown in FIG. 1, the image processing system 1 according to the first embodiment includes a medical image diagnostic apparatus 110, an image storage apparatus 120, a workstation 130, and a terminal apparatus 140. Each apparatus illustrated in FIG. 1 is in a state where it can communicate with each other directly or indirectly by, for example, an in-hospital LAN (Local Area Network) 2 installed in a hospital. For example, when a PACS (Picture Archiving and Communication System) is introduced into the image processing system 1, each apparatus transmits and receives medical images and the like according to DICOM (Digital Imaging and Communications in Medicine) standards.

  The image processing system 1 generates a parallax image for displaying a stereoscopic image based on the volume data generated by the medical image diagnostic apparatus 110, and displays the generated parallax image on a monitor capable of displaying the stereoscopic image. Therefore, it provides stereoscopic images to doctors and laboratory technicians working in hospitals.

  Here, the “stereoscopic image” is displayed to the user by displaying a plurality of parallax images taken from a plurality of viewpoints and having different parallax angles. In other words, the “parallax image” is an image that is taken from a plurality of viewpoints and has different parallax angles and is used to display a stereoscopic image to the user. Moreover, the parallax image for displaying a stereo image is produced | generated by performing a volume rendering process with respect to volume data, for example. The “parallax number” indicates the number of “parallax images” necessary for stereoscopic viewing on the stereoscopic display monitor. The “parallax angle” is an angle determined by the interval between the positions of the viewpoints of the parallax images and the position of the volume data.

  As will be described in detail below, in the first embodiment, the workstation 130 performs various image processes on the volume data to generate a parallax image for displaying a stereoscopic image. The workstation 130 and the terminal device 140 have a monitor capable of displaying a stereoscopic image, and display the stereoscopic image to the user by displaying the parallax image generated by the workstation 130 on the monitor. The image storage device 120 stores volume data generated by the medical image diagnostic device 110 and parallax images generated by the workstation 130. For example, the workstation 130 or the terminal device 140 acquires volume data or a parallax image from the image storage device 120, performs arbitrary image processing on the acquired volume data or parallax image, or displays the parallax image on a monitor. To do.

  The medical image diagnostic apparatus 110 includes an X-ray diagnostic apparatus, an X-ray CT (Computed Tomography) apparatus, an MRI (Magnetic Resonance Imaging) apparatus, an ultrasonic diagnostic apparatus, a SPECT (Single Photon Emission Computed Tomography) apparatus, and a PET (Positron Emission Tomography). An SPECT-CT apparatus in which a SPECT apparatus and an X-ray CT apparatus are integrated, a PET-CT apparatus in which a PET apparatus and an X-ray CT apparatus are integrated, or a group of these apparatuses. Further, the medical image diagnostic apparatus 110 generates volume data.

  Specifically, the medical image diagnostic apparatus 110 according to the first embodiment generates volume data by imaging a subject. For example, the medical image diagnostic apparatus 110 collects data such as projection data and MR signals by imaging a subject. Then, the medical image diagnostic apparatus 110 generates volume data by reconstructing medical images of a plurality of axial surfaces along the body axis direction of the subject based on the collected data. For example, the case where the medical image diagnostic apparatus 110 reconstructs 500 axial medical images will be described. In this case, the medical image group of 500 axial planes reconstructed by the medical image diagnostic apparatus 110 is volume data. In addition, the projection data of the subject imaged by the medical image diagnostic apparatus 110, the MR signal, or the like may be used as the volume data.

  In addition, the medical image diagnostic apparatus 110 transmits volume data to the image storage apparatus 120. The medical image diagnostic apparatus 110 identifies, for example, a patient ID for identifying a patient, an examination ID for identifying an examination, and the medical image diagnostic apparatus 110 as supplementary information when transmitting volume data to the image storage apparatus 120. A device ID, a series ID for identifying one shot by the medical image diagnostic device 110, and the like are transmitted.

  The image storage device 120 is a database that stores medical images. Specifically, the image storage device 120 receives volume data from the medical image diagnostic device 110 and stores the received volume data in a predetermined storage unit. Further, the image storage device 120 receives a parallax image generated from volume data by the workstation 130 and stores the received parallax image in a predetermined storage unit.

  In the first embodiment, volume data and parallax images stored in the image storage device 120 are stored in association with patient IDs, examination IDs, device IDs, series IDs, and the like. Therefore, the workstation 130 and the terminal device 140 acquire necessary volume data and parallax images from the image storage device 120 by performing a search using a patient ID, an examination ID, a device ID, a series ID, and the like. The image storage device 120 and the workstation 130 may be integrated into one device.

  The workstation 130 is an image processing apparatus that performs image processing on medical images. Specifically, the workstation 130 acquires volume data from the image storage device 120. Then, the workstation 130 performs various rendering processes on the acquired volume data to generate a parallax image for displaying a stereoscopic image. For example, the workstation 130 generates two parallax images with different parallax angles when displaying a two-parallax stereoscopic image to the user. Also, for example, when displaying a 9-parallax stereoscopic image to the user, the workstation 130 generates nine parallax images with different parallax angles.

  The workstation 130 has a monitor (also referred to as a stereoscopic display monitor or a stereoscopic image display device) capable of displaying a stereoscopic image as a display unit. The workstation 130 generates a parallax image and displays the generated parallax image on the stereoscopic display monitor, thereby displaying the stereoscopic image to the user. As a result, the user of the workstation 130 can perform an operation for generating a parallax image while confirming the stereoscopic image displayed on the stereoscopic display monitor.

  Further, the workstation 130 transmits the generated parallax image to the image storage device 120 or the terminal device 140. In addition, when transmitting a parallax image to the image storage device 120 or the terminal device 140, the workstation 130 transmits, for example, a patient ID, an examination ID, a device ID, a series ID, and the like as supplementary information. At this time, the workstation 130 may also transmit incidental information indicating the number of parallax images and the resolution in consideration of the various resolutions of the monitor. The resolution corresponds to “466 pixels × 350 pixels”, for example.

  Here, the workstation 130 according to the first embodiment includes specific information for specifying a part of the subject, a rendering condition used when generating a stereoscopic image of the part specified by the specific information, and a rendering condition The rendering condition stored in association with the received specific information is acquired from the specific information table that stores the display condition for displaying the stereoscopic image generated based on A stereoscopic image is generated based on the result. In addition, the workstation 130 acquires display conditions stored in association with the received specific information from the specific information table, and displays a stereoscopic image generated based on the acquired display conditions. As a result, an appropriate stereoscopic image can be easily displayed.

  Returning to the description of FIG. The terminal device 140 is a terminal that allows a doctor or laboratory technician working in a hospital to view a medical image. Specifically, the terminal device 140 includes a stereoscopic display monitor as a display unit. In addition, the terminal device 140 acquires a parallax image from the image storage device 120 and displays the acquired parallax image on the stereoscopic display monitor, thereby displaying the stereoscopic image to the user. Further, for example, when receiving the parallax image from the workstation 130, the terminal device 140 displays the received parallax image on the stereoscopic display monitor, thereby displaying the stereoscopic image to the user. As a result, doctors and laboratory technicians who are users can view stereoscopic medical images. The terminal device 140 corresponds to, for example, a general-purpose PC (Personal Computer) having a stereoscopic display monitor, a tablet terminal, or a mobile phone. The terminal device 140 corresponds to, for example, an arbitrary information processing terminal connected to a stereoscopic display monitor as an external device.

  Here, the stereoscopic display monitor included in the workstation 130 and the terminal device 140 will be described. As a stereoscopic display monitor, for example, there is a display monitor that displays two parallax images (binocular parallax images) to a user wearing dedicated equipment such as stereoscopic glasses by displaying two parallax images.

  FIG. 2 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using two parallax images. The example shown in FIG. 2 shows an example of a stereoscopic display monitor that performs stereoscopic display using the shutter method. In the example illustrated in FIG. 2, a user who observes a monitor wears shutter glasses as stereoscopic glasses. In the example illustrated in FIG. 2, the stereoscopic display monitor emits two parallax images alternately. For example, the stereoscopic display monitor shown in FIG. 2A alternately emits a parallax image for the left eye and a parallax image for the right eye at 120 Hz. As shown in FIG. 2A, the stereoscopic display monitor is provided with an infrared emitting unit, and the infrared emitting unit controls the emission of infrared rays in accordance with the timing at which the parallax images are switched.

  Moreover, as shown to (A) of FIG. 2, the infrared rays light-receiving part of shutter glasses receives the infrared rays radiate | emitted by the infrared rays emission part. A shutter is attached to each of the left and right frames of the shutter glasses, and the shutter glasses alternately switch the transmission state and the light shielding state of the left and right shutters according to the timing when the infrared light receiving unit receives the infrared rays.

  Here, the switching process between the transmission state and the light shielding state in the shutter of the shutter glasses will be described. As shown in FIG. 2B, the shutter has an incident-side polarizing plate and an output-side polarizing plate, and further has a liquid crystal layer between the incident-side polarizing plate and the output-side polarizing plate. Have. Further, as shown in FIG. 2B, the incident-side polarizing plate and the outgoing-side polarizing plate are orthogonal to each other. Here, as shown in FIG. 2B, in the “OFF” state where no voltage is applied, the light that has passed through the polarizing plate on the incident side is rotated by 90 ° by the action of the liquid crystal layer, and is emitted on the outgoing side. Is transmitted through the polarizing plate. That is, a shutter to which no voltage is applied is in a transmissive state.

  On the other hand, as shown in FIG. 2B, in the “ON” state where a voltage is applied, the polarization rotation action caused by the liquid crystal molecules in the liquid crystal layer disappears. It will be blocked by the polarizing plate on the exit side. That is, the shutter to which the voltage is applied is in a light shielding state.

  Based on this, the infrared emitting unit of the stereoscopic display monitor emits infrared rays, for example, during a period when the image for the left eye is displayed on the monitor. Then, the infrared light receiving unit of the shutter glasses applies a voltage to the right eye shutter without applying a voltage to the left eye shutter during a period of receiving the infrared light. As a result, as shown in FIG. 2A, the right-eye shutter enters a light-shielding state and the left-eye shutter enters a transmission state. As a result, the left-eye image is incident only on the user's left eye. On the other hand, the infrared emitting unit of the stereoscopic display monitor stops emitting infrared rays, for example, while the right-eye image is displayed on the monitor. The infrared light receiving unit of the shutter glasses applies a voltage to the left-eye shutter without applying a voltage to the right-eye shutter during a period in which no infrared light is received. As a result, the left-eye shutter enters a light shielding state and the right-eye shutter enters a transmission state. As a result, a right-eye image is incident only on the user's right eye. As described above, the stereoscopic display monitor shown in FIG. 2 displays a stereoscopic image to the user by switching the image displayed on the monitor and the state of the shutter in conjunction with each other.

  In addition, as a stereoscopic display monitor, there is a display monitor that uses a light beam controller such as a lenticular lens to display a 9-parallax stereoscopic image to a naked-eye user, for example. In this case, the stereoscopic display monitor enables stereoscopic viewing using binocular parallax, and can further display a stereoscopic image having motion parallax in which an image observed by the user changes in accordance with the viewpoint movement of the user.

  FIG. 3 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display with nine parallax images. The stereoscopic display monitor shown in FIG. 3 has a light beam controller disposed on the front surface of a flat display surface 200 such as a liquid crystal panel. For example, in the stereoscopic display monitor shown in FIG. 3, a vertical lenticular sheet 201 whose optical aperture extends in the vertical direction is attached to the front surface of the display surface 200 as a light beam controller. In the example shown in FIG. 3, the vertical lenticular sheet 201 is pasted so that the convex portion of the vertical lenticular sheet 201 becomes the front surface, but the convex portion of the vertical lenticular sheet 201 is pasted so as to face the display surface 200. There may be.

  In the example shown in FIG. 3, the display surface 200 has an aspect ratio of 3: 1, and pixels 202 in which three sub-pixels of red (R), green (G), and blue (B) are arranged in the vertical direction. Are arranged in a matrix. In the example illustrated in FIG. 3, the stereoscopic display monitor arranges nine parallax images having different parallax angles in a predetermined format (for example, a lattice shape), and then outputs them on the display surface 200. That is, the stereoscopic display monitor illustrated in FIG. 3 displays an intermediate image in which nine pixels at the same position in nine parallax images having different parallax angles are allocated to the nine columns of pixels 202, respectively. The nine columns of pixels 202 constitute a unit pixel group 203 that simultaneously displays nine images with different parallax angles. In the example illustrated in FIG. 3, the intermediate image has a lattice shape. However, the present invention is not limited to this, and may have an arbitrary shape.

  Nine parallax images with different parallax angles simultaneously output as the unit pixel group 203 on the display surface 200 are emitted as parallel light by, for example, an LED (Light Emitting Diode) backlight, and further, multi-directional by the vertical lenticular sheet 201. To be emitted. As the light of each pixel of the nine parallax images is emitted in multiple directions, the light incident on the right eye and the left eye of the user changes in conjunction with the position of the user (viewpoint position). That is, the parallax image incident on the right eye and the parallax image incident on the left eye are parallax images having different parallax angles depending on the viewing angle of the user. As a result, for example, the user can visually recognize a three-dimensional image in which the object to be photographed is viewed from different viewing angles at each of the nine positions shown in FIG. In addition, for example, the user can view stereoscopically in a state of facing the object to be photographed at the position “5” shown in FIG. 3, and photograph at each position other than “5” shown in FIG. 3. It can be visually recognized in a three-dimensional manner with the direction of the object changed. The example shown in FIG. 3 is an example, and the present invention is not limited to this. For example, in the example shown in FIG. 3, the case where a combination of a horizontal stripe (RRR..., GGG..., BBB...) Liquid crystal and a vertical lens is used as an example, but the present invention is not limited to this. A combination of vertical stripe (RGBRGB...) Liquid crystal and an oblique lens may be used.

  Up to this point, the configuration example of the image processing system 1 in the first embodiment has been briefly described. Note that the application of the image processing system 1 described above is not limited when PACS is introduced. For example, the image processing system 1 may be similarly applied even when an electronic medical record system that manages an electronic medical record to which a medical image is attached is introduced. In this case, the image storage device 120 is a database that stores electronic medical records. In addition, for example, the image processing system 1 may be similarly applied when a HIS (Hospital Information System) and a RIS (Radiology Information System) are introduced. The image processing system 1 is not limited to the configuration example described above. The functions of each device and their sharing may be changed as appropriate according to the form of operation.

  Next, a configuration example of the workstation 130 in the first embodiment will be described with reference to FIG. FIG. 4 is a diagram for explaining a configuration example of the workstation in the first embodiment.

  The workstation 130 is a high-performance computer suitable for image processing and the like. In the example illustrated in FIG. 4, the workstation 130 includes an input unit 131, a display unit 132, a communication unit 133, a storage unit 134, a control unit 135, and a rendering processing unit 136. In the following, a case where the workstation 130 is a high-performance computer suitable for image processing or the like will be described. However, the present invention is not limited to this, and may be any information processing apparatus. For example, any personal computer may be used.

  The input unit 131 is a mouse, a keyboard, a trackball, or the like, and receives input of various operations on the workstation 130 from the user. Specifically, the input unit 131 receives input of information for acquiring volume data to be subjected to rendering processing from the image storage device 120. For example, the input unit 131 receives input of a patient ID, an examination ID, a device ID, a series ID, and the like. The input unit 131 accepts input of conditions related to rendering processing (hereinafter, rendering conditions).

  The display unit 132 is a liquid crystal panel or the like as a stereoscopic display monitor, and displays various information. Specifically, the display unit 132 in the first embodiment displays a GUI (Graphical User Interface) for accepting various operations from the user, a stereoscopic image, and the like. The communication unit 133 is a NIC (Network Interface Card) or the like, and performs communication with other devices. Further, for example, the communication unit 133 receives the rendering condition input to the terminal device 140 by the user from the terminal device 140.

  The storage unit 134 is a hard disk, a semiconductor memory element, or the like, and stores various types of information. Specifically, the storage unit 134 stores volume data acquired from the image storage device 120 via the communication unit 133. In addition, the storage unit 134 stores volume data during rendering processing, parallax images on which rendering processing has been performed, and accompanying information (number of parallaxes, resolution, etc.) and the like. Details of the storage unit 134 will be described later.

  The control unit 135 is an electronic circuit such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or GPU (Graphics Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). Yes, the entire control of the workstation 130 is performed.

  For example, the control unit 135 controls the display of a GUI and the display of a stereoscopic image on the display unit 132. For example, the control unit 135 controls transmission / reception of volume data and parallax images performed with the image storage device 120 via the communication unit 133. For example, the control unit 135 controls the rendering process performed by the rendering processing unit 136. For example, the control unit 135 controls reading of volume data from the storage unit 134 and storage of parallax images in the storage unit 134.

  Here, the control unit 135 of the workstation 130 controls the rendering processing by the rendering processing unit 136 and performs measurement processing by cooperating with the rendering processing unit 136. Details of the control unit 135 will be described after the rendering processing unit 136 is described.

  The rendering processing unit 136 performs various rendering processes on the volume data acquired from the image storage device 120 under the control of the control unit 135 to generate a parallax image. Specifically, the rendering processing unit 136 reads volume data from the storage unit 134 and performs preprocessing on the read volume data. The rendering processing unit 136 generates a parallax image for displaying a stereoscopic image by performing volume rendering processing on the pre-processed volume data. Then, the rendering processing unit 136 stores the generated parallax image in the storage unit 134.

  In addition, the rendering processing unit 136 may generate an overlay image in which various pieces of information (scale, patient name, examination item, etc.) are drawn, and superimpose the generated overlay image on the parallax image. In this case, the rendering processing unit 136 stores the parallax image with the overlay image overlapped in the storage unit 134.

  The rendering process indicates the entire image process performed on the volume data, and the volume rendering process indicates a process of generating a medical image in which the three-dimensional information of the subject is reflected in the rendering process. For example, a parallax image corresponds to the medical image generated by the rendering process.

  FIG. 5 is a diagram for explaining a configuration example of the rendering processing unit shown in FIG. As illustrated in FIG. 5, the rendering processing unit 136 includes a preprocessing unit 1361, a 3D image processing unit 1362, and a 2D image processing unit 1363. As will be described in detail below, the preprocessing unit 1361 performs preprocessing on the volume data. The three-dimensional image processing unit 1362 generates a parallax image from the preprocessed volume data. The two-dimensional image processing unit 1363 generates a parallax image in which various types of information are superimposed on a stereoscopic image.

  The pre-processing unit 1361 performs various pre-processing when performing rendering processing on the volume data. In the example illustrated in FIG. 5, the preprocessing unit 1361 includes an image correction processing unit 1361a, a three-dimensional object fusion unit 1361e, and a three-dimensional object display region setting unit 1361f.

  The image correction processing unit 1361a performs image correction processing when processing two types of volume data as one volume data. In the example illustrated in FIG. 5, the image correction processing unit 1361a includes a distortion correction processing unit 1361b, a body motion correction processing unit 1361c, and an inter-image registration processing unit 1361d. For example, the image correction processing unit 1361a performs image correction processing when processing volume data of a PET image generated by a PET-CT apparatus and volume data of an X-ray CT image as one volume data. The image correction processing unit 1361a performs image correction processing when processing the volume data of the T1-weighted image and the volume data of the T2-weighted image generated by the MRI apparatus as one volume data.

  Here, the distortion correction processing unit 1361b of the image correction processing unit 1361a corrects the data distortion caused by the collection condition when the medical image diagnostic apparatus 110 collects data in each volume data. Further, the body motion correction processing unit 1361c corrects the movement caused by the body motion of the subject at the time of collecting the data used for generating the individual volume data. Further, the inter-image registration processing unit 1361d performs registration (Registration) using, for example, a cross-correlation method between the two volume data subjected to the correction processing by the distortion correction processing unit 1361b and the body motion correction processing unit 1361c. )I do.

  The three-dimensional object fusion unit 1361e fuses a plurality of volume data that has been aligned by the inter-image registration processing unit 1361d. Note that the processing of the image correction processing unit 1361a and the three-dimensional object fusion unit 1361e is omitted when rendering processing is performed on single volume data.

  The three-dimensional object display area setting unit 1361f sets a display area corresponding to the display target organ designated by the user. In the example illustrated in FIG. 5, the three-dimensional object display region setting unit 1361 f includes a segmentation processing unit 1361 g. The segmentation processing unit 1361g of the three-dimensional object display region setting unit 1361f extracts organs such as the heart, lungs, and blood vessels designated by the user, for example, by region expansion based on pixel values (voxel values) of volume data. .

  Note that the segmentation processing unit 1361 g does not perform the segmentation processing when the display target organ is not designated by the user. The segmentation processing unit 1361g extracts a plurality of corresponding organs when a plurality of display target organs are designated by the user. Further, the processing of the segmentation processing unit 1361g may be executed again in response to a user fine adjustment request referring to the rendered image.

  The three-dimensional image processing unit 1362 performs a volume rendering process on the pre-processed volume data processed by the pre-processing unit 1361. In the example illustrated in FIG. 5, the three-dimensional image processing unit 1362 includes a projection method setting unit 1362a, a three-dimensional geometric transformation processing unit 1362b, a three-dimensional object appearance processing unit 1362f, and three processing units that perform volume rendering processing. A dimensional virtual space rendering unit 1362k.

  The projection method setting unit 1362a determines a projection method for generating a stereoscopic image. For example, the projection method setting unit 1362a determines whether to execute the volume rendering process by the parallel projection method or the perspective projection method.

  The three-dimensional geometric conversion processing unit 1362b determines information for converting the volume data on which the volume rendering process is executed into a three-dimensional geometric. In the example illustrated in FIG. 5, the three-dimensional geometric transformation processing unit 1362b includes a parallel movement processing unit 1362c, a rotation processing unit 1362d, and an enlargement / reduction processing unit 1362e. The translation processing unit 1362c of the three-dimensional geometric transformation processing unit 1362b determines the amount of movement for translating the volume data when the viewpoint position when performing the volume rendering process is translated. In addition, the rotation processing unit 1362d determines a moving amount for rotating the volume data when the viewpoint position when performing the volume rendering process is rotated. The enlargement / reduction processing unit 1362e determines the enlargement rate or reduction rate of the volume data when enlargement or reduction of the stereoscopic image is requested.

  The three-dimensional object appearance processing unit 1362f includes a three-dimensional object color processing unit 1362g, a three-dimensional object opacity processing unit 1362h, a three-dimensional object material processing unit 1362i, and a three-dimensional virtual space light source processing unit 1362j. The three-dimensional object appearance processing unit 1362f determines the display state of the stereoscopic image displayed to the user by displaying the parallax image in response to the user's request, for example.

  The three-dimensional object color processing unit 1362g determines a color to be colored for each region segmented by the volume data. The three-dimensional object opacity processing unit 1362h is a processing unit that determines the opacity (Opacity) of each voxel constituting each region segmented by volume data. Note that the area behind the area where the opacity is “100%” in the volume data is not drawn in the parallax image. In addition, an area where the opacity is “0%” in the volume data is not drawn in the parallax image.

  The three-dimensional object material processing unit 1362i determines the material of each region segmented by the volume data, thereby adjusting the texture when this region is rendered. The three-dimensional virtual space light source processing unit 1362j determines the position of the virtual light source installed in the three-dimensional virtual space and the type of the virtual light source when performing volume rendering processing on the volume data. Examples of the virtual light source include a light source that emits parallel rays from infinity, a light source that emits radial rays from a viewpoint, and the like.

  The three-dimensional virtual space rendering unit 1362k performs volume rendering processing on the volume data to generate a parallax image. The three-dimensional virtual space rendering unit 1362k performs various types of information determined by the projection method setting unit 1362a, the three-dimensional geometric transformation processing unit 1362b, and the three-dimensional object appearance processing unit 1362f as necessary when performing the volume rendering process. Is used.

  Here, the three-dimensional virtual space rendering unit 1362k receives a rendering condition from the control unit 135, and performs volume rendering processing on the volume data according to the received rendering condition. The rendering condition is received from the user via the input unit 131, initialized, or received from the terminal device 140 via the communication unit 133. At this time, the projection method setting unit 1362a, the three-dimensional geometric transformation processing unit 1362b, and the three-dimensional object appearance processing unit 1362f determine various pieces of necessary information according to the rendering conditions, and the three-dimensional virtual space rendering unit 1362k Then, a stereoscopic image is generated using the determined various information.

  For example, the rendering condition is “parallel projection method” or “perspective projection method”. For example, the rendering condition is “reference viewpoint position and parallax angle”. Further, for example, the rendering conditions are “translation of viewpoint position”, “rotation movement of viewpoint position”, “enlargement of stereoscopic image”, and “reduction of stereoscopic image”. Further, for example, the rendering conditions are “color to be colored”, “transparency”, “texture”, “position of virtual light source”, and “type of virtual light source”.

  FIG. 6 is a diagram for explaining an example of the volume rendering process in the first embodiment. For example, as shown in “9 parallax image generation method (1)” in FIG. 6, the three-dimensional virtual space rendering unit 1362k accepts the parallel projection method as a rendering condition, and further, the reference viewpoint position (5) and the parallax. Assume that the angle “1 degree” is received. In this case, the three-dimensional virtual space rendering unit 1362k translates the position of the viewpoint from (1) to (9) so that the parallax angle is every “1 degree”, and performs the parallax angle (line of sight) by the parallel projection method. Nine parallax images with different degrees between directions are generated. When performing the parallel projection method, the three-dimensional virtual space rendering unit 1362k sets a light source that emits parallel rays from infinity along the line-of-sight direction.

  Alternatively, as shown in “9-parallax image generation method (2)” in FIG. 6, the three-dimensional virtual space rendering unit 1362k accepts a perspective projection method as a rendering condition, and further, a reference viewpoint position (5) and parallax. Assume that the angle “1 degree” is received. In this case, the three-dimensional virtual space rendering unit 1362k sets the position of the viewpoint to (1) so that the parallax angle is every “one degree” around the center of gravity of the cut surface of the volume data existing on the plane on which the viewpoint is moved. Rotate and move to (9) to generate nine parallax images with different parallax angles by 1 degree by the perspective projection method. In other words, nine parallax images are generated by rotating around the center of gravity of the two-dimensional cut surface instead of the center of gravity of the three-dimensional volume. When performing the perspective projection method, the three-dimensional virtual space rendering unit 1362k sets a point light source or a surface light source that radiates light three-dimensionally radially around the viewing direction at each viewpoint. When performing perspective projection, the viewpoints (1) to (9) may be translated depending on the rendering conditions.

  Note that the three-dimensional virtual space rendering unit 1362k radiates light two-dimensionally radially around the line-of-sight direction with respect to the vertical direction of the displayed volume rendered image, and the horizontal direction of the displayed volume rendered image. On the other hand, volume rendering processing using both the parallel projection method and the perspective projection method may be performed by setting a light source that emits parallel light rays from infinity along the line-of-sight direction.

  In the example of FIG. 6, the case where the projection method, the reference viewpoint position, and the parallax angle are received as the rendering conditions has been described. However, the three-dimensional virtual space is similarly applied when other conditions are received as the rendering conditions. The rendering unit 1362k generates nine parallax images while reflecting the respective rendering conditions.

  Note that the three-dimensional virtual space rendering unit 1362k has a function of reconstructing an MPR image from volume data by performing not only volume rendering but also a cross-section reconstruction method (MPR: Multi Planer Reconstruction). The three-dimensional virtual space rendering unit 1362k also has a function of performing “Curved MPR” as an MPR and a function of performing “Intensity Projection”.

  In addition, the parallax image generated from the volume data by the three-dimensional image processing unit 1362 is used as an underlay, and an overlay image on which various information (scale, patient name, examination item, etc.) is drawn is overlaid ( Overlay) may be superimposed. In this case, the two-dimensional image processing unit 1363 generates a parallax image on which the overlay image is superimposed by performing image processing on the overlay image serving as an overlay and the parallax image serving as an underlay. In the example illustrated in FIG. 5, the two-dimensional image processing unit 1363 includes a two-dimensional object drawing unit 1363a, a two-dimensional geometric transformation processing unit 1363b, and a luminance adjustment unit 1363c. In addition, in order to reduce the drawing processing cost of various types of information, only one overlay is drawn, and one overlay is superimposed on each of the nine parallax images serving as underlays. One parallax image may be generated.

  The two-dimensional object drawing unit 1363a draws various information drawn on the overlay. Also, the two-dimensional geometric transformation processing unit 1363b performs a parallel movement process or a rotational movement process on the position of various information drawn on the overlay, and an enlargement process or a reduction process on various information drawn on the overlay. Also, the luminance adjustment unit 1363c, for example, performs overlay and image processing according to image processing parameters such as gradation of an output destination stereoscopic display monitor, window width (WW: Window Width), window level (WL: Window Level), and the like. Adjust the underlay brightness. In addition, the luminance adjustment unit 1363c performs, for example, luminance conversion processing on the rendered image.

  For example, the parallax image generated by the rendering processing unit 136 is temporarily stored in the storage unit 134 by the control unit 135 and then transmitted to the image storage device 120 via the communication unit 133. Thereafter, for example, the terminal device 140 acquires a parallax image on which an overlay image is superimposed from the image storage device 120, converts the parallax image into an intermediate image arranged in a predetermined format (for example, a lattice shape), and displays the parallax image on a stereoscopic display monitor. Thus, it is possible to display a stereoscopic image on which various types of information (scale, patient name, examination item, etc.) are depicted to a doctor or laboratory technician who is a user.

  As described above, the rendering processing unit 136 generates a parallax image from the volume data under the control of the control unit 135. Below, the control part 135 in 1st Embodiment is demonstrated in detail next.

  FIG. 7 is an example of a diagram illustrating details of the control unit according to the first embodiment. In the example illustrated in FIG. 7, the storage unit 134 is also illustrated for convenience of explanation. As illustrated in FIG. 7, the control unit 135 includes a reception unit 1351, a parallax image generation unit 1352, and a display control unit 1353. In addition, the storage unit 134 includes a specific information table 1341. The specific information table 1341 is also referred to as a “specific information storage unit”.

  That is, as will be described below, when the part that the user wants to see is specified by the user, the control unit 135 generates a stereoscopic image under rendering conditions suitable for the specified part, and generates the generated stereoscopic image. Displayed under appropriate conditions. As a result, an appropriate stereoscopic image can be easily displayed. That is, for example, an appropriate stereoscopic image can be easily displayed without the user having to set rendering conditions and display methods each time a stereoscopic image is displayed.

  Hereinafter, a case where the storage unit 134 includes the specific information table 1341 will be described as an example. However, the present invention is not limited to this, and an arbitrary device may be included. For example, the image storage device 120 may have, or another independent database may have.

  The specific information table 1341 includes specific information for specifying a part of the subject, a rendering condition used when generating a stereoscopic image of the part specified by the specific information, and a stereoscopic image generated based on the rendering condition. Are stored in association with the display conditions for displaying. Here, the specific information table 1341 may store specific information, rendering conditions, and display conditions in association with identification information that uniquely identifies the subject. The information stored in the specific information table 1341 is set in advance based on, for example, empirical rules.

  Here, the specific information for specifying the part of the subject includes, for example, organ names such as heart and liver, blood vessel names such as coronary artery and portal vein, bone names such as ribs and skull, muscle names, head It is an arbitrary name indicating an arbitrary part of the subject such as a foot or a foot. The rendering conditions used when generating the stereoscopic image of the part specified by the specific information are, for example, the viewpoint for generating the parallax image, the parallax angle, the scale of the parallax image, the number of parallaxes, and the stereoscopic effect of the stereoscopically displayed stereoscopic image. Stereoscopic effect information indicating the strength of the stereoscopic image, opacity information indicating the opacity of the stereoscopic image, and the like. Display conditions for displaying a stereoscopic image generated based on the rendering conditions include, for example, rotation, parallel movement, enlargement / reduction, and a stationary state. The specific information, rendering conditions, and display conditions described above are examples, and the present invention is not limited to these.

  In the specific information table 1341, when data is input to the identification information, a region of interest, an arbitrary cross section, or the like is set as the specific information applied to the user identified by the identification information. Also good.

  FIG. 8 is a diagram illustrating an example of information stored in the specific information table according to the first embodiment. In the example illustrated in FIG. 8, the specific information table 1341 stores identification information “null”, specific information “heart coronary artery”, rendering condition “viewpoint A, 9 parallax”, and display condition “still”. That is, the specific information table 1341 generates nine parallax images from the viewpoint A when the specific information “coronary artery of the heart” is selected as information applied to an unspecified user, and the generated parallax images are displayed. By displaying, it is stored that a stereoscopic image of the coronary artery of the heart in a stationary state is displayed to the user. Here, when data is input to the identification information, the associated specific information, rendering conditions, and display conditions are applied to the subject identified by the data input to the identification information. .

  Here, an example viewpoint set as the rendering condition will be described. The viewpoint indicates from which position the stereoscopic image is viewed from the subject indicated by the volume data. FIG. 9A and FIG. 9B are diagrams for illustrating an example of the specific information indicating from which position the subject indicated by the volume data is viewed as a stereoscopic image. 9A and 9B, description will be made assuming that the center of the subject indicated by the volume data is located at the origin where the x axis, the y axis, and the z axis intersect. In addition, the x-axis, the y-axis, and the z-axis in FIGS. 9-1 and 9-2 do not indicate the axes in the stereoscopic image coordinates that are the coordinate system in the stereoscopic image displayed to the user. In the following description, the axes in the volume data coordinates that are the coordinate system are shown.

  As illustrated in FIG. 9A, the viewpoint corresponds to coordinates in volume data coordinates, for example. That is, when the volume data coordinates “X, Y, Z” are the specific information, the stereoscopic image of the subject viewed from the volume data coordinates “X, Y, Z” is specified. Further, as shown in FIG. 9B, the viewpoint connects, for example, an angle “α” formed by a straight line connecting the position where the subject is viewed and the origin and the yz plane, and the position where the subject is viewed and the origin. A combination of the angle “β” formed by the straight line and the xy plane and the distance “r” between the position where the subject is viewed and the origin corresponds. However, the specific information indicating from which position the subject is viewed as shown in FIGS. 9-1 and 9-2 is only an example, and is not limited to this, and arbitrary information is used. Good.

  A brief supplement will be made about the stereoscopic image coordinates and the volume data coordinates. 10 and 11 are diagrams for explaining the stereoscopic image coordinates and the volume data coordinates in the first embodiment. Description will be made assuming that (1) and (2) in FIG. 10 indicate the same subject. (1) and (2) in FIG. 11 will be described as indicating the same subject. (1) in FIG. 10 and (1) in FIG. 11 show an example of the subject indicated by the volume data coordinates in the first embodiment. For convenience of explanation, in the example shown in (1) of FIG. 10, the subject is shown as a cube, and in the example shown in (1) of FIG. 11, the subject is shown as a sphere. (2) in FIG. 10 and (2) in FIG. 11 show an example of a stereoscopic image displayed on the terminal device 140. In FIGS. 10 and 11, the z direction indicates the depth direction in the real space coordinates, the x direction indicates the horizontal direction in the real space coordinates, and the y direction indicates the vertical direction in the real space coordinates. The z ′ direction indicates the depth direction in the virtual space coordinates, the x ′ direction indicates the horizontal direction in the virtual space coordinates, and the y ′ direction indicates the vertical direction in the virtual space coordinates. The coordinates 301, the coordinates 302, and the distance 303 in (1) of FIG. 10 correspond to the coordinates 304, the coordinates 305, and the distance 306 in (2) of FIG. The region of interest 307 in (1) of FIG. 11 corresponds to the region of interest 308 in (2) of FIG.

  The stereoscopic image of (2) in FIG. 10 is narrower in the depth direction than the subject in the volume data shown in (1) of FIG. In other words, in the stereoscopic image of (2) in FIG. 10, the component in the depth direction of the subject shown in (1) of FIG. 10 is displayed after being compressed. In this case, as shown in (2) of FIG. 10, the distance 306 between the coordinates 304 and the coordinates 305 is compared with the distance 303 between the coordinates 301 and the coordinates 302 in (1) of FIG. The distance in the depth direction is shortened as it is compressed. In other words, the distance 306 displayed in the stereoscopic image is shorter than the distance 303 in the real space.

  The stereoscopic image of (2) in FIG. 11 is narrower in the z direction and the x direction than the subject in the volume data shown in (1) of FIG. In other words, in the stereoscopic image of (2) in FIG. 11, the depth and horizontal components of the subject shown in (1) of FIG. 11 are shown after being compressed. In this case, as shown in (2) of FIG. 11, the shape of the region of interest 308 has a z-direction and an x-direction that are different from the “sphere” that is the shape of the region of interest 307 shown in (1) of FIG. It becomes a narrowed shape. In the example illustrated in FIG. 11, the case where the z direction and the x direction are narrowed is illustrated as an example. However, the present invention is not limited to this, and only the z direction may be narrowed, and the y direction is narrowed. May be.

  As shown in FIGS. 10 and 11, the stereoscopic image coordinates and the volume data coordinates may not be the same. Here, the correspondence between the three-dimensional image coordinates and the volume data coordinates is uniquely determined by the scale, viewing angle, direction, and the like of the three-dimensional image, and can be expressed, for example, in the form (Equation 1) below. It becomes.

  (Expression 1) = (x1, y1, z1) = F (x2, y2, z2)

In (Equation 1), “x2”, “y2”, and “z2” indicate stereoscopic image coordinates, respectively. “X1”, “y1”, and “z1” indicate volume data coordinates, respectively. “F” indicates a function. The function “F” is uniquely determined by the scale, viewing angle, direction, and the like of the stereoscopic image. The function “F” is generated every time the scale, viewing angle, direction, etc. of the stereoscopic image are changed. For example, the affine transformation shown in (Expression 2) is used as the function “F” for transforming rotation, translation, enlargement, and reduction.
(Expression 2) x1 = a * x2 + b * y2 + c * z3 + d
y1 = e * x2 + f * y2 + g * z3 + h
z1 = i * x2 + j * y2 + k * z3 + l
(A to l are conversion coefficients)

  In the above description, the case where the correspondence relationship between the stereoscopic image coordinates and the volume data coordinates is indicated by the function “F” is described. However, the present invention is not limited to this. For example, the correspondence between the stereoscopic image coordinates and the volume data coordinates may be indicated by a table created in advance, or may be indicated by an arbitrary method.

  A case will be described in which the specific information table 1341 stores stereoscopic effect information indicating the stereoscopic effect of a stereoscopically displayed stereoscopic image and opacity information indicating the opacity of the stereoscopic image. The stereoscopic image displayed to the user has a depth, and the depth intensity felt by the user varies depending on the parallax angle of each parallax image. Based on this, the specific information table 1341 stores stereoscopic effect information indicating the strength of the stereoscopic effect. In some cases, a stereoscopic image displayed on the inside of the subject is displayed to the user. In this case, the inside of the subject may be visualized after making a part of the subject translucent. Based on this, the specific information table 1341 stores opacity information.

  Here, the relationship between the parallax angle formed by the viewpoint of each parallax image and the stereoscopic effect of the stereoscopic image will be briefly described. FIG. 12 is a diagram illustrating a change in stereoscopic effect according to a change in the parallax angle formed by the viewpoint of each parallax image. In FIG. 12, for convenience of explanation, the stereoscopic image is shown as a rectangular parallelepiped. The three-dimensional image of (1) of FIG. 12 and the three-dimensional image of (2) of FIG. In FIGS. 12 (1) and 12 (2), only the memories for the horizontal direction and the depth direction are shown for convenience of explanation. In (1) and (2) of FIG. 12, each memory is described as indicating “1 cm”.

  Here, when the parallax angle formed by the viewpoint of each parallax image is changed to a larger value, the sense of depth displayed to the user becomes stronger. In other words, the depth becomes longer and the stereoscopic effect of the stereoscopic image becomes stronger. That is, when the parallax angle formed by the viewpoint of each parallax image is changed to a larger value, the parallax image changes from (1) to (2) in FIG. Similarly, when the parallax angle formed by the viewpoint of each parallax image is changed to a smaller value, the sense of depth displayed to the user is weakened. In other words, the depth becomes shorter and the stereoscopic effect of the stereoscopic image becomes weaker. That is, when the parallax angle formed by the viewpoints of the parallax images is changed to a smaller value, the parallax image changes from (2) to (1) in FIG.

  Each unit of the control unit 135 will be described. The receiving unit 1351 receives specific information. For example, the reception unit 1351 receives specific information from the user via the input unit 131 or receives specific information input by the user to another device via the communication unit 133. For example, the control unit 135 receives specific information “the coronary artery of the heart”. In addition to the specific information, the control unit 135 receives identification information.

  The parallax image generation unit 1352 acquires a rendering condition stored in association with the specific information received by the reception unit 1351 from the specific information table 1341, and generates a stereoscopic image based on the acquired rendering condition. For example, the parallax image generation unit 1352 acquires the rendering condition “viewpoint A 9 parallax” corresponding to the specific information “cardiac coronary artery” from the specific information table 1341, and based on the acquired rendering condition “viewpoint A 9 parallax” A parallax image for displaying an image is generated. In this case, the parallax image generation unit 1352 generates nine parallax images when the volume data of the subject is viewed from the viewpoint A.

  In addition, when the identification information is also received by the reception unit 1351, the parallax image generation unit 1352 stores specific information, rendering conditions, and display conditions associated with the received identification information in the specific information table 1341. To find out. Here, when the parallax image generation unit 1352 is stored in the specific information table 1341, the parallax image generation unit 1352 is configured to store the volume data stored in the image storage device 120 based on the rendering condition associated with the received identification information. A stereoscopic image is generated using volume data of the subject identified by the identification information. On the other hand, if the parallax image generation unit 1352 is not stored in the specific information table 1341, the parallax image generation unit 1352 identifies the volume data stored in the image storage device 120 based on the rendering condition not associated with the identification information. A stereoscopic image is generated using volume data of the subject identified by the information.

  Here, an example of volume data used when the identification information is not received will be supplemented. In this case, a parallax image is generated using the currently selected volume data, or a parallax image is generated using preset volume data. Note that the parallax image generation unit 1352 generates a parallax image in cooperation with the rendering processing unit 136 by, for example, outputting rendering conditions to the rendering processing unit 136.

  The display control unit 1353 acquires the display conditions stored in association with the specific information received by the reception unit 1351 from the specific information table 1341, and acquires the stereoscopic image generated by the parallax image generation unit 1352. Is displayed from the display unit 132 based on the above. For example, the display control unit 1353 acquires the display condition “still” corresponding to the specific information “the coronary artery of the heart”. In this case, the display control unit 1353 displays each of the parallax images generated by the parallax image generation unit 1352, thereby displaying a stationary stereoscopic image to the user.

  In addition, when the identification information is also received by the reception unit 1351, the parallax image generation unit 1352 stores specific information, rendering conditions, and display conditions associated with the received identification information in the specific information table 1341. To find out. Here, when the parallax image generation unit 1352 is stored in the specific information table 1341, the parallax image generation unit 1352 displays the display based on the display condition associated with the received identification information. On the other hand, when the parallax image generation unit 1352 is not stored in the specific information table 1341, the parallax image generation unit 1352 displays the display based on display conditions that are not associated with the identification information. Note that the display control unit 1353 displays a stereoscopic image to the user on the display unit 132, displays it on the terminal device 140, or displays it on an arbitrary terminal.

[Processing According to First Embodiment]
FIG. 13 is a flowchart illustrating an example of a flow of processing by the control unit in the first embodiment. In the following, for the sake of convenience of explanation, a case where the receiving unit 1351 receives specific information “the coronary artery of the heart” will be described.

  As illustrated in FIG. 13, in the control unit 135, when the reception unit 1351 receives the specific information (Yes in step S101), the parallax image generation unit 1352 displays the rendering condition stored in association with the specific information in the specific information table 1341. (Step S102), and a stereoscopic image is generated based on the acquired rendering condition (step S103). For example, the parallax image generation unit 1352 acquires the rendering condition “viewpoint A 9 parallax” corresponding to the specific information “cardiac coronary artery” from the specific information table 1341, and based on the acquired rendering condition “viewpoint A 9 parallax” A parallax image for displaying an image is generated.

  Then, the display control unit 1353 acquires the display condition stored in association with the specific information received by the reception unit 1351 from the specific information table 1341 (step S104), and displays a stereoscopic image based on the acquired display condition. (Step S105). For example, the display control unit 1353 acquires the display condition “still” corresponding to the specific information “the coronary artery of the heart”, and displays a stationary three-dimensional image.

(Effects of the first embodiment)
As described above, according to the first embodiment, specific information is received, a rendering condition stored in association with the received specific information is acquired from the specific information table 1341, and a three-dimensional image is obtained based on the acquired rendering condition. Generate an image. Further, the display condition stored in association with the received specific information is acquired from the specific information table 1341, and a stereoscopic image is displayed from the display unit 132 based on the acquired display condition. As a result, an appropriate stereoscopic image can be easily displayed. That is, for example, an appropriate stereoscopic image can be easily displayed without setting a rendering condition and a display method suitable for the user.

  Further, according to the first embodiment, the specific information table 1341 stores specific information, rendering conditions, and display conditions in association with identification information that uniquely identifies the subject. Further, the identification information is further received, and a stereoscopic image is generated based on the volume data of the subject identified by the identification information among the volume data stored in the image storage device 120. As a result, an appropriate stereoscopic image can be easily displayed for a specific subject.

  Further, according to the first embodiment, the stereoscopic effect information indicating the stereoscopic effect of the stereoscopically displayed stereoscopic image and the opacity information indicating the opacity of the stereoscopic image are stored. As a result, even if the stereoscopic effect specified by the user varies in intensity and opacity, an arbitrary stereoscopic image can be easily displayed to the user.

(Second Embodiment)
In the second embodiment, a case where information received from the user is stored in the specific information table 1341 will be described. In the following, the description of the same points as in the first embodiment will be omitted as appropriate.

  FIG. 14 is an example of a diagram illustrating details of the control unit in the second embodiment. In the example shown in FIG. 14, the storage unit 134 and the specific information table 1341 are shown together for convenience of explanation. As shown in FIG. 14, the control unit 135 further includes a storage unit 1354.

  The storage unit 1354 stores specific information, rendering conditions, display conditions, identification information, and the like in the specific information table 1341. Here, the storage unit 1354 may store the specific information, rendering conditions, display conditions, identification information, and the like received as information stored in the specific information table 134 by the receiving unit 1351a as they are in the specific information table 1341. After generating rendering conditions and display conditions from the specific information received by the unit 1351a, the generated rendering conditions and display conditions and the received specific information may be stored. The storage unit 1354 may store an arbitrary display condition or rendering condition as an initial setting when no display condition or rendering condition is input.

  FIG. 15 is a diagram illustrating an example of a screen for receiving specific information and rendering conditions. In the example illustrated in FIG. 15, an example of a screen on which the cross-sectional image 322 to the cross-sectional image 324 are displayed together with the stereoscopic image 321 is illustrated. In the example illustrated in FIG. 15, the specific information “head” is received, and the section 326, the section 327, and the section 328 are set as rendering conditions by the user. In the example illustrated in FIG. 15, the cross section set as the rendering condition is a rendering condition for specifying a stereoscopic image focusing on the accepted cross section.

  In this case, the storage unit 1354 autonomously generates another rendering condition for specifying a stereoscopic image focusing on the received cross section, and stores the generated rendering condition and the received specific information in association with each other. . In the example illustrated in FIG. 15, the cross section 326 received as the specifying information specifies, for example, a stereoscopic image in which the subject is viewed from a viewpoint on a straight line orthogonal to the cross section 326. In addition, the cross section 326 received as the specifying information specifies a stereoscopic image in which a portion between the viewpoint on the straight line orthogonal to the cross section 326 and the cross section 326 has an arbitrary transmittance. Based on this, for example, the storage unit 1354 further stores, as rendering conditions, the position of the viewpoint on a straight line orthogonal to the cross section 326, the transparency of the portion between the viewpoint and the cross section 326, and the like. However, the present invention is not limited to this, and all settings of rendering conditions may be received from the user. Similarly, the storage unit 1354 stores display conditions received from the user and arbitrary display conditions.

  In the example shown in FIG. 15, the case where the cross-sectional image 322 to the cross-sectional image 324 are displayed together is shown, but the present invention is not limited to this and may not be displayed. Further, in the example illustrated in FIG. 15, the case where the reception unit 1351a receives three cross sections is illustrated as an example, but the present invention is not limited to this, and the number of cross sections may be arbitrary. In addition, as a distance between the cross section 326 and a viewpoint on a straight line orthogonal to the cross section 326, a value set in advance as an initial value may be used, or a setting of a value may be accepted by a user.

  In addition, for example, the reception unit 1351a may receive specific information, rendering conditions, and display conditions of a stereoscopic image that is actually displayed when the stereoscopic image displayed on the user is selected by the user. . FIG. 16 is a diagram illustrating an example of a screen for receiving specific information. The screen shown in FIG. 16 is displayed on the display unit 132 or the terminal device 140, for example. In the example illustrated in FIG. 16, a case is illustrated in which a stereoscopic image 311, an input field 312 that receives an input of a comment for identifying specific information, and a save button 313 for saving the specific information are illustrated. In the example shown in FIG. 16, there are three input fields 312 and three save buttons 313. However, the present invention is not limited to this, and the number of input fields 312 and save buttons 313 is arbitrary. It may be.

  In the example illustrated in FIG. 16, the scale, viewpoint, stereoscopic effect, and the like of the stereoscopic image 311 are arbitrarily changed by the user. In the example illustrated in FIG. 16, the display condition of the stereoscopic image 311 is also arbitrarily changed by the user. Then, as shown in FIG. 16, a stereoscopic image at an angle that the user wants to see is displayed under display conditions that the user wants to see, and then, as shown in (2) of FIG. Thus, the specific information is input to the input field 312 and the save button 313 is clicked as shown in (3) of FIG. Then, the storage unit 1354 stores the specific information input in the input field 312 and stores the rendering conditions for generating the stereoscopic image 311 displayed to the user when the save button 313 is clicked. The display condition of the stereoscopic image when the save button 313 is clicked is stored as the display condition.

  17 and 18 are diagrams illustrating examples of information stored in the storage unit according to the second embodiment. In FIG. 17 and FIG. 18, an example of a stereoscopic image displayed to the user is also shown for convenience of explanation. In the example illustrated in FIG. 17, the storage unit 1354 uses “patient name: XX”, “patient ID: △ Δ”, and the like as identification information for identifying the subject displayed as a stereoscopic image to the user. Store. Further, the storage unit 1354 stores “heart” as the specific information, and “view point 1: (X1, Y1, z1)”, “view point 2: (X2,. Y2, z2) "" Viewpoint 3: (X3, Y3, z3) "and the like are stored. Note that “viewpoint 1: (X1, Y1, z1)”, “viewpoint 2: (X2, Y2, z2)”, and “viewpoint 3: (X3, Y3, z3)” are different rendering conditions. In the example illustrated in FIG. 18, the storage unit 1354 has “viewpoint 1: (r1, α1, β1)” and “viewpoint 2: (r2, α2, β2) as information for specifying the viewpoint as rendering conditions. "Viewpoint 3: (r3, α3, β3)" and the like are stored.

(Effects of the second embodiment)
As described above, according to the first embodiment, specific information, rendering conditions, display conditions, identification information, and the like are received and stored in the specific information table 1341. As a result, an arbitrary stereoscopic image can be easily displayed to the user. For example, by setting in advance a viewpoint that the user wants to see the subject, the stereoscopic image can be viewed immediately without adjusting the viewpoint at the timing when the user wants to view the stereoscopic image. As a result, for example, it is possible to reduce the number of operations until a desired part is displayed and to significantly reduce the time required for interpretation.

  That is, it is possible to display a stereoscopic image to the user by using a 3D monitor, but it may be difficult to create each time a parallax image for displaying a stereoscopic image is displayed. . Based on this, by setting a reference position and a region of interest in advance, it is possible to easily display a stereoscopic image focusing on the surgical position, the OM line, and the like to the user.

(Third embodiment)
In addition to the embodiments described above, other embodiments may be used. Therefore, other embodiments will be described below.

(Display mode)
For example, according to the above-described embodiment, the case where the identification information and the specific information are different information has been described as an example. However, the present invention is not limited to this, and information in which the identification information and the specific information are integrated. May be used.

  Further, for example, the specific information table 1341 stores a combination of one or both of rendering conditions and display conditions in association with one or both of the identification information and specific information. May be. That is, for example, display conditions may be stored in association with identification information. In this case, only display conditions are set for a certain user. Similarly, for example, only rendering conditions may be stored in association with specific information. In this case, only a rendering condition is set for a certain part.

(Display mode)
FIG. 19 is a diagram illustrating an example of a parallax image output mode. FIG. 19 shows an example of a screen output to the user. In the example shown in FIG. 19, a case where the “OPEN” button 331 for accepting a display instruction is clicked by the user after the “patient ID” used for specifying the volume data is input will be described. To do. In this case, the reception unit 1351 receives “patient ID” as identification information or specific information. Thereafter, the parallax image generation unit 1352 generates a parallax image for the received patient ID based on the volume data identified by the received patient ID. Then, the display control unit 1353 displays the parallax image, thereby displaying the stereoscopic image 332 and the stereoscopic image 334 to the user as shown in FIG. In the example shown in FIG. 19, there are two rendering conditions associated with the volume data identified by the received patient ID, and the display control unit 1353 displays two stereoscopic images to the user. . In the example illustrated in FIG. 19, the specific information is displayed to the user together with the stereoscopic image. In the example in FIG. 19, the specific information corresponds to “X1, Y1, Z1” or “X2, Y2, Z2”.

(Accepting specific information)
FIG. 20 is a diagram illustrating an example of a screen that accepts selection of specific information. As shown in the screen 341 in FIG. 20, in combination with a stereoscopic image, a button for receiving “RCA” as specific information, a button for receiving “LAD” as specific information, a button for receiving “LCX” as specific information, and any There may be a region for receiving input of specific information. In this case, for example, as shown in a screen 342 in FIG. 20, when a button for accepting “LCX” is clicked by the user, a stereoscopic image specified by the specific information “LCX” is displayed. For example, as illustrated in a screen 343 in FIG. 20, when “LCX” is input in an area for receiving input of arbitrary specific information, a stereoscopic image specified by the specific information “LCX” is displayed.

(Reproduction of editing status of specific information)
For example, after receiving an editing operation on the specific information table 1341 from the user, the editing state by the user may be interrupted and reproduced. In the following, description will be given using a case where the editing operation of the specific information is performed by the control unit 135 of the workstation 130, but the present invention is not limited to this, and the medical image diagnostic apparatus 110 may be used. 120 may be sufficient and the terminal device 140 may be sufficient.

  FIG. 21 is a diagram illustrating an example of a configuration of a control unit capable of reproducing editing work on the specific information table 1341. In the example illustrated in FIG. 21, the control unit 135 includes an editing unit 1355, a reproduction information storage unit 1356, and a reproduction processing unit 1357 in addition to the configuration of the control unit 135 illustrated in FIG. The image processing system also includes a reproduction information storage unit 401 that stores reproduction information for reproducing the editing state of the specific information by the editing unit 1355. The reproduction information storage unit 401 is provided, for example, in the image storage device 120, provided in the workstation 130, provided in the terminal device 140, or provided as a database or various memory devices.

  The editing unit 1355 edits information stored in the specific information table 1341. For example, the editing unit 1355 acquires specific information, rendering conditions, display conditions, identification information, and the like from the specific information table 1341, and provides a user with a work environment for editing the acquired information. Thereafter, the editing unit 1355 updates the specific information storage unit 121 based on the operation content by the user.

  The reproduction information storage unit 1356 stores reproduction information for reproducing the editing state of the specific information by the editing unit 1355 in the reproduction information storage unit 401 when editing by the editing unit 1355 is interrupted. For example, when the user interrupts the editing operation, the reproduction information storage unit 1356 creates a snapshot of the working environment at the time of interruption, and stores the created snapshot in the reproduction information storage unit 401 as reproduction information. In the above description, the case where a snapshot of the work environment is used as reproduction information has been described as an example. However, the present invention is not limited to this, and arbitrary information may be used.

  When the editing by the editing unit 1355 is resumed, the reproduction processing unit 1357 acquires the reproduction information stored in the reproduction information storage unit 401 by the reproduction information storage unit 1356, and reproduces the editing state based on the acquired reproduction information. To do. For example, the reproduction processing unit 1357 acquires the snapshot from the reproduction information storage unit 401, and reproduces the editing state by the editing unit 1355 by reproducing the working environment at the time of interruption based on the acquired snapshot. As a result, the editing state of specific information can be interrupted and reproduced.

(Specific information)
For example, instead of generating a parallax image by real-time rendering, a plurality of parallax image groups may be generated based on volume data, and specific information may be stored in association with the generated parallax image groups. good.

  In this case, the control unit 135 stores the specific information in the specific information table 1341 in association with the parallax image group generated in advance based on the volume data of the subject stored in a predetermined storage device. For example, the control unit 135 stores the viewpoint position in the specific information table 1341 as specific information. For example, on that basis, the control unit 135 selects a predetermined number of parallax images for displaying a stereoscopic image specified by the specific information stored in the specific information table 1341, and selects the selected parallax image. Output an image. Note that the control unit 135 is also referred to as a parallax image selection unit.

  That is, for example, based on the volume data, each parallax image viewed from the entire periphery of the subject may be generated in advance, and each parallax image corresponding to the position of the viewpoint stored as the specific information may be selected. As a result, real-time rendering becomes unnecessary, and a parallax image can be output quickly. In addition, the processing load can be reduced.

(Other)
Further, for example, the specific information may be stored in association with the inspection purpose or application. In this case, the parallax image generation unit generates the parallax image based on the specific information associated with the identified inspection purpose and application after identifying the current inspection purpose and application. Any method may be used as a method for identifying the current inspection purpose and application. For example, the purpose of the program used by the user is identified, or input of the inspection purpose or application from the user is accepted. Or may be identified. Note that the purpose of examination corresponds to non-contrast, contrast, perfusion, emergency, etc., for example.

  Further, when displaying a stereoscopic image specified by the specific information to the user, the specific information may be displayed together and an operation for changing the displayed specific information may be received from the user.

(System configuration)
Also, among the processes described in this embodiment, all or part of the processes described as being performed automatically can be performed manually, or the processes described as being performed manually can be performed. All or a part can be automatically performed by a known method. In addition, the processing procedures, control procedures, specific names, and information including various data and parameters (FIGS. 1 to 19) shown in the above-mentioned document and drawings may be arbitrarily changed unless otherwise specified. Can do.

  Further, each component of each illustrated apparatus is functionally conceptual, and does not necessarily need to be physically configured as illustrated. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or a part of the distribution / integration may be functionally or physically distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. For example, the control unit 135 of the workstation 130 may be connected as an external device of the workstation 130 via a network. Further, the specific information table 1341 may be an independent database or may be in a storage unit of an arbitrary device.

(Other)
Note that the image processing program described in the present embodiment can be distributed via a network such as the Internet. The image processing program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, a DVD, or a Blu-ray disk, and is executed by being read from the recording medium by the computer. You can also.

(Effect of embodiment)
According to the image processing apparatus of at least one embodiment described above, when the specific information is received, the rendering condition stored in association with the received specific information is acquired from the specific information table, and the acquired rendering condition is acquired. A stereoscopic image is generated based on the above. Further, the display condition stored in association with the received specific information is acquired from the specific information table, and a stereoscopic image is displayed based on the acquired display condition. As a result, an appropriate stereoscopic image can be easily displayed.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 110 Medical diagnostic imaging apparatus 120 Image storage apparatus 130 Workstation 135 Control part 1351 Reception part 1352 Parallax image generation part 1353 Display control part 1354 Storage part 140 Terminal device

Claims (6)

Specific information for specifying the region of the subject , and a reception unit that accepts the purpose of the examination or the use of the image of the subject ;
The rendering conditions used when generating the 3D image of the part specified by the specific information, the examination purpose or the image of the subject, and the part specified by the specific information , and the 3D of the 3D image displayed in 3D From the specific information storage device that stores the rendering condition including the stereoscopic effect information indicating the intensity of feeling and the display condition for displaying the stereoscopic image generated based on the rendering condition in association with each other, the receiving unit The rendering condition stored in association with the specific information received by the examination purpose and the purpose of the image of the subject is acquired, and based on the acquired rendering condition, the stereoscopic effect information included in the rendering condition is used. A parallax image generating unit that generates a stereoscopic image with the strength of the stereoscopic effect shown;
The specific information received by the reception unit and the display conditions stored in association with the purpose of examination or the use of the image of the subject are acquired from the specific information storage device, and the stereoscopic image generated by the parallax image generation unit An image processing apparatus comprising: a display control unit configured to display an image on a display unit based on the acquired display condition. The specific information storage device stores the specific information, the examination purpose or the use of the image of the subject, the rendering condition, and the display condition in association with identification information that uniquely identifies the subject. ,
The reception unit further receives the identification information,
The image processing apparatus according to claim 1, wherein the parallax image generation unit generates a stereoscopic image based on volume data of a subject identified by the identification information stored in a predetermined storage device. An editing unit for editing information stored in the specific information storage device;
A reproduction information storage unit that stores reproduction information for reproducing an editing state by the editing unit in a reproduction information storage unit when editing by the editing unit is interrupted;
A reproduction processing unit that acquires reproduction information stored in the reproduction information storage unit by the reproduction information storage unit when editing by the editing unit is resumed, and reproduces the editing state based on the acquired reproduction information; the image processing apparatus according to claim 1 or 2, further comprising a. Specific information for specifying the region of the subject , and a reception step for accepting the purpose of the examination or the use of the image of the subject ;
The rendering conditions used when generating the stereoscopic information of the part specified by the specific information, the examination purpose or the image of the subject and the specific information , and the stereoscopic image of the stereoscopic image displayed in three dimensions From the specific information storage device that stores the rendering condition including the stereoscopic effect information indicating the strength of the feeling and the display condition for displaying the stereoscopic image generated based on the rendering condition in association with each other, the receiving step The rendering condition stored in association with the specific information received by the examination purpose and the purpose of the image of the subject is acquired, and based on the acquired rendering condition, the stereoscopic effect information included in the rendering condition is used. A parallax image generation step of generating a stereoscopic image with the strength of the stereoscopic effect shown;
The specific information received by the receiving step and the display conditions stored in association with the examination purpose or the use of the image of the subject are acquired from the specific information storage device, and the three-dimensional object generated by the parallax image generating step A display control step of displaying an image on a display unit based on the acquired display condition. Specific information for specifying the region of the subject , and a reception unit that accepts the purpose of the examination or the use of the image of the subject ;
The rendering conditions used when generating the stereoscopic information of the part specified by the specific information, the examination purpose or the image of the subject and the specific information , and the stereoscopic image of the stereoscopic image displayed in three dimensions From the specific information storage device that stores the rendering condition including the stereoscopic effect information indicating the intensity of feeling and the display condition for displaying the stereoscopic image generated based on the rendering condition in association with each other, the receiving unit The rendering condition stored in association with the specific information received by the examination purpose and the purpose of the image of the subject is acquired, and based on the acquired rendering condition, the stereoscopic effect information included in the rendering condition is used. A parallax image generating unit that generates a stereoscopic image with the strength of the stereoscopic effect shown;
The specific information received by the reception unit and the display conditions stored in association with the purpose of examination or the use of the image of the subject are acquired from the specific information storage device, and the stereoscopic image generated by the parallax image generation unit An image processing system comprising: a display control unit configured to display an image on a display unit based on the acquired display condition. Specific information for specifying the region of the subject , and a reception unit that accepts the purpose of the examination or the use of the image of the subject ;
The rendering conditions used when generating the stereoscopic information of the part specified by the specific information, the examination purpose or the image of the subject and the specific information , and the stereoscopic image of the stereoscopic image displayed in three dimensions From the specific information storage device that stores the rendering condition including the stereoscopic effect information indicating the intensity of feeling and the display condition for displaying the stereoscopic image generated based on the rendering condition in association with each other, the receiving unit The rendering condition stored in association with the specific information received by the examination purpose and the purpose of the image of the subject is acquired, and based on the acquired rendering condition, the stereoscopic effect information included in the rendering condition is used. A parallax image generating unit that generates a stereoscopic image with the strength of the stereoscopic effect shown;
The specific information received by the reception unit and the display conditions stored in association with the purpose of examination or the use of the image of the subject are acquired from the specific information storage device, and the stereoscopic image generated by the parallax image generation unit A medical image diagnostic apparatus comprising: a display control unit configured to display an image on a display unit based on the acquired display condition.

Images