JP2013022247A - Image processing system, device and method, and medical image diagnostic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing system, device and method, allowing display of images corresponding to the number of observers.SOLUTION: In this image processing device, a display part displays a parallax image grope to cause a display object to be stereoscopically viewed. An observer detection part detects the observers of the display object drawn by the display part. A display control part changes a display method of the parallax image group by the display part according to the number of the observers detected by the observer detection part.

Description

  Embodiments described herein relate generally to an image processing system, apparatus, method, and medical image diagnostic apparatus.

  Conventionally, a monitor capable of stereoscopically viewing a two-parallax image taken from two viewpoints using a dedicated device such as stereoscopic glasses has been put into practical use. In recent years, monitors that can stereoscopically view multi-parallax images (for example, 9 parallax images) taken from a plurality of viewpoints using a light beam controller such as a lenticular lens have been put into practical use. Note that a 2-parallax image or a 9-parallax image displayed on a stereoscopically viewable monitor may be generated by estimating the depth information of an image taken from one viewpoint and performing image processing using the estimated information. .

  On the other hand, a medical image diagnostic apparatus such as an X-ray CT (Computed Tomography) apparatus, an MRI (Magnetic Resonance Imaging) apparatus, or an ultrasonic diagnostic apparatus is practically capable of generating three-dimensional medical image data (hereinafter referred to as volume data). It has become. Conventionally, volume data generated by such a medical image diagnostic apparatus is converted into a two-dimensional image by various image processing and displayed two-dimensionally on a general-purpose monitor. For example, volume data generated by a medical image diagnostic apparatus is converted into a two-dimensional image reflecting three-dimensional information by volume rendering processing, and is displayed two-dimensionally on a general-purpose monitor. However, with the conventional technology, it is difficult to display an image corresponding to the number of observers.

JP 2005-84414 A

  The problem to be solved by the present invention is to provide an image processing system, apparatus, method, and medical image diagnostic apparatus capable of displaying an image according to the number of observers.

  The image processing system according to the embodiment includes display means, detection means, and output control means. The display means stereoscopically displays the display target object by displaying the parallax image group. The detection means detects an observer of the display object drawn by the display means. The display control unit changes a display method of the parallax image group by the display unit according to the number of observers detected by the detection unit.

FIG. 1 is a diagram for explaining a configuration example of an image processing system according to the first embodiment. FIG. 2 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using two parallax images. FIG. 3 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using nine parallax images. FIG. 4 is a diagram for explaining a configuration example of the workstation according to the first embodiment. FIG. 5 is a diagram for explaining a configuration example of the rendering processing unit shown in FIG. FIG. 6 is a diagram for explaining an example of volume rendering processing according to the first embodiment. FIG. 7 is a diagram for explaining a configuration example of a control unit according to the first embodiment. FIG. 8 is a diagram for explaining an example of processing for acquiring information on the position of the observer by the observer detection unit according to the first embodiment. FIG. 9 is a diagram for explaining a viewing zone according to the first embodiment. FIG. 10 is a diagram for explaining an example of the first display process by the display control unit according to the first embodiment. FIG. 11 is a diagram for explaining an example of a viewing zone adjustment method by the display control unit according to the first embodiment. FIG. 12 is a diagram for explaining an example of second display processing by the display control unit according to the first embodiment. FIG. 13 is a diagram for explaining an example of a third display process by the display control unit according to the first embodiment. FIG. 14 is a diagram for explaining viewing zone adjustment in the same display mode by the display control unit according to the first embodiment. FIG. 15 is a diagram illustrating an example of information stored by the storage unit according to the first embodiment. FIG. 16 is a flowchart illustrating a processing procedure performed by the workstation according to the first embodiment. FIG. 17 is a diagram for explaining an example of a viewing zone adjustment method by the display control unit according to the second embodiment. FIG. 18 is a diagram illustrating an example of information stored by the storage unit according to the second embodiment.

  Hereinafter, embodiments of an image processing system, an apparatus, a method, and a medical image diagnostic apparatus will be described in detail with reference to the accompanying drawings. In the following, an image processing system including a workstation having a function as an image processing apparatus will be described as an embodiment. Here, the terms used in the following embodiments will be described. The “parallax image group” is an image generated by performing volume rendering processing by moving the viewpoint position by a predetermined parallax angle with respect to volume data. It is a group. That is, the “parallax image group” includes a plurality of “parallax images” having different “viewpoint positions”. The “parallax angle” is a predetermined position in the space represented by the volume data and an adjacent viewpoint position among the viewpoint positions set to generate the “parallax image group” (for example, the center of the space) It is an angle determined by. The “parallax number” is the number of “parallax images” necessary for stereoscopic viewing on the stereoscopic display monitor. The “9 parallax images” described below is a “parallax image group” composed of nine “parallax images”. The “two-parallax image” described below is a “parallax image group” composed of two “parallax images”.

(First embodiment)
First, a configuration example of the image processing system according to the first embodiment will be described. FIG. 1 is a diagram for explaining a configuration example of an image processing system according to the first embodiment.

  As shown in FIG. 1, the image processing system 1 according to the first embodiment includes a medical image diagnostic apparatus 110, an image storage apparatus 120, a workstation 130, and a terminal apparatus 140. Each apparatus illustrated in FIG. 1 is in a state where it can communicate with each other directly or indirectly by, for example, an in-hospital LAN (Local Area Network) 2 installed in a hospital. For example, when a PACS (Picture Archiving and Communication System) is introduced into the image processing system 1, each apparatus transmits and receives medical images and the like according to DICOM (Digital Imaging and Communications in Medicine) standards.

  The image processing system 1 generates a parallax image group from volume data that is three-dimensional medical image data generated by the medical image diagnostic apparatus 110, and displays the parallax image group on a stereoscopically viewable monitor. Provide medical images that can be viewed stereoscopically to doctors and laboratory technicians working in hospitals. Specifically, in the first embodiment, the workstation 130 performs various image processing on the volume data to generate a parallax image group. In addition, the workstation 130 and the terminal device 140 have a monitor that can be viewed stereoscopically, and displays a parallax image group generated by the workstation 130 on the monitor. Further, the image storage device 120 stores the volume data generated by the medical image diagnostic device 110 and the parallax image group generated by the workstation 130. That is, the workstation 130 and the terminal device 140 acquire volume data and a parallax image group from the image storage device 120, process them, and display them on a monitor. Hereinafter, each device will be described in order.

  The medical image diagnostic apparatus 110 includes an X-ray diagnostic apparatus, an X-ray CT (Computed Tomography) apparatus, an MRI (Magnetic Resonance Imaging) apparatus, an ultrasonic diagnostic apparatus, a SPECT (Single Photon Emission Computed Tomography) apparatus, and a PET (Positron Emission computed Tomography). ) Apparatus, a SPECT-CT apparatus in which a SPECT apparatus and an X-ray CT apparatus are integrated, a PET-CT apparatus in which a PET apparatus and an X-ray CT apparatus are integrated, or a group of these apparatuses. Further, the medical image diagnostic apparatus 110 according to the first embodiment can generate three-dimensional medical image data (volume data).

  Specifically, the medical image diagnostic apparatus 110 according to the first embodiment generates volume data by imaging a subject. For example, the medical image diagnostic apparatus 110 collects data such as projection data and MR signals by imaging the subject, and medical image data of a plurality of axial surfaces along the body axis direction of the subject from the collected data. By reconfiguring, volume data is generated. For example, the medical image diagnostic apparatus 110 reconstructs 500 pieces of medical image data on the axial plane. The 500 axial medical image data groups are volume data. In addition, the projection data of the subject imaged by the medical image diagnostic apparatus 110, the MR signal, or the like may be used as volume data.

  Further, the medical image diagnostic apparatus 110 according to the first embodiment transmits the generated volume data to the image storage apparatus 120. The medical image diagnostic apparatus 110 identifies, for example, a patient ID for identifying a patient, an examination ID for identifying an examination, and the medical image diagnostic apparatus 110 as supplementary information when transmitting volume data to the image storage apparatus 120. A device ID, a series ID for identifying one shot by the medical image diagnostic device 110, and the like are transmitted.

  The image storage device 120 is a database that stores medical images. Specifically, the image storage device 120 according to the first embodiment stores the volume data transmitted from the medical image diagnostic device 110 in a storage unit and stores it. In the first embodiment, the workstation 130 generates a parallax image group from the volume data, and transmits the generated parallax image group to the image storage device 120. Therefore, the image storage device 120 stores the parallax image group transmitted from the workstation 130 in the storage unit and stores it. In the present embodiment, the workstation 130 illustrated in FIG. 1 and the image storage device 120 may be integrated by using the workstation 130 that can store a large-capacity image. That is, this embodiment may be a case where volume data or a parallax image group is stored in the workstation 130 itself.

  In the first embodiment, the volume data and the parallax image group stored in the image storage device 120 are stored in association with the patient ID, examination ID, device ID, series ID, and the like. Therefore, the workstation 130 and the terminal device 140 acquire necessary volume data and a parallax image group from the image storage device 120 by performing a search using a patient ID, an examination ID, a device ID, a series ID, and the like.

  The workstation 130 is an image processing apparatus that performs image processing on medical images. Specifically, the workstation 130 according to the first embodiment performs various rendering processes on the volume data acquired from the image storage device 120 to generate a parallax image group. A parallax image group is a plurality of parallax images taken from a plurality of viewpoints. For example, a parallax image group displayed on a monitor capable of stereoscopically viewing nine parallax images with the naked eye has a viewpoint position. It is nine different parallax images.

  In addition, the workstation 130 according to the first embodiment includes a stereoscopically visible monitor (hereinafter, stereoscopic display monitor) as a display unit. The workstation 130 generates a parallax image group and displays the generated parallax image group on the stereoscopic display monitor. As a result, the operator of the workstation 130 can perform an operation for generating a parallax image group while confirming a stereoscopically visible medical image displayed on the stereoscopic display monitor.

  Further, the workstation 130 transmits the generated parallax image group to the image storage device 120. In addition, when transmitting the parallax image group to the image storage device 120, the workstation 130 transmits, for example, a patient ID, an examination ID, a device ID, a series ID, and the like as incidental information. Further, the incidental information transmitted when transmitting the parallax image group to the image storage device 120 includes incidental information regarding the parallax image group. The incidental information regarding the parallax image group includes the number of parallax images (for example, “9”), the resolution of the parallax images (for example, “466 × 350 pixels”), and the like.

  The terminal device 140 is a device that allows a doctor or laboratory technician working in a hospital to view a medical image. For example, the terminal device 140 is a PC (Personal Computer), a tablet PC, a PDA (Personal Digital Assistant), a mobile phone, or the like operated by a doctor or laboratory technician working in a hospital. Specifically, the terminal device 140 according to the first embodiment includes a stereoscopic display monitor as a display unit. In addition, the terminal device 140 acquires a parallax image group from the image storage device 120 and displays the acquired parallax image group on the stereoscopic display monitor. As a result, a doctor or laboratory technician who is an observer can view a medical image that can be viewed stereoscopically.

  Here, the stereoscopic display monitor included in the workstation 130 and the terminal device 140 will be described. A general-purpose monitor that is most popular at present displays a two-dimensional image in two dimensions, and cannot display a two-dimensional image in three dimensions. If an observer requests stereoscopic viewing on a general-purpose monitor, an apparatus that outputs an image to the general-purpose monitor needs to display two parallax images that can be viewed stereoscopically by the observer in parallel by the parallel method or the intersection method. is there. Alternatively, an apparatus that outputs an image to a general-purpose monitor, for example, uses an after-color method with an eyeglass that has a red cellophane attached to the left eye portion and a blue cellophane attached to the right eye portion. It is necessary to display a stereoscopically viewable image.

  On the other hand, as a stereoscopic display monitor, there is a stereoscopic display monitor that enables a stereoscopic view of a two-parallax image (also referred to as a binocular parallax image) by using dedicated equipment such as stereoscopic glasses.

  FIG. 2 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using two parallax images. An example shown in FIG. 2 is a stereoscopic display monitor that performs stereoscopic display by a shutter method, and shutter glasses are used as stereoscopic glasses worn by an observer who observes the monitor. Such a stereoscopic display monitor emits two parallax images alternately on the monitor. For example, the monitor shown in FIG. 2A alternately emits a left-eye image and a right-eye image at 120 Hz. Here, as shown in FIG. 2A, the monitor is provided with an infrared emitting unit, and the infrared emitting unit controls the emission of infrared rays in accordance with the timing at which the image is switched.

  Moreover, the infrared rays emitted from the infrared ray emitting portion are received by the infrared ray receiving portion of the shutter glasses shown in FIG. A shutter is attached to each of the left and right frames of the shutter glasses, and the shutter glasses alternately switch the transmission state and the light shielding state of the left and right shutters according to the timing when the infrared light receiving unit receives the infrared rays. Hereinafter, the switching process between the transmission state and the light shielding state in the shutter will be described.

  As shown in FIG. 2B, each shutter has an incident-side polarizing plate and an output-side polarizing plate, and a liquid crystal layer between the incident-side polarizing plate and the output-side polarizing plate. Have Further, as shown in FIG. 2B, the incident-side polarizing plate and the outgoing-side polarizing plate are orthogonal to each other. Here, as shown in FIG. 2B, in the “OFF” state where no voltage is applied, the light that has passed through the polarizing plate on the incident side is rotated by 90 ° by the action of the liquid crystal layer, and is emitted on the outgoing side. Is transmitted through the polarizing plate. That is, a shutter to which no voltage is applied is in a transmissive state.

  On the other hand, as shown in FIG. 2B, in the “ON” state where a voltage is applied, the polarization rotation action caused by the liquid crystal molecules in the liquid crystal layer disappears. It will be blocked by the polarizing plate on the exit side. That is, the shutter to which the voltage is applied is in a light shielding state.

  Therefore, for example, the infrared emitting unit emits infrared rays during a period in which an image for the left eye is displayed on the monitor. The infrared light receiving unit applies a voltage to the right-eye shutter without applying a voltage to the left-eye shutter during a period of receiving the infrared light. Accordingly, as shown in FIG. 2A, the right-eye shutter is in a light-shielding state and the left-eye shutter is in a transmissive state, so that an image for the left eye is incident on the left eye of the observer. On the other hand, the infrared ray emitting unit stops emitting infrared rays while the right-eye image is displayed on the monitor. The infrared light receiving unit applies a voltage to the left-eye shutter without applying a voltage to the right-eye shutter during a period in which no infrared light is received. Accordingly, the left-eye shutter is in a light-shielding state and the right-eye shutter is in a transmissive state, so that an image for the right eye enters the right eye of the observer. As described above, the stereoscopic display monitor illustrated in FIG. 2 displays an image that can be viewed stereoscopically by the observer by switching the image displayed on the monitor and the state of the shutter in conjunction with each other. As a stereoscopic display monitor capable of stereoscopically viewing a two-parallax image, a monitor adopting a polarized glasses method is also known in addition to the shutter method described above.

  Furthermore, as a stereoscopic display monitor that has been put into practical use in recent years, there is a stereoscopic display monitor that allows a viewer to stereoscopically view a multi-parallax image such as a 9-parallax image with the naked eye by using a light controller such as a lenticular lens. . Such a stereoscopic display monitor enables stereoscopic viewing based on binocular parallax, and also enables stereoscopic viewing based on motion parallax that also changes the image observed in accordance with the viewpoint movement of the observer.

  FIG. 3 is a diagram for explaining an example of a stereoscopic display monitor that performs stereoscopic display using nine parallax images. In the stereoscopic display monitor shown in FIG. 3, a light beam controller is arranged on the front surface of a flat display surface 200 such as a liquid crystal panel. For example, in the stereoscopic display monitor shown in FIG. 3, a vertical lenticular sheet 201 whose optical aperture extends in the vertical direction is attached to the front surface of the display surface 200 as a light beam controller.

  As shown in FIG. 3, the display surface 200 has an aspect ratio of 3: 1 and pixels in which three sub-pixels, red (R), green (G), and blue (B), are arranged in the vertical direction. 202 are arranged in a matrix. The stereoscopic display monitor shown in FIG. 3 converts a nine-parallax image composed of nine images into an intermediate image arranged in a predetermined format (for example, a lattice shape), and then outputs it to the display surface 200. That is, the stereoscopic display monitor shown in FIG. 3 assigns and outputs nine pixels at the same position in nine parallax images to nine columns of pixels 202. The nine columns of pixels 202 constitute a unit pixel group 203 that simultaneously displays nine images with different viewpoint positions.

  The nine parallax images simultaneously output as the unit pixel group 203 on the display surface 200 are emitted as parallel light by, for example, an LED (Light Emitting Diode) backlight, and further emitted in multiple directions by the vertical lenticular sheet 201. As the light of each pixel of the nine-parallax image is emitted in multiple directions, the light incident on the right eye and the left eye of the observer changes in conjunction with the position of the observer (viewpoint position). That is, the parallax angle between the parallax image incident on the right eye and the parallax image incident on the left eye differs depending on the viewing angle of the observer. Thereby, the observer can visually recognize the photographing object in three dimensions at each of the nine positions shown in FIG. 3, for example. In addition, for example, the observer can view the image three-dimensionally in a state of facing the object to be imaged at the position “5” shown in FIG. 3, and at each position other than “5” shown in FIG. It can be visually recognized in a three-dimensional manner with the direction of the object changed. Note that the stereoscopic display monitor shown in FIG. 3 is merely an example. As shown in FIG. 3, the stereoscopic display monitor that displays a nine-parallax image may be a horizontal stripe liquid crystal of “RRR..., GGG..., BBB. .. ”” May be used. The stereoscopic display monitor shown in FIG. 3 may be a vertical lens system in which the lenticular sheet is vertical as shown in FIG. 3 or a diagonal lens system in which the lenticular sheet is diagonal. There may be.

  So far, the configuration example of the image processing system 1 according to the first embodiment has been briefly described. Note that the application of the image processing system 1 described above is not limited when PACS is introduced. For example, the image processing system 1 is similarly applied when an electronic medical chart system that manages an electronic medical chart to which a medical image is attached is introduced. In this case, the image storage device 120 is a database that stores electronic medical records. Further, for example, the image processing system 1 is similarly applied when a HIS (Hospital Information System) and a RIS (Radiology Information System) are introduced. The image processing system 1 is not limited to the configuration example described above. The functions and sharing of each device may be appropriately changed according to the operation mode.

  Next, a configuration example of the workstation according to the first embodiment will be described with reference to FIG. FIG. 4 is a diagram for explaining a configuration example of the workstation according to the first embodiment. In the following description, the “parallax image group” is a group of stereoscopic images generated by performing volume rendering processing on volume data. Further, the “parallax image” is an individual image constituting the “parallax image group”. That is, the “parallax image group” includes a plurality of “parallax images” having different viewpoint positions.

  The workstation 130 according to the first embodiment is a high-performance computer suitable for image processing and the like, and as illustrated in FIG. 4, an input unit 131, a display unit 132, a communication unit 133, and a storage unit 134. A control unit 135, a rendering processing unit 136, and a detection unit 137. In the following, a case where the workstation 130 is a high-performance computer suitable for image processing or the like will be described. However, the present invention is not limited to this, and may be any information processing apparatus. For example, any personal computer may be used.

  The input unit 131 is a mouse, a keyboard, a trackball, or the like, and receives input of various operations on the workstation 130 from an operator. Specifically, the input unit 131 according to the first embodiment receives input of information for acquiring volume data to be subjected to rendering processing from the image storage device 120. For example, the input unit 131 receives input of a patient ID, an examination ID, a device ID, a series ID, and the like. Further, the input unit 131 according to the first embodiment receives an input of a condition regarding rendering processing (hereinafter, rendering condition).

  The display unit 132 is a liquid crystal panel or the like as a stereoscopic display monitor, and displays various information. Specifically, the display unit 132 according to the first embodiment displays a GUI (Graphical User Interface) for receiving various operations from the operator, a parallax image group, and the like. The communication unit 133 is a NIC (Network Interface Card) or the like, and performs communication with other devices.

  The storage unit 134 is a hard disk, a semiconductor memory element, or the like, and stores various types of information. Specifically, the storage unit 134 according to the first embodiment stores volume data acquired from the image storage device 120 via the communication unit 133. In addition, the storage unit 134 according to the first embodiment stores volume data during rendering processing, a parallax image group generated by rendering processing, an image for two-dimensional display, and the like.

  The control unit 135 is an electronic circuit such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit), an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array), and the entire workstation 130. Take control.

  For example, the control unit 135 according to the first embodiment controls the display of the GUI and the display of the parallax image group on the display unit 132. For example, the control unit 135 controls transmission / reception of volume data and a parallax image group performed with the image storage device 120 via the communication unit 133. For example, the control unit 135 controls the rendering process performed by the rendering processing unit 136. For example, the control unit 135 controls reading of volume data from the storage unit 134 and storage of the parallax image group in the storage unit 134.

  The rendering processing unit 136 performs various rendering processes on the volume data acquired from the image storage device 120 under the control of the control unit 135 to generate a parallax image group. The processing of the rendering processing unit 136 will be described in detail later.

  The detection unit 137 detects the position of the observer of the parallax image with respect to the display unit 132. Specifically, the detection unit 137 detects an observer's standing position with respect to the display unit 132, an observer's face position, an observer's gaze position, and the like. Examples of the detection unit 137 include a head tracking device using a camera, an optical or magnetic position sensor, and a mechanical motion capture system. In the first embodiment, a case where a head tracking device using a camera is used as the detection unit 137 will be described. The description thereof will be described later.

  The rendering processing unit 136 performs various rendering processes on the volume data acquired from the image storage device 120 under the control of the control unit 135 to generate a parallax image group. Specifically, the rendering processing unit 136 according to the first embodiment reads volume data from the storage unit 134 and first performs preprocessing on the volume data. Next, the rendering processing unit 136 performs volume rendering processing on the pre-processed volume data to generate a parallax image group. Subsequently, the rendering processing unit 136 generates a two-dimensional image in which various kinds of information (scale, patient name, examination item, etc.) are drawn, and superimposes it on each of the parallax image groups, thereby outputting 2 for output. Generate a dimensional image. Then, the rendering processing unit 136 stores the generated parallax image group and the output two-dimensional image in the storage unit 134. In the first embodiment, the rendering process is the entire image process performed on the volume data. The volume rendering process is a two-dimensional image reflecting three-dimensional information in the rendering process. It is a process to generate. For example, a parallax image corresponds to the medical image generated by the rendering process.

  FIG. 5 is a diagram for explaining a configuration example of the rendering processing unit shown in FIG. As illustrated in FIG. 5, the rendering processing unit 136 includes a preprocessing unit 1361, a 3D image processing unit 1362, and a 2D image processing unit 1363. The preprocessing unit 1361 performs preprocessing on the volume data, the 3D image processing unit 1362 generates a parallax image group from the preprocessed volume data, and the 2D image processing unit 1363 stores various information on the parallax image group. A two-dimensional image for output on which is superimposed is generated. Hereinafter, each part is demonstrated in order.

  The preprocessing unit 1361 is a processing unit that performs various types of preprocessing when rendering processing is performed on volume data, and includes an image correction processing unit 1361a, a three-dimensional object fusion unit 1361e, and a three-dimensional object display area setting. Part 1361f.

  The image correction processing unit 1361a is a processing unit that performs image correction processing when processing two types of volume data as one volume data, and as shown in FIG. 5, a distortion correction processing unit 1361b, a body motion correction processing unit, 1361c and an inter-image registration processing unit 1361d. For example, the image correction processing unit 1361a performs image correction processing when processing volume data of a PET image generated by a PET-CT apparatus and volume data of an X-ray CT image as one volume data. Alternatively, the image correction processing unit 1361a performs image correction processing when processing the volume data of the T1-weighted image and the volume data of the T2-weighted image generated by the MRI apparatus as one volume data.

  In addition, the distortion correction processing unit 1361b corrects the data distortion caused by the collection conditions at the time of data collection by the medical image diagnostic apparatus 110 in each volume data. Further, the body motion correction processing unit 1361c corrects the movement caused by the body motion of the subject at the time of collecting the data used for generating the individual volume data. Further, the inter-image registration processing unit 1361d performs registration (Registration) using, for example, a cross-correlation method between the two volume data subjected to the correction processing by the distortion correction processing unit 1361b and the body motion correction processing unit 1361c. ).

  The three-dimensional object fusion unit 1361e fuses a plurality of volume data that has been aligned by the inter-image registration processing unit 1361d. Note that the processing of the image correction processing unit 1361a and the three-dimensional object fusion unit 1361e is omitted when rendering processing is performed on single volume data.

  The three-dimensional object display region setting unit 1361f is a processing unit that sets a display region corresponding to the display target organ designated by the operator, and includes a segmentation processing unit 1361g. The segmentation processing unit 1361g is a processing unit that extracts organs such as the heart, lungs, and blood vessels designated by the operator by, for example, a region expansion method based on pixel values (voxel values) of volume data.

  Note that the segmentation processing unit 1361g does not perform the segmentation process when the display target organ is not designated by the operator. The segmentation processing unit 1361g extracts a plurality of corresponding organs when a plurality of display target organs are designated by the operator. Further, the processing of the segmentation processing unit 1361g may be executed again in response to an operator fine adjustment request referring to the rendered image.

  The 3D image processing unit 1362 performs volume rendering processing on the pre-processed volume data processed by the preprocessing unit 1361. As a processing unit that performs volume rendering processing, a three-dimensional image processing unit 1362 includes a projection method setting unit 1362a, a three-dimensional geometric transformation processing unit 1362b, a three-dimensional object appearance processing unit 1362f, and a three-dimensional virtual space rendering unit 1362k. Have

  The projection method setting unit 1362a determines a projection method for generating a parallax image group. For example, the projection method setting unit 1362a determines whether to execute the volume rendering process by the parallel projection method or the perspective projection method.

  The three-dimensional geometric transformation processing unit 1362b is a processing unit that determines information for transforming volume data on which volume rendering processing is performed into a three-dimensional geometrical structure. The three-dimensional geometric transformation processing unit 1362b includes a parallel movement processing unit 1362c, a rotation processing unit 1362d, and an enlargement unit. A reduction processing unit 1362e is included. The parallel movement processing unit 1362c is a processing unit that determines the amount of movement to translate the volume data when the viewpoint position when performing the volume rendering processing is translated, and the rotation processing unit 1362d performs the volume rendering processing. This is a processing unit that determines the amount of movement by which the volume data is rotationally moved when the viewpoint position during the rotation is rotationally moved. The enlargement / reduction processing unit 1362e is a processing unit that determines the enlargement rate or reduction rate of the volume data when enlargement or reduction of the parallax image group is requested.

  The three-dimensional object appearance processing unit 1362f includes a three-dimensional object color processing unit 1362g, a three-dimensional object opacity processing unit 1362h, a three-dimensional object material processing unit 1362i, and a three-dimensional virtual space light source processing unit 1362j. The three-dimensional object appearance processing unit 1362f performs a process of determining the display state of the displayed parallax image group in response to an operator's request, for example.

  The three-dimensional object color processing unit 1362g is a processing unit that determines a color to be colored for each region segmented by the volume data. The three-dimensional object opacity processing unit 1362h is a processing unit that determines the opacity (Opacity) of each voxel constituting each region segmented by volume data. It should be noted that the area behind the area having the opacity of “100%” in the volume data is not drawn in the parallax image group. In addition, an area in which the opacity is “0%” in the volume data is not drawn in the parallax image group.

  The three-dimensional object material processing unit 1362i is a processing unit that determines the material of each region segmented by volume data and adjusts the texture when the region is rendered. The three-dimensional virtual space light source processing unit 1362j is a processing unit that determines the position of the virtual light source installed in the three-dimensional virtual space and the type of the virtual light source when performing volume rendering processing on the volume data. Examples of the virtual light source include a light source that emits parallel light rays from infinity and a light source that emits radial light rays from the viewpoint.

  The three-dimensional virtual space rendering unit 1362k performs volume rendering processing on the volume data to generate a parallax image group. The three-dimensional virtual space rendering unit 1362k performs various types of information determined by the projection method setting unit 1362a, the three-dimensional geometric transformation processing unit 1362b, and the three-dimensional object appearance processing unit 1362f as necessary when performing the volume rendering process. Is used.

  Here, the volume rendering process by the three-dimensional virtual space rendering unit 1362k is performed according to the rendering conditions. For example, the rendering condition is “parallel projection method” or “perspective projection method”. For example, the rendering condition is “reference viewpoint position and parallax angle”. Further, for example, the rendering conditions are “translation of viewpoint position”, “rotational movement of viewpoint position”, “enlargement of parallax image group”, and “reduction of parallax image group”. Further, for example, the rendering conditions are “color to be colored”, “transparency”, “texture”, “position of virtual light source”, and “type of virtual light source”. Such a rendering condition may be accepted from the operator via the input unit 131 or may be initially set. In any case, the three-dimensional virtual space rendering unit 1362k receives a rendering condition from the control unit 135, and performs volume rendering processing on the volume data according to the rendering condition. At this time, the projection method setting unit 1362a, the three-dimensional geometric transformation processing unit 1362b, and the three-dimensional object appearance processing unit 1362f determine various pieces of necessary information according to the rendering conditions, so the three-dimensional virtual space rendering unit 1362k. Generates a parallax image group using the determined various pieces of information.

  FIG. 6 is a diagram for explaining an example of volume rendering processing according to the first embodiment. For example, as shown in “9 parallax image generation method (1)” in FIG. 6, the three-dimensional virtual space rendering unit 1362k accepts the parallel projection method as a rendering condition, and further, the reference viewpoint position (5) and the parallax. Assume that the angle “1 degree” is received. In such a case, the three-dimensional virtual space rendering unit 1362k translates the position of the viewpoint from (1) to (9) so that the parallax angle is "1 degree", and the parallax angle (line of sight) is obtained by the parallel projection method. Nine parallax images with different degrees between directions are generated. When performing the parallel projection method, the three-dimensional virtual space rendering unit 1362k sets a light source that emits parallel light rays from infinity along the line-of-sight direction.

  Alternatively, as shown in “9-parallax image generation method (2)” in FIG. 6, the three-dimensional virtual space rendering unit 1362k accepts a perspective projection method as a rendering condition, and further, the reference viewpoint position (5) and the parallax Assume that the angle “1 degree” is received. In such a case, the three-dimensional virtual space rendering unit 1362k rotates and moves the viewpoint position from (1) to (9) so that the parallax angle is every "1 degree" around the center (center of gravity) of the volume data. Thus, nine parallax images having different parallax angles by 1 degree are generated by the perspective projection method. When performing the perspective projection method, the three-dimensional virtual space rendering unit 1362k sets a point light source or a surface light source that radiates light three-dimensionally radially around the line-of-sight direction at each viewpoint. When performing the perspective projection method, the viewpoints (1) to (9) may be translated depending on rendering conditions.

  Note that the three-dimensional virtual space rendering unit 1362k radiates light two-dimensionally radially around the line-of-sight direction with respect to the vertical direction of the displayed volume rendered image, and the horizontal direction of the displayed volume rendered image. On the other hand, volume rendering processing using both the parallel projection method and the perspective projection method may be performed by setting a light source that irradiates parallel light rays from infinity along the viewing direction.

  The nine parallax images generated in this way are a parallax image group. In the first embodiment, the nine parallax images are converted into intermediate images arranged in a predetermined format (for example, a lattice shape) by the control unit 135, for example, and are output to the display unit 132 as a stereoscopic display monitor. Then, the operator of the workstation 130 can perform an operation for generating a parallax image group while confirming a stereoscopically viewable medical image displayed on the stereoscopic display monitor.

  In the example of FIG. 6, the case where the projection method, the reference viewpoint position, and the parallax angle are received as the rendering conditions has been described. However, the three-dimensional virtual space is similarly applied when other conditions are received as the rendering conditions. The rendering unit 1362k generates a parallax image group while reflecting each rendering condition.

  The three-dimensional virtual space rendering unit 1362k reconstructs not only volume rendering but also a planar image of an arbitrary plane (for example, an axial plane, a sagittal plane, a coronal plane, etc.). For example, the three-dimensional virtual space rendering unit 1362k performs a cross-section reconstruction method (MPR: Multi Planer Reconstruction) to reconstruct an MPR image from volume data. The three-dimensional virtual space rendering unit 1362k also has a function of performing “Curved MPR” and a function of performing “Intensity Projection”.

  Subsequently, the parallax image group generated from the volume data by the three-dimensional image processing unit 1362 is set as an underlay. Then, an overlay (Overlay) on which various types of information (scale, patient name, examination item, etc.) are drawn is superimposed on the underlay, thereby obtaining a two-dimensional image for output. The two-dimensional image processing unit 1363 is a processing unit that generates an output two-dimensional image by performing image processing on the overlay and the underlay. As illustrated in FIG. 5, the two-dimensional object drawing unit 1363a, A two-dimensional geometric transformation processing unit 1363b and a luminance adjustment unit 1363c are included. For example, the two-dimensional image processing unit 1363 superimposes one overlay on each of nine parallax images (underlays) in order to reduce the load required to generate a two-dimensional image for output. Thus, nine output two-dimensional images are generated.

  The two-dimensional object drawing unit 1363a is a processing unit that draws various information drawn on the overlay, and the two-dimensional geometric transformation processing unit 1363b performs parallel movement processing or rotational movement processing on the position of the various information drawn on the overlay. Or a processing unit that performs an enlargement process or a reduction process of various types of information drawn on the overlay.

  The luminance adjustment unit 1363c is a processing unit that performs luminance conversion processing. For example, the gradation of an output destination stereoscopic display monitor, an image such as a window width (WW: Window Width), a window level (WL: Window Level), or the like. This is a processing unit that adjusts the brightness of the overlay and the underlay according to the processing parameters.

  The output two-dimensional image generated in this way is temporarily stored in the storage unit 134 by the control unit 135, for example, and then transmitted to the image storage device 120 via the communication unit 133. For example, when the terminal device 140 acquires the two-dimensional image for output from the image storage device 120, converts it to an intermediate image arranged in a predetermined format (for example, a lattice shape), and displays it on a stereoscopic display monitor, A doctor or a laboratory technician can view a stereoscopically viewable medical image in a state where various types of information (scale, patient name, examination item, etc.) are drawn.

  The configurations of the image processing system 1 and the workstation 130 according to the first embodiment have been described above. Based on such a configuration, the workstation 130 according to the first embodiment is configured to be able to display an image according to the number of observers by the processing of the control unit 135 described in detail below. Has been. Specifically, the workstation 130 according to the first embodiment changes the display method of the parallax image group by the display unit 132 according to the number of observers.

  FIG. 7 is a diagram for explaining a configuration example of the control unit 135 according to the first embodiment. As shown in FIG. 7, the control unit 135 includes an observer detection unit 1351 and a display control unit 1352, and is connected to the head tracking device 1371. The head tracking device 1371 detects an observer of the display object displayed by the display unit 132. Specifically, the head tracking device 1371 has a camera for photographing an observer, and photographs the observer under the control of an observer detection unit 1351 described later. The head tracking device 1371 is an example of the detection unit 137 shown in FIG.

  The observer detection unit 1351 detects the observer of the display object with respect to the display unit 132. Specifically, the observer detection unit 1351 controls the head tracking device 1371 to photograph the observer, and detects the number and positions of the observers who observe the display target displayed on the display unit 132. FIG. 8 is a diagram for explaining an example of processing for acquiring information on the position of the observer by the observer detection unit 1351 according to the first embodiment.

  Here, interpretation using a three-dimensional medical image drawn with multiple parallaxes (for example, 9 parallaxes) will be described with reference to FIG. When a medical image that is recognized as three-dimensional is displayed by displaying a parallax image drawn with multiple parallaxes, the image that is observed changes according to the viewpoint position of the observer. For example, in the imaging region of the camera of the head tracking device 1371 shown in FIG. 8, parallax images that are volume-rendered from different viewpoint directions are observed at the center, left end, and right end of the imaging region. That is, for example, when a plurality of observers observe parallax images from different positions, the observers observe different images.

  Therefore, as shown in FIG. 8, the observer detection unit 1351 identifies the observer's face by face matching pattern matching from the image captured by the camera of the head tracking device 1371, and detects the number and positions of the observers. To do. For example, the observer detection unit 1351 detects the number of areas recognized as faces by pattern matching as the number of observers. Then, the observer detection unit 1351 detects the area where the face is recognized in the imaging area of the camera as the position of the observer. The observer detection unit 1351 uses the center of the display surface of the display unit 132 as the origin, the horizontal direction parallel to the display surface as the X axis, the vertical direction as the Y axis, and the direction perpendicular to the display surface as the Z axis. In the space coordinates, the coordinates of the area recognized as the Z axis and the face are calculated. In addition, the observer detection unit 1351 identifies who is the detected observer from the registered face information stored in the storage unit 134 in advance.

  Returning to FIG. 7, the display control unit 1352 changes the display method of the parallax image group by the display unit 132 according to the number of observers detected by the observer detection unit 1351. Specifically, when one or more observers are detected by the observer detection unit 1351, the display control unit 1352 can stereoscopically display the display object from the position of the observer detected by the observer detection unit 1351. Adjust the viewing zone so that In addition, when one or more observers are detected by the observer detection unit 1351, the display control unit 1352 generates a parallax image generated by changing the viewpoint with respect to the display object according to the position of the observer. The group is displayed on the display unit 132. In addition, when a plurality of observers are detected by the observer detection unit 1351, the display control unit 1352 uses the display unit 132 to display images of display objects generated from the same viewpoint for the plurality of observers. Display.

  As described above, the display control unit 1352 changes the display method in the display unit 132 in accordance with the number of observers. In the following, first, three display methods controlled by the display control unit 1352 will be described. Then, an example of changing the display method will be described.

  First, a display method (follow-up mode) for adjusting the viewing area according to the number of observers will be described. Prior to that, the viewing area of the display unit 132 will be described. The viewing area is an area in which the display object displayed by the display unit 132 can be viewed stereoscopically. FIG. 9 is a diagram for explaining a viewing zone according to the first embodiment. In FIG. 9, (A) in FIG. 9 shows a unit pixel group composed of nine pixels and a lenticular lens installed in front of the unit pixel group. In FIG. 9, (B) of FIG. 9 shows a viewing zone formed on the front surface of the display unit 132.

  For example, in the display unit 132, as shown in FIG. 9A, the image output from the unit pixel group enters the adjacent left and right lenticular lenses in addition to the front lenticular lens. . As a result, three viewing zones are formed on the front surface of the display unit 132 as shown in FIG. That is, as shown in FIG. 9B, the front of the display unit 132 is adjacent to the front viewing area that can be viewed through the lenticular lens located in front of all the unit pixel groups of the entire screen. The side lobe viewing zone that can be seen through the left and right lenticular lenses is formed. These viewing zones exist, for example, in the direction of ± 60 ° from the front of the monitor, and the range of each viewing zone is ± 15 ° from the ± 60 ° direction.

  For example, when the number of observers detected by the observer detection unit 1351 is one, the display control unit 1352 shifts the viewing zone according to the movement of the observer. FIG. 10 is a diagram for explaining an example of the first display processing by the display control unit 1352 according to the first embodiment.

  For example, when the observer moves in the direction of the arrow 301 in FIG. 10, the display control unit 1352 shifts the viewing area in the direction of the arrow 302 in FIG. 10. That is, the display control unit 1352 adjusts the viewing area so that the observer can always stereoscopically view the display target. As a result, the observer can observe the display object without worrying about the observation position. In the workstation 130 according to the first embodiment, the process for adjusting the viewing zone described above is set as <follow-up mode> as shown in FIG. 10, for example.

  Here, an example of a method for shifting the viewing zone will be described with reference to FIG. FIG. 11 is a diagram for explaining an example of a viewing zone adjustment method by the display control unit 1352 according to the first embodiment. FIG. 11 shows projection of a parallax image from nine columns of pixels provided on the display surface of the display unit 132 to a lenticular lens. For example, as shown in FIG. 11A, the display control unit 1352 displays the parallax image group with nine pixels corresponding to the width of the lenticular lens, and the observer detection unit 1351 displays the observer's When it is detected that the position has changed, as shown in FIG. 11B, the viewing zone is shifted by moving the pixel for displaying the parallax image group according to the position of the observer.

  Here, as shown in FIG. 11, when displaying a 9-parallax image, 9 light beams are emitted from the lenticular lens from the unit pixel group, but the interval between 1 light beam is a unique value for each display unit. have. For example, in the display unit 132, when the lenticular lens distributes nine light beams representing a parallax image group by ± θ1, “tan θ” that is a factor indicating the interval of one light beam is expressed by the expression “tan θ = 2 × tan θ1”. ÷ 9 ”. Then, at the distance “L” between the observer and the display unit 132, the shift of the viewing area when one pixel for displaying the parallax image is moved is “L × tan θ”.

  The display control unit 1352 calculates how much the pixel for displaying the parallax image group is to be moved based on the above equation and the coordinates of the observer calculated by the observer detection unit 1351, and sets the parallax image group to The viewing zone is shifted by moving the pixel to be displayed by the calculated pixel.

  In the above-described example, the follow-up mode when there is one observer has been described. However, the follow-up mode can also be applied when there are a plurality of observers. For example, first, a person who preferentially observes an image among a plurality of observers is set in advance. For example, an observer close to the camera or a specific doctor is set in advance as a person who preferentially observes an image. When the observer detection unit 1351 detects that the set observer has moved, the display control unit 1352 shifts the viewing zone so that the set observer can always stereoscopically view the display object.

  Next, a display method (wraparound mode) for changing the angle of the image to be displayed according to the position of the observer will be described. For example, when the number of observers detected by the observer detection unit 1351 is one, the display control unit 1352 displays a group of parallax images generated from different viewpoint directions depending on the position of the observer. FIG. 12 is a diagram for explaining an example of the second display process by the display control unit 1352 according to the first embodiment.

  For example, as illustrated in FIG. 12, when the observer is located in front of the display unit 132, the display control unit 1352 displays a 9-parallax parallax image generated from the viewpoint direction in which the display target is in front. 132 is displayed. When the observer moves to the right side, the display control unit 1352 shifts the viewpoint position to the left side while shifting the viewing area to the right, and generates a plurality of parallax image groups generated in the order in which the group is generated. Display. Similarly, when the observer moves to the left side, the display control unit 1352 causes the display unit 132 to generate a plurality of parallax image groups generated by shifting the viewpoint position stepwise to the right while shifting the viewing zone to the left. To display.

  That is, the display control unit 1352 displays a parallax image group generated by rotating the volume data in accordance with the movement of the observer so that the observer can observe the entire image of the display object. As a result, the observer can observe the entire display object without changing the display setting. In the workstation 130 according to the first embodiment, the display processing in which the angle of the display object is changed is set as <wraparound mode> as illustrated in FIG. 12, for example.

  Further, the display control unit 1352 can perform the same display in the vertical direction as the <wraparound mode>. For example, when the observer moves the face upward from the center of the display unit 132, the display control unit 1352 displays a plurality of parallax image groups generated by shifting the viewpoint position stepwise upward in the order of generation. Displayed on the unit 132. Similarly, when the observer moves the face downward from the center of the display unit 132, the display control unit 1352 generates a plurality of parallax image groups generated by shifting the viewpoint position stepwise downward. They are displayed on the display unit 132 in the order in which they are performed.

  In the above-described example, the wraparound mode in the case where there is one observer has been described, but the wraparound mode can also be applied when there are a plurality of observers. For example, first, a person who preferentially observes an image among a plurality of observers is set in advance. For example, an observer close to the camera or a specific doctor is set in advance as a person who preferentially observes an image. When the observer detection unit 1351 detects that the set observer has moved, the display control unit 1352 displays an image so that the set observer can always observe the entire display object. Let

  Next, a display method (same display mode) for displaying the same image for a plurality of observers when there are a plurality of observers will be described. For example, when the number of observers detected by the observer detection unit 1351 is plural, the display control unit 1352 adjusts the viewing zone so that each observer can see the image, and displays the image. FIG. 13 is a diagram for explaining an example of the third display process by the display control unit 1352 according to the first embodiment.

  For example, as illustrated in FIG. 13, when there are a plurality of observers, the display control unit 1352 adjusts the viewing area so that each observer can see an image, and then from the viewpoint direction in which the display object is in front. Display the generated image. FIG. 14 is a diagram for explaining viewing zone adjustment in the same display mode by the display control unit 1352 according to the first embodiment. For example, as shown in FIG. 14A, when a plurality of observers are detected by the observer detection unit 1351, the display control unit 1352 starts from the current viewing area (front viewing area, side lobe viewing area). It calculates how much each observer's position (coordinates) has shifted. Then, as shown in FIG. 14B, the display control unit 1352 shifts the viewing zone so that the number of people included in the viewing zone is the largest, and displays a parallax image group. In other words, the display control unit 1352 shifts the viewing area so that the sum of the deviations between the viewing area and the observer is minimized, and displays the parallax image group.

  As the same image to be displayed, it is also possible to select an image currently observed by a person whose image is preferentially observed among a plurality of observers. In addition, when it is not necessary to display a stereoscopic image, the same image may be output to nine columns of pixels. In the workstation 130 according to the first embodiment, the above-described display processing of the same image is set as <same display mode> as shown in FIG. 13, for example.

  The display method by the workstation 130 according to the first embodiment has been described above. Below, an example of the change of the display method using the display method mentioned above is demonstrated. Specifically, when the observer detected by the observer detection unit 1351 is a specific person, the display control unit 1352 applies a display method of the parallax image group by the display unit 132 to the specific person in advance. Change to the associated display method. FIG. 15 is a diagram illustrating an example of information stored by the storage unit 134 according to the first embodiment.

  For example, as illustrated in FIG. 15, the storage unit 134 stores a table in which a mode is associated with a person. For example, as illustrated in FIG. 15, the storage unit 134 stores a table in which “person: A” is associated with “mode: wraparound”. For example, the display control unit 1352 changes the display method based on a table as shown in FIG. For example, when the observer is identified as “person: A” by the observer detection unit 1351, the display control unit 1352 changes the display method to “wraparound mode” and displays a parallax image group. Let When the number of observers increases, the display control unit 1352 changes the display method from the “wraparound mode” to the “same display mode” and displays the parallax image group.

  When the observer is a person who is not registered in the table stored in the storage unit 134, the display control unit 1352 displays the parallax image group using a default display method (for example, the follow-up mode). Let The table shown in FIG. 15 is merely an example, and the embodiment is not limited to this. For example, it may be information in which each mode of “for one person”, “for two persons”, and “three or more persons” is associated with a person. Alternatively, a priority order is set between persons, and when two registered persons are identified as observers, the parallax image group is set to be displayed in a mode associated with a person with a higher priority order. It is also possible.

  As described above, the workstation 130 according to the first embodiment executes various modes of display processing according to the number of observers in the parallax image group. This mode can be set freely. For example, if the number of observers changes in the middle, it is possible to freely set whether to switch the mode or continue the mode currently being executed. Is possible. In addition, the information of the mode executed immediately before is stored, and when the same observer as the observer observed immediately before observes the image again, it may be set to display the image in the stored mode. Is possible. In addition, when a person different from the observer observed immediately before starts observation, the previous mode may be continuously executed or may be switched to another mode.

  Next, processing of the workstation 130 according to the first embodiment will be described with reference to FIG. FIG. 16 is a flowchart illustrating a processing procedure performed by the workstation 130 according to the first embodiment. As shown in FIG. 16, in the workstation 130 according to the first embodiment, if the display switching mode is ON (Yes at Step S101), whether or not the observer detection unit 1351 detects a plurality of observers. Is determined (step S102).

  Here, when a plurality of observers are detected (Yes at Step S102), the display control unit 1352 activates the same display mode (Step S103) and sets the viewing area so that the number of persons included in the viewing area is the largest. The parallax image is displayed by shifting (step S104). On the other hand, when a plurality of observers are not detected (No at Step S102), the display control unit 1352 determines whether or not the observer is registered in the table (Step S105).

  Here, when the observer is registered in the table (Yes at Step S105), the display control unit 1352 activates a mode associated with the observer (Step S106) and determines whether or not the follower mode is set. Is determined (step S108). On the other hand, if the observer is not registered in the table (No at Step S105), the display control unit 1352 activates the default mode (Step S107) and determines whether or not the follower mode is set (Step S108). ).

  Here, in the follow-up mode (Yes at Step S108), the display control unit 1352 shifts the viewing zone according to the position of the face of the observer (Step S109). On the other hand, when the follow mode is not set (No in step S108), the display control unit 1352 displays a parallax image group in which the viewpoint position is changed while shifting the viewing zone according to the position of the observer (step S110). ). Note that the workstation 130 according to the first embodiment is in a standby state until the display switching mode is turned on (No in step S101).

  As described above, according to the first embodiment, the display unit 132 displays the parallax image group to stereoscopically display the display object. And the observer detection part 1351 detects the observer of the display target object drawn by the display part 132. FIG. Then, the display control unit 1352 changes the display method of the parallax image group by the display unit 132 according to the number of observers detected by the observer detection unit 1351. Therefore, the workstation 130 according to the first embodiment can display an image corresponding to the number of observers.

  Further, according to the first embodiment, when one or more observers are detected by the observer detection unit 1351, the display control unit 1352 displays from the position of the observer detected by the observer detection unit 1351. The viewing zone is adjusted so that the object is stereoscopically viewed. Therefore, the workstation 130 according to the first embodiment makes it possible to observe the display object without worrying about the observation position.

  Further, according to the first embodiment, when one or more observers are detected by the observer detection unit 1351, the display control unit 1352 applies to the display object according to the position of the observer. The display unit 132 displays a parallax image group generated by changing the viewpoint. Therefore, the workstation 130 according to the first embodiment makes it possible to observe the entire display object without changing the display setting.

  Further, according to the first embodiment, the display control unit 1352, when a plurality of observers are detected by the observer detection unit 1351, the display target generated from the same viewpoint for the plurality of observers. An image of the object is displayed on the display unit 132. Therefore, the workstation 130 according to the first embodiment enables all observers to confirm the same at a conference or the like.

  Further, according to the first embodiment, the display control unit 1352 uses the display unit 132 to display the parallax image group when the observer detected by the observer detection unit 1351 is a specific person. changing the associated in advance with the display method to the specific person. Therefore, the workstation 130 according to the first embodiment makes it possible to display a parallax image group in a display method desired for each user without switching settings or the like.

(Second Embodiment)
Although the first embodiment has been described so far, the present invention may be implemented in various different forms other than the first embodiment described above.

  In the above-described embodiment, the case where the viewing zone is shifted by moving the pixel that outputs the parallax image has been described. However, the embodiment is not limited to this, and any method may be used as long as the viewing zone is shifted according to the movement of the observer. For example, the method shown in FIG. 17 may be used.

  FIG. 17 is a diagram for explaining an example of a viewing zone adjustment method by the display control unit 1352 according to the second embodiment. FIG. 17 shows the projection of a parallax image from nine columns of pixels provided on the display surface of the display unit 132 to the lenticular lens. For example, when the observer detection unit 1351 detects that the position of the observer has changed, the display control unit 1352 changes the projection direction of the parallax image projected from the nine columns of pixels with the arrow 303 or 304 in FIG. Shift in the direction shown in. Thereby, the projection direction of the image after passing through the lenticular lens is also shifted. That is, the viewing zone is shifted.

  In the above-described embodiment, the case where the parallax image generated by changing the viewpoint direction in stages is displayed as the wraparound mode in accordance with the movement of the observer. However, the embodiment is not limited to this. For example, a 9-parallax parallax image generated from the three directions of the front, right, and left sides of the display object may be displayed.

  For example, when the observer is positioned in front of the display unit 132, the display control unit 1352 causes the display unit 132 to display a 9-parallax image generated from the viewpoint direction in which the display object is in front. When the observer moves to the right side, the display control unit 1352 causes the display unit 132 to display a 9-parallax parallax image generated from the viewpoint direction in which the display target is the right side. Similarly, when the observer moves to the left side, the display control unit 1352 causes the display unit 132 to display a 9-parallax parallax image generated from the viewpoint direction in which the display target is the left side.

  In the above-described embodiment, the case where the viewing area is shifted so that the number of persons included in the viewing area is the largest and the parallax image group is displayed as the same display mode has been described. However, the embodiment is not limited to this. For example, when all the viewers are located in the current viewing zone, images of display objects generated from the same viewpoint for all the viewers are displayed. It may be displayed.

  For example, as illustrated in FIG. 13, when there are a plurality of observers, the display control unit 1352 displays images generated from the viewpoint direction in which the display object is in front in three directions where the observer is present. For example, the display control unit 1352 may include pixels in the first column to the third column, pixels in the fourth column to the sixth column, and pixels in the seventh column to the ninth column among the nine columns of pixels illustrated in FIG. Each pixel is caused to output a parallax image for three parallaxes generated from the viewpoint direction in which the display object is in front. Accordingly, the display unit 132 displays the same stereoscopic image on the front, right side, and left side.

  As the same image to be displayed, it is also possible to select an image currently observed by a person whose image is preferentially observed among a plurality of observers. In addition, when it is not necessary to display a stereoscopic image, the same image may be output to nine columns of pixels.

  In the above-described embodiment, when a specific person is associated with a mode and stored, and the observer detected by the observer detection unit 1351 is a specific person, the mode is associated with the specific person. The case where the parallax image group is displayed in the different modes has been described. However, the embodiment is not limited to this. For example, the display condition of the parallax image group may be set for each specific person.

  For example, the storage unit 134 further stores, for each specific person, display conditions of a parallax image group desired by the specific person. FIG. 18 is a diagram illustrating an example of information stored by the storage unit 134 according to the second embodiment. For example, as illustrated in FIG. 18, the storage unit 134 further stores additional conditions in association with a table in which persons and modes are associated with each other. Note that the additional conditions illustrated in FIG. 18 indicate display conditions desired by each specific person. For example, as illustrated in FIG. 18, the storage unit 134 stores “mode: wraparound” and “additional conditions” such as “enlargement” and “contrast: large” in association with “person: A”. .

  When the observer detected by the observer detection unit 1351 is a specific person included in the table stored in the storage unit 134, the display control unit 1352 displays a display associated with the specific person in advance. The parallax image group set as the condition is displayed on the display unit 132. For example, when the observer detected by the observer detection unit 1351 is “person: A”, the display control unit 1352 first refers to the table shown in FIG. 18 and changes the mode to “wraparound”. To do. Then, the display control unit 1352 executes an image enlargement process, and further causes the display unit 132 to display a parallax image group in which “contrast” is set to “large”.

  As described above, in the workstation 130 according to the second embodiment, the storage unit 134 further stores, for each specific person, display conditions of a parallax image group desired by the specific person. Then, the display control unit 1352 causes the display unit 132 to display a parallax image group set in display conditions associated in advance with a specific person. As a result, the workstation 130 according to the second embodiment makes it possible to display a parallax image group by a display method that takes into consideration finer conditions desired by the user.

  In the above-described embodiment, the case where the workstation 130 changes the display method according to the number of observers has been described. However, the disclosed technique is not limited to this, and for example, the medical image diagnostic apparatus 110 may change the display method according to the number of observers. Further, even when the medical image diagnostic apparatus 110 or the workstation 130 generates an image corresponding to the number of observers and stores it in the storage unit, and the terminal device 140 displays the image stored in the storage unit. Good.

  In the above-described embodiment, the case has been described in which the workstation 130 acquires volume data from the image storage device 120 and generates and displays an image corresponding to the viewpoint position of the observer from the volume data. However, the disclosed technique is not limited to this. For example, the workstation 130 acquires volume data from the medical image diagnostic apparatus 110 and generates an image according to the viewpoint position of the observer from the volume data. May be displayed.

  In the above-described embodiment, the case where the terminal device 140 acquires and displays an image from the image storage device 120 has been described. However, the disclosed technology is not limited to this, and for example, the terminal device 140 may acquire an image from the medical image diagnostic apparatus 110 and display the image.

  In the above-described embodiment, the case where the position of the observer is detected by face recognition has been described. However, the disclosed technique is not limited to this. For example, in addition to the face recognition of the observer, the detailed eye-gaze information of the observer can be acquired by detecting the position of the black eye of the eyeball. There may be.

  As described above, according to the embodiment, the image processing system, the image processing apparatus, the method, and the medical image diagnostic apparatus according to the present embodiment can display an image according to the number of observers.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 110 Medical diagnostic imaging apparatus 120 Image storage apparatus 130 Workstation 132 Display part 134 Storage part 135 Control part 137 Detection part 1351 Observer detection part 1352 Display control part 1371 Head tracking apparatus 140 Terminal apparatus

Claims (9)

Display means for stereoscopically displaying the display object by displaying the parallax image group;
Detecting means for detecting an observer of the display object drawn by the display means;
Display control means for changing a display method of the parallax image group by the display means according to the number of observers detected by the detection means;
An image processing system comprising:   The display control means adjusts the viewing zone so that the display object is stereoscopically viewed from the position of the observer detected by the detection means when one or more observers are detected by the detection means. The image processing system according to claim 1.   The display control means, when one or more observers are detected by the detection means, a parallax image group generated by changing the viewpoint with respect to the display object according to the position of the observer. The image processing system according to claim 1, wherein the image processing system is displayed by display means.   The display control means, when a plurality of observers are detected by the detecting means, causes the plurality of observers to display the same image on the display means. The image processing system according to any one of the above. Storage means for storing personal information in which a display method is associated with each specific person;
The display control means, when the observer detected by the detection means is a specific person included in the person information stored in the storage means, the display method of the parallax image group by the display means, The image processing system according to claim 1, wherein the display method is changed to a display method associated with the specific person in advance. The storage means further stores a display condition of a parallax image group desired by the specific person as the person information,
The display control means, when the observer detected by the detection means is a specific person included in the personal information stored in the storage means, display conditions associated in advance with the specific person The image processing system according to claim 5, wherein the display unit displays the parallax image group set in (1). Display means for stereoscopically displaying the display object by displaying the parallax image group;
Detecting means for detecting an observer of the display object drawn by the display means;
Display control means for changing a display method of the parallax image group by the display means according to the number of observers detected by the detection means;
An image processing apparatus comprising: A display step of stereoscopically displaying the display object by displaying the parallax image group;
A detection step of detecting an observer of the display object drawn by the display step;
A display control step of changing a display method of the parallax image group by the display step according to the number of observers detected by the detection step;
An image processing method comprising: Display means for stereoscopically displaying the display object by displaying the parallax image group;
Detecting means for detecting an observer of the display object drawn by the display means;
Display control means for changing a display method of the parallax image group by the display means according to the number of observers detected by the detection means;
A medical image diagnostic apparatus comprising:

Images