JP2012238289A - Three-dimensional image processing device and three-dimensional image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a three dimensional image processing device capable of displaying an auxiliary image without interfering with a stereoscopic image corresponding to volume data and easily accepting an operation for the stereoscopic image through the auxiliary image.SOLUTION: A three dimensional image processing device comprises: a multi-viewpoint rendering image generation part 32 that generates a multi-viewpoint rendering image having a plurality of viewpoints by performing volume rendering from a plurality of viewpoints on the basis of volume data; an auxiliary image generation part 33 that generates auxiliary images such as soft key images and images showing incidental information; a multi-viewpoint image generation part 34 that generates a plurality of viewpoint images including a viewpoint image where a viewpoint rendering image is overlapped with an auxiliary image in such a manner that the auxiliary image is positioned at a predetermined position except in front of a three dimensional area surrounding a stereoscopic image corresponding to the volume data; and a multi-viewpoint image output part 35 that outputs the plurality of viewpoint images to a naked eye three dimensional display device 22 that projects each of the plurality of viewpoint images as a parallax component image.

Description

  Embodiments described herein relate generally to a three-dimensional image processing apparatus and a three-dimensional image processing program.

  Projections obtained by imaging a subject (patient) are used in medical image diagnostic apparatuses (modalities) such as X-ray CT (Computed Tomography) apparatuses, MRI (Magnetic Resonance Imaging) apparatuses, ultrasonic diagnostic apparatuses, and X-ray diagnostic apparatuses. Some can generate volume data (three-dimensional image data) based on the data.

  The volume data can be used to generate a two-dimensional image (hereinafter referred to as a VR image) by volume rendering. This VR image is displayed on the display device and presented to the user.

  In general, a VR image is often displayed on the screen of a display device together with an auxiliary image such as a soft key to which various operation functions are assigned and an image showing supplementary information of the VR image. In this case, the user can easily change the VR image rendering method by, for example, pressing a soft key to which a function for changing the rendering method is assigned.

JP 2011-36496 A

  However, if the VR image and the auxiliary image are simultaneously displayed on a general two-dimensional screen, the display area allocated to the VR image is narrowed by the amount of the auxiliary image. For this reason, a VR image having high importance for the user is displayed in a small size, while soft keys that are less frequently used continue to be displayed on the screen, which is very inconvenient.

  In order to solve the above-described problem, a three-dimensional image processing apparatus according to an embodiment of the present invention performs multi-viewpoint rendering by generating a plurality of viewpoint rendering images by performing volume rendering from a plurality of viewpoints based on volume data. A rendering image generation unit, an image of soft keys, an auxiliary image generation unit for generating auxiliary images and other auxiliary images, and a peripheral image except for the front surface of the three-dimensional region surrounding the stereoscopic image corresponding to the volume data. A multi-view image generation unit that generates a plurality of viewpoint images including a viewpoint image obtained by superimposing a viewpoint rendering image and an auxiliary image so as to be arranged at a predetermined position, and each of the multi-view images as a parallax component image in different directions A multi-viewpoint image output unit that outputs a plurality of viewpoint images is provided on the naked-eye 3D display device to be ejected.

1 is a block diagram showing a configuration example of a medical image processing apparatus according to a first embodiment of the present invention. The schematic block diagram which shows the structural example of the function implementation part by CPU of a control part. The perspective view which shows one structural example of a naked-eye 3D display. Explanatory drawing which shows an example of a mode that the parallax component image which has a different parallax number by a naked-eye 3D display is inject | emitted in a mutually different direction. Explanatory drawing which shows an example of the positional relationship of a naked-eye 3D display and a viewing zone. The block diagram which shows an example of an internal structure of a naked-eye 3D display. Explanatory drawing which shows the example of the auxiliary image element which comprises an auxiliary image. Explanatory drawing which shows an example of a mode when an auxiliary | assistant image is displayed on the side surface of the rectangular parallelepiped area | region which encloses the stereo image corresponding to volume data. 3 is a flowchart showing a procedure when an operation for an auxiliary image displayed on a side surface of a rectangular parallelepiped region surrounding a stereoscopic image corresponding to volume data is accepted by the control unit of the medical image processing apparatus shown in FIG. 1. Explanatory drawing which shows an example of the coordinate of the front and side surface of a rectangular parallelepiped area | region among the three-dimensional coordinates managed by the pointer management part. FIG. 11 is a subroutine flowchart showing a procedure when a function corresponding to an input to a thumbnail image group is executed by the control unit in step S3 of FIG. Explanatory drawing which shows a mode that the pointer was piled up (hovered) on one of the thumbnail images of the thumbnail image group displayed on the side area of the left oblique recognition image. (A) is explanatory drawing which shows an example of a mode that the three-dimensional image corresponding to the thumbnail image selected via the pointer in the example shown in FIG. 12 is displayed on the left oblique recognition image, (b) corresponds to the thumbnail image. Explanatory drawing which shows an example of a mode that a three-dimensional image is displayed on a front vicinity recognition image. FIG. 11 is a subroutine flowchart illustrating a procedure when a function corresponding to a rendering mode change instruction received via an operation panel is executed by the control unit in step S3 of FIG. Explanatory drawing which shows the modification of a left oblique recognition image and a right oblique recognition image. Explanatory drawing which shows an example of a mode when an auxiliary | assistant image is displayed behind the three-dimensional image corresponding to volume data. Explanatory drawing which shows an example of a mode that an auxiliary | assistant image and a three-dimensional image are displayed in the division area of one screen according to a predetermined | prescribed screen layout.

  Embodiments of a 3D image processing apparatus and a 3D image processing program according to the present invention will be described with reference to the accompanying drawings.

  If the VR image and the auxiliary image are displayed simultaneously on a general two-dimensional screen, the display area allocated to the VR image is reduced by the amount of the auxiliary image. A three-dimensional image processing apparatus according to an embodiment of the present invention can use a side surface and a back side of a three-dimensional region surrounding a stereoscopic image corresponding to volume data by using a naked-eye 3D display. By providing an image, it is possible to display an auxiliary image so as not to interfere with the stereoscopic image corresponding to the volume data, and to provide a technique that can easily accept an operation on the stereoscopic image via the auxiliary image It is.

(First embodiment)
FIG. 1 is a block diagram showing a configuration example of a medical image processing apparatus 10 according to the first embodiment of the present invention. In this embodiment, an image of a soft key, an image indicating supplementary information, and other auxiliary images are pasted and arranged on part or all of the upper, lower, left, and right side surfaces of the rectangular parallelepiped region surrounding the stereoscopic image corresponding to the volume data. An example of the case will be described.

  A medical image processing apparatus 10 as a three-dimensional image processing apparatus includes an input unit 11, a storage unit 12, a network connection unit 13, and a control unit 14, as shown in FIG.

  The input unit 11 includes at least a pointing device and is configured by a general input device such as a mouse, a trackball, a keyboard, a touch panel, and a numeric keypad, and outputs an operation input signal corresponding to the operation of the user U to the control unit 14. .

  The storage unit 12 stores medical volume data (three-dimensional image data) output from the modality 20. The modality 20 is a medical image diagnostic apparatus such as an X-ray CT (Computed Tomography) apparatus, an MRI (Magnetic Resonance Imaging) apparatus, an ultrasonic diagnostic apparatus, or an X-ray diagnostic apparatus, and is obtained by imaging a subject (patient). It can be constituted by a device capable of generating volume data (three-dimensional image data) based on the projection data obtained.

  The network connection unit 13 implements various information communication protocols according to the form of the network 21. The network connection unit 13 connects the medical image processing apparatus 10 and another apparatus such as the modality 20 according to these various protocols. Here, the network 21 means an entire information communication network using telecommunications technology. In addition to a wireless / wired LAN such as a hospital basic LAN (Local Area Network), an Internet network, a telephone communication line network, an optical fiber communication network. Cable communication networks and satellite communication networks.

  The medical image processing apparatus 10 may receive volume data from the modality 20 connected via the network 21. Volume data received via the network 21 is also stored in the storage unit 12.

  The control unit 14 includes a storage medium such as a CPU, a RAM, and a ROM, and controls the processing operation of the medical image processing apparatus 10 according to a program stored in the storage medium. Specifically, the CPU of the control unit 14 loads a three-dimensional image processing program stored in a storage medium such as a ROM and data necessary for executing the program into the RAM, and in accordance with the program, the volume A process of enabling an operation on the stereoscopic image via the auxiliary image is performed while displaying the auxiliary image so as not to disturb the stereoscopic image corresponding to the data.

  The RAM of the control unit 14 provides a work area for temporarily storing programs and data executed by the CPU. The storage medium such as the ROM of the control unit 14 stores a startup program for the medical image processing apparatus 10, a three-dimensional image processing program, and various data necessary for executing these programs.

  A storage medium such as a ROM has a configuration including a recording medium readable by a CPU, such as a magnetic or optical recording medium or a semiconductor memory, and a part of programs and data in the storage medium. Alternatively, all may be configured to be downloaded via the network 21.

  The control unit 14 generates VR images and auxiliary images (a plurality of viewpoint images and a multi-viewpoint image) viewed from a plurality of viewpoints, and outputs them to the naked-eye 3D display 22. The control unit 14 may be configured to acquire information indicating the position of the user U who views the naked-eye 3D display 22 (hereinafter referred to as user position information) from the position sensor 23. If the control unit 14 does not use user position information, the position sensor 23 is not necessary.

  FIG. 2 is a schematic block diagram illustrating a configuration example of the function realization unit by the CPU of the control unit 14. In addition, this function realization part may be comprised by hardware logics, such as a circuit, without using CPU.

  As shown in FIG. 2, the CPU of the control unit 14 uses an input reception unit 31 including a pointer management unit 31a, a multi-viewpoint rendering image generation unit 32, an auxiliary image generation unit 33, and a multi-viewpoint image generation by a three-dimensional image processing program. Functions as a unit 34, a multi-viewpoint image output unit 35, and a user position information acquisition unit 36. Each of the units 31 to 36 uses a required work area of the RAM as a temporary storage location for data.

  The input receiving unit 31 receives an instruction from the user U via the input unit 11 based on the output of the input unit 11. The pointer management unit 31a acquires the three-dimensional coordinates of the pointer displayed on the naked-eye 3D display 22 based on the output of the input unit 11, and receives an input to the auxiliary image via the pointer. Note that the three-dimensional coordinates of the pointer are unique regardless of the viewpoint of the user U.

  The multi-viewpoint rendering image generation unit 32 performs volume rendering at a plurality of viewpoints based on the volume data stored in the storage unit 12, thereby generating VR images for each viewpoint (viewpoint rendering images; hereinafter referred to as viewpoint VR images). Generate. In the following description, a VR image having a viewpoint near the front of the naked-eye 3D display 22 as a rendering viewpoint is referred to as a front vicinity viewpoint VR image, and a VR image having a left oblique (right oblique) viewpoint as a rendering viewpoint is a left perspective point VR. This is called an image (right perspective point VR image).

  The auxiliary image generation unit 33 generates a soft key image, an image indicating supplementary information, and other auxiliary images.

  The multi-viewpoint image generation unit 34 generates the viewpoint generated by the multi-viewpoint rendering image generation unit 32 so that the auxiliary image is arranged at a predetermined position around the front surface of the three-dimensional area surrounding the stereoscopic image corresponding to the volume data. Generating a plurality of viewpoint images (multi-viewpoint images) including a viewpoint image in which the VR image and the auxiliary image generated by the auxiliary image generation unit 33 are superimposed, and a viewpoint image including only the viewpoint VR image without being superimposed. To do. The auxiliary image can be displayed so as not to disturb the stereoscopic image corresponding to the volume data by being arranged at a predetermined position around the three-dimensional region surrounding the stereoscopic image corresponding to the volume data, excluding the front surface. it can.

  In the present embodiment, the multi-viewpoint image generation unit 34 arranges the multi-viewpoint rendering image so that the auxiliary image is pasted and disposed on a part or all of the upper, lower, left and right side surfaces of the rectangular parallelepiped region surrounding the stereoscopic image corresponding to the volume data. A plurality of viewpoint images (multi-viewpoint images) including a viewpoint image obtained by superimposing the viewpoint VR image generated by the generation unit 32 and the auxiliary image generated by the auxiliary image generation unit 33 are generated.

  When the auxiliary image is disposed on the side surface, the auxiliary image cannot be seen at all from the viewpoint near the front, or only the width in the thickness direction of the auxiliary image can be seen. For this reason, it is difficult for the user U to visually recognize the auxiliary image even if the auxiliary image is superimposed on the front vicinity viewpoint VR image (the viewpoint VR image volume-rendered at the rendering viewpoint near the front). Therefore, in the following description, the multi-viewpoint image is composed of one or more front-viewpoint viewpoint images that are composed of only the front-viewpoint viewpoint VR image with no auxiliary image superimposed thereon, and a perspective point VR image (left perspective point VR image or right perspective point VR). An example in the case of an image) and a perspective image in which an auxiliary image is superimposed will be described.

  When the perspective image is generated by superimposing the squint point VR image and the auxiliary image, the multi-viewpoint image generation unit 34 sets the transparency of the auxiliary image and displays it as a semi-transparent display so that it is hidden behind the auxiliary image. The squint point VR image may be visible through the auxiliary image. This transparency may be set in advance using a set value stored in the storage unit 12 or may be set by the user U via the input unit 11.

  Note that the near-front viewpoint VR image corresponds to an image when a stereoscopic image corresponding to volume data is captured by a camera provided near the front of the naked-eye 3D display 22, and the perspective point VR image is left and right from the vicinity of the front. This corresponds to an image when a stereoscopic image is captured by a camera provided at a position shifted to. Further, at least two images for both eyes need to be generated in order to make the user stereoscopically view the front vicinity viewpoint image and the perspective point image. Also good. For example, when it is desired to stereoscopically view the frontal near viewpoint image on which only the frontal near viewpoint VR image is displayed while the perspective point image on which the auxiliary image is superimposed does not need to be stereoscopically viewed, the control unit 14 While a plurality of images are generated, only one perspective point image may be generated.

  The multi-viewpoint image output unit 35 generates a multi-viewpoint image generated by the multi-viewpoint image generation unit 34 for the naked-eye 3D display 22 that emits each of a plurality of viewpoint images constituting the multi-viewpoint image as a parallax component image in different directions. Is output.

  The user position information acquisition unit 36 acquires user position information based on the output of the position sensor 23 and provides the user position information to the input reception unit 31.

  Here, the configuration and operation of the naked-eye 3D display 22 will be described with reference to FIGS.

  FIG. 3 is a perspective view showing a configuration example of the naked-eye 3D display 22.

  As shown in FIG. 3, the naked-eye 3D display 22 includes an image display unit 41 and a light beam control element 42 arranged with a predetermined gap in front of the image display unit 41.

  The image display unit 41 is configured by a display output device such as a liquid crystal display or an OLED (Organic Light Emitting Diode) display. For example, when nine types of parallax component images are handled, each pixel of the image display unit 41 includes nine picture elements, and an element image is displayed for each pixel. In addition, among the light beams output from the pixels, the light beams corresponding to the parallax component images having the same parallax number are emitted in parallel from the plurality of pixels.

  The light beam control element 42 includes a plurality of exit pupils 43. In the two-dimensional II (integral imaging) system, as the light beam control element 42, a lens array in which segment lenses as the exit pupil 43 are arranged in a matrix or a pin hole as the exit pupil 43 in an array form. An array of pinhole arrays can be used. Further, in the one-dimensional II system, the light beam control element 42 is a lenticular sheet made up of cylindrical lenses that are extended in the vertical direction and arranged in the horizontal direction, and is extended in the vertical direction and arranged in the horizontal direction. It is comprised by the slit plate which has the slit made. Regardless of which lens array, lenticular sheet, or slit plate is used as the light beam control element 42, each lens or slit optically functions as the exit pupil 43 of the optical aperture.

  FIG. 4 is an explanatory diagram illustrating an example of a state in which parallax component images are emitted in different directions by the naked-eye 3D display 22. FIG. 4 shows an example in which a parallax component image is specified by parallax numbers (−4, −3,..., 0,..., 4) indicating nine parallax directions corresponding to nine shooting numbers. showed that. In the following description, the one-dimensional II method will be described in order to simplify the description. In the one-dimensional II method, parallax component images are distributed to pixels along the horizontal direction, but in the two-dimensional II method, a parallax component image is also displayed in the vertical direction in the same manner as the method for assigning parallax component images in the horizontal direction. Assign it.

  On the display surface of the image display unit 41, the pixels 44 are arranged in a matrix at substantially constant horizontal and vertical pitches. Each pixel 44 includes a predetermined number of picture elements arranged in the horizontal direction. FIG. 4 shows an example in which the pixel 44 is composed of nine picture elements. Each picture element is composed of R, G, and B subpixels arranged in the vertical direction. A high-definition liquid crystal panel module is configured by arranging corresponding vertical stripe color filters on the RGB sub-pixels. In this panel module, an element image composed of parallax component images is displayed and a stereoscopic image is displayed. Each parallax component image is configured by each viewpoint image of the multi-viewpoint image output from the multi-viewpoint image output unit 35.

  The nine types of parallax component images are displayed on each of the nine picture elements constituting the pixel 44. The exit pupil 43 is arranged corresponding to each of the pixels 44. Light rays emitted from each picture element pass through the exit pupil 43 and project a parallax component image 46 from the exit pupil 43 onto the viewing zone plane 45 located at the viewing distance L. At this time, among the light beams output from the pixels 44, the light beams corresponding to the parallax component images having the same parallax number are emitted in parallel from the plurality of pixels 44.

  Element images as a set of nine types of parallax component images are displayed on the pixels 44 corresponding to the exit pupils 43, and light rays from the element images are controlled or regulated by the exit pupils 43 and directed to the user U. Then, when the parallax component image is sent with the light beam directed in the direction in which the user U is located, the user U can recognize the stereoscopic image as a set of the parallax component images. That is, according to the naked-eye 3D display 22, assuming that the position of the user U is in the vicinity of the position in the viewing zone plane, the user U can move the front of the image display unit 41 based on the light rays from the element image. ) And the back (in the depth direction), a stereoscopic image can be observed.

  FIG. 5 is an explanatory diagram showing an example of the positional relationship between the naked-eye 3D display 22 and the viewing zone 47. Here, the viewing area refers to a range in which the user U can observe the parallax component image through the exit pupil 43.

  When the user U moves left and right, the picture element (RGB subpixel) observed through the exit pupil 43 changes. In the one-dimensional II system, rays corresponding to parallax component images having the same parallax number are emitted from the exit pupil 43 in parallel with each other. For this reason, when the user U observes through perspective projection, the position of each sub-pixel seen through the exit pupil 43 differs by the width of the exit pupil 43 (for example, by the lens pitch of the lenticular sheet). In addition, in order to maximize the width of the viewing zone 47, the positional relationship between the exit pupil 43 and the pixel 44 may be different for each exit pupil 43.

  In the II system, element images corresponding to the respective exit pupils 43 are determined in a horizontal plane, and light rays that are parallel to each other are emitted from the exit pupil 43 toward the viewing zone 47, so that a stereoscopic image is displayed in the viewing zone. Formed.

  When the number of parallax component images is sufficiently large, two or more areas where parallax component images having different parallax numbers should be originally displayed, for example, parallax component images having different parallax numbers should be originally displayed 3 The same parallax component image may be displayed in one area.

  FIG. 6 is a block diagram illustrating an example of the internal configuration of the naked-eye 3D display 22.

  The naked-eye 3D display 22 further includes a multi-viewpoint image acquisition unit 48 and an element image generation unit 49.

  The multi-view image acquisition unit 48 acquires a multi-view image from the multi-view image output unit 35. The element image generation unit 49 converts this multi-viewpoint image into an element image. That is, the element image generation unit 49 treats each viewpoint image as a parallax component image by associating each viewpoint image of the multi-viewpoint image with a parallax number, and collects the parallax component images to generate an element image.

  The element image generated by the element image generation unit 49 is displayed on each pixel 44 of the image display unit 41, and the element image is projected onto the viewing area 47 through the exit pupil 43, so that a stereoscopic image is displayed in the viewing area 47. Observed by user U inside.

  Note that the multi-viewpoint image acquisition unit 48 and the element image generation unit 49 may be a function realization unit that is realized by a predetermined program being executed by the CPU, or by hardware logic such as a circuit without using the CPU. It may be configured. Each function may be realized by appropriately combining software and hardware.

  1 shows an example in which the naked-eye 3D display 22 is provided outside the configuration of the medical image processing apparatus 10, the naked-eye 3D display 22 may be a constituent element of the medical image processing apparatus 10. Further, the medical image processing apparatus 10 may be incorporated in the modality 20.

  Next, the auxiliary image will be briefly described.

  FIG. 7 is an explanatory diagram illustrating an example of auxiliary image elements constituting the auxiliary image 50.

  The auxiliary image 50 includes a toolbar 51 composed of a plurality of soft keys to which various functions are assigned, a thumbnail image group 52 composed of a plurality of thumbnail images 52a, an accompanying information display image 53, a simple operation panel 54, and an operation panel 55. , And a list 56 of patients, series and images, and auxiliary image elements such as an image 57 different from the near-front viewpoint VR image. Examples of the image 57 that is different from the front vicinity viewpoint VR image include a VR image that is volume-rendered in a rendering mode different from the front vicinity viewpoint VR image, and an image that has different volume data from the front vicinity viewpoint VR image. it can.

  The auxiliary image generation unit 33 generates an auxiliary image 50 composed of one or more of these auxiliary image elements. Then, the multi-viewpoint image generation unit 34 is arranged so that the auxiliary image elements of the auxiliary image 50 are arranged and pasted on at least one of the upper, lower, left, and right sides of the rectangular parallelepiped region surrounding the stereoscopic image corresponding to the volume data. A multi-viewpoint image including a plurality of viewpoint images in which the viewpoint VR image generated by the rendering image generation unit 32 and the auxiliary image 50 generated by the auxiliary image generation unit 33 are superimposed is generated. The image file that is the basis of each auxiliary image element may be stored in the storage unit 12 in advance, or may be acquired as appropriate via the network 21.

  FIG. 8 is an explanatory diagram illustrating an example of a state when the auxiliary image 50 is displayed on the side surface of the rectangular parallelepiped region 61 that surrounds the stereoscopic image 60 corresponding to the volume data.

  When the naked-eye 3D display 22 displays an element image based on the multi-view image output by the multi-view image output unit 35, each of a plurality of viewpoint images constituting the multi-view image is emitted in different directions as a parallax component image. The For this reason, the parallax component image observed by the user U differs depending on the left and right positions of the user U (see FIG. 4).

  For example, the viewpoint when viewing the naked-eye 3D display 22 from the front vicinity is set to the front vicinity viewpoints A1, A2,..., An, and the viewpoints when viewed from the position shifted to the left from the front vicinity are the left perspective points B1, B2,. .., Bn, and the viewpoint when viewed from a position shifted to the right from the vicinity of the front is assumed to be the right perspective points C1, C2,..., Cn (where n is a positive integer).

  In this case, for example, the user U is positioned in the vicinity of the front, the left eye is positioned in the front vicinity viewpoint A1, the right eye is positioned in the front vicinity viewpoint A2, and the front vicinity viewpoint images different from each other with respect to the front vicinity viewpoints A1 and A2. If the light beam of the parallax component image based on this is emitted, the user U can recognize the front vicinity viewpoint image as a three-dimensional image (hereinafter referred to as a front vicinity recognition image).

  Further, when the user U views from the left perspective points B1 and B2, the user U views the viewpoint VR image (left perspective point VR image) rendered at the viewpoints of the left perspective points B1 and B2 or the vicinity thereof among the perspective point images. Can be recognized as a three-dimensional image (hereinafter referred to as a left oblique recognition image). Similarly, when the user U views from the right perspective points C1 and C2, the user U renders the VR image (right perspective point VR image) rendered at the left perspective points C1 and C2 of the perspective point images or viewpoints in the vicinity thereof. Can be recognized as a three-dimensional image (hereinafter referred to as a right oblique recognition image). In addition, if it is a two-dimensional II system, an upper-slope recognition image and a lower-slope recognition image can be perceivable to a user similarly.

  The left oblique recognition image and the right oblique recognition image have a front area 62 in which the stereoscopic image 60 corresponding to the volume data mainly exists and a side area 63 in which the auxiliary image 50 mainly exists. In FIG. 8, the auxiliary image 50 configured only by the thumbnail image group 52 is displayed in the side region 63 of the left oblique recognition image, and the auxiliary image 50 configured only by the operation panel 55 in the side region 63 of the right oblique recognition image. An example in which is displayed is shown. In FIG. 8, the boundary line 64 between the front area 62 and the side area 63 is shown by a one-point difference line, but the boundary line 64 may not be displayed in each oblique recognition image.

  As shown in FIG. 8, the side area 63 is not included in the front vicinity recognition image. For this reason, the auxiliary image 50 is not displayed. For this reason, all the display areas of the front vicinity recognition image can be used to display the stereoscopic image 60, and the auxiliary image 50 does not erode the display image of the stereoscopic image 60. Therefore, when the user U wants to observe the stereoscopic image 60 firmly, the user U may be positioned near the front of the naked-eye 3D display 22. By being positioned in the vicinity of the front, the stereoscopic image 60 that does not include the auxiliary image 50 can be recognized.

  Further, the user U can recognize the left oblique recognition image (or right oblique recognition image) including the side region 63 on which the auxiliary image 50 is displayed by shifting the position to the left (or right). Therefore, when the user U wants to use various functions assigned to the auxiliary image 50, the user U may shift his / her position to the left or right. The auxiliary image 50 can be visually recognized and various operations can be performed on the auxiliary image 50 by positioning itself at a location shifted left and right from the vicinity of the front.

  Next, an example of the operation of the medical image processing apparatus 10 according to the present embodiment will be described.

  FIG. 9 shows a procedure when the control unit 14 of the medical image processing apparatus 10 shown in FIG. 1 accepts an operation on the auxiliary image 50 displayed on the side of the rectangular parallelepiped region 61 surrounding the stereoscopic image 60 corresponding to the volume data. It is a flowchart to show. In FIG. 9, the code | symbol which attached | subjected the number to S shows each step of a flowchart.

  The procedure shown in FIG. 9 starts when the naked-eye 3D display 22 displays an element image based on the multi-view image output by the multi-view image output unit 35.

  Moreover, FIG. 10 is explanatory drawing which shows an example of the coordinate of the front and side surface of the rectangular parallelepiped area | region 61 among the three-dimensional coordinates managed by the pointer management part 31a. In FIG. 10, the XYZ axis is defined with the lower left front of the rectangular parallelepiped region 61 as the coordinate origin, the right side in the horizontal direction from the origin as the X axis positive direction, the upper vertical direction as the Y axis positive direction, and the near side as the Z axis positive direction. An example of the case is shown. FIG. 10 shows an example of vertex coordinates of each surface together with a development view 65 of the rectangular parallelepiped region 61.

  First, in step S <b> 1, the pointer management unit 31 a acquires the three-dimensional coordinates of the pointer 70 displayed on the naked-eye 3D display 22 based on the output of the input unit 11, and accepts input to the auxiliary image of the auxiliary image 50.

  Next, the pointer management unit 31a determines whether the pointer 70 is on the side surface based on the three-dimensional coordinates of the pointer 70 (step S2). For example, when the user U moves to the right and is positioned at the viewpoints C1 and C2, the user U can visually recognize both the front area 62 and the side area 63 (see FIG. 8). At this time, for example, the user U may operate the pointer 70 in the front area 62 and desire to input the auxiliary image 50 in the side area 63 across the boundary line 64 (see FIG. 10).

  When the pointer 70 is not on the side surface (NO in step S2), the series of procedures ends. On the other hand, when it is on the side surface (YES in step S2), the pointer management unit 31a receives an input to the auxiliary image 50. And the control part 14 performs the function corresponding to the received input (step S3).

  Through the above procedure, an operation for the auxiliary image 50 displayed on the side surface of the rectangular parallelepiped region 61 surrounding the stereoscopic image 60 corresponding to the volume data can be received.

  Next, as shown in FIG. 8, an example in which the auxiliary image 50 configured by the thumbnail image group 52 is displayed in the side region 63 of the left oblique recognition image and the user U inputs the thumbnail image group 52 will be described. This will be described in detail.

  FIG. 11 is a subroutine flowchart showing a procedure when a function corresponding to an input to the thumbnail image group 52 is executed by the control unit 14 in step S3 of FIG. In FIG. 11, reference numerals with numbers added to S indicate the steps in the flowchart.

  FIG. 12 is an explanatory view showing a state in which the pointer 70 is overlaid (hovered) on one of the thumbnail images 52a of the thumbnail image group 52 displayed in the side region 63 of the left oblique recognition image. FIG. 13A is an explanatory diagram showing an example of a state in which the stereoscopic image 60a corresponding to the thumbnail image 52a selected via the pointer 70 in the example shown in FIG. 12 is displayed on the left oblique recognition image. (B) is explanatory drawing which shows an example of a mode that the three-dimensional image 60a corresponding to the thumbnail image 52a is displayed on a front vicinity recognition image.

  In FIGS. 12 and 13, the three-dimensional image 60 that is displayed in advance in the front vicinity recognition image is shown as a rectangular cone, and the selected thumbnail image 52 a (the pointer 70 is hovered) is shown as a rectangular parallelepiped.

  If it is determined that the pointer 70 is on the side surface (YES in step S2 in FIG. 9), the input receiving unit 31 operates one of the thumbnail images 52a of the thumbnail image group 52 by operating the pointer 70 or the like via the input unit 11. It is determined whether or not it has been selected (step S31).

  As an operation for this “selection”, a so-called hover operation for placing the pointer 70 on the thumbnail image 52a, an operation for clicking one of the thumbnail images 52a with the pointer 70, or a keyboard of the input unit 11 is used. One or more of various operations such as an operation of pressing a predetermined key can be assigned in advance. For example, when the hover operation is assigned as an operation for selection, the pointer management unit 31a determines whether or not the pointer 70 is hovered on one of the thumbnail images 52a in step S31.

  If selection for one of the thumbnail images 52a has not been made (NO in step S31), the process returns to step S2 in FIG. On the other hand, when one of the thumbnail images 52a is selected (YES in step S31), the multi-viewpoint rendering image generation unit 32 displays the stereoscopic image 60a corresponding to the selected thumbnail image 52a at the viewpoints A1 to An near the front. A plurality of front vicinity viewpoint VR images corresponding to the selected thumbnail image 52a are generated so as to enable stereoscopic viewing (step S32). At this time, the multi-viewpoint rendering image generation unit 32 may further generate a perspective point VR image corresponding to the selected thumbnail image 52a.

  Next, the multi-viewpoint image generation unit 34 is selected so that the stereoscopic image 60a corresponding to the selected thumbnail image 52a can be stereoscopically viewed from the viewpoints A1 to An near the front (see FIG. 13B). A plurality of front vicinity viewpoint images consisting only of the front vicinity viewpoint VR image corresponding to the thumbnail image 52a are generated (step S33). At this time, if a perspective point VR image corresponding to the thumbnail image 52a selected by the multi-viewpoint rendering image generating unit 32 has been generated, the multi-viewpoint image generation unit 34 generates an auxiliary image for the perspective-point VR image. A perspective point image may be further generated by superimposing (see FIG. 13A). When the squint point VR image is not generated, the multi-viewpoint image generation unit 34 may generate a squint point image including only the auxiliary image.

  Then, the multi-viewpoint image output unit 35 outputs a multi-viewpoint image composed of the near-front viewpoint image and the perspective point image to the naked-eye 3D display 22 (step S34).

  When one of the thumbnail image groups 52 is selected by the above procedure, a near-front viewpoint image of the selected thumbnail image 52a can be generated and output to the naked-eye 3D display.

  Next, as shown in FIG. 8, the auxiliary image 50 configured by the operation panel 55 is displayed in the side region 63 of the right oblique recognition image, and an example in which input to the operation panel 55 is performed by the user U will be described in more detail. explain.

  FIG. 14 is a subroutine flowchart showing a procedure when a function corresponding to a rendering mode change instruction received via the operation panel 55 is executed by the control unit 14 in step S3 of FIG. In FIG. 14, reference numerals with numbers added to S indicate steps of the flowchart.

  If it is determined that the pointer 70 is on the side surface (YES in step S2 in FIG. 9), the input reception unit 31 instructs the rendering ring mode to be changed via the operation panel 55 by operating the pointer 70 or the like via the input unit 11. Is received (step S321).

  As an operation for this “change instruction”, a so-called hover operation for placing the pointer 70 on the image of the soft key on the operation panel 55 to which the rendering mode change instruction function is assigned, a click operation, and the input unit 11 are configured. Various operations such as an operation of pressing a predetermined key of the keyboard to be performed may be assigned in advance. For example, when a click operation is assigned as an operation for a change instruction, the pointer management unit 31a of the input reception unit 31 clicks a soft key on the operation panel 55 to which a rendering mode change instruction function is assigned in step S321. It is determined whether or not it has been done.

  If there is no instruction to change the rendering mode (NO in step S321), the process returns to step S2 in FIG. On the other hand, when a rendering mode change instruction is received (YES in step S321), the multi-viewpoint rendering image generation unit 32 performs volume rendering in the rendering mode after the change at least from the viewpoints A1 to An near the front based on the volume data. A new front vicinity viewpoint VR image is generated (step S322). At this time, the multi-viewpoint rendered image generation unit 32 may further generate a perspective point VR image based on the volume data according to the changed rendering mode.

  Next, the multi-viewpoint image generation unit 34 newly generates the front vicinity viewpoint VR image so that the stereoscopic image corresponding to the volume data in the rendering mode after the change can be stereoscopically viewed from the viewpoints A1 to An near the front. A plurality of near-front-view images consisting only of the image are generated (step S323). At this time, if the perspective image VR image based on the volume data is generated in the rendering mode after the change by the multi-viewpoint rendering image generation unit 32, the multi-viewpoint image generation unit 34 performs an auxiliary image on the perspective-point VR image. May be superimposed to further generate a perspective point image. When the squint point VR image is not generated, the multi-viewpoint image generation unit 34 may generate a squint point image including only the auxiliary image.

  Then, the multi-viewpoint image output unit 35 outputs a multi-viewpoint image composed of the near-front viewpoint image and the perspective point image to the naked-eye 3D display 22 (step S34).

  When an instruction to change the rendering mode is received through the operation panel 55 by the above procedure, a front view viewpoint image in which volume data is volume-rendered in the changed rendering mode can be generated and output to the naked-eye 3D display. .

  The medical image processing apparatus 10 according to the present embodiment uses the autostereoscopic 3D display 22 to freely position the auxiliary image 50 in the three-dimensional space with respect to the display area of the stereoscopic image 60 corresponding to the volume data. Can be arranged. Further, when the auxiliary image 50 is arranged on the side surface of the rectangular parallelepiped region 61 surrounding the stereoscopic image 60 corresponding to the volume data as shown in the present embodiment, as shown in FIG. Is not included. For this reason, all the display areas of the front vicinity recognition image can be used to display the stereoscopic image 60, and the auxiliary image 50 does not erode the display image of the stereoscopic image 60. Therefore, when the user U wants to observe the stereoscopic image 60 firmly, the user U can recognize the stereoscopic image 60 that does not include the auxiliary image 50 by being positioned near the front of the naked-eye 3D display 22.

  Further, the user U can recognize the left oblique recognition image (or right oblique recognition image) including the side region 63 on which the auxiliary image 50 is displayed by shifting the position to the left (or right). For this reason, according to the medical image diagnostic apparatus 10 according to the present embodiment, the user U can visually recognize the auxiliary image 50 only by shifting his / her position to the left (or right). The operation can be performed.

  Therefore, according to the medical image processing apparatus 10 according to the present embodiment, the auxiliary image 50 can be displayed so as not to disturb the stereoscopic image 60 corresponding to the volume data, and the stereoscopic image 60 via the auxiliary image 50 can be displayed. Operation can be easily accepted.

  Further, for example, when the same auxiliary image 50 is arranged in the side region 63 of the left oblique recognition image and the right oblique recognition image, the movement distance in the left-right direction of the pointer 70 for performing input to the auxiliary image 50 is approximately the horizontal width of the screen. Can be less than half. Further, when the same auxiliary image 50 is arranged in the side region 63 of the up-and-down oblique recognition image, the movement distance of the pointer 70 can be made approximately half or less of the screen vertical width. In this case, the user U can reduce the amount of operation of the pointer 70 for input to the auxiliary image 50, which is convenient.

  Further, instead of the naked-eye 3D display 22, a glasses-type 3D display may be used. When the naked-eye 3D display 22 is used, the eyeglasses required for the 3D display using the dedicated glasses are unnecessary, so that the operator can save time and effort for attaching and detaching the glasses.

  In the above description, an example in which the multi-viewpoint image generation unit 34 superimposes the viewpoint VR image and the auxiliary image has been described. However, an auxiliary image in which an auxiliary image is arranged with respect to the volume data stored in the storage unit 12 in advance. Volume data with an image may be created. In this case, the multi-view VR image generated by the multi-view rendering image generation unit 32 can be used as a multi-view image as it is, and the multi-view image generation unit 34 is unnecessary.

  When volume data with an auxiliary image is created in advance, the auxiliary image 50 in the perspective image may face the user U at the corresponding viewpoint. In this case, the auxiliary image 50 faces the user U, so that the auxiliary image 50 attached to the side surface is tilted and visually recognized (see the left oblique recognition image and the right oblique recognition image in FIG. 8). It is possible to make the image 50 more visible to the user U.

  When the medical image processing apparatus 10 is configured to be able to acquire user position information from the position sensor 23, the input receiving unit 31 determines whether or not the user U is in an oblique position in the up, down, left, and right directions. The input via the auxiliary image 50 is accepted only when it is present (permission from step S2 to S3 in FIG. 9 is permitted), and the input via the auxiliary image 50 is not accepted when near the front (step in FIG. 9). The transition from S2 to S3 may be prohibited).

  Further, the multi-viewpoint image generation unit 34 may generate a plurality of perspective point images including the auxiliary image 50 so that a part or all of the auxiliary image 50 can be stereoscopically displayed according to the operation of the input unit 11. . In this case, the multi-viewpoint image generation unit 34 may generate a plurality of viewpoint auxiliary images obtained by viewing the auxiliary image 50 from a plurality of perspective points so that the auxiliary image 50 can be stereoscopically viewed when displayed on the naked-eye 3D display 22. . At this time, the multi-viewpoint image generation unit 34 includes a soft key that is selected by the user U via the input unit 11 in the auxiliary image 50 or is selectable by the user U (hereinafter referred to as a selection portion). If there is, information on the selected portion is acquired from the input receiving unit 31, and a plurality of viewpoint auxiliary images are generated so that the selected portion of the auxiliary image 50 can be viewed stereoscopically. A plurality of perspective point images may be generated by superimposing each of the plurality of viewpoint auxiliary images. In this case, for example, the user U can recognize the stereoscopic image of the soft key by hovering the pointer 70 on one soft key of the operation panel 55, and which soft key is selected by the user U. You can clearly see if it is the key.

  Further, the front vicinity viewpoint image may be configured by one VR image. At this time, the VR image is rotated in accordance with an operation via the input unit 11 of the user U, and the auxiliary image arranged and attached to the rectangular parallelepiped region 61 and the side of the rectangular parallelepiped region 61 along with the rotation of the VR image. 50 may be rotated. For example, when the user U performs a so-called dragging operation on the VR image in a predetermined direction using the pointer 70, the multi-viewpoint image generation unit 34 operates the user U with the pointer 70 so that the VR image rotates together with the auxiliary image 50. The near-front viewpoint images are sequentially generated according to the above. In this case, according to the operation of the pointer 70 of the user U, the auxiliary image 50 can be superimposed on the front vicinity recognition image together with the rotation of the VR image. Therefore, the user U can display the auxiliary image 50 in front of the front vicinity recognition image as needed by operating the pointer 70 and rotating the VR image without moving.

  FIG. 15 is an explanatory diagram illustrating a modified example of the left oblique recognition image and the right oblique recognition image.

  The multi-viewpoint image generation unit 34 may be configured with only the near-front viewpoint VR image as the front vicinity viewpoint image, and only the auxiliary image 50 as the perspective image. At this time, the auxiliary image 50 of the perspective point image may face the user U at the corresponding viewpoint. In this case, as illustrated in FIG. 15, only the stereoscopic image 60 is included in the front vicinity recognition image, and only the auxiliary image 50 is included in the left / right oblique recognition image. In addition, when it is not necessary to stereoscopically view the front vicinity viewpoint VR image, the multi-viewpoint rendering image generation unit 32 may generate one front vicinity viewpoint VR image, and the same front vicinity viewpoint VR image is used as the parallax component image. You may observe from a some near front viewpoint. In this case, the front vicinity recognition image is visually recognized by the user U as a two-dimensional VR image.

(Second Embodiment)
Next, a second embodiment of the 3D image processing apparatus and 3D image processing program according to the present invention will be described.

  The medical image processing apparatus 10 according to the second embodiment is different from the medical image processing apparatus 10 according to the first embodiment in that the auxiliary image 50 is disposed behind the stereoscopic image 60 corresponding to the volume data. Since other configurations and operations are not substantially different from those of the medical image processing apparatus 10 shown in FIG. 1, the same components are denoted by the same reference numerals and description thereof is omitted.

  FIG. 16 is an explanatory diagram illustrating an example of a state when the auxiliary image 50 is displayed behind the stereoscopic image 60 corresponding to the volume data.

  As illustrated in FIG. 16, the multi-viewpoint image generation unit 34 combines each of the plurality of front view viewpoint VR images and the auxiliary image 50 so that the auxiliary image 50 is arranged behind the stereoscopic image 60 corresponding to the volume data. A multi-viewpoint image may be generated by superimposing.

  In this case, when the user U views the naked-eye 3D display 22 from the front vicinity viewpoint, the user U recognizes the front vicinity recognition image in which the auxiliary image 50 is hidden behind the stereoscopic image 60. Therefore, the user U can view the stereoscopic image 60 without being blocked by the auxiliary image 50 by being positioned in the vicinity of the front of the naked-eye 3D display 22. Further, in preparation for a case where the user U desires an operation on the auxiliary image 50, the front-rear relationship between the auxiliary image 50 and the stereoscopic image 60 is switched according to the operation of the input unit 11 of the user U, the system state, and the like.

  As an operation on the input unit 11 of the user U for arranging the auxiliary image 50 in front of the stereoscopic image 60, for example, an operation of clicking the pointer 70 in a display area other than the display area of the stereoscopic image 60, Click operation on the auxiliary image 50 displayed on the screen, a predetermined operation on the keyboard of the input unit 11, and the like. The system state that triggers the auxiliary image 50 to be placed in front of the stereoscopic image 60 includes, for example, when the user U has not operated the input unit 11 for a predetermined time or when returning from a so-called screen saver or standby state. Is mentioned.

  Further, when the auxiliary image 50 is arranged in front of the stereoscopic image 60, the stereoscopic image 60 hidden behind the auxiliary image 50 is passed through the auxiliary image 50 by setting the transparency of the auxiliary image 50 and making it semi-transparent display. It should be visible. This transparency may be set in advance using a set value stored in the storage unit 12 or may be set by the user U via the input unit 11.

  Also by the medical image processing apparatus 10 according to the present embodiment, the display position of the auxiliary image 50 is set in the three-dimensional space with respect to the display area of the stereoscopic image 60 corresponding to the volume data by using the naked eye 3D display 22. It can be arranged freely. In addition, when the auxiliary image 50 is arranged behind the stereoscopic image 60 corresponding to the volume data as shown in the present embodiment, the auxiliary image 50 is the stereoscopic image 60 of the front vicinity recognition image as shown in FIG. Appears behind. Therefore, the stereoscopic image 60 that is not eroded by the auxiliary image 50 can be observed even by the medical image processing apparatus 10 according to the present embodiment.

  In addition, the medical image processing apparatus 10 according to the present embodiment can exchange the front-rear relationship between the auxiliary image 50 and the stereoscopic image 60 according to the operation of the input unit 11 of the user U, the state of the system, and the like. For this reason, the medical image processing apparatus 10 according to the present embodiment can display the auxiliary image 50 so as not to disturb the stereoscopic image 60 corresponding to the volume data, and the stereoscopic image 60 via the auxiliary image 50 can be displayed. Operation can be easily accepted.

(Third embodiment)
Next, a third embodiment of the 3D image processing apparatus and 3D image processing program according to the present invention will be described.

  The medical image processing apparatus 10 according to the third embodiment is different from the medical image processing apparatus 10 in that the auxiliary image 50 and the stereoscopic image 60 corresponding to the volume data are arranged in a divided area of one screen. Since other configurations and operations are not substantially different from those of the medical image processing apparatus 10 shown in FIG. 1, the same components are denoted by the same reference numerals and description thereof is omitted.

  FIG. 17 is an explanatory diagram illustrating an example of how the auxiliary image 50 and the three-dimensional image 60 are displayed in a divided area of one screen of the front vicinity recognition image according to a predetermined screen layout. In FIG. 17, one screen has a main image area 81 for displaying the stereoscopic image 60, an auxiliary area 82 for displaying the operation panel 55 of the auxiliary image 50, and other images such as images in other rendering modes. The example in the case of being divided into the sub-image area 83 for displaying the image of the above is shown. Note that the image displayed in the main image area 81 may not be the stereoscopic image 60 but may be a two-dimensional VR image.

  As shown in FIG. 17, when the multi-viewpoint image generation unit 34 creates a near-front viewpoint image so that the auxiliary image 50 and the three-dimensional image 60 are displayed in a divided area of one screen, the three-dimensional image 60 is displayed. The area to be displayed (main image area 81) is eroded by other display areas (auxiliary area 82 and sub-image area 83).

  Therefore, when the input receiving unit 31 detects that the pointer 70 has been hovered over the stereoscopic image 60, the multi-viewpoint image generation unit 34 includes a magnified stereoscopic image 60b in which the display size of the stereoscopic image 60 is enlarged. The image is regenerated (see the lower left in FIG. 17). When the input receiving unit 31 detects that the pointer 70 has been hovered over the auxiliary area 82, the multi-viewpoint image generating unit 34 displays an enlarged auxiliary image 50 a in which the display size of the operation panel 55 in the auxiliary area 82 is enlarged. The front vicinity viewpoint image including the image is regenerated (see the lower right in FIG. 17). Further, when the operation panel 55 is enlarged, the multi-viewpoint image generation unit 34 may generate a plurality of near-front viewpoint images so that the operation panel 55 can be stereoscopically viewed.

  According to the medical image processing apparatus 10 according to the present embodiment, even when the auxiliary image 50 and the three-dimensional image 60 are displayed in a divided area of one screen, the three-dimensional image is appropriately displayed according to the operation of the user U. 60 and the auxiliary image 50 can be enlarged and displayed. For this reason, the medical image processing apparatus 10 according to the present embodiment can display the auxiliary image 50 so as not to disturb the stereoscopic image 60 corresponding to the volume data, and the stereoscopic image 60 via the auxiliary image 50 can be displayed. Operation can be easily accepted.

  In addition, although some embodiment of this invention was described, these embodiment is shown as an example and is not intending limiting the range of invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  Further, in the embodiment of the present invention, each step of the flowchart shows an example of processing that is performed in time series in the order described. The process to be executed is also included.

DESCRIPTION OF SYMBOLS 10 Medical image processing apparatus 11 Input part 12 Storage part 13 Network connection part 14 Control part 20 Modality 21 Network 22 Autostereoscopic 3D display 23 Position sensor 31 Input reception part 31a Pointer management part 32 Multi-viewpoint rendering image generation part 33 Auxiliary image generation part 34 Multi-viewpoint image generation unit 35 Multi-viewpoint image output unit 36 User position information acquisition unit 50 Auxiliary image 60 Three-dimensional image 61 Cuboid region 62 Front region 63 Side region 70 Pointer 81 Main image region 82 Auxiliary region 83 Sub-image region

Claims (13)

A multi-viewpoint rendering image generation unit that generates a plurality of viewpoint rendering images by performing volume rendering from a plurality of viewpoints based on the volume data;
An auxiliary image generation unit that generates an image of a soft key, an image indicating auxiliary information, and other auxiliary images;
A plurality of viewpoint images including a viewpoint image in which the viewpoint rendering image and the auxiliary image are superimposed so that the auxiliary image is disposed at a predetermined peripheral position excluding the front surface of a three-dimensional region surrounding the stereoscopic image corresponding to the volume data. A multi-viewpoint image generation unit for generating a viewpoint image;
A multi-viewpoint image output unit that outputs the plurality of viewpoint images to a naked-eye 3D display device that emits each of the plurality of viewpoint images as parallax component images in different directions;
A three-dimensional image processing apparatus. The multi-viewpoint image generation unit
While generating the front vicinity viewpoint image without superimposing the auxiliary image on the front vicinity viewpoint rendering image among the plurality of viewpoint rendering images, the perspective view rendering image excluding the viewpoint rendering image of the viewpoint near the front is used. A perspective image is generated by superimposing the auxiliary image,
The multi-viewpoint image output unit
The naked-eye 3D display device outputs the plurality of viewpoint images to the naked-eye 3D display device so that the near-front viewpoint image is emitted in a direction near the front and the perspective point image is emitted in a direction other than the near-front direction. To
The three-dimensional image processing apparatus according to claim 1. The multi-viewpoint image generation unit
Superimposing the perspective-point rendering image and the auxiliary image among the plurality of viewpoint rendering images so that the auxiliary image is disposed on a side surface of a rectangular parallelepiped region surrounding the stereoscopic image corresponding to the volume data;
The three-dimensional image processing apparatus according to claim 2. A pointer management unit that acquires the three-dimensional coordinates of the pointer displayed on the naked-eye 3D display device and receives an input to the auxiliary image;
Further equipped with,
The three-dimensional image processing apparatus according to any one of claims 1 to 3. The multi-viewpoint rendered image generation unit
When an instruction to change the rendering mode via the auxiliary image is received by the user via the input unit, volume rendering is performed in the rendering mode after the change from the viewpoint near the front based on the volume data, and a plurality of new rendering modes are newly created. Generate perspective rendering images,
The multi-viewpoint image generation unit
Generating a plurality of near-front viewpoint images consisting only of newly generated viewpoint rendering images so that the stereoscopic image corresponding to the volume data in the changed rendering mode can be stereoscopically viewed from the near-viewpoint; ,
The three-dimensional image processing apparatus according to any one of claims 1 to 4. The multi-viewpoint rendered image generation unit
When the user receives a selection for one of the plurality of thumbnail images included in the auxiliary image via the input unit, the stereoscopic image corresponding to the selected thumbnail image can be stereoscopically viewed from the viewpoint near the front. And generating the plurality of viewpoint rendering images corresponding to the selected thumbnail images,
The multi-viewpoint image generation unit
Generating a plurality of near-front viewpoint images consisting only of viewpoint rendering images corresponding to the selected thumbnail image so that a stereoscopic image corresponding to the selected thumbnail image can be stereoscopically viewed from a viewpoint near the front;
The three-dimensional image processing apparatus according to any one of claims 1 to 5. The multi-viewpoint image generation unit
Generating the plurality of viewpoint images by superimposing each of the plurality of viewpoint rendering images and the auxiliary image so that the auxiliary image is arranged behind a stereoscopic image corresponding to the volume data;
The three-dimensional image processing apparatus according to claim 1. The multi-viewpoint image generation unit
In response to an instruction from the user via the input unit, the front-rear relationship between the auxiliary image and the viewpoint rendering image in the viewpoint image is changed, and the auxiliary image is displayed when the auxiliary image is displayed in front of the viewpoint rendering image. A translucent image,
The three-dimensional image processing apparatus according to claim 7. The multi-viewpoint image generation unit
When an operation on the input unit by the user is not performed for a predetermined time or more, the auxiliary image in the viewpoint image is displayed in front of the viewpoint rendering image and the auxiliary image is a translucent image.
The three-dimensional image processing apparatus according to claim 7. The multi-viewpoint image generation unit
Among the plurality of viewpoint images, the viewpoint rendering image is arranged in a predetermined display area of the front vicinity viewpoint image and the auxiliary image is arranged in another display area of the front vicinity viewpoint image. When the viewpoint rendering image is selected, the near-front viewpoint image is generated again so as to enlarge the viewpoint rendering image. On the other hand, when the auxiliary image is selected by the user via the input unit, the auxiliary image is enlarged. Re-generating the near-front perspective image to display,
The three-dimensional image processing apparatus according to claim 1. The multi-viewpoint image generation unit
A plurality of viewpoint auxiliary images obtained by viewing the auxiliary image from a plurality of viewpoints so that the auxiliary image can be stereoscopically viewed when displayed on the naked-eye 3D display device, and each of the plurality of viewpoint rendering images and the plurality of viewpoint rendering images are displayed. Superimposing each of the viewpoint auxiliary images of
The three-dimensional image processing apparatus according to any one of claims 1 to 10. The multi-viewpoint image generation unit
The plurality of viewpoint auxiliary images are generated so that the auxiliary images can be stereoscopically viewed in a state selected by the user via the input unit or in a selectable state. Superimposing each and each of the plurality of viewpoint auxiliary images,
The three-dimensional image processing apparatus according to claim 11. On the computer,
Generating a plurality of viewpoint rendering images by performing volume rendering from a plurality of viewpoints based on the volume data;
Generating a soft key image, an image showing supplementary information, and other auxiliary images;
A plurality of viewpoint images including a plurality of viewpoint images obtained by superimposing the viewpoint rendering image and the auxiliary image so that the auxiliary image is arranged around the three-dimensional region surrounding the stereoscopic image corresponding to the volume data, excluding the front surface. A step of generating
Outputting the plurality of viewpoint images to a naked-eye 3D display device that emits each of the multi-viewpoint images in different directions;
3D image processing program for executing