JP2012073996A - Image distribution device and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible to distribute a proper two-dimensional image when selectively distributing a three-dimensional image and a two-dimensional image to a terminal device.SOLUTION: Upon receiving an image distribution request from a terminal device 8, based on information transmitted from the terminal device 8 and representing a type of a monitor 8A, a computer 12 determines whether or not the monitor 8A of the terminal device 8 can perform three-dimensional display. If the monitor 8A can perform three-dimensional display, an image file of an image that can be three-dimensionally displayed is distributed to the terminal device 8. If the monitor 8A cannot perform three-dimensional display, a two-dimentional image G1 to be a reference that is included in the image file of the image that can be three-dimensionally displayed and is acquired at a position where a specimen is viewed from a vertical direction is distributed to the terminal device 8.

Description

  The present invention relates to an image distribution apparatus and method for distributing a stereoscopically viewable medical three-dimensional image to a terminal apparatus that has requested image distribution.

  Conventionally, it is known that stereoscopic viewing can be performed using parallax by displaying a plurality of images in combination. Such a stereoscopically viewable image (hereinafter referred to as a stereoscopic image or a three-dimensional image) is displayed based on a plurality of images with parallax obtained by photographing the same subject from different directions.

  Such 3D image display is used not only in the fields of digital cameras and televisions, but also in the field of radiographic imaging. In other words, radiation is irradiated to the subject from a reference position where the subject is viewed from the vertical direction and a reference position shifted from the reference position by a predetermined angle, and the radiation transmitted through the subject is detected by a radiation image detector. A plurality of radiation images having parallax with each other is acquired, and a three-dimensional image is displayed based on these radiation images. By displaying a three-dimensional image in this way, it is possible to observe a radiographic image having a sense of depth, so that diagnosis can be made easier.

  By the way, stereoscopic vision is performed by three-dimensionally displaying the above-described plurality of radiation images or a three-dimensional image generated from the plurality of radiation images on a three-dimensional monitor for performing stereoscopic vision. However, a monitor that can only perform two-dimensional display (referred to as a two-dimensional monitor) cannot display a three-dimensional image in a stereoscopic manner. When a three-dimensional image is displayed on a two-dimensional monitor, the image looks very double, and the image becomes very difficult to observe. In this case, an image that cannot be stereoscopically viewed, that is, a two-dimensional image (for example, a radiation image used to generate a three-dimensional image) may be displayed instead of the three-dimensional image on the two-dimensional monitor.

  For this reason, whether or not the image file includes a three-dimensional image is described in the header of the image file. If the image file includes a three-dimensional image, three-dimensional display is performed using the three-dimensional image. If the image file is not included, the image file includes only the two-dimensional image, and therefore a method for displaying the two-dimensional image has been proposed (see Patent Document 1). A method of switching the image display mode to the two-dimensional display mode or the three-dimensional display mode based on the file identification information has also been proposed (see Patent Document 2). Further, in Patent Document 2, when a request for image distribution is made from a terminal device that can store images on a server and can only perform two-dimensional display, and the image is a three-dimensional image, There has also been proposed a method for preventing delivery of a three-dimensional image.

Japanese Patent Laid-Open No. 10-232665 JP 2009-124768 A

  However, the method described in Patent Document 1 performs three-dimensional display when the image file includes a three-dimensional image, and the image file that performs three-dimensional display includes only a three-dimensional image. is there. Further, the technique described in Patent Document 2 also has a display mode in the two-dimensional mode and the three-dimensional mode according to the type of image requested when two-dimensional images and three-dimensional images are stored in the server. Since switching is performed, the image file for performing the three-dimensional display only includes a three-dimensional image. For this reason, when two-dimensional display is desired for a three-dimensional image, a two-dimensional image of a subject included in the three-dimensional image is acquired separately from the three-dimensional image, and the two-dimensional image is stored together with the three-dimensional image. There is a need.

  However, in order to store both the three-dimensional image and the two-dimensional image, it is necessary to take a two-dimensional image, and the storage capacity of the image is further increased. For this reason, it is conceivable to use the two-dimensional image used for generating the three-dimensional image for the two-dimensional display. Here, when generating a three-dimensional image of a radiographic image, a two-dimensional image obtained by irradiating a subject with radiation from different directions is used. In order to accurately perform a diagnosis using a two-dimensional image. It is preferable to use an image that allows the subject to be observed from the front.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to enable distribution of an appropriate two-dimensional image when a three-dimensional image and a two-dimensional image are selectively distributed to a terminal device.

An image distribution apparatus according to the present invention includes an image file that includes a plurality of two-dimensional images obtained from a plurality of different viewpoints and that can generate a three-dimensional image for stereoscopic viewing, or the plurality of two-dimensional images and Storage means for storing an image file including the three-dimensional image;
A communication means for communicating with the terminal device;
Determining means for determining whether or not the terminal device is capable of three-dimensional display when there is an image distribution instruction from the terminal device;
When it is determined that the terminal device is not capable of three-dimensional display, a two-dimensional image acquired at a reference viewpoint among the plurality of viewpoints among the plurality of two-dimensional images is distributed to the terminal device. And a distribution control means.

  In the image distribution apparatus according to the present invention, the reference viewpoint may be a viewpoint that faces the subject from a vertical direction.

  In the image distribution apparatus according to the present invention, the determination unit may be a unit that performs the determination based on information transmitted from the terminal device and indicating a type of display unit of the terminal device.

  In the image distribution device according to the present invention, the distribution control means distributes the plurality of two-dimensional images or the three-dimensional images to the terminal device when it is determined that the terminal device can display three-dimensionally. It is good also as a means to do.

  In the image distribution device according to the present invention, the terminal device may display the plurality of two-dimensional images or the three-dimensional images three-dimensionally by an anaglyph method.

An image distribution apparatus control method according to the present invention includes an image file including a plurality of two-dimensional images obtained by acquiring a subject from a plurality of different viewpoints and capable of generating a three-dimensional image for stereoscopic viewing, or the plurality of two-dimensional images. Storage means for storing a three-dimensional image and an image file containing the three-dimensional image;
A control method for an image distribution device comprising a communication means for communicating with a terminal device,
When there is an image distribution instruction from the terminal device, it is determined whether or not the terminal device is capable of three-dimensional display,
When it is determined that the terminal device is not capable of three-dimensional display, a two-dimensional image acquired at a reference viewpoint among the plurality of viewpoints among the plurality of two-dimensional images is distributed to the terminal device. It is characterized by this.

  According to the present invention, when there is an image distribution instruction from the terminal device, it is determined whether or not the terminal device is capable of three-dimensional display, and it is determined that the terminal device is not capable of three-dimensional display. In this case, a two-dimensional image acquired from a reference viewpoint among a plurality of two-dimensional images is distributed to the terminal device. For this reason, in the terminal device, since a two-dimensional image in which the subject can be observed from the reference viewpoint position is displayed, diagnosis using the displayed two-dimensional image can be performed with high accuracy.

  In particular, since a two-dimensional image that allows the subject to be observed from the front is displayed on the terminal device by distributing to the terminal device a two-dimensional image that faces the subject from a vertical direction among a plurality of two-dimensional images. Diagnosis using the obtained two-dimensional image can be performed with higher accuracy.

1 is a schematic block diagram showing a configuration of a medical image distribution system using an image distribution apparatus according to an embodiment of the present invention. Schematic configuration diagram of a radiographic imaging apparatus used in the present embodiment The figure which looked at the arm part of the radiographic imaging apparatus shown in FIG. 2 from the right direction of FIG. The block diagram which shows schematic structure inside the computer of the radiographic imaging apparatus shown in FIG. A block diagram showing a schematic configuration inside the computer of the image server A flowchart showing processing performed in the present embodiment

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a schematic block diagram showing a configuration of a medical image distribution system using an image distribution apparatus according to an embodiment of the present invention. As shown in FIG. 1, the medical image distribution system 1 according to the present embodiment includes a radiographic image capturing device 2, an image server 4, a network 6, and a plurality of terminal devices 8. Then, the medical image acquired by the radiographic image capturing apparatus 2 is stored in the image server 4, and a medical image stored in the image server 4 is requested via the network 6 in response to an image distribution request from the terminal device 8. The terminal device 8 is distributed, and a medical image is displayed on the monitor 8A of the terminal device 8.

  The radiographic imaging device 2 acquires, for example, two two-dimensional medical images (hereinafter referred to as two-dimensional images) at different viewpoint positions in order to display a radiographic image of a breast three-dimensionally. FIG. 2 is a schematic configuration diagram of the radiation image processing apparatus 2 used in the present embodiment. As shown in FIG. 2, the radiographic image capturing apparatus 2 includes an imaging unit 50, a computer 32 connected to the imaging unit 50, a monitor 33 connected to the computer 32, and an input unit 34.

  The imaging unit 50 is capable of moving in a vertical direction (Z direction) with respect to the base 51, a rotatable rotating shaft 52, and an arm portion 53 coupled to the base 51 by the rotating shaft 52. It has. 3 shows the arm portion 53 viewed from the right direction in FIG.

  The arm portion 53 has an alphabet C shape, and a radiation table 56 is attached to one end of the arm portion 53 so as to face the imaging table 54 at the other end. The rotation and vertical movement of the arm unit 53 are controlled by an arm controller 71 incorporated in the base 51.

  A radiographic image detector 55 such as a flat panel detector and a detector controller 73 that controls reading of a charge signal from the radiographic image detector 55 are provided inside the imaging stand 54.

  Further, inside the imaging stand 54, a charge amplifier that converts the charge signal read from the radiation image detector 55 into a voltage signal, a correlated double sampling circuit that samples the voltage signal output from the charge amplifier, and a voltage signal A circuit board or the like provided with an AD conversion unit or the like for converting the signal into a digital signal is also installed.

  Further, the photographing table 54 is configured to be rotatable with respect to the arm unit 53, and even when the arm unit 53 is rotated with respect to the base 51, the direction of the photographing table 54 is fixed to the base 51. can do.

  The radiation image detector 55 can repeatedly perform recording and reading of a radiation image, and may use a so-called direct type radiation image detector that directly receives radiation and generates charges. A so-called indirect radiation image detector that converts radiation once into visible light and converts the visible light into a charge signal may be used. As a radiation image signal readout method, a radiation image signal is read out by turning on / off a TFT (thin film transistor) switch, or a radiation image is emitted by irradiating reading light. It is desirable to use a so-called optical readout system in which a signal is read out, but the present invention is not limited to this, and other systems may be used.

  A radiation source 57 and a radiation source controller 72 are housed inside the radiation irradiation unit 56. The radiation source controller 72 controls the timing of irradiating radiation from the radiation source 57 and the radiation generation conditions (tube current, time, tube current time product, etc.) in the radiation source 57.

  Further, in the central portion of the arm portion 53, a compression plate 58 that is disposed above the imaging table 54 and presses and compresses the breast, a support portion 60 that supports the compression plate 58, and a support portion 60 in the vertical direction ( A moving mechanism 59 for moving in the Z direction) is provided. The position of the compression plate 58 and the compression pressure are controlled by the compression plate controller 74.

  The computer 32 includes a central processing unit (CPU) and a storage device such as a semiconductor memory, a hard disk, and an SSD. The control unit 38a, the radiation image storage unit 38b, and the display as shown in FIG. A control unit 38c and a communication unit 38d are configured.

  The control part 38a outputs a predetermined control signal with respect to various controllers 71-74, and controls the whole system.

  The radiographic image storage unit 38b stores two two-dimensional radiographic images (hereinafter referred to as two-dimensional images) detected by the radiographic image detector 55 by imaging from two different imaging directions.

  The display control unit 38c performs predetermined processing on the two two-dimensional images read from the radiation image storage unit 38b, and then displays a three-dimensional image of the breast M on the monitor 33.

  The file generation unit 38d generates an image file of a three-dimensional image including two two-dimensional images.

  The communication unit 38e transmits two two-dimensional images and three-dimensional images to the image server 4 via the network 6.

  The input unit 34 is configured by a pointing device such as a keyboard and a mouse, for example, and receives an input of shooting conditions including an enlargement ratio and an input of a shooting start instruction by a photographer.

  The monitor 33 is configured to display a three-dimensional image in a three-dimensional manner using the two two-dimensional images output from the computer 32 when photographing a three-dimensional image. As a configuration for stereoscopically viewing a three-dimensional image, for example, two two-dimensional images are respectively displayed using two screens, and one of these radiographic images is observed by using a half mirror or a polarizing glass. It is possible to adopt a configuration in which a three-dimensional image is displayed by making it enter the right eye of the person and making the other radiation image enter the left eye of the observer. Alternatively, a configuration may be adopted in which a two-dimensional image is generated by superimposing two two-dimensional images shifted by a predetermined amount of parallax, and viewed stereoscopically by polarizing glass. Two two-dimensional images are changed to red and blue, respectively, and are shifted by a predetermined amount of parallax to generate a three-dimensional image, which is viewed stereoscopically by red and blue glasses equipped with a red filter and a blue filter. It is good also as composition to do. Moreover, it is good also as a structure stereoscopically displayed by displaying two two-dimensional images on 3D liquid crystal which can be stereoscopically viewed like a parallax barrier system and a lenticular system.

  In such a radiographic imaging device 2, imaging is performed as follows. First, the patient's breast M is placed on the imaging table 54, and the breast M is compressed with a predetermined pressure by the compression plate 58. Next, after various shooting conditions are input at the input unit 34, an instruction to start shooting is input.

  Then, when there is an instruction to start photographing at the input unit 34, one of the two two-dimensional images constituting the three-dimensional image of the breast M is photographed. Specifically, first, the control unit 38 a reads a convergence angle θ for capturing a preset three-dimensional image, and outputs the read information about the convergence angle θ to the arm controller 71. In this embodiment, θ = 4 ° is stored in advance as information on the convergence angle θ at this time. However, the present invention is not limited to this, and an arbitrary convergence angle is set in the input unit 34 by the photographer. Is possible.

  Then, the arm controller 71 receives the information of the convergence angle θ output from the control unit 38a, and the arm controller 71 first has the arm unit 53 in a direction perpendicular to the imaging table 54 as shown in FIG. The control signal is output as follows.

  Then, in a state where the arm unit 53 is in a direction perpendicular to the imaging table 54 in accordance with the control signal output from the arm controller 71, the control unit 38 a notifies the radiation source controller 72 and the detector controller 73. On the other hand, a control signal is output so as to perform radiation irradiation and readout of a radiographic image signal. Note that the position of the radiation source 57 in this state is a reference viewpoint position. In response to this control signal, radiation is emitted from the radiation source 57, a radiation image obtained by photographing the breast from the 0 ° direction is detected by the radiation image detector 55, and a radiation image signal is output from the radiation image detector 55 by the detector controller 73. Are read out and subjected to predetermined signal processing on the radiographic image signal, and then stored in the radiographic image storage unit 38b of the computer 32 as a two-dimensional image.

  Note that a two-dimensional image acquired by photographing the breast from the 0 ° direction faces the breast from the vertical direction. In the present embodiment, the two-dimensional image acquired by photographing the breast from the 0 ° direction is referred to as a reference two-dimensional image G1.

  Next, as shown in FIG. 2, the arm controller 71 outputs a control signal to rotate the arm portion 53 by + θ ° with respect to a direction perpendicular to the imaging table 54. That is, in the present embodiment, the control signal is output so that the arm unit 53 is rotated by 4 ° with respect to the direction perpendicular to the imaging table 54. Then, in a state where the arm unit 53 is rotated by 4 ° according to the control signal output from the arm controller 71, the control unit 38a subsequently applies radiation to the radiation source controller 72 and the detector controller 73 and the radiation. A control signal is output so as to read out the image signal.

  Specifically, the control unit 38a outputs a control signal to the radiation source controller 72 and the detector controller 73 so as to perform radiation irradiation and radiographic image reading. In response to this control signal, radiation is emitted from the radiation source 57, a radiation image obtained by photographing the breast from a 4 ° direction is detected by the radiation image detector 55, and a radiation image signal is read by the detector controller 73, and a predetermined value is obtained. Is then stored as a two-dimensional image in the storage unit 38b of the computer 32.

  Note that since the two-dimensional image acquired by photographing the breast from the 4 ° direction does not face the breast from the vertical direction, in this embodiment, the two-dimensional image is obtained by photographing the breast from the 4 ° direction. The two-dimensional image is referred to as a reference two-dimensional image G2.

  Then, the two two-dimensional images G1 and G2 stored in the radiation image storage unit 38b are read out, and a predetermined process is performed on the two-dimensional images G1 and G2 in the display control unit 38e. The three-dimensional image of the breast is displayed on the monitor 33.

  Furthermore, after confirmation by the radiographing apparatus 2 photographer, an image file F0 including two two-dimensional images G1 and G2 is generated by the file generation unit 38d, and the generated image file F0 is stored in the image server by the communication unit 38e. Sent to 4 and saved. Here, the generated image file F0 includes two two-dimensional images G1 and G2 that can generate a three-dimensional image. Therefore, information indicating that the image file is an image file of an image that can be three-dimensionally displayed is described in the header of the image file F0.

  Returning to FIG. 1, the image server 4 includes a recording medium 10 such as a hard disk for storing a plurality of image files, and a computer 12. A program for causing the computer 12 to function as the image distribution apparatus according to the present embodiment is installed in the computer 12. The image file transmitted from the radiation image capturing apparatus 2 is recorded on the recording medium 10.

  The computer 12 includes a central processing unit (CPU) and a storage device such as a semiconductor memory, a hard disk, and an SSD. The control unit 12a, the determination unit 12b, and the distribution control unit as illustrated in FIG. 12c and the communication part 12d are comprised.

  The controller 12a controls the computer 12 as a whole.

  When there is an image distribution request from any one of the plurality of terminal devices 8 via the network 6 as described later, the determination unit 12b transmits the terminal device 8 transmitted from the terminal device 8. Based on the information indicating the type of monitor, it is determined whether or not the monitor 8A of the terminal device 8 can be three-dimensionally displayed. The information indicating the type of the monitor 8A of the terminal device 8 includes information indicating whether or not the monitor 8A can perform three-dimensional display, and is transmitted to the image server 4 together with an image distribution request.

  The distribution control unit 12c distributes the image to the terminal device 8 based on the determination result of the determination unit 12b. That is, when the monitor 8A included in the terminal device 8 is a three-dimensional monitor capable of three-dimensional display, an image file capable of three-dimensional display is delivered to the terminal device 8 as it is. On the other hand, when the monitor 8A of the terminal device 8 is a two-dimensional monitor that cannot display three-dimensionally, the two-dimensional images G1 and G2 included in the image file are acquired at a position facing the subject breast from the vertical direction. The reference two-dimensional image G1 is distributed to the terminal device 8.

  The communication unit 12 d communicates with the terminal device 8 via the network 6.

  Next, processing performed in the present embodiment will be described. FIG. 6 is a flowchart showing processing performed in the present embodiment. When the communication unit 12d receives the image distribution request from the terminal device 8 (step ST1), the determination unit 12b includes three monitors 8A included in the terminal device 8 based on the information indicating the type of monitor transmitted from the terminal device 8. It is determined whether or not dimension display is possible (step ST2).

  When the monitor 8A included in the terminal device 8 can display three-dimensionally (Yes in step ST2), the distribution control unit 12c searches the recording medium 10 for an image file for which a distribution request has been made, and searches for the image file in the terminal device 8. (3D image distribution, step ST3), and the process ends.

  On the other hand, when the monitor 8A included in the terminal device 8 cannot display three-dimensionally (No in step ST2), the distribution control unit 12c searches the recording medium 10 for an image file of the image requested to be distributed, Only the included reference two-dimensional image G1 is distributed to the terminal device 8 (step ST4), and the process ends.

  Thereby, when the monitor 8A of the terminal device 8 can display three-dimensionally, a three-dimensional image is generated from the two two-dimensional images G1 and G2 in the terminal device 8, and the generated three-dimensional image is converted into a three-dimensional image. It is displayed on the monitor 8A so as to be visible. In this case, as a configuration for displaying a three-dimensional image three-dimensionally on the monitor 8A, an arbitrary method such as a method using a half mirror or a polarizing glass, an anaglyph method, a parallax barrier method, or a lenticular method as described above may be used. it can.

  On the other hand, when the monitor 8A of the terminal device 8 cannot display three-dimensionally, a two-dimensional image G1 acquired at a position facing the breast from the vertical direction is displayed on the monitor 8A.

  Thus, in the present embodiment, when there is an image distribution instruction from the terminal device 8, it is determined whether or not the monitor 8A of the terminal device 8 can display three-dimensionally. When it is determined that 8A cannot be displayed three-dimensionally, the reference two-dimensional image G1 that faces the breast from the vertical direction among the two-dimensional images G1 and G2 is distributed to the terminal device 8. Thereby, in the terminal device 8, since the two-dimensional image which can observe the subject from the front is displayed, the diagnosis using the displayed two-dimensional image can be performed with high accuracy.

  In the above embodiment, a 3D image is generated from a 2D image and displayed in 3D. However, when 3D display is performed by an anaglyph method or the like, two 2D images are superimposed. Thus, a three-dimensional image can be generated. In addition, a three-dimensional image can be generated in advance when three-dimensional display is performed by the parallax barrier method and the lenticular method. For this reason, the radiographic imaging device 2 may generate a three-dimensional image, include the two two-dimensional images G1, G2 and the three-dimensional image in the image file, and transmit them to the image server 4 for storage. . In this case, when the monitor 8A of the terminal device 8 that has requested the image distribution is capable of three-dimensional display, the three-dimensional image included in the image file is distributed to the terminal device 8.

  In the above-described embodiment, a two-dimensional image obtained by photographing the breast from the 0 degree direction is distributed as a reference two-dimensional image. However, when photographing for obtaining two two-dimensional images, the breast is set to 0. In some cases, an image taken from a direction different from the angle is used as a reference. In this case, of the two two-dimensional images, a two-dimensional image acquired by photographing from a reference direction may be distributed as a reference two-dimensional image.

  In the above embodiment, the radiographic image capturing apparatus of the present invention is a mammographic image capturing apparatus. However, the subject is not limited to the breast, and for example, a radiographic image capturing apparatus that captures the chest, head, or the like may be used. Is possible.

DESCRIPTION OF SYMBOLS 1 Medical image delivery system 2 Radiographic imaging device 4 Image server 6 Network 8 Terminal device 10 Recording medium 12 Computer 12a Control part 12b Judgment part 12c Delivery control part 12d Communication part

Claims (6)

An image file including a plurality of 2D images obtained from a plurality of different viewpoints and capable of generating a 3D image for stereoscopic viewing, or an image file including the plurality of 2D images and the 3D image A storage means for storing
A communication means for communicating with the terminal device;
Determining means for determining whether or not the terminal device is capable of three-dimensional display when there is an image distribution instruction from the terminal device;
When it is determined that the terminal device is not capable of three-dimensional display, a two-dimensional image acquired at a reference viewpoint among the plurality of viewpoints among the plurality of two-dimensional images is distributed to the terminal device. An image distribution apparatus comprising distribution control means.   The image distribution apparatus according to claim 1, wherein the reference viewpoint is a viewpoint that faces the subject from a vertical direction.   The image distribution apparatus according to claim 1, wherein the determination unit is a unit that performs the determination based on information indicating a type of display unit of the terminal device transmitted from the terminal device.   The distribution control means is means for distributing the plurality of two-dimensional images or the three-dimensional images to the terminal device when it is determined that the terminal device is capable of three-dimensional display. The image delivery apparatus according to any one of 1 to 3.   5. The image distribution device according to claim 1, wherein the terminal device displays the plurality of two-dimensional images or the three-dimensional image in a three-dimensional manner by an anaglyph method. An image file including a plurality of 2D images obtained from a plurality of different viewpoints and capable of generating a 3D image for stereoscopic viewing, or an image file including the plurality of 2D images and the 3D image A storage means for storing
A control method for an image distribution device comprising a communication means for communicating with a terminal device,
When there is an image distribution instruction from the terminal device, it is determined whether or not the terminal device is capable of three-dimensional display,
When it is determined that the terminal device is not capable of three-dimensional display, a two-dimensional image acquired at a reference viewpoint among the plurality of viewpoints among the plurality of two-dimensional images is distributed to the terminal device. A method for controlling an image distribution apparatus.

Images