WO2012056721A1 - Procédé d'affichage d'image 3d, dispositif de commande d'affichage en 3d, et programme associé - Google Patents

Procédé d'affichage d'image 3d, dispositif de commande d'affichage en 3d, et programme associé Download PDF

Info

Publication number
WO2012056721A1
WO2012056721A1 PCT/JP2011/006068 JP2011006068W WO2012056721A1 WO 2012056721 A1 WO2012056721 A1 WO 2012056721A1 JP 2011006068 W JP2011006068 W JP 2011006068W WO 2012056721 A1 WO2012056721 A1 WO 2012056721A1
Authority
WO
WIPO (PCT)
Prior art keywords
stereoscopic
cursor
image
display
subject
Prior art date
Application number
PCT/JP2011/006068
Other languages
English (en)
Japanese (ja)
Inventor
哲郎 楠木
吉川　賢治
孝夫 桑原
靖子 八尋
大田　恭義
ロムスダル・ハーレン
玲 長谷川
Original Assignee
富士フイルム株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士フイルム株式会社 filed Critical 富士フイルム株式会社
Publication of WO2012056721A1 publication Critical patent/WO2012056721A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/022—Stereoscopic imaging
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/42—Arrangements for detecting radiation specially adapted for radiation diagnosis
    • A61B6/4208—Arrangements for detecting radiation specially adapted for radiation diagnosis characterised by using a particular type of detector
    • A61B6/4233—Arrangements for detecting radiation specially adapted for radiation diagnosis characterised by using a particular type of detector using matrix detectors
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/46—Arrangements for interfacing with the operator or the patient
    • A61B6/461—Displaying means of special interest
    • A61B6/466—Displaying means of special interest adapted to display 3D data
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
    • A61B6/502—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of breast, i.e. mammography
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/156—Mixing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/183—On-screen display [OSD] information, e.g. subtitles or menus

Definitions

  • the present invention displays a stereoscopically viewable stereoscopic image using two images for each photographing direction acquired by photographing a subject from two different photographing directions and moves in the depth direction of the stereoscopic image.
  • the present invention relates to a technique for displaying a possible three-dimensional cursor.
  • stereoscopic viewing can be performed using parallax by displaying a plurality of images in combination.
  • a stereoscopically viewable image hereinafter referred to as a stereoscopic image or a stereo image
  • a stereoscopic image or a stereo image is displayed based on a plurality of images having parallax obtained by photographing the same subject from different positions.
  • Such stereoscopic image display is used not only in fields such as digital cameras and televisions but also in medical fields such as radiological diagnostic equipment and endoscopy equipment.
  • a subject is irradiated with radiation from different directions, the radiation transmitted through the subject is detected by a radiation image detector, and a plurality of radiation images having parallax are obtained.
  • a stereoscopic image is displayed based on the radiation image.
  • stereoscopic viewing is particularly necessary when the area of interest, which has an anatomical distribution in the depth direction, such as travel of bones and blood vessels, and the spread in the depth direction, such as nodules and tumors, is targeted for diagnosis. It is effective to display an image.
  • a stereoscopic cursor is often used to intuitively grasp the positional relationship in the depth direction or to quantitatively grasp by stereoscopic measurement or the like.
  • the stereoscopic cursor is stereoscopically displayed in the stereoscopic display space by displaying a right-eye cursor image and a left-eye cursor image having a predetermined left-right parallax amount on the monitor.
  • the three-dimensional cursor can move not only in the vertical and horizontal directions of the image displayed on the monitor but also in the depth direction connecting the observer and the monitor. Is.
  • the movement in the depth direction is realized by adjusting the amount of parallax between the right-eye cursor image and the left-eye cursor image (see, for example, Patent Document 1, Patent Document 2, and Patent Document 3).
  • the observer when the movement operation of the three-dimensional cursor is performed by the observer, the observer often moves the line of sight so as to follow the position of the three-dimensional cursor.
  • the distance (focal length) from each eye of the observer to the cursor image for each eye displayed on the monitor surface, or in the space where the stereoscopic display is performed The convergence angle at the position of the three-dimensional cursor changes. Therefore, the observer repeatedly adjusts the focal length and converges in an attempt to continuously establish the stereoscopic view of the cursor, which may lead to eye fatigue.
  • the present invention has been made in view of the above circumstances, and an object of the present invention is to provide a stereoscopic image display method, a stereoscopic display control device, and a program that can reduce the fatigue of the eyes of an observer associated with a movement operation of a stereoscopic cursor.
  • Another object of one embodiment of the present invention is to enable a stereoscopic cursor to be always stereoscopically displayed and to display the stereoscopic cursor at a desired position on the stereoscopic image.
  • the stereoscopic image display method of the present invention performs stereoscopic display of the subject using two subject images for each photographing direction acquired by photographing subjects from two different photographing directions, and has a predetermined amount of parallax.
  • a second step of adjusting is
  • the stereoscopic image display control apparatus of the present invention performs subject image display control for performing stereoscopic display of the subject using two subject images for each photographing direction acquired by photographing subjects from two different photographing directions.
  • a stereoscopic image display control apparatus comprising: means for displaying a stereoscopic cursor that can be stereoscopically viewed using a right-eye cursor image and a left-eye cursor image having a predetermined amount of parallax;
  • a stereoscopic cursor operation receiving unit configured to receive an operation of moving the stereoscopic cursor with respect to the subject in a stereoscopic display space in which a visual display is performed, and the subject image display control unit is configured to perform the operation in the stereoscopic display space according to the operation; Adjust the display position of the two subject images so that the subject moves in the direction opposite to the direction of movement of the three-dimensional cursor. Characterized in that the so that.
  • a stereoscopic display device includes the above-described stereoscopic display control device, and stereoscopic display means for performing stereoscopic display of the subject and the stereoscopic cursor.
  • the stereoscopic image display control program of the present invention displays a stereoscopic display of the subject on a computer using two subject images for each of the photographing directions acquired by photographing the subject from two different photographing directions. And a step of causing a display means to display a stereoscopic cursor that can be viewed stereoscopically using a right-eye cursor image and a left-eye cursor image having a predetermined amount of parallax. Receiving an operation of moving the stereoscopic cursor with respect to the subject in a stereoscopic display space where the stereoscopic display is performed; and in the stereoscopic display space, the moving direction of the stereoscopic cursor by the operation is opposite to the moving direction. Adjusting the display positions of the two subject images so that the subject moves. Characterized in that way the.
  • the amount of parallax between the right-eye cursor image and the left-eye cursor image when the stereoscopic cursor is moved in the depth direction according to the operation
  • the parallax amount is set to be equal to or smaller than the threshold
  • the depth position of the subject in the stereoscopic display space is calculated with the calculated parallax amount.
  • the display positions of the two subject images may be adjusted so as to move in the direction opposite to the moving direction of the three-dimensional cursor by an amount corresponding to the difference from the threshold value.
  • the parallax amount between the two subject images can be set to the threshold value.
  • the threshold value can be set to a value such that the parallax angle of the three-dimensional cursor is 1 ° or less.
  • enlargement processing may be performed on the two subject images, and an enlarged stereoscopic display may be performed using the two subject images on which the enlargement processing has been performed.
  • the stereoscopic cursor may be fixedly displayed at a predetermined position in the stereoscopic display space.
  • a display surface of a stereoscopic display means for performing stereoscopic display can be cited.
  • the display positions of the two subject images are adjusted by an amount corresponding to at least a part of the movement amount of the stereoscopic cursor by the above operation, and
  • the display position of the cursor image for each eye may be adjusted by an amount corresponding to the remainder excluding at least a part.
  • At least a part of the movement amount of the stereoscopic cursor and the remaining distribution excluding the part may be determined according to the degree of enlargement / reduction of the subject displayed stereoscopically. Specifically, when the subject is enlarged to some extent, the observer feels like observing the subject from the inside, and therefore it is preferable to move the subject in accordance with the movement operation of the three-dimensional cursor. On the other hand, when the subject is not enlarged or reduced, the observer feels like observing the subject from a bird's-eye view. Therefore, the stereoscopic cursor is moved according to the movement operation of the stereoscopic cursor. Is preferred.
  • the moving direction of the stereoscopic cursor can be a three-dimensional direction including the vertical, horizontal, and depth directions in the stereoscopic display space.
  • the display positions of the two subject images to be stereoscopically displayed are adjusted so that the subject moves in the direction opposite to the moving direction of the stereoscopic cursor by the moving operation of the stereoscopic cursor.
  • the stereoscopic cursor can be moved relatively by moving the subject existing around the stereoscopic cursor in the stereoscopic display space in accordance with the movement operation of the stereoscopic cursor, and the movement amount of the stereoscopic cursor itself is reduced. Therefore, the observer can adjust the focal length for tracking the three-dimensional cursor and reduce the number of times of convergence, thereby reducing the eyestrain of the observer.
  • the parallax amount is set to the threshold value or less and stereoscopic display is performed.
  • the display position of the two subject images is adjusted so that the depth position of the subject in the space moves in the direction opposite to the moving direction of the three-dimensional cursor by an amount corresponding to the difference between the parallax amount and the threshold value.
  • the stereoscopic cursor can always be stereoscopically viewed, and the stereoscopic cursor can be displayed at a desired position in the stereoscopic image.
  • the stereoscopic cursor when the stereoscopic cursor is fixedly displayed at a predetermined position in the stereoscopic display space, the stereoscopic cursor itself does not move at all, so the observer can adjust the focal length to follow the stereoscopic cursor. And it is not necessary to repeatedly perform congestion, and the effect of reducing eye fatigue becomes more prominent.
  • the fixed position of the stereoscopic cursor is the display surface of the stereoscopic display means for performing stereoscopic display, there is no discrepancy between the adjustment of the focal length and the convergence at the position of the stereoscopic cursor. The burden on the observer is further reduced.
  • the display positions of the two subject images are adjusted by an amount corresponding to at least a part of the movement amount of the three-dimensional cursor according to the above operation, and the remaining amount obtained by removing the at least one part from the movement amount of the three-dimensional cursor.
  • the display position of the cursor image for each eye is adjusted by a corresponding amount, and at least a part of the movement amount of the stereoscopic cursor and the remaining distribution excluding the part thereof are stereoscopically displayed.
  • FIG. 1 is a schematic configuration diagram of a breast image photographing display system using an embodiment of a stereoscopic image display device of the present invention.
  • photography display system shown in FIG. 1 is a block diagram showing a schematic configuration inside a computer of the breast image capturing and displaying system shown in FIG.
  • the figure which shows an example of the wheel mouse which moves the position of a solid cursor to the depth direction The flowchart for demonstrating the effect
  • the figure which shows an example of the radiographic image for right eyes, the radiographic image for left eyes, and a stereo image typically The figure which shows typically an example of the enlarged radiographic image for right eyes, the radiographic image for left eyes, and a stereo image
  • the figure for demonstrating the threshold value preset by a solid cursor display control part The figure which showed the figure which looked at the monitor in which the stereoscopic cursor and the stereo image were displayed from the upper part 9 illustrates adjustment of the parallax amount between the right-eye cursor image and the left-eye cursor image corresponding to the positions I, II, and III of the three-dimensional cursor illustrated in FIG. 9 and the parallax amount between the right-eye radio image and the left-eye radio image.
  • FIG. 1 Figure of The figure which showed typically the details of the processing which adjusts the display position of the radiographic image for the right eye and the radiographic image for the left eye in order to move the stereo image of the breast to the back
  • the first embodiment of the present invention limits the movement range of the stereoscopic cursor to the near side in the depth direction in the stereoscopic display space to the stereoscopic establishment limit position, and moves the stereoscopic cursor to the front of the stereoscopic establishment limit position.
  • the movement of the three-dimensional cursor is controlled so as to relatively move the breast stereo image as the subject.
  • FIG. 1 is a diagram showing a schematic configuration of the whole mammography / display system according to the first embodiment of the present invention.
  • the mammography and display system of the present embodiment includes a mammography apparatus 1, a computer 2 connected to the mammography apparatus 1, a monitor 3 and an input unit 4 connected to the computer 2. And.
  • the mammography apparatus 1 includes a base 21, a rotary shaft 12 that can move in the vertical direction (Z direction) with respect to the base 21, and can rotate.
  • the arm part 13 connected with the base 21 is provided.
  • FIG. 2 shows the arm 13 viewed from the right direction in FIG.
  • the arm portion 13 has an alphabet C shape, and a radiation source unit 16 is attached to one end of the arm portion 13 so as to face the imaging table 14 at the other end.
  • the movement of the arm part 13 in the vertical direction is controlled by an arm controller 31 incorporated in the base 21.
  • a radiographic image detector 15 such as a flat panel detector and a detector controller 33 that controls reading of a charge signal from the radiographic image detector 15 are provided inside the imaging table 14.
  • a charge amplifier that converts the charge signal read from the radiation image detector 15 into a voltage signal
  • a correlated double sampling circuit that samples the voltage signal output from the charge amplifier
  • a circuit board provided with an AD conversion unit for converting a voltage signal into a digital signal is also installed.
  • the radiographic image detector 15 can repeatedly perform recording and reading of radiographic images, and a so-called direct conversion type radiographic image detector that directly receives radiation and generates charges may be used.
  • a so-called indirect conversion type radiation image detector that converts radiation once into visible light and converts the visible light into a charge signal may be used.
  • a radiation image signal reading method a radiation image signal is read by turning on / off a TFT (thin film transistor) switch, or by irradiating reading light. It is desirable to use a so-called optical readout system from which a radiation image signal is read out, but the present invention is not limited to this, and other systems may be used.
  • a radiation source 17 and a radiation source controller 32 are accommodated in the radiation source unit 16.
  • the radiation source controller 32 controls the timing of irradiating radiation from the radiation source 17 and the radiation generation conditions (tube current, time, tube voltage, etc.) in the radiation source 17.
  • a compression plate 18 that is arranged above the imaging table 14 and presses against the breast, a support unit 20 that supports the compression plate 18, and a support unit 20 in the vertical direction.
  • a moving mechanism 19 for moving is provided. The position of the compression plate 18 and the compression pressure are controlled by the compression plate controller 34.
  • the computer 2 includes a central processing unit (CPU) and a storage device such as a semiconductor memory, a hard disk, and an SSD, and controls as shown in FIG. 3 by these hardware and software running on the hardware.
  • a unit 40, a radiation image storage unit 41, an enlargement / reduction processing unit 42, a radiation image display control unit 43, and a three-dimensional cursor display control unit 44 are configured.
  • the control unit 40, the enlargement / reduction processing unit 42, the radiation image display control unit 43, and the three-dimensional cursor display control unit 44 are realized by executing a program installed from a recording medium such as a CD-ROM.
  • the program may be installed after being downloaded from a storage device of a server connected via a network such as the Internet.
  • the control unit 40 outputs predetermined control signals to the various controllers 31 to 35, controls the flow of processing between the respective units 41 to 44 in the computer 2, and the monitor 3 and the input unit 4
  • the radiation image storage unit 41 stores in advance two radiation image signals detected by the radiation image detector 15 by photographing from two different photographing directions.
  • the enlargement / reduction processing unit 42 performs enlargement processing or reduction processing on the two radiation image signals stored in the radiation image storage unit 41 in accordance with the enlargement display instruction or the reduction display instruction received by the input unit 4. is there.
  • the radiographic image display control unit 43 performs predetermined signal processing on the radiographic image signal read from the radiographic image storage unit 41 and then displays a stereo image of the breast of the subject M on the monitor 3. is there.
  • the radiation image display control unit 43 responds to the two radiation image signals subjected to the enlargement process or the reduction process in the enlargement / reduction processing unit 42 according to the enlargement display instruction or the reduction display instruction received by the input unit 4. After performing predetermined signal processing, the enlarged stereo image of the breast or the reduced stereo image of the breast is displayed on the monitor 3.
  • the three-dimensional cursor display control unit 44 generates a right-eye cursor image signal and a left-eye cursor image signal that form a three-dimensional cursor and has a relative parallax amount in the left-right direction, and displays them on the monitor 3 respectively.
  • a stereoscopic cursor capable of stereoscopic viewing is displayed.
  • the stereoscopic cursor display control unit 44 moves the stereoscopic cursor displayed on the monitor 3 in the depth direction and the in-plane direction of the stereo image in response to an input from the input unit 4 by the observer.
  • the in-plane direction refers to an in-plane direction orthogonal to the depth direction.
  • the depth direction is the Z direction, it means a direction in the XY plane orthogonal to the Z direction.
  • the three-dimensional cursor display control unit 44 changes the right and left parallax amounts of the right-eye cursor image signal and the left-eye cursor image signal in accordance with the input from the input unit 4 to change the three-dimensional cursor. It is moved in the depth direction. Further, the three-dimensional cursor display control unit 44 changes the display positions of the right-eye cursor image signal and the left-eye cursor image signal in accordance with the input from the input unit 4 while maintaining the relative left and right shift amounts.
  • the stereoscopic cursor is moved in the in-plane direction by changing in the horizontal direction and the vertical direction.
  • a threshold value for the amount of parallax between the right-eye cursor image signal and the left-eye cursor image signal is set in advance. If the amount of parallax between the right-eye cursor image signal and the left-eye cursor image signal is greater than or equal to a preset threshold due to the movement of the three-dimensional cursor by the input from the input unit 4, the notification signal is sent to that effect. The amount of parallax is output to the radiation image display control unit 43.
  • the radiological image display control unit 43 performs the parallax between the two radiographic image signals so that the depth position of the stereo image moves in the direction opposite to the moving direction of the three-dimensional cursor based on the input notification signal and the parallax amount. The amount is adjusted, and the operation will be described in detail later.
  • the threshold value preset in the three-dimensional cursor display control unit 44 will be described.
  • the threshold value d_limit is set so that the parallax angle ( ⁇ ) shown in FIG. 8 is 1 ° or less.
  • 8 can be represented by the observation distance D between the monitor 3 and the observer and the binocular distance d of the observer, and these values are Since it is set in advance, the convergence angle ⁇ can also be calculated in advance. Further, the convergence angle ⁇ when viewing a stereoscopically displayed object based on the binocular parallax shown in FIG. 8 can be represented by the observation distance D, the binocular distance d, and the threshold value d_limit, as described above.
  • a threshold value d_limit that satisfies ( ⁇ ) ⁇ 1 ° can be calculated from these values.
  • the input unit 4 is configured by a pointing device such as a keyboard and a mouse, for example, and receives an input of shooting conditions, a shooting start instruction, and the like by a photographer.
  • a wheel mouse 51 as shown in FIG. 4 is used to move the position of the three-dimensional cursor in the depth direction.
  • the wheel mouse 51 includes a rotating wheel 52, and the position of the three-dimensional cursor in the depth direction is changed by rotating the rotating wheel 52 by an observer.
  • the monitor 3 displays a stereo image using the two radiation image signals output from the computer 2 and displays a stereoscopic cursor on the stereo image.
  • the monitor 3 includes two monitors.
  • the radiographic images based on the two radiographic image signals are displayed, and one of these radiographic images is made incident on the right eye of the observer by using a half mirror or polarizing glass, and the other radiographic image is displayed by the observer.
  • a configuration in which a stereo image is displayed by being incident on the left eye can be employed.
  • two radiographic images may be displayed by being shifted by a predetermined amount of parallax, and the stereo images may be generated by observing them with a polarizing glass, or a parallax barrier method and a lenticular method
  • a stereo image may be generated by displaying two radiation images on a stereoscopically viewable 3D liquid crystal.
  • the patient's breast M is placed on the imaging table 14, and the breast M is compressed with a predetermined pressure by the compression plate 18 (S10).
  • the first radiographic image of the two radiographic images constituting the stereo image of the breast M is captured (S12).
  • the control unit 40 reads a preset convergence angle ⁇ for capturing a stereo image, and outputs the read information about the convergence angle ⁇ to the arm controller 31.
  • the convergence angle ⁇ represents the convergence angle when the center of the monitor surface is viewed.
  • radiation irradiation is performed with respect to the normal line of the detection surface of the radiation image detector 15. This represents the magnitude of the angle formed by the axes, that is, the shooting angle.
  • ⁇ 4 ° is stored in advance as information on the convergence angle ⁇ at this time.
  • the present invention is not limited to this, and an arbitrary convergence angle can be set by the photographer in the input unit 4.
  • the arm controller 31 receives the information of the convergence angle ⁇ output from the control unit 40, and the arm controller 31 first has the arm unit 13 in a direction perpendicular to the imaging table 14, as shown in FIG.
  • the control signal is output as follows.
  • the control unit 40 notifies the radiation source controller 32 and the detector controller 33.
  • a control signal is output so as to perform radiation irradiation and readout of a radiographic image signal.
  • radiation is emitted from the radiation source 17, a radiation image obtained by photographing the breast from the 0 ° direction is detected by the radiation image detector 15, and a radiation image signal is read by the detector controller 33.
  • the radiographic image signal is stored in the radiographic image storage unit 41 of the computer 2 after being subjected to predetermined signal processing.
  • the arm controller 31 outputs a control signal so as to rotate the arm unit 13 by + ⁇ ° with respect to a direction perpendicular to the imaging table 14. That is, in the present embodiment, the control signal is output so that the arm unit 13 is rotated by 4 ° with respect to the direction perpendicular to the imaging table 14.
  • the control unit 40 applies radiation to the radiation source controller 32 and the detector controller 33 and the radiation image signal.
  • a control signal is output so as to read out.
  • radiation is emitted from the radiation source 17, a radiation image obtained by photographing the breast from the 4 ° direction is detected by the radiation image detector 15, and the radiation image signal is read by the detector controller 33.
  • predetermined signal processing it is stored in the radiation image storage unit 41 of the computer 2.
  • FIG. 6 is a diagram schematically illustrating an example of a right-eye radiation image, a left-eye radiation image, and a stereo image.
  • the three-dimensional cursor display control unit 44 displays the right-eye cursor image CR and the left-eye cursor image CL to display the three-dimensional cursor CG.
  • FIG. 7 is a diagram schematically illustrating an example of an enlarged right-eye radiographic image, left-eye radiographic image, and stereo image.
  • the amount of parallax between the two radiographic image signals is increased according to the enlargement ratio, so that the stereo image from the monitor surface is displayed as shown in FIG.
  • the pop-out amount also increases.
  • the range in which the observer moves the stereoscopic cursor CG in the depth direction on the stereo image also becomes large. For example, if the stereoscopic cursor CG is moved too far, that is, for the right eye constituting the stereoscopic cursor CG. If the amount of parallax between the cursor image CR and the left-eye cursor image CL is too large, stereoscopic viewing becomes difficult and it becomes difficult to grasp the position of the stereoscopic cursor CG.
  • the stereoscopic cursor display control unit 44 moves to the position in the depth direction of the stereoscopic cursor CG after the movement. It is determined whether or not the amount of parallax between the corresponding right-eye cursor image CR and left-eye cursor image CL is equal to or greater than the threshold value d_limit described above (S22).
  • the stereoscopic cursor display control unit 44 uses the current parallax amount as it is and the right-eye cursor image CR and the left-eye cursor image. CL is displayed (S22, YES).
  • the stereoscopic cursor display control unit 44 determines that the amount of parallax between the right-eye cursor image CR and the left-eye cursor image CL is greater than or equal to the threshold value d_limit, a notification signal indicating that fact and the amount of parallax are displayed as a radiographic image. While outputting to the control part 43, the parallax amount of the cursor image CR for right eyes and the cursor image CL for left eyes is set to threshold value d_limit (S26). Thereby, the stereoscopic cursor CG can be appropriately stereoscopically viewed.
  • the radiographic image display control part 43 will adjust the parallax amount of the radiographic image for right eyes and the radiographic image for left eyes based on the input parallax amount, if the notification signal and parallax amount which were mentioned above are input (S28). ).
  • FIG. 9 is a diagram schematically showing a view of the monitor 3 on which the stereoscopic cursor CG and the stereo image of the breast are displayed
  • FIG. 10 shows the positions I and II of the stereoscopic cursor CG shown in FIG. , III are diagrams for explaining the adjustment of the parallax amount between the right-eye cursor image CR and the left-eye cursor image CL and the parallax amount between the right-eye radiographic image and the left-eye radiographic image.
  • the right-eye cursor image CR and the left-eye cursor image CL are represented by circles for easy viewing.
  • the positions of the stereoscopic cursor CG after moving by the movement amount of the stereoscopic cursor CG input by the observer are positions I and II that are on the far side from the stereoscopic vision establishment limit position.
  • the stereoscopic cursor CG is displayed at the same position, and the right-eye radiographic image and the left-eye radiographic image are displayed as shown in FIG.
  • the display is performed without changing the depth position of the stereo image of the breast without changing the amount of parallax.
  • the stereoscopic vision establishment limit position is the position of the stereoscopic cursor CG when the parallax amount between the right-eye cursor image CR and the left-eye cursor image CL is the above-described threshold value d_limit.
  • the stereoscopic cursor display control unit 44 does not move by the movement amount input by the observer, and sets the parallax amount between the right-eye cursor image CR and the left-eye cursor image CL as shown in FIG.
  • the stereoscopic cursor CG is displayed at the stereoscopic vision establishment limit position III ′ as shown in FIG.
  • the radiological image display control unit 43 sets the parallax amount between the right-eye radiographic image and the left-eye radiographic image so that the stereo image of the breast is moved in the depth direction by the amount the stereoscopic cursor CG is returned in the depth direction. adjust. That is, as shown in FIG. 9, the depth position of the stereo image of the breast is moved in the direction opposite to the direction in which the observer tried to move the stereoscopic cursor CG.
  • the stereoscopic cursor display calculates a parallax amount d1 between the cursor image CR for the right eye and the cursor image CL for the left eye according to the depth position III of the stereoscopic cursor CG as shown in FIG. 10, and displays the parallax amount d1 as a radiation image display. Output to the control unit 43.
  • the radiation image display control unit 43 based on the input parallax amount d1, the threshold value d_limit, and the preset parallax amount d2 between the right-eye radiographic image and the left-eye radiographic image, as shown in FIG.
  • the radiological image display control unit 43 changes the parallax amount between the right-eye radiographic image and the left-eye radiographic image from d2 to d2 ′, that is, by reducing the parallax amount, as shown in FIG.
  • the depth position of the stereo image is moved in the depth direction.
  • FIG. 11 schematically shows details of the process of reducing the parallax amount between the right-eye radiographic image and the left-eye radiographic image.
  • the figure shows the right-eye radiation image MR, the left-eye radiation image ML, the right-eye cursor image CR, and the left-eye cursor image CL displayed on the monitor surface MTR of the monitor 3 from the left eye EL and right eye ER of the observer.
  • the radiographic images MR and ML for eyes and the cursor images CR and CL for eyes are shown not to overlap each other in the monitor surface MTR. It is displayed in a superimposed manner on the MTR.
  • the radiographic image display control unit 43 performs image shift processing for adjusting the display position so that the interval between the radiographic image MR for the right eye and the radiographic image CL for the left eye is made closer, so that The amount of parallax between the radiographic image CR and the left-eye radiographic image CL is changed from d2 to d2 ′ (reduced).
  • the depth position of the breast stereo image MG moves toward the back, and the distance between the stereoscopic cursor CG and the breast stereo image MG increases. Therefore, the movement of the stereoscopic cursor CG in the forward direction is expressed by the relative movement of the stereoscopic cursor CG and the breast stereo image MG without moving the stereoscopic cursor CG to the front of the depth position III.
  • the radiation image display control unit 43, the display positions of the right-eye radiographic image MR and the left-eye radiographic image ML can be adjusted so that the breast stereo image MG moves in the direction opposite to the moving direction of the three-dimensional cursor CG.
  • the stereoscopic cursor CG can be moved relatively by moving the breast stereo image MG existing around the stereoscopic cursor CG in the stereoscopic display space in accordance with the movement operation of the stereoscopic cursor CG. Since the amount of movement of the cursor CG itself can be reduced, the observer can adjust the focal length for tracking the three-dimensional cursor CG and the number of times of convergence, thereby reducing the eyestrain of the observer.
  • the depth position of the stereoscopic cursor CG and the stereo image MG of the breast are adjusted so that the depth position of the stereoscopic cursor CG does not exceed the stereoscopic vision establishment limit position, so that the stereoscopic cursor CG is always displayed in a stereoscopic view.
  • the relative position of the stereoscopic cursor CG with respect to the breast stereo image MG can be set to a desired position.
  • the operation of moving the stereoscopic cursor CG further forward is performed when the stereoscopic cursor CG is at the stereoscopic vision establishment limit position.
  • the depth position of the stereoscopic image MG of the breast is moved to the back by the amount corresponding to the moving operation amount of the stereoscopic cursor CG while the depth position of the stereoscopic cursor CG is fixed at the stereoscopic vision establishment limit position.
  • the three-dimensional cursor CG may be moved to the back according to the movement operation amount.
  • the depth position of the breast stereo image MG may move toward the back, but not move toward the front. Therefore, for example, when the operation of moving the stereoscopic cursor CG forward beyond the stereoscopic vision establishment limit position is repeatedly performed, the depth position of the breast stereo image MG is repeated. Is repeatedly moved toward the back.
  • the stereoscopic vision establishment limit is set.
  • the depth position of the stereo image MG of the breast is moved to the back according to the movement operation amount (excess movement operation amount) that exceeds the position, and the excess movement operation amount is stored in the memory of the computer 2.
  • the depth position of the stereoscopic cursor CG may be moved to the front without being moved.
  • the excess movement operation amount is given a sign so that the positive / negative direction is reversed depending on the movement direction, for example, the forward movement operation amount is positive and the backward movement operation amount is negative. It is cumulatively added for each movement operation in the depth direction.
  • the depth position of the breast stereo image MG can be determined by repeating the operation of moving the stereoscopic cursor CG forward beyond the stereoscopic vision establishment limit position and then moving the stereoscopic cursor CG forward. Then, it moves toward the back according to the former operation, and moves toward the near side according to the latter operation.
  • the excess movement operation amount is 0, the depth position of the breast stereo image MG is controlled to return to the original position, that is, the depth position when the stereoscopic cursor CG reaches the stereoscopic vision establishment limit position. Can do.
  • the depth position of the stereoscopic cursor CG when the depth position of the stereoscopic cursor CG is behind the stereoscopic vision establishment limit position, control is performed so that only the stereoscopic cursor CG is moved, but the stereoscopic cursor CG and the breast stereo are controlled.
  • the movement ratio of the depth position of the image MG may be controlled to change according to the depth position of the stereoscopic cursor CG (or the stereo image MG of the breast). Alternatively, the movement ratio may be changed according to the magnification ratio of the stereo image.
  • FIG. 14 schematically shows an example of the control method.
  • the movement operation amount is calculated based on the movement ratio defined stepwise according to the depth position.
  • the three-dimensional cursor CG and the breast stereo image MG are moved according to the distributed movement operation amount.
  • the stereoscopic cursor CG moves to the front and the breast stereo image MG moves to the back.
  • the depth position before the movement operation of the stereoscopic cursor CG is at the stereoscopic vision establishment limit position, only the breast stereo image MG is moved according to the movement operation amount.
  • the stereoscopic cursor CG moves to the stereoscopic establishment limit position, The depth position of the breast stereo image MG is moved to the back by the amount of movement operation that exceeds the vision establishment limit position.
  • the stereoscopic cursor display control unit 44 displays the stereoscopic cursor CG.
  • the display position of the stereoscopic cursor images CR and CL for each eye may be adjusted so that the position in the in-plane direction is moved according to the operation.
  • the display position of the stereoscopic cursor CG is fixed, and the radiation image display control unit 43 moves the right eye so that the breast stereo image MG moves in the direction opposite to the moving direction of the stereoscopic cursor CG.
  • the display positions of the radiographic image MR and the left-eye radiographic image ML may be adjusted. Details of the latter adjustment method will be described in detail with reference to FIG. 16 in the second embodiment.
  • the stereoscopic cursor is fixedly displayed at a predetermined position in the stereoscopic display space, and the stereo image of the breast that is the subject is relatively moved according to the movement operation of the stereoscopic cursor. In this way, the movement of the three-dimensional cursor is controlled.
  • the configuration of the breast image radiographing display system of the present embodiment is substantially the same as that of the first embodiment.
  • the operation of the mammography radiographing display system of the present embodiment will be described using the flowchart shown in FIG. Differences from the first embodiment will be described in detail.
  • the patient's breast M is placed and compressed (S10), the first radiographic image is captured (S12), and the second radiographic image is captured (S14).
  • the three-dimensional cursor display control unit 44 determines the initial position of the three-dimensional cursor CG by obtaining a parameter that defines the initial display position of the three-dimensional cursor CG from the initial setting file (S15). .
  • the initial position of the stereoscopic cursor CG is on the near side of the monitor surface MTR of the monitor 3 and on the far side of the stereoscopic vision establishment limit position, as schematically shown in FIGS. It is assumed that a predetermined position is set. Note that a user interface for setting the initial position may be provided, and the initial position may be determined based on the input of the user (observer).
  • the breast stereo image MG and the stereoscopic cursor CG are displayed (S16)
  • the breast stereo image MG is enlarged and displayed (S18).
  • the stereoscopic cursor display control unit 44 does not perform control to move the display position of the stereoscopic cursor CG.
  • the radiological image display control unit 43 adjusts the display positions of the right-eye radiographic image MR and the left-eye radiographic image ML so that the breast stereo image MG moves in the direction opposite to the moving direction of the three-dimensional cursor CG ( S30).
  • FIG. 16 shows the details of the process of adjusting the display positions of the right-eye radiographic image and the left-eye radiographic image in the same manner as in FIG. 11 when the operation of moving the stereoscopic cursor CG leftward in the in-plane direction is performed.
  • This is a schematic representation.
  • the upper half of the figure represents the state before the display position of the radiation image for each eye is changed, and the lower half represents the position after the display position is changed.
  • the radiation image display control unit 43 performs the right-eye radiation image MR and the left-eye radiation image.
  • the display position of CL is adjusted to the right which is the direction opposite to the moving operation direction of the three-dimensional cursor CG.
  • the stereoscopic cursor CG moves leftward by relative movement of the stereoscopic cursor CG and the breast stereo image MG while the display position of the stereoscopic cursor CG is fixed. Is expressed.
  • This image shift process can be similarly applied when it is desired to move the three-dimensional cursor CG in an arbitrary direction in the plane.
  • the radiographic image display control unit 43 moves the display positions of both the right-eye radiographic image MR and the left-eye radiographic image CL in the direction opposite to the direction in which the in-plane movement operation is performed on the stereoscopic cursor CG. Control may be performed.
  • FIG. 17 schematically illustrates the details of the process of adjusting the display positions of the right-eye radiographic image and the left-eye radiographic image when an operation of moving the stereoscopic cursor CG toward the back is performed, as in FIG. It is a representation.
  • the upper half of the figure represents the state before the display position of the radiation image for each eye is changed, and the lower half represents the position after the display position is changed.
  • the radiation image display control unit 43 displays the right-eye radiation image MR and the left-eye radiation image MR.
  • the amount of parallax between the radiographic image CR for the right eye and the radiographic image CL for the left eye is changed (increased).
  • the depth position of the breast stereo image MG moves toward the front, and the distance between the stereoscopic cursor CG and the breast stereo image MG approaches. Therefore, the movement toward the back of the stereoscopic cursor CG is expressed by the relative movement of the stereoscopic cursor CG and the breast stereo image MG while the display position of the stereoscopic cursor CG is fixed.
  • the stereoscopic cursor CG is fixedly displayed at a predetermined position in the stereoscopic display space, and the radiation image display is performed. Since the control unit 43 adjusts the display positions of the right-eye radiographic image MR and the left-eye radiographic image ML so that the stereo image MG of the breast moves in the direction opposite to the moving operation direction of the three-dimensional cursor CG.
  • the stereoscopic cursor CG itself does not move at all, and the observer does not have to repeatedly adjust the focal length and follow up the tracking of the stereoscopic cursor CG, and the effect of reducing eye fatigue becomes more prominent.
  • the fixed position of the three-dimensional cursor is the monitor surface MTR of the monitor 3.
  • the display position of the three-dimensional cursor CG may be fixed and released by a user operation. Specifically, for example, after the stereoscopic cursor CG and the breast stereo image MG are stereoscopically displayed at the initial position in step S16 of FIG. Move the cursor CG in the stereoscopic display space, display the menu at the desired position by right-clicking the mouse, etc., and select “Fix 3D cursor position” to fix the display position of the 3D cursor CG. What should I do? Similarly, when releasing the fixation of the display position of the three-dimensional cursor CG, the user may select “cancel fixation of the position of the three-dimensional cursor” from the menu.
  • the adjustment of the display position of the stereoscopic cursor CG and the stereo image of the breast when the stereo image is magnified is described.
  • the adjustment is not limited to the case where the stereo image is magnified and displayed. The same can be applied when an image is displayed at the same magnification.
  • the enlargement / reduction ratio of the stereoscopic display target breast it may be determined.
  • the enlargement / reduction rate of the breast to be stereoscopically displayed the enlargement / reduction rate in the enlargement / reduction processing performed by the enlargement / reduction processing unit 42 may be acquired, or in the imaging system, the radiation source 17 may be acquired.
  • the enlargement ratio at the time of photography may be acquired.
  • stereoscopic display of the subject and the stereoscopic cursor can be performed according to the relationship between the observer (stereoscopic cursor CG) and the size of the breast in the stereoscopic display space.
  • the observer feels like observing the breast from the inside, so it is preferable to move the breast according to the movement operation of the three-dimensional cursor CG.
  • the stereoscopic cursor CG is moved according to the movement operation of the stereoscopic cursor CG. It is more preferable that
  • the stereoscopic image display apparatus of the present invention is applied to a breast image capturing and displaying system.
  • the subject is not limited to the breast, and the chest other than the breast (heart, lungs) Etc.), or a radiographic imaging device for so-called general imaging for imaging the head or the like. Further, it may be an endoscopic image.
  • control of the stereoscopic cursor in the present invention may be applied to a targeting operation in stereo biopsy.
  • the monitor 3 on which stereoscopic display is performed uses a polarizing filter type, but may be a frame sequential type or a naked eye type.
  • radiographic images for stereoscopic display are taken by changing the radiation irradiation direction in the XZ plane shown in FIG. 2, but radiation irradiation is performed in the other directions.
  • a plurality of radiation images may be taken by changing the direction. That is, for example, a plurality of radiographic images may be taken by changing the radiation irradiation direction in the YZ plane (plane perpendicular to the paper surface of FIG. 2) shown in FIG.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Mathematical Physics (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

L'invention concerne la réduction de la fatigue des yeux de l'observateur liée au déplacement d'un curseur 3D, qui consiste en ce que, dans un espace d'affichage en 3D dans lequel l'affichage en 3D est exécuté, on reçoit une opération de déplacement d'un curseur 3D (CG) par rapport à un objet (MG), et les positions d'affichage de deux images d'objet (MR, ML) sont réglées de manière que l'objet (MG) se déplace dans la direction du mouvement et dans la direction opposée du curseur 3D (CG).
PCT/JP2011/006068 2010-10-29 2011-10-28 Procédé d'affichage d'image 3d, dispositif de commande d'affichage en 3d, et programme associé WO2012056721A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US40839010P 2010-10-29 2010-10-29
US61/408,390 2010-10-29
US201161440183P 2011-02-07 2011-02-07
US61/440,183 2011-02-07

Publications (1)

Publication Number Publication Date
WO2012056721A1 true WO2012056721A1 (fr) 2012-05-03

Family

ID=45993465

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/006068 WO2012056721A1 (fr) 2010-10-29 2011-10-28 Procédé d'affichage d'image 3d, dispositif de commande d'affichage en 3d, et programme associé

Country Status (1)

Country Link
WO (1) WO2012056721A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS577514B2 (fr) * 1976-06-09 1982-02-10
JPH031217A (ja) * 1989-05-29 1991-01-07 Olympus Optical Co Ltd 立体画像処理装置
JP2001318665A (ja) * 2000-05-11 2001-11-16 Matsushita Electric Ind Co Ltd 表示制御装置および表示制御方法
JP2004354540A (ja) * 2003-05-28 2004-12-16 Sanyo Electric Co Ltd 立体映像表示装置及びプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS577514B2 (fr) * 1976-06-09 1982-02-10
JPH031217A (ja) * 1989-05-29 1991-01-07 Olympus Optical Co Ltd 立体画像処理装置
JP2001318665A (ja) * 2000-05-11 2001-11-16 Matsushita Electric Ind Co Ltd 表示制御装置および表示制御方法
JP2004354540A (ja) * 2003-05-28 2004-12-16 Sanyo Electric Co Ltd 立体映像表示装置及びプログラム

Similar Documents

Publication Publication Date Title
JP5486437B2 (ja) 立体視画像表示方法および装置
US20130300737A1 (en) Stereoscopic image generating apparatus, stereoscopic image generating method, and stereoscopic image generating program
JP2012050605A (ja) Ｘ線画像撮影装置、ｘ線画像撮影方法およびプログラム
WO2012056695A1 (fr) Dispositif d'affichage d'image tridimensionnelle, procédé et programme associés
JP5658818B2 (ja) 放射線乳房画像表示方法、放射線乳房画像表示装置ならびにプログラム
WO2012056721A1 (fr) Procédé d'affichage d'image 3d, dispositif de commande d'affichage en 3d, et programme associé
WO2012105188A1 (fr) Dispositif, procédé et programme pour afficher une image stéréoscopique
JP5946070B2 (ja) 画像再生システムおよび画像ファイル生成装置
WO2012102022A1 (fr) Procédé d'affichage d'image stéréoscopique, et programme et appareil de commande d'affichage d'image stéréoscopique
WO2012066753A1 (fr) Dispositif et procédé d'affichage d'une image stéréoscopique
JP2012068610A (ja) 立体視画像表示装置、放射線画像撮影表示システムおよび立体視画像表示方法
WO2012056679A1 (fr) Système et dispositif d'affichage d'images 3d
WO2012043480A1 (fr) Procédé d'affichage d'image en stéréovision et dispositif d'affichage d'image en stéréovision
WO2012132320A1 (fr) Appareil d'affichage d'image stéréoscopique et procédé d'affichage d'image stéréoscopique
WO2012043547A1 (fr) Procédé d'affichage d'image stéréoscopique et dispositif d'affichage d'image stéréoscopique
WO2012056718A1 (fr) Dispositif d'affichage d'image radiologique tridimensionnelle, procédé et programme associés
WO2012029705A1 (fr) Dispositif et procédé d'envoi d'images
JP2012178626A (ja) 立体視放射線画像表示方法および装置
WO2012096221A1 (fr) Appareil et procédé d'affichage de radiographies
JP2012095274A (ja) 立体視画像表示装置および立体視画像表示方法
WO2012029726A1 (fr) Procédé et appareil d'imagerie/affichage d'une image des seins
WO2013024572A1 (fr) Dispositif de reproduction d'image, procédé de reproduction d'image, et programme
JP2012024516A (ja) 放射線画像撮影表示方法および装置
WO2012132453A1 (fr) Méthode, dispositif et programme d'affichage d'image radiologique des seins
WO2012114758A1 (fr) Dispositif et procédé d'imagerie radiographique

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11835865

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11835865

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP