JP2015043920A - Imaging support device, imaging system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable an operator of an imaging system to intuitively grasp imaging sensitivity distribution or an imageable area when performing set-up before imaging.SOLUTION: An imaging support device 1 comprises: a head-mounted display 5 mounted on the operator 91 and including a camera 51 for acquiring a real image in front of an eye of an operator 91, and a display part 55 for displaying a created image so that the operator 91 can view it by overlapping it with the real image; recognition means 601 for analyzing the image acquired by the camera 51 and recognizing at least part of the imaging system included in the image; specification means 605 for specifying imaging sensitivity distribution/an imageable area based on the recognition result; and creation means 609 which is the means for creating an image to be displayed in the display part 55, and creates an image which shows the imaging sensitivity distribution/the imageable area, and in which the imaging sensitivity distribution/the imageable area appear to be overlapped with the real image when displayed in the display part 55.

Description

  The present invention relates to a technique for supporting imaging in an imaging system that captures a tomographic image of a subject.

  2. Description of the Related Art Conventionally, in imaging systems such as a magnetic resonance imaging system and a radiation computed tomography system, a setup related to subject placement and imaging conditions is performed before imaging.

  For example, in a magnetic resonance imaging system, a coil that receives a magnetic resonance signal is arranged in accordance with an imaging region, and an imaging scheduled region is set within a coil sensitivity region in which the sensitivity of the coil is equal to or greater than a certain value (patent) Reference 1, paragraph [0042] etc.).

  Further, for example, in a radiation tomography system, a subject is placed on a bed, and an area in which the subject is desired to be imaged in a scanable range or FOV (Field Of View) in the body axis direction of the subject The subject is aligned so that is included.

JP 2013-5985 A

  However, the coil sensitivity distribution and coil sensitivity region in the magnetic resonance imaging system, the scanable range and the FOV (imaging field of view) in the radiation tomographic imaging system, etc. cannot be actually seen with the eyes, but must be grasped intuitively. I can't. For this reason, in particular, in the case of an operator with insufficient knowledge or an inexperienced operator, the set scheduled imaging region or the region to be captured may be out of the region suitable for imaging. In such a case, the image quality of the captured image may deteriorate, or the captured image may not include an area to be viewed, and in some cases, re-shooting may occur.

  Under such circumstances, there is a demand for a technique that allows an operator of an imaging system to intuitively grasp a region suitable for imaging when performing setup before imaging.

The invention of the first aspect
An imaging support apparatus for an imaging system that captures a tomographic image of a subject,
A camera (camera) that acquires an image of a real image in front of the operator's eyes; and a display unit that displays the generated image so that the operator can see the image superimposed on the real image. A head mount display worn by the person,
Recognizing means for analyzing an image acquired by the camera and recognizing at least a part of the imaging system included in the image;
A specifying means for specifying an imaging sensitivity distribution or an imageable region based on a recognition result by the recognition means;
A generating unit configured to generate an image to be displayed on the display unit, the imaging sensitivity distribution or the imageable region specified by the specifying unit, and when displayed on the display unit, the imaging sensitivity distribution or An imaging support apparatus is provided that includes generation means for generating an image in which an imageable region appears to overlap the real image.

The invention of the second aspect is
The generating means represents a set imaging planned area, and further generates an image that appears to overlap the real image when the imaging planned area is displayed on the display unit. An imaging support apparatus is provided.

The invention of the third aspect is
The head mounted display has a microphone,
The recognition means analyzes an image taken by the camera and recognizes the operator's hand or finger included in the image;
The imaging according to the first aspect or the second aspect, further comprising setting means for setting the imaging planned area based on the position of the hand or finger in response to a specific command voice obtained by the microphone. A support device is provided.

The invention of the fourth aspect is
The imaging support apparatus according to any one of the first to third aspects, wherein the generation unit generates an image representing the internal organs of the subject based on the position information of the subject.

The invention of the fifth aspect is
Imaging according to any one of the first to fourth aspects, wherein the generation unit generates an image representing a position where the member holding the subject is to be arranged based on a set imaging condition. A support device is provided.

The invention of the sixth aspect is
The imaging system is a magnetic resonance imaging system;
A part of the imaging system is a magnetic resonance signal receiving coil or a bed in which the coil is built in a predetermined position,
The imaging support device according to any one of the first to fifth aspects is provided, wherein the imageable area is a coil sensitivity area in which the sensitivity of the coil is equal to or higher than a certain level.

The invention of the seventh aspect
The imaging support apparatus according to the sixth aspect, in which the generation unit generates an image representing a position where the coil is to be arranged based on a set imaging condition.

The invention of the eighth aspect
The bed has a plurality of coils built-in,
The recognition means recognizes the position of the bed;
The imaging support apparatus according to the sixth aspect, in which the specifying unit specifies the coil sensitivity region according to a coil used for imaging in the plurality of coils.

The invention of the ninth aspect is
Provided is an imaging support apparatus according to the sixth to eighth aspects, wherein the generation means generates an image representing a coil to be used based on a set imaging condition.

The invention of the tenth aspect is
The imaging system is a radiation tomography system;
A part of the imaging system is a bed,
The imaging support apparatus according to any one of the first to fifth aspects, wherein the imageable area is an area defined by an FOV (imaging field of view) or a scanable range in the body axis direction of the subject. I will provide a.

The invention of the eleventh aspect is
An imaging system including the imaging support apparatus according to any one of the first to tenth aspects is provided.

The invention of the twelfth aspect is
A program for causing a computer to function as a recognition unit, a specifying unit, and a generation unit in the imaging support apparatus according to any one of the first to tenth aspects is provided.

  According to the invention of the above aspect, the imaging sensitivity distribution or the imageable area is represented, and when displayed on the display unit of the head mounted display worn by the operator, the area is a real image and real space in front of the operator's eyes. Since the images that appear to overlap each other are generated and displayed on the display unit, the operator of the imaging system can intuitively grasp the region suitable for imaging when performing setup before imaging. .

1 is a block diagram schematically showing the configuration of a magnetic resonance imaging system 1 according to a first embodiment. 4 is a diagram illustrating a configuration example of a head mounted display 5. FIG. FIG. 3 is a flowchart showing a setup flow before scanning in the magnetic resonance imaging system 1. It is a figure which shows an example of the image seen through the head mounted display 5 when the use coil guidance image G1 is displayed. It is a figure which shows an example of the image seen through the head mounted display 5 when the subject arrangement guide image G2 is displayed. 6 is a diagram illustrating an example of an image that can be seen through the head mounted display 5 when a subject 90 is placed on a cradle 31. FIG. It is a figure which shows an example of the image seen through the head mounted display 5 when the fixed pad arrangement | positioning guidance image G3 is displayed. It is a figure which shows an example of the image seen through the head mounted display 5 when the organ image G4 is displayed. It is a figure which shows an example of the image seen through the head mounted display 5 when the landmark image (Gland) image G5 and the scheduled scan area image G6 are displayed. It is a figure which shows an example of the image seen through the head mounted display 5 when a final landmark and a scan plan area | region are set. It is a figure which shows an example of the image seen through the head mounted display 5 when the coil arrangement | positioning guidance image G7 and the coil sensitivity area | region image G8 are displayed. It is a figure which shows an example of an image seen through the head mounted display 5 when the transmission / reception coil 4 is arrange | positioned. It is a block diagram showing roughly the composition of magnetic resonance imaging system 1 'concerning a second embodiment. It is a flow figure showing a flow of setup in magnetic resonance imaging system 1 '. It is a figure which shows an example of the image seen through the head mounted display 5 when the use coil element image G9 is displayed. It is a figure which shows an example of the image seen through the head mounted display 5 when the coil sensitivity area | region image G10 is displayed. 6 is a diagram illustrating an example of an image that can be seen through the head mounted display 5 when a subject 90 is placed on a cradle 31. FIG.

  Embodiments of the invention will be described below. Note that this does not limit the invention.

(First embodiment)
FIG. 1 is a block diagram schematically showing the configuration of a magnetic resonance imaging system 1 according to the first embodiment.

  As shown in FIG. 1, the magnetic resonance imaging system 1 includes a gantry 2, a bed 3, a transmission / reception coil 4, a head mounted display 5, a control unit 6, and an operation unit 7. .

  The gantry 2 has a cavity 21. The gantry 2 includes a magnet 21 (or magnet coil). A static magnetic field is formed in the cavity 22 by the magnet 21. The cavity 22 is an imaging space, and the subject 90 is transported.

  The bed 3 includes a cradle 31 on which the subject 90 is placed. The cradle 31 can move horizontally in the longitudinal direction of the bed 3, that is, in the body axis direction of the subject 90.

  The transmission / reception coil 4 is attached to the subject 90. The transmitting / receiving coil 4 transmits an excitation pulse (pulse) to the subject 90 and receives a magnetic resonance signal emitted from the subject 90. The transmitter / receiver coil 4 is prepared for a type suitable for each imaging region, such as for the head, for the chest, for the abdomen, and for the lower limbs.

The head mounted display 5 is a kind of wearable computer, and is an augmented reality AR (Augmented).
Reality) screen is provided to the operator 91.

  FIG. 2 shows a configuration example of the head mounted display 5. In this example, as shown in FIG. 2, the head mounted display 5 is a glasses type, and is worn by wearing glasses on the head of the operator 91. The head mounted display 5 includes a camera 51, a microphone 52, a touch operation unit 53, a first communication unit 54, and a display unit 55.

  The camera 51 acquires a real image in front of the operator 91 and outputs the image data. Here, the real image is a scene included in the field of view of the operator 91, that is, an image that the operator 91 actually sees. The microphone 52 collects the voice of the operator 91 and outputs the voice data. The touch operation unit 53 is an operation unit that is operated by a finger touch of the operator 91. The first communication unit 54 performs data communication with the control unit 6 wirelessly. Image data output from the camera 51, audio data output from the microphone 52, operation signals output from the touch operation unit 53, and the like are sent to the first communication unit 54. In addition, the first communication unit 54 sends the image data received from the control unit 6 to the display unit 55. The display unit 55 is disposed in front of the operator 91 and at a position close to the eye. The display unit 55 displays an image represented by the image data (CG (Computer Graphics), a photographic image, etc.) on a screen made of a transparent member such as plastic or glass in real space. Is displayed so as to overlap the real image.

The control unit 6 uses a scan protocol (scan
protocol) and scanning of the subject 90 are controlled. The control unit 6 reconstructs an image based on the magnetic resonance signal received by the transmission / reception coil 4. Further, the control unit 6 transmits / receives data to / from the head mounted display 5 in order to assist the imaging setting of the operator 91 before scanning. The control unit 6 can be realized by causing a computer to execute a predetermined program.

  The control unit 6 includes an image recognition unit 601, a subject arrangement specifying unit 602, a used coil specifying unit 603, an organ position specifying unit 604, a coil sensitivity region specifying unit 605, a coil arrangement specifying unit 606, and a scan schedule. An area specifying unit 607, a fixed pad arrangement specifying unit 608, an image generation unit 609, a voice recognition unit 610, a command processing unit 611, and a second communication unit 612 are included.

  The image recognition unit 601 analyzes the image data output from the camera 51 and recognizes at least a part of the magnetic resonance imaging system 1 and other objects included in the acquired image. Here, for example, a characteristic portion where the position of the gantry 2 or the bed 3 is fixed, a cradle 31 where the position is not fixed, the transmission / reception coil 4, the subject 90, the hand / finger of the operator 91, etc. are searched and recognized. . From these recognition results, the position and orientation (posture) of the operator 91 and the hand / finger of the operator 91 in the real space, the position and orientation of the cradle 31, the transmission / reception coil 4, and the subject 90 in the real space, the cradle 31. The relative position and orientation (posture) of the operator 91 with respect to the transmission / reception coil 4 and the subject 90 are specified.

  For image recognition, various methods such as a pattern recognition method or a feature extraction method can be used.

  For example, specific asymmetrical marks (f) that are different from each other on characteristic portions of the gantry 2 and the bed 3, the cradle 31, the transmission / reception coil 4, and the like are easily visible to the operator 91, that is, easily enter the field of view. It is attached to the position. In addition, three-dimensional shape data such as the gantry 2, the bed 3, the cradle 31, and the receiving coil 4 and the three-dimensional positional relationship between the mark f and the object with the mark f are stored. And in the image imaged with the camera 51, those marks f are searched and recognized, and the position, size, orientation, distortion, etc. of the marks f are specified. In this way, the operator 91 with respect to the gantry 2, the bed 3, the cradle 31, and the transmission / reception coil 4 can be determined based on the position, size, orientation, and distortion of the mark f and the stored shape data and the positional relationship. The position and orientation (posture) can be specified. That is, it is determined from which characteristic position the gantry 2 and the bed 3 are fixed, the cradle 31 and the transmission / reception coil 4, and from which position the operator 91 is viewing the cradle 31 and the transmission / reception coil 4. be able to. In particular, since the position of the gantry 2 and the bed 3 in which the positions of the gantry 2 and the bed 3 are fixed does not move in the real space, the position and orientation of the operator 91 in the real space can be specified from here. Note that specifying the position and orientation (posture) of the operator 91 with respect to the gantry 2, the bed 3, the cradle 31 and the transmission / reception coil 4 means that the position of the gantry 2, the bed 3, the cradle 31 and the transmission / reception coil 4 with respect to the operator 91 It is synonymous with specifying the orientation (posture).

  In addition, for example, a three-dimensional template representing a standard shape of the human body that is the subject 90 in a sleeping state or a standard shape of a hand / finger in a state of pointing a finger is prepared. Then, the subject 90 and the hand / finger of the operator 91 are recognized by template matching.

  Information indicating the position and orientation (posture) of the hand / finger of the cradle 31, the transmission / reception coil 4, the subject 90, the operator 91, and the operator 91 is sent to each unit in the control unit 6 as necessary.

  The position and orientation of the operator 91 may be specified by attaching a sensor capable of detecting the position and orientation of the head mounted display 5 to the head mounted display 5 and using the output of this sensor.

  The subject placement specifying unit 602 specifies the orientation to be placed and the posture to be taken of the subject 90 based on information representing the imaging region included in the scan protocol. Information indicating the specified orientation to be placed and the posture to be taken is sent to the image generation unit 609.

  The used coil specifying unit 603 specifies the type of transmitting / receiving coil to be used based on information representing the imaging region included in the scan protocol. Information indicating the type of the identified transmission / reception coil is sent to the image generation unit 609.

  The organ position specifying unit 604 stores three-dimensional data representing a standard positional relationship between the organs. The organ position specifying unit 604 specifies the approximate position and orientation of each organ of the subject 90 based on the three-dimensional data and information indicating the position and orientation of the subject 90.

  The coil sensitivity area specifying unit 605 stores information representing the positional relationship between the transmission / reception coil 4 and the coil sensitivity area. The coil sensitivity area specifying unit 605 specifies the coil sensitivity area based on information indicating the positional relationship and information indicating the position and orientation of the transmission / reception coil 4. Here, the coil sensitivity region is a region in which the reception sensitivity of the transmission / reception coil 4 is a certain level or more. The coil sensitivity region is a region where the image quality of the captured image is ensured to a certain level or more, and is a substantially imageable region. Information representing the identified coil sensitivity region is sent to the image generation unit 609.

  The coil arrangement specifying unit 606 specifies an approximate position where the transmission / reception coil 4 should be arranged based on information representing the imaging region included in the scan protocol. Information indicating the position where the specified transmission / reception coil 4 should be arranged is sent to the image generation unit 609.

  The scheduled scan area specifying unit 607 includes information indicating the range of the scheduled scan area (imaging scheduled area) when the landmark is used as a reference and information indicating the position indicated by the fingertip of the operator 91 included in the scan protocol. Based on this, the scheduled scan area is specified when it is assumed that the landmark is set at the position indicated by the fingertip. Further, when a landmark is set, the scheduled scan area specifying unit 607 determines the scheduled scan area based on the landmark as a final scheduled scan area. The landmark and the scheduled scan area may be moved, adjusted, and set by an operation on the operation unit 7 or the touch operation unit 53 in addition to the fingertip of the operator 91.

  The fixed pad arrangement specifying unit 608 specifies an approximate position where the fixed pad is to be arranged based on information such as the imaging region and the size of the scheduled scan area included in the scan protocol. The fixed pad is a member such as a cushion material for fixing the position of the subject 90 in order to suppress body movement of the subject 90 during imaging. Information indicating the position where the specified fixed pad is to be arranged is sent to the image generation unit 609.

  The image generation unit 609 has three-dimensional data representing these shapes and patterns for a subject, a transmission / reception coil, an organ, a fixed pad, a coil sensitivity area, a scheduled scan area, and the like. The image generation unit 609 uses these three-dimensional data and the input information representing the position and orientation of each target, such as a subject, a transmission / reception coil, an organ, a fixed pad, a coil sensitivity region, a scan scheduled region, and the like. Generate an image. When these images are displayed on the display unit 56 of the head mounted display 5, the images are generated so as to be seen to overlap the real image in the real space when viewed from the operator 91. The three-dimensional data may be artificially generated standard model data, actual data obtained by actual photographing, or semi-real data obtained by processing the actual data. Also good.

  The voice recognition unit 610 analyzes the voice data output from the microphone 52 and searches for and recognizes a command in the acquired voice. Then, the recognized command is sent to the command processing unit 611.

  The command processing unit 611 performs various processes in accordance with the input command.

  The second communication unit 612 performs data communication with the head mounted display 5 wirelessly. The second communication unit 610 receives image data output from the camera 51 and audio data output from the microphone 52 from the first communication unit 54. Further, the second communication unit 610 transmits the image data generated by the image generation unit 609 to the first communication unit 54.

  The operation unit 7 receives various operations of the operator 91 and sends operation information to the control unit 6.

  The setup flow before scanning in the magnetic resonance imaging system 1 according to the first embodiment will be described below.

  FIG. 3 is a flowchart showing the flow of setup before scanning in the magnetic resonance imaging system 1.

  In step S1, a scan protocol is set. Specifically, the operator 91 designates a desired scan protocol from scan protocols already prepared and inputs a read command by an operation on the operation unit 7 or the touch operation unit 53. In response to the command, the command processing unit 611 reads the designated scan protocol. The operator 91 performs an operation for partially changing the read scan protocol as necessary. If there is a change operation, the control unit 6 accepts the change and sets the scan protocol.

  In step S <b> 2, an image representing a transmission / reception coil to be used (hereinafter referred to as a used coil guide image) is displayed on the display unit 55 of the head mounted display 5. Specifically, the use coil specifying unit 603 specifies a transmit / receive coil to be used for scanning from a plurality of types of transmit / receive coils based on information representing an imaging region included in the set scan protocol. . Information representing the identified transmission / reception coil is sent to the image generation unit 609. Based on the information, the image generation unit 609 generates a use coil guide image G1 representing a transmission / reception coil to be used. The image data representing the used coil guide image G1 is transmitted to the display unit 55 via the second communication unit 612 and the first communication unit 54. The display unit 55 displays the used coil guide image G1 on the screen.

  FIG. 4 shows an example of an image that can be seen through the head mounted display 5 when the used coil guide image G1 is displayed. In this example, the used coil guide image G1 is displayed on the upper right of the screen. FIGS. 4 to 12 and FIGS. 15 to 17 show examples of images when the operator 91 looks down from the cradle 31 or the subject 90 from above, for easy understanding. Actually, an image when the cradle 31 and the operator 91 are looked down obliquely from above is generally used.

  In step S <b> 3, the operator 91 refers to the used coil guide image G <b> 1 displayed on the display unit 55. Then, a transmission / reception coil of the same type as the transmission / reception coil represented by the used coil guide image G <b> 1 is prepared and connected to the controller 6.

  In step S <b> 4, an image representing an aspect in which the subject 90 is to be placed (hereinafter referred to as a subject placement guide image) is displayed on the display unit 55 of the head mounted display 5.

  Specifically, the image recognition unit 601 recognizes the mark f attached to the cradle 31 based on the image of the real image taken by the camera 51, and the position of the cradle 31 in the real space with the operator 91 as a reference. Identify the size and orientation (posture). The position information of the specified cradle 31 is sent to each part. The subject placement specifying unit 602 specifies the orientation of the subject 90 to be placed and the posture to be taken based on information representing the imaging region included in the set scan protocol. Information indicating the specified orientation to be placed and the posture to be taken is sent to the image generation unit 609. Based on the position information of the identified cradle 31, information indicating the orientation to be placed and the orientation to be taken, and the like, the image generation unit 609 displays the subject representing the subject in the orientation to be placed and the posture to be taken. A specimen arrangement guide image G2 is generated. Image data representing the subject arrangement guide image G2 is transmitted to the display unit 55 via the second communication unit 612 and the first communication unit 54. The display unit 55 displays the subject arrangement guide image G2 on the screen of the display unit 55.

  FIG. 5 shows an example of an image that can be seen through the head mounted display 5 when the subject arrangement guide image G2 is displayed. In this example, a mark f is attached to the upper right corner of the cradle 31. The image recognizing unit 601 specifies the position, size, and orientation (posture) of the cradle 31 in the real space with reference to the operator 91 based on the shape of the mark f. Further, in this example, the cradle 31 in front of the operator 91 is seen through the screen, and the subject arrangement guide image G2 is displayed on the upper right of the screen.

  In step S5, the operator 91 refers to the subject arrangement guide image G1 displayed on the display unit 55. Then, the subject 90 is placed on the cradle 31 so as to have the same orientation and posture as the subject represented by the subject arrangement guide image G2.

  FIG. 6 shows an example of an image that can be seen through the head mounted display 5 when the subject 90 is placed on the cradle 31.

  In step S <b> 6, an image representing a schematic position where the fixed pad is to be arranged (hereinafter, referred to as a fixed pad arrangement guide image) is displayed on the display unit 55 of the head mounted display 5. Specifically, the approximate position where the fixed pad is to be arranged based on information indicating the imaging region included in the scan protocol, information indicating the position and orientation of the subject 90, and the like. Is identified. Information indicating the position where the specified fixed pad is to be arranged is sent to the image generation unit 609. The image generation unit 609 generates a fixed pad arrangement guide image based on the information. The fixed pad arrangement guide image is generated so as to overlap with a real image such as the subject 90 in the real space when viewed from the operator 91. Image data representing the fixed pad arrangement guide image is transmitted to the display unit 55 via the second communication unit 612 and the first communication unit 54. The display unit 55 displays the fixed pad arrangement guide image.

  FIG. 7 shows an example of an image that can be seen through the head mounted display 5 when the fixed pad arrangement guide image G3 is displayed. The fixed pad arrangement guide image G3 is displayed almost in real time. That is, when the operator 91 moves and changes its line of sight, the fixed pad arrangement guide image G3 itself also changes. When viewed by the operator 91, it appears that the subject 90 and the approximate position where the fixed pad is to be arranged always overlap in real space.

  In step S <b> 7, the operator 91 refers to the image of the approximate position where the fixed pad to be displayed displayed on the display unit 55 is to be arranged. Then, a real fixing pad is arranged at a rough position where the subject 90 and the fixing pad displayed on the display unit 55 should be arranged, and the subject 90 is fixed.

  In step S8, an image representing an organ in the subject 90 (hereinafter referred to as an organ image) is displayed on the display unit 55 of the head mounted display 5. Specifically, the organ position specifying unit 604 is based on the three-dimensional data representing the standard positional relationship between the organs and the position information in the real space of the subject 90 sent from the image recognition unit 601. Thus, the approximate position and orientation of the organ of the subject 90 in the real space are specified. Information representing the approximate position and orientation of the identified organ is sent to the image generation unit 609. The image generation unit 609 generates an organ image G4 of the subject 90 based on the information. The organ image G4 includes a brain, lungs, heart, liver, kidney, and the like. The organ image G4 is generated so as to overlap the subject 90 in real space when viewed from the operator 91. The image data representing the organ image G4 is transmitted to the display unit 55 via the second communication unit 612 and the first communication unit 54. The display unit 55 displays the organ image G4. The organ image G4 is displayed almost in real time. That is, when the position of the subject 90 or the operator 91 changes, the organ image G4 itself also changes. And when the operator 91 sees, it seems that the organ always overlaps with the subject 90 in the real space. The organ image G4 may be generated based on actual data representing a real organ of the subject 90 or another person acquired by previous imaging, or based on standard model data representing a virtual organ. May be generated.

  FIG. 8 shows an example of an image that can be seen through the head mounted display 5 when the organ image G4 is displayed.

  In step S <b> 9, an image representing the temporary landmark and the scheduled scan area (hereinafter referred to as the temporary landmark image and the temporary scan scheduled area image) is displayed on the display unit 55 of the head mounted display 5. Specifically, the scheduled scan area specifying unit 607 includes information indicating the range of the scheduled scan area when the landmark is used as a reference, and information indicating the position of the fingertip designated by the operator 91, included in the scan protocol. Based on the above, the position of the fingertip is specified as the temporary landmark position and the provisional scan scheduled area when the landmark is set at the fingertip position. Information indicating the position of the specified temporary landmark and the scheduled scan area is sent to the image generation unit 609. The image generation unit 609 generates a landmark image G5 and a scheduled scan area image G6 based on the information. The landmark image G5 and the scheduled scan area image G6 are generated so as to overlap with a real image such as the subject 90 in the real space when viewed from the operator 91. Image data representing the landmark image G5 and the scheduled scan region image G6 is transmitted to the display unit 55 via the second communication unit 612 and the first communication unit 54. The display unit 55 displays the landmark image G5 and the scheduled scan area image G6.

  FIG. 9 shows an example of an image that can be seen through the head mounted display 5 when the landmark image G5 and the scheduled scan region image G6 are displayed. The landmark image G5 and the scheduled scan area image G6 are displayed almost in real time. That is, when the operator 91 moves the fingertip and changes its position, the landmark image G5 and the scheduled scan area image G6 themselves also change. And when the operator 91 sees, it seems that the temporary position of the landmark L and the scheduled scan area SR always overlap the real image in the real space.

  In step S10, the operator 91 refers to the landmark image G5 and the scheduled scan area image G6 displayed on the display unit 55. Then, while confirming the positional relationship between the subject 90 or its organ and the provisional scan scheduled area displayed on the display unit 55, the fingertip is adjusted to an appropriate position as a landmark. Here, the operator 91 utters a voice command for setting a landmark, for example, “landmark, set”. Then, the voice recognition unit 610 recognizes the command and sends the command to the command processing unit 611. The command processing unit 611 sends the command to the scheduled scan area specifying unit 607, and the scheduled scan area specifying unit 607 sets the position of the fingertip of the operator 91 as the final landmark. Further, the scheduled scan area when the landmark is used as a reference is set as the final scheduled scan area. The scheduled scan area can be adjusted by a command for adjustment by voice. Note that landmarks and scheduled scan areas can be set and adjusted not only by fingertip movement and voice commands, but also by operations on the operation unit 7 or the touch operation unit 53.

  FIG. 10 shows an example of an image that can be seen through the head mounted display 5 when the final landmark and the scheduled scan area are set.

  In step S <b> 11, an image (hereinafter referred to as a coil arrangement guide image) representing a schematic position where the transmission / reception coil 4 is to be arranged is displayed on the display unit 55 of the head mounted display 5. Specifically, the coil arrangement specifying unit 606 specifies the approximate position range where the transmission / reception coil 4 should be arranged based on information representing the imaging region included in the scan protocol. Information representing the specified position range is sent to the image generation unit 609. The image generation unit 609 generates a coil arrangement guide image G7 based on the information. The coil arrangement guide image G <b> 7 is generated so as to overlap with a real image such as the subject 90 in the real space when viewed from the operator 91. Image data representing the coil arrangement guide image G7 is transmitted to the display unit 55 via the second communication unit 612 and the first communication unit 54. The display unit 55 displays the coil arrangement guide image G6.

  In step S <b> 12, an image representing the coil sensitivity region (hereinafter referred to as a coil sensitivity region image) is displayed on the display unit 55 of the head mounted display 5. Specifically, the coil sensitivity area specifying unit 605 is based on information representing the positional relationship between the transmission / reception coil 4 and the coil sensitivity area, and information representing the position and orientation of the transmission / reception coil 4 in the real space. The coil sensitivity region at is specified. Information representing the identified coil sensitivity region is sent to the image generation unit 609. The image generation unit 609 generates a coil sensitivity region image G8 based on the information. The coil sensitivity region image G8 is generated so as to appear to overlap with a real image such as the subject 90 in the real space when viewed from the operator 91. Image data representing the coil sensitivity region image G8 is transmitted to the display unit 55 via the second communication unit 612 and the first communication unit 54. The display unit 55 displays the coil sensitivity region image G8.

  FIG. 11 shows an example of an image that can be seen through the head mounted display 5 when the coil arrangement guide image G7 and the coil sensitivity region image G8 are displayed. The coil arrangement guide image G7 is displayed almost in real time. That is, when the subject 90 or the operator 91 moves, the coil arrangement guide image G7 itself also changes. And when the operator 91 sees, it seems that the position which should arrange | position a coil in real space has always overlapped with the real image. The position of the transmission / reception coil 4 held by the operator 91 in the hand 91h is recognized almost in real time, and a coil sensitivity region image G8 is displayed on the screen so as to follow the position. That is, when the operator 91 moves the transmitting / receiving coil 4 to change its position, the coil sensitivity region image G8 itself also changes. And when the operator 91 sees, it seems that the coil sensitivity area | region always overlaps with the real image in real space.

  In step S13, the operator 91 refers to the organ image G4, the landmark image G5, the scheduled scan region image G6, the coil arrangement guide image G7, and the coil sensitivity region image G8 displayed on the display unit 55. Then, the transmitter / receiver coil 4 is placed at an appropriate position of the subject 90 while confirming the positional relationship between the organ, the landmark, the scheduled scan area, the position where the coil is to be arranged, and the coil sensitivity area represented by these images. To do. That is, the position where the coil is to be placed is confirmed, and in the vicinity thereof, the transmitting / receiving coil 4 is placed so that the organ corresponding to the imaging region and the scheduled scan region are within the coil sensitivity region.

  FIG. 12 shows an example of an image that can be seen through the head mounted display 5 when the transmission / reception coil 4 is arranged.

(Second embodiment)
FIG. 13 is a block diagram schematically showing the configuration of a magnetic resonance imaging system 1 ′ according to the second embodiment.

  As shown in FIG. 13, the magnetic resonance imaging system 1 ′ includes a gantry 2, a bed 3 ′, a head mounted display 5, a control unit 6 ′, and an operation unit 7.

  The bed 3 'has a cradle 31'. The cradle 31 ′ incorporates a plurality of transmission / reception coil elements 4 i (i = 1, 2,..., N). The plurality of coil elements 4 i used for transmission / reception are arranged at least in the longitudinal direction of the cradle 31 ′, that is, in the body axis direction of the subject 90. Each of the plurality of coil elements 4i can be selectively used according to the size of the subject 90 and the imaging region.

  The control unit 6 ′ includes an image recognition unit 601, a subject arrangement specifying unit 602, a used coil element specifying unit 613, an organ position specifying unit 604, a coil sensitivity region specifying unit 605, a scheduled scan region specifying unit 607, The fixed pad arrangement specifying unit 608, the image generation unit 609, the voice recognition unit 610, the command processing unit 611, and the second communication unit 612 are provided.

  The used coil element specifying unit 613 includes a plurality of coil elements based on information indicating the size of the imaging region and the scheduled scan area and information indicating the position and orientation of the subject 90 included in the set scan protocol. One or more coil elements used for scanning are identified from 4i. Information representing the identified coil element is sent to the image generation unit 609.

  The coil sensitivity area specifying unit 605 specifies the coil sensitivity area according to the coil element to be used. Information representing the identified coil sensitivity region is sent to the image generation unit 609.

  Each other part in control part 6 'functions similarly to 1st embodiment.

  Hereafter, the setup flow before scanning in the magnetic resonance imaging system 1 ′ according to the second embodiment will be described.

  FIG. 14 is a flowchart showing the flow of setup in the magnetic resonance imaging system 1 ′.

  In step T1, a scan protocol is set.

  In step T <b> 2, an image representing the coil element to be used (hereinafter referred to as a used coil element image) is displayed on the display unit 55 of the head mounted display 5.

  FIG. 15 shows an example of an image that can be seen through the head mounted display 5 when the used coil element image G9 is displayed. In this example, among the plurality of coil elements incorporated in the cradle 31 ′, the coil element to be used is represented by a solid line, and the coil element that is not used is represented by a broken line.

  In step T <b> 3, a coil sensitivity region image G <b> 10 that is an image representing the coil sensitivity region is displayed on the display unit 55 of the head mounted display 5.

  FIG. 16 shows an example of an image that can be seen through the head mounted display 5 when the coil sensitivity region image G10 is displayed. The coil sensitivity area image G10 changes according to the coil element to be used.

  In step T <b> 4, a subject placement guide image G <b> 2 that is an image representing an aspect in which the subject 90 is to be placed is displayed on the display unit 55 of the head mounted display 5.

  In step T <b> 5, an organ image G <b> 4 that is an image representing the organ of the subject 90 is displayed on the display unit 55 of the head mounted display 5.

  In step T6, the operator 91 places the subject 90 on the cradle 31 with reference to the coil sensitivity region image G10 and the organ image G4.

  FIG. 17 shows an example of an image that can be seen through the head mounted display 5 when the subject 90 is placed on the cradle 31.

  In step T7, a fixed pad arrangement guide image G3, which is an image representing the position where the fixed pad is to be arranged, is displayed on the display unit 55 of the head mounted display 5.

  In step T8, the fixed pad is arranged with reference to the fixed pad arrangement guide image G3 in step T9.

  In step T9, the landmark image G5 and the scheduled scan area image G6, which are images representing the landmark L and the scheduled scan area SR, are displayed on the display unit 55 of the head mounted display 5 as provisional images.

  In step T10, the operator 91 refers to each displayed image, confirms and adjusts the arrangement of the subject 90, and sets the landmark L and the scheduled scan area SR.

  As described above, according to the above-described embodiment, when performing setup before scanning, it is possible to provide information necessary for setup which is difficult to understand in an operation manual or the like in a visible form, and the setup work can be efficiently performed. It can be carried out.

  Further, according to the above-described embodiment, the coil sensitivity region that cannot be seen with the naked eye can be grasped from the image, the transmitting / receiving coil or the subject can be arranged at an appropriate position, or the scan region can be set to an appropriate region. can do. As a result, it is possible to avoid concern about image quality degradation and re-shooting by setting the scan region at a position outside the coil sensitivity region.

  Further, according to the above-described embodiment, since the coil sensitivity area is displayed using a technique based on so-called augmented reality, the coil sensitivity area can be shown in three dimensions regardless of the viewpoint of the operator 91. The coil sensitivity region can be grasped intuitively.

  In addition, according to the above-described embodiment, the image to be referred to is displayed on the display unit of the head mounted display, so that both hands of the operator 91 can always be used, and care of the subject 90 and various operations are performed. Can be performed without hindrance.

  Further, according to the above-described embodiment, the position of the organ in the body of the subject 90 can be grasped from the image, and even if the operator lacks anatomical knowledge, the landmark (scan area (Reference position) can be easily set.

  In addition, according to the above-described embodiment, the position where the fixed pad should be arranged can be grasped from the image, and the operator lacks specialized knowledge and experience in fixing the subject with the fixed pad. In addition, the subject can be efficiently fixed by the fixing pad.

  In the above-described embodiment, the coil sensitivity area specifying unit 605 stores the positional relationship between the transmission / reception coil 4 and the coil sensitivity distribution, and separately from the coil sensitivity area or instead of the coil sensitivity area, the coil sensitivity area A distribution (imaging sensitivity distribution) may be specified. In this case, information representing the identified coil sensitivity distribution is sent to the image generation unit 609. The image generation unit 609 generates a coil sensitivity distribution image based on this information, and the image is displayed on the display unit 55.

  Moreover, although the said embodiment is an example which applied invention to the magnetic resonance imaging system, invention can also be applied to a radiation tomography imaging system. In this case, for example, instead of the image of the coil sensitivity area, an image representing a scanable area on the cradle in the body axis direction of the subject or the FOV (imaging field of view) may be displayed. This image is, for example, an image representing a columnar or cylindrical region.

  Moreover, although the said embodiment is an imaging system called a magnetic resonance imaging system, the program for functioning a computer as a control part in this system is also an example of embodiment of invention.

1,1 'magnetic resonance imaging system (imaging system)
2 Gantry 3, 3 'couch 4 Transmitting and receiving coil 5 Head mounted display 6, 6' Control unit (setting means)
7 Operation part 21 Magnet 22 Cavity part 31, 31 'Cradle 4i Transmission / reception coil element 51 Camera 52 Microphone 53 Touch operation part 54 First communication part 55 Display part 90 Subject (subject)
91 Operator 601 Image recognition unit (recognition means)
602 Subject arrangement specifying unit 603 Coil use unit 604 Organ position specifying unit,
605 Coil sensitivity area specifying unit (specifying means)
606 Coil arrangement specifying unit 607 Scheduled scan area specifying unit 608 Fixed pad arrangement specifying unit 609 Image generating unit (generating unit),
610 Voice recognition unit 611 Command processing unit 612 Second communication unit 613 Used coil element specifying unit (specifying means)

Claims (12)

An imaging support apparatus for an imaging system that captures a tomographic image of a subject,
A camera that acquires an image of a real image in front of the operator's eyes and a display unit that displays the generated image so that the operator can see the image superimposed on the real image. A head mounted display,
Recognizing means for analyzing an image acquired by the camera and recognizing at least a part of the imaging system included in the image;
A specifying means for specifying an imaging sensitivity distribution or an imageable region based on a recognition result by the recognition means;
A generating unit configured to generate an image to be displayed on the display unit, the imaging sensitivity distribution or the imageable region specified by the specifying unit, and when displayed on the display unit, the imaging sensitivity distribution or An imaging support apparatus comprising: a generating unit configured to generate an image in which an imageable region appears to overlap the real image.   The generation unit represents a set imaging planned area, and further generates an image that appears to overlap the real image when the imaging planned area is displayed on the display unit. The imaging support apparatus described. The head mounted display has a microphone,
The recognizing means analyzes the image taken by the camera and recognizes the operator's hand or finger included in the image;
The imaging support according to claim 1, further comprising a setting unit configured to set the imaging scheduled area based on a position of the hand or finger in response to a specific command voice obtained by the microphone. apparatus.   The imaging support apparatus according to any one of claims 1 to 3, wherein the generation unit generates an image representing the internal organs of the subject based on position information of the subject.   5. The imaging support apparatus according to claim 1, wherein the generation unit generates an image representing a position where a member that holds the subject is to be arranged based on a set imaging condition. . The imaging system is a magnetic resonance imaging system;
A part of the imaging system is a coil for receiving a magnetic resonance signal or a bed in which the coil is built in a predetermined position.
The imaging support device according to any one of claims 1 to 5, wherein the imageable region is a coil sensitivity region in which the sensitivity of the coil is a certain level or more.   The imaging support apparatus according to claim 6, wherein the generation unit generates an image representing a position where the coil is to be arranged based on a set imaging condition. The bed includes a plurality of coils,
The recognizing means recognizes the position of the bed;
The imaging support apparatus according to claim 6, wherein the specifying unit specifies the coil sensitivity region in accordance with a coil used for imaging among the plurality of coils.   The imaging support apparatus according to claim 6, wherein the generation unit generates an image representing a coil to be used based on a set imaging condition. The imaging system is a radiation tomographic imaging system,
A part of the imaging system is a bed,
The imaging support device according to any one of claims 1 to 5, wherein the imageable area is an area defined by an FOV (imaging field of view) or a scanable range in a body axis direction of the subject.   The imaging system provided with the imaging assistance device as described in any one of Claims 1-10.   The program for functioning a computer as a recognition means in the imaging assistance apparatus as described in any one of Claims 1-10, a specific means, and a production | generation means.

Images