WO2024038031A1

WO2024038031A1 - Methods and systems for augmented reality display within the mri environment

Info

Publication number: WO2024038031A1
Application number: PCT/EP2023/072422
Authority: WO
Inventors: Donald Alan FORRER JR.; Avraham YEINI; Paul Franz REDDER
Original assignee: Koninklijke Philips N.V.
Priority date: 2022-08-18
Filing date: 2023-08-15
Publication date: 2024-02-22

Abstract

An MRI interface system for an MRI environment, comprising: MRI-compatible augmented reality (AR) equipment configured to be wearable by a user; a data aggregator configured to receive MRI data within the MRI environment, and further configured to package some or all of the received data for transmission to the AR equipment, wherein the MRI data comprises monitoring information for a subject being imaged by the MRI; a wireless network configured to transmit the packaged data to the AR equipment, and further configured to receive, from the AR equipment, user input from the user; wherein the AR equipment is configured to: (i) receive the transmitted packaged data; (ii) display some or all of the received packaged data to the user via augmented reality; and (iii) receive an input from the user; and (iv) transmit the received input to the wireless network.

Description

METHODS AND SYSTEMS FOR AUGMENTED REALITY DISPLAY WITHIN THE MRI ENVIRONMENT

Field of the Invention

[0001] The present disclosure is directed generally to methods and systems for augmented reality display solutions within the MRI environment.

Background

[0002] Magnetic resonance imaging (MRI) is a medical imaging modality that uses a magnetic field to create detailed images of a subject’s internal structures. MRI has become a ubiquitous component of health care.

[0003] The MRI environment is a hostile one. The magnetic field of the MRI system is extremely strong, and thus any ferromagnetic objects within the MRI environment can become airborne projectiles with high velocity. This includes surgical tools, monitors, and other healthcare equipment commonly used with patients. It also includes consumer equipment such as smartphones, watches, and other consumer equipment. Thus, all healthcare and consumer equipment and personnel within the MRI environment must be configured or otherwise prepared to withstand the magnetic field of the MRI. Careful screening of people and objects entering the MRI environment is critical.

[0004] In addition to the magnetic field, the MRI system generates a radiofrequency (RF) field that can cause other complications within the MRI environment. For example, the RF field can induce currents within any wires inside the MRI environment, and can seriously disrupt communications within the MRI environment.

[0005] The MRI environment is typically broken down into Zone 1, Zone 2, Zone 3, and Zone 4. Zone 1 is the area outside of the immediate MRI facility, and is freely accessible to the general public. Zone 2 is typically restricted to the public and functions as the interface between the public area of Zone 1 and the remaining zones. The zone may comprise examination rooms, testing rooms, restrooms, or other rooms not immediately accessible to the public. Zones 3 and 4, collectively, are typically referred to as the MRI suite. Zone 3 comprises the control room which may include monitors, computer equipment, and other hardware and/or software necessary to control and/or monitor the MRI environment. Zone 4 comprises the MRI magnet room and equipment room, and thus comprises the strongest magnetic field and highest RF energy.

[0006] The strong magnetic and FR fields make it extremely difficult to monitor a subject and display information within the MRI environment, especially within Zone 4. Although closely tracking a patient’s vital signs during any procedure is critical as clinicians and MRI technicians make real-time decisions to sufficiently care for the patient, the patient may be isolated at a distance due to the limitations that are imposed by the restrictive MRI environment. MRI staff are typically limited to review data by means of an information portal or by visibly watching, from a distance, the primary patient monitor in the MRI control room. Availability of patient monitoring information is limited to a primary monitor located in the MRI suite and a fixed, stationary, portal located within the MR control room. This distance and numerous other limitations to monitoring by the clinician in the MRI magnet room and equipment room can lead to delays and other concerns for the care and safety of the patient.

Summary of the Invention

[0007] Accordingly, there is a continued need for methods and systems that allow a clinician within the MRI environment, especially within Zone 4, to monitor patient information more closely despite the challenges of the MRI environment.

[0008] The present disclosure is directed to inventive methods and systems for augmented reality display solutions within the MRI environment. Various embodiments and implementations herein are directed to an MRI interface system for an MRI environment. The system includes an MRI-compatible augmented reality (AR) display configured to be wearable by a user within at least Zones 1, 2, 3, and 4 of the MRI environment. The system also includes a data aggregator configured to receive MRI data within the MRI environment, and further configured to package some or all of the received data for transmission to the MRI-compatible AR display. A wireless network of the system transmits the packaged data to the MRI-compatible AR display, and can receive, from the MRI-compatible AR display, user input from the user. The MRI-compatible AR display are therefore configured to: (i) receive the transmitted packaged data; (ii) display some or all of the received packaged data to the user via augmented reality; and (iii) receive an input from the user; and (iv) transmit the received input to the wireless network.

[0009] Generally in one aspect, an MRI interface system for an MRI environment is provided. The system includes MRI-compatible augmented reality (AR) equipment configured to be wearable by a user within at least Zones 1, 2, 3, and 4 of the MRI environment; a data aggregator configured to receive MRI data within the MRI environment, and further configured to package some or all of the received data for transmission to the MRI-compatible AR equipment, wherein the MRI data comprises monitoring information for a subject being imaged by the MRI; a wireless network configured to transmit the packaged data to the MRI-compatible AR equipment, and further configured to receive, from the MRI-compatible AR equipment, user input from the user; wherein the MRI-compatible AR equipment is configured to: (i) receive the transmitted packaged data; (ii) display some or all of the received packaged data to the user via augmented reality; and (iii) receive an input from the user; and (iv) transmit the received input to the wireless network.

[0010] According to an embodiment, the MRI-compatible AR equipment is further configured to be transportable, while worn by the user, from one of Zones 1, 2, 3, and 4 to another of said Zones.

[0011] According to an embodiment, the packaged data displayed to the user via augmented reality comprises one or more vital signs for the subject being imaged by the MRI. According to an embodiment, the MRI data further comprises imaging information for the subject being imaged by the MRI.

[0012] According to an embodiment, the data aggregator is within Zone 4 of the MRI environment. According to an embodiment, the data aggregator is within Zone 3 of the MRI environment.

[0013] According to an embodiment, the MRI-compatible AR equipment is further configured to modify the data displayed to the user via augmented reality in response to the received user input.

[0014] According to a second aspect is a method for augmented reality (AR) by an MRI interface system for an MRI environment. The method includes: (i) receiving, by a data aggregator of the MRI interface system, MRI data comprising monitoring information for a subject being imaged by the MRI; (ii) packaging, by the data aggregator, some or all of the received MRI data for transmission to MRI-compatible AR equipment, wherein the MRI-compatible AR equipment is configured to be wearable by a user within at least Zones 1, 2, 3, and 4 of the MRI environment; (iii) receiving the transmitted packaged data by the MRI-compatible AR equipment; and (iv) displaying, by the MRI-compatible AR equipment, some or all of the received packaged data to the user via augmented reality.

[0015] According to an embodiment, the method further includes receiving an input from the user of the MRI-compatible AR equipment; and modifying the displayed packaged data in response to the received user input. According to an embodiment, modifying the displayed packaged data in response to the received user input comprises adding or removing data from the augmented reality.

[0016] It should be appreciated that all combinations of the foregoing concepts and additional concepts discussed in greater detail below (provided such concepts are not mutually inconsistent) are contemplated as being part of the inventive subject matter disclosed herein. In particular, all combinations of claimed subject matter appearing at the end of this disclosure are contemplated as being part of the inventive subject matter disclosed herein.

[0017] These and other aspects of the invention will be apparent from and elucidated with reference to the embodiment(s) described hereinafter.

Brief Description of the Drawings

[0018] In the drawings, like reference characters generally refer to the same parts throughout the different views. Also, the drawings are not necessarily to scale, emphasis instead generally being placed upon illustrating the principles of the invention.

[0019] FIG. 1 is a flowchart of a method for augmented reality (AR) by an MRI interface system, in accordance with an embodiment.

[0020] FIG. 2 is a schematic representation of an MRI interface system, in accordance with an embodiment. Detailed Description of Embodiments

[0021] The present disclosure describes various embodiments of an MRI visualization system and method. More generally, Applicant has recognized and appreciated that it would be beneficial to provide an MRI monitoring system that improves a clinician or technician’s ability to monitor a patient or other subj ect within or proximate the MRI equipment, thus also improving the patient’ s ability to communicate with the clinician or technician. For example, an MRI interface system for the MRI environment comprises an MRI-compatible augmented reality (AR) display configured to be wearable by a user within at least Zones 1, 2, 3, and 4 of the MRI environment. The system also includes a data aggregator configured to receive MRI data within the MRI environment, and further configured to package some or all of the received data for transmission to the MRI- compatible AR display. A wireless network of the system transmits the packaged data to the MRI- compatible AR display, and can receive, from the MRI-compatible AR display, user input from the user. The MRI-compatible AR display are therefore configured to: (i) receive the transmitted packaged data; (ii) display some or all of the received packaged data to the user via augmented reality; and (iii) receive an input from the user; and (iv) transmit the received input to the wireless network. According to an embodiment, the systems and methods disclosed or otherwise envisioned herein can be used in any MRI environment.

[0022] According to an embodiment, AR display technology that provides vital sign information presents a flexible and interactive means for the clinician or technician to review and react to real-time patient information. Since the clinician or technician is not physically or visually tethered to a portal or a desk, they can more efficiently perform other monitoring tasks while the patient is being scanned. Additionally, the AR display and system is not limited to a since person. While one clinician or technician may have the primary responsibility may to monitor the patient, other parties may also have access to the AR information and may review and interact from their workspace locations throughout the hospital.

[0023] Thus, the MRI interface system and method disclosed or otherwise envisioned herein provides numerous advantages over the prior art. Providing an MRI interface system that improves the ability of a clinician, technician, or other user to monitor and interact with a patient being imaged by the MRI also improves the safety of the patient, and thus potentially save lives. Similarly, providing an MRI interface system that allows a patient wearing the MRI-compatible AR display to communicate with a clinician, technician, or other person or system monitoring that patient similarly improves the safety of the patient, and thus potentially save lives.

[0024] Referring to FIG. 1, in one embodiment, is a flowchart of a method 100 for MRI monitoring using an MRI interface system. The methods described in connection with the figures are provided as examples only, and shall be understood not to limit the scope of the disclosure. The MRI interface system can be any of the systems described or otherwise envisioned herein. The MRI interface system can be a single system or multiple different systems.

[0025] At step 110 of the method, an MRI interface system 200 is provided. Referring to an embodiment of an MRI interface system 200 as depicted in FIG. 2, for example, the system comprises one or more of a processor 220, memory 230, user interface 240, communications interface 250, storage 260, data aggregator 270, patient monitoring equipment 280, and AR equipment or display 290, interconnected via one or more system buses 212. It will be understood that FIG. 2 constitutes, in some respects, an abstraction and that the actual organization of the components of the system 200 may be different and more complex than illustrated. Additionally, MRI interface system 200 can be any of the systems described or otherwise envisioned herein. Other elements and components of system 200 are disclosed and/or envisioned elsewhere herein. MRI interface system may be a component of a larger or more comprehensive MRI control or monitoring system.

[0026] At step 120 of the method, the MRI interface system receives patient monitoring information from one or more pieces of patient monitoring equipment 280. The patient monitoring equipment 280 may be located within the MRI equipment room or MRI control room, among other locations. According to an embodiment, the monitoring equipment is configured to withstand the limitations of the MRI equipment room or MRI control room. The patient monitoring equipment may be configured to obtain any information from the patient. This may include, for example, patient vital signs such as heart rate, breathing rate, temperature, oxygen levels, and/or any other vitals signs. The information about the patient may additionally or alternatively comprise imaging data for the patient, such as imaging obtained by the MRI equipment.

[0027] According to an embodiment, the monitoring information may be transmitted from the patient monitoring equipment 280 to another component of the MRI system using any method or system for data transmission, including but not limited to wired and/or wireless data transmission. For example, the data may be transmitted via a wired connection, or via a wireless network such as the internet, a local intranet, or other wireless network. According to an embodiment, the transmission components are configured to withstand the limitations of the MRI environment, such as through hardening of the transmission hardware.

[0028] According to an embodiment, the monitoring information may be received by any component of the MRI system capable of receiving the information, including but not limited to the data aggregator 270.

[0029] Once the monitoring information is received, it may be utilized by the system immediately or it may be stored within one or more components of the MRI system for downstream or future use by the system. The MRI system may utilize some or all of the received monitoring information, immediately or in the future.

[0030] At step 130 of the method, the MRI interface system packages some or all of the received patient monitoring information for immediate or future transmission, via wired and/or wireless communication, to another component of the system. According to an embodiment, the MRI interface system packages the data for transmission to one or more pieces of augmented reality (AR) equipment. According to an embodiment, “packaging” information refers to any manipulation of the received patient monitoring information necessary to transmit the information to another component of the system.

[0031] According to an embodiment, the data aggregator 270 receives the patient monitoring information from the patient monitoring equipment 280 and either communicates the information to another component for packaging, or packages the information itself. According to an embodiment, in addition to the patient monitoring information, the data aggregator can receive, obtain, or otherwise comprise other monitoring or MRI information such as imaging information, environmental information, and other information. Accordingly, some or all of this information may be packaged or otherwise prepared for transmission by the MRI system.

[0032] Accordingly, the MRI interface system 200 comprises a wireless network 252 configured to transmit information within the MRI environment, and optionally into and out of the MRI environment. The wireless network may be the internet, a local intranet, or other wireless network. According to an embodiment, the transmission components of the wireless network are configured to withstand the limitations of the MRI environment, such as through hardening of the transmission hardware. The MRI interface system utilizes the wireless network to transmit the packaged information to one or more pieces of AR equipment of the system.

[0033] The MRI interface system comprises one or more pieces of augmented reality (AR) equipment 290. The AR equipment may be any device configured for augmented reality. According to an embodiment, the AR equipment may be any device worn by a user and capable of augmenting the vision of that user. For example, the AR equipment may be glasses worn by the user and configured to project or otherwise display information to the user, thereby augmenting the visual field of the user. This augmentation of the visual field may comprise, among other things, adding information to the visual field such as overlaying patient information including patient vital signs and/or patient imaging data. The user may be any user that is required to or desires to view visualization information within the MRI environment. This can include a technician, a clinician, or other healthcare professional, among other users. According to another embodiment, the user is a patient or subject wearing the AR equipment within the MRI environment.

[0034] The AR equipment may be any other type or configuration of AR equipment. The AR equipment may be worn by the user on their body or their clothes, and display or otherwise project information that augments the user’s visual field. For example, the AR equipment may be a device that hooks around a user’s ear and displays or otherwise projects information that augments the user’s visual field.

[0035] According to an embodiment, the AR equipment comprises one or more lenses that allows natural light to pass through to the eyes of the user, and a digital display such as an LED or OLED display that sends computer-generated images to the eyes of the user. Thus, the user receives both the natural light from the environment as well as the computer-generated images. These computer-generated images can be overlay ed onto objects within the environment.

[0036] According to an embodiment, the AR equipment comprises one or more cameras to capture the natural light in the MRI environment. The camera may be local to the AR equipment or may be remote to the AR equipment. For example, the room where the AR equipment is being utilized may comprise the one or more cameras utilized by the AR equipment.

[0037] According to an embodiment, the AR equipment comprises a processor to process one or more of the received patient information and the image data captured by the one or more cameras. The processor may be further configured to combine the received patient information and the image data to overlay some or all of the patient information onto the image data, and to transmit the combined information to the user via a display. Thus, according to an embodiment, the AR equipment comprises a digital display such as an LED or OLED display that sends the combined computer-generated images to the eyes of the user.

[0038] According to an embodiment, the AR equipment may comprise any other components necessary to display the augmented information or images to the user. For example, among many other possible components, the AR equipment may comprise eye-tracking sensors or movement detection components, head-tracking or movement detection components, and other components.

[0039] According to an embodiment, the AR equipment is not connected by a wired connection to any other component of the system when in use, and is therefore connected to the system only by wireless communication. This allows the AR equipment, and the user, to move within different zones of the MRI environment, or within a zone of the MRI environment, without worrying about hardware and wired connection restrictions.

[0040] Due to the restrictions of the MRI environment, including but not limited to the high magnetic field and RF field, the AR equipment is preferably configured or designed to withstand those limitations. For example, the AR equipment may be hardened to withstand the MRI environment. The AR equipment may be designed or configured such that it does not comprise any ferromagnetic material. Other designs and configurations are possible.

[0041] At step 140 of the method, the AR equipment 290 receives, via the wireless network 252, the transmitted information. The AR equipment may utilize the received information immediately, or may store it for future use. Accordingly, the AR equipment may comprise or be in communication with storage to store the received information.

[0042] At step 150 of the method, the AR equipment 290 displays some or all of the received transmitted information. To “display” means any method of adding information to the user’ s visual field using augmented reality. According to one embodiment, the AR equipment 290 overlays virtual information over image data from the MRI environment to create computer-generated imagery, and transmits this combined computer-generated imagery to the user via a digital display such as an LED or OLED display or projector. [0043] According to an embodiment, the display perceived by the user comprises patient information as a digital overlay on the MRI environment. For example, the display may comprise patient information such as demographics, medical information such as diagnosis or history or treatment, monitoring information such as vital signs, imaging information such as MRI images, and/or other information.

[0044] According to an embodiment, the display perceived by the user comprises information or a communication presented to the patient or subject wearing the AR equipment within the MRI environment, sent by a monitoring entity such as the MRI system, a clinician, technician, or other user. This enables bi-directional communication between the patient and the MRI system or a user within the MRI environment. The communication to the patient or subject wearing the AR equipment within the MRI environment can be any information or action item. For example, the communication may comprise information about the patient or the patient’s past or current condition, information about the MRI procedure, or other information. As another example, the displayed information may comprise actionable items presented to the patient, such as a button, selection, or other interactive element that the patient may interact with. For example, the display may comprise a button or other interactive element that the patient should “press,” via the AR system, to request help, initiate communication, or any other action item. These action items can be presented to the user by the MRI system automatically, and/or the action items may be presented based on one or more parameters specific to the patient, and/or the action items may be presented based on a direction received from a monitoring entity such as a clinician or technician. For example, a clinician may be interested in asking the patient about their current status, and thus directs the AR equipment to present a question to the patient. The patient can then respond to that question as described or otherwise envisioned herein.

[0045] According to an embodiment, the display perceived by the user comprises an alarm or other alert condition generated at the patient. The MRI system may monitor information about the patient and transmit that monitoring information to the AR equipment worn by a monitoring entity such as a clinician or technician. For example, the MRI system may monitor the patient’s vitals or other information, and automatically generate an alarm or alert if the vitals or other information is outside of a predetermined range or value. These predetermined ranges or values can be automatic or can be determined by a monitoring entity such as a clinician or technician. Alternatively, the alert or alarm may be manually initiated or generated, such as a patient-initiated alarm. For example, the patient may want to communicate with the clinician or technician and thus create an alarm or alert that is provided to the clinician or technician. As described or otherwise envisioned herein, the clinician or technician can manage the provided alarm or alert, such as by silencing it or otherwise addressing or modifying the alarm or alert.

[0046] According to an embodiment, the displayed information is customizable by the user or is predetermined. For example, the system may be programmed or designed or configured to display one or a predetermined larger number of information elements or components. The display may comprise, therefore, a display of patient heart rate. The display may comprise a suite of vital statistics including but not limited to heart rate. The display may further or alternatively comprise other monitoring information, or imaging information. These information elements or components may be designed or configured such that they do not obscure the visual field of the user, but instead augment that visual field.

[0047] According to an embodiment, the MRI interface system is configured to respond to user input in order to adjust the display. Accordingly, at step 160 of the method, the AR equipment 290 receives input from the user regarding the displayed information. The user input may be a request to stop showing displayed information, to modify displayed information, to show information not currently displayed, and/or any other input. The user input may be provided to the AR equipment or to another component of the MRI system via any mechanism for user input, including but not limited to voice commands, hand movement, eye movement, head movement, text, computer input, and/or any other input. For example, the system may be configured to detect, via a camera of the AR equipment or via any other camera in the MRI environment, a body movement by the user that is programmed to be associated with a particular user input. For example, a waving hand may indicate moving a portion of the display, swiping through information on the display, or any other response. Alternatively, the system may be configured to detect, via a sound sensor of the AR equipment or via any other sound sensor in the MRI environment, a voice command from the user.

[0048] According to an embodiment, the system receives the input from a clinician or technician responding to an alarm or alert displayed via the AR equipment. The alarm or alert may be generated at the patient, and may be automatically generated by the MRI system or may be generated in response to input from the patient. Once displayed, the clinician or technician can provide a user input to address the alarm or alert, including but not limited to silencing or dismissing the alarm or alert, modifying something within the MRI system, communicating with the patient, or any other action.

[0049] According to an embodiment, the system receives the input from the patient or subject wearing the AR equipment within the MRI environment. For example, the display may present action items to the patient, and the patient may activate an action item using any of the mechanisms for user input described or otherwise envisioned herein. The display may comprise a button or other interactive element that the patient should activate via the AR system, to request help, initiate communication, or activate any other action item.

[0050] The AR equipment or other component of the MRI system receiving the user input can transmit the user input to an appropriate component of the MRI system, thus enabling the system to respond to the user input. For example, according to an embodiment, the AR component receives the user input via a sensor and wirelessly transmits that received user input via the wireless network to another component of the system such as data aggregator 270, processor 220, patient monitoring equipment 280, and/or any other component of the MRI environment.

[0051] Once the user input is received, the system analyzes the user input to determine how to respond. For example, the system may be programmed with a slate of user commands or predetermined user inputs that are associated with a predetermined response. A first user input can be programmed to add a piece of information to the augmented display, and a second user input can be programmed to remove a piece of information from the augmented display. Many other responses are possible. For example, one user input can completely remove or turn off the augmentation, and another user input can turn the augmentation on.

[0052] Once the user input is recognized, the MRI system can respond to the user input. Accordingly, at step 180 of the method, the AR equipment for example modifies the display in response to the user input, and/or the MRI system responds to the user input. According to one embodiment, the AR equipment itself modifies the display in response to the user input. According to another embodiment, the AR equipment receives, from another component of the MRI system, modified information or instructions that result in the display being modified. According to yet another embodiment, the MRI system responds to the user input by silencing or modifying an alarm, modifying a parameter of the MRI system, enabling communication between the patient and the monitoring entity, and/or any other response.

[0053] Many different display modifications are possible. According to an embodiment, a piece of information is added to the augmented display, a piece of information is removed from the augmented display, the augmented display is activated, the augmented display is deactivated, the augmented display is dimmed, the augmented display is brightened, and/or any other modification of the augmented display is made.

[0054] According to an embodiment, the MRI interface systems and methods disclosed or otherwise envisioned herein provide numerous advantages over the prior art. For example, a healthcare professional in the MRI environment, such as a Primary Responsible Care Attendant (RCA), attends and monitors the patient but is often distracted by other responsibilities. For example, the RCA may become distracted with lower priority tasks associated with the care of the patient, such as charting monitor results. In such a case, the RCA may not see the monitor at all times, and thus could miss an alert or other important healthcare event. The MRI interface systems and methods disclosed or otherwise envisioned herein frees the healthcare professional from viewing the vital signs only on a monitor, since they can now use the AR to visualize the vital signs as a virtual component of the MRI environment. For example, during a coding situation, the healthcare professional can provide care to the patient without having to look away from the patient to view vital sign information or other important information. Accordingly, the MRI interface systems and methods disclosed or otherwise envisioned herein increases patient safety and healthcare efficacy by eliminating these distractions.

[0055] According to just one possible embodiment of the MRI interface systems and methods disclosed or otherwise envisioned herein, the system may comprise AR glasses configured to be worn by the RCA. This enables the wearer to see selected or predetermined monitor parameters via the glasses and allows them to have clear visibility of their surroundings to perform additional workflow tasks. The AR glasses could be designed with interactive user interface options to allow the RCA to view single or multiple parameters simultaneously. Additionally, the AR glasses could provide alerts when, as determined by the monitor, an unexpected, an undesired, or a predetermined event occurs. The AR glasses could have a feature set to allow the RCA to turn off alarms or investigate via the AR glasses. [0056] According to an embodiment, the MRI-compatible AR equipment 290 is configured to be wearable by a user within at least Zones 1, 2, 3, and 4 of the MRI environment as well as outside the MRI environment. One of the benefits of the systems and methods disclosed or otherwise envisioned herein is that because the AR equipment is wireless and hardened or otherwise adapted or configured for each zone of the MRI environment, the user wearing the AR equipment can move from one zone to another in either direction, as well as into or out of the MRI environment, without removing or otherwise adjusting the AR equipment. This is an enormous advantage over any other patient monitoring system currently available.

[0057] Referring to FIG. 2 is a schematic representation of an MRI interface system 200. System 200 may be any of the systems described or otherwise envisioned herein, and may comprise any of the components described or otherwise envisioned herein. It will be understood that FIG. 2 constitutes, in some respects, an abstraction and that the actual organization of the components of the system 200 may be different and more complex than illustrated.

[0058] According to an embodiment, system 200 comprises a processor 220 capable of executing instructions stored in memory 230 or storage 260 or otherwise processing data to, for example, perform one or more steps of the method. Processor 220 may be formed of one or multiple modules. Processor 220 may take any suitable form, including but not limited to a microprocessor, microcontroller, multiple microcontrollers, circuitry, field programmable gate array (FPGA), application-specific integrated circuit (ASIC), a single processor, or plural processors.

[0059] Memory 230 can take any suitable form, including a non-volatile memory and/or RAM. The memory 230 may include various memories such as, for example LI, L2, or L3 cache or system memory. As such, the memory 230 may include static random access memory (SRAM), dynamic RAM (DRAM), flash memory, read only memory (ROM), or other similar memory devices. The memory can store, among other things, an operating system. The RAM is used by the processor for the temporary storage of data. According to an embodiment, an operating system may contain code which, when executed by the processor, controls operation of one or more components of system 200. It will be apparent that, in embodiments where the processor implements one or more of the functions described herein in hardware, the software described as corresponding to such functionality in other embodiments may be omitted. [0060] User interface 240 may include one or more devices for enabling communication with a user. The user interface can be any device or system that allows information to be conveyed and/or received, and may include a display, a mouse, and/or a keyboard for receiving user commands. In some embodiments, user interface 240 may include a command line interface or graphical user interface that may be presented to a remote terminal via communication interface 250. The user interface may be located with one or more other components of the system, or may be located remote from the system and in communication via a wired and/or wireless communications network.

[0061] Communication interface 250 may include one or more devices for enabling communication with other hardware devices, and may comprise or otherwise be in communication with a wireless network 252. For example, communication interface 250 may include a network interface card (NIC) configured to communicate according to the Ethernet protocol. Additionally, communication interface 250 may implement a TCP/IP stack for communication according to the TCP/IP protocols. Various alternative or additional hardware or configurations for communication interface 250 will be apparent.

[0062] Storage 260 may include one or more machine-readable storage media such as readonly memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash-memory devices, or similar storage media. In various embodiments, storage 260 may store instructions for execution by processor 220 or data upon which processor 220 may operate. For example, storage 260 may store an operating system 261 for controlling various operations of system 200.

[0063] It will be apparent that various information described as stored in storage 260 may be additionally or alternatively stored in memory 230. In this respect, memory 230 may also be considered to constitute a storage device and storage 260 may be considered a memory. Various other arrangements will be apparent. Further, memory 230 and storage 260 may both be considered to be non-transitory machine-readable media. As used herein, the term non-transitory will be understood to exclude transitory signals but to include all forms of storage, including both volatile and non-volatile memories.

[0064] While system 200 is shown as including one of each described component, the various components may be duplicated in various embodiments. For example, processor 220 may include multiple microprocessors that are configured to independently execute the methods described herein or are configured to perform steps or subroutines of the methods described herein such that the multiple processors cooperate to achieve the functionality described herein. Further, where one or more components of system 200 is implemented in a cloud computing system, the various hardware components may belong to separate physical systems. For example, processor 220 may include a first processor in a first server and a second processor in a second server. Many other variations and configurations are possible.

[0065] According to an embodiment, system 200 may comprise patient monitoring equipment 280. Patient monitoring equipment may be any component of the MRI environment that obtains information about the patient or about the MRI environment itself. For example, the patient monitoring equipment may be configured to obtain any information from the patient. This may include, for example, patient vital signs such as heart rate, breathing rate, temperature, oxygen levels, and/or any other vital signs. The information about the patient may additionally or alternatively comprise imaging data for the patient, such as imaging obtained by the MRI equipment. The patient monitoring equipment 280 may be located within the MRI equipment room or MRI control room, among other locations. According to an embodiment, the monitoring equipment is configured to withstand the limitations of the MRI equipment room or MRI control room. According to an embodiment, the patient monitoring equipment 280 is configured to transmit monitoring information to another component of the MRI system using any method or system for data transmission, including but not limited to wired and/or wireless data transmission. For example, the data may be transmitted via a wired connection, or via a wireless network such as the internet, a local intranet, or other wireless network.

[0066] According to an embodiment, system 200 may comprise a data aggregator 270. The data aggregator can receive information from a plurality of sources within and/or outside the MRI environment, including but not limited to the patient monitoring equipment 280. According to an embodiment, in addition to the patient monitoring information, the data aggregator can receive, obtain, or otherwise comprise other monitoring or MRI information such as imaging information, environmental information, and other information. The data aggregator may be configured to package the received data for transmission to another component of the MRI system. The patient data aggregator 270 may be located within the MRI equipment room or MRI control room, among other locations. According to an embodiment, the data aggregator is configured to withstand the limitations of the MRI equipment room or MRI control room. According to an embodiment, the data aggregator 270 is configured to receive information from, and transmit information to, another component of the MRI system using any method or system for data transmission, including but not limited to wired and/or wireless data transmission. For example, the data may be transmitted via a wired connection, or via a wireless network such as the internet, a local intranet, or other wireless network.

[0067] According to an embodiment, system 200 may comprise AR equipment 290. The AR equipment may be any device configured for augmented reality. According to an embodiment, the AR equipment may be any device worn by a user and capable of augmenting the vision of that user. For example, the AR equipment may be glasses worn by the user and configured to project or otherwise display information to the user, thereby augmenting the visual field of the user. This augmentation of the visual field may comprise, among other things, adding information to the visual field such as overlaying patient information including patient vital signs and/or patient imaging data. The user may be any user that is required to or desires to visualization information within the MRI environment. This can include a technician, a clinician, or other healthcare professional, among other users.

[0068] The AR equipment may be any other type or configuration of AR equipment. The AR equipment may be worn by the user on their body or their clothes, and display or otherwise project information that augments the user’s visual field. For example, the AR equipment may be a device that hooks around a user’s ear and displays or otherwise projects information that augments the user’s visual field.

[0069] According to an embodiment, the AR equipment comprises one or more lenses that allows natural light to pass through to the eyes of the user, and a digital display such as an LED or OLED display that sends computer-generated images to the eyes of the user. The AR equipment may also comprise one or more cameras to capture the natural light in the MRI environment. The AR equipment may also comprise a processor to process one or more of the received patient information and the image data captured by the one or more cameras. The processor may be further configured to combine the received patient information and the image data to overlay some or all of the patient information onto the image data, and to transmit the combined information to the user via a display. The AR equipment may also comprise eye-tracking sensors or movement detection components, head-tracking or movement detection components, and other components.

[0070] According to an embodiment, the AR equipment is not connected by a wired connection to any other component of the system when in use, and is therefore connected to the system only by wireless communication. This allows the AR equipment, and the user, to move within different zones of the MRI environment, or within a zone of the MRI environment, without worrying about hardware and wired connection restrictions.

[0071] Due to the restrictions of the MRI environment, including but not limited to the high magnetic field and RF field, the AR equipment is preferably configured or designed to withstand those limitations. For example, the AR equipment may be hardened to withstand the MRI environment. The AR equipment may be designed or configured such that it does not comprise any ferromagnetic material. Other designs and configurations are possible.

[0072] According to an embodiment, storage 260 of system 200 may store data as well as one or more algorithms, modules, and/or instructions to carry out one or more functions or steps of the methods described or otherwise envisioned herein. For example, the system may comprise, among other instructions or data, patient monitoring data 262, AR display instructions 263, and/or user input instructions 264.

[0073] According to an embodiment, patient monitoring data 262 is any patient monitoring data received from the patient monitoring equipment 280. The storage of this data may be temporary or long-term. The data may comprise, for example, patient data such as vital signs, patient imaging, and/or any other information.

[0074] According to an embodiment, AR display instructions direct the system to augment reality using the AR equipment 290. The augmentation may be any augmentation of the user’s visual field. Among many other possibilities, the instructions can direct the AR equipment to display a computer-generated image comprising patient monitoring information. Many other embodiments are described or otherwise envisioned herein.

[0075] According to an embodiment, user input instructions 264 direct the system to receive and/or interpret user input and direct the system to modify the AR display in response to the interpreted user input. The user input may be provided to the AR equipment or to another component of the MRI system via any mechanism for user input, including but not limited to voice commands, hand movement, eye movement, head movement, text, computer input, and/or any other input. For example, the system may be configured to detect, via a camera of the AR equipment or via any other camera in the MRI environment, a body movement by the user that is programmed to be associated with a particular user input. For example, a waving hand may indicate moving a portion of the display, swiping through information on the display, or any other response. Alternatively, the system may be configured to detect, via a sound sensor of the AR equipment or via any other sound sensor in the MRI environment, a voice command from the user.

[0076] Many different display modifications, in response to the interpreted user input, are possible. According to an embodiment, a piece of information is added to the augmented display, a piece of information is removed from the augmented display, the augmented display is activated, the augmented display is deactivated, the augmented display is dimmed, the augmented display is brightened, and/or any other modification of the augmented display is made.

[0077] All definitions, as defined and used herein, should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and/or ordinary meanings of the defined terms.

[0078] The indefinite articles “a” and “an,” as used herein in the specification and in the claims, unless clearly indicated to the contrary, should be understood to mean “at least one.”

[0079] The phrase “and/or,” as used herein in the specification and in the claims, should be understood to mean “either or both” of the elements so conjoined, i.e., elements that are conjunctively present in some cases and disjunctively present in other cases. Multiple elements listed with “and/or” should be construed in the same fashion, i.e., “one or more” of the elements so conjoined. Other elements may optionally be present other than the elements specifically identified by the “and/or” clause, whether related or unrelated to those elements specifically identified.

[0080] As used herein in the specification and in the claims, “or” should be understood to have the same meaning as “and/or” as defined above. For example, when separating items in a list, “or” or “and/or” shall be interpreted as being inclusive, i.e., the inclusion of at least one, but also including more than one, of a number or list of elements, and, optionally, additional unlisted items. Only terms clearly indicated to the contrary, such as “only one of’ or “exactly one of,” or, when used in the claims, “consisting of,” will refer to the inclusion of exactly one element of a number or list of elements. In general, the term “or” as used herein shall only be interpreted as indicating exclusive alternatives (i.e. “one or the other but not both”) when preceded by terms of exclusivity, such as “either,” “one of,” “only one of,” or “exactly one of.”

[0081] As used herein in the specification and in the claims, the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements. This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified.

[0082] It should also be understood that, unless clearly indicated to the contrary, in any methods claimed herein that include more than one step or act, the order of the steps or acts of the method is not necessarily limited to the order in which the steps or acts of the method are recited.

[0083] In the claims, as well as in the specification above, all transitional phrases such as “comprising,” “including,” “carrying,” “having,” “containing,” “involving,” “holding,” “composed of,” and the like are to be understood to be open-ended, i.e., to mean including but not limited to. Only the transitional phrases “consisting of’ and “consisting essentially of’ shall be closed or semi-closed transitional phrases, respectively, as set forth in the United States Patent Office Manual of Patent Examining Procedures, Section 2111.03.

[0084] While several inventive embodiments have been described and illustrated herein, those of ordinary skill in the art will readily envision a variety of other means and/or structures for performing the function and/or obtaining the results and/or one or more of the advantages described herein, and each of such variations and/or modifications is deemed to be within the scope of the inventive embodiments described herein. More generally, those skilled in the art will readily appreciate that all parameters, dimensions, materials, and configurations described herein are meant to be exemplary and that the actual parameters, dimensions, materials, and/or configurations will depend upon the specific application or applications for which the inventive teachings is/are used. Those skilled in the art will recognize, or be able to ascertain using no more than routine experimentation, many equivalents to the specific inventive embodiments described herein. It is, therefore, to be understood that the foregoing embodiments are presented by way of example only and that, within the scope of the appended claims and equivalents thereto, inventive embodiments may be practiced otherwise than as specifically described and claimed. Inventive embodiments of the present disclosure are directed to each individual feature, system, article, material, kit, and/or method described herein. In addition, any combination of two or more such features, systems, articles, materials, kits, and/or methods, if such features, systems, articles, materials, kits, and/or methods are not mutually inconsistent, is included within the inventive scope of the present disclosure.

Claims

Claims What is claimed is:

1. An MRI interface system for an MRI environment, comprising:

MRI-compatible augmented reality (AR) equipment configured to be wearable by a user within at least Zones 1, 2, 3, and 4 of the MRI environment; a data aggregator configured to receive MRI data within the MRI environment, and further configured to package some or all of the received data for transmission to the MRI- compatible AR equipment, wherein the MRI data comprises monitoring information for a subject being imaged by the MRI; a wireless network configured to transmit the packaged data to the MRI-compatible AR equipment, and further configured to receive, from the MRI-compatible AR equipment, user input from the user; wherein the MRI-compatible AR equipment is configured to: (i) receive the transmitted packaged data; (ii) display some or all of the received packaged data to the user via augmented reality; and (iii) receive an input from the user; and (iv) transmit the received input to the wireless network.

2. The MRI interface system of claim 1, wherein the MRI-compatible AR equipment is further configured to be transportable, while worn by the user, from one of Zones 1, 2, 3, and 4 to another of said Zones.

3. The MRI interface system of claim 1, wherein the packaged data displayed to the user via augmented reality comprises one or more vital signs for the subject being imaged by the MRI.

4. The MRI interface system of claim 1, wherein the data aggregator is within Zone 4 of the MRI environment.

5. The MRI interface system of claim 1, wherein the data aggregator is within Zone 3 of the MRI environment.

6. The MRI interface system of claim 1, wherein the MRI data further comprises imaging information for the subject being imaged by the MRI.

7. The MRI interface system of claim 1, wherein the MRI-compatible AR equipment is further configured to modify the data displayed to the user via augmented reality in response to the received user input.

8. A method for augmented reality (AR) by an MRI interface system for an MRI environment, comprising: receiving, by a data aggregator of the MRI interface system, MRI data comprising monitoring information for a subject being imaged by the MRI; packaging, by the data aggregator, some or all of the received MRI data for transmission to MRI-compatible AR equipment, wherein the MRI-compatible AR equipment is configured to be wearable by a user within at least Zones 1, 2, 3, and 4 of the MRI environment; receiving the transmitted packaged data by the MRI-compatible AR equipment; and displaying, by the MRI-compatible AR equipment, some or all of the received packaged data to the user via augmented reality.

9. The method of claim 8, further comprising: receiving an input from the user of the MRI-compatible AR equipment; and modifying the displayed packaged data in response to the received user input.

10. The method of claim 9, wherein modifying the displayed packaged data in response to the received user input comprises adding or removing data from the augmented reality.

11. The method of claim 8, wherein the MRI-compatible AR equipment is further configured to be transportable, while worn by the user, from one of Zones 1, 2, 3, and 4 to another of said Zones.

12. The method of claim 8, wherein the packaged data displayed to the user via augmented reality comprises one or more vital signs for the subject being imaged by the MRI.

13. The method of claim 8, wherein the data aggregator is within Zone 4 of the MRI environment.

14. The method of claim 8, wherein the data aggregator is within Zone 3 of the MRI environment.

15. The method of claim 8, wherein the MRI data further comprises imaging information for the subject being imaged by the MRI.