Classifications

• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
  • G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H30/00—ICT specially adapted for the handling or processing of medical images
  • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS

Definitions

• Embodiments of the present disclosure relate generally to the field of medical devices and, more particularly, to a multi-modality selective archiving system and method.
• data associated with each medical modality is traditionally acquired and managed by distinct hardware or software systems.
• a practitioner may review a data set associated with a first medical modality on a different system than a data set associated with a second, different medical modality. Transitioning between systems to review data acquired from the same patient may lead to inefficient and inaccurate diagnoses.
• archival mechanisms and archival storage locations may be different between different modality acquisition systems. For example, a patient's IVUS data may be archived in a different location and in a different format that the same patient's OCT data, making data retrieval inefficient and burdensome.
• the present disclosure is directed to selectively archiving patient data in a multi-modality medical processing system.
• the method and system described herein selectively archive medical data at a patient case level, at modality data set level, and/or at an individual image level, so as to allow a practitioner to have a fine level of control over the specific data archived.
• data sets in different medical modalities may be archived at the same time, and patient cases corresponding to different patients may be archived at the same time to increase archival efficiency.
• the present disclosure is directed to a method of selectively archiving medical data associated with a patient with a multi-modality medical processing system.
• the method includes receiving first medical data acquired from the patient from a first medical instrument, the first medical data being associated with a first medical modality and receiving second medical data acquired from the patient from a second medical instrument, the second medical data being associated with a second medical modality different than the first medical modality.
• the method also includes displaying selectable representations of the first medical data and the second medical data on a user interface, receiving a user selection of one or more of the selectable representations, and receiving an archiving request via the user interface. Further, the method includes archiving, in response to receiving the archiving request, the medical data corresponding to the selected one or more selectable representations to an archival location.
• the present disclosure is directed to a multi-modality medical processing system.
• the system includes a non-transitory, computer-readable storage medium that stores a plurality of instructions for execution by at least one computer processor.
• the instructions are for receiving first medical data acquired from the patient from a first medical instrument, the first medical data being associated with a first medical modality and receiving second medical data acquired from the patient from a second medical instrument, the second medical data being associated with a second medical modality different than the first medical modality.
• the instructions are also for displaying selectable representations of the first medical data and the second medical data on a user interface, receiving a user selection of one or more of the selectable representations, and receiving an archiving request via the user interface. Further, the instructions are for archiving, in response to receiving the archiving request, the medical data corresponding to the selected one or more selectable representations to an archival location.
• the present disclosure is directed to a method of selectively archiving medical data with a patient with a multi-modality medical processing system.
• the method includes maintaining a first patient case corresponding to a first patient, the first patient case including multi-modality medical data acquired from the first patient and maintaining a second patient case corresponding to a second patient, the second patient case including multi-modality medical data acquired from the second patient.
• the method also includes displaying selectable representations of the first patient case and the second patient case on a user interface and receiving a user selection of one or more of the selectable representations, receiving an archive request via the user interface.
• the method includes archiving, in response to receiving the archive request, the multi-modality medical data within the patient cases corresponding to the selected one or more selectable representations to an archival location.
• the present disclosure is directed to anonymizing patient data in a multi-modality medical processing system.
• the method and system described herein automatically remove information from medical data that could identify the patient from which it was acquired, so as to protect the privacy of the patient.
• the anonymizing is performed without intervention from a human to limit errors and incomplete information deletion.
• data sets in different medical modalities may be anonymized at the same time, and multiple patient cases corresponding to different patients may be anonymized at the same time to increase efficiency.
• the present disclosure is directed to a method of anonymizing medical data acquired from a patient in a multi-modality medical processing system.
• the method includes receiving first medical data acquired from the patient from a first medical instrument, the first medical data being associated with a first medical modality, receiving second medical data acquired from the patient from a second medical instrument, the second medical data being associated with a second medical modality different than the first medical modality, and adding the first and second medical data to a patient case corresponding to the patient, the patient case including identifying information about the patient.
• the method further includes displaying a selectable representation of the patient case on a user interface, receiving a user selection of the selectable representation, and receiving an anonymizing request from a user via the user interface.
• the method includes removing, in response to the receiving the anonymizing request, the identifying information from the patient case, the removing being free of influence from the user, and wherein at least some of the identifying information is hidden from the user during the removing.
• the present disclosure is directed to a multi-modality medical processing system.
• the system includes a non-transitory, computer-readable storage medium that stores a plurality of instructions for execution by at least one computer processor.
• the instructions are for receiving first medical data acquired from the patient from a first medical instrument, the first medical data being associated with a first medical modality and receiving second medical data acquired from the patient from a second medical instrument, the second medical data being associated with a second medical modality different than the first medical modality.
• the instructions are also for adding the first and second medical data to a patient case corresponding to the patient, the patient case including identifying information about the patient, displaying a selectable representation of the patient case on a user interface, and receiving a user selection of the selectable representation.
• the instructions are for receiving an anonymizing request from a user via the user interface and removing, in response to the receiving the anonymizing request, the identifying information from the patient case, the removing being free of influence from the user, and wherein at least some of the identifying information is hidden from the user during the removing.
• the present disclosure is directed to another method of anonymizing medical data in a multi-modality medical processing system.
• the method includes receiving first medical data acquired from a first patient from a first medical instrument, adding the first medical data to a first patient case corresponding to the first patient, the first patient case including first identifying information about the first patient, receiving second medical data acquired from a second patient from a second medical instrument, the second patient being different than the first patient, and adding the second medical data to a second patient case corresponding to the second patient, the second patient case including second identifying information about the second patient.
• the method also includes displaying selectable representations of the first and second patient cases on a user interface, receiving user selections of both of the selectable representations, and receiving an anonymizing request from a user via the user interface.
• the method also includes removing, in response to the receiving the anonymizing request, the first and second identifying information from the respective first and second patient cases, the removing being free of influence from the user, and wherein the first and second identifying information is hidden from the user during the removing.
• the present disclosure is directed to displaying patient medical data in a multi-modality medical processing system.
• the method and system described herein present medical data in multiple different modalities on a single user interface screen, allowing a practitioner viewing the user interface to manage all acquired data sets associated with a patient regardless of modality. As such, the amount of time a practitioner must spend reviewing patient medical data is reduced, leading to more efficient diagnosis and treatment. Further, multiple patient cases corresponding to different patients may be presented on a single user interface screen to simplify multi-patient case management.
• the present disclosure is directed to a method of displaying multi-modality medical data with a multi-modality medical processing system.
• the method includes receiving first medical data acquired from a patient from a first medical instrument, the first medical data being associated with a first medical modality, storing the first medical data in a data repository, receiving second medical data about the patient from a second medical instrument, the second medical data being associated with a second medical modality different than the first medical modality, and storing the second medical data in the data repository.
• the method also includes displaying selectable representations of each of the first medical data and the second medical data on a user interface, receiving a user selection of the selectable representation of the first medical data, and displaying, in response to receiving the user selection, the first medical data in the user interface.
• the present disclosure is directed to a multi-modality medical processing system.
• the system includes a data repository and a non-transitory, computer-readable storage medium that stores a plurality of instructions for execution by at least one computer processor.
• the instructions are for receiving first medical data acquired from a patient from a first medical instrument, the first medical data being associated with a first medical modality storing the first medical data in the data repository, receiving second medical data acquired from the patient from a second medical instrument, the second medical data being associated with a second medical modality different than the first medical modality, and storing the second medical data in the data repository.
• the instructions are also for displaying selectable representations of each of the first medical data and the second medical data on a user interface, receiving a user selection of the selectable representation of the first medical data, and displaying, in response to receiving the user selection, the first medical data in the user interface.
• the present disclosure is directed to another method of displaying multi-modality medical data with a multi-modality medical processing system.
• the method includes maintaining a first patient case corresponding to a first patient, the first patient case including a first data set associated with a first medical modality and a second data set associated with a second medical modality different than the first modality and maintaining a second patient case corresponding to a second patient, the second patient case including medical data acquired from the second patient.
• the method also includes displaying selectable representations of each of the first patient case and the second patient case on a user interface, receiving a first user selection of the selectable representation of the first patient case, and displaying, in response to receiving the first user selection, selectable representations of each of the first data set and the second data set on the user interface.
• the method also includes receiving a second user selection of the selectable representation of the first data set and displaying, in response to receiving the second user selection, the first data set on the user interface.
• the present disclosure is directed to managing and storing patient data in a multi-modality medical processing system.
• the method and systems described herein store all medical data acquired from a patient in a single patient record that is assigned a unique identifier. For example, (i) information identifying a patient, (ii) data acquired during a first diagnostic procedure, and (iii) data acquired during a second, different diagnostic procedure may all be stored in association with the same unique identifier, so as to simplify patient case review and retrieval. As an aspect of this, identifying patient information such as patient name and date of birth need only be inputted into the disclosed system a single time, thereby reducing the chance of clerical error.
• the present disclosure is directed to a method of multi- modality medical case management in a multi-modality medical processing system.
• the method includes receiving identifying information about a patient, generating a unique identifier corresponding to the patient, and associating the identifying information with the unique identifier.
• the method also includes receiving, at the multi-modality medical processing system, first medical data acquired from the patient from a first medical instrument, the first medical data being associated with a first medical modality and storing the first medical data in a data repository, the first medical data being associated with the unique identifier in the data repository.
• the method includes receiving, at the multi- modality medical processing system, second medical data acquired from the patient from a second medical instrument, the second medical data being associated with a second medical modality different than the first medical modality and storing the second medical data in the data repository, the second medical data being associated with the unique identifier in the data repository.
• the present disclosure is directed to a multi-modality medical processing system.
• the system includes a data repository and a non- transitory, computer-readable storage medium that stores a plurality of instructions for execution by at least one computer processor.
• the instructions are for receiving identifying information about a patient, generating a unique identifier corresponding to the patient, and associating the identifying information with the unique identifier.
• the instructions are also for receiving first medical data acquired from the patient from a first medical instrument communicatively coupled to the multi-modality medical processing system, the first medical data being associated with a first medical modality and storing the first medical data in the data repository, the first medical data being associated with the unique identifier in the data repository.
• the instructions are for receiving second medical data acquired from the patient from a second medical instrument communicatively coupled to the multi-modality medical processing system, the second medical data being associated with a second medical modality different than the first medical modality and storing the second medical data in the data repository, the second medical data being associated with the unique identifier in the data repository.
• the present disclosure is directed to a multi-modality medical processing system.
• the system includes a computing system communicatively coupled to a first medical instrument and a second medical instrument.
• the computing system includes a user interface component configured to receive identifying information about a patient, a first modality workflow component configured to receive first medical data acquired from the patient from the first medical instrument, the first medical data being in a first medical modality, and a second modality workflow component configured to receive second medical data acquired from the patient from the second medical instrument, the second medical data being in a second medical modality different from the first medical modality.
• the computing system also includes a multi-modality case management (MMCM) workflow component configured to associate a unique identifier with the identifying information, the first medical data, and the second medical data and a data repository configured to store the identifying information, the first medical data, and the second medical data in association with the unique identifier.
• MMCM multi-modality case management
• Figure 1 is a schematic drawing depicting a medical system including a multi-modality processing system according to one embodiment of the present disclosure.
• Figure 2 is a functional block diagram of portions of the medical system, including a processing framework executing on an embodiment of the multi-modality processing system.
• Figure 3A is a functional block diagram of portions of the processing framework of Figure 2, the portions being associated with multi-modality case management.
• Figure 3B illustrates an example patient case having unique identifiers at each hierarchical data level.
• Figure 4 is a simplified flow diagram of patient case management within the multi- modality processing system of Figure 1 according to aspects of the present disclosure.
• Figures 5-13 are various example screens of a case management user interface rendered by the multi-modality processing system of Figure 1.
• Figure 14 is a simplified flow diagram showing archiving and anonymizing patient medical data within the multi-modality processing system of Figure 1.
• Figure 15 is an example archival screen of the case management user interface rendered by the multi-modality processing system of Figure 1.
• Figure 1 is a schematic drawing depicting a medical system 100 including a multi- modality processing system 101 according to one embodiment of the present disclosure.
• the medical system 100 provides for coherent integration and consolidation of multiple forms of acquisition and processing elements designed to be sensitive to a variety of methods used to acquire and interpret human biological physiology and morphological information and coordinate treatment of various conditions.
• the multi-modality processing system 101 is an integrated device for the acquisition, control, interpretation, and display of multi-modality medical sensing data.
• the processing system 101 is a computer system with the hardware and software to acquire, process, and display multi-modality medical data, but, in other embodiments, the processing system 101 may be any other type of computing system operable to process medical data.
• processing system 101 is a computer
• the system includes at least a processor such as a microcontroller or a dedicated central processing unit (CPU), a non-transitory computer-readable storage medium such as a hard drive, random access memory (RAM), and/or compact disk read only memory (CD- ROM), a video controller such as a graphics processing unit (GPU), and a network communication device such as an Ethernet controller or wireless communication controller.
• a processor such as a microcontroller or a dedicated central processing unit (CPU), a non-transitory computer-readable storage medium such as a hard drive, random access memory (RAM), and/or compact disk read only memory (CD- ROM), a video controller such as a graphics processing unit (GPU), and a network communication device such as an Ethernet controller or wireless communication controller.
• the processing system 101 is programmed to execute steps associated with the data acquisition and analysis described herein. Accordingly, it is understood that any steps related to data acquisition, data processing, instrument control, and/or other processing or control aspects of the present disclosure may be implemented by the processing system using corresponding
• processing system 101 comprises a plurality of computing devices.
• different processing and/or control aspects of the present disclosure may be implemented separately or within predefined groupings using a plurality of computing devices. Any divisions and/or combinations of the processing and/or control aspects described below across multiple computing devices are within the scope of the present disclosure.
• the medical system 100 is deployed in a catheter lab 102 having a control room 104, with the processing system 101 being located in the control room.
• the processing system 101 may be located elsewhere, such as in the catheter lab 102, in a centralized area in a medical facility, or at an off-site location (i.e., in the cloud).
• the catheter lab 102 includes a sterile field generally encompassing a procedure area but its associated control room 104 may or may not be sterile depending on the requirements of a procedure and/or health care facility.
• the catheter lab and control room may be used to perform on a patient any number of medical sensing procedures such as angiography, intravascular ultrasound (IVUS), virtual histology (VH), forward looking IVUS (FL-IVUS), intravascular photoacoustic (IVPA) imaging, a fractional flow reserve (FFR) determination, an instantaneous wave-free ratio (iFR) determination, an x-ray angiography (XA) imaging, a coronary flow reserve (CFR) determination, optical coherence tomography (OCT), computed tomography, intracardiac echocardiography (ICE), forward-looking ICE (FLICE), intravascular palpography, transesophageal ultrasound, or any other medical sensing modalities known in the art.
• IVUS intravascular ultrasound
• VH virtual histology
• FL-IVUS forward looking IVUS
• IVPA intravascular photoacoustic
• FFR fractional flow reserve
• iFR instantaneous wave-free ratio
• XA x-ray angi
• the catheter lab and control room may be used to perform one or more treatment or therapy procedures on a patient such as radiofrequency ablation (RFA), cryotherapy, atherectomy or any other medical treatment procedure known in the art.
• RPA radiofrequency ablation
• a patient 106 may be undergoing a multi-modality procedure either as a single procedure or in combination with one or more sensing procedures.
• the catheter lab 102 includes a plurality of medical instruments including medical sensing devices that may collect medical sensing data in various different medical sensing modalities from the patient 106.
• instruments 108 and 110 are medical sensing devices that may be utilized by a clinician to acquire medical sensing data about the patient 106.
• the device 108 collects medical sensing data in one modality and the device 110 collects medical sensing data in a different modality.
• the instruments may each collect one of pressure, flow (velocity), images (including images obtained using ultrasound (e.g., IVUS), OCT, thermal, and/or other imaging techniques), temperature, and/or combinations thereof.
• the devices 108 and 110 may be any form of device, instrument, or probe sized and shaped to be positioned within a vessel, attached to an exterior of the patient, or scanned across a patient at a distance.
• instrument 108 is an IVUS catheter 108 that may include one or more sensors such as a phased-array transducer to collect IVUS sensing data.
• the IVUS catheter 108 may be capable of multi-modality sensing such as IVUS and IVPA sensing.
• the instrument 110 is an OCT catheter 110 that may include one or more optical sensors configured to collect OCT sensing data.
• an IVUS patient interface module (PIM) 112 and an OCT PIM 114 respectively couple the IVUS catheter 108 and OCT catheter 110 to the medical system 100.
• PIM IVUS patient interface module
• the IVUS PIM 112 and the OCT PIM 114 are operable to respectively receive medical sensing data collected from the patient 106 by the IVUS catheter 108 and OCT catheter 110 and are operable to transmit the received data to the processing system 101 in the control room 104.
• the PIMs 112 and 114 include analog to digital (A/D) converters and transmit digital data to the processing system 101, however, in other embodiments, the PIMs transmit analog data to the processing system.
• the IVUS PIM 112 and OCT PIM 114 transmit the medical sensing data over a Peripheral Component Interconnect Express (PCIe) data bus connection, but, in other embodiments, they may transmit data over a USB connection, a Thunderbolt connection, a Fire Wire connection, or some other high-speed data bus connection.
• PCIe Peripheral Component Interconnect Express
• the PIMs may be connected to the processing system 101 via wireless connections using IEEE 802.11 Wi-Fi standards, Ultra Wide-Band (UWB) standards, wireless Fire Wire, wireless USB, or another high-speed wireless networking standard.
• an electrocardiogram (ECG) device 116 is operable to transmit electrocardiogram signals or other hemodynamic data from patient 106 to the processing system 101.
• the processing system 101 may be operable to synchronize data collected with the catheters 108 and 110 using ECG signals from the ECG 116.
• an angiogram system 117 is operable to collect x-ray, computed tomography (CT), or magnetic resonance images (MRI) of the patient 106 and transmit them to the processing system 101.
• CT computed tomography
• MRI magnetic resonance images
• the angiogram system 117 may be communicatively coupled to the processing system to the processing system 101 through an adapter device. Such an adaptor device may transform data from a proprietary third-party format into a format usable by the processing system 101.
• the processing system 101 may be operable to co-register image data from angiogram system 117 (e.g., x-ray data, MRI data, CT data, etc.) with sensing data from the IVUS and OCT catheters 108 and 110.
• angiogram system 117 e.g., x-ray data, MRI data, CT data, etc.
• the co-registration may be performed to generate three-dimensional images with the sensing data.
• a bedside controller 118 is also communicatively coupled to the processing system 101 and provides user control of the particular medical modality (or modalities) being used to diagnose the patient 106.
• the bedside controller 118 is a touch screen controller that provides user controls and diagnostic images on a single surface.
• the bedside controller 118 may include both a non- interactive display and separate controls such as physical buttons and/or a joystick.
• the bedside controller 118 is operable to present workflow control options and patient image data in graphical user interfaces (GUIs).
• GUIs graphical user interfaces
• the bedside controller 118 includes a user interface (UI) framework service through which workflows associated with multiple modalities may execute.
• UI user interface
• the bedside controller 118 is capable displaying workflows and diagnostic images for multiple modalities allowing a clinician to control the acquisition of multi-modality medical sensing data with a single interface device.
• a main controller 120 in the control room 104 is also communicatively coupled to the processing system 101 and, as shown in Figure 1, is adjacent to catheter lab 102.
• the main controller 120 is similar to the bedside controller 118 in that it includes a touch screen and is operable to display multitude of GUI-based workflows corresponding to different medical sensing modalities via a UI framework service executing thereon.
• the main controller 120 may be used to simultaneously carry out a different aspect of a procedure's workflow than the bedside controller 118.
• the main controller 120 may include a non-interactive display and standalone controls such as a mouse and keyboard.
• the medical system 100 further includes a boom display 122 communicatively coupled to the processing system 101.
• the boom display 122 may include an array of monitors, each capable of displaying different information associated with a medical sensing procedure. For example, during an IVUS procedure, one monitor in the boom display 122 may display a tomographic view and one monitor may display a sagittal view.
• the multi-modality processing system 101 is communicatively coupled to a data network 125.
• the data network 125 is a TCP/IP-based local area network (LAN), however, in other embodiments, it may utilize a different protocol such as Synchronous Optical Networking (SONET), or may be a wide area network (WAN).
• SONET Synchronous Optical Networking
• WAN wide area network
• the processing system 101 may connect to various resources via the network 125. For example, the processing system 101 may communicate with a Digital Imaging and
• DICOM Communications in Medicine
• a network console 130 may communicate with the multi-modality processing system 101 via the network 125 to allow a doctor or other health professional to access the aspects of the medical system 100 remotely.
• a user of the network console 130 may access patient medical data such as diagnostic images collected by multi-modality processing system 101, or, in some embodiments, may monitor or control one or more on-going procedures in the catheter lab 102 in real-time.
• the network console 130 may be any sort of computing device with a network connection such as a PC, laptop, smartphone, tablet computer, or other such device located inside or outside of a health care facility.
• medical sensing tools in system 100 discussed above are shown as communicatively coupled to the processing system 101 via a wired connection such as a standard copper link or a fiber optic link, but, in alternative embodiments, the tools may be connected to the processing system 101 via wireless connections using IEEE 802.11 Wi-Fi standards, Ultra Wide-Band (UWB) standards, wireless Fire Wire, wireless USB, or another high-speed wireless networking standard.
• IEEE 802.11 Wi-Fi standards Ultra Wide-Band (UWB) standards
• UWB Ultra Wide-Band
• the medical system 100 described above is simply an example embodiment of a system that is operable to collect diagnostic data associated with a plurality of medical modalities.
• different and/or additional tools may be communicatively coupled to the processing system 101 so as to contribute additional and/or different functionality to the medical system 100.
• the processing framework 200 includes various independent and dependent executable components that control the operation of the processing system 101, including the acquisition, processing, and display of multi-modality medical sensing data.
• the processing framework 200 of processing system 101 is modular and extensible. That is, the framework 200 is comprised of independent software and/or hardware components (or extensions) respectively associated with different functions and medical sensing modalities. This modular design allows the framework to be extended to accommodate additional medical sensing modalities and functionality without impacting existing functionality or requiring changes to the underlying architecture.
• an internal messaging system facilitates independent data communication between modules within the framework.
• the processing framework 200 may be implemented as computer-executable instructions stored on a non-transitory computer-readable storage medium in the processing system 10. In other instances the processing framework 200 may be a combination of hardware and software modules executing within with the processing system 101.
• processing framework 200 includes a plurality of components that are configured to receive medical sensing data from a plurality of medical sensing devices, process the data, and output the data as diagnostic images via the main controller 120, the bedside controller 118, or other graphical display device.
• the framework 200 includes several system-level components that manage the core system functions of the processing system 101 and also coordinate the plurality of modality- specific components.
• the framework 200 includes a system controller 202 that coordinates startup and shutdown of the plurality of executable components of the processing framework 200, including hardware and software modules related to acquisition and processing of patient diagnostic data.
• the system controller 202 is also configured to monitor the state of components executing within the framework 202, for instance, to determine if any components have unexpectedly stopped executing.
• system controller 202 provides an interface through which other framework components may obtain system configuration and status information. Because the software framework 200 is modular, the system controller 202 is independent of the components within the framework that it manages so that errors and changes made to components do not affect the execution or structure of the system controller.
• an extension executing within framework 200 may include a plurality of executable components that together implement the full functionality of the extension.
• an extension may include an extension controller that is similar to the system controller 202 that is operable to startup, shutdown, and monitor the various executable components associated with the extension. For example, upon system startup, the system controller 202 may start an extension controller corresponding to a medical modality, and then the extension controller may, in turn, start the executable components associated with the modality.
• extension controllers may be unallocated until system controller 202 associates them with a specific modality or other system task via parameters retrieved from a configuration mechanism, such as a configuration file.
• the processing framework 200 further includes a workflow controller component 204 that is generally configured to govern the execution of the executable components of the framework 202 during multi-modality medical sensing workflows.
• the workflow controller component 204 may govern workflows executed by the processing framework 200 in various different manners.
• the processing framework 200 further includes an event logging component 206 that is configured to log messages received from various components of the processing framework. For instance, during system startup, the system controller 202 may send messages about the status of components being started to the event logging component 206 which, in turn, writes the messages to a log file in a standardized format. Additionally, the processing framework 200 includes a resource arbiter component 208 that is configured to manage the sharing of limited system resources between various executable components of the framework 202 during multi-modality medical sensing and/or treatment workflows. For example, during a multi-modality workflow, two or more components associated with different modalities within the processing framework 202 may be vying for the same system resource such as a graphical display on the main controller 120. The resource arbiter component 208 may coordinate sharing of limited system resources in various manners such as through a lock system, a queue system, or a hierarchical collision management system.
• system controller 202 may be implemented as processor-executable software stored on non-transitory, computer-readable storage medium, but in alternative embodiments, these components may be implemented as hardware components such as special purpose microprocessors, Field Programmable Gate Arrays (FPGAs), microcontrollers, graphics processing units (GPU), digital signal processors (DSP). Alternatively, the components of the processing framework may be implemented as a combination of hardware and software. In certain embodiments in which executable components are implemented in FPGAs, the system controller 202 may be configured to dynamically alter the programmable logic within the FPGAs to implement various functionality needed at the time.
• FPGAs Field Programmable Gate Arrays
• DSP digital signal processors
• the components of the processing framework may be implemented as a combination of hardware and software.
• the system controller 202 may be configured to dynamically alter the programmable logic within the FPGAs to implement various functionality needed at the time.
• the processing system 101 may include one or more unassigned FPGAs that may be allocated by the system controller during system startup. For instance, if upon startup of the processing system 101, the system controller detects an OCT PIM and catheter coupled thereto, the system controller or an extension controller associated with OCT functionality may dynamically transform the programmable logic within one the unassigned FPGAs such that it includes functionality to receive and/or process OCT medical data.
• the processing framework 200 further includes a message delivery component 210.
• the message delivery component 210 is configured to receive messages from components within the framework 202, determine the intended target of the messages, and deliver the messages in timely manner (i.e., the message delivery component is an active participant in the delivery of messages).
• message metadata may be generated by the sending component that includes destination information, pay load data (e.g., modality type, patient data, etc.), priority information, timing information, or other such information.
• message delivery component 210 may be configured to receive messages from components within the framework 202, temporarily store the messages, and make the messages available for retrieval by other components within the framework (i.e., the message delivery component is a passive queue).
• the message delivery component 210 facilitates communication between executable components in the framework 200.
• the system controller 202 may utilize the message delivery component 210 to inquire into the status of components starting up during a system startup sequence, and then, upon the receiving status information, utilize the message delivery component to transmit the status information to the event logging component 206 so that it may be written to a log file.
• the resource arbiter component 208 may utilize the message delivery component 210 to pass a resource token between components requesting access to limited resources.
• components in the framework 200 may packetize incoming medical sensing data into messages and then transmit the messages to a queue on the message delivery component where they may be retrieved by other components such as image data processing components. Further, in some embodiments, the message delivery component 210 is operable to make received messages available in a First-In-First-Out (FIFO) manner, wherein messages that arrive on the queue first will be removed from the queue first. In alternative embodiments, the message delivery component 210 may make messages available in a different manner for instance by a priority value stored in a message header.
• FIFO First-In-First-Out
• the message delivery component 210 is implemented in random-access memory (RAM) in the processing system 101, but, in other embodiments, it may be implemented in non-volatile RAM (NVRAM), secondary storage (e.g., magnetic hard drives, flash memory, etc.), or network-based storage. Further, in one embodiment, messages stored on the message delivery component 210 may be accessed by software and hardware modules in processing system 101 using Direct Memory Access (DMA).
• DMA Direct Memory Access
• the processing framework 202 further includes a number of additional system components that provide core system functionality including a security component 212, a multi-modality case management (MMCM) component 214, and a database management component 216.
• the security component 212 is configured to provide various security services to the overall processing framework and to individual components.
• components implementing an IVUS data acquisition workflow may utilize encryption application programming interfaces (APIs) exposed by the security component 212 to encrypt IVUS data before it is transmitted over a network connection.
• APIs application programming interfaces
• the security component 212 may provide other security services, such as system- level authentication and authorization services to restrict access to the processing framework to credentialed users and also to prevent the execution of untrusted components within the extensible framework.
• the multi-modality case management (MMCM) component 214 is configured to coordinate and consolidate diagnostic data associated with a plurality of medical modalities into a unified patient record that may be more easily managed. Such a unified patient record may be more efficiently stored in a database and may be more amenable to data archival and retrieval.
• the database management component 216 is configured to present transparent database services to the other components in the framework 200 such that database connection and management details are hidden from the other components.
• the database management component 216 may expose an API that includes database storage and retrieval functionality to components of the framework 200.
• a medical sensing workflow component may be able to transmit diagnostic data to a local and/or remote database such as a DICOM or PACS server via the database component without being aware of database connection details.
• the database management component 216 may be operable perform additional and/or different database services such as data formatting services that prepare diagnostic data for database archival.
• the processing framework 200 of the multi-modality processing system 101 is operable to receive and process medical data associated with a plurality of modalities.
• the processing framework 200 includes a plurality of modular acquisition components and workflow components that are respectively associated with different medical sensing and diagnostic modalities.
• the processing framework 200 includes an IVUS acquisition component 220 and an IVUS workflow component 222 that are respectively configured to receive and process IVUS medical sensing data from the IVUS PIM 112.
• any number of additional acquisition and workflow components may be independently added to the framework as denoted by the modality "N" acquisition component 224 and the modality "N" workflow component 226 that acquire and process data from a modality "N" PIM 228.
• the processing system 101 may be communicatively coupled to the OCT PIM 114, the ECG system 116, a fractional flow reserve (FFR) PIM, a FLIVUS PIM, and an ICE PIM.
• FFR fractional flow reserve
• additional and/or different medical sensing, treatment, or diagnostic devices may be coupled to the processing system 101 via additional and/or different data communication connections known in the art.
• the processing framework 200 may include an FFR acquisition component to receive FFR data from an FFR PIM, a FLIVUS acquisition component to receive FLIVUS data from a FLIVUS PIM, an ICE acquisition component to receive ICE data from an ICE PIM, and an OCT acquisition component is operable to receive OCT data from an OCT PIM.
• medical data communicated between the executable components of the processing framework 200 and the communicatively coupled medical devices may include data collected by sensors, control signals, power levels, device feedback, and other medical data related to a sensing, treatment, or diagnostic procedure.
• patient treatment devices may be communicatively coupled to the processing system 101 such as devices associated with radiofrequency ablation (RFA), cryotherapy, or atherectomy and any PIMs or other control equipment associated with such treatment procedures.
• RPA radiofrequency ablation
• the modality "N" acquisition component 224 and the modality "N” workflow component 226 may be configured to communicate with and control the treatment devices such as by relaying control signals, relaying power levels, receiving device feedback, and receiving data collected by sensors disposed on the treatment devices.
• the components packetize the data into messages to facilitate intersystem communication.
• the components may be operable to create a plurality of messages from an incoming digital data stream, where each message contains a portion of the digitized medical sensing data and a header.
• the message header contains metadata associated with the medical sensing data contained within the message.
• the acquisition components 220 and 224 may be operable to manipulate the digitized medical sensing data in some way before it is transmitted to other portions of the framework 200. For example, the acquisition components may compress the sensing data to make intersystem communication more efficient, or normalize, scale or otherwise filter the data to aid later processing of the data.
• this manipulation may be modality-specific.
• the IVUS acquisition component 220 may identify and discard redundant IVUS data before it is passed on to save processing time in subsequent steps.
• the acquisition components 220 and 224 may additionally perform a number of tasks related to the acquisition of data including responding to interrupts generated by data buses (e.g., PCIe, USB), detecting which medical sensing devices are connected to processing system 101, retrieving information about connected medical sensing devices, storing sensing device- specific data, and allocating resources to the data buses.
• data buses e.g., PCIe, USB
• the data acquisition components are independent from each other and may be installed or removed without disrupting data acquisition by other components.
• acquisition components are independent of underlying data bus software layers (for example, through the use of APIs) and thus may be created by third parties to facilitate acquisition of data from third party medical sensing devices.
• the workflow components of the processing framework receive unprocessed medical sensing and/or diagnostic data from respective acquisition components via the message delivery component 210.
• the workflow components are configured to control the acquisition of medical sensing data such as by starting and stopping data collection at calculated times, displaying acquired and processed patient data, and facilitating the analysis of acquired patient data by a clinician.
• the workflow components are operable to transform unprocessed medical data gathered from a patient into diagnostic images or other data formats that enable a clinician to evaluate a patient's condition.
• an IVUS workflow component 222 may interpret IVUS data received from the IVUS PIM 112 and convert the data into human- readable IVUS images.
• a software stack within the framework may expose a set of APIs with which the workflow component 222 and other workflow components in the framework may call to access system resources such as the computational resources, the message delivery component 210, and communication resources.
• the modality-centric workflow components may transmit one or messages containing the processed data to other components within the framework 200 via the message delivery component 210.
• the components may insert a flag in the header indicating that the message contains processed data.
• the components may utilize the database management component 216 to transmit the processed data to archival systems such as a locally attached mass storage device or the network-based PACS server 127.
• the workflow components 222 and 226 are independent of each other and may be installed or removed without disrupting other components, and may be written by third parties. Further, due to their independence, they may be are operable to process signaling and imaging data from multiple medical sensing devices concurrently.
• the processing framework 200 additionally includes a co-registration interface component 230 and a co-registration workflow component 232 that are configured to acquire and process data from any number of data collection tools 234 and co-register the acquired data with data acquired by one of the other acquisition components within the framework.
• the co-registration interface component 230 may be operable to communicatively interface with medical data acquisition tools associated with any number of modalities, such as the ECG device 116 or the angiography system 117 of Figure 1.
• the interface component 230 may be operable to standardize and/or transform incoming modality data such that it may be co-registered with other sensing data acquired by the processing system 101.
• the co-registration workflow component 232 is configured to facilitate the co-registration of data from different modalities such as by spatially or temporally synchronizing data collection among medical sensing devices, aligning two or more acquired data sets based on spatial or temporal registration markers, and generating co-registered diagnostic images or other human-readable data that enable a clinician to evaluate a patient' s condition. Further, in other embodiments, the co-registration workflow component 232 may be operable to spatially co-register catheter-gathered data in a two-dimensional (2-D) or three-dimensional (3-D) space using previously-generated 2-D images or 3-D models.
• a catheter-based sensing tool may include fiducials that are tracked to generate position data during a sensing procedure, and the co-registration workflow component 232 may register this position data against previously acquired MRI data. Still further, the co- registration workflow component 232 may facilitate co-registration of multi-modality data acquired by native acquisition components within the framework 200 such as the IVUS acquisition component 220 and modality "N" acquisition component 224. Additionally, in some embodiments, a real-time clock may be integrated into the co-registration workflow component 232.
• DISTRIBUTED MEDICAL SENSING SYSTEM AND METHOD discloses temporally synchronizing medical sensing data collection in more detail and is hereby incorporated by reference in its entirety.
• a clinician utilizing the processing system 101 may control workflows and view diagnostic images through the main controller 120 and the bedside controller 118.
• the main controller 120 and the bedside controller 118 respectively include user interface (UI) framework services 240 and 242 that support a plurality of user interface (UI) extensions (or components).
• UI user interface
• the UI extensions supported by the UI framework services 240 and 242 respectively correspond to medical sensing modalities and are operable to render a user interface for control of the associated acquisition workflow and display of processed sensing data.
• the UI frameworks 240 and 242 are extensible in that they support UI extensions that are independent of one another. That is, its modular design allows the UI frameworks 240 and 242 to be extended to accommodate additional medical sensing modality user interfaces without impacting existing user interfaces or requiring changes to the underlying UI architectures.
• the main controller 120 includes a system UI extension 244 that renders a user interface containing core system controls and configuration options. For example, a clinician may startup, shutdown or otherwise manage the processing system 101 using the user interface rendered by the system UI extension 244.
• the components of the main controller 120 may be considered part of the processing framework 200.
• the IVUS UI extensions 246 and 248 render user interfaces for the main controller 120 and bedside controller 118, respectively.
• the IVUS UI extensions 246 and 248 may render and display the touch screen buttons used to control an IVUS workflow and also render and display the IVUS diagnostic images created by the IVUS workflow component 222.
• the modality "N" UI extensions 250 and 252 render controls and images associated with a modality "N" workflow.
• the UI framework services 240 and 242 may expose APIs with which the UI extensions may call to access system resources such as a look-and-feel toolbox and error handling resources.
• Look-and-feel toolbox APIs enable the UI extensions to present a standardized user interface with common buttons, parallel workflow formats, and data presentation schemes for different modality workflows. In this manner, clinicians may more easily transition between acquisition modalities without additional user interface training.
• co-registration UI extensions may present and/or combine processed image or signaling data from multiple modalities. For instance, a UI extension may display an electrocardiogram (ECG) wave adjacent to IVUS imaging data or may display an IVUS image overlaid with borders that were previously drawn on an OCT image.
• ECG electrocardiogram
• the UI framework services 240 and 242 may include a multi-tasking framework to coordinate concurrently executing UI extensions. For instance, in the event the processing system 101 is simultaneously acquiring data associated with more than one modality, the UI framework services 240 and 242 may present the user with a modality selector screen on which a desired user interface may be selected.
• the UI framework service 240 communicates with the components of the processing framework 200 via the message delivery component 210.
• the bedside controller 118 may be communicatively coupled to the processing framework 200 via a network connection 254.
• the network connection 254 may be any type of wired of wireless network connection such as an Ethernet connection or IEEE 802.11 Wi-Fi connection.
• one or both of the main and bedside controllers 120 and 118 may communicate with the processing framework 200 via a local bus connection such as a (PCIe) data bus connection, a USB connection, a Thunderbolt connection, a Fire Wire connection, or some other high-speed data bus connection.
• PCIe PCIe
• the bedside controller includes a message delivery component 256 that is configured to facilitate message -based communication between the UI extensions in the bedside controller 118 and the components in the processing framework 200.
• the message delivery component 256 may extract diagnostic image data from network communication packets as they arrive over the network connection 254.
• the processing framework 200 includes additional components that allow a clinician to access and/or control workflows executing in the multi-modality processing system 101.
• the framework 200 includes a remote access component 260 that
• the remote access component 260 is operable to export control functionality of the processing system 101 to the network console 130, so that the network console may present workflow control functions in its user interface.
• the remote access component 260 may receive workflow commands from the network console 130 and forward them to a remote access workflow component 262.
• the remote access workflow component 262 may dictate the set of commands and diagnostic data to which a remote user may access through the network console 130.
• the legacy control component 264 and legacy control workflow component 266 provide some level of access to modality workflow control and data to users of legacy consoles 268 (e.g. button consoles, mice, keyboards, standalone monitors).
• the core system components of the processing framework 200 and the additional components such as the modality-related components may be implemented as processor-executable software stored on non-transitory, computer-readable storage medium, but in alternative embodiments, these components may be implemented as hardware components such as special purpose microprocessors, Field Programmable Gate Arrays (FPGAs), microcontrollers, graphics processing units (GPU), digital signal processors (DSP).
• FPGAs Field Programmable Gate Arrays
• DSP digital signal processors
• the components of the processing framework may be implemented as a combination of hardware and software.
• processing framework 200 of Figure 2 is simply an example embodiment and, in alternative embodiments, the framework may include different and/or additional components configured to carry out various medical sensing workflows.
• the processing framework 200 may further include executable components configured for the evaluation of a stenosis of a human blood vessel or configured to facilitate control of computer-assisted surgery or remotely-controlled surgery.
• the MMCM workflow component 214 is configured to coordinate and consolidate patient medical data associated with a plurality of medical modalities into a unified patient record that may be more easily managed.
• the MMCM workflow component 214 associates a unique identifier (UID) with every aspect of a patient case including both medical data acquired from medical instruments and metadata (non-acquired data) describing the patient, the acquired data, and the procedure.
• UID unique identifier
• the UID may be a number, alphanumeric key, hexadecimal value, or any other item that may be used to uniquely identify a patient.
• the metadata associated with a UID may include identifying information about the patient (e.g., patient name, gender, date of birth, social security number, blood type, etc.), derived data associated with the acquired medical data (measurements, generated borders on intravascular images, etc.), annotations on images generated from the acquired medical data (vessel name, practitioner notes, internal structure identification, etc.), and information about the procedure performed on the patient (e.g., procedure time, procedure location, practitioner name, medical instruments utilized, etc.).
• a common unique identifier is assigned to all data acquired from a patient irrespective of the modality of the data. For example, a patient may typically undergo multiple different diagnostic procedures so that a practitioner may more fully assess the patient's condition. In that regard, data acquired during an IVUS procedure on the patient may be assigned the same UID as data acquired during an OCT procedure on the patient.
• the procedures may be performed during a single catheter lab session and in other instances they may be performed during multiple sessions separated by hours, days, months, or years.
• all diagnostic and/or treatment data acquired from the same patient is assigned the same unique identifier for improved patient diagnostics and, ultimately, treatment.
• the MMCM workflow component 214 illustrated in Figure 3 A coordinates the assignment of a common UID to all metadata and acquired data related to a patient case.
• the modality- specific workflow components for example the IVUS workflow component 222 and modality N workflow component 226— utilize the MMCM workflow component 214 to store medical data acquired from a patient with medical instruments such as catheter-based transducers.
• the MMCM workflow component 214 exposes a library of storage-related functions to the modality workflow components so that they may store and retrieve patient data from a designated storage medium.
• storage of acquired data is handled in a uniform manner rather than each modality component implementing its own storage mechanisms including file management mechanisms and data formatting mechanisms, etc.
• the MMCM workflow component 214 receives storage/retrieval requests from modality-specific components, it can coordinate a single set of patient metadata with medical data acquired from a patient across multiple different modalities.
• the MMCM workflow component 214 includes a MMCM logic component 302 that implements the storage and retrieval functionality of the library called by the modality- specific components.
• the MMCM logic component 302 may be implemented as a hierarchical state machine, but, in other embodiments, it may be implemented as an executable or another logic container.
• the MMCM logic component 302 generates unique identifiers and associates them with newly acquired data and metadata within a patient case.
• a single patient case may be "open" at a time within the processing framework 200 and the MMCM logic component 302 ensures all data acquired or entered by a practitioner while the case is open is associated with the same study (case) UID.
• the MMCM logic component 302 assigns the current UID to the acquired data and stores it in a data repository 304.
• the data repository 304 may implement any type of logical data container such as a database and be stored on any type of storage medium such as a hard drive on the multi-modality processing system 101 or at a networked storage location.
• the repository is an XML database that is accessed through a Shared Patient Information Management System (SPIMS).
• SPIMS Shared Patient Information Management System
• a patient's metadata e.g., identifying information, image annotation, etc
• acquired diagnostic data across modalities are stored in the repository 304 in association with the same UID.
• UID 1 is associated with a patient case that includes metadata 306, IVUS data 308, OCT data 310, and modality N data 312.
• all data associated with a patient case may be coordinated with a UID in numerous different manners, such as with a database table, data structure, hash table, stack, queue, linked list, etc.
• all data associated with a medical modality is stored together in a logical data partition, but each data set within the group of modality data may be associated with a UID corresponding to the patient case to which it belongs.
• the acquired patient data may be stored in the repository 304 in a number of different formats. For instance, it may be stored in "raw" form unchanged from the format generated by the acquiring medical instrument, or it may be stored in processed form— for example, as intravascular IVUS images.
• the data associated with a single UID may be collected over multiple clinical sessions, or maybe collected during a single session.
• each hierarchical level of data within a patient record has its own unique identifier, such that there is a chain of unique identifiers that links all the patient data together.
• An example of a patient case having unique identifiers at each data level is illustrated in Figure 3B.
• a patient case that includes all data acquired or associated with a patient may have a global unique identifier, shown in Fig. 3B as the patient case UID.
• a patient case may include one or more patient studies, where each patient study includes all data collected during a catheter lab session. Each patient study may include its own unique identifier that is linked to the global patient case unique identifier.
• each patient study may include one or more data sets (or series) comprised of data in a specific medical modality.
• a patient study may include an IVUS series, an OCT series, and an FFR series that were all acquired during a single catheter lab session, where each series has its own unique identifier that is linked to the patient study unique identifier.
• each data set or series may include one or more diagnostic images, where each image has its own unique identifier that is linked to the data set unique identifier. In this manner, the unique identifiers at each data level form a chain of ownership that links together patient metadata, patient studies, data sets (series), and individual images within a patient case.
• the MMCM logic component 302 may retrieve all acquired diagnostic data, regardless of modality, with a single access of the repository using the UID associated with the patient case. Or, the MMCM logic component 302 may retrieve just a single image using the unique identifier associated with the image. Similarly, if patient data is no longer needed, all medical data associated with a patient, regardless of modality, may be deleted concurrently using the UID associated with the patient.
• the MMCM logic component 302 may additionally interact with a data archive component 314 when a request to archive patient data is made by a practitioner. Specifically, as will be discussed in more detail in association with Figures 14-15, a practitioner may choose to archive all or parts of a patient case to a storage medium 316.
• the storage medium 316 may be a removable medium such as a writable Digital Versatile Disc (DVD), a writeable Blu-Ray Disc, a portable flash drive, or the storage medium 316 may be a fixed- typed storage such as a local hard drive, a DICOM server, or another networked archive repository.
• the MMCM logic component 302 may retrieve all data associated with a patient case from the repository 304 via the corresponding UID and then send the data to the data archive component 314 to be archived in association with the UID.
• restoration of archived data may be accomplished through reference to the UID.
• the data archive component 314 is configured, upon request, to anonymize data before it is archived. In embodiment, all identifying information about a patient may be removed from a patient case but the UID may remain associated with the case to facilitate efficient data management.
• the MMCM workflow component 214 further includes a MMCM graphical user interface component 320 that drives the user interface components associated with managing a patient case.
• the MMCM GUI component 320 renders UI screens related to new patient case creation, collection of identifying information about a patient, management of previously- acquired modality data, and the archival of patient diagnostic data.
• the MMCM GUI component 320 is configured to interpret user commands entered in association with the user interface. The screens related to patient case
• MMCM GUI component 320 The user interface rendered by the MMCM GUI component 320 will be discussed in greater detail in association with Figures 4-13.
• each modality- specific workflow component may independently handle the storage of acquired diagnostic data.
• each modality- specific workflow component may query the MMCM workflow component 214 for the UID corresponding to the currently open patient case and store the acquired diagnostic data in its dedicated storage container with the UID.
• the MMCM workflow component 214 may store patient metadata in a separate MMCM storage container along with the corresponding UID.
• an identifying information input screen 402 allows a practitioner to initially enter identifying information about a new patient into the multi- modality processing system 101.
• An example identifying information input screen 402 is shown in detail in Figure 5.
• the screen 402 permits entry of patient metadata including last name, middle name, first name, date of birth, gender, and UID.
• the UID may be entered by a practitioner or generated automatically by the MMCM workflow component. Further, the identifying information input screen 402 may be used to edit previously-stored patient information. By virtue of using a common unique identifier for all acquired patient data, regardless of modality, a practitioner need only enter the patient identifying information once when a patient case is initialized. In this manner, data entry errors are reduced and patient identifying information is ensured to be linked to the correct acquired diagnostic data.
• patient identifying information may be retrieved from an external patient data repository such as a Hospital Information System (HIS). In such a case, the identifying information input screen 402 may prompt a practitioner for network connection information for the external data repository so that the patient metadata may be retrieved.
• HIS Hospital Information System
• a patient case is initialized and the metadata 404 is passed to the MMCM workflow component 214 where the metadata is associated with a UID 406.
• the UID 406 may be the UID entered in the screen 402 or it may be a UID generated by the MMCM workflow component.
• the MMCM workflow component 214 stores the metadata in the data repository 304.
• a practitioner may perform one or more diagnostic and/or treatment procedures on the patient.
• a modality data acquisition screen 408 facilitates the acquisition of diagnostic data received from a medical instrument internal or external to the patient.
• An example modality data acquisition screen 408 is shown in detail in Figure 6.
• the example screen 408 illustrates an IVUS acquisition workflow.
• An image of the patient's vessel as generated from data captured by an IVUS transducer is displayed to allow the practitioner to guide the delivery catheter through the patient.
• each modality may have a user interface extension that renders the screens needed to perform the diagnostic procedure associated with the particular modality.
• the screens associated with data management rendered by the MMCM workflow component 214 and the screens associated with data acquisition rendered by each modality extension are integrated into a seamlessly user interface by the system UI extension 244 ( Figure 2).
• patient medical data 410 associated with the first modality captured via the modality data acquisition screen 408 is transmitted to the MMCM workflow component 214 where it is associated with the UID 406 corresponding to the open patient case and then stored in the data repository 304.
• the patient metadata 404 and patient medical data 406 are both stored in the data repository 304 in association with the UID 406.
• the medical data 410 may be stored in the data repository 304 in the form received from the medical instrument, but, in another embodiment, the medical data may be stored as processed data, such as IVUS or OCT images.
• a second data acquisition procedure is performed on the patient.
• the medical modality associated with the second data acquisition is different than the medical modality associated with the first data acquisition.
• the second data acquisition may be performed during the same catheter lab procedure as the first data acquisition or may be performed during a later procedure.
• the unique identifier methodology disclosed herein ensures that data collected during each acquisition is registered with the same patient, regardless of when the acquisitions occur.
• a second modality data acquisition screen 412 is presented to a practitioner to guide the second acquisition workflow.
• An example modality data acquisition screen 412 is shown in detail in Figure 7.
• the example screen 412 illustrates an FFR diagnostic procedure.
• the screen 412 presents a practitioner with data representative of the flow of blood through a patient's vessel as acquired by a sensor disposed in the vessel.
• patient medical data 414 captured in association with the second data acquisition screen 412 is passed to the MMCM workflow component 214 where the same UID 406 is associated with the data and the data is stored in the data repository 304.
• an acquired data management screen 416 allows a practitioner to review and manage the acquired data sets.
• An example acquired data management screen 416 is shown in detail in Figure 8.
• the screen 416 includes a case log that displays a selectable representation of every acquisition procedure performed on a patient, regardless of modality.
• each of the data sets displayed in the case log are stored in the data repository 304 under the same UID that corresponds to the patient case.
• the example screen 416 includes both IVUS data sets and FFR data sets that were acquired from the same patient.
• the selectable representations displayed on the screen 416 may correspond to data sets acquired over a period of hours, days, weeks, or years, or they may correspond to distinct data sets acquired within the same procedure.
• the MMCM GUI component 320 queries the data repository 304 for a list of all acquisition data sets associated with the UID corresponding to the open patient case.
• all the data sets are associated with the unique identifier 123456, and the selectable representations are organized by modality type.
• each selectable representation of a data set displays the title of the data set, whether the data sets includes any bookmarks highlighting important patient features, and the date and time the data set was acquired.
• additional information may be displayed in association with each selectable representation of a data set.
• the display order of the selectable representations in the case log may be altered based on various features of the data sets such as acquisition time.
• selecting a selectable representation on the screen 416 will cause the user interface to display the data and/or images contained in the selected data set.
• selecting a selectable representation on the screen 416 causes the UI to display additional information about the selected data set within the screen 416, for example in a drop-down preview pane.
• Figure 9 illustrates a scenario where a practitioner has selected the data set titled "UNTITLED 01". Additional information about the data set including acquisition time, pull back rate, and the labels of the bookmarks within the data set are displayed beneath the selectable representation of the data set. Further, as shown in the illustrated embodiment, a preview of the image data contained within the data set may be additionally displayed.
• buttons to delete the data set, load the data set, and display additional details about the data set are selectable by a practitioner.
• the screen 416 may allow a practitioner to select more than one selectable representation of a data set for comparison purposes. Accordingly, a practitioner viewing the acquired data management screen 416 may easily view and manage all acquired data sets associated with a patient regardless of modality. As such, the amount of time a practitioner must spend reviewing patient medical data is reduced, leading to more efficient diagnosis and treatment.
• the data management screen 418 is similar to the data management screen 416 but it is configured to display selectable representations of data sets associated with a plurality of patient cases.
• Each selectable representation of a patient case includes information about the patient case such as patient name, the unique identifier (UID), procedure date, physician, modality /mode, whether the data set is archived, the size of the data set, and the case type.
• each selectable representation of a patient case may include different and/or additional information such as patient date of birth, patient gender, procedure location, etc.
• the display order of the patient cases listed on the data management screen 418 may be arranged by one or more of the information categories associated with each patient case.
• the individual data sets comprising the selected patient case are displayed. All acquired data sets associated with a patient case, regardless of medical modality, are displayed below the selectable representation.
• the first patient case has been selected and data sets associated with an IVUS procedure and an FFR procedure are displayed.
• the multi-patient acquired data management screen 418 is configured to allow a practitioner to retrieve and open a patient case by selecting one of the displayed selectable representations.
• the MMCM GUI component 320 queries the data repository 304 using the associated UID, and the data sets associated with the patient are retrieved.
• a selected patient case may be retrieved from a local or network-based hard drive, but, in other embodiments, the selected patient case may be retrieved from a removable medium such as a DVD, Blu-ray disc, or flash-based drive. Accordingly, a practitioner viewing the multi-patient acquired data management screen 418 may easily view and manage all patient cases, including all acquired data sets contained in the patient cases regardless of modality. As such, a practitioner may efficiently identify and compare relevant patient cases, thus facilitating efficient diagnosis and treatment.
• a practitioner viewing the acquired data management screen 416 may select a particular data set to view in more detail, as described above.
• An identification of the selected medical data 420 is transmitted to the MMCM workflow component 214 so that the selected medical data may be retrieved from the data repository 304.
• the MMCM workflow component 214 queries the data repository 304 using at least the UID of the selected medical data.
• the selected patient medical data 422 is retrieved from the data repository 304, it is displayed to the requesting practitioner via an acquired medical data display screen 424.
• an example acquired medical data display screen 424 is illustrated in Figure 11.
• the example display screen 424 shows an image data set captured during an IVUS procedure.
• the acquired data management screen 416 may allow a practitioner to select more than one selectable representation of a data set for comparison purposes.
• the MMCM workflow component 214 may retrieve each of the requested data sets for simultaneous display on the acquired medical data display screen 424.
• Figure 12 illustrates another example of the acquired medical data display screen 424 that shows two IVUS images side by side.
• the two IVUS images may be from data sets acquired during two different IVUS procedures performed on a patient.
• the side by side comparison of patient images acquired at different times allows a practitioner to efficiently determine any changes in a patient's condition over time.
• Figure 13 is another example acquired medical data display screen 424 showing data associated with different modalities displayed side by side.
• an IVUS image acquired from a patient is shown concurrently with FFR data collected from the same patient.
• the IVUS data and the FFR data may have been collected during the same catheter lab procedure or during different catheter lab procedures.
• the MMCM workflow component 214 may include synchronization components to spatially or temporally synchronizing the multi-modality data displayed in the screen 424.
• One of ordinary skill in the art would recognize that the screen 424 in Figure 13 is just an example and that data in different modalities may be displayed side by side for comparison purposes.
• an OCT image may be displayed adjacent an ICE image, or, in some instances, data acquired outside of (but streamed to) the multi-modality processing system 101, such as x-ray angiography (XA) data, may be displayed adjacent data acquired by the processing system itself, such as IVUS or OCT data.
• XA x-ray angiography
• any measurements, annotations, notes, or other derived data 426 created during a review of acquired data via screen 424 are transmitted to the MMCM workflow component 214.
• the MMCM workflow component 214 associates the UID 406 corresponding to the open patient case with the derived data 426 and stores the derived data 426 in the data repository 304. In this manner, any annotations, measurements, etc. are closely associated with their corresponding acquired data to facilitate efficient retrieval and subsequent review.
• each modality workflow component may handle the writing and retrieving of data associated with that modality.
• the independent modality workflow components may query the MMCM workflow component for the UID corresponding to the currently open patient case before storing any new acquired data.
• the screens 402, 408, 412, 416, and 424 are simply examples and such screens may include different and/or additional features and user options to further facilitate patient case management within the multi- modality processing system 101.
• Figure 14 illustrated is flow diagram showing a different aspect of patient case management within the multi-modality processing system 101. Specifically, Figure 14 shows systems and methods of archiving and anonymizing patient medical data. Portions of Figure 14 similar to portions of Figure 4 and have been labeled similarly for the sake of clarity.
• archiving acquired medical data includes moving the medical data to a storage location outside of the medical processing system through which the medical data was acquired.
• acquired medical data may be transferred to a removable storage medium such as a writable optical disc or a portable flash-based container.
• acquired medical data may be transferred to a remote, data repository such as DICOM over a network connection.
• the MMCM GUI component renders an acquired medical data archive screen 1400.
• An example acquired medical data archive screen 1400 is shown in detail in Figure 15.
• the example archive screen 1400 displays a list of selectable representations of patient cases available for archival.
• Each selectable representation of a patient case includes information about the patient case such as patient name, the unique identifier (UID), procedure date, physician, modality/mode, whether the data set already archived, the size of the data set, and the case type.
• the UID displayed in association with each patient case may be an identifier assigned by the clinic hospital treating the patient and may not be universally unique like a social security number.
• each selectable representation of a patient case may include different and/or additional information such as patient date of birth, patient gender, procedure location, etc.
• the display order of the patient cases listed on the archive screen 1400 may be arranged one or more of the information categories associated with each patient case.
• Each representation of a patient case is selectable— for example, via a checkbox.
• Actuating a dropdown toggle associated with one of the patient cases further displays the modality data sets that comprise the patient case.
• the first patient case displayed on screen 1400 includes a data set generated during an IVUS procedure and a data set generated during an FFR procedure. These data sets are displayed as representations that are independently selectable— for example, by selecting a checkbox to the left of the data set representation.
• each image-based data set within a patient case i.e., an IVUS data set
• each image may be individually selectable— for example via a checkbox.
• the practitioner may select one or more patient cases, data sets, or images for archival.
• the practitioner would place checkmarks besides each item to be archived, and then actuate an archive button.
• the archival system of the present disclosure is configured to archive at the patient case level, at the data set level, and at the image level. That is, a practitioner may (1) selectively determine which patient case or plurality of patient cases to archive, (2) selectively determine which data set or plurality of data sets within a patient case to archive, and (3) selectively determine which image or plurality of images within a data set to archive. In some instances, any permutation of patient case, data set, or image may be archived together.
• a single archive action may archive multiple patient cases corresponding to multiple patients concurrently.
• an archived patient case may contain data sets associated with different medical modalities, and may also contain multi-modality data sets acquired during a single catheter lab procedure or acquired during different catheter lab procedures performed at different times.
• a patient case may be archived in association with its corresponding UID for efficient storage management and retrieval.
• utilization of the UID allows an archived patient case to be updated with "new" patient data acquired after the initial archival action.
• the screen 1400 will indicate as much in the "ARCHIVED" information column.
• the screen 1400 will indicate that the new data set is not archived. A practitioner may individually select the un-archived data set and actuate the archive button.
• the archival system (implemented by the data archive component 314 in Figure 3 A or by the MMCM workflow component 214) locates the archived patient case via the associated UID, opens it, and inserts the new data set.
• updating an archived patient case may be performed in a different manner such as by retrieving the data in the archived patient case, adding the new data set, and creating a new archive with the updated patient case.
• the MMCM workflow component prohibits data from being added to previously-archived cases to prevent data tampering.
• the archival system of Figures 14 and 15 is configured to archive medical data to a location chosen by a practitioner, rather than a fixed location.
• a practitioner may choose to either archive to a removable medium such as an optical writable disc or portable flash storage, or archive to a networked remote storage medium such as a DICOM server.
• additional and/or different archival locations may be selected by a practitioner such as a local hard drive, storage area network (SAN), or cloud-based storage.
• SAN storage area network
• the archival system of Figures 14 and 15 is configured to archive medical data in one of a plurality of different formats, as selected by a practitioner on the example screen 1400.
• patient medical data may be simply archived "as is" without a format change, its format may be modified (i.e., to a format selected on screen 1400), or it may be archived in a compressed form to reduce the amount of required storage space.
• the medical data may be inserted into a proprietary or industry- standard archival data container.
• medical data archived by the illustrated archival system may be encrypted, or otherwise obfuscated to prevent unauthorized access.
• an option to encrypt and/or limit access to an archived item via a password may be presented on the archival screen 1400.
• the archival element of the multi-modality processing system 101 illustrated in the embodiment of Figures 14 and 15 is further configured to selectively anonymize medical data before it is archived. For example, a practitioner may choose whether to remove identifying patient information from medical data before it is archived. In more detail, when archiving a patient case without anonymizing, all acquired modality data sets and also all metadata—including identifying patient information— are included in the archive container. Similarly, an individual archived modality data set and images also would include identifying patient information if archived without anonymizing. However, if a practitioner chooses to anonymize before archiving, the archival system automatically removes any information from an archival record that could identify the patient from whom the data was acquired. In the illustrated embodiment, the archival system anonymizes medical data when an
• the archival system is configured to remove all identifying patient information without the influence of the practitioner performing the archival. That is, the system first determines which data fields in a patient case contain information that could identify a patient, and then deletes any data in the identified fields. In one embodiment, the determination is based on a configuration file that includes a pre-determined set of data fields known to include identifying information. In an alternative embodiment, the archival system determines sensitive data fields on a case-by- case basis using natural language processing algorithms. Further, in some embodiments, identifying patient information is obfuscated, rather than removed, during the anonymizing procedure.
• obfuscated patient information may only be recovered by authorized systems or practitioners. Additionally, when multiple patient cases corresponding to multiple patients are selected for archive— and the anonymizing option is selected— identifying information about each different patient is removed or obfuscated from the patient cases.
• the multi-modality processing system 101 anonymizes archival data automatically without intervention by the practitioner, at least some of the removed patient information remains hidden from the practitioner or other third party data processor, thereby increasing confidentiality of sensitive medical information. Further, automated anonymization reduces clerical errors and ensures all identifying information is removed, regardless of whether it is accessible via the user interface. Further, in the archival scenario described herein, the anonymizing action is performed at the multi-modality
• the multi-modality processing system is a portable processing system stationed in a catheter lab
• a practitioner may acquire medical data from a patient, anonymize it, and archive it to a removal storage medium, such as a DVD, all within the catheter lab at the processing system.
• an archive request 1402 is transmitted to the
• the archive request is indicative of the specific medical data selected to be archived and whether the selected medical data should be anonymized.
• the MMCM workflow component 214 processes the request and retrieves the selected medical data 1404 from the data repository 304. If the practitioner indicated that the medical data 1404 should be anonymized, patient identifying information 1406 is removed or obfuscated by the MMCM workflow component 214 before it is saved to the archival storage medium 316.
• the MMCM workflow component 214 may further modify the data to be archived such as by compressing it, encrypting it, changing its format, and/or placing it in an archival data container, etc.
• archiving and anonymizing multi-modality medical data in a multi-modality processing system is simply an example embodiment, and in alternative embodiments, additional and/or different steps may be included in the method and the system may include additional and/or different user interface screens.
• the archival screen 1400 is simply an example and it may include different and/or additional features and user options to further facilitate patient case management within the multi-modality processing system 101.

Landscapes

• Health & Medical Sciences (AREA)
• Engineering & Computer Science (AREA)
• Epidemiology (AREA)
• General Health & Medical Sciences (AREA)
• Medical Informatics (AREA)
• Primary Health Care (AREA)
• Public Health (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Radiology & Medical Imaging (AREA)
• Measuring And Recording Apparatus For Diagnosis (AREA)
• Medical Treatment And Welfare Office Work (AREA)

Applications Claiming Priority (5)

Publications (2)

Family

ID=51021964

Family Applications (1)

Country Status (4)

Families Citing this family (7)

Family Cites Families (19)

• 2013
  • 2013-12-19 JP JP2015550491A patent/JP6552966B2/ja active Active
  • 2013-12-19 EP EP13867779.4A patent/EP2939202A4/de not_active Ceased
  • 2013-12-19 WO PCT/US2013/076349 patent/WO2014105592A1/en active Application Filing
  • 2013-12-19 CA CA2896519A patent/CA2896519A1/en not_active Abandoned
• 2018
  • 2018-05-17 JP JP2018095015A patent/JP6692855B2/ja active Active
• 2020
  • 2020-04-15 JP JP2020072633A patent/JP7171645B2/ja active Active

Also Published As

Similar Documents

Legal Events