Classifications

• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
  • G16H40/20—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
  • A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
  • A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
  • A61B6/03—Computed tomography [CT]
  • A61B6/032—Transmission computed tomography [CT]
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
  • A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
  • A61B6/03—Computed tomography [CT]
  • A61B6/037—Emission tomography
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
  • A61B6/54—Control of apparatus or devices for radiation diagnosis
  • A61B6/545—Control of apparatus or devices for radiation diagnosis involving automatic set-up of acquisition parameters
• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H30/00—ICT specially adapted for the handling or processing of medical images
  • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
  • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
  • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
  • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
  • G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
  • A61B6/54—Control of apparatus or devices for radiation diagnosis
  • A61B6/548—Remote control of the apparatus or devices
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
  • A61B6/56—Details of data transmission or power supply, e.g. use of slip rings
  • A61B6/563—Details of data transmission or power supply, e.g. use of slip rings involving image data transmission via a network
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
  • A61B6/58—Testing, adjusting or calibrating thereof
  • A61B6/586—Detection of faults or malfunction of the device

Definitions

• the present invention relates to autonomous imaging.
• the present invention relates to a rule engine apparatus and a method for evaluating an autonomous scan procedure for controlling an autonomous imaging apparatus to acquire an image of a patient, an autonomous imaging system, a computer program product, and a computer readable medium.
• a rule engine apparatus for evaluating an autonomous scan procedure for controlling an autonomous imaging apparatus to acquire an image of a patient.
• the rule engine apparatus comprises an input unit, a master rule engine unit, a plurality of workflow step rule engine units, each workflow step rule engine unit being associated with a respective set of rules, and an output unit.
• the input unit is configured to receive a data input indicative of an event in an autonomous image acquisition workflow.
• the master rule engine unit is configured to select, for the data input, one or more workflow step rule engine units from the plurality of workflow step rule engine units to determine a set of readiness indices, wherein each of the one or more selected workflow step rule engine units is configured to execute, in response to the data input, one or more rules of the respective rule set to generate a respective readiness index indicative of a state of being prepared for a particular step in the autonomous image acquisition workflow.
• the master rule engine unit is further configured to determine an action of the autonomous imaging apparatus based on the set of readiness indices.
• the output unit is configured to output the determined action, which is usable for controlling the autonomous imaging apparatus.
• the inventors of the present invention have found out that in an autonomous imaging system, a defined methodology should be in place to start, stop, or abort the imaging procedure. Criteria such as suitability of patient for autonomous scan, subsequent preparations, prevention of injury, and subjective human intervention are even more rigorously need to avoid any untoward situations. The inventors of the present invention have also found out that a well-defined procedure may be required in autonomous imaging system to put in place to cover any foreseen eventuality and some unforeseen ones.
• a rule engine apparatus for evaluating an autonomous scan procedure for controlling an autonomous imaging apparatus to acquire an image of a patient.
• the proposed rule engine apparatus is implemented as “systems of self-contained systems” with each self- contained system can have its own “workflow step rule engine unit” and a master rule engine unit whose output may be states indicative of an action to be performed by the autonomous imaging apparatus, such as“ start”, “stop”, and “abort”.
• the proposed rule engine apparatus the ability to process input data in autonomous medical workflow settings and to decide on specific workflow steps readiness as well as readiness at the autonomous scan level.
• Each self-contained system collects data from various data sources.
• the data can be sourced from relevant sensors such as spirometer, camera based detection mechanism, Augmented Reality (AR), Virtual Reality (VR), physiological data sensor (e.g. Spo2 sensor, plethysmography sensor, etc.), clinical data (lung capacity, earlier incident of any lung/heart disease, etc.), patient profile (athletic/swimmer), etc.
• the data may be sourced from data (e.g. image data) collected from the environment in the imaging room.
• the data may be sourced from machine setting data (e.g. scan protocol). These data sources may be processed by different processing steps and finally fed as a data input for one or more rules.
• Each workflow step rule engine for real-time data processing is a kind of decision engine that evaluates the data input according to a set of defined rule and determines an a readiness index.
• the readiness index may be a probability number between 0 and 1 or may be discrete states, such as “low”, “medium”, and “high”. Since each of the rule system, rules, processing steps are self-contained, the readiness index may be tailored based on e.g. risk factors, impact, and the like in the master rule engine unit.
• the evaluation step of each self-contained system is a readiness index.
• the master rule engine takes these readiness indices evaluates the autonomous image acquisition workflow and outputs an action to be performed by the autonomous imaging apparatus, such as start, abort, stop the imaging procedure, or human intervention.
• the proposed rule engine apparatus may also help drive clinical and operational efficiency across all phases of the image acquisition, from patient preparation to image quality assessment.
• the proposed rule engine apparatus may help reduce variability and staff workload, increase productivity, and increase patient throughput. Further, criteria, such as suitability of patient for autonomous scan, subsequent preparations, prevention of injury, subjective human intervention, and the like are reflected in the readiness indices, which are fed as an input to the master rule engine unit to make a decision. Therefore, untoward situations may be avoided.
• each rule corresponds to a specific workflow step in the autonomous image acquisition workflow, and workflow steps between different rules are different.
• the master rule engine unit is configured to associate the data input to at least one of the one or more selected workflow step rule engine units with a sub-step of the specific workflow step.
• the patient preparation workflow step may comprise different multiple processing steps including, but not limited to, breath holding, following instructions, anxiety level, etc.
• Each processing step may also be referred to as a sub-step of the corresponding workflow step.
• the data input comprises an output from a pre-trained machine-learning algorithm.
• some data inputs may be pre-processed by a pre-trained machine-learning algorithm to determine the probability of whether an event is likely to happen.
• the predictions from the machine-learning algorithm are then an input into the rules.
• the rules then evaluate the output of the machine-learning model and provide an output value.
• the machine-learning algorithm may be a neural network, a support vector machine, a decision tree, or the like.
• workflow details from previous imaging examinations may be used.
• the machine-learning algorithm may optimize some kind of process, which cannot be fully enumerated with a deterministic set of rules.
• the plurality of workflow step rule engine units are configured to use an active learning mechanism to update respective rule sets.
• the data input may be used to evaluate e.g. suitability of patient for an autonomous scan, subsequent preparations, prevention of injury, subjective human interventions, etc.
• data collected from the patient may include e.g. sensor data, clinical data, and patient profde data.
• data collected from a device used in the autonomous scan procedure may include data indicative of status and/or functionality of a device, such as electrical coil, sensors, and the like.
• data collected from the autonomous imaging apparatus may include data indicative of scan protocol, working status of the imaging apparatus, and the like.
• data collected from the imaging room may include image data of the imaging room, which may be used to detect whether a foreign object closed to the imaging system may interfere the imaging procedure.
• the data collected from the patient comprises one or more of: sensor data collected from sensors for monitoring the patient, clinical data of the patient, and patient profde data.
• the determined action comprises at least one of: starting image acquisition, aborting image acquisition, and stopping image acquisition.
• the master rule engine unit for determining the action of starting image acquisition, is configured to select, for the data input, one or more workflow step rule engine units from the plurality of workflow step rule engine units to determine a set of readiness indices about a device indicative a state of the autonomous imaging apparatus being prepared for starting image acquisition and a set of readiness indices about the patient indicative a state of the patient being prepared for starting image acquisition.
• the master rule engine unit for determining the action of aborting image acquisition, is configured to select, for the data input, one or more workflow step rule engine units from the plurality of workflow step rule engine units to determine a set of readiness indices about a device indicative a state of the autonomous imaging apparatus not being suitable for continuing image acquisition and/or a set of readiness indices about the patient indicative a state of the patient not being suitable for continuing image acquisition.
• the master rule engine unit is configured to select, for the data input, one or more workflow step rule engine units from the plurality of workflow step rule engine units to determine a set of readiness indices indicative of one or more of the following: planned end, scan protocol completed, image quality assessment, coverage of organ of interest, and stable internet access by remote operator.
• an autonomous imaging system comprising an autonomous imaging apparatus and a rule engine apparatus according to the first aspect and any associated example.
• the autonomous imaging apparatus is configured to acquire an image of a patient based on a determined action provided by the rule engine apparatus.
• Examples of the autonomous imaging apparatus may include, but are not limited to, x-ray imaging apparatus, magnetic resonance imaging apparatus, computerized tomography scanner, positron emission tomography scanner, and the like.
• a method for evaluating an autonomous scan procedure for controlling an autonomous imaging apparatus to acquire an image of a patient comprising: a) receiving, by an input unit, a data input indicative of an event in an autonomous image acquisition workflow; b) selecting, by a master engine unit, for the data input, one or more workflow step rule engine units from a plurality of workflow step rule engine units to determine a set of readiness indices, wherein each workflow step rule engine unit is associated with a respective set of rules; and wherein each of the one or more selected workflow step rule engine units is configured to execute, in response to the data input, one or more rules of the respective rule set to generate a respective readiness index indicative of a state of being prepared for a particular step in the autonomous image acquisition workflow; c) determining, by the master engine unit, an action of the autonomous imaging apparatus based on the set of readiness indices; and d) outputting, by an output unit, the determined action, which is usable for controlling the autonomous imaging apparatus.
• a computer program product comprising instructions which, when executed by at least one processing unit, cause the at least one processing unit to perform the steps of the method according to the third aspect and any associated example.
• a computer readable medium having stored the program product.
• Fig. 1 shows an exemplary rule engine apparatus 10 for evaluating an autonomous scan procedure for controlling an autonomous imaging apparatus to acquire an image of a patient.
• Fig. 2 shows a schematic block diagram illustrating an overall rule engine flow.
• Fig. 3 shows a schematic block diagram illustrating an exemplary overall workflow.
• Fig. 4 shows an exemplary active learning mechanism.
• Fig. 5 shows an exemplary autonomous imaging system.
• Fig. 6 shows a flow chart of a method for evaluating an autonomous scan procedure for controlling an autonomous imaging apparatus to acquire an image of a patient.
• Fig. 1 shows an exemplary rule engine apparatus 10 for evaluating an autonomous scan procedure for controlling an autonomous imaging apparatus to acquire an image of a patient.
• the rule engine apparatus 10 may be any computing device, including desktop and laptop computers, smartphones, tablets, etc.
• the rule engine apparatus 10 may be a general-purpose device or a device with a dedicated unit of equipment suitable for providing the below-described functionality.
• the components of the rule engine apparatus 10 are shown as integrated in one single unit.
• some or all components may be arranged as separate modules in a distributed architecture and connected in a suitable communication network, such as a 3rd Generation Partnership Project (3GPP) network, a Fong Term Evolution (FTE) network, Internet, FAN (Focal Area Network), Wireless FAN (Focal Area Network), WAN (Wide Area Network), and the like.
• the rule engine apparatus 10 and its components may be arranged as dedicated FPGAs or as hardwired standalone chips. In some examples, the rule engine apparatus 10 or some of its components may be resident in a console running as software routines.
• the rule engine apparatus 10 comprises an input unit 12, a master rule engine unit 14, a plurality of workflow step rule engine units 16, and an output unit 18.
• the plurality of workflow step rule engine units 16 comprises workflow step rule engine units 16A to 16N.
• Each unit may be part of, or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logical circuit, and/or other suitable components that provide the described functionality.
• ASIC Application Specific Integrated Circuit
• the input unit 12 is configured to receive a data input indicative of an event in an autonomous image acquisition workflow.
• the input unit 12 is, in an example, implemented as an Ethernet interface, a USB (TM) interface, a wireless interface such as a WiFi (TM) or Bluetooth (TM) or any comparable data transfer interface enabling data transfer between input peripherals and the processing unit 14.
• the event may be any event that may have an influence on the autonomous imaging procedure, which may cause the imaging process to start, abort, or stop.
• Examples of the events may include events that have an influence on e.g. suitability of patient for autonomous scan, subsequent preparations, prevention of injury, subjective human intervention, etc.
• vital signs e.g. oxygen saturation, heart rate, and systolic, and diastolic blood pressure
• vital signs may be used to assess the patient’s anxiety and the suitability of the patient for the autonomous scan. If it is determined that the patient has a high anxiety and high fear index, the autonomous imaging procedure may be aborted or stopped. In this example, the event is that the patient has a lot of anxiety, which has an influence on the autonomous imaging procedure.
• a video signal from a video camera or a depth camera monitoring the face expression or the skin of the patient may be used to assess a pain level experienced by the patient. If the patient is experiencing a high level of pain, the autonomous imaging procedure may be aborted in order to prevent or reduce the severity of bodily injuries. In this example, the event is that the patient suffers a lot of pain, which has an influence on the autonomous imaging procedure.
• the data input may comprise data collected from the patient.
• the data collected from the patient may comprise sensor data collected from one or more sensors configured to measure the patient’s reaction prior to and during an autonomous imaging procedure.
• the sensors may be used to measure e.g. patient motion, patient pain, nervousness, etc.
• the sensor data may be collected from one or more physiological data sensors, which record waveforms and provide periodic measurements of vital signs such as heart rate (HR), respiratory rate (RR), peripheral arterial oxygen saturation (Sp02), arterial blood pressure (ABP), and temperature (T).
• the sensor data may be collected from a camera-based detection mechanism, which may be used to detect the movement of the patient.
• the sensor data may be collected from three-dimensional radar sensors, which are used to monitor movement patterns of patients, persons, and devices.
• Radar array sensors have the advantage of creating three-dimensional point-cloud images suitable for recognition of body posture and motion, but do not allow face recognition. Radar array sensors also have the advantage of working in all lighting conditions and of not being distracted by clothing or other non-conductive objects. For example, radar arrays can detect arm or leg prostheses even when covered by clothes. Radar array sensors should ideally be set up in a way that they can monitor the patient and imaging room without requiring additional action.
• the data collected from the patient may further comprise clinical data of the patient, such as lung capacity, earlier incident of any lung or heat disease, and the like.
• the patient profile (such as athletic or swimmer) may also be included in the data input.
• the clinical data and the patient profile may be received from a hospital database.
• the data input may comprise data collected from devices and systems.
• the data input may comprise machine -setting data of an autonomous imaging apparatus.
• the machine setting data may include the scan protocol, the working state of a medical equipment, etc.
• the data input may comprise data collected from the imaging room.
• the data input may comprise data collected from a user input, which allows subjective human intervention e.g. in case of medical emergency.
• the data input may comprise an output from a pre-trained machine- learning algorithm.
• some data inputs may be pre-processed by a pre-trained machine- learning algorithm to determine the probability of whether an event is likely to happen.
• the predictions from the machine-learning algorithm are then an input into the rules.
• the rules then evaluate the output of the machine-learning model and provide an output value.
• the machine-learning algorithm may optimize some kind of process, which cannot be fully enumerated with a deterministic set of rules. For example, one machine-learning algorithm may be used to correlate face expression in the image data with an anxiety level.
• the image data is firstly pre-processed by a machine-learning algorithm and the output of the machine-learning algorithm, i.e. the determined anxiety level, is provided for the one or more rules.
• the machine-learning algorithm may be a neural network, a support vector machine, a decision tree, or the like.
• workflow details from previous imaging examinations may be used.
• Fig. 2 shows a schematic block diagram illustrating an overall rule engine flow.
• each self-contained system comprises a workflow step rule engine unit 16 and a self- contained system of rules 20.
• Each self-contained system works on defined rules for a specific segment of an autonomous image acquisition workflow.
• each workflow step rule engine 16 for real time data processing is a kind of decision engine that evaluates the data input according to a set of defined rule and determines an output value.
• the workflow step rule engine 16A receives the data input from one or more data sources 24, such as data sources A and B shown in Fig. 2.
• the data input may comprise data collected from the patient, devices, system, the imaging room, and/or the user input as discussed above.
• the master rule engine unit 14 is configured to select, for the data input, one or more workflow step rule engine units 16 from the plurality of workflow step rule engine units 16, such as units 16A-16N shown in Fig. 2, to determine a set of readiness indices.
• one or more rules 20 may involve multiple processing steps.
• the patient preparation workflow step may comprise different multiple processing steps including, but not limited to, breath holding, following instructions, anxiety level, etc.
• Each processing step may also be referred to as a sub-step of the corresponding workflow step.
• each workflow step rule engine unit 16 may evaluate data from various sources and provide a readiness index. As discussed above, some rules may involve multiple processing steps. For example, rule 20A comprises processing steps 22A and 22B. For example, in the above-mentioned patient preparation workflow steps, one of the readiness indices may be “patient readiness index”, which is focused on whether the patient is ready for the scan in autonomous settings. This index may have different readiness indices and corresponding rules engine setup. Exemplary readiness indices may include, but are not limited to,
• Some readiness indices may be a probability number between 0 and 1. Some readiness indices may be discrete states, such as “low”, “medium”, and “high”.
• the master rule engine unit 14 takes all these readiness indices to evaluate the autonomous image acquisition workflow and output an action to be performed by the autonomous imaging apparatus via the output unit 18 as mentioned above.
• the determined action is usable for controlling the autonomous imaging apparatus.
• the output unit 18 is, in an example, implemented as an Ethernet interface, a USB (TM) interface, a wireless interface such as a WiFi (TM) or Bluetooth (TM) or any comparable data transfer interface enabling data transfer between output peripherals and the processing unit 14.
• Fig. 3 shows a schematic block diagram illustrating an exemplary overall workflow 50.
• the exemplary autonomous image acquisition workflow is broadly classified into six specified workflow steps: readiness checklist, scan start prompt, abort event lookout, scan end prompt, image assessment, and end.
• one or more workflow step rule engine units may be provided to evaluate data from one or multiple data sources and to provide one or more readiness indices, such as a patient readiness index indicative of the readiness of the patient for the scan in autonomous settings and a device readiness index indicative of the readiness of the system for the scan in autonomous settings.
• the data input may comprise data collected from the patient.
• the data may comprise sensor data obtained from one or more sensors that measure the patient’s reaction.
• the sensor data may comprise image data obtained from monitoring the patient movement before the scan procedure and vital signs obtained from monitoring the patient’s anxiety level before the scan procedure.
• the data input may further comprise data indicative of whether the contrast material has been injected.
• the data input may further comprise data indicative if whether the anesthesia or sedatives have been given to the patient.
• the data input may comprise identification of the patient, data indicative of whether there is any metal objects in the body, and pre-existing conditions like pregnancy, allergy, medication, and the like, which may be collected from a hospital database. These data inputs may be used to determine whether the patient is ready for starting the scan.
• multiple workflow step rule engine units 16 may be used to provide different readiness indices, such as “anxiety index”, “sedation index”, “contrast material index”, “metal object risk index”, and “patient condition risk index”.
• the data input may comprise data collected from devices and systems.
• the data input may comprise data indicative of scan protocol selection, data indicative of coil selection, data indicative of working status of a medical equipment, data indicative of disinfection of device performed, data indicative of stress-test of remote VPN connection to remote operator, data indicative of status and positioning of a camera system, data indicative of balance in patient support, and data indicative of cardiac gating probe placement. These data inputs may be used to determine whether devices and systems are well prepared for starting the scan.
• multiple workflow step rule engine units 16 may be used to provide different readiness indices, such as “coil readiness index”, “scan protocol readiness index”, “medical equipment readiness index”, “camera system readiness index”, “VPN connection readiness index”, “patient support readiness index”, and “cardiac gating probe placement readiness index”.
• the data input may comprise user input data, such as patient confirmation, obtained via a user interface.
• user interfaces that may be employed in various implementations of the present disclosure include, but are not limited to, switches, potentiometers, buttons, dials, sliders, track balls, display screens, various types of graphical user interfaces (GUIs), touch screens, microphones, cameras and other types of sensors that may receive some form of human generated stimulus and generate a signal in response thereto.
• GUIs graphical user interfaces
• the data input may comprise data collected from one or more sensors that monitor the environment in the scanner room.
• the sensor data may comprise video signals from a video camera that monitors e.g. devices present in the scanner room, which may generate noise or image artifacts and whether the door of the scanner room is closed.
• These data inputs allow the system to determine whether the environment in the scanner room is suitable for the start condition.
• multiple workflow step rule engine units may be used to provide different readiness indices, such as “object risk index” and “scanner room readiness index”.
• multiple workflow step rule engine units may be used to provide different readiness indices, such as “pain index”, “anxiety index”, “sedation index”, and “medical emergency index”.
• a threshold level may be set to determine if it is necessary to abort the scan procedure.
• the data input may comprise user input data obtained via a user interface, e.g. via an integrated emergency button integrated with an MRI scanner or a command received from a remote operator to abort the scan procedure.
• the user input data thus allows subjective human intervention.
• the patient may press the integrated emergency button in case of pain and anxiety.
• multiple workflow step rule engine units 16 may be used to provide different readiness indices, such as “patient intervention index” and “operator intervention index”.
• the data input may comprise data collected from various devices and systems.
• the data input may comprise data indicative of electrical coil status, position of sensors, position of a mattress in the imaging system, and/or the status of internet connection to remote client.
• the data input thus allows the system to determine whether the status and functionality of e.g. imaging devices, systems, and internet connect are good enough to continue the autonomous imaging procedure.
• multiple workflow step rule engine units may be used to provide different readiness indices, such as “electrical coil status index”, “sensor position index”, “mattress position index”, and “internet connection index”.
• the above -described exemplary readiness indices are then provided to the master rule engine unit 14 to determine whether to abort the imaging procedure.
• one or more workflow step rule engine units associated with the workflow step “Image Assessment” evaluate image data and determine, based on these data inputs, whether it is necessary to perform another scan (step 60).
• the autonomous imaging procedure ends
• the process of performing a scan is very dynamic and it may be difficult to determine all conditions on which a system should abort and restart.
• the system and condition under which an event happened may be learned during every scan of the device starting from patient preparing to scan complete.
• An active learning mechanism may be put in place, which captures each state of the machine and corresponding conditions of the machine during each event.
• each state of the machine may be tagged with the event. Any new state in which an abort action occurred may be a new rule for the system of systems.
• Fig. 5 shows an exemplary autonomous imaging system 100, which comprises an autonomous imaging apparatus 90 and a rule engine apparatus 10 as described above.
• the autonomous imaging apparatus 90 is configured to acquire an image of a patient based on a determined action provided by the rule engine apparatus 10.
• Examples of the autonomous imaging apparatus 90 may include, but are not limited to, x- ray imaging apparatus, magnetic resonance imaging apparatus, computerized tomography scanner, positron emission tomography scanner, and the like.
• Fig. 6 shows a flow chart of a method 200 for evaluating an autonomous scan procedure for controlling an autonomous imaging apparatus to acquire an image of a patient.
• the method may be carried out by the exemplary apparatus shown in Fig. 1.
• step 210 i.e. step a
• a data input indicative of an event in an autonomous image acquisition workflow is received e.g. via an input unit of the exemplary apparatus 10.
• the data input may comprise data collected from the patient, data collected from a device and the autonomous imaging apparatus, data collected from an imaging room, and/or data collected from a user input. These data input may be used to evaluate the suitability of patient for autonomous scan, subsequent preparations, prevention of injury, subjective human intervention, etc.
• a master engine unit selects, for the data input, one or more workflow step rule engine units from a plurality of workflow step rule engine units to determine a set of readiness indices.
• Each workflow step rule engine unit is associated with a respective set of rules.
• Each of the one or more selected workflow step rule engine units is configured to execute, in response to the data input, one or more rules of the respective rule set to generate a respective readiness index indicative of a state of being prepared for a particular step in the autonomous image acquisition workflow.
• the master rule engine may select one or more workflow step rule engine units that are associated with patient preparation to determine a set of readiness indices.
• each rule may correspond to a specific workflow step in the autonomous image acquisition workflow, and workflow steps between different rules may be different.
• the master rule engine unit is configured to associate the data input to at least one of the one or more selected workflow step rule engine units with a sub-step of the specific workflow step.
• multiple workflow step rule engine units may be used to provide different readiness indices, such as “anxiety index”, “sedation index”, “contrast material index”, “metal object risk index”, and “patient condition risk index”. These workflow steps may also be referred to as sub-steps of the patient preparation workflow step.
• step 230 i.e. step c
• the master engine unit determines an action of the autonomous imaging apparatus based on the set of readiness indices.
• the determined action may comprise one or more of starting image acquisition, aborting image acquisition, and stopping image acquisition.
• the master rule engine unit is configured to select, for the data input, one or more workflow step rule engine units from the plurality of workflow step rule engine units to determine a set of readiness indices about a device indicative a state of the autonomous imaging apparatus being prepared for starting image acquisition and a set of readiness indices about the patient indicative a state of the patient being prepared for starting image acquisition.
• the master rule engine unit is configured to select, for the data input, one or more workflow step rule engine units from the plurality of workflow step rule engine units to determine a set of readiness indices about a device indicative a state of the autonomous imaging apparatus not being suitable for continuing image acquisition and/or a set of readiness indices about the patient indicative a state of the patient not being suitable for continuing image acquisition.
• the master rule engine unit is configured to select, for the data input, one or more workflow step rule engine units from the plurality of workflow step rule engine units to determine a set of readiness indices indicative of one or more of the following: planned end, scan protocol completed, image quality assessment, coverage of organ of interest, and stable internet access by remote operator.
• step 240 i.e. step d
• an output unit of the exemplary apparatus 10 outputs the determined action, which is usable for controlling the autonomous imaging apparatus.
• the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements.
• This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified.
• a computer program or a computer program element is provided that is characterized by being adapted to execute the method steps of the method according to one of the preceding embodiments, on an appropriate system.
• the computer program element might therefore be stored on a computer unit, which might also be part of an embodiment of the present invention.
• This computing unit may be adapted to perform or induce a performing of the steps of the method described above. Moreover, it may be adapted to operate the components of the above described apparatus.
• the computing unit can be adapted to operate automatically and/or to execute the orders of a user.
• a computer program may be loaded into a working memory of a data processor.
• the data processor may thus be equipped to carry out the method of the invention.
• This exemplary embodiment of the invention covers both, a computer program that right from the beginning uses the invention and a computer program that by means of an up-date turns an existing program into a program that uses the invention. Further on, the computer program element might be able to provide all necessary steps to fulfil the procedure of an exemplary embodiment of the method as described above.
• a computer readable medium such as a CD-ROM
• the computer readable medium has a computer program element stored on it which computer program element is described by the preceding section.
• a computer program may be stored and/or distributed on a suitable medium, such as an optical storage medium or a solid state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless telecommunication systems.
• a suitable medium such as an optical storage medium or a solid state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless telecommunication systems.
• the computer program may also be presented over a network like the World Wide Web and can be downloaded into the working memory of a data processor from such a network.
• a medium for making a computer program element available for downloading is provided, which computer program element is arranged to perform a method according to one of the previously described embodiments of the invention.
• inventive embodiments are presented by way of example only and that, within the scope of the appended claims and equivalents thereto, inventive embodiments may be practiced otherwise than as specifically described and claimed.
• inventive embodiments of the present disclosure are directed to each individual feature, system, article, material, kit, and/or method described herein.

Landscapes

• Health & Medical Sciences (AREA)
• Engineering & Computer Science (AREA)
• Medical Informatics (AREA)
• Life Sciences & Earth Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Public Health (AREA)
• Biomedical Technology (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Radiology & Medical Imaging (AREA)
• Epidemiology (AREA)
• Primary Health Care (AREA)
• Physics & Mathematics (AREA)
• High Energy & Nuclear Physics (AREA)
• Animal Behavior & Ethology (AREA)
• Pathology (AREA)
• Biophysics (AREA)
• Heart & Thoracic Surgery (AREA)
• Molecular Biology (AREA)
• Surgery (AREA)
• General Business, Economics & Management (AREA)
• Veterinary Medicine (AREA)
• Business, Economics & Management (AREA)
• Optics & Photonics (AREA)
• Theoretical Computer Science (AREA)
• Pulmonology (AREA)
• Measuring And Recording Apparatus For Diagnosis (AREA)
• Medical Treatment And Welfare Office Work (AREA)

Priority Applications (4)

Applications Claiming Priority (2)

Publications (1)

Family

ID=76283571

Family Applications (1)

Country Status (5)

Cited By (1)

Families Citing this family (1)

Citations (4)

Family Cites Families (13)

• 2021
  • 2021-06-04 EP EP21177678.6A patent/EP4099338A1/en not_active Withdrawn
• 2022
  • 2022-05-18 EP EP22727200.2A patent/EP4348670A1/en active Pending
  • 2022-05-18 US US18/566,122 patent/US20240257945A1/en active Pending
  • 2022-05-18 WO PCT/EP2022/063394 patent/WO2022253570A1/en not_active Ceased
  • 2022-05-18 CN CN202280040021.9A patent/CN117501380A/zh active Pending
  • 2022-05-18 JP JP2023574394A patent/JP2024522291A/ja active Pending

Patent Citations (4)

Non-Patent Citations (3)

Also Published As

Similar Documents

Legal Events