CN108366755B

CN108366755B - Scanning and tracking monitoring apparatus and method

Info

Publication number: CN108366755B
Application number: CN201680072294.6A
Authority: CN
Inventors: 奥利纳·文特·奥勒森; 克劳斯·本杰明森
Original assignee: Danmarks Tekniskie Universitet
Current assignee: Danmarks Tekniskie Universitet
Priority date: 2015-12-14
Filing date: 2016-12-14
Publication date: 2021-11-05
Anticipated expiration: 2036-12-14
Also published as: US20200146554A1; CA3041019C; CN108366755A; CA3041019A1; WO2017102860A1; EP3389488A1

Abstract

A scanning monitoring device for medical imaging is disclosed, the scanning monitoring device comprising a controller unit and a display, wherein the controller unit during a scanning session is configured to: obtaining tracking data (102) of a subject in a medical scanner; obtaining scanner data indicative of an operating parameter of a medical scanner (104); determining an output of the validation function based on the tracking data and the scanner data (106); and controlling the scanning monitoring device (108) in dependence on the output of the verification function. The notification signal may be provided in a case where a scan indicating an error is output.

Description

Scanning and tracking monitoring apparatus and method

Technical Field

The present disclosure relates to a scanning monitoring device and related methods, in particular to a scanning monitoring device for medical imaging such as Magnetic Resonance Imaging (MRI) and/or Positron Emission Tomography (PET) and/or Computed Tomography (CT) and/or Magnetoencephalography (MEG) and radiotherapy.

Background

Motion tracking methods for motion correction in medical imaging have been intensively studied during the last years, but there are no functional clinical tools for validated motion detection during biomedical scan acquisitions.

Motion during medical image acquisition may degrade the quality of the medical image. Poor quality medical images can lead to expensive rescanning and, at worst, to erroneous diagnosis and treatment. Optimally, the medical imaging data should be corrected for any motion; however, the known tracking methods are subject to reliability and thus reduce the usability in clinical practice. In addition, motion correction methods are commonly specified for medical scanners and image acquisition of the object being scanned.

Medical scanner-driven motion tracking methods developed for medical brain imaging typically suffer from the inability to obtain sufficiently high temporal and spatial resolution simultaneously. In addition, the high resolution of modern medical scanners, as low as a tenth of a millimeter for Magnetic Resonance Imaging (MRI) and as low as a few millimeters for Positron Emission Tomography (PET), sets strict requirements for motion tracking estimation. Most external tracking systems use markers attached to the subject's head. Marker-based systems introduce a key source of error in which the motion of the marker may not be indicative of the patient's motion. This problem becomes important because of the limited information available. There is no information to verify whether the tracking registered correctly the patient's motion or registered only the motion of the markers.

Label-free tracking methods based on 3D surface representations, for example using structured light, depth sensors and stereo vision systems, are very complex with a high risk of unpredictable errors.

Disclosure of Invention

There is a need for an apparatus and method that provides an improved clinical tool for motion management in medical/biological imaging based on tracking from 3D surface information.

A scanning monitoring device for medical imaging is disclosed, the scanning monitoring device comprising a controller unit and a display, wherein the controller unit, during and/or before a scanning session, is configured to: obtaining tracking data of a subject in a medical scanner, wherein obtaining the tracking data optionally comprises: determining one or more quality parameters indicative of a quality of tracking data and including the one or more quality parameters in the tracking data; obtaining scanner data indicative of one or more operating parameters of a medical scanner; determining an output of the validation function based on the tracking data and/or the scanner data; and controls the scanning monitoring device in accordance with the output of the authentication function.

Further, a method of operating a scanning monitoring device for medical imaging comprising a controller unit and a display is disclosed, wherein the method comprises during a scanning session: obtaining tracking data of a subject in a medical scanner, wherein obtaining the tracking data optionally comprises: determining one or more quality parameters indicative of a quality of the tracking data and including the one or more quality parameters in the tracking data; obtaining scanner data indicative of an operating parameter of a medical scanner; determining an output of a validation function based on the tracking data and the scanner data; and controls the scanning monitoring device in accordance with the output of the authentication function.

An important advantage of the present invention is that the number of scanning sessions can be reduced by improving the quality of the medical images. Errors or poor image quality can be immediately discovered during a scanning session, enabling the operator to repeat the scan in the same scanning session without image reconstruction and inspection. Manual image inspection and scanning times may be reduced. In addition, the person being scanned may avoid being recalled for a new scanning session at a later point in time that is highly desirable, both with respect to optimal use of scanning resources and a reduced risk of the person being scanned. Another advantage of the present invention is: motion tracking can be made clinically suitable for control of the scan, for example by allowing motion correction and quality control.

In addition, the present disclosure helps to improve patient safety because the risk of problematic or erroneous biometric image formation basis for diagnosis and treatment is greatly reduced. In addition, better diagnosis and treatment can be obtained.

The present disclosure proposes simultaneous or real-time tracking and monitoring of binding from a 3D surface scan. The validated tracking data plus scanner information may enable output of a validation function from the pilot image acquisition. Thus, the quality of the scanning session may be improved by enabling an operator of the medical scanner to monitor the scanning environment in a simple and convenient manner. Verified tracking information may also be given directly to the medical scanner. It is contemplated that the data may also be stored for post-scan correction.

Drawings

The above and other features and advantages will become apparent to those skilled in the art from the following detailed description of exemplary embodiments of the invention, which proceeds with reference to the accompanying drawings, in which:

figure 1 schematically illustrates an exemplary scanning monitoring device,

figure 2 schematically illustrates a display having an exemplary first representation and a second representation,

figure 3 schematically illustrates an exemplary method,

figure 4 schematically illustrates an example of obtaining tracking data,

FIG. 5 illustrates operation of an exemplary controller unit, an

Fig. 6 schematically illustrates a display having an exemplary first representation and a second representation.

Detailed Description

Various embodiments are described below with reference to the drawings. Like numbers refer to like elements throughout. Therefore, the same elements will not be described in detail with respect to the description of each drawing. It should also be noted that the drawings are only intended to facilitate the description of the embodiments. They are not intended as an exhaustive description of the invention as claimed or as a limitation on the scope of the invention as claimed. Moreover, the illustrated embodiments need not have all of the aspects or advantages shown. Aspects or advantages described in connection with a particular embodiment are not necessarily limited to that embodiment, and may be practiced in any other embodiment even if not so illustrated or otherwise explicitly described.

The same reference numerals are used throughout the description for the same or corresponding parts.

The scanning monitoring device combines the tracking data and the scanner data, effectively improving the scanning quality of the subject during the scanning session. The scanning monitoring device may thus be a scanning and tracking monitoring device. A scan session may be defined as a period of time from when a scanning subject is placed into the scanner to when the scanning subject is removed from the scanner. The subject is also referred to as a scanning subject.

The scanning monitoring device comprises a controller unit and a display. The display includes a display controller and a display face. The display may be a computer screen, for example an LED display such as an OLED display or a Liquid Crystal Display (LCD).

The controller unit is configured to obtain tracking data of the subject in the medical scanner during the scan session. The tracking data may include image control data, such as image settings, for one or more image projectors. The tracking data may include 3D representation data of the imaged region of the subject, e.g., from any sensor system capable of providing or configured to provide 3D surface representation data of the imaged region of the subject, including surface scanners, stereoscopic or multi-vision camera systems, depth sensors, time-of-flight cameras, and/or structured light imaging systems, and the like. The tracking data may include image data from one or more cameras or detectors. The tracking data may include, for example, scanner driven tracking data from an image navigator, a k-space navigator, and a center of mass. The tracking data may comprise one or more quality parameters indicative of the tracking quality. The quality parameter may be based on, for example, 3D representation data comprising a set of 3D points. The tracking data may include displacement data.

Obtaining the trace data may include: one or more quality parameters indicative of the quality of the tracking data are determined and included in the tracking data.

Obtaining the trace data may include: a weighting function and/or a filtering function is applied to the raw tracking data, e.g. the 3D surface representation data, based on the raw tracking data and/or the scanner data and/or the user input data. The raw tracking data on which the weighting function is based may comprise a 2D image, 3D representation data such as a 3D set of points, including e.g. previous representation data, current representation data from which e.g. distances of neighboring points and point normals may be extracted. The scanner data and/or user input data on which the weighting function is based may include a model of the region of interest (e.g., shielded off the MR coil) or the scanned subject. One or more quality parameters indicative of the quality of the tracking data may be based on the output of the weighting/filtering function.

Obtaining the trace data may include: displacement data indicative of a subject motion is determined and the displacement data, or at least a portion thereof, is included in the tracking data. Thus, the controller unit may be configured to determine the displacement data, e.g. based on one or more reference points or groups of reference points. The reference point may be derived from the scan subject data and/or obtained via a user interface. One or more quality parameters in the tracking data may be based on the displacement data.

The controller unit is configured to obtain scanner data indicative of an operating parameter of the medical scanner during and/or before the scanning session. The scanner data may be obtained via a scanner interface connected to the medical scanner and/or the user interface. The user interface may allow an operator to feed scanner data into the scanning monitoring device. The scanner data may be obtained from a scan subject database that includes one or more scan subject parameters. The scanner data may include a scan type identifier indicative of a scanner type (PET, MR, CT, MEG, or any combination) and/or a scanner model. Different types of medical scanners may have different requirements for the subject being scanned.

The controller unit may also be configured to obtain a scan subject parameter.

The controller unit may be configured to obtain user input data via the user interface. The user data may include a motion threshold such that, for example, a notification is provided when the motion threshold is reached.

The scanner data may include one or more operating parameters of the medical scanner, such as a first operating parameter and a second operating parameter.

The one or more operating parameters of the medical scanner may include a first operating parameter or a first set of operating parameters, wherein the first operating parameter may be indicative of a scan pattern. The scan mode may include specific settings and operating parameters of the scanner. By way of example, the first operating parameters that may be used for MRI include the strength of the magnet, the aperture size, the contrast agent, and the like. The scanning modalities that can be used for MRI are conventional MRI, diffusion tensor imaging, functional MRI (fmri), blood oxygen level dependent Diffusion Weighted Imaging (DWI), MRI spectroscopy, MR angiography, and the like. Scanning modalities that can be used for PET are imaging of stable tracers, dynamic tracers, different tracers such as Fluorodeoxyglucose (FDG), and different isotopes such as fluorine (18F) and carbon (11C, 13C, 14C). The scan pattern may indicate an MRI scan sequence, e.g., MPRAGE, EPI, FLAIR, STIR, T1 weighted, or T2 weighted.

The one or more operating parameters of the medical scanner may include a second operating parameter or a second set of operating parameters, wherein the second operating parameter may indicate a start of a scan acquisition.

The one or more operating parameters of the medical scanner may include a third operating parameter or a third set of operating parameters, wherein the third operating parameter may indicate an end of the scan acquisition.

The scanner data may include one or more scan subject parameters of a subject scanned in a scan session.

The one or more scanning subject parameters of the subject may include a first scanning subject parameter indicative of an age and/or weight of the scanning subject.

The one or more scanning subject parameters of the subject may include a second scanning subject parameter indicative of an examination to be performed on the scanning subject.

The one or more scanning subject parameters of the subject may include a third scanning subject parameter indicative of a disease of the scanning subject, e.g., a tumor/lesion, alzheimer's disease, neurological disease, etc.

The one or more scanning subject parameters of the subject may include a fourth scanning subject parameter indicative of a symptom of the scanning subject, such as pain, dementia, or tremor.

The one or more scanning subject parameters of the subject may include a fifth scanning subject parameter indicative of a level of consciousness of the scanning subject, e.g., sedation, wakefulness, sleep, etc.

The one or more scanning subject parameters of the subject may include a sixth scanning subject parameter indicative of one or more of a position, a shape, and a size of a scanning volume to be examined. For example, a sixth scanning subject parameter may be indicative of a portion of the brain to be examined when the tumor is located within a portion of the brain of the scanning subject, such as the left/right frontal lobe, the left/right parietal lobe, the left/right temporal lobe, the speech center, the occipital lobe, the hearing center, the cerebellum, the brainstem, or the brain, or a portion thereof.

The one or more scanning subject parameters of the subject may include a seventh scanning subject parameter indicative of an injection of a contrast agent and/or a PET tracer.

The one or more scan subject parameters of the subject may include an eighth scan subject parameter indicative of an injection dose and time.

The controller unit is configured to determine an output of the validation function based on the tracking data and the scanner data during and/or before the scanning session. The validation function may select and apply the validation function based on scanner data (e.g., one or more operating parameters of a medical scanner and/or one or more scan subject parameters). The authentication function may select the authentication function from a plurality of authentication functions. The validation function may apply the first validation function if the first operating parameter of the medical scanner indicates the first scanning mode. The validation function may apply the second validation function if the first operating parameter of the medical scanner indicates the second scanning mode. The verification function may calculate parameters based on the tracking data and/or scanner data. The validation function may determine whether the input data, input value, or calculated parameter satisfies a criterion, such as whether the input value is greater than a threshold, whether the input value is less than a threshold, or whether the input value is equal to a value.

For example, if a quality parameter of the one or more quality parameters indicative of the quality of the trace data does not meet a trace data quality criterion, the output of the validation function may be indicative of corrupted trace data. The validation function may validate the trace data, for example, by applying one or more trace data criteria to the trace data. For example, if a quality parameter of the one or more quality parameters indicative of the quality of the trace data meets a trace data quality criterion, the output of the validation function may indicate high quality trace data.

The output of the verification function may be based on tracking data, e.g. raw tracking data such as data comprising 2D and 3D surface representation data and/or displacement data. The output of the verification function may be based on the trace data, e.g. one or more quality parameters indicative of the quality of the trace data. The invention has the advantages that: an operator of the medical scanner can monitor the tracking data quality. In particular, the apparatus enables an operator to distinguish between tracking data indicative of erroneous scans due to subject motion or due to poor tracking quality or errors in the tracking data. Errors in the tracking data may include, for example, occlusion of the subject, presence of foreign objects, unwanted deformation, and/or interference from light.

The first validation function may include determining whether the trace data meets a first error criterion, e.g., whether the displacement is greater than a first threshold, and wherein the output of the validation function is set to a value indicative of an erroneous scan if the first error criterion is met.

The second validation function may include determining whether the trace data meets a second error criterion, e.g., whether the displacement is greater than a second threshold, and wherein the output of the validation function is set to a value indicative of an erroneous scan if the second error criterion is met.

The controller unit is configured to control the scanning monitoring device in accordance with the output of the authentication function, e.g. during and/or before a scanning session.

Controlling the scanning monitoring device according to the output of the verification function may include: a notification signal or signals is/are provided in case a scan indicating an error is output. This enables the operator of the medical scanner to optimize the scanning session immediately or at least during the scanning session, thereby reducing the number of additional scanning sessions. The controller unit may be configured to select the notification signal from a plurality of notification signals based on an output of the verification function. Different types of notification signals may be selected for different types of erroneous scans.

The scanning monitoring device may comprise a speaker. Providing the notification signal optionally includes: the audio signal is provided by means of a loudspeaker. An audio signal may be advantageous because the operator may have a higher chance of recording the audio signal than other types of notification signals.

The controller unit may be configured to select an audio signal from the plurality of audio signals based on the output of the verification function. Thus, the scanning monitoring device is able to notify different types of erroneous scans.

Providing the notification signal may include: the visual alarm signal is provided on the display, for example by sending a control signal from the controller unit to the display.

Controlling or controlling the scanning monitoring device in dependence of the output of the verification function may comprise: a notification scheme including a plurality of notification signals is determined based on an output of the verification function. Controlling or controlling the scanning monitoring device in dependence on the output of the verification function may comprise: the notification scheme is optionally provided in case the notification scheme comprises at least one notification signal.

Examples of notification signals are:

an audio signal presented to the operator, for example via a speaker of the scanning monitoring device.

One or more error indicators in the first representation and/or the second representation.

A control signal of the medical scanner instructing to stop scanning (e.g., in case it is detected that the scanning subject is crawling out of the scanner or a similar severe event).

For example, a control signal of the medical scanner indicating the resumption of the scan, in case the current scan session is known to be critical and the motion is very severe, or simply in case the just started and resumed scan can be completed with little time loss.

Control signals of the medical scanner indicating rescanning of the slice (redo partial scan).

The scan results are flagged as motion corrupted, e.g., if there is no time to redo the scan and there is no motion correction method present, the scan image may be flagged as at least being motion corrupted.

The marker scan results are corrected for retrospective or possible retrospective motion.

Marking the scan results without motion damage.

Thus, a notification may be provided to the operator at the time of the scan, and in addition, selected notifications may be provided to the subject, for example to indicate that motion should be reduced. The notification may also be stored with the resulting scan results to indicate at a later stage whether the data should be corrected retrospectively, e.g. retrospectively, for motion correction data, whether the data can be used without correction, e.g. without motion correction, etc.

The scanning monitoring device may provide feedback to the medical scanner. Thus, controlling the scanning monitoring device in dependence of the output of the verification function may comprise: the first control signal is determined based on the output of the verification function and/or transmitted to the medical scanner. The first control signal may indicate to stop scanning if the output indicates a first error.

In addition, controlling the scanning monitoring device according to the output of the authentication function may include: the second control signal is determined based on the output of the verification function and/or transmitted to the medical scanner. The second control signal may indicate that the scan restarts if the output indicates a second error. Restarting may include restarting the entire scanning session, restarting the last scan, redoing the last performed action, and so on.

The scanning monitoring device may provide an improved representation of the results of the scanning session to the operator during the scanning session. Controlling the scanning monitoring device according to the output of the verification function may include: the first representation is determined and/or provided based on the tracking data. The controller unit may be configured to determine and/or provide the first representation based on scanner data, e.g., one or more scan subject parameters and/or user input data. The controller unit may be configured to provide the first representation to the display. The controller unit may be configured to store the first representation in a memory. The first representation may comprise a graphical representation of the subject, e.g. a reference point or set of reference points relative to the subject and/or a displacement (translation and/or rotation) as a function of time. The graphical representation of the displacement may comprise a first graphical representation. The first graphical representation may be a total 3D displacement in distance units. The first graphical representation may be indicative of a translational motion of the subject, the first point or the set of first points in a fixed relationship with the subject, e.g. relative to a reference point or set of reference points of the subject and/or as a function of time. The first graphical representation may be indicative of a rotational movement of the subject, a first point or a set of first points in a fixed relationship with the subject, e.g. relative to a reference point or set of reference points optionally in a fixed relationship with the subject and/or as a function of time.

The graphical representation of the displacement may comprise a second graphical representation. The second graphical representation may be a first displacement along the first axis as a function of time. The second graphical representation may be indicative of a translational motion of the subject, of a second point or set of second points having a fixed relationship to the subject, e.g. relative to a reference point or set of reference points of the subject, and/or as a function of time. The second graphical representation may indicate a rotational movement of the subject, the first point having a fixed relationship with the subject, the second point having a fixed relationship with the subject, the first set of points having a fixed relationship with the subject or the second set of points having a fixed relationship with the subject, for example, relative to a reference point or set of reference points optionally having a fixed relationship with the subject and/or as a function of time. The first graphical representation may indicate any combination of translational and rotational motion of the subject, the first point having a fixed relationship with the subject, or the first set of points having a fixed relationship with the subject, e.g., relative to a reference point or set of reference points optionally having a fixed relationship with the subject, and/or as a function of time.

The graphical representation of the displacement may comprise a third graphical representation. The third graphical representation may be a second displacement along a second axis as a function of time. The third graphical representation may be indicative of translational movement of the subject, a third point having a fixed relationship with the subject, or a set of third points having a fixed relationship with the subject, e.g., relative to a reference point or set of reference points having a fixed relationship with the subject, and/or as a function of time. The third graphical representation may indicate a rotational movement of the subject, a third point having a fixed relationship with the subject or a set of third points having a fixed relationship with the subject, e.g. relative to a reference point or set of reference points optionally having a fixed relationship with the subject and/or as a function of time.

The graphical representation of the displacement may comprise a fourth graphical representation. The fourth graphical representation may be a third displacement along the third axis as a function of time. The fourth graphical representation may be indicative of a translational movement of the subject, a fourth point having a fixed relationship with the subject or a group of fourth points having a fixed relationship with the subject, e.g. relative to a reference point or group of reference points having a fixed relationship with the subject and/or as a function of time. The fourth graphical representation may indicate a rotational movement of the subject, a fourth point having a fixed relationship with the subject or a group of fourth points having a fixed relationship with the subject, for example relative to a reference point or group of reference points optionally having a fixed relationship with the subject and/or as a function of time.

The controller unit may be configured to determine the one or more indicators based on the output of the validation function and/or the scanner data. The one or more indicators may be based on the tracking data. The controller unit may be configured to include one or more indicators, or at least a portion thereof, in the first representation. The one or more indicators may include a first indicator or a first set of indicators that indicate a start of a scan acquisition. The one or more indicators may include a second indicator or a second set of indicators that indicates an end of a scan acquisition. The one or more indicators may include an error indicator or a set of error indicators that indicate erroneous scans. The one or more indicators may include a third indicator or a third set of indicators that indicate a scan pattern. The one or more indicators may comprise a fourth indicator or a fourth set of indicators indicative of one or more thresholds applied in the verification function. The one or more indicators may include one or more stop indicators indicating a stop of the scan acquisition. The one or more indicators may include a resume indicator indicating a scan acquisition being resumed. The one or more indicators may include a pause indicator indicating a scan acquisition being paused.

The one or more indicators may indicate at which time the respective event occurred. The different indicators may have the same or different sizes. The different indicators may have the same or different shapes. The different indicators may have the same or different colors. The first indicator may have a first color and a first shape. The second indicator may have a second color and a second shape. The second color may be different from the first color. The third indicator may have a third color and a third shape.

Controlling the scanning monitoring device according to the output of the verification function may include: a second representation is determined and/or provided based on the tracking data. The controller unit may be configured to determine and/or provide the second representation based on scanner data, e.g. one or more scan subject parameters and/or user input data.

The controller unit may be configured to provide the second representation to the display and/or to store the second representation in the memory. The second representation may include a surface representation of a surface of the scanned subject. The second representation may include a reference surface representation of a surface of the scanning subject. The second representation may include one or more indicators including a first indicator indicative of a reference point or set of reference points of the subject for the first representation. The controller unit may be configured to determine the first indicator of the second representation based on the output of the verification function and/or the scanner data. The one or more indicators of the second representation may be based on the tracking data. The controller unit may be configured to include the one or more indicators, or at least a portion thereof, in the second representation. The second representation may be different from the first representation.

The first representation and/or the second representation may comprise a model of the scanning subject. A first indicator indicative of a reference point or set of reference points of the subject for the first representation may be superimposed on the model of the scanned subject.

The plurality of different representations enhance the operator's ability to monitor and alter or adapt the scanning session in order to obtain improved or optimal quality medical images obtained with the medical scanner.

The controller unit may be configured to update the first representation and/or the second representation with an update frequency of at least 1Hz, e.g. less than 50Hz, e.g. less than 20 Hz. The second representation may be provided in real-time or substantially real-time (e.g., with a delay of less than 1 minute, less than 10 seconds, less than 1 second, less than 50 milliseconds, less than 10 milliseconds).

For example, if a scan indicating an error is output, the second representation may include a notification signal. The notification signal of the second representation may comprise one or more error indicators. The notification signal of the second representation may comprise a blinking error indicator.

The scanning monitoring device may comprise any sensor system capable of providing or configured to provide 3D surface representation data of an imaging region of a subject.

The scan monitoring device may include an image projector configured to project one or more images onto an imaging region of a subject in a medical scanner. The tracking data may include image control data for the image projector. The image projector may be configured to project the structured light onto an imaging region of a subject in a medical scanner.

The scanning monitoring device may comprise a multi-vision or stereo vision camera configured to obtain 3D surface representation data of an imaged region of a subject in the medical scanner. The tracking data may comprise 3D surface representation data or at least a part thereof.

The scanning monitoring device may include an image detector configured to detect an image of a subject. The tracking data may include image data of the detected image.

The scanning monitoring device operates before and/or during a scanning session of a (scanning) subject or patient.

Fig. 1 shows an exemplary scanning monitoring device for medical imaging, for example for biomedical imaging. The scanning monitoring device 2 comprises a controller unit 4 and a display 6. Optionally, the scanning monitoring device comprises a tracking interface 7 and a user interface 8, such as a keyboard and/or a pointing device (mouse or pen). The display may be a touch display configured as a user interface. The scanning monitoring device may include a scanner interface 10 and a speaker 12. The controller unit 4 is configured during a scan session to obtain tracking data 14 of the subject in the medical scanner. The tracking data is indicative of subject motion of the subject. It is highly desirable to compensate or correct for subject motion during a scan session. The tracking data optionally includes a time series of sets of surface points of a subject region of the subject. The set of surface points is optionally generated by a depth sensor (or extracted from the image volume of a medical scanner), e.g. a structured light system, a stereo vision system, a time-of-flight sensor. The tracking data is acquired during a medical scan such as Magnetic Resonance Imaging (MRI), PET, CT, SPECT, MEG, or as a combined PET/CT and MRI/PET scan.

The controller unit 4 is configured to obtain scanner data 16 indicative of operational parameters of the medical scanner, e.g. via a scanner interface 10 connected to the medical scanner and/or via a user interface 8 allowing an operator of the medical scanner to input necessary scanner data. The scanner data includes a scan type identifier indicating a scanner type (PET, MRI, CET, or any combination). The controller unit 4 may be configured to obtain user input data 17 indicative of user input to allow an operator of the medical scanner to provide user input comprising, for example, configuration parameters such as color settings, viewpoint for the first representation and/or the second representation.

The scanner data 16 includes one or more operating parameters of the medical scanner. Exemplary operating parameters of a medical scanner are:

timing, e.g. scan acquisition on/off and/or start/stop

Scanning session protocols, e.g. MRI/PET brain tumor examination

Scan parameters that affect the spatial and temporal resolution of the resulting medical image. For example, the individual MR image acquisition may for example depend on the acquisition method: DWI, fMRI, structural MRI, etc. or scanner specifications including magnetic field strength aperture size, etc., and acquisition method settings: spin echo, relaxation settings, k-space readings, etc. to change in motion sensitivity.

Biomarkers and contrast agents

The scanner data 16 includes one or more scan subject parameters of the subject scanned in a scan session. Exemplary scan subject parameters are:

age

Sex

Body weight

Examination (presumed/suspected diseases)

Diseases, e.g. tumors/lesions, Alzheimer's disease, neurological diseases

Symptoms, e.g. pain, dementia, tremor

Level of consciousness, e.g. sedation, wakefulness, sleep.

The controller unit 4 is configured to determine the output of the verification function based on the tracking data and the scanner data. For example, if the displacement of the scanned subject, a reference point of the scanned subject, or a set of reference points representing the scanned subject or the scanned subject is greater than a threshold and thus meets an error criterion, the output is set to a value indicating an erroneous scan. The controller unit 4 is configured to control the scanning monitoring device in dependence of the output of the authentication function. For example, when outputting a scan indicating an error, the controller unit 4 is configured to determine and provide a notification signal in the form of an audio signal using the speaker 12. Further, the controller unit is configured to determine the first representation 18 based on the tracking data 14, the scanner data 16 and/or the user input data 17. Further, the controller unit is configured to determine a second representation 20 based on the tracking data 14, the scanner data 16 and/or the user input data 17 and to provide the

representations

18, 20 to the display 6.

Fig. 2 shows a display with an exemplary first representation 18 and second representation 20 provided by the controller unit 4 at time t 7. The first representation 18 includes a graphical representation 22 of the displacement of a reference point of the subject as a function of time. The controller unit 4 has determined based on the scanner data 16 and includes a first indicator 24 indicating the start of a scan acquisition at times t1, t3 and t 6. In addition, the controller unit 4 has determined based on the scanner data 16 and includes a second indicator 26 indicating the end of the scan acquisition at times t2 and t 5. The first indicator 24 is different from the second indicator 26. At time t4, the output of the validation function indicates an erroneous scan (the tracking data indicates that the displacement is greater than the threshold, while the scanner data indicates that the scan acquisition is on), and the controller unit determines and provides the error indicator 28 in the first representation. In addition, the controller unit provides the first notification signal in the second representation 20 via the loudspeaker 12 in the form of an audio signal at time t4 and the second notification signal in the form of a blinking error indicator at time t 4. The notification signal of the second representation may comprise a blinking error indicator. Although the displacement between t5 and t6 is large, no notification signal or error indicator is provided because the scanner data indicates that no scan acquisition occurred, which is also directly from the first indicator 24 and the second indicator 26.

The second representation 20 is based on the tracking data and the scanner data at time t 7. The second representation 20 is different from the first representation 18 and includes a surface representation 30 of a surface of the scanning subject. Additionally, the second representation may include a reference surface representation 32 of the surface of the scanned subject. Optionally, the second representation 20 includes a first indicator 34 indicating a reference point for the graphical representation 22 of the first representation 18. The controller unit determines the first indicator 34 of the second representation 20 based on the tracking data, the output of the verification function and/or the scanner data. Optionally, the second representation 20 comprises a second indicator 36 indicating the position of the reference point of the graphical representation 22 compared to the surface representation 30. The controller unit determines the second indicator 36 of the second representation 20 based on the tracking data, the output of the verification function and/or the scanner data.

Fig. 3 is a flow chart of an exemplary method of operating a scanning monitoring device for bio/medical imaging, the scanning monitoring device comprising a controller unit and a display. The method 100 includes starting 101 a scanning session. After starting the scanning session, the method 100 includes, during the scanning session: obtaining 102 tracking data of a subject in a medical scanner; obtaining 104 scanner data indicative of an operating parameter of the medical scanner; determining 106 an output of the validation function based on the tracking data and the scanner data; and controls 108 the scanning of the monitoring device in dependence on the output of the authentication function. If the scan is to continue 110, the method returns to obtaining 102 trace data. Obtaining 102 tracking data and obtaining 104 scanner data may be performed in parallel and/or sequentially.

Obtaining 102 trace data may include: a 3D surface representation of a subject region generated by a 3D/depth sensor, such as a structured light system, a stereo vision system, a time-of-flight sensor (or extracted from an image volume of a medical scanner) is obtained. The region of interest of the subject is in particular the face and/or the surface of a body part from which the medical scanner acquires data.

Tracking data in, for example, medical imaging; obtained during a scan session of Magnetic Resonance Imaging (MRI), Positron Emission Tomography (PET), CT, SPECT or a combination scanner such as PET/CT and MRI/PET.

Fig. 4 schematically shows an example of obtaining tracking data in more detail. The raw tracking data 112(3D representation data, e.g. surface points) is obtained 113 and optionally weighted and/or filtered by a weighting function and/or filtering function 114. Optionally, the quality of the raw trace data (3D representation data such as surface points) is verified in a trace data verification 116, the trace data verification 116 outputting one or more quality parameters 120 indicative of the quality of the trace data as part of the trace data. The filtered/weighted raw tracking data 122 may be input to the tracking data validation 116. The displacement data function 124 determines displacement data 126 included in the tracking data. The displacement data function determines displacement data indicative of, for example, displacement of the scanned subject with respect to one or more reference points or groups of reference points.

The displacement data function may determine the displacement based on tracking data obtained at different points in time and related to a predetermined reference point, and thus, the displacement function may receive as input reference points, such as the predetermined reference point, tracking data related to the reference point at the reference point in time, and tracking data related to the reference point at the evaluation point in time. For example, the displacement may be given as the distance between a given point at time t1 and the same point at time t 2.

The inputs to the weighting/filtering function 114 may include one or more of a 2D image, a 3D set of points, or 3D representation data (e.g., a current set of points, a previous set of points from which distances of neighboring points and point normals may be extracted), a predefined region of interest (e.g., shielded from the MR coil), a model of the scanned object. The weighting/filtering function 114 may be based on the scanner data 16, e.g., one or more operating parameters of the medical scanner such as a first operating parameter or a first set of operating parameters, a second operating parameter or a second set of operating parameters, and/or a third operating parameter or a third set of operating parameters; wherein the first operating parameter may be indicative of a scan mode, wherein the second operating parameter may be indicative of a start of a scan acquisition, wherein the third operating parameter may be indicative of an end of a scan acquisition. The weighting/filtering function 114 can be based on, for example, scanner data including one or more scan subject parameters of a subject scanned in a scan session.

The weighting/filtering function may include manual region of interest selection with binary weights. Semi-automated methods may be applicable to references that may be based only on distance neighbor clustering. Therefore, a verification step may be required to ensure that the estimated data represents the object of interest.

Fig. 5 illustrates operations 200 of an exemplary controller unit. The controller is configured to obtain 202 tracking data 14 comprising one or more of raw tracking data, displacement data and one or more quality parameters. The controller unit is configured to obtain 202 scanner data 16. In addition, the controller unit applies the authentication function 206 and controls the scanning monitoring device, for example by determining and optionally applying a notification scheme comprising one or more notification signals.

Fig. 6 schematically shows a display with an exemplary first representation and a second representation. The second representation 20 includes a model representation 38 of the scanned subject. The first indicator 34 indicates the current position of the reference point for the first representation and is superimposed on the model representation 38. The model representation 38 may be included in the first representation 18, wherein an indicator indicating a current position of the reference point for the first representation is superimposed on the model representation 38.

Also disclosed are a scanning monitoring device and a method of operating a scanning monitoring device according to the following items:

item 1. a scanning monitoring device for medical imaging, the scanning monitoring device comprising a controller unit and a display, wherein the controller unit during a scanning session is configured to:

-obtaining tracking data of a subject in a medical scanner;

-obtaining scanner data indicative of an operational parameter of the medical scanner;

-determining an output of a validation function based on the tracking data and the scanner data; and is

-controlling the scanning monitoring device in accordance with an output of the verification function.

Item 2. the scanning monitoring device of item 1, wherein controlling the scanning monitoring device according to the output of the verification function comprises: providing a notification signal if the output indicates an erroneous scan.

Item 3. the scanning monitoring device of item 2, wherein the scanning monitoring device includes a speaker, and wherein providing the notification signal includes: an audio signal is provided with the loudspeaker.

Item 4. the scanning monitoring device of item 3, wherein the controller unit is configured to select the audio signal from a plurality of audio signals based on an output of the verification function.

Item 5. the scanning monitoring device of any one of items 2 to 4, wherein providing the notification signal comprises: providing a visual alert signal on the display.

Item 6. the scanning monitoring device of any one of items 1 to 5, wherein controlling the scanning monitoring device according to the output of the verification function comprises: transmitting a first control signal to the medical scanner, wherein the first control signal indicates to stop scanning if the output indicates a first error.

Item 7. the scanning monitoring device of any one of items 1 to 6, wherein controlling the scanning monitoring device according to the output of the verification function comprises: transmitting a second control signal to the medical scanner, wherein the second control signal indicates a scan restart if the output indicates a second error.

Item 8. the scanning monitoring device of any one of items 1 to 7, wherein controlling the scanning monitoring device according to the output of the verification function comprises: a first representation is determined and provided based on the tracking data.

Item 9. the scanning monitoring device of any one of items 1 to 8, wherein controlling the scanning monitoring device according to the output of the verification function comprises: a second representation is determined and provided based on the tracking data.

Item 10. the scan monitoring device of any one of items 1 to 9, wherein the scan monitoring device comprises an image projector configured to project one or more images onto an imaging region of the subject in the medical scanner, and wherein the tracking data comprises image control data of the projector.

Item 11. the scan monitoring device of any one of items 1 to 9, wherein the scan monitoring device comprises any sensor system configured to provide 3D surface representation data of an imaging region of the subject in the medical scanner, and wherein the tracking data comprises the 3D surface representation data.

Item 12. the scanning monitoring device of any of items 1 to 10, wherein the scanning monitoring device comprises an image detector configured to detect an image of a subject, and wherein the tracking data comprises image data of the detected image.

Item 13. the scan monitoring device of any one of items 1 to 12, wherein the controller unit is further configured to obtain scan subject parameters.

A method of operating a scanning monitoring device for medical imaging, the scanning monitoring device comprising a controller unit and a display, wherein the method comprises during a scanning session:

-obtaining tracking data of a subject in a medical scanner;

The use of the terms "first," "second," "third," and "fourth," etc. do not imply any particular order, but are included to identify various elements. Moreover, the use of the terms first, second, etc. do not denote any order or importance, but rather the terms first, second, etc. are used to distinguish one element from another. Note that the words first and second are used herein and elsewhere for purposes of notation only and are not intended to imply any particular spatial or temporal ordering. Further, the labeling of a first element does not imply the presence of a second element, and vice versa.

While particular features have been shown and described, it will be understood that they are not intended to limit the claimed invention, and it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the claimed invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. The claimed invention is intended to embrace all alternatives, modifications and equivalents.

List of reference numerals

2 scanning monitoring device

4 controller unit

6 display

7 trace interface

8 user interface

10 medical scanner interface

12 loudspeaker

14 trace data

16 scanner data

17 user input data

18 first representation

20 second representation

22 graphical representation

24 first indicator of first representation

26 second indicator of the first representation

28 error indicator

30 surface representation

32 reference surface representation

34 first indicator of the second representation

36 second indicator of the second representation

38 model representation of a scanned subject

100 method of operating a scanning monitoring device for medical imaging

101 start scanning session

102 obtain trace data

104 obtaining scanner data

106 determining the output of the verification function

108 control scanning monitoring device

110 continue scanning?

112 raw trace data

113 obtaining raw trace data

114 apply weighting and/or filtering

116 tracking data validation

120 quality parameter indicating the quality of the trace data

122 filtered/weighted by a filtering/weighting function

124 displacement data function

126 displacement data

200 operation of the controller Unit

202 obtain trace data

204 obtain scanner data

206 application authentication function

208 control scanning and tracking monitoring devices

210 decide whether the scanning session is stopped

Claims

1. A scanning monitoring device for medical imaging, the scanning monitoring device comprising a controller unit and a display, wherein the controller unit during a scanning session is configured to:

-obtaining tracking data of the subject in the medical scanner based on the tracking from the 3D surface information, wherein obtaining the tracking data comprises: determining one or more quality parameters indicative of a quality of tracking data and including the one or more quality parameters in the tracking data;

-validating the tracking data, including determining an output of a validation function based on the tracking data and the scanner data; and is

-controlling the scanning monitoring device in accordance with an output of the verification function,

wherein the validation function is based on one or more operating parameters in the scanner data,

wherein the verification of the trace data comprises applying one or more trace data criteria to the trace data,

wherein the verification function outputs trace data indicative of corruption if a quality parameter of the one or more quality parameters indicative of trace data quality does not meet a trace data quality criterion of the trace data criteria,

wherein if a quality parameter of the one or more quality parameters indicative of tracking data quality meets a tracking data quality criterion of the tracking data criteria, the output of the validation function is indicative of high quality tracking data, and

wherein controlling the scanning monitoring device according to the output of the verification function comprises providing a notification scheme comprising:

-providing a control signal to the medical scanner indicating to stop scanning;

-providing a control signal to the medical scanner indicating a scan restart; or

-providing a control signal to the medical scanner indicating to redo the partial scan.

2. The scanning monitoring device of claim 1, wherein controlling the scanning monitoring device according to the output of the verification function comprises: a first representation is determined and provided based on the tracking data.

3. The scanning monitoring device of claim 2, wherein the first representation includes a graphical representation of the subject's displacement as a function of time.

4. A scanning monitoring device according to claim 3, wherein the graphical representations of displacements comprise a first graphical representation of the total 3D displacement in distance, a second graphical representation of the first displacement along a first axis as a function of time, a third graphical representation of the second displacement along a second axis as a function of time, and a fourth graphical representation of the third displacement along a third axis as a function of time.

5. The scanning monitoring device of claim 2, wherein the controller unit is configured to determine one or more indicators based on the output of the verification function, the scanner data and the tracking data, and wherein the controller unit is configured to include the one or more indicators, or at least a portion thereof, in the first representation.

6. The scanning monitoring device of claim 5, wherein the one or more indicators comprise an error indicator or set of error indicators indicating erroneous scans.

7. The scanning monitoring device of claim 5, wherein the one or more indicators indicate at which time a respective event occurred.

8. The scanning monitoring device of claim 2, wherein controlling the scanning monitoring device according to the output of the verification function comprises: determining and providing a second representation based on the tracking data, wherein the second representation is different from the first representation.

9. The scanning monitoring device of claim 8, wherein the second representation includes a surface representation of a surface of a scanning subject and a reference surface representation of the surface of the scanning subject.

10. The scanning monitoring device of claim 8, wherein the second representation includes one or more indicators including a first indicator indicative of a reference point or set of reference points of the subject for the first representation.

11. The scanning monitoring device of claim 10, wherein the controller unit is configured to determine the first indicator of the second representation based on an output of the verification function, the scanner data and the tracking data.

12. The scanning monitoring device of claim 1, wherein the scanning monitoring device comprises an image projector configured to project one or more images onto an imaging region of the subject in the medical scanner, and wherein the tracking data comprises image control data of the projector.

13. The scanning monitoring device of claim 1, wherein controlling the scanning monitoring device according to the output of the verification function comprises: providing a notification signal if the output indicates an erroneous scan.

14. The scanning monitoring device of claim 13, wherein the scanning monitoring device comprises a speaker, and wherein providing a notification signal comprises: an audio signal is provided with the loudspeaker.

15. A scanning monitoring device according to claim 14, wherein the controller unit is configured to select the audio signal from a plurality of audio signals based on an output of the verification function.

16. The scanning monitoring device of claim 13, wherein providing a notification signal comprises: providing a visual alert signal on the display.

17. The scanning monitoring device of claim 1, wherein controlling the scanning monitoring device according to the output of the verification function comprises: transmitting a first control signal to the medical scanner, wherein the first control signal indicates to stop scanning if the output indicates a first error.

18. The scanning monitoring device of claim 1, wherein controlling the scanning monitoring device according to the output of the verification function comprises: transmitting a second control signal to the medical scanner, wherein the second control signal indicates a scan restart if the output indicates a second error.

19. The scanning monitoring device of claim 1, wherein the scanning monitoring device comprises any sensor system configured to provide 3D surface representation data of an imaging region of the subject in the medical scanner, and wherein the tracking data comprises the 3D surface representation data.

20. The scanning monitoring device of claim 1, wherein the scanning monitoring device includes an image detector configured to detect an image of a subject, and wherein the tracking data includes image data of the detected image.

21. The scanning monitoring device of claim 1, wherein the controller unit is further configured to obtain a scanning subject parameter.

22. A method of operating a scanning monitoring device for medical imaging, the scanning monitoring device comprising a controller unit and a display, wherein the method comprises, during a scanning session:

-providing a control signal to the medical scanner indicating to stop scanning;