CA3196709A1 - Methods, systems and computer program products for calculating metakg signals for regions having multiple sets of optical characteristics - Google Patents
Methods, systems and computer program products for calculating metakg signals for regions having multiple sets of optical characteristicsInfo
- Publication number
- CA3196709A1 CA3196709A1 CA3196709A CA3196709A CA3196709A1 CA 3196709 A1 CA3196709 A1 CA 3196709A1 CA 3196709 A CA3196709 A CA 3196709A CA 3196709 A CA3196709 A CA 3196709A CA 3196709 A1 CA3196709 A1 CA 3196709A1
- Authority
- CA
- Canada
- Prior art keywords
- metakg
- signal
- interest
- region
- calculating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 230000003287 optical effect Effects 0.000 title claims abstract description 33
- 238000004590 computer program Methods 0.000 title description 13
- 238000004458 analytical method Methods 0.000 claims description 49
- 230000010412 perfusion Effects 0.000 claims description 43
- 238000012545 processing Methods 0.000 claims description 37
- 238000011002 quantification Methods 0.000 claims description 7
- 230000035479 physiological effects, processes and functions Effects 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 5
- 238000010606 normalization Methods 0.000 claims description 4
- 230000035488 systolic blood pressure Effects 0.000 claims description 4
- 230000035487 diastolic blood pressure Effects 0.000 claims 2
- 101150087426 Gnal gene Proteins 0.000 claims 1
- 230000017531 blood circulation Effects 0.000 description 60
- 210000001519 tissue Anatomy 0.000 description 50
- 230000008081 blood perfusion Effects 0.000 description 45
- 238000003384 imaging method Methods 0.000 description 39
- 230000000747 cardiac effect Effects 0.000 description 36
- 239000000523 sample Substances 0.000 description 34
- 238000005516 engineering process Methods 0.000 description 22
- 238000009826 distribution Methods 0.000 description 18
- 210000000056 organ Anatomy 0.000 description 18
- 238000010586 diagram Methods 0.000 description 15
- 238000005259 measurement Methods 0.000 description 15
- 239000008280 blood Substances 0.000 description 13
- 210000004369 blood Anatomy 0.000 description 13
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 12
- 238000005286 illumination Methods 0.000 description 12
- 229910052760 oxygen Inorganic materials 0.000 description 12
- 239000001301 oxygen Substances 0.000 description 12
- 230000002093 peripheral effect Effects 0.000 description 12
- 230000008569 process Effects 0.000 description 12
- 230000000241 respiratory effect Effects 0.000 description 9
- 239000000463 material Substances 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 239000012530 fluid Substances 0.000 description 6
- 230000029058 respiratory gaseous exchange Effects 0.000 description 6
- 230000003595 spectral effect Effects 0.000 description 6
- 230000002159 abnormal effect Effects 0.000 description 5
- 230000003205 diastolic effect Effects 0.000 description 5
- 210000003484 anatomy Anatomy 0.000 description 4
- 230000008901 benefit Effects 0.000 description 4
- 238000011109 contamination Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 230000001991 pathophysiological effect Effects 0.000 description 4
- 230000006461 physiological response Effects 0.000 description 4
- 230000002123 temporal effect Effects 0.000 description 4
- 230000035515 penetration Effects 0.000 description 3
- 230000004962 physiological condition Effects 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 102000001554 Hemoglobins Human genes 0.000 description 2
- 108010054147 Hemoglobins Proteins 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000036772 blood pressure Effects 0.000 description 2
- 210000004204 blood vessel Anatomy 0.000 description 2
- 230000008602 contraction Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 210000003414 extremity Anatomy 0.000 description 2
- 210000005003 heart tissue Anatomy 0.000 description 2
- 230000000004 hemodynamic effect Effects 0.000 description 2
- 210000000936 intestine Anatomy 0.000 description 2
- 210000004789 organ system Anatomy 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 210000001835 viscera Anatomy 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 241000252505 Characidae Species 0.000 description 1
- 235000008597 Diospyros kaki Nutrition 0.000 description 1
- 244000236655 Diospyros kaki Species 0.000 description 1
- 239000012620 biological material Substances 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 210000000748 cardiovascular system Anatomy 0.000 description 1
- 210000004351 coronary vessel Anatomy 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 230000005021 gait Effects 0.000 description 1
- 238000002329 infrared spectrum Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000002595 magnetic resonance imaging Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000004165 myocardium Anatomy 0.000 description 1
- 238000003333 near-infrared imaging Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000007310 pathophysiology Effects 0.000 description 1
- 230000037361 pathway Effects 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 241000894007 species Species 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000001225 therapeutic effect Effects 0.000 description 1
- 238000003325 tomography Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 210000001364 upper extremity Anatomy 0.000 description 1
- 230000002861 ventricular Effects 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/026—Measuring blood flow
- A61B5/0261—Measuring blood flow using optical means, e.g. infrared light
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
- A61B5/004—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part
- A61B5/0044—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part for the heart
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
- A61B5/7207—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
- A61B5/7214—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts using signal cancellation, e.g. based on input of two identical physiological sensors spaced apart, or based on two signals derived from the same sensor, for different optical wavelengths
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/48—Laser speckle optics
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2576/00—Medical imaging apparatus involving image processing or analysis
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Pathology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Surgery (AREA)
- Biophysics (AREA)
- Radiology & Medical Imaging (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Molecular Biology (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Cardiology (AREA)
- Physiology (AREA)
- Artificial Intelligence (AREA)
- General Physics & Mathematics (AREA)
- Hematology (AREA)
- Optics & Photonics (AREA)
- Databases & Information Systems (AREA)
- Psychiatry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Methods for calculating a Meta KG signal are provided. The method including illuminating a region of interest (2115) in a sample with a near- infra red (NiR) light source and/or a visible light source. The region of interest includes a sample portion and background portion, each having a different set of optical characteristics. Images of the region of interest are acquired (2125) and processed to obtain metadata (2135) associated with the acquired images. Meta KG signals are calculated (2145) for the region of interest and for the background. The Meta KG signal for the background is used to adjust the Meta KG signal for the region of interest to provide a final adjusted Meta KG signal for the region of interest.
Description
2 PCT/US2021/049608 METHODS, SYSTEMS AND COMPUTER PROGRAM PRODUCTS FOR
CALCULATING METAKG SIGNALS FOR REGIONS HAVING MUTLIPLE SETS OF
OPTICAL CHARACTERISTICS
CLAIM OF PRIORITY
[0001] The present application is continuation-in-part of U.S. Patent Application No.
151518,545, filed April 12, 2017, which claims priority to International Application No.
PCT/US20151055234, filed October 13,2015, which claims the benefit of U.S.
Provisional Application Nos. 62/063,663, filed October 14, 2014 and 62/136,010, filed March 20, 2015, the disclosures of which are hereby incorporated herein by reference as if set fOrth in their entireties.
FIELD
100021 The inventive concept relates generally to visualization of organs and/or tissue and, more particularly, to determining blood flow and perfusion parameters in a sample.
BACKGROUND
CALCULATING METAKG SIGNALS FOR REGIONS HAVING MUTLIPLE SETS OF
OPTICAL CHARACTERISTICS
CLAIM OF PRIORITY
[0001] The present application is continuation-in-part of U.S. Patent Application No.
151518,545, filed April 12, 2017, which claims priority to International Application No.
PCT/US20151055234, filed October 13,2015, which claims the benefit of U.S.
Provisional Application Nos. 62/063,663, filed October 14, 2014 and 62/136,010, filed March 20, 2015, the disclosures of which are hereby incorporated herein by reference as if set fOrth in their entireties.
FIELD
100021 The inventive concept relates generally to visualization of organs and/or tissue and, more particularly, to determining blood flow and perfusion parameters in a sample.
BACKGROUND
[0003] Blood flow and perfusion in tissue/organs are defined by the amount of blood transferred per unit time over a 2-dimensional area or in a 3-dimensional structure. Blood flow generally relates to volume of flow/unit time in conduits lamer than the arteriolar level (macrovascular level), Perfusion typically refers to the blood flow in the microvascular level, with no current parameters for quantification with non-invasive technologies.
Direct measurement and quantification of blood flow and perfusion in real time is still being developed.
Direct measurement and quantification of blood flow and perfusion in real time is still being developed.
[0004] Currently, there are several imaging technologies that may be used to measure the.
magnitude and distribution of fluid velocity, such as Laser Doppler Imaging (LDI) and Laser Speckle Imaging (LSI). Fluid velocity is linear flow demonstrating the direction and magnitude of flow, but does not directly quantify .flow in either the rnicrovascular or macrovascttlar levels.
To be linked with the more clinically intuitive concepts and terms of blood .flow and perfusion, further assumptions or analysis may be required. Indeed, combined with proper fluid dynamic modeling, these imaging techniques of fluid. velocity measurement have the potential to derive quantification information of blood flow and perfusion, in both experimental and.human clinical conditions. Throughout this document, the terms "blood flow" and "perfusion"
are used instead of the more technically oriented term "fluid velocity."
[00051 Blood flow is not a constant in the cardiovascular system in mammalian species.
Experimental and clinical data document that there are blood velocity changes within one cardiac cycle because the cardiac Output and aortic pressure are not constant. within one cardiac cycle.
Using the blood flow in coronary arteries as an. example, in the systolic phase of the cycle the coronary blood flow is low or even stops due to the contraction of the ventricular myocardium.
However, in the diastolic phase the blood flow is comparatively high and reaches a maximum level. Based on specific anatomic and physiologic characteristics, the blood flow and perfusion in other tissues and Organs may vary as well influenced by the cardiac cycle, but these different organ systems also have specific conditions of blood flow and perfusion seemingly unrelated to the cardiac cycle. Current techniques to assess blood flow and perfusion cannot make this differentiation in these tissues and organ. systems and, therefore, improved techniques may be desired.
SUMMARY
100061 Some embodiments of the present inventive concept provide methods for calculating a MetaKG signal. The method includes illuminating a region of interest in a sample with at least one light source, wherein the light source is a near-infrared. (NIR) light source and/or a visible light source; acquiring images of the region of interest; processing the acquired images to obtain metadata associated with the acquired images; and calculating the MetaKG
signal from the metaclata associated with the acquired images.
[00071 In further embodiments, the MetaKG signal may be derived from raw images or from perfusion images.
[00081 In still further embodiments, the method may furtherinclude acquiring blood flow and perfusion data using the calculated MetaKG signal. Calculating the MetaKG
signal may further include generating the MetaKG signal from the acquired images by processing the acquired images to obtain contrast images and calculating average contrast intensity of the contrast images versus time in the region of interest. The method may further include calculating at least one of heart rate and pulsatility information from the average intensity versus time in the region of interest by analyzing a frequency component of the average intensity versus time. The method may further include differentiating between abnormal and normal tissue based on frequency component of the average intensity versus time; and indicating a degree of abnormality related to an underlying physiological response.
100091 In some embodiments, the method may further include extracting heart rate variability (HRV) information from the heart rate calculated from the average contrast intensity versus time in the region of interest.
[00101 In further embodiments, the method may further include changing configuration of the region of interest; and generating .a two dimensional heart rate map of a region of interest in a field of view. Changing the configuration of the region of interest may include changing at least one of the size and the location of the region of interest.
[00111 In still further embodiments, the sample may be one of tissue and an organ.
[0012] In some embodiments, calculating the MetaKG signal may include calculating the MetaKG signal using average intensity of speckle contrast images.
[00131 In Father embodiments, at least one Hemodynarnic Status Parameter (I-ISP) may be determined including Heart Rate (HR); heart rate variability (I-IRV); R-to-R
interval (RRI); RRI
Standard Deviation (RRISD); systolic Blood Pressure threshold (SBt); rate x pressure product (RPP); instantaneous perfusion in systole and diastole; frequency analysis and time-frequency analysis of a perfusion curve; and contractility index including slope of the perfusion curve based on the calculated MetaKG.
[00141 In still further embodiments, at least one Hemodynamic Status Parameter may be determined including tissue oxygen content, hemoglobin content, and temperature based on the calculated MetaK0 [00151 Some embodiments of the present inventive concept provide computer systems for calculating a MetaKG signal.. The systems include a processor; and a memory coupled to the processor and comprising computer readable program code that when executed by the processor causes the processor to perform operations including illuminating a region of interest in a sample with, at least one light source, wherein the light source is a near-infrared (NIR) light source and/or a visible light source; acquiring images of the region of interest;
processing the acquired images to obtain metadata associated with the acquired images; and calculating the MetaKG
signal from the metadata associated with the acquired images.
[00161 Further embodiments of the present inventive concept provide computer program products for calculating a MetaKG signal. The computer program products including a non-transitory computer readable storage medium having computer readable program code embodied in the medium, the computer readable program code including computer readable program code to illuminate a region of interest in a sample with at least One light source, wherein the light source is a near-infrared (NIR) light source and/or a visible light source.;
computer readable program code to acquire images of the region of interest; computer readable program .code to process the acquired images to obtain metadata associated with the acquired images; and computer readable program code to calculate the MetaKG signal from the metadata associated With the acquired images.
[0017) Still further embodiments of the present inventive concept provide methods of removing movement-related artifacts from a MetaKG signal using dual wavelength light sources.
The methods include illuminating a region of interest in a sample with a near-infrared (NIR) light source and a visible light (VL) source; acquiring two sets of images of the region of interest each corresponding to one of the NIR light source and the VL source;
processing the two sets of images to obtain NIR-metadata and VL-metadata; calculating a MR MetaKG and aVL
MetaKG
from the NIR- metadata and the VL metadata, respectively; extracting a movement-related common signal component from the NIR MetaKG and the VL MetaKG; and calculating a noise-free MetaKG by cancelling out the movement-related common signal component from the MR
MetaKG.
100181 In some embodiments, calculating the noise-free MetaK0 may include removing noise due to a motion artifact, where the noise due to the motion artifact includes respiratory activity.
[00191 Further embodiments of the present inventive concept provide a method for calculating a MetaKG signal. The method includes illuminating a region of interest in a sample with at least one multi-;wavelength light source. The region of interest includes a sample portion and a background portion and the multi-wavelength light source is a near-infrared (NIR) light source and/or a visible light source. Multi-spectral images of the region of interest are acquired using a multi-wavelength camera. The acquired multi-spectral images are processed to obtain metadata associated with the acquired multi-spectral images. A background MetaKG signal is calculated for the background portion of the .region of interest from the metadata associated with the acquired multi-spectral images. A MetaKG signal for the region of interest is Calculated from the metadata associated with the acquired multi-spectral images. The calculated MetaKG
signal for the region of interest is adjusted using the calculated background MetaKG signal to provide a final adjusted MetaKG signal. Calculating the background MetaKG
signal and the MetaKG signal for the region of interest includes calculating a multi-spectral MetaKG signal using multi-spectral signal processing to remove motion artifacts and improve signal quality.
Calculating the multi-spectral MetaKG signal comprises calculating a residual MetaKG
(Meta/W(112.2.W) as:
= aXinv21(.2474¨bXIT.T34s.2z (x=Ypr, +c Al eta K ta:,. (t) == ***
or et x ________________________________________ Y¨ = x = Img:4,(x,Y, MetafcGliz(t) ki X IV
wherein tIngAi (x,Y, .c.) is raw or speckle contrast images of a first wavelength.
Im922 (x,Y, t) is raw or speckle contrast images of a second wavelength; a, b and c are parameters for normalization; and M and N are a number of pixels along x and y axes, respectively.
[00201 Still further embodiments of the present inventiN.,e.concept provide a method for calculating a MetaKG signal for a region of interest in a sample. The .method includes illuminating a region of interest in a sample with a light source having a single wavelength. The region of interest has a sample portion having a first set of optical characteristics and a background portion having a second set of optical characteristics. Images of the region of interest are acquired. The acquired images of the region of interest are processed to obtain metadata associated with the acquired images. A MetaKG signal for the region of interest from the metadata associated with the acquired images is calculated. A background MetaKG signal from the metadata associated with the background portion of the region of interest is calculated.
The calculated MetaKG signal for the region of interest is adjusted using the calculated background MetaKG to provide a final adjusted MetaKG signal for the region of interest.
BRIEF DESCRIPTION OF THE DRAWINGS
100211 Fig. I is a block diagram of a system in accordance with. some embodiments of the present inventive concept(s).
[0022] Figs. 2A through 2C are graphs illustrating average intensity vs.
time in a multi-wavelength imaging technology in accordance with some embodiments of the present inventive concept [00231 Figs. 3Athrough 3C are graphs illustrating average intensity vs.
time in a multi-wavelength imaging technology having respiration contamination removed in accordance with some embodiments of the present inventive concept.
[0024] Figs. 4A through 4C are a series of Laser Speckle images of the heart.
[0025] Fig. 5 is a graph illustrating average intensity v. time representing the metaKG signal in accordance with embodiments of the present inventive concept.
[0026] Figs. 6A-C is a series .of Laser Speckle images of the heart during a systolic phase.
[0027] Fig. 7 is. a graph illustrating average intensity v. time representing the metaKG signal in accordance with embodiments of the present inventive concept.
10028] Figs. 8A-C is a series of Laser Speckle images of the heart during diastolic phase.
10029] Fig. 8D is a graph illustrating average intensity v. time representing the metaKG
signal in accordance with embodiments of the present inventive concept.
[0030] Fig. 9A is an image illustrating one frame of raw image data sequence in diastolic phase.
[0031] Fig. 9B is an image illustrating one frame of raw image data sequence in systolic phase.
[0032] Fig. 9C is a graph of average intensity vs. time curve as the metaKG
signal in accordance with some embodiments of the present inventive concept.
[0033] Fig. 10A is an image illustrating one. frame from raw image data sequence.
[0034] Fig. 1.0B .is an image illustrating the blood velocity distribution in the fingers.
[0035] Fig. 10C is a graph of average intensity vs. time curve as the metaKG
signal in accordance with some embodiments of the present inventive concept.
[0036] Fig. I1A is an image illustrating LSI-analyzed velocity map of perfusion to two fingers of left hand and two fingers of right hand..
[0037] Fig. 118 is a graph Illustrating average intensity vs. time curve of 12 seconds (60 fps) image sequence of two fingers of left hand and two fingers of right hand (aggregate from. all four fingers) of Fig. 1.1A.
[0038] Fig. 11C is a graph illustrating standard EKG and peripheral oxygen saturation pulsatility data acquired simultaneous with the image sequence in accordance.
with embodiments of the present inventive concept.
[0039] Figs. I2A and. 1.2B illustrate the two left:fingers of Fig. 11A and the associated average intensity vs. time curve of the two left fingers.
[0040] Figs. I2C and 121) illustrate the two right fingers of Fig. 11A and the associated average intensity vs. time curve of the two right fingers.
[00411 Figs. 12E through 12H are graphs illustrating frequency domain analyses of the average intensity -vs. time curves for both the left (E and F) and right (G
and H) fingers, [0042] Figs 13A is an image illustrating LSI-analyzed velocity map of perfusion to two fingers of left- hand and two .fingers of right hand.
[00431 Fig. I3B is a graph illustrating average intensity vs. time curve of 12 seconds (60 fps) image sequence of two fingers of left hand and two fingers of right hand (aggregate from all four fingers) of Fig. 11A.
[00441 Fig. 13C is a graph illustrating standard EKG and peripheral oxygen saturation pulsatility dataacquired simultaneous with the image sequence in accordance with embodiments of the present inventive concept.
[00451 Figs. 14A and 14B illustrate the two left fingers and the associated average intensity vs. time curve of the two left fingers.
100461 Figs. 14C and 14D illustrate the two right fingers: and the associated average intensity vs, time curve of the two right fingers.
P90471 Fig. 14E through 1411 are graphs illustrating frequency domain analyses of the average intensity vs. time curves for both the left (E and -F) and right (G
and.11) fingers.
100481 Fig. 15A is an image illustrating LSI-analyzed velocity map of perfusion to two fingers of left hand and two fingers of right hand.
[0049] Fig. 15B it a graph illustrating average intensity vs. time curve of 12. seconds (60 fps) image sequenee.of two fingers of left hand and two fingers of right hand (aggregate from all four fingers).
[0050] Fig. 15C is a graph illustrating standard EKG and peripheral oxygen saturation pulsatility data acquired simultaneous with the image sequence in acpordance with embodiments of the present inventive concept.
[00511 Figs. 16A and 168 illustrate the two left fingers and. the associated average intensity vs. time curve of the two left fingers.
100521 Figs. 16C and 16D illustrate the two right fingers and the associated average intensity vs. time curve of the two right fingers.
100531 Figs. 16E through 161i are graphs illustrating frequency domain analyses of the average intensity vs. time curves for both the left (E and F.) and right (G
and H) fingers.
[00541 Fig. 1 7A is an image illustrating LSI-analyzed velocity map of perfusion to two fingers of left hand and two fingers of right hand.
100551 Fig. 178 is a graph illustrating average intensity vs. time curve of 12 seconds (60 fps) image sequence of two fingers of left hand and two fingers.of right hand (aggregate from all four fingers).
100501 Fig. 17C is a graph illustrating standard EKG and peripheral oxygen saturation pulsatility, .data acquired simultaneous with the image sequence in accordance with embodiments of the present inventive concept.
100571 Figs. 18A and 18B illustrate the two left fingers and the associated average intensity vs. time curve of the two left fingers.
[00581 Figs. 1.8C and I8D illustrate the two right. fingers and the associated average intensity vs. time curve of the two right fingers.
100591 Figs.18E through 1811 are graphs illustrating frequency domain analyses of the average intensity vs. time curves for both the left (E and F.) and right (G
and ID fingers.
100601 Fig. 19 is a block diagram of a data processing system according to embodiments of the present inventive concept(s).
100611 Fig. 20 is .a more detailed block diagram of the data processing system illustrated in Fig. 19 in accordance with some embodiments of the present inventive concept(s).
100621 Figs. 21, through 23 are -flowcharts illustrating operations for combining images in accordance with various embodiments of the present inventive concept(s).
[00631 Figs. 24A through 24D illustrate laser speckle imaging of a pig intestine in accordance with some embodiments of the present inventive concept.
[0064] Figs. 25A and 2513 are graphs illustrating time-domain (or spectral) analysis of MetaKG signals in accordance with some embodiments of the present inventive concept.
100651 Figs. 26A and 26B are graphs illustrating frequency-domain (or spectral) analysis of MetaKG signals in accordance with some embodiments of the present inventive concept.
100661 Figs. 27A and 27B are graphs illustrating Frequency-time domain (or spectrogram) analysis of MetaKG signals in accordance with some embodiments of the present inventive concept.
100671 Figs. 28A and 28B are graphs instating residual MetaKG versus time/frequency in accordance with some embodiments of the present inventive concept.
100681 Fig. 29 is a graph illustrating frequency-time domain (or spectrogram) analysis of residual-MetaKG signals in accordance with some embodiments of the present inventive concept.
100691 Fig. 30 is a flow chart illustrating operations according to some embodiments of the present inventive concept.
100701 Figs. 31A through 31G are images and graphs illustrating various physiologic status parameters that may be determined from a MetaKG in accordance with some embodiments of the present inventive concept.
100711 Fig. 32 is a block diagram illustrating a field of view having a sample on a background having a different set of optical characteristics in accordance with some embodiments of the present inventive concept.
100721 Fig. 33 is a graph of frames versus mean iKG illustrating noise in the visible MetaK.G
in a palm caused by movement in the background in accordance with some embodiments of the present inventive concept.
100731 Fig. 34 is a flowchart illustrating methods using a single wavelength in accordance with some embodiments of the present inventive concept.
100741 Fig. 35 is a flowchart illustrating methods using multiple wavelengths in accordance with some embodiments of the present inventive concept.
DETAILED DESCRIPTION OF SOME EMBODIMENTS
100751 Specific example embodiments of the inventive concept now will be described with reference to the accompanying drawings. This inventive concept may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein;
rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the inventive concept to those skilled in the art. In the drawings, like numbers refer to like elements. It will be understood that when an. element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. As used herein the term "and/or" includes any and all combinations of one or more of the associated listed items.
100761 The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the inventive concept. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless expressly stated otherwise. It will be further understood that the terms "includes,"
"comprises," "including"
and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
Unless otherwise defined, all terms (including technical and scientific temis) used herein have the same meaning as commonly understood by .one of ordinary skill in the art to which this inventive concept belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in thecontext of the specification and the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
100781 Throughout the present application the more clinically intuitive terms "blood flow"
and "perfusion" will be used to discuss aspects of the present inventive concept are used instead of the more technically oriented term. "fluid velocity." However, it will be understood that these tetras may be used interchangeably.
100791 As discussed above, currently there is no method or system for direct measurement and quantification of blood flow and perfusion in real time. Accordingly, embodiments of the present inventive concept relate generally to using image metadata as a physiologically-relevant signal for any blood velocity imaging technology and analysis of that imaging technology product. As used herein, "metadata" refers to data that describes another form of data.. For example, an image, as discussed herein, may include metadata that describes how large the picture is, the color depth, the image resolution, when the image was created, and other data. A
text document's metadata may contain information about bow long the document is, who the author is, When the document was written, and a short summary of the document.
Embodiments of the present inventive concept are directed to abstracting a surrogate "metaKG" signal from any blood velocity imaging technology and analysis of that imaging technology product, by calculating an average intensity vs. time curve within a region of interest (ROI) as will be discussed further herein.
[00801 Embodiments of the present inventive concept may he applied to imaging technology, using one or more appropriate wavelengths to collect digital image data for use in a medical experimental or clinical context. The imaging may be used for simple visualization or for more complex qualitative physiologic evaluation or even more complex quantitative physiologic evaluation without departing. from the scope of the present inventive concept.
p0811 Due to its physiologic dependence on the cardiac cycle, blood flow and perfusion measurement over time does not provide meaningful information without a specific indication of the cardiac phase. In cardiac computerized tomography (CT) and magnetic resonance imaging (MRI) scanning, use of the standard external electrocardiogram (EKG) to gait signal acquisition and to track time during the image acquisition gives the advantage of linking each specific blood flow and perfusion distribution to its cardiac phase.
100821 Embodiments of the present inventive concept provide methods for generating reliable instantaneous blood flow and perfusion distribution .at any time of a cardiac cycle and average blood flow and perfusion distribution of several cardiac phases or cycles. Furthermore, embodiments of the present inventive concept may allow a valid comparison of blood flow and perfusion distribution in different cardiac phases and in a pre- and post-treatment fashion.
[09831 In particular, in accordance with embodiments discussed herein, when an external EKG signal is absent during the imaging process, a "surrogate EKG signal"
(interchangeably referred to hereinafter as a "metaKG" signal or a "MetaKG" signal) can be calculated from the metadata contained within the image/image sequence. For example, from, the average intensity vs. time curve of a specific ROI on the image sequence, using frequency component analysis, a "metaKG" signal can be calculated and may yield the same heart rate/pulsatility as an external EKG signal. The "metaKG" signal may also reflect dynamic physiology; for example, when the blood vessel is occluded, the frequency component changes compared with the frequency component of the non-occluded control state.
[00841 By using each pixel as a field of view (FOV), a two dimensional (2D) rate map can be generated using the above concept and abnormal tissue can be identified by examining the frequency component of each specific region.
100851 Although discussed herein with respect to cardiac tissue, the "metaKG"
signal calculated in accordance with embodiments of the present inventive concept is not limited to cardiac tissue, It may be calculated and used in all tissue/organ systems where blood flow and perfusion can be imaged and measured,. including skin.
[0086] Thus, the metaKG signal in accordance with embodiments of the present inventive concept is a multi-channel physiological signal that can be derived from the NI.R image data sequence. The number of channels can be up to the pixel number of the Na image.. As discussed above, this physiological signal can not only be used as a surrogate EKG signal, but also contains other information about the physiological condition of the monitored tissue/organ.
[00871 As discussed above, in accordance with some embodiments, average intensity within a region of interest (ROD/multiple ROIs on the NIR image data sequence may be calculated at each time point. After a series of signal processing, such as noise removal, baseline correction and other modification, the average intensity vs. time curve at each ROI/multi R.Ors is analyzed in time, frequency and time-frequency domain to monitor the physiological condition of a tissue/organ.
[00881 Thus, embodiments of the present inventive concept provide a completely non-contact, non-invasive tissue/organ physiological condition monitoring technology that can be used in real time. The monitoring region and number of channels are much less limited than traditional monitoring technology, such as EKG. This technology captures and analyzes much more information than the current products that count heart beat and pulsatility using visible light as will be discussed further herein with respect to Figs, 1 through .31.
100891 Referring now to Fig. I, a system for calculating a Meta.KG signal in accordance with some embodiments of the present inventive concept will be discussed. It will be understood that some systems in accordance with embodiments of the present inventive concept may be non-invasive. As used herein, "non-invasive" refers to a system or method that does not require the subject to be injected with a dye, penetrated with an object or touched with an intrabodyprobe or probes. Thus, as used herein, the term non-invasive refers to a system or method that makes no direct contact with the subject. As used herein, "subject" refers to the person or thing being imaged. The subject can be any subject, including a veterinary, cadaver study or human subject.
As used herein, "perfusion" refers to blood flow at the tissue perfusion distribution level detected with speckle imaging.
[0090I As illustrated in Fig. 1, the system 100 includes at least one light source 120, a camera 130, an image processing device 110 and a metaKG device 112. Although the system of Fig. 1 is depicted as only including these elements, it will be understood that other elements may also be present in the system without departing from the scope of the present inventive concept.
In particular, in some embodiments of the present inventive concept, multiple light sources 120 may be used. In these embodiments, the first light source may be a NIR light source and the second light source may be a visible light (VL) light source. Although embodiments of the present inventive concept are discussed herein as having one or two light sources, it will be understood that more than two light sources may also be used without departing from the scope of the present inventive concept.
[00911 In these embodiments, the NIR light source may have a wavelength of from about 780nrn to about 2500nm and the visible light source has a wavelength of from about 400nm to about 780nm. Thus, some embodiments of the present inventive concept provide a system that uses two wavelengths of differential transmittance through a sample to apply LSI and/or LDI.
For example, a first of the two wavelengths may be within the visible ranee that has zero or very shallow penetration, such as blue light 450-495 am. This wavelength captures the anatomical structure of tissue/organ surface and 'serves.as a position marker of the sample but not the subsurface movement of blood flow and perfusion. A second wavelength may be in the near Infra-Red (NIR) range, which has much deeper penetration. This wavelength reveals the underlying blood flow physiology and correlates both to the motion of the sample and also the movement of blood flow and perfusion. Using the imaging measurement of the visible light as a baseline, the true motion of blood flow and perfusion can be derived from the NIR imaging measurement without being affected by the motion artifact of the target.
Furthermore, the anatomical structure information captured by visible light and the physiological characteristics measured by NIR light are combined. Details with respect to systems using two wavelengths are discussed in detail in U.S. Provisional Application No. 62/136,010, flied arch 20, 2015, the disclosure of which was incorporated herein by reference above. Although embodiments are discussed herein with respect to NIR raw images and visible light images, embodiments of the present inventive concept are not limited to this configuration. Any other image form that can adequately represent anatomy can. be used without departing from the scope of the present inventive concept.
100921 Referring again to Fig. 1, in some embodiments, the at least one light source unit 120 may be, for example, one or more lasers or light emitting diode (LED) lights.
The at least one light source 120 may be used to illuminate a region of interest 140 (hereinafter "tissue/organ").
If the light source 120 is an NIR light source, it may have a wavelength, of from about 780nm to about 2500 ran. As used herein, the "region of interest" refers to the region of the subject that is being imaged, for example, the principal vessels and tissue, organs, etc. When light (incident light 127) from the at least one source 120 is directed to a living target.
(region of interest 140), such as a tissue/organ, part of the light will go through multiple scattering inside the target and eventually reflect back (Reflecting light) to the camera 130 as shown in 'Fig.
I.
100931 The camera 130 is configured to collect the reflecting light and provide a visible light or MR image (NIR Layer 115), each with different characteristics depending, for example, upon a.depth of penetration of the illumination light determined by the wavelength energy. Thus, laser illumination 120 and image capture 130 may be processed 110 with near-infrared (NIR) technology and results in a video image sequence or sequences 115 for subsequent analysis.
Details with respect to the NIR technology is. discussed in commonly assigned International Application No. PCTIUS2015/055251, entitled Methods, Systems and Computer Program Products for Visualizing Anatomical Structures, Blood Flow and Perfusion Using Near-Infrared Imaging (Attorney Docket No. 5218-228W0), tiled on October 13, 2015, the contents of which.
are hereby incorporated herein by reference as if set forth in its entirety.
[00941 Contained within this image sequence or sequences 115 is metadata 118 associated with each image sequence or sequences. The metaKG device 112 according to embodiments of the present inventive concept processes the metadata 118 associated with the image sequences and provides a "metaKG signal" 117, which directly finks to underlying fundamental physiologic and/or pathophysio logic processes 121 being imaged. In accordance with embodiments discussed herein, the metaKG signals can optimize the image acquisition and may be integral to optimizing analysis of blood flow and perfusion 131. Since the metaKG signal 117 is imbedded in the metadata 118 of the non-invasively acquired image sequence without direct tissue contact, embodiments of the inventive concept of the metaKG enables this new image approach to be directly linked to the physiologic and pathophysiologic 121 parameters and characteristics without the requirement for traditional external EKG signals. Thus, a sample 140, for example, tissue or organ, with blood flow and perfusion may be examined for measurement and quantification of blood flow and perfusion 131 using non-invasive imaging, with no need for an EKG.
[00951 As discussed above, in a multi-wavelength embodiment, the region of interest 140 is illuminated with two different light sources, for example, NIR and VL, and two sets of images are acquired and processed to obtain two different types of metadata, for example, NIR-metadata and VL-metadata. A.ccordingly, the calculations discussed herein with respect to metadata related to a single wavelength may be performed for multiple wavelength data.
For example, the NIR MetaKG and the VL MetaKG may be calculated from the .metadata,a movement-related common signal component may be extracted from the NIR MetaKG and the VL
MetaKG; and a noise-free MetaKG may be calculated by cancelling out the movement-related common signal component from the NIR MetaKG as will be discussed further below with respect to a...single wavelength. In other words, using two wavelengths in accordance with some embodiments discussed herein may improve the signal to noise ratio (SNR) of the image by combining the penetrating capability of the NIR wavelengths and the advantages of the VL
wavelengths, i.e. the superficial surface noise of the VL may be cancelled out.
100961 Referring now to Figs. 2A through 2C, graphs illustrating average intensity vs. time using .a multi-wavelength imaging technology to document the presence of the metaKG signal will be discussed. Fig. 2A illustrates the 20 seconds metaKG using near infra-red wavelength illumination; Fig. 28 illustrates the 20 seconds metaKG using near visible wavelength illumination; and Fig. 2C illustrates the 20 seconds EKG signals. As illustrated therein, the metaK0 is fluctuating at heart rate frequency (90 peaks per minute) and also at respiration frequency (one larger peak every 4--5 seconds). Figs. 2A through 2C also illustrate that the metaKG generated. by near infra-red illumination has less noise than the one generated by visible wavelength illumination.
100971 Referring now to Figs. 3A through 3C, graphs illustrating average intensity vs. time using a multi-wavelength imagine technology to document the presence of the metaKG signal with respiration contamination removed will be discussed. Fig. 3A illustrates the 20 seconds metaKG without respiration contamination using near infra-red wavelength 'illumination; Fig. .3B
illustrates the 20 seconds metaKG without respiration contamination using near visible wavelength illumination; and Fig. 3C illustrates the 20 seconds EKG signals.
As illustrated in Figs. :3A through 3C, the metaKG is only fluctuating at heart rate frequency .(90 peaks per minute). As further illustrated, the metaKG generated by near infra-red illumination has less noise than the. one generated by visible wavelength illumination.
[00981 Thus, it will be understood that although many embodiments of the present inventive concept are discussed herein with respect to a single light source having a particular wavelength, embodiments of the present inventive concept are not limited to this configuration.
[00991 Figs. 4A through 4C are images illustrating asingle.frame in the raw image data sequence (4A); inversed spatial contrast image (4B) and an inversed temporal contrast image (4C). The graph of Fig. 5 illustrates average intensity vs. time during the image acquisition period of time as the metaKG signal (end-diastolic phase in a.specific cardiac cycle is labeled).
Thus, Figs. 4A through 4C and 5 illustrate instantaneous blood velocity distribution of anterior wall of a heart using Laser Speckle Imaging (LSI) at the end-diastolic phase of the cardiac cycle (determined visually).
[00100] Figs. 6A through 6C illustrate 4 single frame in the raw image data sequence (6A); an inversed spatial contrast image (613); and an inversed temporal contrast image (6C). Fla. 7 illustrates an average intensity vs. time curve during the image acquisition period of time as the metaKG signal (end-diastolic phase in nine (9)cardiac cycles are used). Thus.
Figs. 6A through 6C and 7 illustrate average blood velocity distribution of anterior wall of aheart using Laser Speckle Imaging at the end-diastolic phase of the cardiac cycle.
[001011 Figs. 8A through 8C illustrate a single frame in the raw image data sequence (8A); an inversed spatial contrast image (8B); and an inversed temporal contrast image (8C). Fig. 8D
illustrates an average intensity vs. time curve during the image acquisition period of time as the metaKG signal (end-systolic phases in eight (8) cardiac cycles are used).
Thus, Figs. 8A through 8D illustrate average blood velocity distribution of anterior wall of a heart using Laser Speckle Imaging at the end-systolic phase of the cardiac cycle (determined visually).
[001021 Figs. 9A through 9B illustrate using an average intensity vs. time curve as the .metaKG signal in a potential cardiac application to assess blood flow and perfusion. Fig. 9C
illustrates the average intensity vs. time curve as the metaKG signal .with diastolic and systolic phases labeled. Fig. 9A illustrates one frame of raw image data sequence in diastolic phase and Fig. 98 illustrates one frame of raw image data sequence in systolic phase.
1001031 Referring now to Figs. 10A through 1QC, using average intensity vs.
time curve as the metaKG signal in a potential skin/peripheral extremity application to assess blood flow and perfusion will be discussed. Figs. 10A and 10B 'illustrate a finger perfusion measurement setup.
Fig. 10A illustrates one frame from raw image data sequence, with flow to the two left fingers reduced by greater than 70% by inflation of a.blood pressure cuff on the left arm. Fig. 108 illustrates the blood velocity distribution, illustrating this substantial reduction in flow and perfusion to the left fingers. Fig. IOC is a graph illustrating an average intensity vs. time curve as the metaKG
Referring to Figs. 11A through 1811, use of the average intensity vs. time curves as the metaKG signal in a different finger perfusion measurement experiment will be discussed.
These figures illustrate a potential skin/peripheral extremity application to assess blood flow and perfusion. The figures document the interoperability of the metaKG, the external standard EKG, flow, velocity of flow, frequency, and change in frequency due to pathophysiologic changes in flow and perfusion in accordance with embodiments discussed herein.
[00105] Referring first to Figs. IAA through 11C, embodiments of at baseline, with no fingers occluded will be discussed. Fig. 118 illustrates the average intensity vs.
time curve of 12 seconds (60 fps) image sequence of two .fingers of left hand and two fingers of right hand (aggregate from all four fingers). Fig. I IA illustrates an LSI-analyzed velocity map of perfusion to all fOur fingers. Fig. 11C illustrates standard EKG and peripheral oxygen saturation pulsatility data acquired simultaneous with the image sequence. The inetaKG 'rate' is 73 beats/min (bpm), while the recorded standard EKG rate is 74 bpm...
[001061 Referring now to Figs. 12A through 12.H, using the same data as in Figs. 11A-C, this baseline data is farther analyzed. Figs. 128 and 12D illustrate the wave form of the average intensity vs. time curve of the two left (12A) and two right (12C) finger sets, respectively., and Show that they are similar (la =73 bpm, R =74 bpm). Figs. 12EIF and 1.2G/E1 are frequency domain analyses of the average intensity vs. time curves, which document that the main frequency component in both finger sets is the heart rate (HR), and that the main frequency component of the two left fingers (Figs. 12E and 12F) and two right fingers (Figs. I2G and 12H.) are virtually identical.
f001071 Referring now to Figs. 13A through 13C, results of the same experimental setup as Figs. 11A-12II, but now flow and perfusion to the left two fingers (Fig. 13A) are occluded by the blood pressure cuff will be discussed. The peripheral oxygen saturation measurement. is made from the third digit on the left hand. Fig. 138 illustrates an average intensity vs. time curve of 12 seconds (60 fps) image sequence of fingers Of left hand and two fingers of right hand (Fig.
13A). Fig. 13C illustrates the standard external EKG .and peripheral oxygen saturation pulsatility data acquired simultaneous with the image sequence. With the finger occlusion, the metaKG
signal (aggregate from. all four fingers) differs slightly from the standard EKG (72 bpm vs. 69 bprn).
1001081 Referring now to Figs. 14A through 14H, analysis is similar to that discussed above with. respect to Figs. 12A-H. The flow and perfusion to the left finger set (14A) are occluded, while the right finger set (14C) is normally perfused as the control. Figs.
148 and. 14D illustrates the wave form of the average intensity vs. time curve as the metaKG of the left (148) and right finger sets (14D), and that they are different. Figs. 14E47 and 140/H.
illustrate the frequency domain analysis of the average intensity vs. time curves. Figs. 140/H
'illustrate the main .frequency component of the non-occluded right finger set (14D) is still .the HR. Figs. 14E/Fõ
however, illustrate the frequency component of the occluded left finger set is degraded from the perfused condition in Figs. 12E/F, and very different from the. frequency component of the two right fingers (Figs. 0,41). Thus, Figs. 14A through 14H illustrate that there is a difference in the metadata (B&D) because blood flows to the fingers in A are occluded and those in C are not.
The strength of intensity fluctuation in D and 0 are much greater than that in B and E. In other words, when the blood, flow is blocked, the metadata (MetaKG) may weaken.
[001091 Referring now to Figs. 15A through 15C, restilts of the same experimental setup as prior figures, but now the blood cuff on the left arm has been released and both finger sets are perfused again (note the time stamp from the standard EKG display) will be discussed. Fig. 15B
illustrates the average intensity vs. time tnetaKG curve of 12 seconds (60 fps) image sequence of two fingers of left hand and two fingers of right hand (Fig. 15A). Fig. 15C
illustrates bottom panel. is the standard external EKG and peripheral oxygen saturation pulsatility data acquired simultaneously with the image sequence. The metaKG rate is 72 bpm versus the standard EKG
rate of 75 bpm.
1001101 Referring now to Figs. 16A through 16H, an analysis is similar to Figs. 1.2 and 14 above will be discussed. Figs. 16B and 16D illustrate the wave form of the average intensity vs.
time curve of the left (16A) and right (1.6C) finger sets are similar after the occlusion on the two left fingers (16A) are released. Figs. 16E/F and 16G/H illustrate the frequency domain analyses Of the average intensity vs. time curves, which again illustrate that the main frequency component is the HR, and that the main frequency component of the left finger set .(16E/F) and the right finger set (16G/H) are identical again after the occlusion to the left finger set is released.
[001111 Referring now to Figs. 17A through 1.7Cõ using the same experimental setup as Fig.
15, the heart rate of the subject was temporarily increased by isometric exercise. The average intensity vs. time curve as the metaKG signal in this finger perfusion experiment is illustrated with the heart rate elevated. Fig. 17B is the average intensity vs. time curve of 12 seconds (60 fps) image sequence of the left and right finger sets (I7A). Fig. 17C
illustrates the standard external EKG and peripheral oxygen saturation pulsatility data acquired simultaneously with the image sequence.
[001121 Referring now to Figs. 18A through 18H, Figs. 18B and 18D
illustrate that wave forms of the average intensity vs. time curve of the left (18A) and right (18C) finger sets are .similar. Figs. 18E/F and 180/H illustrate that the frequency domain analyses of the metaKO
data, which show the main frequency component is the HR in both finger sets (1.8A and 18C), and that the main frequency component of the two left fingers (Figs. I 8E/F) and two right fingers (Figs. 18G/H) are identical.
[001131 As discussed above, because the blood flow and perfusion are dynamic processes that change in one cardiac cycle, it is critical to synchronize the imaging measurement results with a reference signal. Most commonly in medical imaging the reference signal is the external electrocardiogram ( EKG) signal. In other words, if the blood flow measurement is not linked to specific physiologic parameters, such as the time point during a cardiac cycle, the results are not useful because they have no physiologic context.
[001141 Furthermore, the significance of the physiologically-referenced, for example, EKG-timed, blood flow and perfusion measurement in evolving imaging technologies is Instantaneous flow and perfusion distribution that can be generated and linked at any time of a cardiac cycle as discussed above. Similarly, average flow and perfusion distribution can also be generated and linked to one or several cardiac phases or cycles as discussed with respect to the figures above.
1001151 The significance of the physiologically-referenced, for example, EKG-timed, blood flow and perfusion comparison, i.e., before and after an intervention, in evolving imaging technologies is as follows: (J) A standardized, non-temporal baseline for comparison (in physiology, time phase is not standard across clinical applications); and(2) unique and often novel new physiologic/pathophysiologic information, not obtainable otherwise.
[001161 The significance of the physiologically-referenced, for example, EKG-timed, blood.
flow and perfusion also creates the analytical basis for: (1) quantitative comparison of the instantaneous flow and perfusion distribution, because the flow and perfusion patterns will vary, based on the physiology/pathophysiology of blood flow and perfusion, Quantitative comparison typically requires before and after imaging.d.ata that are synchronously comparable, and 'EKG
synchronization is a useful way to link the quantitative -flow and perfusion to an independent, objective benchmark, i.e. a specific cardiac phase. Moreover, the precision of a benchmark 'like the EKG is useful for defining the starting and ending points of the averaging process, versus simply finding a random starting point and averaging a few seconds of flow and perfusion measurements, where quantitative comparison of the average flow and perfusion maps is indicated.
100/171 Embodiments of the present inventive concept address situations where an EKG
signal is not available or desirable. As discussed herein, embodiments of the present inventive concept provide a "surrogate EKG signal" that can be used instead of the standard EKG signal to identify and target these physiologic processes, benchmarks, data acquisition and data analysis parameters. The "surrogate EKG signal" has been referred to herein as a "MetaKG signal." The MetaKG in accordance with embodiments discussed herein consists of an.
electrical, mechanical, and/or motion signal embedded in the.metadataof the image file(s) obtained by imaging across or within the visible and near-infrared spectrum wavelengths. The surrogate EGK signal is referred to herein as "rnetaKa"
[001181 As discussed above with respect to the Figures, for example, Figs. 2 through SD, the metaKG is imbedded in the average intensity vs. time curve of the raw image data sequence. In particular, if 10 seconds of image sequence is captured at 100 frames/second, an average intensity is calculated. at each frame to form a curve of 1.000 intensity points along the second time line. Due to contraction of the heart, the imaged tissue/organ will move toward and away from the camera causing the intensity to fluctuate periodically. The fluctuation of intensity shows a certain pattern in one cardiac cycle and repeats itself different cardiac cycles.
[001191 Although embodiments of the present inventive concept are discussed herein with respect to cardiac applications, embodiments of the present inventive concept are not limited to this configuration. For example, the periodic fluctuation average intensity vs. time not only happens in cardiac imaging applications, but also in other tissues/organs. In particular, Figs. I OA
through 10C illustrate a metaKG signal in accordance with embodiments discussed herein from finger digits of the upper extremities, despite being located quite far from the heart.
[001201 In validating the accuracy of this metaKG physiologic data using frequency component analysis, in Figs. 11A through IC, the metaKG signal yields the same heart rate as the real EKG signal and peripheral oxygen saturation pulsatility data (73 bpm vs. 74 bprn).
1001211 As further illustrated in Figs. 12A through 12H, the frequency components of the average intensity vs. time curves from representative different normal tissues (left hand finger pair (12A) vs. right hand finger pair(12C)) are similar indicating the HR. as the main frequency component of the metaKG.
(001221 As evidence of the physiologic relevance of the metaKG, when blood flow and perfusion are physiologically or pathophysiologically reduced, the frequency component of the average intensity vs. time curve metaKG from the occluded tissue changes compared. with the frequency component from the non-occluded control tissue metaKG, as illustrated in Figs.I 3.A-C. In Figs. 14A through 14H, the main frequency component of the metaKG
average intensity vs. time curve from the non-occluded control tissue is still the HR which is consistent with the external EKG reading while the frequency component of average intensity vs.
time curve from the occluded .tissue becomes more complex. This indicates the presence of a different and abnormal underlying physiological response.
[00123] As further evidence of the physiologic relevance of the metaKG, when blood flow and perfusion can be restored to the certain part of tissue that was previously interrupted of blood flow and perfusion, the frequency components of the average intensity vs. time 'metaKG. from occlusion released tissue. and normal tissue are similar, as indicated by the HR as the main frequency component as shown in Figs. 15A through 15C and 16A through 16H.
[001241 Finally, as further evidence of the physiologic relevance of the metaKG, Figs. 17A
through 17C and. 18A through 18H demonstrate that when the heart rate is elevated (HR 103 bpm), the frequency components of the average intensity vs. time metaKG curves from different normal tissues are similar. This indicates that metaKG signal HR is the main frequency component, which again is consistent with the external EKG tracing obtained at the same time.
1001251 Accordingly, as discussed briefly above, using an. EKG signal to track time during the image acquisition is useful to link each specific blood flow and perfusion.
distribution to its cardiac phase. For any blood flow and perfusion imaging technology, this method can generate reliable instantaneous blood flow and perfusion distribution at any time of a cardiac cycle and average blood flow and perfusion distribution of several cardiac phases or cycles. Furthermore, this method allows the valid comparison of blood flow and perfusion distribution in different cardiac phases and in a pre and post treatment fashion. Thus, the link between EKG and image acquisition and subsequent instantaneous and average blood flow and perfusion measurement upgrades any current blood flow and perfusion imaging technology into a more practical, reliable, precise and clinically relevant methodology. in accordance with embodiments discussed herein, when an EKG signal is absent during the imaging process, a .metaKG signal (surrogate EKG signal) can be calculated from the average, intensity vs. time curve of a specific region of interest on the image sequence. As discussed above with respect to 'Figs. 2 through I 81-1, the metaKG signal yields reliable heart rateipulsatility information using frequency component analysis. When the blood vessel is occluded, the frequency component changes compared with the frequency component of the non-occluded control tissue indicating underlying physiological response.
1001261 Referring now to Figs. 19 and 20, a data processing system 200 that may be used in the system 100 illustrated in Fig. I in accordance with some embodiments of the inventive concept will be discussed. The data processing system 200 may be included in the metaKG
device 112, the camera 130 or split between various .elements of the system 100 without departing from the scope of the present inventivezoncept. As illustrated in Fig. 19, an .exemplary embodiment of a data processing system 200 suitable for use in the system 100 of Fig. I 'includes a user interface 244 such as a keyboard, keypad, touchpad or the like,. I/0 data ports 246 and a memory 236 that communicates with a processor 238. The 110 data ports 246 can be used to .transfer information between the data processing system 200 and another computer system or a network. These components may be conventional components, such as 7?
those used in many conventional data processing systems, which may be configured to operate as described herein.
[001.271 Referring now to Fig. 20, a more detailed block diagram of the data processing system 200 in accordance with some embodiments of the present inventive concept will be discussed. The processor 238 communicates with a display 345 via and address/data bus 347, the memory 236 via an address/data bus 348 and the I/O data ports 246 via, an.
address/date bus 349. The processor 238 can be any commercially available or custom microprocessor or ASICs.
The memory 236 is representative of the overall hierarchy of memory:devices containing the software and data used to implement the functionality of the data processing system 200. The memory 236 can include, but is not limited to, the following types of devices:
cache, ROM, PROM, EPROM, EEPROM, flash memory, SRAM, and DRAM.
[001281 As shown in Fig. 20, the memory 236 may include several categories of software and data used in the data processing system 200: an operating system 352;
application programs 354;
input/output (I/0) device drivers 358; and data 356. As will be appreciated by those of skill in the art, the operating system 352 may be any operating system suitable for use with a data processing system, such as Mac OSX, OS/2, AIX or zOS from International Business Machines Corporation, Armonk, NY, Windows95, Windows98, Windows2000, WindovvsXP, Windows .8, Windows 10 or Vista. from Microsoft Corporation, Redmond, WA, Unix., Linux, LabView, or a real-time operating system such as QNX or VxWorks, or the like. The liO device drivers 358 typically include sOftware routines accessed through the operating system 352 by the application programs 354 to communicate with devices such as the I/O data port(s) 246 and certain memory .236 components. The application programs 354 are illustrative of the programs that implement the various features of the data processing system 200 included a system in accordance with some embodiments of the present inventive concept and preferably include At least one application that supports operations according to some embodiments of the present inventive concept: Finally, the data 356 represents the static and dynamic data used by the application programs 354, the operating system 352, the I/O device drivers 358, and other software programs that may reside in the memory .236.
. [001291 As illustrated in Fig. 20, the data 356 according to some embodiments of the present inventive concept may include acquired images 360, image metadata 361, physiologic signal data 363, calculated blood flow/perfusion rates (velocity data) 364 and MetaKG
data 365.
Although the data 356 illustrated in Fig. 20 includes five different files 360, 361, 363, 364 and 365 embodiments of the present inventive concept are not limited to this configuration. Two or more files may be combined to make a single file; a single tile may be split into two or more files and the like without departing .from the scope of the present inventive concept.
[001301 As further illustrated in Fig. 20, the application programs 354 may include a metadata module 351, an image capture module 352, a MetaKG module 353 and velocity module 354 in accordance with some embodiments of the inventive concept. While the present inventive concept is illustrated, for example, with reference to the metadata module 351, the image capture module 352, the MetaKG module 353 and the velocity module 354 being application programs in Fig. 20õ as will be appreciated by those. of skill in the art, other configurations may also be utilized while still benefiting from the teachings of the present inventive concept. For example, the metadata module 351, the image capturemodule 352, the MetaKG module 353 and the velocity module 354 may also be incorporated into the operating system 352 or other such logical division of the data processing system 300. Thus, the present inventive concept should not be construed as limited to the configuration of Fig. 20, but is intended to encompass any configuration capable of carrying out the operations described herein.
[001311 Furthermore, while the metadata module 351, the image. capture module 352, the MetaKG module 353 and the velocity module 354 are illustrated in a single data processing system, as will be appreciated by those of skill in the art, such functionality may be distributed across one or more data processing systems. Thus, the present inventive concept should not be construed as limited to the configuration illustrated in Figs. 19 and 20, but may be provided by other arrangements and/or divisions of function between data processing systems.
[001321 As discussed above with respect to Fig. 1, at least one source 120 may illuminate a sample of tissue/organ and light may be reflected into a camera. The camera 130/image capture module 352 may receive the reflected light and provide it to the imaging processing device 110 to provide an image 360.. These images may be processed (metadata module 351) to provide metadata 361 associated therewith and an MetaKG signal 365 (surrogate EKG
signal) may be determined by the MetaKG module 353 using the Physiologic signal data 363 and the metadata 361 as discussed above. As also discussed above, this surrogate EKG signal (MetaKG signal) may be used to provide blood flow and perfusion data 364 by the velocity module 354. In particular, the data 356 may be used by the metaKG module 353 to provide blood flow and perfusion data synchronized with a surrogate EKG signal (inetaKG signal).
1001331 Operations in accordance with various embodiments of the inventive concept will now be discussed with respect to the flowcharts of Figs. 21 through 23.
Operations for calculating a MetaKG signal begin at block 2115 by illuminating a region of interest in a sample with At least one light source, for example, a near-infrared (NIR) light source and/or a visible light source. Images of the region of interest are acquired (2125). The acquired images are processed to obtain metadata associated with the acquired images (block 2135).
The MetaKG
signal is calculated from. the metadata associated with the acquired images (block 2145). In some embodiments, the MetaKG signal may be calculated or derived from one of raw (reflectance images) images and perfusion (analyzed) images (processed images). In some embodiments, the sample may be one of tissue and an organ.
1001341 In some embodiments, blood flow and perfusion data may be acquired using the calculated MetaKG signal (block 2155). Dotted lines indicating optional subject matter.
1001351 Referring now to Fig. 22, operations begin at block 2217 by generating the MetaKG
signal from acquired images by calculating average intensity versus time in the region of interest.
At least one of heart rate and pulsatility information may be calculated from the average intensity versus time in the region of interest by analyzing a frequency component of the average intensity versus time (block .2227). In some embodiments, heart rate variability (HRV) may be extracted from the heart rate calculated from the average intensity versus time in the region of interest. As used herein, the term "heart rate variability" refers to a measure of changes of the heart rate over time. This change may be large or small, and .over a small or large time-intenfal. Normally, the heart rate is not absolutely regular, and one can quantify the degree of changes of the heart rate over a certain period of time, for example, the heart beats faster and slower with respiration.
Some types of HRV are indicative, of abnormal physiological status, and/or diseases.
[001361 Abnormal and normal tissue may be differentiated based on a frequency component of the average intensity versus time (block 2237). A degree of abnormality related to an underlying physiological response may be indicated (block 2247).
[001371 Referring now .to Fig. 23, a configuration of the region of interest may be changed (block 2318). For example, one of the size and the location of the region of interest may be changed. A two dimensional heart rate map may be generated of a region of interest in a field of view (block 2328).
[00138] As discussed above, in some embodiments of the present inventive concept, a surrogate EKG (MetaKG) may be calculate4 using average intensity of the raw images.
However, in some embodiments, the MetaKG may be calculated using average intensity of speckle contrast images as will be discussed further below with respect to Figs. 24A through 29.
Embodiments of the present inventive concept illustrated in Fills. 24A through 29 discuss processing the images in the time domain,. frequency domain and the time-frequency domain as discussed below. Thus, Figs. 2A - 3B, .5, 7, 81), 9C, 10C, 11B, 12B, 121), 13B, 1413, 14D, 15B, 1613, 1613, 17B, 1813 and 181) illustrate MetaKG signals calculated from a raw image (reflectance image) in accordance with some embodiments of the present inventive concept.
Figs. 25,26 (frequency domain), 27 (time-frequency domain), 28A, 28B
(frequency domain) and Fig 29 (time-frequency domain) illustrate MetaKG calculated from perfusion images (LSI, =LDI
etc.) in accordance with some embodiments of the present inventive concept.
[001391 .Referring first to Figs. 24A and 24B, laser speckle imaging examples of a pig intestine will be discussed. Figs. 24A and 24B illustrate a raw NIR laser speckle image and a MR laser speckle contrast image, respectively. Figs. 24C and 241) illustrate a raw VL laser speckle image and a VL laser speckle contrast image, respectively, As illustrated, the difference between the raw laser speckle images (24A and 24C) and the laser speckle contrast images (2413 and 24D) is more apparent in the NIR images (24A and 2413) than it is in the VL images (24C
and 2413). This is indicative of the fact the NIR laser speckle contrast image (2413) provides better insights into blood flow and perfusion than the raw NIR laser speckle image (24A).
[00140] Referring now to Figs. 25A. and 25B, graphs illustrating time-domain (or spectral) analysis of MetaKG signals will be discussed. Fig. 25A illustrates an NIR-MetaKG (X) versus time and .Fig. 25B illustrates a VL-MetaKG (Y) versus time. The X lines on both plots represent the large amplitude slow trend of the MetaKG caused .by the respiratory activity related movement. Both NTR-MetaKG (W) and VL-MetaKG (Y) are contaminated by this noise to the same degree.
[00141] Referring now to Figs. 26A and 2613, graphs illustrating frequency-domain (or spectral) analysis of MetaKG signals will be discussed. Fig. 26A illustrates.
the Power Spectral Density (PSD) of NIR-MetaKCi versus frequency and Fig. 2613 illustrates the PSD of VL-MetaKG versus frequency, both graphs illustrating respiratory activity and cardiac activity in the frequency domain. Thus, PSD is a measure of strength of a given signal's specific frequency components.
[00142] Referring now to Figs. 27A and 27B, graphs illustrated frequency-time domain (or spectrogram) analysis of MetaKG signals will be discussed. Fig. 27A
illustrates a spectrogram of NIR-MetaKG and Fig. 27B illustrates a spectrogram of VL-MetaKGõ both including cardiac and respiratory activity. The spectrogram of MetaKG signals reveals the frequency-domain spectral contents of the signals over time. Both MetaKG signals are severely contaminated by the respiratory activity related noise. The spectrogram of the N1R-MetaKG
(27A) shows a slight sign of cardiac activity (labeled line), which is Much weaker than. the respiratory.ae.tivity related noise.
.f00143] Referring now to Figs. 28A and 2813, graphs illustrating residual MetaKG will be discussed. Fig. 28A illustrates residual-MetaKG versus time and Fig. 28B
illustrates residual-MetaKG versus frequency. By utilizing bothINI1R-MetaKG and VL-MetaKG, the residual-MetaKG can be extracted. The PSD of the residual-MetaKG (Fig. 2813) clearly shows that the signal's dominant component is related to the cardiac activity (about 9(1 bpm), not the respiratory activity.
[00144] Referring now to Fig. 29, a graph illustrating frequency-time domain (or spectrogram) analysis of the residual-MetaKG will be discussed. The spectrogram of the residual-MetaKG signal illustrates in Fig. 29 reveals that the signal is free .from the respiratory activity related noise. The instantaneous heart rate changing over time is marked thereon. By utilizing the residual-MetaKG, the slight changes in the heart rate over time can be tracked and heart rate variability (HRV ¨ defined above) can be computed.
[0014.5] Given the residual MetaKG, there are many ways to calculate HRV.
However, most of them are designed to calculate HRV over a long period of time,. for example, at least 5 minutes. MetaKG in accordance with embodiments discussed herein tends to be shorter than average (20s-1min), the difference between the maximum and minimum HR values may be obtained and may be used as a HRV index. An extended Kalman filter may be used to estimate the heart rate series of any given Meta-KG. Then, the HRV may be determined as the difference between the maximum and minimum heart rate values.
[001461 Referring now to Fig. 30, operations for a two wavelength embodiment in accordance with some embodiments will be discussed. As illustrated in Fig. 3.0, operations for removing movement-related .artifacts. from a MetaKG signal using dual wavelength light sources begins at block 3050 by illuminating a region of interest in a sample with a near-infrared (N1R) !kaki source and a visible light (VL) source. Two.sets of images of the region of interest are acquired, each corresponding to one of the NIR light source and the VI, source (block 3053). The two sets of images are processed to obtain NIR-metadata and VL-metadata (block 3055).
An NIR
MetaKG and a VL MetaKG are calculated from the NIR- metadata and the VL
metadata, respectively (block 3057). A movement-related common signal component is extracted from the NIR MetaKG and the VL MetaKG (block 3058). A noise-free MetaKG is calculated by cancelling out the movement-related common signal component from the NIR
MetaKG (block 3059).
[001471 As discussed above, embodiments of the present inventive concept that use multiple wavelengths to acquire multi-spectral images can remove noise due to motion artifacts caused by, for example, respiratory activity (Figs. 26-29). Single wavelength technologies may not be able to effectively remove such noise artifacts.
[001481 Referring. now to Figures 31A through 31G, a block diagram illustrating Hernodynamic Status Parameters (HSP) that may be derived from MetaKG in accordance with embodiments discussed herein will be discussed. As illustrated. in Figure 31, the 1-ISPs may include Heart Rate (HR), heart rate variability (HRV), R-to-R interval (RR!), and RRI Standard Deviation (RR1SD) as illustrated in Fig. 31C, systolic Blood Pressure threshold (SBO as illustrated in Fig. 310, and rate x pressure product (RPP), instantaneous perfusion in systole and diastole, frequency analysis and time-frequency analysis of the perfusion curve, and contractility index (slope of the pet-Fusion curve) as illustrated in Figs. 31A-31B and 31D-31F. In some embodiments, the MetaKG may be used to derive additional HSPs such as tissue oxygen content, hemoglobin content, temperature, and the like. The opportunity to capture these relevant hemodynamic parameters non-invasively from imaging is an innovation for clinical point-of-care monitoring technologies. Real-time integration with physiolOgic blood flow and perfusion data will further augment the accuracy and potential .diagnostic and therapeutic impact of these digital HSP data trended over time.
[001491 It will be understood that embodiments of the present inventive concept may be used in any format of clinical imaging, which includes both surgical imaging (usually an in-patient application) and other out-patient imagine procedure (non-surgical application) without departing from the scope of the present inventive concept.
[00150] Referring now to Figs, 32 through 35, methods for providing improved images of samples using embodiments of the present inventiveconeept discussed above with respect .10 Figs. I through 31G will be discussed. Using embodiments of the present inventive concept to calculate an accurate MetaKG signal for a region of interest, it has been determined that when all portions of the region of interest have a same or similar set of optical characteristics, for example, when the region of interest is an internal organ, the "background"
behind the organ or region of interest does not generally interfere significantly with the image and/or the resulting MetaKG signal. However, when the region of interest is provided on a background that has a different set of optical characteristics than the region of interest, forexample, when a hand is imaged on a table or dark background, this background may have different optical characteristics that could alter the image and/or resulting MetaKG signal. During clinical studies including field of views (FOlis) of both tissue with blood flow and background with no blood flow, it was determined that in environments where the background. has a.different set of optical characteristics than the region of interest in the field of view, a corrective factor may be calculated to provide a more accurate image and/or MetaKG
1001511 Although embodiments of the present inventive concept may be discussed herein with respect to imaging a hand on a dark background, where the hand has blood flow and the background does not, thus, having different optical characteristics, it will be understood that embodiments of the present inventive concept are not limited to this example.
Embodiments of the present inventive concept may be used in combination with any environment where the results may benefit from a correction factordue to different sets of optical characteristics. For example, during a surgical procedure towels or drapes may be positioned around the field of view to block out the areas around the tissues of interest in the field of view. Thus, the tissue in the field of view and the towels will not have the same set of optical characteristics. A similar line of reasoning may be applied when there is biologic, tissues of interest and non-biologic materials together in the field of view, [001521 As used herein, '4a set of optical characteristics" refers to the biologic versus non-biologic nature of the materials being illuminated in the field of view. The optical properties of a biological tissue are described in terms of the absorption coefficient, 1.,:a (cm-1), the scattering coefficient las (cm¨I), the scattering phase function p(0, j) where 0 (050.7c) is the polar angle of scatter and j (0..5..]<27c) is the azimuthal angle of scatter, and the refractive index of the tissue, it.
Optical scattering can be described either as scattering by particles that have a refractive index different from the surrounding medium, or as scattering by a medium with a continuous but fluctuating refractive index. These optical properties (absorption, scattering, anisotropy, reduced scattering, refractive index) vary between different biological, tissues, and between different biological tissues in the same field of view. Furthermore, these tissue optical characteristics will be different for the same tissue depending upon the illumination source, for example visible light versus NIR, or different wavelengths within the visible spectrum or the NIR
spectrum.
[00153] The biological optical characteristics differ from the optical characteristics of non-biologic materials, for example, background, towels or drapes, surgical instruments, foreign bodies, or other such inert materials, which are separately defined by the nature of the non-biologic materials themselves. For example, laser speckle contrast of biological material, such as tissue and laser speckle contrast of non-biologic materials such as background are differentiated through laser speckle imaging analysis.
[00154] Referring now to Fig. 32, is a block diagram illustrating a field of view 3242 including a sample 3240 positioned on a background 3241 will be discussed. The sample 3241 may be any sample to be imaged in a field of view. Th.e "background" may be any background 3241 that has a different set of optical characteristics than the sample to be imaged. As discussed above, when internal organs are being imaged, all tissue in the field of view may all have the same tissue structure and, .therefore, have the same or similar set of optical characteristics. The set of optical characteristics of the sample in the field of view effect the reaulting calculated MetaKG signal. In stark contrast, if the field of view includes a sample having a first set of optical Characteristics and a "background" having a second set of optical characteristics that are different than the first set of characteristics, the resulting MetaKG signal may be less accurate.
[001551 For example, Fig. 33 is a graph illustrating frames versus mean iKG.
The sample is a human palm positioned on a background. The graph illustrates the NIR iKG of the background (A) and the palm (B) and the visible (V IS) iKG of the background (C) and the palm (D). As illustrated, there is noise in the visible iKG of the palm (D) caused by movement in the background.
[001561 Accordingly, some embodiments of the present inventive concept provide a method for correcting a calculated MetaKG signal when the field of view includes a sample and a background having different sets of optical characteristics. For example, a MetaKG signal may be calculated for the field of view and a second MetaKG signal may be calculated for the background and then the background MetaKG signal may be subtracted out of or removed from the MetaKG signal of the field of view as will be discussed further below.
1001571 More specifically, in some embodiments a multi-spectral MetaKG signal may be calculated by calculating a residual MetaKG (Metall-GALL: (t)) as:
c*.m. Zfrilff bxist-t9A2 M etaKG ¨
Z.
x = Eqn. (I) or N-At vµv a x Pin.111 , b 4-=-1:211 %mg Y t) =
MetaNGAILiz(t) =
MXN Eqn. (2) wherein fmg.a:L(x,Y,t) is raw or speckle contrast images of a first wavelength; /Ingz. (x,.Y!t) is raw or speckle contrast images of a second wavelength; a, b and c are parameters for normalization; and M and N are a number of pixels along x and y axes, respectively.
1001581 Imp.' may be NIR and ImgA,2 may be visible (VIS) as illumination sources. The two (or more) wavelengths cross-contaminate in the standard metaKG analysis, mostly through translational motion of the tissues causing a false positive LSCI indication of flow and perfusion.
[001591 Furthermore, replacing Img),1 may be NIR and Irng-A2 in equations (I) and (2) with Img),..3 representing the background NIR, and Img;µ,4 representing the background VIS, respectively, may provide data with respect to the "background" in the Field of View. As discussed above, this background could be an opaque flat pad on which the hand is imaged, or the towel drapes placed to isolate the tissues of interest in the operating room. The characteristic of the "background" is that it is inert material with kilOWII optical properties, it should not be moving or exhibiting any translational motion, and that there should not be any BFD signal in this inert material. The background MetaKG-NIR and the background MetaKG-V1S, thus, represent additional 'corrective" factors that can be applied. Ideally, both the background signals (NIR and VIS) should be flat. However, in reality, they may not be.
Any actual BFD
signal obtained from the background is a false positive that could be used to further refine the analyses of actual BFD.
[001601 As discussed above, some embodiments of the present inventive concept use MetaKG
signals calculated for the background (NIR and V1S) to adjust the MetaKG for the region of interest. It will be understood that the MetaKG can be calculated using any number of methods without departing from the scope of the present inventive concept. For example, a MetaKG may be calculated using one wavelength or multiple wavelengths.
1001611 Referring first to Fig. 34, a flowchart illustrating methods using a single wavelength.
will be discussed. Operations for calculating a MetaKG signal for a region of interest in a sample using a single wavelength begin at block 3400 by illuminating a region of interest in a sample with a light source having a single wavelength. In the single wavelength in some embodiments is in. the NIR range. As discussed above, the region of interest has a sample portion 3240 (Fig. 32) having a first set of optical characteristics and a background portion (3241) having a second set of optical characteristics. Images of the region of interest are acquired (block 3410). The acquired images of the region of interest are processed to obtain metadata associated with the acquired images (block 3420). A MetaKG signal for the region of interest is calculated from the metadata associated with the acquired images (block 3430). A
background MetaKG signal is also calculated from the metadata associated with the background portion of the region of interest (block 3440). The calculated MetaKG signal for the region of interest is adjusted using the calculated background MetaKG to provide a final adjusted MetaKG
signal for the region of interest (block 3450). As discussed above, the MetaKG
signal can be adjusted in many ways using the background MetaKG signal. For example, the background MetaKG signal may be subtracted from the MetaKG signal for the region of interest.
1001621 Embodiments of the present inventive concept using more than one wavelength will now be discussed. with respect to. the flowchart of Fig. 35. As illustrated in Fig. 35, operations for calculating a MetaKG signal using multiple wavelengths begin at block 3500 by illuminating a region of interest in a sample with at least one multi-wavelength light source. As discussed above, the region. of interest includes a sample portion and a background portion. The multi-wavelength light source may be a near-infrared (NIR) light source and/or a visible light source and in some embodiments is both. Multi-spectral images of the region of interest are acquired using a multi-wavelength camera (block 3510). The acquired multi-spectral images are processed to obtain metadata associated with the acquired multi-spectral images (block 3520). A
background MetaKG signal is calculated for the background portion of the region of interest from the metadata associated with the acquired multi-spectral images (block 3530). A MetaKG
signal is calculated for the region of interest from the metadata associated with the acquired multi-spectral images (block 3540). The calculated MetaKG signal for the region of interest is adjusted using the calculated background MetaKG signal to provide a final adjusted MetaKG
signal (block 3550). Calculating the background MetaKG signal and the MetaKG
signal for the region of interest comprises calculating a multi-spectral MetaKG signal using multi-spectral signal processing to remove motion artifacts and improve signal quality using equations (1) and (2) above.
[001631 In particular, in some embodiments, calculating the background MetaKG
signal includes first calculating a background MetaKG signal for both near-infrared (NIR) and visible wavelengths to provide a background MetaKG signal NIR and a background MetaKG
signal visible. The background MetaKG signal NIR may be adjusted using the background MetaKG
signal visible if necessary. Then,. the MetaKG signal for the region of interest may be calculated by calculating a MetaKG signal for the region of interest for visible wavelengths to provide a MetaKG signal visible for the region of interest. The calculated the MetaKG
signal visible for the region of interest may be reserved for any motion artifact present therein. A window of frames may be selected for NIR analysis tbr the region of interest. A .MetaKG
signal for the region of interest for NIR wavelengths may be calculated to provide a MetaKG
signal NIR for the region of interest using the selected window. Finally, the MetaKG signal visible for the region of interest may be normalized using the background MetaKG signal visible to provide the final adjusted MetaKG signal for the region of interest. This process may optimize the MetaKG
MR flow an perfusion pathway for the region of interest.
[001641 It will be understood that embodiments of the present inventive concept are not limited to these examples. For example, the steps in the method may be performed in a different order without departing fiom the scope of the present inventive concept.
Additional steps may also be added or steps may be removed.
[001651 For example, in some embodiments, the visible MetaKG may be used to identify translational motion from the MetaKG-VIS as a first step. Then, a section of the MetaKG-VIS
that is stable and flat, i.e. has no translational motion, may he used to identify where the RAW
frames are located where the MetaKG-NIR can be analyzed, thus, translational movement may be reduces in the analysis. There also may be other possible signals in the VIS wavelength that may improve the MetaKG-NIR analyses beyond just mathematical processes.
[001661 Furthermore, in some embodiments the background data May be process prior to .MetaKG or residual metaKG analysis. The background metaKG-VIS may be used to confirm absence of motion artifact. Background metaKG-VIS and background metal(G-NIR
may be compared and this comparison may be used to assess false positivity in background MetaKG-NIR. This may be used to 'correct' the MetaKG-NIR or residual MetaKG-NIR. The background-NIR may be matched to background-VIS to provide an optimal window for selection for analysis. The corrected background-NIR may be used to normalize the MetaKG-NIR or residual MetaKG-NIR analysis, as "true baseline of zero perfusion" for that imaging encounter. This approach may be used to 'normalize' MetaKG or residual MetaKG
to a standard baseline value, within subjects and also across subjects 1001671 As briefly discussed above, embodiments of the present inventive concept discussed with respect Figs. 32 through 35 utilize the concepts discussed in prior portions of the application to further refine the final MetaKG. Thus, embodiments of the present 'inventive concept may provide more accurate results.
[00168] Example embodiments are described above with reference to block diagrams and/or flowchart illustrations of methods, devices, systems and/or computer program products. It is understood that a block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer special purpose computer, and/or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer and/or other programmable data processing apparatus, create means (functionality) and/or structure for implementing the functions/acts specified in the block, diagrams and/or flowchart block or blocks.
1001691 These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory =
produce an article of manufacture including instructions which implement the functions/acts specified in the block diagrams and/or flowchart block or blocks.
[00170j The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks.
1001711 Accordingly, example embodiments may be implemented in hardware and/or in software (including firmware, resident software, micro-code, etc.).
Furthermore, example embodiments may take the form of a computer program product on a computer-usable or computer-readable storage medium having computer-usable or computer-readable program code embodied in the medium for use by or in connection with an instruction execution system. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
1001721 The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, and a portable compact disc read-only memory (CD-ROM). Note that the computer-usable or computer-readable medium. could even be paper or another suitable medium upon which the program is printed, as the program can be electronically .captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
1001731 Computer program code for carrying out operations of data processing systems discussed herein may be written in .a high-level programming language, such as Java, AJAX
(Asynchronous JavaScript), C, and/or C++, for development convenience. In addition, computer program code for carrying out operations of example embodiments may also be written in other programming languages, such as, but not limited to, interpreted languages.
Some modules or routines may be written in assembly language or even micro-code to enhance performance and/or memory usage. However, embodiments are not limited to a particular programming language. It will be further appreciated that the functionality of any or all of the program modules may also be implemented using discrete hardware components, one or more application specific integrated circuits (ASICs), or a field programmable gate array (FPG.A), or a programmed digital signal processor, a programmed logic controller (PLC), or microcontroller.
1001741 it should also be noted that in some alternate implementations, the functions/acts noted in the blocks may occur out of the .order noted in the flowcharts. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
Moreover, the functionality of a given block of the flowcharts and/or block diagrams may be separated into multiple blocks and/or the functionality of two or more blocks of the flowcharts and/or block diagrams may be at least partially integrated.
[001751 In the drawings and specification, there have been disclosed example embodiments of the inventive concept. Although specific terms are employed, they are used in a generic and descriptive sense only and not for purposes of limitation, the scope of the inventive concept being defined by the following claims.
.36
magnitude and distribution of fluid velocity, such as Laser Doppler Imaging (LDI) and Laser Speckle Imaging (LSI). Fluid velocity is linear flow demonstrating the direction and magnitude of flow, but does not directly quantify .flow in either the rnicrovascular or macrovascttlar levels.
To be linked with the more clinically intuitive concepts and terms of blood .flow and perfusion, further assumptions or analysis may be required. Indeed, combined with proper fluid dynamic modeling, these imaging techniques of fluid. velocity measurement have the potential to derive quantification information of blood flow and perfusion, in both experimental and.human clinical conditions. Throughout this document, the terms "blood flow" and "perfusion"
are used instead of the more technically oriented term "fluid velocity."
[00051 Blood flow is not a constant in the cardiovascular system in mammalian species.
Experimental and clinical data document that there are blood velocity changes within one cardiac cycle because the cardiac Output and aortic pressure are not constant. within one cardiac cycle.
Using the blood flow in coronary arteries as an. example, in the systolic phase of the cycle the coronary blood flow is low or even stops due to the contraction of the ventricular myocardium.
However, in the diastolic phase the blood flow is comparatively high and reaches a maximum level. Based on specific anatomic and physiologic characteristics, the blood flow and perfusion in other tissues and Organs may vary as well influenced by the cardiac cycle, but these different organ systems also have specific conditions of blood flow and perfusion seemingly unrelated to the cardiac cycle. Current techniques to assess blood flow and perfusion cannot make this differentiation in these tissues and organ. systems and, therefore, improved techniques may be desired.
SUMMARY
100061 Some embodiments of the present inventive concept provide methods for calculating a MetaKG signal. The method includes illuminating a region of interest in a sample with at least one light source, wherein the light source is a near-infrared. (NIR) light source and/or a visible light source; acquiring images of the region of interest; processing the acquired images to obtain metadata associated with the acquired images; and calculating the MetaKG
signal from the metaclata associated with the acquired images.
[00071 In further embodiments, the MetaKG signal may be derived from raw images or from perfusion images.
[00081 In still further embodiments, the method may furtherinclude acquiring blood flow and perfusion data using the calculated MetaKG signal. Calculating the MetaKG
signal may further include generating the MetaKG signal from the acquired images by processing the acquired images to obtain contrast images and calculating average contrast intensity of the contrast images versus time in the region of interest. The method may further include calculating at least one of heart rate and pulsatility information from the average intensity versus time in the region of interest by analyzing a frequency component of the average intensity versus time. The method may further include differentiating between abnormal and normal tissue based on frequency component of the average intensity versus time; and indicating a degree of abnormality related to an underlying physiological response.
100091 In some embodiments, the method may further include extracting heart rate variability (HRV) information from the heart rate calculated from the average contrast intensity versus time in the region of interest.
[00101 In further embodiments, the method may further include changing configuration of the region of interest; and generating .a two dimensional heart rate map of a region of interest in a field of view. Changing the configuration of the region of interest may include changing at least one of the size and the location of the region of interest.
[00111 In still further embodiments, the sample may be one of tissue and an organ.
[0012] In some embodiments, calculating the MetaKG signal may include calculating the MetaKG signal using average intensity of speckle contrast images.
[00131 In Father embodiments, at least one Hemodynarnic Status Parameter (I-ISP) may be determined including Heart Rate (HR); heart rate variability (I-IRV); R-to-R
interval (RRI); RRI
Standard Deviation (RRISD); systolic Blood Pressure threshold (SBt); rate x pressure product (RPP); instantaneous perfusion in systole and diastole; frequency analysis and time-frequency analysis of a perfusion curve; and contractility index including slope of the perfusion curve based on the calculated MetaKG.
[00141 In still further embodiments, at least one Hemodynamic Status Parameter may be determined including tissue oxygen content, hemoglobin content, and temperature based on the calculated MetaK0 [00151 Some embodiments of the present inventive concept provide computer systems for calculating a MetaKG signal.. The systems include a processor; and a memory coupled to the processor and comprising computer readable program code that when executed by the processor causes the processor to perform operations including illuminating a region of interest in a sample with, at least one light source, wherein the light source is a near-infrared (NIR) light source and/or a visible light source; acquiring images of the region of interest;
processing the acquired images to obtain metadata associated with the acquired images; and calculating the MetaKG
signal from the metadata associated with the acquired images.
[00161 Further embodiments of the present inventive concept provide computer program products for calculating a MetaKG signal. The computer program products including a non-transitory computer readable storage medium having computer readable program code embodied in the medium, the computer readable program code including computer readable program code to illuminate a region of interest in a sample with at least One light source, wherein the light source is a near-infrared (NIR) light source and/or a visible light source.;
computer readable program code to acquire images of the region of interest; computer readable program .code to process the acquired images to obtain metadata associated with the acquired images; and computer readable program code to calculate the MetaKG signal from the metadata associated With the acquired images.
[0017) Still further embodiments of the present inventive concept provide methods of removing movement-related artifacts from a MetaKG signal using dual wavelength light sources.
The methods include illuminating a region of interest in a sample with a near-infrared (NIR) light source and a visible light (VL) source; acquiring two sets of images of the region of interest each corresponding to one of the NIR light source and the VL source;
processing the two sets of images to obtain NIR-metadata and VL-metadata; calculating a MR MetaKG and aVL
MetaKG
from the NIR- metadata and the VL metadata, respectively; extracting a movement-related common signal component from the NIR MetaKG and the VL MetaKG; and calculating a noise-free MetaKG by cancelling out the movement-related common signal component from the MR
MetaKG.
100181 In some embodiments, calculating the noise-free MetaK0 may include removing noise due to a motion artifact, where the noise due to the motion artifact includes respiratory activity.
[00191 Further embodiments of the present inventive concept provide a method for calculating a MetaKG signal. The method includes illuminating a region of interest in a sample with at least one multi-;wavelength light source. The region of interest includes a sample portion and a background portion and the multi-wavelength light source is a near-infrared (NIR) light source and/or a visible light source. Multi-spectral images of the region of interest are acquired using a multi-wavelength camera. The acquired multi-spectral images are processed to obtain metadata associated with the acquired multi-spectral images. A background MetaKG signal is calculated for the background portion of the .region of interest from the metadata associated with the acquired multi-spectral images. A MetaKG signal for the region of interest is Calculated from the metadata associated with the acquired multi-spectral images. The calculated MetaKG
signal for the region of interest is adjusted using the calculated background MetaKG signal to provide a final adjusted MetaKG signal. Calculating the background MetaKG
signal and the MetaKG signal for the region of interest includes calculating a multi-spectral MetaKG signal using multi-spectral signal processing to remove motion artifacts and improve signal quality.
Calculating the multi-spectral MetaKG signal comprises calculating a residual MetaKG
(Meta/W(112.2.W) as:
= aXinv21(.2474¨bXIT.T34s.2z (x=Ypr, +c Al eta K ta:,. (t) == ***
or et x ________________________________________ Y¨ = x = Img:4,(x,Y, MetafcGliz(t) ki X IV
wherein tIngAi (x,Y, .c.) is raw or speckle contrast images of a first wavelength.
Im922 (x,Y, t) is raw or speckle contrast images of a second wavelength; a, b and c are parameters for normalization; and M and N are a number of pixels along x and y axes, respectively.
[00201 Still further embodiments of the present inventiN.,e.concept provide a method for calculating a MetaKG signal for a region of interest in a sample. The .method includes illuminating a region of interest in a sample with a light source having a single wavelength. The region of interest has a sample portion having a first set of optical characteristics and a background portion having a second set of optical characteristics. Images of the region of interest are acquired. The acquired images of the region of interest are processed to obtain metadata associated with the acquired images. A MetaKG signal for the region of interest from the metadata associated with the acquired images is calculated. A background MetaKG signal from the metadata associated with the background portion of the region of interest is calculated.
The calculated MetaKG signal for the region of interest is adjusted using the calculated background MetaKG to provide a final adjusted MetaKG signal for the region of interest.
BRIEF DESCRIPTION OF THE DRAWINGS
100211 Fig. I is a block diagram of a system in accordance with. some embodiments of the present inventive concept(s).
[0022] Figs. 2A through 2C are graphs illustrating average intensity vs.
time in a multi-wavelength imaging technology in accordance with some embodiments of the present inventive concept [00231 Figs. 3Athrough 3C are graphs illustrating average intensity vs.
time in a multi-wavelength imaging technology having respiration contamination removed in accordance with some embodiments of the present inventive concept.
[0024] Figs. 4A through 4C are a series of Laser Speckle images of the heart.
[0025] Fig. 5 is a graph illustrating average intensity v. time representing the metaKG signal in accordance with embodiments of the present inventive concept.
[0026] Figs. 6A-C is a series .of Laser Speckle images of the heart during a systolic phase.
[0027] Fig. 7 is. a graph illustrating average intensity v. time representing the metaKG signal in accordance with embodiments of the present inventive concept.
10028] Figs. 8A-C is a series of Laser Speckle images of the heart during diastolic phase.
10029] Fig. 8D is a graph illustrating average intensity v. time representing the metaKG
signal in accordance with embodiments of the present inventive concept.
[0030] Fig. 9A is an image illustrating one frame of raw image data sequence in diastolic phase.
[0031] Fig. 9B is an image illustrating one frame of raw image data sequence in systolic phase.
[0032] Fig. 9C is a graph of average intensity vs. time curve as the metaKG
signal in accordance with some embodiments of the present inventive concept.
[0033] Fig. 10A is an image illustrating one. frame from raw image data sequence.
[0034] Fig. 1.0B .is an image illustrating the blood velocity distribution in the fingers.
[0035] Fig. 10C is a graph of average intensity vs. time curve as the metaKG
signal in accordance with some embodiments of the present inventive concept.
[0036] Fig. I1A is an image illustrating LSI-analyzed velocity map of perfusion to two fingers of left hand and two fingers of right hand..
[0037] Fig. 118 is a graph Illustrating average intensity vs. time curve of 12 seconds (60 fps) image sequence of two fingers of left hand and two fingers of right hand (aggregate from. all four fingers) of Fig. 1.1A.
[0038] Fig. 11C is a graph illustrating standard EKG and peripheral oxygen saturation pulsatility data acquired simultaneous with the image sequence in accordance.
with embodiments of the present inventive concept.
[0039] Figs. I2A and. 1.2B illustrate the two left:fingers of Fig. 11A and the associated average intensity vs. time curve of the two left fingers.
[0040] Figs. I2C and 121) illustrate the two right fingers of Fig. 11A and the associated average intensity vs. time curve of the two right fingers.
[00411 Figs. 12E through 12H are graphs illustrating frequency domain analyses of the average intensity -vs. time curves for both the left (E and F) and right (G
and H) fingers, [0042] Figs 13A is an image illustrating LSI-analyzed velocity map of perfusion to two fingers of left- hand and two .fingers of right hand.
[00431 Fig. I3B is a graph illustrating average intensity vs. time curve of 12 seconds (60 fps) image sequence of two fingers of left hand and two fingers of right hand (aggregate from all four fingers) of Fig. 11A.
[00441 Fig. 13C is a graph illustrating standard EKG and peripheral oxygen saturation pulsatility dataacquired simultaneous with the image sequence in accordance with embodiments of the present inventive concept.
[00451 Figs. 14A and 14B illustrate the two left fingers and the associated average intensity vs. time curve of the two left fingers.
100461 Figs. 14C and 14D illustrate the two right fingers: and the associated average intensity vs, time curve of the two right fingers.
P90471 Fig. 14E through 1411 are graphs illustrating frequency domain analyses of the average intensity vs. time curves for both the left (E and -F) and right (G
and.11) fingers.
100481 Fig. 15A is an image illustrating LSI-analyzed velocity map of perfusion to two fingers of left hand and two fingers of right hand.
[0049] Fig. 15B it a graph illustrating average intensity vs. time curve of 12. seconds (60 fps) image sequenee.of two fingers of left hand and two fingers of right hand (aggregate from all four fingers).
[0050] Fig. 15C is a graph illustrating standard EKG and peripheral oxygen saturation pulsatility data acquired simultaneous with the image sequence in acpordance with embodiments of the present inventive concept.
[00511 Figs. 16A and 168 illustrate the two left fingers and. the associated average intensity vs. time curve of the two left fingers.
100521 Figs. 16C and 16D illustrate the two right fingers and the associated average intensity vs. time curve of the two right fingers.
100531 Figs. 16E through 161i are graphs illustrating frequency domain analyses of the average intensity vs. time curves for both the left (E and F.) and right (G
and H) fingers.
[00541 Fig. 1 7A is an image illustrating LSI-analyzed velocity map of perfusion to two fingers of left hand and two fingers of right hand.
100551 Fig. 178 is a graph illustrating average intensity vs. time curve of 12 seconds (60 fps) image sequence of two fingers of left hand and two fingers.of right hand (aggregate from all four fingers).
100501 Fig. 17C is a graph illustrating standard EKG and peripheral oxygen saturation pulsatility, .data acquired simultaneous with the image sequence in accordance with embodiments of the present inventive concept.
100571 Figs. 18A and 18B illustrate the two left fingers and the associated average intensity vs. time curve of the two left fingers.
[00581 Figs. 1.8C and I8D illustrate the two right. fingers and the associated average intensity vs. time curve of the two right fingers.
100591 Figs.18E through 1811 are graphs illustrating frequency domain analyses of the average intensity vs. time curves for both the left (E and F.) and right (G
and ID fingers.
100601 Fig. 19 is a block diagram of a data processing system according to embodiments of the present inventive concept(s).
100611 Fig. 20 is .a more detailed block diagram of the data processing system illustrated in Fig. 19 in accordance with some embodiments of the present inventive concept(s).
100621 Figs. 21, through 23 are -flowcharts illustrating operations for combining images in accordance with various embodiments of the present inventive concept(s).
[00631 Figs. 24A through 24D illustrate laser speckle imaging of a pig intestine in accordance with some embodiments of the present inventive concept.
[0064] Figs. 25A and 2513 are graphs illustrating time-domain (or spectral) analysis of MetaKG signals in accordance with some embodiments of the present inventive concept.
100651 Figs. 26A and 26B are graphs illustrating frequency-domain (or spectral) analysis of MetaKG signals in accordance with some embodiments of the present inventive concept.
100661 Figs. 27A and 27B are graphs illustrating Frequency-time domain (or spectrogram) analysis of MetaKG signals in accordance with some embodiments of the present inventive concept.
100671 Figs. 28A and 28B are graphs instating residual MetaKG versus time/frequency in accordance with some embodiments of the present inventive concept.
100681 Fig. 29 is a graph illustrating frequency-time domain (or spectrogram) analysis of residual-MetaKG signals in accordance with some embodiments of the present inventive concept.
100691 Fig. 30 is a flow chart illustrating operations according to some embodiments of the present inventive concept.
100701 Figs. 31A through 31G are images and graphs illustrating various physiologic status parameters that may be determined from a MetaKG in accordance with some embodiments of the present inventive concept.
100711 Fig. 32 is a block diagram illustrating a field of view having a sample on a background having a different set of optical characteristics in accordance with some embodiments of the present inventive concept.
100721 Fig. 33 is a graph of frames versus mean iKG illustrating noise in the visible MetaK.G
in a palm caused by movement in the background in accordance with some embodiments of the present inventive concept.
100731 Fig. 34 is a flowchart illustrating methods using a single wavelength in accordance with some embodiments of the present inventive concept.
100741 Fig. 35 is a flowchart illustrating methods using multiple wavelengths in accordance with some embodiments of the present inventive concept.
DETAILED DESCRIPTION OF SOME EMBODIMENTS
100751 Specific example embodiments of the inventive concept now will be described with reference to the accompanying drawings. This inventive concept may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein;
rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the inventive concept to those skilled in the art. In the drawings, like numbers refer to like elements. It will be understood that when an. element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. As used herein the term "and/or" includes any and all combinations of one or more of the associated listed items.
100761 The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the inventive concept. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless expressly stated otherwise. It will be further understood that the terms "includes,"
"comprises," "including"
and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
Unless otherwise defined, all terms (including technical and scientific temis) used herein have the same meaning as commonly understood by .one of ordinary skill in the art to which this inventive concept belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in thecontext of the specification and the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
100781 Throughout the present application the more clinically intuitive terms "blood flow"
and "perfusion" will be used to discuss aspects of the present inventive concept are used instead of the more technically oriented term. "fluid velocity." However, it will be understood that these tetras may be used interchangeably.
100791 As discussed above, currently there is no method or system for direct measurement and quantification of blood flow and perfusion in real time. Accordingly, embodiments of the present inventive concept relate generally to using image metadata as a physiologically-relevant signal for any blood velocity imaging technology and analysis of that imaging technology product. As used herein, "metadata" refers to data that describes another form of data.. For example, an image, as discussed herein, may include metadata that describes how large the picture is, the color depth, the image resolution, when the image was created, and other data. A
text document's metadata may contain information about bow long the document is, who the author is, When the document was written, and a short summary of the document.
Embodiments of the present inventive concept are directed to abstracting a surrogate "metaKG" signal from any blood velocity imaging technology and analysis of that imaging technology product, by calculating an average intensity vs. time curve within a region of interest (ROI) as will be discussed further herein.
[00801 Embodiments of the present inventive concept may he applied to imaging technology, using one or more appropriate wavelengths to collect digital image data for use in a medical experimental or clinical context. The imaging may be used for simple visualization or for more complex qualitative physiologic evaluation or even more complex quantitative physiologic evaluation without departing. from the scope of the present inventive concept.
p0811 Due to its physiologic dependence on the cardiac cycle, blood flow and perfusion measurement over time does not provide meaningful information without a specific indication of the cardiac phase. In cardiac computerized tomography (CT) and magnetic resonance imaging (MRI) scanning, use of the standard external electrocardiogram (EKG) to gait signal acquisition and to track time during the image acquisition gives the advantage of linking each specific blood flow and perfusion distribution to its cardiac phase.
100821 Embodiments of the present inventive concept provide methods for generating reliable instantaneous blood flow and perfusion distribution .at any time of a cardiac cycle and average blood flow and perfusion distribution of several cardiac phases or cycles. Furthermore, embodiments of the present inventive concept may allow a valid comparison of blood flow and perfusion distribution in different cardiac phases and in a pre- and post-treatment fashion.
[09831 In particular, in accordance with embodiments discussed herein, when an external EKG signal is absent during the imaging process, a "surrogate EKG signal"
(interchangeably referred to hereinafter as a "metaKG" signal or a "MetaKG" signal) can be calculated from the metadata contained within the image/image sequence. For example, from, the average intensity vs. time curve of a specific ROI on the image sequence, using frequency component analysis, a "metaKG" signal can be calculated and may yield the same heart rate/pulsatility as an external EKG signal. The "metaKG" signal may also reflect dynamic physiology; for example, when the blood vessel is occluded, the frequency component changes compared with the frequency component of the non-occluded control state.
[00841 By using each pixel as a field of view (FOV), a two dimensional (2D) rate map can be generated using the above concept and abnormal tissue can be identified by examining the frequency component of each specific region.
100851 Although discussed herein with respect to cardiac tissue, the "metaKG"
signal calculated in accordance with embodiments of the present inventive concept is not limited to cardiac tissue, It may be calculated and used in all tissue/organ systems where blood flow and perfusion can be imaged and measured,. including skin.
[0086] Thus, the metaKG signal in accordance with embodiments of the present inventive concept is a multi-channel physiological signal that can be derived from the NI.R image data sequence. The number of channels can be up to the pixel number of the Na image.. As discussed above, this physiological signal can not only be used as a surrogate EKG signal, but also contains other information about the physiological condition of the monitored tissue/organ.
[00871 As discussed above, in accordance with some embodiments, average intensity within a region of interest (ROD/multiple ROIs on the NIR image data sequence may be calculated at each time point. After a series of signal processing, such as noise removal, baseline correction and other modification, the average intensity vs. time curve at each ROI/multi R.Ors is analyzed in time, frequency and time-frequency domain to monitor the physiological condition of a tissue/organ.
[00881 Thus, embodiments of the present inventive concept provide a completely non-contact, non-invasive tissue/organ physiological condition monitoring technology that can be used in real time. The monitoring region and number of channels are much less limited than traditional monitoring technology, such as EKG. This technology captures and analyzes much more information than the current products that count heart beat and pulsatility using visible light as will be discussed further herein with respect to Figs, 1 through .31.
100891 Referring now to Fig. I, a system for calculating a Meta.KG signal in accordance with some embodiments of the present inventive concept will be discussed. It will be understood that some systems in accordance with embodiments of the present inventive concept may be non-invasive. As used herein, "non-invasive" refers to a system or method that does not require the subject to be injected with a dye, penetrated with an object or touched with an intrabodyprobe or probes. Thus, as used herein, the term non-invasive refers to a system or method that makes no direct contact with the subject. As used herein, "subject" refers to the person or thing being imaged. The subject can be any subject, including a veterinary, cadaver study or human subject.
As used herein, "perfusion" refers to blood flow at the tissue perfusion distribution level detected with speckle imaging.
[0090I As illustrated in Fig. 1, the system 100 includes at least one light source 120, a camera 130, an image processing device 110 and a metaKG device 112. Although the system of Fig. 1 is depicted as only including these elements, it will be understood that other elements may also be present in the system without departing from the scope of the present inventive concept.
In particular, in some embodiments of the present inventive concept, multiple light sources 120 may be used. In these embodiments, the first light source may be a NIR light source and the second light source may be a visible light (VL) light source. Although embodiments of the present inventive concept are discussed herein as having one or two light sources, it will be understood that more than two light sources may also be used without departing from the scope of the present inventive concept.
[00911 In these embodiments, the NIR light source may have a wavelength of from about 780nrn to about 2500nm and the visible light source has a wavelength of from about 400nm to about 780nm. Thus, some embodiments of the present inventive concept provide a system that uses two wavelengths of differential transmittance through a sample to apply LSI and/or LDI.
For example, a first of the two wavelengths may be within the visible ranee that has zero or very shallow penetration, such as blue light 450-495 am. This wavelength captures the anatomical structure of tissue/organ surface and 'serves.as a position marker of the sample but not the subsurface movement of blood flow and perfusion. A second wavelength may be in the near Infra-Red (NIR) range, which has much deeper penetration. This wavelength reveals the underlying blood flow physiology and correlates both to the motion of the sample and also the movement of blood flow and perfusion. Using the imaging measurement of the visible light as a baseline, the true motion of blood flow and perfusion can be derived from the NIR imaging measurement without being affected by the motion artifact of the target.
Furthermore, the anatomical structure information captured by visible light and the physiological characteristics measured by NIR light are combined. Details with respect to systems using two wavelengths are discussed in detail in U.S. Provisional Application No. 62/136,010, flied arch 20, 2015, the disclosure of which was incorporated herein by reference above. Although embodiments are discussed herein with respect to NIR raw images and visible light images, embodiments of the present inventive concept are not limited to this configuration. Any other image form that can adequately represent anatomy can. be used without departing from the scope of the present inventive concept.
100921 Referring again to Fig. 1, in some embodiments, the at least one light source unit 120 may be, for example, one or more lasers or light emitting diode (LED) lights.
The at least one light source 120 may be used to illuminate a region of interest 140 (hereinafter "tissue/organ").
If the light source 120 is an NIR light source, it may have a wavelength, of from about 780nm to about 2500 ran. As used herein, the "region of interest" refers to the region of the subject that is being imaged, for example, the principal vessels and tissue, organs, etc. When light (incident light 127) from the at least one source 120 is directed to a living target.
(region of interest 140), such as a tissue/organ, part of the light will go through multiple scattering inside the target and eventually reflect back (Reflecting light) to the camera 130 as shown in 'Fig.
I.
100931 The camera 130 is configured to collect the reflecting light and provide a visible light or MR image (NIR Layer 115), each with different characteristics depending, for example, upon a.depth of penetration of the illumination light determined by the wavelength energy. Thus, laser illumination 120 and image capture 130 may be processed 110 with near-infrared (NIR) technology and results in a video image sequence or sequences 115 for subsequent analysis.
Details with respect to the NIR technology is. discussed in commonly assigned International Application No. PCTIUS2015/055251, entitled Methods, Systems and Computer Program Products for Visualizing Anatomical Structures, Blood Flow and Perfusion Using Near-Infrared Imaging (Attorney Docket No. 5218-228W0), tiled on October 13, 2015, the contents of which.
are hereby incorporated herein by reference as if set forth in its entirety.
[00941 Contained within this image sequence or sequences 115 is metadata 118 associated with each image sequence or sequences. The metaKG device 112 according to embodiments of the present inventive concept processes the metadata 118 associated with the image sequences and provides a "metaKG signal" 117, which directly finks to underlying fundamental physiologic and/or pathophysio logic processes 121 being imaged. In accordance with embodiments discussed herein, the metaKG signals can optimize the image acquisition and may be integral to optimizing analysis of blood flow and perfusion 131. Since the metaKG signal 117 is imbedded in the metadata 118 of the non-invasively acquired image sequence without direct tissue contact, embodiments of the inventive concept of the metaKG enables this new image approach to be directly linked to the physiologic and pathophysiologic 121 parameters and characteristics without the requirement for traditional external EKG signals. Thus, a sample 140, for example, tissue or organ, with blood flow and perfusion may be examined for measurement and quantification of blood flow and perfusion 131 using non-invasive imaging, with no need for an EKG.
[00951 As discussed above, in a multi-wavelength embodiment, the region of interest 140 is illuminated with two different light sources, for example, NIR and VL, and two sets of images are acquired and processed to obtain two different types of metadata, for example, NIR-metadata and VL-metadata. A.ccordingly, the calculations discussed herein with respect to metadata related to a single wavelength may be performed for multiple wavelength data.
For example, the NIR MetaKG and the VL MetaKG may be calculated from the .metadata,a movement-related common signal component may be extracted from the NIR MetaKG and the VL
MetaKG; and a noise-free MetaKG may be calculated by cancelling out the movement-related common signal component from the NIR MetaKG as will be discussed further below with respect to a...single wavelength. In other words, using two wavelengths in accordance with some embodiments discussed herein may improve the signal to noise ratio (SNR) of the image by combining the penetrating capability of the NIR wavelengths and the advantages of the VL
wavelengths, i.e. the superficial surface noise of the VL may be cancelled out.
100961 Referring now to Figs. 2A through 2C, graphs illustrating average intensity vs. time using .a multi-wavelength imaging technology to document the presence of the metaKG signal will be discussed. Fig. 2A illustrates the 20 seconds metaKG using near infra-red wavelength illumination; Fig. 28 illustrates the 20 seconds metaKG using near visible wavelength illumination; and Fig. 2C illustrates the 20 seconds EKG signals. As illustrated therein, the metaK0 is fluctuating at heart rate frequency (90 peaks per minute) and also at respiration frequency (one larger peak every 4--5 seconds). Figs. 2A through 2C also illustrate that the metaKG generated. by near infra-red illumination has less noise than the one generated by visible wavelength illumination.
100971 Referring now to Figs. 3A through 3C, graphs illustrating average intensity vs. time using a multi-wavelength imagine technology to document the presence of the metaKG signal with respiration contamination removed will be discussed. Fig. 3A illustrates the 20 seconds metaKG without respiration contamination using near infra-red wavelength 'illumination; Fig. .3B
illustrates the 20 seconds metaKG without respiration contamination using near visible wavelength illumination; and Fig. 3C illustrates the 20 seconds EKG signals.
As illustrated in Figs. :3A through 3C, the metaKG is only fluctuating at heart rate frequency .(90 peaks per minute). As further illustrated, the metaKG generated by near infra-red illumination has less noise than the. one generated by visible wavelength illumination.
[00981 Thus, it will be understood that although many embodiments of the present inventive concept are discussed herein with respect to a single light source having a particular wavelength, embodiments of the present inventive concept are not limited to this configuration.
[00991 Figs. 4A through 4C are images illustrating asingle.frame in the raw image data sequence (4A); inversed spatial contrast image (4B) and an inversed temporal contrast image (4C). The graph of Fig. 5 illustrates average intensity vs. time during the image acquisition period of time as the metaKG signal (end-diastolic phase in a.specific cardiac cycle is labeled).
Thus, Figs. 4A through 4C and 5 illustrate instantaneous blood velocity distribution of anterior wall of a heart using Laser Speckle Imaging (LSI) at the end-diastolic phase of the cardiac cycle (determined visually).
[00100] Figs. 6A through 6C illustrate 4 single frame in the raw image data sequence (6A); an inversed spatial contrast image (613); and an inversed temporal contrast image (6C). Fla. 7 illustrates an average intensity vs. time curve during the image acquisition period of time as the metaKG signal (end-diastolic phase in nine (9)cardiac cycles are used). Thus.
Figs. 6A through 6C and 7 illustrate average blood velocity distribution of anterior wall of aheart using Laser Speckle Imaging at the end-diastolic phase of the cardiac cycle.
[001011 Figs. 8A through 8C illustrate a single frame in the raw image data sequence (8A); an inversed spatial contrast image (8B); and an inversed temporal contrast image (8C). Fig. 8D
illustrates an average intensity vs. time curve during the image acquisition period of time as the metaKG signal (end-systolic phases in eight (8) cardiac cycles are used).
Thus, Figs. 8A through 8D illustrate average blood velocity distribution of anterior wall of a heart using Laser Speckle Imaging at the end-systolic phase of the cardiac cycle (determined visually).
[001021 Figs. 9A through 9B illustrate using an average intensity vs. time curve as the .metaKG signal in a potential cardiac application to assess blood flow and perfusion. Fig. 9C
illustrates the average intensity vs. time curve as the metaKG signal .with diastolic and systolic phases labeled. Fig. 9A illustrates one frame of raw image data sequence in diastolic phase and Fig. 98 illustrates one frame of raw image data sequence in systolic phase.
1001031 Referring now to Figs. 10A through 1QC, using average intensity vs.
time curve as the metaKG signal in a potential skin/peripheral extremity application to assess blood flow and perfusion will be discussed. Figs. 10A and 10B 'illustrate a finger perfusion measurement setup.
Fig. 10A illustrates one frame from raw image data sequence, with flow to the two left fingers reduced by greater than 70% by inflation of a.blood pressure cuff on the left arm. Fig. 108 illustrates the blood velocity distribution, illustrating this substantial reduction in flow and perfusion to the left fingers. Fig. IOC is a graph illustrating an average intensity vs. time curve as the metaKG
Referring to Figs. 11A through 1811, use of the average intensity vs. time curves as the metaKG signal in a different finger perfusion measurement experiment will be discussed.
These figures illustrate a potential skin/peripheral extremity application to assess blood flow and perfusion. The figures document the interoperability of the metaKG, the external standard EKG, flow, velocity of flow, frequency, and change in frequency due to pathophysiologic changes in flow and perfusion in accordance with embodiments discussed herein.
[00105] Referring first to Figs. IAA through 11C, embodiments of at baseline, with no fingers occluded will be discussed. Fig. 118 illustrates the average intensity vs.
time curve of 12 seconds (60 fps) image sequence of two .fingers of left hand and two fingers of right hand (aggregate from all four fingers). Fig. I IA illustrates an LSI-analyzed velocity map of perfusion to all fOur fingers. Fig. 11C illustrates standard EKG and peripheral oxygen saturation pulsatility data acquired simultaneous with the image sequence. The inetaKG 'rate' is 73 beats/min (bpm), while the recorded standard EKG rate is 74 bpm...
[001061 Referring now to Figs. 12A through 12.H, using the same data as in Figs. 11A-C, this baseline data is farther analyzed. Figs. 128 and 12D illustrate the wave form of the average intensity vs. time curve of the two left (12A) and two right (12C) finger sets, respectively., and Show that they are similar (la =73 bpm, R =74 bpm). Figs. 12EIF and 1.2G/E1 are frequency domain analyses of the average intensity vs. time curves, which document that the main frequency component in both finger sets is the heart rate (HR), and that the main frequency component of the two left fingers (Figs. 12E and 12F) and two right fingers (Figs. I2G and 12H.) are virtually identical.
f001071 Referring now to Figs. 13A through 13C, results of the same experimental setup as Figs. 11A-12II, but now flow and perfusion to the left two fingers (Fig. 13A) are occluded by the blood pressure cuff will be discussed. The peripheral oxygen saturation measurement. is made from the third digit on the left hand. Fig. 138 illustrates an average intensity vs. time curve of 12 seconds (60 fps) image sequence of fingers Of left hand and two fingers of right hand (Fig.
13A). Fig. 13C illustrates the standard external EKG .and peripheral oxygen saturation pulsatility data acquired simultaneous with the image sequence. With the finger occlusion, the metaKG
signal (aggregate from. all four fingers) differs slightly from the standard EKG (72 bpm vs. 69 bprn).
1001081 Referring now to Figs. 14A through 14H, analysis is similar to that discussed above with. respect to Figs. 12A-H. The flow and perfusion to the left finger set (14A) are occluded, while the right finger set (14C) is normally perfused as the control. Figs.
148 and. 14D illustrates the wave form of the average intensity vs. time curve as the metaKG of the left (148) and right finger sets (14D), and that they are different. Figs. 14E47 and 140/H.
illustrate the frequency domain analysis of the average intensity vs. time curves. Figs. 140/H
'illustrate the main .frequency component of the non-occluded right finger set (14D) is still .the HR. Figs. 14E/Fõ
however, illustrate the frequency component of the occluded left finger set is degraded from the perfused condition in Figs. 12E/F, and very different from the. frequency component of the two right fingers (Figs. 0,41). Thus, Figs. 14A through 14H illustrate that there is a difference in the metadata (B&D) because blood flows to the fingers in A are occluded and those in C are not.
The strength of intensity fluctuation in D and 0 are much greater than that in B and E. In other words, when the blood, flow is blocked, the metadata (MetaKG) may weaken.
[001091 Referring now to Figs. 15A through 15C, restilts of the same experimental setup as prior figures, but now the blood cuff on the left arm has been released and both finger sets are perfused again (note the time stamp from the standard EKG display) will be discussed. Fig. 15B
illustrates the average intensity vs. time tnetaKG curve of 12 seconds (60 fps) image sequence of two fingers of left hand and two fingers of right hand (Fig. 15A). Fig. 15C
illustrates bottom panel. is the standard external EKG and peripheral oxygen saturation pulsatility data acquired simultaneously with the image sequence. The metaKG rate is 72 bpm versus the standard EKG
rate of 75 bpm.
1001101 Referring now to Figs. 16A through 16H, an analysis is similar to Figs. 1.2 and 14 above will be discussed. Figs. 16B and 16D illustrate the wave form of the average intensity vs.
time curve of the left (16A) and right (1.6C) finger sets are similar after the occlusion on the two left fingers (16A) are released. Figs. 16E/F and 16G/H illustrate the frequency domain analyses Of the average intensity vs. time curves, which again illustrate that the main frequency component is the HR, and that the main frequency component of the left finger set .(16E/F) and the right finger set (16G/H) are identical again after the occlusion to the left finger set is released.
[001111 Referring now to Figs. 17A through 1.7Cõ using the same experimental setup as Fig.
15, the heart rate of the subject was temporarily increased by isometric exercise. The average intensity vs. time curve as the metaKG signal in this finger perfusion experiment is illustrated with the heart rate elevated. Fig. 17B is the average intensity vs. time curve of 12 seconds (60 fps) image sequence of the left and right finger sets (I7A). Fig. 17C
illustrates the standard external EKG and peripheral oxygen saturation pulsatility data acquired simultaneously with the image sequence.
[001121 Referring now to Figs. 18A through 18H, Figs. 18B and 18D
illustrate that wave forms of the average intensity vs. time curve of the left (18A) and right (18C) finger sets are .similar. Figs. 18E/F and 180/H illustrate that the frequency domain analyses of the metaKO
data, which show the main frequency component is the HR in both finger sets (1.8A and 18C), and that the main frequency component of the two left fingers (Figs. I 8E/F) and two right fingers (Figs. 18G/H) are identical.
[001131 As discussed above, because the blood flow and perfusion are dynamic processes that change in one cardiac cycle, it is critical to synchronize the imaging measurement results with a reference signal. Most commonly in medical imaging the reference signal is the external electrocardiogram ( EKG) signal. In other words, if the blood flow measurement is not linked to specific physiologic parameters, such as the time point during a cardiac cycle, the results are not useful because they have no physiologic context.
[001141 Furthermore, the significance of the physiologically-referenced, for example, EKG-timed, blood flow and perfusion measurement in evolving imaging technologies is Instantaneous flow and perfusion distribution that can be generated and linked at any time of a cardiac cycle as discussed above. Similarly, average flow and perfusion distribution can also be generated and linked to one or several cardiac phases or cycles as discussed with respect to the figures above.
1001151 The significance of the physiologically-referenced, for example, EKG-timed, blood flow and perfusion comparison, i.e., before and after an intervention, in evolving imaging technologies is as follows: (J) A standardized, non-temporal baseline for comparison (in physiology, time phase is not standard across clinical applications); and(2) unique and often novel new physiologic/pathophysiologic information, not obtainable otherwise.
[001161 The significance of the physiologically-referenced, for example, EKG-timed, blood.
flow and perfusion also creates the analytical basis for: (1) quantitative comparison of the instantaneous flow and perfusion distribution, because the flow and perfusion patterns will vary, based on the physiology/pathophysiology of blood flow and perfusion, Quantitative comparison typically requires before and after imaging.d.ata that are synchronously comparable, and 'EKG
synchronization is a useful way to link the quantitative -flow and perfusion to an independent, objective benchmark, i.e. a specific cardiac phase. Moreover, the precision of a benchmark 'like the EKG is useful for defining the starting and ending points of the averaging process, versus simply finding a random starting point and averaging a few seconds of flow and perfusion measurements, where quantitative comparison of the average flow and perfusion maps is indicated.
100/171 Embodiments of the present inventive concept address situations where an EKG
signal is not available or desirable. As discussed herein, embodiments of the present inventive concept provide a "surrogate EKG signal" that can be used instead of the standard EKG signal to identify and target these physiologic processes, benchmarks, data acquisition and data analysis parameters. The "surrogate EKG signal" has been referred to herein as a "MetaKG signal." The MetaKG in accordance with embodiments discussed herein consists of an.
electrical, mechanical, and/or motion signal embedded in the.metadataof the image file(s) obtained by imaging across or within the visible and near-infrared spectrum wavelengths. The surrogate EGK signal is referred to herein as "rnetaKa"
[001181 As discussed above with respect to the Figures, for example, Figs. 2 through SD, the metaKG is imbedded in the average intensity vs. time curve of the raw image data sequence. In particular, if 10 seconds of image sequence is captured at 100 frames/second, an average intensity is calculated. at each frame to form a curve of 1.000 intensity points along the second time line. Due to contraction of the heart, the imaged tissue/organ will move toward and away from the camera causing the intensity to fluctuate periodically. The fluctuation of intensity shows a certain pattern in one cardiac cycle and repeats itself different cardiac cycles.
[001191 Although embodiments of the present inventive concept are discussed herein with respect to cardiac applications, embodiments of the present inventive concept are not limited to this configuration. For example, the periodic fluctuation average intensity vs. time not only happens in cardiac imaging applications, but also in other tissues/organs. In particular, Figs. I OA
through 10C illustrate a metaKG signal in accordance with embodiments discussed herein from finger digits of the upper extremities, despite being located quite far from the heart.
[001201 In validating the accuracy of this metaKG physiologic data using frequency component analysis, in Figs. 11A through IC, the metaKG signal yields the same heart rate as the real EKG signal and peripheral oxygen saturation pulsatility data (73 bpm vs. 74 bprn).
1001211 As further illustrated in Figs. 12A through 12H, the frequency components of the average intensity vs. time curves from representative different normal tissues (left hand finger pair (12A) vs. right hand finger pair(12C)) are similar indicating the HR. as the main frequency component of the metaKG.
(001221 As evidence of the physiologic relevance of the metaKG, when blood flow and perfusion are physiologically or pathophysiologically reduced, the frequency component of the average intensity vs. time curve metaKG from the occluded tissue changes compared. with the frequency component from the non-occluded control tissue metaKG, as illustrated in Figs.I 3.A-C. In Figs. 14A through 14H, the main frequency component of the metaKG
average intensity vs. time curve from the non-occluded control tissue is still the HR which is consistent with the external EKG reading while the frequency component of average intensity vs.
time curve from the occluded .tissue becomes more complex. This indicates the presence of a different and abnormal underlying physiological response.
[00123] As further evidence of the physiologic relevance of the metaKG, when blood flow and perfusion can be restored to the certain part of tissue that was previously interrupted of blood flow and perfusion, the frequency components of the average intensity vs. time 'metaKG. from occlusion released tissue. and normal tissue are similar, as indicated by the HR as the main frequency component as shown in Figs. 15A through 15C and 16A through 16H.
[001241 Finally, as further evidence of the physiologic relevance of the metaKG, Figs. 17A
through 17C and. 18A through 18H demonstrate that when the heart rate is elevated (HR 103 bpm), the frequency components of the average intensity vs. time metaKG curves from different normal tissues are similar. This indicates that metaKG signal HR is the main frequency component, which again is consistent with the external EKG tracing obtained at the same time.
1001251 Accordingly, as discussed briefly above, using an. EKG signal to track time during the image acquisition is useful to link each specific blood flow and perfusion.
distribution to its cardiac phase. For any blood flow and perfusion imaging technology, this method can generate reliable instantaneous blood flow and perfusion distribution at any time of a cardiac cycle and average blood flow and perfusion distribution of several cardiac phases or cycles. Furthermore, this method allows the valid comparison of blood flow and perfusion distribution in different cardiac phases and in a pre and post treatment fashion. Thus, the link between EKG and image acquisition and subsequent instantaneous and average blood flow and perfusion measurement upgrades any current blood flow and perfusion imaging technology into a more practical, reliable, precise and clinically relevant methodology. in accordance with embodiments discussed herein, when an EKG signal is absent during the imaging process, a .metaKG signal (surrogate EKG signal) can be calculated from the average, intensity vs. time curve of a specific region of interest on the image sequence. As discussed above with respect to 'Figs. 2 through I 81-1, the metaKG signal yields reliable heart rateipulsatility information using frequency component analysis. When the blood vessel is occluded, the frequency component changes compared with the frequency component of the non-occluded control tissue indicating underlying physiological response.
1001261 Referring now to Figs. 19 and 20, a data processing system 200 that may be used in the system 100 illustrated in Fig. I in accordance with some embodiments of the inventive concept will be discussed. The data processing system 200 may be included in the metaKG
device 112, the camera 130 or split between various .elements of the system 100 without departing from the scope of the present inventivezoncept. As illustrated in Fig. 19, an .exemplary embodiment of a data processing system 200 suitable for use in the system 100 of Fig. I 'includes a user interface 244 such as a keyboard, keypad, touchpad or the like,. I/0 data ports 246 and a memory 236 that communicates with a processor 238. The 110 data ports 246 can be used to .transfer information between the data processing system 200 and another computer system or a network. These components may be conventional components, such as 7?
those used in many conventional data processing systems, which may be configured to operate as described herein.
[001.271 Referring now to Fig. 20, a more detailed block diagram of the data processing system 200 in accordance with some embodiments of the present inventive concept will be discussed. The processor 238 communicates with a display 345 via and address/data bus 347, the memory 236 via an address/data bus 348 and the I/O data ports 246 via, an.
address/date bus 349. The processor 238 can be any commercially available or custom microprocessor or ASICs.
The memory 236 is representative of the overall hierarchy of memory:devices containing the software and data used to implement the functionality of the data processing system 200. The memory 236 can include, but is not limited to, the following types of devices:
cache, ROM, PROM, EPROM, EEPROM, flash memory, SRAM, and DRAM.
[001281 As shown in Fig. 20, the memory 236 may include several categories of software and data used in the data processing system 200: an operating system 352;
application programs 354;
input/output (I/0) device drivers 358; and data 356. As will be appreciated by those of skill in the art, the operating system 352 may be any operating system suitable for use with a data processing system, such as Mac OSX, OS/2, AIX or zOS from International Business Machines Corporation, Armonk, NY, Windows95, Windows98, Windows2000, WindovvsXP, Windows .8, Windows 10 or Vista. from Microsoft Corporation, Redmond, WA, Unix., Linux, LabView, or a real-time operating system such as QNX or VxWorks, or the like. The liO device drivers 358 typically include sOftware routines accessed through the operating system 352 by the application programs 354 to communicate with devices such as the I/O data port(s) 246 and certain memory .236 components. The application programs 354 are illustrative of the programs that implement the various features of the data processing system 200 included a system in accordance with some embodiments of the present inventive concept and preferably include At least one application that supports operations according to some embodiments of the present inventive concept: Finally, the data 356 represents the static and dynamic data used by the application programs 354, the operating system 352, the I/O device drivers 358, and other software programs that may reside in the memory .236.
. [001291 As illustrated in Fig. 20, the data 356 according to some embodiments of the present inventive concept may include acquired images 360, image metadata 361, physiologic signal data 363, calculated blood flow/perfusion rates (velocity data) 364 and MetaKG
data 365.
Although the data 356 illustrated in Fig. 20 includes five different files 360, 361, 363, 364 and 365 embodiments of the present inventive concept are not limited to this configuration. Two or more files may be combined to make a single file; a single tile may be split into two or more files and the like without departing .from the scope of the present inventive concept.
[001301 As further illustrated in Fig. 20, the application programs 354 may include a metadata module 351, an image capture module 352, a MetaKG module 353 and velocity module 354 in accordance with some embodiments of the inventive concept. While the present inventive concept is illustrated, for example, with reference to the metadata module 351, the image capture module 352, the MetaKG module 353 and the velocity module 354 being application programs in Fig. 20õ as will be appreciated by those. of skill in the art, other configurations may also be utilized while still benefiting from the teachings of the present inventive concept. For example, the metadata module 351, the image capturemodule 352, the MetaKG module 353 and the velocity module 354 may also be incorporated into the operating system 352 or other such logical division of the data processing system 300. Thus, the present inventive concept should not be construed as limited to the configuration of Fig. 20, but is intended to encompass any configuration capable of carrying out the operations described herein.
[001311 Furthermore, while the metadata module 351, the image. capture module 352, the MetaKG module 353 and the velocity module 354 are illustrated in a single data processing system, as will be appreciated by those of skill in the art, such functionality may be distributed across one or more data processing systems. Thus, the present inventive concept should not be construed as limited to the configuration illustrated in Figs. 19 and 20, but may be provided by other arrangements and/or divisions of function between data processing systems.
[001321 As discussed above with respect to Fig. 1, at least one source 120 may illuminate a sample of tissue/organ and light may be reflected into a camera. The camera 130/image capture module 352 may receive the reflected light and provide it to the imaging processing device 110 to provide an image 360.. These images may be processed (metadata module 351) to provide metadata 361 associated therewith and an MetaKG signal 365 (surrogate EKG
signal) may be determined by the MetaKG module 353 using the Physiologic signal data 363 and the metadata 361 as discussed above. As also discussed above, this surrogate EKG signal (MetaKG signal) may be used to provide blood flow and perfusion data 364 by the velocity module 354. In particular, the data 356 may be used by the metaKG module 353 to provide blood flow and perfusion data synchronized with a surrogate EKG signal (inetaKG signal).
1001331 Operations in accordance with various embodiments of the inventive concept will now be discussed with respect to the flowcharts of Figs. 21 through 23.
Operations for calculating a MetaKG signal begin at block 2115 by illuminating a region of interest in a sample with At least one light source, for example, a near-infrared (NIR) light source and/or a visible light source. Images of the region of interest are acquired (2125). The acquired images are processed to obtain metadata associated with the acquired images (block 2135).
The MetaKG
signal is calculated from. the metadata associated with the acquired images (block 2145). In some embodiments, the MetaKG signal may be calculated or derived from one of raw (reflectance images) images and perfusion (analyzed) images (processed images). In some embodiments, the sample may be one of tissue and an organ.
1001341 In some embodiments, blood flow and perfusion data may be acquired using the calculated MetaKG signal (block 2155). Dotted lines indicating optional subject matter.
1001351 Referring now to Fig. 22, operations begin at block 2217 by generating the MetaKG
signal from acquired images by calculating average intensity versus time in the region of interest.
At least one of heart rate and pulsatility information may be calculated from the average intensity versus time in the region of interest by analyzing a frequency component of the average intensity versus time (block .2227). In some embodiments, heart rate variability (HRV) may be extracted from the heart rate calculated from the average intensity versus time in the region of interest. As used herein, the term "heart rate variability" refers to a measure of changes of the heart rate over time. This change may be large or small, and .over a small or large time-intenfal. Normally, the heart rate is not absolutely regular, and one can quantify the degree of changes of the heart rate over a certain period of time, for example, the heart beats faster and slower with respiration.
Some types of HRV are indicative, of abnormal physiological status, and/or diseases.
[001361 Abnormal and normal tissue may be differentiated based on a frequency component of the average intensity versus time (block 2237). A degree of abnormality related to an underlying physiological response may be indicated (block 2247).
[001371 Referring now .to Fig. 23, a configuration of the region of interest may be changed (block 2318). For example, one of the size and the location of the region of interest may be changed. A two dimensional heart rate map may be generated of a region of interest in a field of view (block 2328).
[00138] As discussed above, in some embodiments of the present inventive concept, a surrogate EKG (MetaKG) may be calculate4 using average intensity of the raw images.
However, in some embodiments, the MetaKG may be calculated using average intensity of speckle contrast images as will be discussed further below with respect to Figs. 24A through 29.
Embodiments of the present inventive concept illustrated in Fills. 24A through 29 discuss processing the images in the time domain,. frequency domain and the time-frequency domain as discussed below. Thus, Figs. 2A - 3B, .5, 7, 81), 9C, 10C, 11B, 12B, 121), 13B, 1413, 14D, 15B, 1613, 1613, 17B, 1813 and 181) illustrate MetaKG signals calculated from a raw image (reflectance image) in accordance with some embodiments of the present inventive concept.
Figs. 25,26 (frequency domain), 27 (time-frequency domain), 28A, 28B
(frequency domain) and Fig 29 (time-frequency domain) illustrate MetaKG calculated from perfusion images (LSI, =LDI
etc.) in accordance with some embodiments of the present inventive concept.
[001391 .Referring first to Figs. 24A and 24B, laser speckle imaging examples of a pig intestine will be discussed. Figs. 24A and 24B illustrate a raw NIR laser speckle image and a MR laser speckle contrast image, respectively. Figs. 24C and 241) illustrate a raw VL laser speckle image and a VL laser speckle contrast image, respectively, As illustrated, the difference between the raw laser speckle images (24A and 24C) and the laser speckle contrast images (2413 and 24D) is more apparent in the NIR images (24A and 2413) than it is in the VL images (24C
and 2413). This is indicative of the fact the NIR laser speckle contrast image (2413) provides better insights into blood flow and perfusion than the raw NIR laser speckle image (24A).
[00140] Referring now to Figs. 25A. and 25B, graphs illustrating time-domain (or spectral) analysis of MetaKG signals will be discussed. Fig. 25A illustrates an NIR-MetaKG (X) versus time and .Fig. 25B illustrates a VL-MetaKG (Y) versus time. The X lines on both plots represent the large amplitude slow trend of the MetaKG caused .by the respiratory activity related movement. Both NTR-MetaKG (W) and VL-MetaKG (Y) are contaminated by this noise to the same degree.
[00141] Referring now to Figs. 26A and 2613, graphs illustrating frequency-domain (or spectral) analysis of MetaKG signals will be discussed. Fig. 26A illustrates.
the Power Spectral Density (PSD) of NIR-MetaKCi versus frequency and Fig. 2613 illustrates the PSD of VL-MetaKG versus frequency, both graphs illustrating respiratory activity and cardiac activity in the frequency domain. Thus, PSD is a measure of strength of a given signal's specific frequency components.
[00142] Referring now to Figs. 27A and 27B, graphs illustrated frequency-time domain (or spectrogram) analysis of MetaKG signals will be discussed. Fig. 27A
illustrates a spectrogram of NIR-MetaKG and Fig. 27B illustrates a spectrogram of VL-MetaKGõ both including cardiac and respiratory activity. The spectrogram of MetaKG signals reveals the frequency-domain spectral contents of the signals over time. Both MetaKG signals are severely contaminated by the respiratory activity related noise. The spectrogram of the N1R-MetaKG
(27A) shows a slight sign of cardiac activity (labeled line), which is Much weaker than. the respiratory.ae.tivity related noise.
.f00143] Referring now to Figs. 28A and 2813, graphs illustrating residual MetaKG will be discussed. Fig. 28A illustrates residual-MetaKG versus time and Fig. 28B
illustrates residual-MetaKG versus frequency. By utilizing bothINI1R-MetaKG and VL-MetaKG, the residual-MetaKG can be extracted. The PSD of the residual-MetaKG (Fig. 2813) clearly shows that the signal's dominant component is related to the cardiac activity (about 9(1 bpm), not the respiratory activity.
[00144] Referring now to Fig. 29, a graph illustrating frequency-time domain (or spectrogram) analysis of the residual-MetaKG will be discussed. The spectrogram of the residual-MetaKG signal illustrates in Fig. 29 reveals that the signal is free .from the respiratory activity related noise. The instantaneous heart rate changing over time is marked thereon. By utilizing the residual-MetaKG, the slight changes in the heart rate over time can be tracked and heart rate variability (HRV ¨ defined above) can be computed.
[0014.5] Given the residual MetaKG, there are many ways to calculate HRV.
However, most of them are designed to calculate HRV over a long period of time,. for example, at least 5 minutes. MetaKG in accordance with embodiments discussed herein tends to be shorter than average (20s-1min), the difference between the maximum and minimum HR values may be obtained and may be used as a HRV index. An extended Kalman filter may be used to estimate the heart rate series of any given Meta-KG. Then, the HRV may be determined as the difference between the maximum and minimum heart rate values.
[001461 Referring now to Fig. 30, operations for a two wavelength embodiment in accordance with some embodiments will be discussed. As illustrated in Fig. 3.0, operations for removing movement-related .artifacts. from a MetaKG signal using dual wavelength light sources begins at block 3050 by illuminating a region of interest in a sample with a near-infrared (N1R) !kaki source and a visible light (VL) source. Two.sets of images of the region of interest are acquired, each corresponding to one of the NIR light source and the VI, source (block 3053). The two sets of images are processed to obtain NIR-metadata and VL-metadata (block 3055).
An NIR
MetaKG and a VL MetaKG are calculated from the NIR- metadata and the VL
metadata, respectively (block 3057). A movement-related common signal component is extracted from the NIR MetaKG and the VL MetaKG (block 3058). A noise-free MetaKG is calculated by cancelling out the movement-related common signal component from the NIR
MetaKG (block 3059).
[001471 As discussed above, embodiments of the present inventive concept that use multiple wavelengths to acquire multi-spectral images can remove noise due to motion artifacts caused by, for example, respiratory activity (Figs. 26-29). Single wavelength technologies may not be able to effectively remove such noise artifacts.
[001481 Referring. now to Figures 31A through 31G, a block diagram illustrating Hernodynamic Status Parameters (HSP) that may be derived from MetaKG in accordance with embodiments discussed herein will be discussed. As illustrated. in Figure 31, the 1-ISPs may include Heart Rate (HR), heart rate variability (HRV), R-to-R interval (RR!), and RRI Standard Deviation (RR1SD) as illustrated in Fig. 31C, systolic Blood Pressure threshold (SBO as illustrated in Fig. 310, and rate x pressure product (RPP), instantaneous perfusion in systole and diastole, frequency analysis and time-frequency analysis of the perfusion curve, and contractility index (slope of the pet-Fusion curve) as illustrated in Figs. 31A-31B and 31D-31F. In some embodiments, the MetaKG may be used to derive additional HSPs such as tissue oxygen content, hemoglobin content, temperature, and the like. The opportunity to capture these relevant hemodynamic parameters non-invasively from imaging is an innovation for clinical point-of-care monitoring technologies. Real-time integration with physiolOgic blood flow and perfusion data will further augment the accuracy and potential .diagnostic and therapeutic impact of these digital HSP data trended over time.
[001491 It will be understood that embodiments of the present inventive concept may be used in any format of clinical imaging, which includes both surgical imaging (usually an in-patient application) and other out-patient imagine procedure (non-surgical application) without departing from the scope of the present inventive concept.
[00150] Referring now to Figs, 32 through 35, methods for providing improved images of samples using embodiments of the present inventiveconeept discussed above with respect .10 Figs. I through 31G will be discussed. Using embodiments of the present inventive concept to calculate an accurate MetaKG signal for a region of interest, it has been determined that when all portions of the region of interest have a same or similar set of optical characteristics, for example, when the region of interest is an internal organ, the "background"
behind the organ or region of interest does not generally interfere significantly with the image and/or the resulting MetaKG signal. However, when the region of interest is provided on a background that has a different set of optical characteristics than the region of interest, forexample, when a hand is imaged on a table or dark background, this background may have different optical characteristics that could alter the image and/or resulting MetaKG signal. During clinical studies including field of views (FOlis) of both tissue with blood flow and background with no blood flow, it was determined that in environments where the background. has a.different set of optical characteristics than the region of interest in the field of view, a corrective factor may be calculated to provide a more accurate image and/or MetaKG
1001511 Although embodiments of the present inventive concept may be discussed herein with respect to imaging a hand on a dark background, where the hand has blood flow and the background does not, thus, having different optical characteristics, it will be understood that embodiments of the present inventive concept are not limited to this example.
Embodiments of the present inventive concept may be used in combination with any environment where the results may benefit from a correction factordue to different sets of optical characteristics. For example, during a surgical procedure towels or drapes may be positioned around the field of view to block out the areas around the tissues of interest in the field of view. Thus, the tissue in the field of view and the towels will not have the same set of optical characteristics. A similar line of reasoning may be applied when there is biologic, tissues of interest and non-biologic materials together in the field of view, [001521 As used herein, '4a set of optical characteristics" refers to the biologic versus non-biologic nature of the materials being illuminated in the field of view. The optical properties of a biological tissue are described in terms of the absorption coefficient, 1.,:a (cm-1), the scattering coefficient las (cm¨I), the scattering phase function p(0, j) where 0 (050.7c) is the polar angle of scatter and j (0..5..]<27c) is the azimuthal angle of scatter, and the refractive index of the tissue, it.
Optical scattering can be described either as scattering by particles that have a refractive index different from the surrounding medium, or as scattering by a medium with a continuous but fluctuating refractive index. These optical properties (absorption, scattering, anisotropy, reduced scattering, refractive index) vary between different biological, tissues, and between different biological tissues in the same field of view. Furthermore, these tissue optical characteristics will be different for the same tissue depending upon the illumination source, for example visible light versus NIR, or different wavelengths within the visible spectrum or the NIR
spectrum.
[00153] The biological optical characteristics differ from the optical characteristics of non-biologic materials, for example, background, towels or drapes, surgical instruments, foreign bodies, or other such inert materials, which are separately defined by the nature of the non-biologic materials themselves. For example, laser speckle contrast of biological material, such as tissue and laser speckle contrast of non-biologic materials such as background are differentiated through laser speckle imaging analysis.
[00154] Referring now to Fig. 32, is a block diagram illustrating a field of view 3242 including a sample 3240 positioned on a background 3241 will be discussed. The sample 3241 may be any sample to be imaged in a field of view. Th.e "background" may be any background 3241 that has a different set of optical characteristics than the sample to be imaged. As discussed above, when internal organs are being imaged, all tissue in the field of view may all have the same tissue structure and, .therefore, have the same or similar set of optical characteristics. The set of optical characteristics of the sample in the field of view effect the reaulting calculated MetaKG signal. In stark contrast, if the field of view includes a sample having a first set of optical Characteristics and a "background" having a second set of optical characteristics that are different than the first set of characteristics, the resulting MetaKG signal may be less accurate.
[001551 For example, Fig. 33 is a graph illustrating frames versus mean iKG.
The sample is a human palm positioned on a background. The graph illustrates the NIR iKG of the background (A) and the palm (B) and the visible (V IS) iKG of the background (C) and the palm (D). As illustrated, there is noise in the visible iKG of the palm (D) caused by movement in the background.
[001561 Accordingly, some embodiments of the present inventive concept provide a method for correcting a calculated MetaKG signal when the field of view includes a sample and a background having different sets of optical characteristics. For example, a MetaKG signal may be calculated for the field of view and a second MetaKG signal may be calculated for the background and then the background MetaKG signal may be subtracted out of or removed from the MetaKG signal of the field of view as will be discussed further below.
1001571 More specifically, in some embodiments a multi-spectral MetaKG signal may be calculated by calculating a residual MetaKG (Metall-GALL: (t)) as:
c*.m. Zfrilff bxist-t9A2 M etaKG ¨
Z.
x = Eqn. (I) or N-At vµv a x Pin.111 , b 4-=-1:211 %mg Y t) =
MetaNGAILiz(t) =
MXN Eqn. (2) wherein fmg.a:L(x,Y,t) is raw or speckle contrast images of a first wavelength; /Ingz. (x,.Y!t) is raw or speckle contrast images of a second wavelength; a, b and c are parameters for normalization; and M and N are a number of pixels along x and y axes, respectively.
1001581 Imp.' may be NIR and ImgA,2 may be visible (VIS) as illumination sources. The two (or more) wavelengths cross-contaminate in the standard metaKG analysis, mostly through translational motion of the tissues causing a false positive LSCI indication of flow and perfusion.
[001591 Furthermore, replacing Img),1 may be NIR and Irng-A2 in equations (I) and (2) with Img),..3 representing the background NIR, and Img;µ,4 representing the background VIS, respectively, may provide data with respect to the "background" in the Field of View. As discussed above, this background could be an opaque flat pad on which the hand is imaged, or the towel drapes placed to isolate the tissues of interest in the operating room. The characteristic of the "background" is that it is inert material with kilOWII optical properties, it should not be moving or exhibiting any translational motion, and that there should not be any BFD signal in this inert material. The background MetaKG-NIR and the background MetaKG-V1S, thus, represent additional 'corrective" factors that can be applied. Ideally, both the background signals (NIR and VIS) should be flat. However, in reality, they may not be.
Any actual BFD
signal obtained from the background is a false positive that could be used to further refine the analyses of actual BFD.
[001601 As discussed above, some embodiments of the present inventive concept use MetaKG
signals calculated for the background (NIR and V1S) to adjust the MetaKG for the region of interest. It will be understood that the MetaKG can be calculated using any number of methods without departing from the scope of the present inventive concept. For example, a MetaKG may be calculated using one wavelength or multiple wavelengths.
1001611 Referring first to Fig. 34, a flowchart illustrating methods using a single wavelength.
will be discussed. Operations for calculating a MetaKG signal for a region of interest in a sample using a single wavelength begin at block 3400 by illuminating a region of interest in a sample with a light source having a single wavelength. In the single wavelength in some embodiments is in. the NIR range. As discussed above, the region of interest has a sample portion 3240 (Fig. 32) having a first set of optical characteristics and a background portion (3241) having a second set of optical characteristics. Images of the region of interest are acquired (block 3410). The acquired images of the region of interest are processed to obtain metadata associated with the acquired images (block 3420). A MetaKG signal for the region of interest is calculated from the metadata associated with the acquired images (block 3430). A
background MetaKG signal is also calculated from the metadata associated with the background portion of the region of interest (block 3440). The calculated MetaKG signal for the region of interest is adjusted using the calculated background MetaKG to provide a final adjusted MetaKG
signal for the region of interest (block 3450). As discussed above, the MetaKG
signal can be adjusted in many ways using the background MetaKG signal. For example, the background MetaKG signal may be subtracted from the MetaKG signal for the region of interest.
1001621 Embodiments of the present inventive concept using more than one wavelength will now be discussed. with respect to. the flowchart of Fig. 35. As illustrated in Fig. 35, operations for calculating a MetaKG signal using multiple wavelengths begin at block 3500 by illuminating a region of interest in a sample with at least one multi-wavelength light source. As discussed above, the region. of interest includes a sample portion and a background portion. The multi-wavelength light source may be a near-infrared (NIR) light source and/or a visible light source and in some embodiments is both. Multi-spectral images of the region of interest are acquired using a multi-wavelength camera (block 3510). The acquired multi-spectral images are processed to obtain metadata associated with the acquired multi-spectral images (block 3520). A
background MetaKG signal is calculated for the background portion of the region of interest from the metadata associated with the acquired multi-spectral images (block 3530). A MetaKG
signal is calculated for the region of interest from the metadata associated with the acquired multi-spectral images (block 3540). The calculated MetaKG signal for the region of interest is adjusted using the calculated background MetaKG signal to provide a final adjusted MetaKG
signal (block 3550). Calculating the background MetaKG signal and the MetaKG
signal for the region of interest comprises calculating a multi-spectral MetaKG signal using multi-spectral signal processing to remove motion artifacts and improve signal quality using equations (1) and (2) above.
[001631 In particular, in some embodiments, calculating the background MetaKG
signal includes first calculating a background MetaKG signal for both near-infrared (NIR) and visible wavelengths to provide a background MetaKG signal NIR and a background MetaKG
signal visible. The background MetaKG signal NIR may be adjusted using the background MetaKG
signal visible if necessary. Then,. the MetaKG signal for the region of interest may be calculated by calculating a MetaKG signal for the region of interest for visible wavelengths to provide a MetaKG signal visible for the region of interest. The calculated the MetaKG
signal visible for the region of interest may be reserved for any motion artifact present therein. A window of frames may be selected for NIR analysis tbr the region of interest. A .MetaKG
signal for the region of interest for NIR wavelengths may be calculated to provide a MetaKG
signal NIR for the region of interest using the selected window. Finally, the MetaKG signal visible for the region of interest may be normalized using the background MetaKG signal visible to provide the final adjusted MetaKG signal for the region of interest. This process may optimize the MetaKG
MR flow an perfusion pathway for the region of interest.
[001641 It will be understood that embodiments of the present inventive concept are not limited to these examples. For example, the steps in the method may be performed in a different order without departing fiom the scope of the present inventive concept.
Additional steps may also be added or steps may be removed.
[001651 For example, in some embodiments, the visible MetaKG may be used to identify translational motion from the MetaKG-VIS as a first step. Then, a section of the MetaKG-VIS
that is stable and flat, i.e. has no translational motion, may he used to identify where the RAW
frames are located where the MetaKG-NIR can be analyzed, thus, translational movement may be reduces in the analysis. There also may be other possible signals in the VIS wavelength that may improve the MetaKG-NIR analyses beyond just mathematical processes.
[001661 Furthermore, in some embodiments the background data May be process prior to .MetaKG or residual metaKG analysis. The background metaKG-VIS may be used to confirm absence of motion artifact. Background metaKG-VIS and background metal(G-NIR
may be compared and this comparison may be used to assess false positivity in background MetaKG-NIR. This may be used to 'correct' the MetaKG-NIR or residual MetaKG-NIR. The background-NIR may be matched to background-VIS to provide an optimal window for selection for analysis. The corrected background-NIR may be used to normalize the MetaKG-NIR or residual MetaKG-NIR analysis, as "true baseline of zero perfusion" for that imaging encounter. This approach may be used to 'normalize' MetaKG or residual MetaKG
to a standard baseline value, within subjects and also across subjects 1001671 As briefly discussed above, embodiments of the present inventive concept discussed with respect Figs. 32 through 35 utilize the concepts discussed in prior portions of the application to further refine the final MetaKG. Thus, embodiments of the present 'inventive concept may provide more accurate results.
[00168] Example embodiments are described above with reference to block diagrams and/or flowchart illustrations of methods, devices, systems and/or computer program products. It is understood that a block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer special purpose computer, and/or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer and/or other programmable data processing apparatus, create means (functionality) and/or structure for implementing the functions/acts specified in the block, diagrams and/or flowchart block or blocks.
1001691 These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory =
produce an article of manufacture including instructions which implement the functions/acts specified in the block diagrams and/or flowchart block or blocks.
[00170j The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks.
1001711 Accordingly, example embodiments may be implemented in hardware and/or in software (including firmware, resident software, micro-code, etc.).
Furthermore, example embodiments may take the form of a computer program product on a computer-usable or computer-readable storage medium having computer-usable or computer-readable program code embodied in the medium for use by or in connection with an instruction execution system. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
1001721 The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, and a portable compact disc read-only memory (CD-ROM). Note that the computer-usable or computer-readable medium. could even be paper or another suitable medium upon which the program is printed, as the program can be electronically .captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
1001731 Computer program code for carrying out operations of data processing systems discussed herein may be written in .a high-level programming language, such as Java, AJAX
(Asynchronous JavaScript), C, and/or C++, for development convenience. In addition, computer program code for carrying out operations of example embodiments may also be written in other programming languages, such as, but not limited to, interpreted languages.
Some modules or routines may be written in assembly language or even micro-code to enhance performance and/or memory usage. However, embodiments are not limited to a particular programming language. It will be further appreciated that the functionality of any or all of the program modules may also be implemented using discrete hardware components, one or more application specific integrated circuits (ASICs), or a field programmable gate array (FPG.A), or a programmed digital signal processor, a programmed logic controller (PLC), or microcontroller.
1001741 it should also be noted that in some alternate implementations, the functions/acts noted in the blocks may occur out of the .order noted in the flowcharts. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
Moreover, the functionality of a given block of the flowcharts and/or block diagrams may be separated into multiple blocks and/or the functionality of two or more blocks of the flowcharts and/or block diagrams may be at least partially integrated.
[001751 In the drawings and specification, there have been disclosed example embodiments of the inventive concept. Although specific terms are employed, they are used in a generic and descriptive sense only and not for purposes of limitation, the scope of the inventive concept being defined by the following claims.
.36
Claims (16)
A method for calculating a MetaKG signal, the method comprising:
illuminating a region of interest in a sample with at least one multi-wavelength light source, wherein the region of interest includes a sample portion and a background portion and wherein the multi-wavelength light source is a near4nfrared .(NIR) light source andfor a visible light source;
acquiring multi-spectral images of the region of interest using a muhi-wavelength camera;
processing the acquired multi-spectral images to obtain rnetadata associated with the acquired multi-spectral images;
calculating a background MetaKG signal for the background portion. Of the region. of interest from the metadata associated with the acquired multi-spectral images;
calculating a MetaKG signal for the region of interest from the metadata associated with the acquired multi-spectral images; and.
adjusting the calculated MetaKG signal for the region of interest using the calculated back.ground MetaKG si.gnal to provide a final adjusted MetaKG
wherein calculating the background.MetaKG signal and the MetaKG signal for the region of interest comprises calculating a multi-spectral MetaKG signal using multi-spectral signal processing to rernove motion artifacts and improve signal quality, wherein calculating the multi-spectral MetaKG signal comprises:
calculating a residual MetaKG (li'letaKG4tit: (0) as:
a xinkl; Cr,y,r)-?)rrkv_z$:x;;;,44c MetaKG2.:i (0 ¨ __________________________________ 3?).:3;
or rg a x fmg.1.1(x, Y
b (x,y z(t) , t;
MetalfGaLl M X N
1o:herein in:921 (x,Y, t) is raw= or speckle contrast images of a first wavelength;
InVA2 (X,Y. t) is raw or speckle contrast images of a second wavelength; a, b and c are parameters for normalization; and M and N are a nuxnber of pixels along x and y axes, respectively.
InVA2 (X,Y. t) is raw or speckle contrast images of a second wavelength; a, b and c are parameters for normalization; and M and N are a nuxnber of pixels along x and y axes, respectively.
2. The rnethod of Clairn I, wherein the first wavelength is a wavelength in a near-infrared range and the second wavelength is a wavelength in a visible range.
3. The tnethod of Claim I:
wherein -calculating the background MetaK.G signal further coinprises:
calculating a background. MetaKG signal for both near-inframd (NIR) and visible wavelengths to provide a background MetaKG signal NIR and a background MetaKG
signal visible;
adjusting the background MetaKG signal NIR using the background MetaKC't signal visible if necessary;
wherein calculating the IVIetaK.G signal for the region of interest comprises:
calculating a luletaKG signal for the region.of interest for visible wavelengths to provide a MetaKG signal visible for the region of interest;
observing the calculated the MetaK.G .signal visible .for the region of interest for any 11)otion artifact present therein;
'selecting a window of frames for NIR analysis for the region of interest;
calculating a MetaKG signal for the region of interest for NIR wavelengths to provide =a MetaKG signal NIR for the region of interest using the seleeted window; and normalizing the MetaKG signal visible for the region of interest using the backgro.und MetaKG signal .visible to provide the final adjusted MetaK.G
signal for the region of interest.
wherein -calculating the background MetaK.G signal further coinprises:
calculating a background. MetaKG signal for both near-inframd (NIR) and visible wavelengths to provide a background MetaKG signal NIR and a background MetaKG
signal visible;
adjusting the background MetaKG signal NIR using the background MetaKC't signal visible if necessary;
wherein calculating the IVIetaK.G signal for the region of interest comprises:
calculating a luletaKG signal for the region.of interest for visible wavelengths to provide a MetaKG signal visible for the region of interest;
observing the calculated the MetaK.G .signal visible .for the region of interest for any 11)otion artifact present therein;
'selecting a window of frames for NIR analysis for the region of interest;
calculating a MetaKG signal for the region of interest for NIR wavelengths to provide =a MetaKG signal NIR for the region of interest using the seleeted window; and normalizing the MetaKG signal visible for the region of interest using the backgro.und MetaKG signal .visible to provide the final adjusted MetaK.G
signal for the region of interest.
4. The method of Claim 3, wherein the rnulti-spectral MetaKG is used to determine physiologic status parameters (PSPs) by determining specific quantitative aspects of the multi-spectral MetaK.G that represent one or more PSPs.
'38
'38
5. The method of Claim 4, wherein the PSPs comprise Heart Rate (HR); heart rate variability (HRV); R-to-R interval (RRI); RRI Standard Deviation (MUSD);
systolic Blood Pressure threshold (SBt); diastolic blood pressure threshold (Dik); rate x pressure product (RPP);
irstantaneous perfusion in systole and diastole; frequency analysis and time-frequency analysis of a perfusion curve; and/or contractility index including slope of the perfasion curve based on the calculated MetaKG
systolic Blood Pressure threshold (SBt); diastolic blood pressure threshold (Dik); rate x pressure product (RPP);
irstantaneous perfusion in systole and diastole; frequency analysis and time-frequency analysis of a perfusion curve; and/or contractility index including slope of the perfasion curve based on the calculated MetaKG
6. The method of Claim 5, wherein the inulti-speetral MetaKG generates a specific value that represents a .relative perfusion quantification for a pixel at a single point in time, wherein differences at the singlepoint in time between MetaKG values can differentiate thresholds for PSPs., the .method further cornprising observing a change in the MetaKG for the pixel to provide a different representation of physiology status.
7. The method of Claim 1, wherein calculating the background MetaKG signal and the MetaK20 signal for the region of interest further comprises:
Calculating the MetaKG signal using average intensity of speckle contrast images derived from the acquired multi-spectral irnages to provide an average intensity MetaKG signal;
calculating a frequency MetaKG signal using frequency analysis; and/or calculating a time-frequency MetaK0 signal using time-frequency analysis.
Calculating the MetaKG signal using average intensity of speckle contrast images derived from the acquired multi-spectral irnages to provide an average intensity MetaKG signal;
calculating a frequency MetaKG signal using frequency analysis; and/or calculating a time-frequency MetaK0 signal using time-frequency analysis.
8. .A method for calculating a MetaK.G signal for a reeion of interest in a sample, the method cornprising:
illmninating a region of interest in a sample with a light source having a single wavelength, the region of interest having a sample portion having a first set of optical characteristics and a background portion having a second.set of optical characteristics;
acquiring. images of the region of interest;
processing the acquired images of the region of interest to obtain metadata associated with the acquired images;
calculating a MetaKG signal for .the region of interest from the metadata associated with the acquired images;
calculating a background MetaKG signal from the rnetadata associated with the 'background portion of the region of interest; and adjusting the calculated MetaKG signal for the region of interest .using the calculated background MetaKG to provide a final adjusted MetaKG signal for the region of interest.
illmninating a region of interest in a sample with a light source having a single wavelength, the region of interest having a sample portion having a first set of optical characteristics and a background portion having a second.set of optical characteristics;
acquiring. images of the region of interest;
processing the acquired images of the region of interest to obtain metadata associated with the acquired images;
calculating a MetaKG signal for .the region of interest from the metadata associated with the acquired images;
calculating a background MetaKG signal from the rnetadata associated with the 'background portion of the region of interest; and adjusting the calculated MetaKG signal for the region of interest .using the calculated background MetaKG to provide a final adjusted MetaKG signal for the region of interest.
9. The method of Clahn 1, wherein illuminating further comprises illuminatina the region of interest of the sample with a near-infrared (MR) light source.
10. The method of Clairn 8, wherein calculating the background Meta.KG
signal and.
the MetaKG signal for the region of interest further comprises:
calculating the .Meta.KG signal using average intensity of speckle contrastimages derived from the acquired irnages to provide an average intensity MetaKG signal;
calculating a frequency MetaKG Signal using frequency analysis; and/or calculating a time-frequency MetaKG signal using time-frequency analysis.
signal and.
the MetaKG signal for the region of interest further comprises:
calculating the .Meta.KG signal using average intensity of speckle contrastimages derived from the acquired irnages to provide an average intensity MetaKG signal;
calculating a frequency MetaKG Signal using frequency analysis; and/or calculating a time-frequency MetaKG signal using time-frequency analysis.
11. The method of Claim 10:
wherein illuminating the region. of .interest in the sample comprising illuminating the region of interest with at least.one multi-wavelength light source, wherein the region of interest includes a sample portion and a backgrotmd portion and wherein .the multi-wavelength light source is a near-infrared (NIR) light source and/or a visible light source;
wherein acquiring comprises acquiring multi-spectral images of the region of interest using a multi-wavelength camera;
wherein processing comprises processing the acquired multi-spectral images to obtain metadata associated with the acquired multi-spectral images;
wherein calculating the background IVIetaKG comprises calculating the background MetaKG signal for the bacicgrouncl portion of the region of interest front the rnetadata. associated with the acquired multi-spectral. itnaaes;
wherein calculating the MetaKG signal for the reeion of interest comprisingcalculating the MetaKG signal for the region of interest from the metadata associated with the acquired multi-spectral images; and wherein adjusting comprises adjusting the calculated MetaKG signal for the retrion of interest usirtg the calculated background MetaKG .signal to provide a final adjusted MetaKG
signal, wherein calculating the background MetaKG signal and the MetaKG signal for the region of interest cornprises calculating a rnulti-spectral MetaKG signal using multi-spectral signal processing to remove motion artifacts and irnprovesignal quality, wherein calculating the multi-spectral MetaK.G signal comprises:
calculating a residual MetaKG (MetaKadtaaa.()) as:
TAT e = 2.1,-.-:_=-=x=1,==Aµ"'4A
.`", '11 A I'M ==...:.1',1?==== ' MetaK4(t) MXN
or :mu) x, v, .
E;:i...11,Z=3. a X , = u 1 ragA2 MetalCGAI -42(t) ______________________________ x N
wherein fmg:41(x,y, is raw or speckle contrast irnages of a first wavelength;
imat.2 (X,37, t) is raw or speckle contrast images of a second wavelength; a b and c are pararneters for normalization; and '1\4 and N are a number of pixels 'along x and y axes, respectively.
wherein illuminating the region. of .interest in the sample comprising illuminating the region of interest with at least.one multi-wavelength light source, wherein the region of interest includes a sample portion and a backgrotmd portion and wherein .the multi-wavelength light source is a near-infrared (NIR) light source and/or a visible light source;
wherein acquiring comprises acquiring multi-spectral images of the region of interest using a multi-wavelength camera;
wherein processing comprises processing the acquired multi-spectral images to obtain metadata associated with the acquired multi-spectral images;
wherein calculating the background IVIetaKG comprises calculating the background MetaKG signal for the bacicgrouncl portion of the region of interest front the rnetadata. associated with the acquired multi-spectral. itnaaes;
wherein calculating the MetaKG signal for the reeion of interest comprisingcalculating the MetaKG signal for the region of interest from the metadata associated with the acquired multi-spectral images; and wherein adjusting comprises adjusting the calculated MetaKG signal for the retrion of interest usirtg the calculated background MetaKG .signal to provide a final adjusted MetaKG
signal, wherein calculating the background MetaKG signal and the MetaKG signal for the region of interest cornprises calculating a rnulti-spectral MetaKG signal using multi-spectral signal processing to remove motion artifacts and irnprovesignal quality, wherein calculating the multi-spectral MetaK.G signal comprises:
calculating a residual MetaKG (MetaKadtaaa.()) as:
TAT e = 2.1,-.-:_=-=x=1,==Aµ"'4A
.`", '11 A I'M ==...:.1',1?==== ' MetaK4(t) MXN
or :mu) x, v, .
E;:i...11,Z=3. a X , = u 1 ragA2 MetalCGAI -42(t) ______________________________ x N
wherein fmg:41(x,y, is raw or speckle contrast irnages of a first wavelength;
imat.2 (X,37, t) is raw or speckle contrast images of a second wavelength; a b and c are pararneters for normalization; and '1\4 and N are a number of pixels 'along x and y axes, respectively.
12. The method of.Clairn 11, wherein the 'first wavelength is a wavelength in a near-infrared range and the second wavelength is a wavelength in a visible range.
13. The rnethod of Claim I 1:
wherein calculating the background MetaKG signal farther comprises:
calculating a background MetaKG signal for both near-infrarecl (NIR) and visible wavelengths to provide a background MetaKG signal NIR and a background MetaKG
signal visible;
adjustirtg the bwkeround MetaKG signal NIR. using the background MetaKG
signal visible if necessary;
wherein.calculating the IVIetaKG signal for the region of interest comprises:
calculating a MetaKG signal for the region of interest for visible wavelengths to .provide a MetaKG signal visible for the region of interest;
observing the calculated the MetaKG signal visible for the region of interest for any motion artifact present therein;
selecting a window of fra. mes for NIR analysis for the region of interest;
calculating a MetaKG signal for the region of interest for NIR wavelengths to provide a MetaKG signal NIR for the region of interest using the selected window; and normalizing the MetaKG signal visible for the region of interest using the background MetaKG signal visible to provide the final adjusted MetaKG signal for the region of interest.
wherein calculating the background MetaKG signal farther comprises:
calculating a background MetaKG signal for both near-infrarecl (NIR) and visible wavelengths to provide a background MetaKG signal NIR and a background MetaKG
signal visible;
adjustirtg the bwkeround MetaKG signal NIR. using the background MetaKG
signal visible if necessary;
wherein.calculating the IVIetaKG signal for the region of interest comprises:
calculating a MetaKG signal for the region of interest for visible wavelengths to .provide a MetaKG signal visible for the region of interest;
observing the calculated the MetaKG signal visible for the region of interest for any motion artifact present therein;
selecting a window of fra. mes for NIR analysis for the region of interest;
calculating a MetaKG signal for the region of interest for NIR wavelengths to provide a MetaKG signal NIR for the region of interest using the selected window; and normalizing the MetaKG signal visible for the region of interest using the background MetaKG signal visible to provide the final adjusted MetaKG signal for the region of interest.
14. The method of Claim 13, wherein the multi-spectral MetaKG is used to determine physiologic status parameters (PSPs) by determining specific .quantitative aspects of the multi-spectral MetaKG that represent one or more PSPs.
15. The method of Claim 14, wherein the PSPs comprise Heart Rate (HR);
heart rate variability (HR.V).; R-to-R interval (RRI); RRI Standard Deviation (RRISD);
systolic Blood Pressure threshold (SBt); diastolic blood pressure threshold .(DBt); rate x pressure product (RPP);
instantaneous perfusion in systole and diastole; frequency analysis and time-frequency analysis of a perfiision curve; and/or contractility index including slope of the perfusion curve based on the calculated MetaKG sign.al.
heart rate variability (HR.V).; R-to-R interval (RRI); RRI Standard Deviation (RRISD);
systolic Blood Pressure threshold (SBt); diastolic blood pressure threshold .(DBt); rate x pressure product (RPP);
instantaneous perfusion in systole and diastole; frequency analysis and time-frequency analysis of a perfiision curve; and/or contractility index including slope of the perfusion curve based on the calculated MetaKG sign.al.
16. The method of Claim 15, wherein the .multi-spectral MetaKG generates a specific value that represents a relative perfusion quantification for a pixel at a single point in time, wherein differences .at the single point in tirne between MetaK.G values can differentiate thresholds for PSPs, the method further comprising observing a change in the MetaKG for the pixel to provide a different representation of physiology status.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/062,989 US11553844B2 (en) | 2014-10-14 | 2020-10-05 | Methods, systems and computer program products for calculating MetaKG signals for regions having multiple sets of optical characteristics |
US17/062,989 | 2020-10-05 | ||
PCT/US2021/049608 WO2022076122A1 (en) | 2020-10-05 | 2021-09-09 | Methods, systems and computer program products for calculating metakg signals for regions having multiple sets of optical characteristics |
Publications (1)
Publication Number | Publication Date |
---|---|
CA3196709A1 true CA3196709A1 (en) | 2022-04-14 |
Family
ID=78087530
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA3196709A Pending CA3196709A1 (en) | 2020-10-05 | 2021-09-09 | Methods, systems and computer program products for calculating metakg signals for regions having multiple sets of optical characteristics |
Country Status (2)
Country | Link |
---|---|
CA (1) | CA3196709A1 (en) |
WO (1) | WO2022076122A1 (en) |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016061041A1 (en) * | 2014-10-14 | 2016-04-21 | East Carolina University | Methods, systems and computer program products for determining hemodynamic status parameters using signals derived from multispectral blood flow and perfusion imaging |
US10058256B2 (en) * | 2015-03-20 | 2018-08-28 | East Carolina University | Multi-spectral laser imaging (MSLI) methods and systems for blood flow and perfusion imaging and quantification |
KR102491850B1 (en) * | 2015-07-15 | 2023-01-26 | 삼성전자주식회사 | Imaging system and mentod of laser speckle contrast and apparatus employing the same |
US20210321887A1 (en) * | 2018-08-28 | 2021-10-21 | Sony Corporation | Medical system, information processing apparatus, and information processing method |
-
2021
- 2021-09-09 WO PCT/US2021/049608 patent/WO2022076122A1/en active Application Filing
- 2021-09-09 CA CA3196709A patent/CA3196709A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
WO2022076122A1 (en) | 2022-04-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2963866C (en) | Methods, systems and computer program products for determining hemodynamic status parameters using signals derived from multispectral blood flow and perfusion imaging | |
US11278220B2 (en) | Determining peripheral oxygen saturation (SpO2) and hemoglobin concentration using multi-spectral laser imaging (MSLI) methods and systems | |
US11553844B2 (en) | Methods, systems and computer program products for calculating MetaKG signals for regions having multiple sets of optical characteristics | |
Gratton et al. | Removing the heart from the brain: compensation for the pulse artifact in the photon migration signal | |
Kamshilin et al. | Accurate measurement of the pulse wave delay with imaging photoplethysmography | |
EP2956906B1 (en) | Analysing video images of a subject to identify spatial image areas which contain periodic intensity variations | |
US9060722B2 (en) | Apparatus for processing physiological sensor data using a physiological model and method of operation therefor | |
JP5939649B2 (en) | Method and apparatus for visualization of cardiovascular pulse waves | |
KR20140058573A (en) | Remote monitoring of vital signs | |
Zhou et al. | The noninvasive blood pressure measurement based on facial images processing | |
Van Gent et al. | Heart rate analysis for human factors: Development and validation of an open source toolkit for noisy naturalistic heart rate data | |
Blanik et al. | Remote vital parameter monitoring in neonatology–robust, unobtrusive heart rate detection in a realistic clinical scenario | |
Papon et al. | Non-invasive heart rate measuring smartphone applications using on-board cameras: A short survey | |
Spicher et al. | Initial evaluation of prospective cardiac triggering using photoplethysmography signals recorded with a video camera compared to pulse oximetry and electrocardiography at 7T MRI | |
Gupta et al. | Availability and performance of face based non-contact methods for heart rate and oxygen saturation estimations: A systematic review | |
Kavya et al. | Photoplethysmography—A modern approach and applications | |
Saiko et al. | On the feasibility of pulse wave velocity imaging for remote assessment of physiological functions | |
Malasinghe et al. | A comparative study of common steps in video-based remote heart rate detection methods | |
Liu et al. | Real-time visual analysis of microvascular blood flow for critical care | |
Wang et al. | Fundamentals of camera-PPG based magnetic resonance imaging | |
Blanik et al. | Frequency-selective quantification of skin perfusion behavior during allergic testing using photoplethysmography imaging | |
Chatterjee et al. | Non-invasive cardiovascular monitoring | |
CA3196709A1 (en) | Methods, systems and computer program products for calculating metakg signals for regions having multiple sets of optical characteristics | |
JP2024532284A (en) | Method and system for designing photoplethysmographic waveform features from biophysical signals for use in characterizing physiological systems | |
Hassan et al. | A real-time non-contact heart rate measurement based on imaging photoplethysmography (ippg)-power spectral density (psd) |