US8214011B2 - System and method for remodeling prediction using ultrasound - Google Patents
System and method for remodeling prediction using ultrasound Download PDFInfo
- Publication number
- US8214011B2 US8214011B2 US12/190,947 US19094708A US8214011B2 US 8214011 B2 US8214011 B2 US 8214011B2 US 19094708 A US19094708 A US 19094708A US 8214011 B2 US8214011 B2 US 8214011B2
- Authority
- US
- United States
- Prior art keywords
- remodeling
- heart
- accordance
- determining
- myocardial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000007634 remodeling Methods 0.000 title claims abstract description 85
- 238000002604 ultrasonography Methods 0.000 title claims abstract description 83
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000002107 myocardial effect Effects 0.000 claims abstract description 31
- 230000000747 cardiac effect Effects 0.000 claims description 25
- 230000007115 recruitment Effects 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 7
- 210000005240 left ventricle Anatomy 0.000 claims description 7
- 238000013507 mapping Methods 0.000 claims description 7
- 230000003205 diastolic effect Effects 0.000 claims description 6
- 238000005259 measurement Methods 0.000 claims description 6
- 208000033774 Ventricular Remodeling Diseases 0.000 claims description 5
- 210000004165 myocardium Anatomy 0.000 claims description 5
- 239000000463 material Substances 0.000 claims description 4
- 230000010016 myocardial function Effects 0.000 claims description 4
- 208000010125 myocardial infarction Diseases 0.000 claims description 4
- 238000004904 shortening Methods 0.000 claims description 3
- 230000003416 augmentation Effects 0.000 claims description 2
- 230000006735 deficit Effects 0.000 claims description 2
- 230000010247 heart contraction Effects 0.000 claims 2
- 230000015654 memory Effects 0.000 description 41
- 230000006870 function Effects 0.000 description 14
- 206010000891 acute myocardial infarction Diseases 0.000 description 13
- 238000012285 ultrasound imaging Methods 0.000 description 13
- 206010019280 Heart failures Diseases 0.000 description 12
- 238000012545 processing Methods 0.000 description 12
- 238000004519 manufacturing process Methods 0.000 description 11
- 238000003860 storage Methods 0.000 description 11
- 206010061216 Infarction Diseases 0.000 description 10
- 230000007574 infarction Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 206010007559 Cardiac failure congestive Diseases 0.000 description 9
- 230000000302 ischemic effect Effects 0.000 description 8
- 239000000523 sample Substances 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 210000000107 myocyte Anatomy 0.000 description 7
- 230000007423 decrease Effects 0.000 description 6
- 208000028867 ischemia Diseases 0.000 description 6
- 230000002861 ventricular Effects 0.000 description 6
- 230000006907 apoptotic process Effects 0.000 description 5
- 230000008602 contraction Effects 0.000 description 5
- 210000001519 tissue Anatomy 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000003384 imaging method Methods 0.000 description 4
- 230000036770 blood supply Effects 0.000 description 3
- 230000030833 cell death Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000002059 diagnostic imaging Methods 0.000 description 3
- 238000002592 echocardiography Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 206010007572 Cardiac hypertrophy Diseases 0.000 description 2
- 208000006029 Cardiomegaly Diseases 0.000 description 2
- 206010016803 Fluid overload Diseases 0.000 description 2
- 208000013875 Heart injury Diseases 0.000 description 2
- 206010020880 Hypertrophy Diseases 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 2
- 210000001765 aortic valve Anatomy 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 239000008280 blood Substances 0.000 description 2
- 238000002591 computed tomography Methods 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 201000010099 disease Diseases 0.000 description 2
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000002595 magnetic resonance imaging Methods 0.000 description 2
- 230000004118 muscle contraction Effects 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 238000002560 therapeutic procedure Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 208000001778 Coronary Occlusion Diseases 0.000 description 1
- 206010011086 Coronary artery occlusion Diseases 0.000 description 1
- MYMOFIZGZYHOMD-UHFFFAOYSA-N Dioxygen Chemical compound O=O MYMOFIZGZYHOMD-UHFFFAOYSA-N 0.000 description 1
- 206010016654 Fibrosis Diseases 0.000 description 1
- 206010047139 Vasoconstriction Diseases 0.000 description 1
- 206010047295 Ventricular hypertrophy Diseases 0.000 description 1
- 230000001154 acute effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003782 apoptosis assay Methods 0.000 description 1
- 208000037849 arterial hypertension Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 210000000601 blood cell Anatomy 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005266 casting Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 210000002808 connective tissue Anatomy 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000034994 death Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000035487 diastolic blood pressure Effects 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000004064 dysfunction Effects 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 230000004761 fibrosis Effects 0.000 description 1
- 230000008570 general process Effects 0.000 description 1
- 230000003483 hypokinetic effect Effects 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000005764 inhibitory process Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000005226 mechanical processes and functions Effects 0.000 description 1
- 238000002483 medication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 230000003387 muscular Effects 0.000 description 1
- 238000009659 non-destructive testing Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 230000007170 pathology Effects 0.000 description 1
- 230000009955 peripheral mechanism Effects 0.000 description 1
- 230000036316 preload Effects 0.000 description 1
- 238000004393 prognosis Methods 0.000 description 1
- 230000005522 programmed cell death Effects 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 210000001908 sarcoplasmic reticulum Anatomy 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 230000035488 systolic blood pressure Effects 0.000 description 1
- 230000001225 therapeutic effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000011282 treatment Methods 0.000 description 1
- 230000025033 vasoconstriction Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
Definitions
- Embodiments of the present invention relate generally to medical imaging systems, and more particularly, to ultrasound imaging systems, especially for cardiac imaging.
- Cardiac remodeling also referred to a ventricular remodeling
- CR Cardiac remodeling
- AMI acute myocardial infarction
- CR is a process that involves changes of the myocardial tissue properties (e.g. contractility) and is accompanied by an increase in the myocardial mass and in particular left ventricular (LV) mass and volume, as well as a change in the shape of the ventricle that eventually leads to congestive heart failure (CHF).
- LV left ventricular
- CHF congestive heart failure
- Post-AMI remodeling is asymmetric and is initially triggered and associated with infarct expansion. Infarct expansion, which is related to work performed by myocytes that do not receive enough blood supply (ischemic), occurs mostly through apoptosis (programmed cell death).
- indices are based on serial follow-ups to measure global functional parameters, for example, ejection fraction and LV volumes.
- the follow-up and monitoring of these indices are commonly used as indices of success of a particular therapy (e.g., administered medications).
- These global indices are, however, of low sensitivity. Specifically, these indices are of very low sensitivity to cardiac changes occurring post-AMI, and to regional changes, which actually initiate the cascade of events eventually leading to heart failure.
- a method for determining a likelihood of myocardial remodeling includes obtaining ultrasound information relating to a heart and determining a likelihood of myocardial remodeling of the heart based on the ultrasound information.
- a method for determining a likelihood of myocardial remodeling includes determining a plurality of strain curves over time based on ultrasound information of a heart and determining an amount of local work for each point in the left ventricle of the heart, based on the strain curves.
- the method further includes generating a remodeling map based on the determined amount of local work and determining a likelihood of regional myocardial remodeling based on the remodeling map.
- an ultrasound system in accordance with yet another embodiment of the present invention, includes a transducer configured to acquire ultrasound information of a heart.
- the ultrasound system further includes a processor module configured to determine a likelihood of myocardial remodeling of the heart based on the ultrasound information.
- FIG. 1 is a block diagram of a diagnostic ultrasound system configured to determine a probability of remodeling in accordance with various embodiments of the invention.
- FIG. 2 is a block diagram of an ultrasound processor module of the diagnostic ultrasound system of FIG. 1 formed in accordance with an embodiment of the invention.
- FIG. 3 is a flowchart of a method for generating a regional cardiac remodeling map to predict regional remodeling in accordance with various embodiments of the invention.
- FIG. 4 is a graph illustrating recruitment in a normal individual, in relationship to the Aortic Valve Closure time.
- FIG. 5 is a graph illustrating recruitment in an acute myocardial infarction (AMI) individual, in relationship to the Aortic Valve Closure time.
- AMI acute myocardial infarction
- FIG. 6 is a graph illustrating regional work in a normal individual, calculated by plotting the percent recruitment versus the longitudinal strain (in percent).
- FIG. 7 is a graph illustrating regional work in an acute myocardial infarction (AMI) individual, calculated by plotting the percent recruitment versus the longitudinal strain (in percent).
- AMI acute myocardial infarction
- FIG. 8 is bullseye plot formed in accordance with various embodiments of the invention.
- FIG. 9 is an ultrasound image that includes identified regions overlaid on the image indicating a probability of remodeling in accordance with various embodiments of the invention.
- FIG. 10 is a drawing illustrating a miniaturized ultrasound imaging system that may be configured to determine a probability of remodeling in accordance with various embodiments of the invention.
- FIG. 11 is a drawing illustrating a hand carried or pocket-sized ultrasound imaging system that may be configured to a determine probability of remodeling in accordance with various embodiments of the invention.
- FIG. 12 is a drawing illustrating a console-based ultrasound imaging system provided on a movable base that may be configured to determine a probability of remodeling in accordance with various embodiments of the invention.
- FIG. 13 is a block diagram of exemplary manners in which embodiments of the invention may be stored, distributed and installed on computer readable medium.
- the functional blocks are not necessarily indicative of the division between hardware circuitry.
- one or more of the functional blocks e.g., processors or memories
- the programs may be stand alone programs, may be incorporated as subroutines in an operating system, may be functions in an installed software package, and the like. It should be understood that the various embodiments are not limited to the arrangements and instrumentality shown in the drawings.
- Exemplary embodiments of ultrasound systems and methods for predicting cardiac remodeling using local indices based on regional measurements are described in detail below.
- a detailed description of an exemplary ultrasound system will first be provided followed by a detailed description of various embodiments of methods and systems for predicting cardiac remodeling.
- At least one technical effect of the various embodiments of the systems and methods described herein include determining a likelihood or predicting cardiac remodeling using local indices based on regional measurements from an ultrasound system.
- the parameters used to predict cardiac remodeling and infarct expansion allow for optimizing of preventative treatments. For example, the prediction of remodeling supports cardiologists attempting to treat the post-AMI patient and minimize deterioration to CHF.
- the various embodiments may be described in connection with an ultrasound system, the methods and systems described herein are not limited to ultrasound imaging or a particular configuration thereof.
- the various embodiments may be implemented in connection with different types of medical imaging, including, for example, magnetic resonance imaging (MRI) and computed-tomography (CT) imaging.
- MRI magnetic resonance imaging
- CT computed-tomography
- the various embodiments may be implemented in other non-medical imaging systems, for example, non-destructive testing systems.
- FIG. 1 is a block diagram of an ultrasound system 20 , and more particularly, a diagnostic ultrasound system formed in accordance with an embodiment of the present invention that may be used to perform ultrasound imaging as described in more detail below to predict cardiac remodeling.
- the ultrasound system 20 includes a transmitter 22 that drives an array of elements 24 (e.g., piezoelectric crystals) within a transducer 26 to emit pulsed ultrasonic signals into a body or volume.
- elements 24 e.g., piezoelectric crystals
- the ultrasonic signals are back-scattered from structures in the body, for example, blood cells or muscular tissue, to produce echoes that return to the elements 24 .
- the echoes are received by a receiver 28 .
- the received echoes are provided to a beamformer 30 that performs beamforming and outputs an RF signal.
- the RF signal is then provided to an RF processor 32 that processes the RF signal.
- the RF processor 32 may include a complex demodulator (not shown) that demodulates the RF signal to form IQ data pairs representative of the echo signals.
- the RF or IQ signal data may then be provided directly to a memory 34 for storage (e.g., temporary storage).
- the ultrasound system 20 also includes a processor module 36 to process the acquired ultrasound information (e.g., RF signal data or IQ data pairs) and prepare frames of ultrasound information for display on a display 38 .
- the processor module 36 is adapted to perform one or more processing operations according to a plurality of selectable ultrasound modalities on the acquired ultrasound information.
- Acquired ultrasound information may be processed in real-time during a scanning session as the echo signals are received. Additionally or alternatively, the ultrasound information may be stored temporarily in the memory 34 during a scanning session and processed in less than real-time in a live or off-line operation.
- An image memory 40 is included for storing processed frames of acquired ultrasound information that are not scheduled to be displayed immediately.
- the image memory 40 may comprise any known data storage medium, for example, a permanent storage medium, removable storage medium, etc.
- the processor module 36 is connected to a user interface 42 that controls operation of the processor module 36 as explained below in more detail and is configured to receive inputs from an operator.
- the display 38 includes one or more monitors that present patient information, including diagnostic ultrasound images to the user for review, diagnosis and analysis.
- the display 38 may automatically display, for example, a map showing predictors of regional cardiac remodeling based on, for example, a three-dimensional (3D) ultrasound data set stored in the memory 34 or 40 .
- One or both of the memory 34 and the memory 40 may store 3D data sets of the ultrasound data, where such 3D data sets are accessed to present 2D and 3D images.
- a 3D ultrasound data set may be mapped into the corresponding memory 34 or 40 , as well as one or more reference planes.
- the processing of the data, including the data sets is based in part on user inputs, for example, user selections received at the user interface 42 .
- the ultrasound system 20 acquires data, for example, volumetric data sets by various techniques (e.g., 3D scanning, real-time 3D imaging, volume scanning, 2D scanning with transducers having positioning sensors, freehand scanning using a voxel correlation technique, scanning using 2D or matrix array transducers, etc.).
- the data is acquired by holding the transducer 26 , or moving the transducer 26 such as along a linear or arcuate path, while scanning a region of interest (ROI), which may be moved manually, mechanically or electronically, or a combination thereof.
- ROI region of interest
- the transducer 26 obtains scan planes that are stored in the memory 34 .
- FIG. 2 illustrates an exemplary block diagram of the ultrasound processor module 36 of FIG. 1 formed in accordance with an embodiment of the present invention.
- the ultrasound processor module 36 is illustrated conceptually as a collection of sub-modules, but may be implemented utilizing any combination of dedicated hardware boards, DSPs, processors, etc.
- the sub-modules of FIG. 2 may be implemented utilizing an off-the-shelf PC with a single processor or multiple processors, with the functional operations distributed between the processors.
- the sub-modules of FIG. 2 may be implemented utilizing a hybrid configuration in which certain modular functions are performed utilizing dedicated hardware, while the remaining modular functions are performed utilizing an off-the shelf PC and the like.
- the sub-modules also may be implemented as software modules within a processing unit.
- the operations of the sub-modules illustrated in FIG. 2 may be controlled by a local ultrasound controller 50 or by the processor module 36 .
- the sub-modules 52 - 68 perform mid-processor operations.
- the ultrasound processor module 36 may receive ultrasound data 70 in one of several forms.
- the received ultrasound data 70 constitutes I,Q data pairs representing the real and imaginary components associated with each data sample.
- the I,Q data pairs are provided to one or more of a color-flow sub-module 52 , a power Doppler sub-module 54 , a B-mode sub-module 56 , a spectral Doppler sub-module 58 and an M-mode sub-module 60 .
- an Acoustic Radiation Force Impulse (ARFI) sub-module 62 may be included such as an Acoustic Radiation Force Impulse (ARFI) sub-module 62 , a strain module 64 , a strain rate sub-module 66 , a Tissue Doppler (TDE) sub-module 68 , among others.
- ARFI Acoustic Radiation Force Impulse
- the strain sub-module 62 , strain rate sub-module 66 and TDE sub-module 68 together may define an echocardiographic processing portion.
- Each of sub-modules 52 - 68 are configured to process the I,Q data pairs in a corresponding manner to generate color-flow data 72 , power Doppler data 74 , B-mode data 76 , spectral Doppler data 78 , M-mode data 80 , ARFI data 82 , echocardiographic strain data 84 , echocardiographic strain rate data 86 and tissue Doppler data 88 , all of which may be stored in a memory 90 (or memory 34 or image memory 40 shown in FIG. 1 ) temporarily before subsequent processing.
- the data 72 - 88 may be stored, for example, as sets of vector data values, where each set defines an individual ultrasound image frame. The vector data values are generally organized based on the polar coordinate system.
- a scan converter sub-module 92 access and obtains from the memory 90 the vector data values associated with an image frame and converts the set of vector data values to Cartesian coordinates to generate an ultrasound image frame 95 formatted for display.
- the ultrasound image frames 95 generated by the scan converter module 92 may be provided back to the memory 90 for subsequent processing or may be provided to the memory 34 or the image memory 40 .
- the scan converter sub-module 92 may restore the ultrasound image frames 95 associated with, for example, the strain data, strain rate data, and the like, the image frames may be restored in the memory 90 or communicated over a bus 96 to a database (not shown), the memory 34 , the image memory 40 and/or to other processors, for example, the regional cardiac remodeling map generation processor module 102 .
- the scan converter sub-module 92 obtains strain or strain rate vector data sets for images stored in the memory 90 .
- the vector data is interpolated where necessary and converted into an X,Y format for video display to produce ultrasound image frames.
- the scan converted ultrasound image frames are provided to a display controller (not shown) that may include a video processor that maps the video to a grey-scale mapping for video display.
- the grey-scale map may represent a transfer function of the raw image data to displayed grey levels.
- the display controller controls the display 38 , which may include one or more monitors or windows of the display, to display the image frame.
- the echocardiographic image displayed in the display 38 is produced from an image frame of data in which each datum indicates the intensity or brightness of a respective pixel in the display.
- the display image represents muscle motion in a region of interest being imaged and may include a predicted remodeling value are described in more detail herein.
- a 2D video processor sub-module 94 combines one or more of the frames generated from the different types of ultrasound information.
- the 2D video processor sub-module 94 may combine a different image frames by mapping one type of data to a grey map and mapping the other type of data to a color map for video display.
- the color pixel data is superimposed on the grey scale pixel data to form a single multi-mode image frame 98 that is again re-stored in the memory 90 or communicated over the bus 96 .
- Successive frames of images may be stored as a cine loop in the memory 90 or memory 40 (shown in FIG. 1 ).
- the cine loop represents a first in, first out circular image buffer to capture image data that is displayed in real-time to the user.
- the user may freeze the cine loop by entering a freeze command at the user interface 42 .
- the user interface 42 may include, for example, a keyboard and mouse and all other input controls associated with inputting information into the ultrasound system 20 (shown in FIG. 1 ).
- a 3D processor sub-module 100 is also controlled by the user interface 42 and accesses the memory 90 to obtain spatially consecutive groups of ultrasound image frames and to generate three dimensional image representations thereof, such as through volume rendering or surface rendering algorithms as are known.
- the three dimensional images may be generated utilizing various imaging techniques, such as ray-casting, maximum intensity pixel projection and the like.
- the regional cardiac remodeling map generation processor module 102 is also controlled by the user interface 42 and accesses the memory 90 to obtain ultrasound information, and as described in more detail below, use ultrasound strain data to generate a map of the strain, which in the various embodiments is used to determine local indices of the left ventricle over time. From the local indices, a local work function may be calculated as described herein to thereby generate a cardiac map providing regional predictors of cardiac remodeling.
- cardiac remodeling mapping in accordance with various embodiments may provide assessment of early ventricular remodeling following coronary occlusion that is triggered (and dominated by) and may cause infarct expansion.
- Ventricular remodeling is initiated by and causes infarct expansion within the akinetic-hypokinetic segments adjacent to the infracted area followed by mainly volume-overload hypertrophy of the non-infarcted segments. Further volume enlargement, a lengthening of the ventricular perimeters, and an increased sphericity index both in systole and diastole is accompanied by a blunting of the normal curvature of the apex.
- remodeling is characterized by additional enlargement and sphericity of the ventricle, a decrease in stroke volume, and impaired diastolic filling.
- the various embodiments provide a model of ventricular remodeling after myocardial infarction based on a cascade of the following events: systolic impairment secondary to the continuous loss of contractile material, resulting in an increased end-systolic volume, an increased cardiac size, and a secondary augmentation of the diastolic filling pressure and cardiac distensibility.
- systolic impairment secondary to the continuous loss of contractile material resulting in an increased end-systolic volume
- an increased cardiac size and a secondary augmentation of the diastolic filling pressure and cardiac distensibility.
- Peripheral mechanisms including vasoconstriction subsequently increase both preload and afterload, which results in an increased wall stress and a progressive thinning of the area.
- elevation of the end-diastolic stress causes volume-overload hypertrophy that tends to normalize the wall stress according to Laplace's law.
- the extent and location of the infarction, therapy, or associated diseases may be provided to modify cardiac remodeling by, for example, therapeutic means.
- cardiac remodeling often also originates from a more general process such as arterial hypertension or valvular disease, in which case the ventricular hypertrophy remains symmetric.
- Compensated cardiac hypertrophy (CCH) is concentric and is initially characterized by a thick ventricular wall and septum, a normal internal volume and wall stress, and a high mass-to-volume ratio.
- Cardiac failure occurs when the normal compensation fails, and instead of increased contractile efficiency the myocardium develops more connective tissue, which is accompanied by a progressive enlargement of the ventricular cavity, and the mass-to-volume ratio returns to normal values.
- CF Cardiac failure
- a method 120 for generating a regional cardiac remodeling map to predict regional remodeling is shown in FIG. 3 .
- the method 120 includes obtaining ultrasound images of a heart at 122 .
- different views of a heart may be acquired by the ultrasound system 20 (shown in FIG. 1 ) using any know scanning process.
- the different views of the heart may include three standard views as is known, which include an apical long axis (APLAX) view, a two-chamber (2-chamber) view and a four-chamber (4-chamber) view.
- Multiple standard views of the heart may be acquired, for example, at different times during a heart cycle.
- One or more strain curves for different regions of the imaged heart then may be generated at 124 using any known process. It should be noted that when reference is made herein to a region of the heart, this may refer to a local area of the heart, such as a portion of the base, apex, etc. of the myocardium and corresponds, for example, to an area or point of the heart, which may be about one square centimeter (1 cm 2 ). In others embodiments, and for example, this area may be as small as 0.2 millimeters (mm) ⁇ 0.2 mm.
- the strain curves may be based on a measure of local instantaneous strain value as a function of time.
- the local instantaneous strain value may be a percentage value based on a change in length of the heart muscle at a particular local location, such as based on a percent of muscle contraction.
- the strain value may be calculated in any known manner using, for example, the strain module 64 (shown in FIG. 2 ), operating in a manner based on any known process or method.
- the calculated strain values may be stored in a database that associates the strain value with a portion of the ultrasound image and corresponding, for example, to a pixel position or location of the imaged heart.
- the stored strain values may be, for example, the peak systolic value, which in one embodiment is the peak systolic strain, and more particularly, the peak negative strain if the peak occurs during systole or end systolic strain if the peak occurs later.
- This value generally may be the strain value for any local portion of, for example, the left ventricle of the heart, as a function of any time period during one or more heart cycles.
- local indices are thereafter calculated at 126 .
- one or more local indices may be calculated that generally define remodeling related parameters.
- the one or more indices generally relate to work performed in ischemic, overloaded (mainly afterloaded) regions of the heart and define parameters that relate to the amount of ischemia and afterload of that region, as well as the work performed by that region (e.g., amount of muscle contraction or blood forced through that region).
- a post-systolic shortening index that defines ischemia/afterload, may be defined and calculated. Specifically, for each region or segment of the heart, the variable post-systolic shortening index (as the percent change in length (% ⁇ L)), is calculated as follows:
- PostSystolicShorteningIndex ( End ⁇ - ⁇ diastolic ⁇ ⁇ length - minimal ⁇ ⁇ segment ⁇ ⁇ length ) ( End ⁇ - ⁇ diastolic ⁇ ⁇ length ) ⁇ 100
- an index of segmental work may be calculated which determines the local work of the heart at 128 .
- local stress is related to ventricular pressure
- local strain can be measured by 2D Strain (as described herein).
- ventricular pressure is related to a weighted percentage of recruited myocytes.
- segmental work e.g., mechanical function of the heart at one segment
- SW k L 0 ⁇ ( k ) ⁇ ⁇ Start ⁇ ⁇ Recruitment End ⁇ ⁇ Recruitment ⁇ Percent recruitment ⁇ ( t ) ⁇ Strain k ⁇ ( t ) ⁇ ⁇ d t
- the local work performed by the heart is defined by the index of SW as described above.
- the value of the local work at each point or region of the heart is the value of the index at that point or region.
- a remodeling index (RI), for example, in acute infarction patients also may be calculated.
- an acute myocardial infarction usually results in an infarcted area, mostly diskinetic or akinetic, surrounded with a hypokinetic ischemic area, referred to as “area at risk”.
- the infarcted (diskinetic or akinetic) zone will then expand into the “area at risk”, because myocytes in the area at risk are stimulated to generate work under conditions of ischemia and increased “afterload”. Under these conditions both contraction and relaxation become slow.
- the increased afterload results because the remote non-ischemic myocytes are faster to contract and exert force on the slower ischemic myocytes.
- ischemic blood supply
- cell death e.g., myocytes apoptosis
- prognosis is related to the size of the area at risk.
- the RI is defined as the product of the local work and an index i, which defines post systolic activity, for example, as follows:
- RI ⁇ 1 ⁇ ( PSSI > 0.2 ) 0 ⁇ ( PSSI ⁇ 0.2 ⁇
- the regional amount of ischemia based on calculated local work may be estimated.
- a remodeling index may be calculated for each of a plurality of local regions of the left ventricle, the values of which are the likelihood of myocardial remodeling.
- the first event in the “remodeling cascade” is infarct expansion due to cell death, which is mainly apoptosis in the area at risk.
- the various embodiments relate the probability of cell death to the work performed in the ischemic/overloaded region with a resultant infarct expansion (and other processes described above).
- Apoptosis is caused due to work demand without appropriate blood/oxygen supply, or with elevated afterload.
- FIGS. 6 and 7 the regional work in a normal individual and an AMI individual are illustrated by the curves 160 and 170 , respectively. As can be seen, there is a noticeable change in the local P-V loops equivalence in the infarcted regions.
- WPR weighted percent recruitment
- the start of contraction is determined by the time when the strain trace starts to decline.
- the end of contraction is determined as the time when the strain curve reaches minimum.
- Maximum WPR during systole, ⁇ of systolic WPR relaxation, and maximum diastolic re-recruitment (MDRR) are also measured.
- the maximum WRP is 100% in normal individuals and the following in individuals having heart injury: 80 ⁇ 17% (LAD), 72 ⁇ 11% (RCA), 93 ⁇ 8% (LCX) and 74 ⁇ 20% in CHF patients.
- ⁇ of systolic WPR relaxation in some embodiments are as follows:
- WPR curves are significantly different between normal individuals and individuals with heart injury, as well as among the various type of pathologies in different AMI subgroups and CHF patients.
- the ⁇ parameter may point to apical dysfunction, probably reduced de-rotation rate, whereas the MDRR could be an index related to marked inhibition of the Ca +2 reuptake by the sarcoplasmic reticulum.
- a regional cardiac remodeling map may be generated at 132 that shows the probability of remodeling in local regions of the heart, such as the left ventricle (e.g., predicting the likelihood of myocardial remodeling).
- the map may be a bullseye plot 180 having a plurality of segments 182 as is known (17 segments are shown, but more or less segments, for example, 16 segments or 18 segments may be provided).
- Each of the segments 182 may include therein a numeric value indicating the peak systolic strain for that segment 182 .
- regions 184 indicative of possible remodeling as determined by the RI may be provided and in some embodiments are color coded to identify the probability or likelihood of remodeling. For example, dark red may indicate a local region or area at high risk for remodeling, light red may indicate a local region or area at moderate risk for remodeling and blue may indicate a local region or area at very low risk for remodeling.
- the probability of risk may be determined directly from the value of the RI or may be the value of the RI.
- the RI value may be displayed in combination with the regions (not shown), for example, in the regions or in an associated legend.
- an ultrasound image 190 may include identified regions 192 overlaid on the image indicating a probability of remodeling as described herein and which may be color coded as described above.
- the various embodiments are not limited to predicting remodeling based on the indices described herein.
- the various embodiments may be implemented in connection with any ultrasound system wherein any parameter indicative of potential ischemia is extracted from the ultrasound data, for example, from one or more strain curves. This parameter then may be used to map a number (e.g., an index number) to the probability that a portion of the heart is going to die.
- a number e.g., an index number
- a 3D-capable miniaturized ultrasound imaging system 230 having a probe 232 may be provided.
- the probe 232 may be a miniaturized probe as previously described above.
- a user interface 234 (that may also include an integrated display 236 ) is provided to receive commands from an operator.
- miniaturized means with respect to the ultrasound system 230 that the system is a handheld or hand-carried device or is configured to be carried in a person's hand, pocket, briefcase-sized case, or backpack.
- the ultrasound system 230 may be a hand-carried device having a size of a typical laptop computer, for instance, having dimensions of approximately 2.5 inches in depth, approximately 14 inches in width, and approximately 12 inches in height.
- the ultrasound system 230 may weigh about ten pounds, and thus is easily portable by the operator.
- the integrated display 236 e.g., an internal display
- the ultrasonic data may be sent to an external device 238 via a wired or wireless network 250 (or direct connection, for example, via a serial or parallel cable or USB port).
- the external device 238 may be a computer or a workstation having a display.
- the external device 238 may be a separate external display or a printer capable of receiving image data from the hand carried ultrasound system 230 and of displaying or printing images that may have greater resolution than the integrated display 236 .
- a hand carried or pocket-sized ultrasound imaging system 276 may be provided.
- the pocket-sized ultrasound imaging system 276 may be a pocket-sized or hand-sized ultrasound system approximately 2 inches wide, approximately 4 inches in length, and approximately 0.5 inches in depth and weighs less than 3 ounces.
- the display 242 may be, for example, a 320 ⁇ 320 pixel color LCD display (on which a medical image 290 may be displayed in combination with a graphical representation of the probe 232 ).
- a typewriter-like keyboard 280 of buttons 282 may optionally be included in the user interface 240 . It should be noted that the various embodiments may be implemented in connection with a pocket-sized ultrasound system 276 having different dimensions, weights, and power consumption.
- Multi-function controls 284 may each be assigned functions in accordance with the mode of system operation. Therefore, each of the multi-function controls 284 may be configured to provide a plurality of different actions. Label display areas 286 associated with the multi-function controls 284 may be included as necessary on the display 242 .
- the system 276 may also have additional keys and/or controls 288 for special purpose functions, which may include, but are not limited to “freeze,” “depth control,” “gain control,” “color-mode,” “print,” and “store.”
- a console-based ultrasound imaging system 245 may be provided on a movable base 247 .
- the portable ultrasound imaging system 245 may also be referred to as a cart-based system.
- a display 242 and user interface 240 are provided and it should be understood that the display 242 may be separate or separable from the user interface 240 .
- the user interface 240 may optionally be a touchscreen, allowing the operator to select options by touching displayed graphics, icons, and the like.
- the user interface 240 also includes control buttons 252 that may be used to control the portable ultrasound imaging system 245 as desired or needed, and/or as typically provided.
- the user interface 240 provides multiple interface options that the user may physically manipulate to interact with ultrasound data and other data that may be displayed, as well as to input information and set and change scanning parameters.
- the interface options may be used for specific inputs, programmable inputs, contextual inputs, and the like.
- a keyboard 254 and trackball 256 may be provided.
- the system 245 has at least one probe port 260 for accepting probes.
- FIG. 13 is a block diagram of exemplary manners in which embodiments of the present invention may be stored, distributed and installed on computer readable medium.
- the “application” represents one or more of the methods and process operations discussed above.
- the application is initially generated and stored as source code 1001 on a source computer readable medium 1002 .
- the source code 1001 is then conveyed over path 1004 and processed by a compiler 1006 to produce object code 1010 .
- the object code 1010 is conveyed over path 1008 and saved as one or more application masters on a master computer readable medium 1011 .
- the object code 1010 is then copied numerous times, as denoted by path 1012 , to produce production application copies 1013 that are saved on separate production computer readable medium 1014 .
- the production computer readable medium 1014 is then conveyed, as denoted by path 1016 , to various systems, devices, terminals and the like.
- a user terminal 1020 , a device 1021 and a system 1022 are shown as examples of hardware components, on which the production computer readable medium 1014 are installed as applications (as denoted by 1030 - 1032 ).
- the source code may be written as scripts, or in any high-level or low-level language.
- Examples of the source, master, and production computer readable medium 1002 , 1011 and 1014 include, but are not limited to, CDROM, RAM, ROM, Flash memory, RAID drives, memory on a computer system and the like.
- Examples of the paths 1004 , 1008 , 1012 , and 1016 include, but are not limited to, network paths, the internet, Bluetooth, GSM, infrared wireless LANs, HIPERLAN, 3G, satellite, and the like.
- the paths 1004 , 1008 , 1012 , and 1016 may also represent public or private carrier services that transport one or more physical copies of the source, master, or production computer readable medium 1002 , 1011 or 1014 between two geographic locations.
- the paths 1004 , 1008 , 1012 and 1016 may represent threads carried out by one or more processors in parallel.
- one computer may hold the source code 1001 , compiler 1006 and object code 1010 . Multiple computers may operate in parallel to produce the production application copies 1013 .
- the paths 1004 , 1008 , 1012 , and 1016 may be intra-state, inter-state, intra-country, inter-country, intra-continental, inter-continental and the like.
- the operations noted in FIG. 13 may be performed in a widely distributed manner world-wide with only a portion thereof being performed in the United States.
- the application source code 1001 may be written in the United States and saved on a source computer readable medium 1002 in the United States, but transported to another country (corresponding to path 1004 ) before compiling, copying and installation.
- the application source code 1001 may be written in or outside of the United States, compiled at a compiler 1006 located in the United States and saved on a master computer readable medium 1011 in the United States, but the object code 1010 transported to another country (corresponding to path 1012 ) before copying and installation.
- the application source code 1001 and object code 1010 may be produced in or outside of the United States, but production application copies 1013 produced in or conveyed to the United States (e.g. as part of a staging operation) before the production application copies 1013 are installed on user terminals 1020 , devices 1021 , and/or systems 1022 located in or outside the United States as applications 1030 - 1032 .
- the phrases “computer readable medium” and “instructions configured to” shall refer to any one or all of i) the source computer readable medium 1002 and source code 1001 , ii) the master computer readable medium and object code 1010 , iii) the production computer readable medium 1014 and production application copies 1013 and/or iv) the applications 1030 - 1032 saved in memory in the terminal 1020 , device 1021 and system 1022 .
- the various embodiments and/or components also may be implemented as part of one or more computers or processors.
- the computer or processor may include a computing device, an input device, a display unit and an interface, for example, for accessing the Internet.
- the computer or processor may include a microprocessor.
- the microprocessor may be connected to a communication bus.
- the computer or processor may also include a memory.
- the memory may include Random Access Memory (RAM) and Read Only Memory (ROM).
- the computer or processor further may include a storage device, which may be a hard disk drive or a removable storage drive such as a floppy disk drive, optical disk drive, and the like.
- the storage device may also be other similar means for loading computer programs or other instructions into the computer or processor.
- the term “computer” may include any processor-based or microprocessor-based system including systems using microcontrollers, reduced instruction set computers (RISC), application specific integrated circuits (ASICs), logic circuits, and any other circuit or processor capable of executing the functions described herein.
- RISC reduced instruction set computers
- ASICs application specific integrated circuits
- the above examples are exemplary only, and are thus not intended to limit in any way the definition and/or meaning of the term “computer”.
- the computer or processor executes a set of instructions that are stored in one or more storage elements, in order to process input data.
- the storage elements may also store data or other information as desired or needed.
- the storage element may be in the form of an information source or a physical memory element within a processing machine.
- the set of instructions may include various commands that instruct the computer or processor as a processing machine to perform specific operations such as the methods and processes of the various embodiments of the invention.
- the set of instructions may be in the form of a software program.
- the software may be in various forms such as system software or application software. Further, the software may be in the form of a collection of separate programs, a program module within a larger program or a portion of a program module.
- the software also may include modular programming in the form of object-oriented programming.
- the processing of input data by the processing machine may be in response to user commands, or in response to results of previous processing, or in response to a request made by another processing machine.
- the terms “software” and “firmware” are interchangeable, and include any computer program stored in memory for execution by a computer, including RAM memory, ROM memory, EPROM memory, EEPROM memory, and non-volatile RAM (NVRAM) memory.
- RAM memory random access memory
- ROM memory read-only memory
- EPROM memory erasable programmable read-only memory
- EEPROM memory electrically erasable programmable read-only memory
- NVRAM non-volatile RAM
Landscapes
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
Description
Where:
- L0(k) is the local length at the start of systole;
- StartRecruitment is the time when zones start to be recruited (start on contraction);
- EndRecruitment is the time when all zones are released;
- PercentRecruitment(t) is the percent of segments recruited at the time t;
- Straink(t) is the strain at the zone k at the time t.
It should be noted that zones generally refer to local areas or regions of the heart. Also, as shown inFIGS. 4 and 5 , the recruitment (pressure surrogate) in a normal individual and an AMI individual are illustrated by thecurves
The remodeling Index (RI) will thus be defined as:
RI=i×LocalWork
It should be noted that that value of i may be varied, for example, based on the particular patient.
Normal | LAD | RCA | LCX | CHF | ||
Average | 30.4 | 52.6 | 20.0 | 30.0 | 49.3 | ||
STDV | 6.7 | 7.9 | 2.2 | 12.9 | 14.4 | ||
It should be noted that CHF individuals may have significant post-systolic activity, with an MDRR of 41±25%.
Claims (22)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/190,947 US8214011B2 (en) | 2007-08-13 | 2008-08-13 | System and method for remodeling prediction using ultrasound |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US95553407P | 2007-08-13 | 2007-08-13 | |
US12/190,947 US8214011B2 (en) | 2007-08-13 | 2008-08-13 | System and method for remodeling prediction using ultrasound |
Publications (2)
Publication Number | Publication Date |
---|---|
US20090048513A1 US20090048513A1 (en) | 2009-02-19 |
US8214011B2 true US8214011B2 (en) | 2012-07-03 |
Family
ID=40363521
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/190,947 Active 2030-11-17 US8214011B2 (en) | 2007-08-13 | 2008-08-13 | System and method for remodeling prediction using ultrasound |
Country Status (1)
Country | Link |
---|---|
US (1) | US8214011B2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120253891A1 (en) * | 2011-04-01 | 2012-10-04 | The Corporate Executive Board | Computer-Implemented Generation Of Roadmap Visualizations |
US20170103534A1 (en) * | 2015-10-07 | 2017-04-13 | Samsung Medison Co., Ltd. | Method and apparatus for displaying image showing object |
CN108703770A (en) * | 2018-04-08 | 2018-10-26 | 智谷医疗科技(广州)有限公司 | ventricular volume monitoring device and method |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9176211B2 (en) * | 2008-01-09 | 2015-11-03 | Washington University | Method for quantitatively mapping myocardial contractile function with magnetic resonance based multiparametric strain analysis |
EP2633457B1 (en) * | 2010-10-26 | 2021-10-06 | Oslo Universitetssykehus HF | Method for myocardial segment work analysis |
US9033879B2 (en) * | 2011-02-08 | 2015-05-19 | General Electric Company | Portable imaging system with remote accessibility |
US12042250B2 (en) * | 2013-11-15 | 2024-07-23 | The Regents Of The University Of California | Compositions, devices and methods for diagnosing heart failure and for patient-specific modeling to predict outcomes of cardiac resynchronization therapy |
US20210275835A1 (en) * | 2019-08-29 | 2021-09-09 | Adenocyte Ltd. | Device for inducing exfoliation of cells and/or tissue fragments for enhanced cytopathologic cell collection |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040153128A1 (en) * | 2003-01-30 | 2004-08-05 | Mitta Suresh | Method and system for image processing and contour assessment |
US7877128B2 (en) * | 2005-08-02 | 2011-01-25 | Biosense Webster, Inc. | Simulation of invasive procedures |
US7912270B2 (en) * | 2006-11-21 | 2011-03-22 | General Electric Company | Method and system for creating and using an impact atlas |
-
2008
- 2008-08-13 US US12/190,947 patent/US8214011B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040153128A1 (en) * | 2003-01-30 | 2004-08-05 | Mitta Suresh | Method and system for image processing and contour assessment |
US7877128B2 (en) * | 2005-08-02 | 2011-01-25 | Biosense Webster, Inc. | Simulation of invasive procedures |
US7912270B2 (en) * | 2006-11-21 | 2011-03-22 | General Electric Company | Method and system for creating and using an impact atlas |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120253891A1 (en) * | 2011-04-01 | 2012-10-04 | The Corporate Executive Board | Computer-Implemented Generation Of Roadmap Visualizations |
US20170103534A1 (en) * | 2015-10-07 | 2017-04-13 | Samsung Medison Co., Ltd. | Method and apparatus for displaying image showing object |
US10013768B2 (en) * | 2015-10-07 | 2018-07-03 | Samsung Medison Co., Ltd. | Method and apparatus for displaying image showing object |
US20180308238A1 (en) * | 2015-10-07 | 2018-10-25 | Samsung Medison Co., Ltd. | Method and apparatus for displaying image showing object |
US10861161B2 (en) * | 2015-10-07 | 2020-12-08 | Samsung Medison Co., Ltd. | Method and apparatus for displaying image showing object |
CN108703770A (en) * | 2018-04-08 | 2018-10-26 | 智谷医疗科技(广州)有限公司 | ventricular volume monitoring device and method |
Also Published As
Publication number | Publication date |
---|---|
US20090048513A1 (en) | 2009-02-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8214011B2 (en) | System and method for remodeling prediction using ultrasound | |
Marwick | Ejection fraction pros and cons: JACC state-of-the-art review | |
US8469890B2 (en) | System and method for compensating for motion when displaying ultrasound motion tracking information | |
US9420996B2 (en) | Methods and systems for display of shear-wave elastography and strain elastography images | |
US20120116218A1 (en) | Method and system for displaying ultrasound data | |
US8081806B2 (en) | User interface and method for displaying information in an ultrasound system | |
US10206651B2 (en) | Methods and systems for measuring cardiac output | |
US20100249589A1 (en) | System and method for functional ultrasound imaging | |
US11553900B2 (en) | Ultrasound system with automated wall tracing | |
CN113825451B (en) | System and method for acquisition triggering for cardiac elastography | |
US8636662B2 (en) | Method and system for displaying system parameter information | |
Gupta et al. | Role of echocardiography in the diagnostic assessment and etiology of heart failure in older adults: opacify, quantify, and rectify | |
US8394023B2 (en) | Method and apparatus for automatically determining time to aortic valve closure | |
US20170252000A1 (en) | Analyzer | |
KR102244069B1 (en) | Method and ultrasound apparatus for displaying location information of a bursa | |
US11944501B2 (en) | Systems and methods for automatic measurements of medical images | |
JP7346192B2 (en) | Device, medical information processing device, and program | |
US20230397905A1 (en) | Ultrasound time series data processing apparatus and ultrasound time series data processing program | |
JP2002330967A (en) | Ultrasonic diagnostic instrument | |
US20240173007A1 (en) | Method and apparatus with user guidance and automated image setting selection for mitral regurgitation evaluation | |
Di Somma et al. | Bioimpedance Vector Analysis in Acute Heart Failure | |
US20210244380A1 (en) | Ultrasound diagnostic apparatus and method of processing ultrasound image | |
CN117379094A (en) | Ultrasound imaging apparatus and method | |
CN116602707A (en) | Method and system for visualizing cardiac electrical conduction | |
CN117197024A (en) | Medical imaging method, device and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: GENERAL ELECTRIC COMPANY, NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FRIEDMAN, ZVI;LYSYANSKY, PETER;REEL/FRAME:021755/0716 Effective date: 20081026 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |