EP3469549B1 - Image-based diagnostic systems - Google Patents
Image-based diagnostic systemsInfo
- Publication number
- EP3469549B1 EP3469549B1 EP17732542.0A EP17732542A EP3469549B1 EP 3469549 B1 EP3469549 B1 EP 3469549B1 EP 17732542 A EP17732542 A EP 17732542A EP 3469549 B1 EP3469549 B1 EP 3469549B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- points
- heart
- images
- value
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/08—Clinical applications
- A61B8/0883—Clinical applications for diagnosis of the heart
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
- A61B8/5223—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for extracting a diagnostic or physiological parameter from medical diagnostic data
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room
- A61B5/004—Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part
- A61B5/0044—Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part for the heart
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30048—Heart; Cardiac
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
Definitions
- the present invention relates to systems for analysing medical images, for example of the heart, and for measuring parameters of the imaged subject. It has application in echocardiography, but also with other imaging modalities such as X-ray computer tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET).
- CT X-ray computer tomography
- MRI magnetic resonance imaging
- PET positron emission tomography
- Echocardiography is widely used as a method of imaging the heart. It uses a series of rapidly acquired pulse-echo ultrasound images to build up, for example, a real time video image of the heart.
- the images are typically two dimensional (2D) and the images are typically analysed visually by a skilled clinician, although computer analysis of the images is known, for example from US8077944 and " Quantification of regional atrial contraction in the fetal heart using the parameters strain and velocity-a tissue Doppler imaging (TDI) study", Steinhard J. et. al., Ultrasound in Obstetrics and Gynecology, vol. 30, no. 4, page 519 .
- stress echocardiography the heart is imaged in a rest condition, i.e.
- DSE Dobutamine stress echo
- the present invention provides a system for measuring deformation of the heart as defined in claim 1.
- the processing means may be arranged to compare the value of at least one parameter with reference data to generate a diagnostic output.
- the locating means may comprise a user input device arranged to enable a user to locate said pairs of points in the images and to record the positions of said pairs of points, for example by recording the coordinates of each of the points in a two dimensional coordinate system.
- the imaging system may be arranged to store the images as respective image data sets, and the locating means may be arranged to process the image data sets to determine the locations of said pairs of points and to record the positions of said pairs of points.
- the at least one parameter may comprise a plurality of parameters and the processing means may be arranged to compare the value of each of the parameters with a respective reference value.
- the system may be arranged to acquire a further set of two images of the heart at respective points in a cardiac cycle, with heart in a second condition, which is different from its condition when the first set of two images are acquired.
- one of the conditions may be a rest condition when the subject is at rest and one of the conditions may be a stress condition when the subject is under stress.
- Each of the parameters may be determined once for each set of images.
- One or more further parameters may be defined which combine data from the two sets of images. For example the difference in the value of one of the parameters, between the two sets of images, may be used as a further parameter.
- the processing means may be arranged to define a decision tree for generating the diagnostic output from the values of the parameters.
- the decision tree may include a plurality of decision points. Each decision point may define a reference value of one of the parameters. For example one of the decision points may define a reference value of the principal transformation, and/or one of the decision points may define a value of the shear transformation as described in more detail below, and/or one of the decision points may define a reference value of the difference between the principal transformation in the two different conditions of the heart.
- Systems for building decision trees from training data are well known, such as C4.5 and J48.
- the invention further provides a method of measuring deformation of the heart as defined in claim 9.
- the invention further provides a method of producing a system for diagnosing a heart condition, the method including analysing a set of images, wherein each of the images has a diagnostic outcome associated with it, the method including calculating a value of the at least one parameter for each of the images, analysing the values and the diagnostic outcomes to determine a relationship or correlation between the two.
- the method may further comprise using machine learning to develop a decision tree for generating the diagnostic output from the values of the parameters.
- the method may be performed on a computer system or processor system, which may form part of an imaging system, or may comprise a separate computer.
- the diagnostic output may relate to a variety of cardiac conditions, such as coronary artery disease (CAD), or mitral regurgitation, or hypertrophic cardiomyopathy.
- CAD coronary artery disease
- mitral regurgitation or hypertrophic cardiomyopathy.
- the imaging system may comprise an echocardiography system, or it may be an X-ray imaging system such as an X-ray computer tomography (CT) scanner, magnetic resonance imaging (MRI) scanner, or a positron emission tomography (PET) scanner.
- CT X-ray computer tomography
- MRI magnetic resonance imaging
- PET positron emission tomography
- the system or method may further comprise, in any workable combination, any one or more features or steps of the preferred embodiments of the invention, as will now be described with reference to the accompanying drawings.
- an echocardiography system 100 comprises a transducer array 102 arranged to be located close to the body of the patient 104, typically as close to the heart as possible, a processing unit 106 which includes a processor 108 which may be a digital electronic processor, a memory 110 such as a hard disk, and a display 112, such as a flat screen monitor or LED display.
- the system may further include a user input device, for example a touchscreen 114 integrated into the display 112, which provides a user input allowing a user to provide inputs to the system 100.
- Other user inputs such as a mouse, touchpad or keyboard may of course be used.
- the processor unit 106 is connected to the transducer array 102 and is arranged to control the transducer array as a phased array so as to emit an ultrasound beam which scans across the patient in a series of pulses, and detect reflected ultrasound from the heart from each pulse.
- One scan of the heart builds up a single image, and the scan is repeated at typically 25 to 50 images per second to build up a real time video image of the heart showing its movement during the cardiac cycle.
- Each image may be stored in the memory 110 as an image data set which may comprise, for example, intensity values for each of the pixels of which the image is made up.
- suitable echocardiography systems include, for example the Philips Epic iE33, GE vivid e9, or portable systems such as the Philips CX50, or hand held systems.
- LV left ventricle
- RV right ventricle
- LA left atrium
- RA right atrium
- views include, for example, an apical four chamber view, apical two or three chamber views and parasternal long and short axis views.
- a single still image can be obtained, typically a series of views is acquired over the cycle of the heart so that its movement can be recorded and analysed.
- the images are four chamber apical views, they show a 2D plane of the heart 200 showing the left ventricle 202, the right ventricle 204, the left atrium 206 and the right atrium 208.
- the plane includes the long axis 210 of the LV, also extends through the apex 212 of the LV, the lateral wall 214 of the LV and the septum 216.
- the echocardiography system 100 may be arranged to acquire at step 300 a sequence of 2D images and store them in its memory 110.
- the images may be acquired over a single cardiac cycle, and may include for example between ten and 50 images covering one cycle.
- the acquisition of the images can of course be carried out on a conventional echocardiography system 100.
- the following analysis of the images can be carried out using the same processing unit 106 that forms part of the echocardiography system as shown in Figure 1 .
- the images may be downloaded onto a computer, such as a laptop or PC, which has a processor, memory, user input and display, which operate for this purpose in the same way as those of the control unit 106, and the further analysis of the images may be carried out on that computer under the control of dedicated software.
- the images closest to end systole, i.e. maximum contraction, and end diastole, i.e. maximum volume of the LV may be identified. This can be done by a user viewing all of the images on the display 112 and selecting one of them as the closest to end systole and one of them as the closest to end diastole using the user input device 114. This selection may be made by the user on the basis of an assessment and comparison of the volume of the LV in each of the images as judged by eye, or by noting the points of opening and closing of the mitral valve, or using the QRS complex on an ECG plot, or by any combination of these. This is reasonably easy for a practiced clinician to do.
- the processor 108 may be arranged to use image processing techniques to identify, and measure the volume of, the LV in each of the images, compare the volumes of the LV in the different images, and identify the image with the smallest LV volume as the end systole image and the image with the largest LV volume as the end diastole image.
- the end systole and end diastole images may be identified in the memory 110, for example being marked with an appropriate flag, so that they can be selected and viewed by a user.
- the apex 402 and the base 404 may be identified by the user via the user input, or by image processing.
- the coordinate of each of the points 400a, 400b on the coordinate system may then be determined and recorded. Since the scale of the image is known from the echocardiography system, the coordinates of each of the points define the position of the point in the plane of the image, and therefore the distance between the two points in each pair indicates the distance moved by the relevant part of the heart between end systole and end diastole.
- the identification of the points may be done manually by a user selecting each of the points on each of the images using the user input 114, or it may be done by image processing software running on the system 100 and arranged to analyse the shapes of the LV in each of the end systole and end diastole images and identify specific points.
- a point at the apex 402a, 402b of the LV at both end systole and end diastole may include for each of the two images, for example, a point at the apex 402a, 402b of the LV at both end systole and end diastole, a point 404a, 406a, at one side of the base of the LV, and a point at the other side of the base of the LV, two points at the midpoint of the LV, two points at the start of the apex, and various intermediate points spaced between.
- the apex 602 of the LV can be located as the extreme end of the LV, and the base of the LV on each side 604, 605 can be located from the shape of the side walls.
- the y axis can then be defined as the line passing through the apex 602 and the midpoint between the two sides of the base 604, 605.
- the x axis can then be defined as the line perpendicular to the y axis half way between the apex and the midpoint between the two sides of the base.
- the mid-point on each side 606, 607 can be identified as the point where the x axis intersects the side wall on that side.
- each of these points may be identified by a user.
- image processing may be used to identify them. If image processing is used, the outline of the LV is first identified as the boundary between the lighter area within the LV and the darker area of the myocardium forming the walls around it (or vice versa for images acquired without use of a contrast agent). This boundary is not sharp, but algorithms for identifying such boundaries are well known.
- the algorithm may then be arranged to identify the highest point (maximum y value) of the boundary as being the apex 602, and the points where the boundary changes direction at the lower end, for example as can be seen at the point 605 on the right hand side of the base line in Figure 5a .
- the algorithm may then be arranged to identify these points, and the points 608, 609 at the lower end of the apex.
- points on the walls of the LV can be identified, either manually or by the processor using simple algorithms. For example these might be points on the side walls equally spaced in the y direction between the points indicated in Figure 5a .
- the processor may be arranged at step 306 to calculate, from the two coordinate sets, the transformation in geometry of the LV between end systole and end diastole.
- the processor may be arranged to use the coordinate sets to calculate movement in one or more directions as will now be described in more detail.
- the processor 108 is arranged to calculate, for the deformation of the shape of the LV between end systole and end diastole, values for various parameters that quantify the movement of the LV between end systole and end diastole.
- the calculation may include working out how far each point has moved in each of the x and y directions, by working out the change in position (End diastole - End systole) along both the x axis and the y axis.
- Each of these values may be a simple distance with no indication of direction.
- the mean change of all the points in both the x axis ( ⁇ X) and y axis ( ⁇ Y) may then be calculated separately so as to provide an average ⁇ x value or x direction movement ⁇ X, and an average ⁇ y value or y direction movement ⁇ Y for the entire ventricle. If each of the individual movement values are purely distance, without any indication of whether they are in the positive or negative x or y direction, then these averages will describe the total amount of movement, but not give an indication of the direction or of whether different parts of the LV wall are moving in the same direction or opposite directions.
- the mean of all the values of ⁇ xy for all points can then be calculated to a value for the entire ventricle ⁇ XY.
- This calculation is similar to the calculation of shear strain and is therefore referred to herein as the shear transformation. It will be appreciated that, for a given distance of movement, this parameter will be largest for movements at 45 degrees to both of the x and y axes, and smallest for movements along one of the axes.
- C1 may be 1 ⁇ 2 and C2 may be 4.
- This transformation is closely related to the shear transformation and therefore tends to vary in a similar way to that parameter, but has a negative value indicating contraction of the heart.
- the principal transformation value can give a more reliable diagnosis in some cases, in particular of CAD.
- each of these parameters relates to changes between end systole and end diastole in a single coronary cycle.
- stress echocardiography (or corresponding tests carried out with other imaging methods) there will be one value for each parameter for the heart at rest and one value for the heart at stress. Comparing those values, for example determining the difference between them, gives further information about heart function that can be used in diagnosis.
- the processor is then arranged at step 308 to compare these with reference values stored in the memory 110 to make a diagnosis of one or more specific heart conditions, and to generate a diagnostic output.
- the output may be a simple binary output indicating a positive or negative diagnosis.
- the processor unit 106 may be arranged to display the output on the display 112. Alternatively, or in addition, it may be arranged to store the output as data in association with the images on which it was based, for example by adding output data, indicative of the diagnosis, to a file in which the images are stored.
- the reference values may for example be determined by analysis of images of hearts some of which do and some of which do not have the specific heart conditions to determine for example threshold values which are indicative of a specific condition.
- the reference values can be determined by means of a learning algorithm which, for example, can be run on the processor unit 106, and which uses a database of stress echo images with associated diagnoses as determined by conventional methods, which may be stored in the memory 110.
- the database may include a large number of sets of images, each set comprising an end systole image and an end diastole image for both rest condition and stress condition, together with, for each set of images, an associated diagnosis, such as a positive or negative diagnosis for CAD.
- the learning algorithm may be arranged to analyse the images to calculate values of the various parameters described above, and then to determine the correlation between the diagnosis and the values of each of the various parameters.
- machine learning may be used to determine the accuracy of each parameter as an indicator of adjusted DSE outcome.
- a J48 pruned decision tree with 10 fold cross validation method was used to classify the data.
- the accuracy of each parameter as an indicator of diagnostic outcome is summarized in the tables below, in which the following abbreviations used are:
- the decision tree defines a series of decision points, each of which defines a reference or threshold value of a parameter.
- the decision tree outlines a simple algorithm which operates as follows. Firstly the principal transformation of the LV as described above is determined for the stress condition of the heart. If the transformation is less than - 5.95mm (i.e. a negative value with magnitude greater than 5.95mm) then the diagnosis is negative. If the value is greater than -5.95mm then difference in principal transformation between rest and stress conditions is greater than 12.278053mm then the diagnosis is negative, but if it is less than that distance, the diagnosis is positive. It will be appreciated that the structure of the decision tree, and the reference or threshold values at each decision point in the decision tree, will depend on the diagnosis that is to be made.
- Table 11 illustrates that the principal transformation is reduced in other disease cohorts (hypertrophic cardiomyopathy (HCM) and mitral regurgitation) implying it is also sensitive at detecting hypertrophy, cardiomyopathies and valve disorders. Notice that the principal vector was reduced in both the 4 chamber and the 2 chamber views indicating that it is sensitive at detecting abnormalities in the heart from just a single plane. Specifically with regard to HCM where the hypertrophy occurred only in the 4 chamber view yet the principal transformation was still significantly reduced in the 2 chamber view.
- HCM hypertrophic cardiomyopathy
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Pathology (AREA)
- Animal Behavior & Ethology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Biophysics (AREA)
- Heart & Thoracic Surgery (AREA)
- Veterinary Medicine (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Cardiology (AREA)
- Theoretical Computer Science (AREA)
- Physiology (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Image Analysis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Image Processing (AREA)
Description
- The present invention relates to systems for analysing medical images, for example of the heart, and for measuring parameters of the imaged subject. It has application in echocardiography, but also with other imaging modalities such as X-ray computer tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET).
- Echocardiography is widely used as a method of imaging the heart. It uses a series of rapidly acquired pulse-echo ultrasound images to build up, for example, a real time video image of the heart. The images are typically two dimensional (2D) and the images are typically analysed visually by a skilled clinician, although computer analysis of the images is known, for example from
US8077944 and "Quantification of regional atrial contraction in the fetal heart using the parameters strain and velocity-a tissue Doppler imaging (TDI) study", Steinhard J. et. al., Ultrasound in Obstetrics and Gynecology, vol. 30, no. 4, page 519. In stress echocardiography, the heart is imaged in a rest condition, i.e. when the subject is at rest, and under a stress condition, for example after exercise. The function of the heart in the two conditions can be compared to provide information on how it responds to stress. If it is not appropriate for the subject to be exercised, then stress can be induced or simulated, for example by injecting a stimulant such as dobutamine into the subject. Dobutamine stress echo (DSE) is widely used in diagnosing coronary artery disease (CAD). - The present invention provides a system for measuring deformation of the heart as defined in claim 1.
- The processing means may be arranged to compare the value of at least one parameter with reference data to generate a diagnostic output.
- The at least one parameter may include any one or more of: a displacement in at least one direction of a part of the heart; a mean, for all of said parts of the heart, of the displacements in at least one direction; the mean, for all of said parts of the heart, of that sum of displacements; and the principle transformation which is described in more detail below.
- The locating means may comprise a user input device arranged to enable a user to locate said pairs of points in the images and to record the positions of said pairs of points, for example by recording the coordinates of each of the points in a two dimensional coordinate system.
- The imaging system may be arranged to store the images as respective image data sets, and the locating means may be arranged to process the image data sets to determine the locations of said pairs of points and to record the positions of said pairs of points.
- The at least one parameter may comprise a plurality of parameters and the processing means may be arranged to compare the value of each of the parameters with a respective reference value.
- The system may be arranged to acquire a further set of two images of the heart at respective points in a cardiac cycle, with heart in a second condition, which is different from its condition when the first set of two images are acquired. For example one of the conditions may be a rest condition when the subject is at rest and one of the conditions may be a stress condition when the subject is under stress. Each of the parameters may be determined once for each set of images. One or more further parameters may be defined which combine data from the two sets of images. For example the difference in the value of one of the parameters, between the two sets of images, may be used as a further parameter.
- The processing means may be arranged to define a decision tree for generating the diagnostic output from the values of the parameters. The decision tree may include a plurality of decision points. Each decision point may define a reference value of one of the parameters. For example one of the decision points may define a reference value of the principal transformation, and/or one of the decision points may define a value of the shear transformation as described in more detail below, and/or one of the decision points may define a reference value of the difference between the principal transformation in the two different conditions of the heart. Systems for building decision trees from training data are well known, such as C4.5 and J48.
- The invention further provides a method of measuring deformation of the heart as defined in claim 9.
- The invention further provides a method of producing a system for diagnosing a heart condition, the method including analysing a set of images, wherein each of the images has a diagnostic outcome associated with it, the method including calculating a value of the at least one parameter for each of the images, analysing the values and the diagnostic outcomes to determine a relationship or correlation between the two.
- The method may further comprise using machine learning to develop a decision tree for generating the diagnostic output from the values of the parameters. The method may be performed on a computer system or processor system, which may form part of an imaging system, or may comprise a separate computer.
- The diagnostic output may relate to a variety of cardiac conditions, such as coronary artery disease (CAD), or mitral regurgitation, or hypertrophic cardiomyopathy.
- The imaging system may comprise an echocardiography system, or it may be an X-ray imaging system such as an X-ray computer tomography (CT) scanner, magnetic resonance imaging (MRI) scanner, or a positron emission tomography (PET) scanner.
- The system or method may further comprise, in any workable combination, any one or more features or steps of the preferred embodiments of the invention, as will now be described with reference to the accompanying drawings.
-
-
Figure 1 is a schematic view of a system according to an embodiment of the invention; -
Figure 2 shows schematically a four chamber view of a heart; -
Figure 3 is a flow diagram showing the main steps of a diagnostic method performed by the system ofFigure 1 ; -
Figure 4 is a schematic view of a comparison of two images performed by the system ofFigure 1 ; -
Figures 5a and 5b show a sample image at two stages of the analysis as performed by the system ofFigure 1 ; -
Figures 6a and 6b show the results of analysis of sample data obtained using the system of Figure; and -
Figure 7 is a flow diagram showing the algorithm used to produce the results ofFigures 6a and 6b . - Referring to
Figure 1 , an echocardiography system 100 comprises a transducer array 102 arranged to be located close to the body of the patient 104, typically as close to the heart as possible, a processing unit 106 which includes a processor 108 which may be a digital electronic processor, a memory 110 such as a hard disk, and a display 112, such as a flat screen monitor or LED display. The system may further include a user input device, for example a touchscreen 114 integrated into the display 112, which provides a user input allowing a user to provide inputs to the system 100. Other user inputs such as a mouse, touchpad or keyboard may of course be used. The processor unit 106 is connected to the transducer array 102 and is arranged to control the transducer array as a phased array so as to emit an ultrasound beam which scans across the patient in a series of pulses, and detect reflected ultrasound from the heart from each pulse. One scan of the heart builds up a single image, and the scan is repeated at typically 25 to 50 images per second to build up a real time video image of the heart showing its movement during the cardiac cycle. Each image may be stored in the memory 110 as an image data set which may comprise, for example, intensity values for each of the pixels of which the image is made up. - While the system is described in general terms above, suitable echocardiography systems include, for example the Philips Epic iE33, GE vivid e9, or portable systems such as the Philips CX50, or hand held systems.
- The process of echocardiography is well known and will not be described in detail. There are several different imaging methods, but two dimensional imaging may be used. It is known to provide images on several different planes through the heart, which show different aspects of the four main chambers of the heart, the left ventricle (LV), right ventricle (RV), left atrium (LA) and right atrium (RA). Such views include, for example, an apical four chamber view, apical two or three chamber views and parasternal long and short axis views. In each case, while a single still image can be obtained, typically a series of views is acquired over the cycle of the heart so that its movement can be recorded and analysed.
- Referring to
Figure 2 , if the images are four chamber apical views, they show a 2D plane of the heart 200 showing the left ventricle 202, the right ventricle 204, the left atrium 206 and the right atrium 208. The plane includes the long axis 210 of the LV, also extends through the apex 212 of the LV, the lateral wall 214 of the LV and the septum 216. - Referring to
Figure 3 , the echocardiography system 100 may be arranged to acquire at step 300 a sequence of 2D images and store them in its memory 110. The images may be acquired over a single cardiac cycle, and may include for example between ten and 50 images covering one cycle. The acquisition of the images can of course be carried out on a conventional echocardiography system 100. The following analysis of the images can be carried out using the same processing unit 106 that forms part of the echocardiography system as shown inFigure 1 . However the images may be downloaded onto a computer, such as a laptop or PC, which has a processor, memory, user input and display, which operate for this purpose in the same way as those of the control unit 106, and the further analysis of the images may be carried out on that computer under the control of dedicated software. - At step 302, the images closest to end systole, i.e. maximum contraction, and end diastole, i.e. maximum volume of the LV, may be identified. This can be done by a user viewing all of the images on the display 112 and selecting one of them as the closest to end systole and one of them as the closest to end diastole using the user input device 114. This selection may be made by the user on the basis of an assessment and comparison of the volume of the LV in each of the images as judged by eye, or by noting the points of opening and closing of the mitral valve, or using the QRS complex on an ECG plot, or by any combination of these. This is reasonably easy for a practiced clinician to do. Alternatively the processor 108 may be arranged to use image processing techniques to identify, and measure the volume of, the LV in each of the images, compare the volumes of the LV in the different images, and identify the image with the smallest LV volume as the end systole image and the image with the largest LV volume as the end diastole image. In either case, once the end systole and end diastole images have been identified, they may be identified in the memory 110, for example being marked with an appropriate flag, so that they can be selected and viewed by a user.
- Referring to
Figure 4 , once the end systole and end diastole images have been identified, corresponding points 401 on the wall of the LV at end systole 400a and at end diastole 400b may be identified at step 304. A Cartesian coordinate system may also be defined, for example having a vertical axis (referred to as the y axis herein) through the apex 402 of the LV and extending along its longitudinal axis, and a horizontal axis (referred to as the x axis herein) through the mid-point of the LV half way between its apex 402 and its base 404. The apex 402 and the base 404 may be identified by the user via the user input, or by image processing. The coordinate of each of the points 400a, 400b on the coordinate system may then be determined and recorded. Since the scale of the image is known from the echocardiography system, the coordinates of each of the points define the position of the point in the plane of the image, and therefore the distance between the two points in each pair indicates the distance moved by the relevant part of the heart between end systole and end diastole. Again, the identification of the points may be done manually by a user selecting each of the points on each of the images using the user input 114, or it may be done by image processing software running on the system 100 and arranged to analyse the shapes of the LV in each of the end systole and end diastole images and identify specific points. These may include for each of the two images, for example, a point at the apex 402a, 402b of the LV at both end systole and end diastole, a point 404a, 406a, at one side of the base of the LV, and a point at the other side of the base of the LV, two points at the midpoint of the LV, two points at the start of the apex, and various intermediate points spaced between. Some of these points are described in more detail below with reference toFigures 5a and 5b . - Referring to
Figure 5a , which shows an echo image acquired with a contrast agent, in each of the images of the LV, the apex 602 of the LV can be located as the extreme end of the LV, and the base of the LV on each side 604, 605 can be located from the shape of the side walls. The y axis can then be defined as the line passing through the apex 602 and the midpoint between the two sides of the base 604, 605. The x axis can then be defined as the line perpendicular to the y axis half way between the apex and the midpoint between the two sides of the base. The mid-point on each side 606, 607 can be identified as the point where the x axis intersects the side wall on that side. The lower end of the apex on each side 608, 609 can also be identified where the sidewalls start to taper towards the apex 602. As mentioned above, each of these points may be identified by a user. Alternatively image processing may be used to identify them. If image processing is used, the outline of the LV is first identified as the boundary between the lighter area within the LV and the darker area of the myocardium forming the walls around it (or vice versa for images acquired without use of a contrast agent). This boundary is not sharp, but algorithms for identifying such boundaries are well known. Once the boundary has been identified, the algorithm may then be arranged to identify the highest point (maximum y value) of the boundary as being the apex 602, and the points where the boundary changes direction at the lower end, for example as can be seen at the point 605 on the right hand side of the base line inFigure 5a . Again algorithms for analysing the radius and direction of curvature, and how that changes around the boundary, can be used to identify these points, and the points 608, 609 at the lower end of the apex. - Referring to
Figure 5b , further points on the walls of the LV can be identified, either manually or by the processor using simple algorithms. For example these might be points on the side walls equally spaced in the y direction between the points indicated inFigure 5a . - Referring back to
Figure 3 , once all of these points have been identified, their x and y coordinates in the Cartesian coordinate system may be stored in the memory 110, for example as an end systole coordinate set including the coordinates of the points on the end systole image and an end diastole coordinate set including the coordinates of the points on the end diastole image. The processor may be arranged at step 306 to calculate, from the two coordinate sets, the transformation in geometry of the LV between end systole and end diastole. For example the processor may be arranged to use the coordinate sets to calculate movement in one or more directions as will now be described in more detail. - Referring back to
Figure 4 , the processor 108 is arranged to calculate, for the deformation of the shape of the LV between end systole and end diastole, values for various parameters that quantify the movement of the LV between end systole and end diastole. - The calculation may include working out how far each point has moved in each of the x and y directions, by working out the change in position (End diastole - End systole) along both the x axis and the y axis. This gives a set of x axis movements Δx, with one value for each corresponding pair of points, as shown in
Figure 4 for the points 404a, 404b, and a set of y axis movements Δy, again with one value for each corresponding pair of points. Each of these values may be a simple distance with no indication of direction. The mean change of all the points in both the x axis (ΔX) and y axis (ΔY) may then be calculated separately so as to provide an average Δx value or x direction movement ΔX, and an average Δy value or y direction movement ΔY for the entire ventricle. If each of the individual movement values are purely distance, without any indication of whether they are in the positive or negative x or y direction, then these averages will describe the total amount of movement, but not give an indication of the direction or of whether different parts of the LV wall are moving in the same direction or opposite directions. - Another parameter that maybe calculated is, for each point on the LV, i.e. each pair of points on the images, to calculate the mean of the x and y direction movements Δx and Δy, where the mean value for each point Δxy=(Δx+Δy)/2. The mean of all the values of Δxy for all points can then be calculated to a value for the entire ventricle ΔXY. This calculation is similar to the calculation of shear strain and is therefore referred to herein as the shear transformation. It will be appreciated that, for a given distance of movement, this parameter will be largest for movements at 45 degrees to both of the x and y axes, and smallest for movements along one of the axes.
- A further parameter that can be calculated is similar to the principal transformation that can be calculated from x and y strain components, and is therefore referred to herein as the principal transformation, given by
where C1 and C2 are constants. For example C1 may be ½ and C2 may be 4. These values were used in the examples described below. - This transformation is closely related to the shear transformation and therefore tends to vary in a similar way to that parameter, but has a negative value indicating contraction of the heart. However, as indicated by the test results below, the principal transformation value can give a more reliable diagnosis in some cases, in particular of CAD.
- It will be appreciated that each of these parameters relates to changes between end systole and end diastole in a single coronary cycle. However in stress echocardiography, (or corresponding tests carried out with other imaging methods) there will be one value for each parameter for the heart at rest and one value for the heart at stress. Comparing those values, for example determining the difference between them, gives further information about heart function that can be used in diagnosis.
- Once the x and y movements, and shear and principal transformation values have been calculated, the processor is then arranged at step 308 to compare these with reference values stored in the memory 110 to make a diagnosis of one or more specific heart conditions, and to generate a diagnostic output. The output may be a simple binary output indicating a positive or negative diagnosis. The processor unit 106 may be arranged to display the output on the display 112. Alternatively, or in addition, it may be arranged to store the output as data in association with the images on which it was based, for example by adding output data, indicative of the diagnosis, to a file in which the images are stored.
- The reference values may for example be determined by analysis of images of hearts some of which do and some of which do not have the specific heart conditions to determine for example threshold values which are indicative of a specific condition.
- The reference values can be determined by means of a learning algorithm which, for example, can be run on the processor unit 106, and which uses a database of stress echo images with associated diagnoses as determined by conventional methods, which may be stored in the memory 110. Specifically the database may include a large number of sets of images, each set comprising an end systole image and an end diastole image for both rest condition and stress condition, together with, for each set of images, an associated diagnosis, such as a positive or negative diagnosis for CAD. The learning algorithm may be arranged to analyse the images to calculate values of the various parameters described above, and then to determine the correlation between the diagnosis and the values of each of the various parameters.
- Analysis was carried out on sample images from 70 subjects. All results generated were from an apical 4 chamber view. Firstly the values were compared for positive and negative outcomes as determined from the DSE results. Then the comparison was repeated with the DSE results corrected for confirmed false positives in the DSE results.
Table 1 Shows values of the principal transformation (in mm), shear transformation value (in mm), and mean ΔX (in mm) at rest and stress for DSE outcome (1= Pos, 2= Neg) in the Apical 4 Chamber view. Group Statistics DSE_Result N Mean Std. Deviation Std. Error Mean Stress_Prin 1.00 9 -6.8214 4.08788 1.36263 2.00 61 -8.9260 2.20018 .28170 Rest_Prin 1.00 9 -7.7332 3.86497 1.28832 2.00 61 -9.3163 2.41589 .30932 Rest_Shr 1.00 9 17.7267 9.16943 3.05648 2.00 61 21.5356 5.50610 .70498 Stress_Shr 1.00 9 17.0074 8.06969 2.68990 2.00 61 22.2608 4.56871 .58496 Rest_X 1.00 9 18.8694 11.02116 3.67372 2.00 61 21.8492 6.65078 .85155 Stress_X 1.00 9 19.9334 9.80639 3.26880 2.00 61 25.8710 7.43965 .95255 Table 2 Shows means of Principal transformation value (in mm), Shear transformation (in mm) and X transformation (in mm) at rest and stress for Adjusted DSE outcome (1= Pos, 2= Neg). Group Statistics Adjusted_DSE N Mean Std. Deviation Std. Error Mean Stress_Prin 1.00 7 -4.4716 1.29120 .48803 2.00 63 -9.1203 2.24588 .28295 Rest_Prin 1.00 7 -5.3352 1.21275 .45838 2.00 63 -9.5325 2.44136 .30758 Rest_Shr 1.00 7 12.0645 2.74525 1.03761 2.00 63 22.0438 5.58342 .70344 Stress_Shr 1.00 7 12.2348 3.81629 1.44242 2.00 63 22.6243 4.44025 .55942 Rest_X 1.00 7 11.6937 2.73459 1.03358 2.00 63 22.5519 6.84823 .86280 Stress_X 1.00 7 14.1727 4.81157 1.81860 2.00 63 26.3226 7.29318 .91885 Table 3 Shows Independent samples T-Test for variables vs adjusted DSE. Independent Samples Test Levene's Test for Equality of Variances F Sig. t df Sig. (2-tailed) Stress_Prin Equal variances assumed 1.705 .196 6.356 68 .000 Equal variances not assumed 8.240 10.596 .000 Rest_Prin Equal variances assumed 2.355 .130 4.466 68 .000 Equal variances not assumed 7.604 12.377 .000 Rest_8hr Equal variances assumed 2.106 .151 -4.644 68 .000 Equal variances not assumed -7961 12.527 .000 Stress_8hr Equal variances assumed .194 .661 -5.942 68 .000 Equal variances not assumed -6.715 7.923 .000 Rest_x Equal variances assumed 6.696 .020 -4.136 68 .000 Equal variances not assumed -8.065 16.500 .000 Stress_x Equal variances assumed .927 .339 -4.290 68 .000 Equal variances not assumed -5.963 9.395 .000 - From the values of the various parameters obtained from the sample data, machine learning may be used to determine the accuracy of each parameter as an indicator of adjusted DSE outcome. Using the data above, a J48 pruned decision tree with 10 fold cross validation method was used to classify the data. The accuracy of each parameter as an indicator of diagnostic outcome is summarized in the tables below, in which the following abbreviations used are:
- TP = true positive
- FP = false positive
- FN = false negative
- TN = true negative
- PPV = positive predictive value
- NPV = negative predictive value
- Then from all of the variables, using machine learning, a decision tree which is shown in
Figure 7 was derived to provide accurate diagnosis from the data. The decision tree defines a series of decision points, each of which defines a reference or threshold value of a parameter. The decision tree outlines a simple algorithm which operates as follows. Firstly the principal transformation of the LV as described above is determined for the stress condition of the heart. If the transformation is less than - 5.95mm (i.e. a negative value with magnitude greater than 5.95mm) then the diagnosis is negative. If the value is greater than -5.95mm then difference in principal transformation between rest and stress conditions is greater than 12.278053mm then the diagnosis is negative, but if it is less than that distance, the diagnosis is positive. It will be appreciated that the structure of the decision tree, and the reference or threshold values at each decision point in the decision tree, will depend on the diagnosis that is to be made. - The decision tree was then used on the sample data to test its accuracy and the outcome is given below.
-
Table 9 Accuracy of J48 decision tree for Adjusted DSE Outcome J48 Value = Fig. 1 AlgorithmTP = 5 FN = 2 Accuracy = 100% FP = 4 TN = 59 Sensitivity = 100% PPV = 100 % Specificity = 100 % NPV = 100% - To test whether a 2 chamber view could be used instead of a 4 chamber view in a similar diagnostic system, two chamber views corresponding to each of the four chamber views in the sample data were analysed in the same way to derive the same parameters of principal transformation, shear transformation, and radial (X) and longitudinal (Y) movements.
Table 10 Intraclass correlation coefficient of translation measurement parameters between 4 chamber and 2 chamber views. Prin transformation 0.84 Radial displacement (ΔX) -0.23 Shear transformation 0.36 Longitudinal displacement (ΔY) -0.532 - A very significant result is the similarity in principal transformation values between the 4 and 2 chamber view. This implies that not only is the principal vector a sensitive parameter for detecting disease, it also implies that it gives a 3D functional assessment from a 2D view
Table 11. Principal transformation value stats for other Disease Cohorts Principal transformation 2ch Principal transformation 4ch HCM -4.5 -3.6 Mitral Regurgitation -6.0 -6.1 Healthy -7.7 -7.5 - Table 11 illustrates that the principal transformation is reduced in other disease cohorts (hypertrophic cardiomyopathy (HCM) and mitral regurgitation) implying it is also sensitive at detecting hypertrophy, cardiomyopathies and valve disorders. Notice that the principal vector was reduced in both the 4 chamber and the 2 chamber views indicating that it is sensitive at detecting abnormalities in the heart from just a single plane. Specifically with regard to HCM where the hypertrophy occurred only in the 4 chamber view yet the principal transformation was still significantly reduced in the 2 chamber view.
- It will be appreciated that analysis of images in just one plane can be used to diagnose a range of diseases, and that various different parameters can be used to develop a decision tree which provides more accurate diagnosis than a single parameter.
| J48 | TP = 6 | FN = 1 |
| Accuracy = 94.3% | FP = 3 | TN = 60 |
| Sensitivity = 85.7% | PPV = 66.7% | |
| Specificity = 95% | NPV = 98.4% | |
| J48 Value = -5.95 | TP = 7 | FN = 0 |
| Accuracy = 95.7% | FP = 3 | TN = 60 |
| Sensitivity = 100% | PPV = 70% | |
| Specificity = 95.2% | NPV = 100% | |
| J48 Value = -6.92 | TP = 5 | FN = 2 |
| Accuracy = 88.6% | FP = 6 | TN = 57 |
| Sensitivity = 71.4 | PPV = 45.5 % | |
| Specificity = 90.5% | NPV = 96.6% | |
| J48 Value = 15.85 | TP = 6 | FN = 1 |
| Accuracy = 95.7% | FP = 2 | TN = 61 |
| Sensitivity = 85.7% | PPV = 85.7 | |
| Specificity = 96.8 % | NPV = 98.4 | |
| J48 Value = 15.35 | TP = 5 | FN = 2 |
| Accuracy = 91.4% | FP = 4 | TN = 59 |
| Sensitivity = 71.4 | PPV = 55.6% | |
| Specificity = 93.7 % | NPV = 96.7% | |
Claims (15)
- A system (100) for measuring deformation of a heart, the system (100) comprising:an imaging system arranged to acquire two images of the heart at respective points in the cardiac cycle;locating means for locating a series of pairs of points on the images, each pair of points indicating the respective positions of a single part of the heart in two images;processing means (106, 108) arranged to:
calculate from the positions of said pairs of points a value of at least one parameter of the deformation of the heart, characterized in that the at least one parameter includes the sum of displacements in the longitudinal and radial directions for at least one of said parts of the heart. - A system according to claim 1 for diagnosing a heart condition wherein the processing means are further arranged to compare the value of the at least one parameter with reference data to generate a diagnostic output.
- The system according to claim 1 or 2, wherein the at least one parameter further includes principal transformation, wherein the principal transformation = C1(ΔX+ΔY-√(ΔX+ΔY)^2+ C2ΔXY^2), wherein C1 and C2 are constants and wherein ΔX is calculated as an average of Δx values, ΔY is calculated as an average of Δy values and ΔXY is calculated as the mean of all the values Δxy=(Δx+Δy)/2, wherein there is a set of x axis movements Δx, with one value for each corresponding pair of points and there is a set of y axis movements Δy, with one value for each corresponding pair of points.
- The system according to claim 1, wherein the at least one parameter further includes a displacement in at least one direction, optionally wherein the displacement is a mean of the displacements for all of said parts of the heart in at least one direction.
- The system according to any preceding claim, wherein the locating means comprises a user input device arranged to enable a user to locate said pairs of points and to record the positions of said pairs of points.
- The system according to any one of claims 1 to 4, wherein the imaging system is arranged to store the images as respective image data sets, and the locating means is arranged to process the image data sets to determine the locations of said pairs of points and to record the positions of said pairs of points.
- The system according to any preceding claim, wherein the at least one parameter comprises a plurality of parameters and the processing means is arranged to compare the value of each of the parameters with a respective reference value.
- The system according to claim 7, wherein the processing means is arranged to define a decision tree for generating the diagnostic output from the values of the parameters.
- A processor system implemented method of measuring deformation of a heart, the method comprising:acquiring two images of the heart at respective points in the cardiac cycle;locating a series of pairs of points on the images, each pair of points indicating the respective positions of a single part of the heart in the two images;
calculating from the positions of said pairs of points at least one parameter of deformation of the heart, characterized in that the at least one parameter includes the sum of displacements in the longitudinal and radial directions for at least one of said parts of the heart. - The method according to claim 9, wherein the at least one parameter further includes principal transformation, wherein the principal transformation = C1(ΔX+ΔY-√(ΔX+ΔY)^2+ C2ΔXY^2), wherein C1 and C2 are constants and wherein ΔX is calculated as an average of Δx values, ΔY is calculated as an average of Δy values and ΔXY is calculated as the mean of all the values Δxy=(Δx+Δy)/2, wherein there is a set of x axis movements Δx, with one value for each corresponding pair of points and there is a set of y axis movements Δy, with one value for each corresponding pair of points.
- The method according to claim 9 or 10, wherein the at least one parameter further includes a displacement in at least one direction.
- The method according to claim 11, wherein the displacement is a mean of the displacements for all of said parts of the heart in at least one direction.
- The method according to any one of claims 9 to 12, further comprising processing the image data sets to determine the locations of said pairs of points and recording the positions of said pairs of points.
- The method according to any one of claims 9 to 12, wherein the at least one parameter comprises a plurality of parameters and the processing means is arranged to compare the value of each of the parameters with a respective reference value.
- The method according to any one of claims 9 to 14, further comprising defining a decision tree for generating the diagnostic output from the values of the parameters.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GBGB1610269.1A GB201610269D0 (en) | 2016-06-13 | 2016-06-13 | Image-based diagnostic systems |
| PCT/GB2017/051720 WO2017216545A1 (en) | 2016-06-13 | 2017-06-13 | Image-based diagnostic systems |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| EP3469549A1 EP3469549A1 (en) | 2019-04-17 |
| EP3469549B1 true EP3469549B1 (en) | 2025-08-20 |
| EP3469549C0 EP3469549C0 (en) | 2025-08-20 |
Family
ID=56894845
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP17732542.0A Active EP3469549B1 (en) | 2016-06-13 | 2017-06-13 | Image-based diagnostic systems |
Country Status (10)
| Country | Link |
|---|---|
| US (3) | US10959698B2 (en) |
| EP (1) | EP3469549B1 (en) |
| JP (2) | JP6987131B2 (en) |
| KR (1) | KR20190032348A (en) |
| CN (1) | CN109661682B (en) |
| AU (1) | AU2017286613A1 (en) |
| BR (1) | BR112018075961A2 (en) |
| GB (1) | GB201610269D0 (en) |
| SG (1) | SG11201811125XA (en) |
| WO (1) | WO2017216545A1 (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB201610269D0 (en) | 2016-06-13 | 2016-07-27 | Isis Innovation | Image-based diagnostic systems |
| GB2569333A (en) | 2017-12-13 | 2019-06-19 | Univ Oxford Innovation Ltd | Diagnostic modelling method and apparatus |
| GB2569332B (en) | 2017-12-13 | 2021-06-09 | Univ Oxford Innovation Ltd | Method and apparatus for analysing images |
| CN111820947B (en) * | 2019-04-19 | 2023-08-29 | 无锡祥生医疗科技股份有限公司 | Ultrasound cardiac reflux automatic capture method, system and ultrasound imaging equipment |
| US20220392065A1 (en) | 2020-01-07 | 2022-12-08 | Cleerly, Inc. | Systems, methods, and devices for medical image analysis, diagnosis, risk stratification, decision making and/or disease tracking |
| US11969280B2 (en) | 2020-01-07 | 2024-04-30 | Cleerly, Inc. | Systems, methods, and devices for medical image analysis, diagnosis, risk stratification, decision making and/or disease tracking |
| CA3162872A1 (en) | 2020-01-07 | 2021-07-15 | James K. MIN | Systems, methods, and devices for medical image analysis, diagnosis, risk stratification, decision making and/or disease tracking |
| JP7730828B2 (en) | 2020-03-06 | 2025-08-28 | ウルトロミクス・リミテッド | Estimation of cardiac parameters using neural networks |
| US12394049B2 (en) * | 2021-11-12 | 2025-08-19 | Northwestern University | Method and system for data extraction from echocardiographic strain graphs |
| US12406365B2 (en) | 2022-03-10 | 2025-09-02 | Cleerly, Inc. | Systems, devices, and methods for non-invasive image-based plaque analysis and risk determination |
| US12440180B2 (en) | 2022-03-10 | 2025-10-14 | Cleerly, Inc. | Systems, devices, and methods for non-invasive image-based plaque analysis and risk determination |
| US20250217981A1 (en) | 2022-03-10 | 2025-07-03 | Cleerly, Inc. | Systems, methods, and devices for image-based plaque analysis and risk determination |
| US20250143657A1 (en) | 2022-03-10 | 2025-05-08 | Cleerly, Inc. | Systems, devices, and methods for non-invasive image-based plaque analysis and risk determination |
| WO2024137796A1 (en) * | 2022-12-21 | 2024-06-27 | Cleerly, Inc. | Systems, devices, and methods for non-invasive image-based plaque analysis and risk determination |
Family Cites Families (47)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6728394B1 (en) * | 2000-02-14 | 2004-04-27 | Siemens Medical Solutions Usa, Inc. | Dynamic measurement of object parameters |
| US6491636B2 (en) * | 2000-12-07 | 2002-12-10 | Koninklijke Philips Electronics N.V. | Automated border detection in ultrasonic diagnostic images |
| US7526112B2 (en) * | 2001-04-30 | 2009-04-28 | Chase Medical, L.P. | System and method for facilitating cardiac intervention |
| WO2004068406A2 (en) * | 2003-01-30 | 2004-08-12 | Chase Medical, L.P. | A method and system for image processing and contour assessment |
| AU2004251360A1 (en) * | 2003-06-25 | 2005-01-06 | Siemens Medical Solutions Usa, Inc. | Automated regional myocardial assessment for cardiac imaging |
| US7912528B2 (en) | 2003-06-25 | 2011-03-22 | Siemens Medical Solutions Usa, Inc. | Systems and methods for automated diagnosis and decision support for heart related diseases and conditions |
| US7347821B2 (en) * | 2003-06-26 | 2008-03-25 | Koninklijke Philips Electronics N.V. | Adaptive processing of contrast enhanced ultrasonic diagnostic images |
| ATE550680T1 (en) * | 2003-09-30 | 2012-04-15 | Esaote Spa | METHOD FOR POSITION AND VELOCITY TRACKING OF AN OBJECT EDGE IN TWO OR THREE DIMENSIONAL DIGITAL ECHOGRAPHIC IMAGES |
| US20070014452A1 (en) * | 2003-12-01 | 2007-01-18 | Mitta Suresh | Method and system for image processing and assessment of a state of a heart |
| JP2005237555A (en) | 2004-02-25 | 2005-09-08 | Jgs:Kk | Heart wall motion evaluation method, heart wall motion evaluation apparatus and program |
| US20060074315A1 (en) * | 2004-10-04 | 2006-04-06 | Jianming Liang | Medical diagnostic ultrasound characterization of cardiac motion |
| US8280136B2 (en) * | 2005-09-16 | 2012-10-02 | The Ohio State University | Method and apparatus for detecting intraventricular dyssynchrony |
| WO2007054861A2 (en) | 2005-11-08 | 2007-05-18 | Koninklijke Philips Electronics, N.V. | Ultrasonic diagnosis of myocardial synchronization |
| US7828735B2 (en) * | 2006-05-11 | 2010-11-09 | The Trustees Of Columbia In The City Of New York | Methods for providing diagnostic information using endocardial surface data for a patient's heart |
| DE102006026695A1 (en) | 2006-06-08 | 2007-12-13 | Tomtec Imaging Systems Gmbh | Method, apparatus and computer program product for evaluating dynamic images of a cavity |
| US20070299479A1 (en) * | 2006-06-27 | 2007-12-27 | Ep Medsystems, Inc. | Method for Reversing Ventricular Dyssynchrony |
| JP5031758B2 (en) * | 2006-10-04 | 2012-09-26 | 株式会社日立メディコ | Medical diagnostic imaging equipment |
| US9275190B2 (en) * | 2007-04-23 | 2016-03-01 | Siemens Aktiengesellschaft | Method and system for generating a four-chamber heart model |
| JP4921253B2 (en) * | 2007-06-13 | 2012-04-25 | 富士フイルム株式会社 | Image processing apparatus and image processing program |
| JP4966108B2 (en) * | 2007-06-25 | 2012-07-04 | 株式会社東芝 | Ultrasonic diagnostic apparatus, ultrasonic image processing apparatus, and ultrasonic image processing program |
| US8491794B2 (en) | 2007-10-23 | 2013-07-23 | Siemens Industry, Inc. | Process for enhanced total organic carbon removal while maintaining optimum membrane filter performance |
| AU2008350849B2 (en) | 2008-02-19 | 2012-06-21 | Abb Schweiz Ag | On-line performance management of membrane separation process |
| JP4471230B2 (en) * | 2008-02-29 | 2010-06-02 | 財団法人大阪産業振興機構 | Apparatus and method for measuring circulatory system hardness |
| US8170312B2 (en) * | 2008-06-17 | 2012-05-01 | Siemens Medical Solutions Usa, Inc. | Respiratory motion compensated cardiac wall motion determination system |
| JP5764058B2 (en) * | 2008-07-10 | 2015-08-12 | コーニンクレッカ フィリップス エヌ ヴェ | Ultrasound assessment of cardiac synchrony and viability |
| US8538103B2 (en) * | 2009-02-10 | 2013-09-17 | Hitachi Medical Corporation | Medical image processing device, medical image processing method, medical image diagnostic apparatus, operation method of medical image diagnostic apparatus, and medical image display method |
| EP2415401A4 (en) * | 2009-03-31 | 2017-04-19 | Hitachi, Ltd. | Medical image diagnosis device and volume calculating method |
| JP2011056345A (en) | 2009-09-07 | 2011-03-24 | Toshiba Corp | Desalination system |
| US8396268B2 (en) | 2010-03-31 | 2013-03-12 | Isis Innovation Limited | System and method for image sequence processing |
| JP5323795B2 (en) * | 2010-10-12 | 2013-10-23 | 富士フイルム株式会社 | Diagnosis support apparatus, diagnosis support program, and diagnosis support method |
| US8777856B2 (en) | 2012-06-26 | 2014-07-15 | General Electric Company | Diagnostic system and method for obtaining an ultrasound image frame |
| US9508140B2 (en) * | 2012-08-27 | 2016-11-29 | Agency For Science, Technology And Research | Quantifying curvature of biological structures from imaging data |
| WO2014054660A1 (en) * | 2012-10-01 | 2014-04-10 | 株式会社東芝 | Image processing device and x-ray ct device |
| JP6238672B2 (en) * | 2012-10-04 | 2017-11-29 | 東芝メディカルシステムズ株式会社 | Ultrasonic diagnostic equipment |
| US10130332B2 (en) * | 2013-08-06 | 2018-11-20 | Samsung Electronics Co., Ltd. | Method and apparatus of diagnosing cardiac diseases based on modeling of cardiac motion |
| US10776998B1 (en) * | 2014-02-28 | 2020-09-15 | University Of Louisville Research Foundation, Inc. | Method and system for analysis of 3D deformations and regional function of a heart with 3D SinMod |
| US9380940B2 (en) * | 2014-05-05 | 2016-07-05 | Pacesetter, Inc. | Method and system for displaying a three dimensional visualization of cardiac motion |
| CA2948046A1 (en) * | 2014-05-06 | 2015-11-12 | Circle Cardiovascular Imaging Inc. | Method and system for analysis of myocardial wall dynamics |
| FR3025111A1 (en) * | 2014-09-02 | 2016-03-04 | Univ Bordeaux | METHOD FOR CONTROLLING THE CALIBRATION OF A FOCUSED ULTRASONIC BEAM FOR CARDIAC STIMULATION, METHOD FOR CARDIAC STIMULATION, SYSTEMS AND DEVICES THEREFOR |
| JP6353608B2 (en) * | 2015-01-29 | 2018-07-04 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Evaluation of myocardial infarction by real-time ultrasonic strain imaging |
| US10420515B2 (en) * | 2015-06-15 | 2019-09-24 | Vital Labs, Inc. | Method and system for acquiring data for assessment of cardiovascular disease |
| US10149958B1 (en) * | 2015-07-17 | 2018-12-11 | Bao Tran | Systems and methods for computer assisted operation |
| WO2017069699A1 (en) * | 2015-10-20 | 2017-04-27 | Singapore Health Services Pte Ltd | Medical image processing methods and systems for assessing right ventricular function |
| US11191520B2 (en) * | 2016-03-17 | 2021-12-07 | Canon Medical Systems Corporation | Ultrasonic diagnostic apparatus, image processing apparatus, and image processing method |
| JP7163278B2 (en) * | 2016-04-27 | 2022-10-31 | マイオカーディアル ソリューションズ インク. | Rapid quantitative assessment of cardiac function by MRI strain measurements |
| GB201610269D0 (en) | 2016-06-13 | 2016-07-27 | Isis Innovation | Image-based diagnostic systems |
| JP7721228B2 (en) * | 2022-12-22 | 2025-08-12 | 矢崎総業株式会社 | Charging inlet |
-
2016
- 2016-06-13 GB GBGB1610269.1A patent/GB201610269D0/en not_active Ceased
-
2017
- 2017-06-13 BR BR112018075961-9A patent/BR112018075961A2/en not_active IP Right Cessation
- 2017-06-13 AU AU2017286613A patent/AU2017286613A1/en not_active Abandoned
- 2017-06-13 KR KR1020197000713A patent/KR20190032348A/en not_active Ceased
- 2017-06-13 WO PCT/GB2017/051720 patent/WO2017216545A1/en not_active Ceased
- 2017-06-13 JP JP2019517180A patent/JP6987131B2/en active Active
- 2017-06-13 US US16/309,432 patent/US10959698B2/en active Active
- 2017-06-13 CN CN201780041969.5A patent/CN109661682B/en active Active
- 2017-06-13 EP EP17732542.0A patent/EP3469549B1/en active Active
- 2017-06-13 SG SG11201811125XA patent/SG11201811125XA/en unknown
-
2021
- 2021-02-18 US US17/179,252 patent/US11864945B2/en active Active
- 2021-11-30 JP JP2021193816A patent/JP2022031825A/en active Pending
-
2023
- 2023-11-30 US US18/524,838 patent/US12496038B2/en active Active
Non-Patent Citations (2)
| Title |
|---|
| ANONYMOUS: "Strain rate imaging - Wikipedia", 11 August 2015 (2015-08-11), XP055782308, Retrieved from the Internet <URL:https://en.wikipedia.org/w/index.php?title=Strain_rate_imaging&oldid=675532405> [retrieved on 20210304] * |
| GIL C.S. ET AL: "Linking Myocardial Function and Structure Through Tagged MRI and Diffusion Tensor Imaging", INTERNATIONAL SOCIETY FOR MAGNETIC RESONANCE IN MEDICINE, 11 May 2012 (2012-05-11), XP040626271 * |
Also Published As
| Publication number | Publication date |
|---|---|
| AU2017286613A1 (en) | 2019-01-03 |
| BR112018075961A2 (en) | 2019-04-02 |
| JP2019523690A (en) | 2019-08-29 |
| US20190247016A1 (en) | 2019-08-15 |
| US10959698B2 (en) | 2021-03-30 |
| KR20190032348A (en) | 2019-03-27 |
| US20210177375A1 (en) | 2021-06-17 |
| CN109661682A (en) | 2019-04-19 |
| CN109661682B (en) | 2023-07-28 |
| SG11201811125XA (en) | 2019-01-30 |
| EP3469549A1 (en) | 2019-04-17 |
| US12496038B2 (en) | 2025-12-16 |
| JP6987131B2 (en) | 2021-12-22 |
| US11864945B2 (en) | 2024-01-09 |
| WO2017216545A1 (en) | 2017-12-21 |
| US20240156431A1 (en) | 2024-05-16 |
| EP3469549C0 (en) | 2025-08-20 |
| GB201610269D0 (en) | 2016-07-27 |
| JP2022031825A (en) | 2022-02-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12496038B2 (en) | Image-based diagnostic systems | |
| US6994673B2 (en) | Method and apparatus for quantitative myocardial assessment | |
| US8391546B2 (en) | Method and corresponding apparatus for quantitative measurements on sequences of images, particularly ultrasonic images | |
| KR101565311B1 (en) | 3 automated detection of planes from three-dimensional echocardiographic data | |
| CN109584350A (en) | Measurement point in diagnosis imaging determines | |
| JP7333448B2 (en) | ultrasound diagnostic equipment | |
| Schiller et al. | Analysis of left ventricular systolic function | |
| EP4125606B1 (en) | Systems and methods for imaging and measuring epicardial adipose tissue | |
| JP2009539442A (en) | Method, apparatus and computer product for evaluating cavity images | |
| KR20110128197A (en) | Automatic Analysis of Cardiac M-Mode Views | |
| US8172756B2 (en) | Ultrasonic imaging system and method | |
| KR20200115488A (en) | Image analysis to record heart wall movement | |
| EP4210588B1 (en) | Systems and methods for measuring cardiac stiffness | |
| EP4608278B1 (en) | Echocardiogram classification with machine learning | |
| US20240197262A1 (en) | Methods and Systems for Intramyocardial Tissue Displacement and Motion Measurement | |
| EP4577120A1 (en) | Guided ultrasound imaging for point-of-care staging of medical conditions | |
| WO2018036893A1 (en) | Image processing apparatus and method for segmenting a region of interest | |
| EP4327750A1 (en) | Guided ultrasound imaging for point-of-care staging of medical conditions | |
| EP4516238A1 (en) | Removal of motion-corrupted ultrasond images for optimal multibeat cardiac quantification | |
| WO2025026775A1 (en) | Removal of motion-corrupted ultrasond images for optimal multibeat cardiac quantification | |
| WO2019071128A1 (en) | Medical imaging assessment of left ventricular mass |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20181220 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20210316 |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230524 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G16H 50/30 20180101ALI20250221BHEP Ipc: A61B 8/00 20060101ALI20250221BHEP Ipc: A61B 8/08 20060101ALI20250221BHEP Ipc: G06T 7/00 20170101AFI20250221BHEP |
|
| INTG | Intention to grant announced |
Effective date: 20250311 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602017091308 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| U01 | Request for unitary effect filed |
Effective date: 20250918 |
|
| U07 | Unitary effect registered |
Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT RO SE SI Effective date: 20250925 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20251220 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20251120 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250820 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20251121 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250820 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20251120 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250820 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250820 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250820 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250820 |