WO2011135103A1 - Analyse d'images intracoronaires obtenues par tomographie par cohérence optique - Google Patents
Analyse d'images intracoronaires obtenues par tomographie par cohérence optique Download PDFInfo
- Publication number
- WO2011135103A1 WO2011135103A1 PCT/EP2011/056982 EP2011056982W WO2011135103A1 WO 2011135103 A1 WO2011135103 A1 WO 2011135103A1 EP 2011056982 W EP2011056982 W EP 2011056982W WO 2011135103 A1 WO2011135103 A1 WO 2011135103A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- stent
- strut
- image
- previous
- coverage
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/40—Analysis of texture
- G06T7/41—Analysis of texture based on statistical description of texture
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10101—Optical tomography; Optical coherence tomography [OCT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30052—Implant; Prosthesis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
Definitions
- the present invention relates generally to the field of medical images processing and, more specifically to a system and method to analyse automatically intracoronary optical coherence tomography (OCT) images.
- OCT optical coherence tomography
- the present invention relates to image processing and apparatus for the automatic quantification and analysis of optical coherence tomography images, e.g. of coronary arteries, the urinary tract or the bile duct as well as software for carrying out such processes.
- OCT optical coherence tomography
- An object of the present invention is to provide alternative methods of medical image processing and, more specifically, to provide an alternative system or method to analyse optical coherence tomography (OCT) images.
- OCT optical coherence tomography
- an object of some embodiments of the present invention is to provide image processing and apparatus for the automatic quantification and analysis of optical coherence tomography images, e.g. of coronary arteries, the urinary tract or the bile duct as well as software for carrying out such processes. More in particular the present invention provides alternative image processing and apparatus for automatic stent and lumen analysis.
- the images may be 2 dimensional (pixels) or 3 dimensional (voxels).
- Embodiments of the present invention relating to a method, an algorithm or a system can have the advantages that: (1) it works for in-vivo acquired images and (2) it provides an accurate analysis for both stent coverage and apposition.
- Embodiments of the present invention provide a method, an algorithm, or a system that is able to provide an individual per strut analysis, as created by a transversal image present (cfr. infra).
- the present invention can provide methods or apparatus performing a completely automated and very fast analysis of lumen and stent images in intra-coronary optical coherence tomography images or for images of the urinary tract or the bile duct or in other images where stents are used.
- the analysis is very robust because the algorithm is able to analyse images corresponding to a large number of different situations (malapposition, restenosis, neointima coverage ”).
- Another aspect of the invention is that every single structure is individually analysed, providing accurate measurements at a stent strut level.
- the analysis is very easy to perform via a user friendly graphical interface.
- an optical signal acquisition and processing apparatus comprises a light source to generate a light that can penetrate into a scattering medium for generating micrometer-resolution three-dimensional images of long vessel segments of a transluminal implant device with multiple separate surface zones or of a longitudinal tubular implant device with multiple surfaces zones within a body vessel, the apparatus further comprising a processor for receiving and processing signals from said its detector for automatic contouring and identifying structures of the in-vivo acquired images, characterized in that the processor is programmed for automated identifying and measuring both 1) the distance of the separate surfaces zones of said implant device to vessel wall (apposition) and 2) neointima coverage (corresponding to vessel healing after implantation of the implant device).
- an optical signal acquisition and processing apparatus comprises a light source to generate a light that can penetrate into a scattering medium for generating micrometer-resolution three-dimensional images of long vessel segments of a transluminal implant device with multiple separate surface zones or of a longitudinal tubular implant device with multiple surfaces zones within a body vessel, the apparatus further comprising a processor for receiving and processing signals from said its detector and for:
- the processor is programmed for automated identifying and measuring both 1) the distance of the separate surfaces zones of said implant device to vessel wall (apposition) and 2) neointima coverage (corresponding to vessel healing after implantation of the implant device).
- the optical signal acquisition and processing apparatus comprises a processor which is programmed for automated identifying and measuring beside both implant coverage and apposition is also programmed for automated identifying and measuring of the luminal area.
- the multiple separate surfaces zones are different strut sections, in particular of axially aligned stent struts or of a set of interconnected struts (typically the longitudinal struts).
- the distance of the separate surfaces zones of said implant device to vessel wall concerns the stent strut to vessel wall distance of said implant device.
- the apparatus comprises a processor whereby the processor is programmed is to provide stent strut to vessel wall distance for different individual stent struts zones in the image.
- the processor is programmed to provide neointima coverage for different individual stent struts zones in the image.
- the optical signal acquisition and processing apparatus is an optical coherence tomography (OCT) apparatus.
- OCT optical coherence tomography
- SEFD-OCT spectral domain or Fourier domain OCT
- the apparatus comprises a storage means to store the processes signal electronically.
- the apparatus comprises a display means, which can display the coverage, apposition and or luminal area for the stent or for individual stent struts zones.
- apparatus comprises a near-infrared light source. In yet another embodiment of the invention the apparatus comprises a long wavelength light source.
- the apparatus is used to analyse images corresponding to a multiple parameters of implant disorder or of implant failure parameters such as malapposition, thrombus, restenosis.
- the apparatus is used to follow up of stent behaviour after stent implant, for instance intracoronay implant.
- the apparatus is used for estimating the risk of for instance thrombosis or restenosis after such implantation.
- the apparatus is used to provide the physician with information to evaluate the success of implantation of a transluminal implant for instance to asses malapposition, thrombus or restenosis.
- the apparatus is used to assess reocclusion or obstructions after angioplasty for instance to treat a problem of neointimal hyperplasia.
- the apparatus is used to estimate the need to redilate or to evaluate the incidence and/or severity of post-operative elastic recoil restenosis after percutaneous endovascular therapy by stent placement.
- the apparatus is used for in-vivo images analysis to measure coverage and stent apposition individual analysis of multiple stent strut visualization in an image.
- the apparatus is used in such way that the images to be analysed are recorded at baseline (freshly implanted device) and at any time point thereafter.
- the apparatus is used for discovering a medicament to prevent reocclusions or obstructions after angioplasty.
- the apparatus is used for diagnostic medical treatments of a subject to diagnose for a transluminal implant body reaction, in particular stent body reaction.
- the invention provides in one embodiment a method for automatically analysing the behaviour of a transluminal implant, for instance of an intracoronary implant device, which method comprises analysing multiple images from in- vivo acquired OCT images, recorded at baseline (freshly implanted device) and at any time point thereafter, of long vessel segments of transluminal implant device formed by strut from bars or of a longitudinal tubular implant device formed by strut from bars in a body vessel, characterised in that said method comprises automatic contouring and identifying structures of the in- vivo acquired images, characterized in that the processor is programmed for automated operator identifying and measuring both 1) distance of the separate surfaces zones of said implant device to vessel wall (apposition) and 2) neointima coverage (corresponding to vessel healing after implantation of the implant device).
- the method comprises three processing steps of (1) segmentation of the implant device and lumen based on A-scan analysis, (2) scan conversion of the image to a fast analysis platform (e.g. C++), (3) evaluation of strut apposition or strut coverage from A-line segmentation (A-scan lines) in the scan- converted image.
- the method comprises that the stent struts segmentation is based on A-scan lines analysis and a strut in OCT images is characterized by: (1) a bright reflection, (2) a shadow and (3) a rapid rise and fall of energy.
- the invention provides a method for automatically analysing the behaviour of a transluminal implant, for instance of an intracoronary implant device, which method comprises analysing multiple images from in- vivo acquired OCT images, recorded at baseline (freshly implanted device) and at any time point thereafter, of long vessel segments of transluminal implant device formed by strut from bars or of a longitudinal tubular implant device formed by strut from bars in a body vessel, characterised in that said method comprises:
- said method is characterized in that the processor is programmed for automated operator identifying and measuring both 1) distance of the separate surfaces zones of said implant device to vessel wall (apposition) and 2) neointima coverage (corresponding to vessel healing after implantation of the implant device).
- the segmentation used in the method consists of three steps: (1) preprocessing of the image, (2) identification of candidate A-scan lines, (3) processing of the candidates.
- multiple zones or structures of the implant are individually analysed for providing such stent strut to vessel wall distance (and neointima coverage) for different individual stent struts zones in the image.
- the multiple zones or structures can be multiple views or segments of a strut.
- the multiple zones or structures can be multiple images of transversal sections of a strut of the longitudinal tubular implant.
- the multiple surfaces are formed optionally by at least one axial strut.
- Stent struts segmentation can be based on A-scan lines analysis and a strut in OCT images can be characterized by: (1) a bright reflection, (2) a shadow and (3) a rapid rise and fall of energy.
- the segmentation comprises or consists of three steps: (a) preprocessing of the image, (b) identification of candidate A-scan lines, (c) processing of the candidates.
- the preprocessing of image can involve image calibration, whereby the calibration line coincides with the catheter plastic border. Using the calibration line as a reference, the catheter can be automatically recognized and ignored from the algorithm for strut segmentation (and lumen segmentation later).
- the A-scan line candidates can be identified by searching for strut characteristics whereby the maximum intensity value of each line is located and recorded and if this value exceeds a selected threshold, the line is labeled as a candidate.
- the A-scan line candidates are processed by removing the non-desired lines by analyzing the shadows coming from a strut and taking into account the depth of the shadow excluding false candidates (i.e.
- the horizontal coordinates of the located struts can be identified by the following steps: 1) the algorithm takes as a starting point the coordinate founded in step b.
- the lumen segmentation can be based on A-scan line analysis. It comprises or consists of three steps: (1) preprocessing of the image, (2) A-line single analysis and (3) correction considering all A-lines together. Alternatively, the lumen segmentation comprises or consists of three steps: (a) preprocessing of the image, (b) identification of candidate A-scan lines, (c) correction.
- the preprocessing step for lumen segmentation can comprise optionally removal of the strut positive A-scan lines. Removal of these from the image can comprise the three steps (1) based on the histogram of the whole image, turning all the pixels or voxels under a selected intensity value to zero and incrementing all the pixels or voxels above another selected fixed value to a higher intensity, (2) applying a Gaussian symmetric low-pass filter, e.g. with a 5 pixel square dimension or a 5 voxel cube dimension and e.g. a sigma equal to 2.5 and (3) morphologically opening the image using a disk structuring element.
- a Gaussian symmetric low-pass filter e.g. with a 5 pixel square dimension or a 5 voxel cube dimension and e.g. a sigma equal to 2.5
- morphologically opening the image using a disk structuring element e.g. with a 5 pixel square dimension or a 5 voxel cube dimension and
- the candidate A-scan lines identification can comprise analysing every line locating the shallowest pixel or voxel with an intensity greater than a certain fraction of the maximum intensity value, e.g. 2/3 of the maximum intensity value of the line and from the located points, moving the code s back in the direction of the lumen for a predefined maximum number of steps stopping when finding the first pixel or voxel with an intensity value inferior to a second lower fraction such as 2/7 of the maximum to generate a rough lumen profile.
- a certain fraction of the maximum intensity value e.g. 2/3 of the maximum intensity value of the line and from the located points
- the correction of the rough lumen profile to the definitive lumen segmentation can be carried out 1) by considering all the A-scan lines together, 2) consequently generating a ID profile from all the points, 3) consequently filtering this profile using a ID median filter with a very small kernel and consequently 4) fitting a smoothing B-spline through all the points.
- the stent strut apposition and coverage is generated by calculation of the distance from the external surface of the strut to the vessel wall, more particular the perpendicular distance from the center of the stent to the lumen by computing said distances to obtain strut apposition and coverage, whereby the stent strut apposition represents how far a stent strut is removed from the inner layer of the vessel wall and stent strut coverage represents the thickness of the tissue overlaying the strut surface.
- a threshold can be based on strut real thickness or a strut real thickness and its coating thickness to discriminate between apposed and malapposed struts. Or for example, a threshold is based on strut real thickness or a strut real thickness and its coating thickness to discriminate between uncovered, covered struts and hyperplasia.
- the body vessel can be a blood vessel, or the body vessel can be any one of an urinary tract or a bile duct.
- the multiple surfaces can be different external or exposed strut zones.
- the implant device can be a stent, for example the stent can be an intracoronary stenting
- Methods of the present invention can be used for follow up of stent behavior after stent implant, for instance intracoronay implant, and/or for estimating the risk of for instance thrombosis or restenosis after such implantation.
- An advantage of the present invention is that it can provide the physician with information to evaluate the success of implantation of a transluminal implant for instance to asses malapposition, thrombus or restenosis and/or to assess reocclusions or obstructions after angioplasty for instance to treat a problem of neointimal hyperplasia, and/or to estimate the need to redilate or to evaluate the incidence and/or severity of post-operative elastic recoil restenosis after percutaneous endovascular therapy by stent placement.
- the present invention also provides software such as an operating system for operating any of the methods of the embodiments described above.
- the software or operating system may comprise an automated operator for automatic stent and lumen analysis system identifying and measuring luminal area, both stent apposition and neointima stent coverage on in-vivo acquired OCT images.
- the software or operating system can be adapted for automatic contouring and identifying of the structures of stent or tissue environment.
- the software or operating system can be adpted to measure neointima coverage and stent apposition.
- the software or operating system can be adapted to provide such stent strut to vessel wall distance.
- the software or operating system can be adapted to provide neointima coverage for different individual stent struts zones in the image.
- the software or operating system can be adapted to measure coverage and stent apposition individual analysis of multiple stent strut visualization in an image.
- the software or operating system can be adapted for determining the presence or absence of disorder, the seriousness of disorder or the progress of disorder in the patient of any of the previous embodiments.
- the software or operating system can be adapted so that it also controls usage of the apparatus.
- the software or operating system can be adapted so that the operating system includes a user interface to enable the user to interact with the functionality of the computer.
- the software or operating system can be adapted so that the operating system includes a graphical user interface whereby the software or operating system can be adapted to control the ability to generate graphics on the computer's display device that can be displayed in a variety of manners representative for or associated with the condition of a stent placement malfunction or disorder in a selected patient or a group of patients to allow a user to distinguish between the absence of malfunction or disorder, the seriousness of malfunction or disorder or the progress of malfunction or disorder in identified patients or patient groups.
- Such software can be provided as a computer-executable code, e.g.
- the computer executable code being adapted, so that it can run on a computer system, e.g. to run the operating system of any of the above embodiments or to execute the method described in any of the embodiments above and to direct a processing means to produce output signals that are representative for a condition of disorder or a modifying condition of disorder.
- FIG. la provides a graphic display that demonstrates segmented A-scan lines containing just lumen.
- FIG. lb provides a graphic display that demonstrates segmented A-scan lines of a uncovered strut.
- FIG. lc provides a graphic display that demonstrates segmented A-scan lines of a covered stent (the tissue over the stent is clearly visible from the profile).
- FIG. 2a provides an image that shows candidate A-lines.
- FIG. 2b provides an image that shows candidate A-lines after low intensity and close shadow processing.
- FIG. 2c provides an image that shows candidate A-lines after medium and far shadow processing.
- FIG. 2d provides an image that shows the final strut positive A-lines after correction.
- FIG. 2e provides a graphic display of the derived maximum intensity profile and threshold.
- FIG. 2f provides a graphic display of the derived amount of pixels having a value over the maximum profile and threshold.
- FIG. 2g provides a graphic display of the derived shadow profile and relative threshold.
- FIG. 3a provides an image (raw-data) to analyse for the lumen segmentation.
- FIG. 3b provides an image after preprocessing.
- FIG. 3c provides an image after final lumen segmentation.
- FIG. 4a provides an image that illustrates the scan conversion of images (and relative segmentation) for an image from follow-up pullbacks (coverage).
- FIG. 4b provides an image that illustrates the scan conversion of images (and relative segmentation) for an image from a baseline pullback (fresh implanted stent).
- FIG. 5a provides an image that demonstrates coverage analysis.
- FIG. 5b provides an image that is used for apposition analysis.
- FIG. 6a is a graphic display of the correlation between the stent apposition algorithms against MD n. l.
- FIG. 6b is a graphic display of a Bland-Altman plot of the stent apposition algorithm against MD n. l.
- FIG. 6c is a graphic display of the correlation between the stent coverage algorithms against MD n. l
- FIG. 6d is a graphic display of a Bland-Altman plot stent coverage algorithm against MD n. l.
- FIG. 7 is an example of an algorithm for segmentation. DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
- Optical coherence tomography is an optical signal acquisition and processing method. It captures micrometer-resolution, three-dimensional images from within optical scattering media (e.g., biological tissue).
- Optical coherence tomography is an interferometric technique, typically employing near-infrared light. The use of relatively long wavelength light allows it to penetrate into the scattering medium. Confocal microscopy, another similar technique, typically penetrates less deeply into the sample.
- This reflectivity profile contains information about the spatial dimensions and location of structures within the item of interest.
- a cross-sectional tomography (B-scan) may be achieved by laterally combining a series of these axial depth scans (A-scan).
- En face imaging (C-scan) at an acquired depth is possible depending on the imaging engine used.
- Rapid rise and fall of energy corresponds for example to an adluminal edge of a stent strut. The rapid rise and fall of energy can be defined as the speed at which the signal consecutively increases and decreases its energy as a function of depth.
- Spatially encoded frequency domain OCT or spectral domain or Fourier domain OCT SEFD-OCT extracts spectral information by distributing different optical frequencies onto a detector stripe (e.g. line-array CCD or CMOS) via a dispersive element. Thereby the information of the full depth scan can be acquired within a single exposure. For example, using SEFD-OCT images, the distance between stent and tissue can be evaluated.
- a detector stripe e.g. line-array CCD or CMOS
- a stent is a generally longitudinal tubular device formed of biocompatible material, preferably a metallic or plastic material. Stents are useful in the treatment of stenosis, strictures or aneurysms in body vessels, such as blood vessels.
- the device is implanted either as a "permanent stent" within the vessel to reinforce collapsing, partially occluded, weakened or abnormally dilated sections of the vessel or as a "temporary stent" for providing therapeutic treatment to the diseased vessel.
- Stents are typically employed after angioplasty of a blood vessel to prevent restenosis of the diseased vessel. Stents may be useful in other body vessels, such as the urinary tract and the bile duct.
- a typical intracoronary stent includes an open flexible configuration.
- the stent configuration allows the stent to be configured in a radially compressed state for transluminal catheter insertion into an appropriate site. Once properly positioned within the lumen of a damaged vessel, the stent is radially expanded to support and reinforce the vessel. Radial expansion of the stent may be accomplished by an inflatable balloon attached to the catheter, or the stent may be of the self-expanding type so that it will radially expand once deployed.
- An example of a suitable stent is disclosed in U.S. Pat. No. 4,733,665, which is incorporated herein by reference in its entirety.
- the stent properties of flexibility in the unexpanded state and radial rigidity in the expanded state have been achieved using one set of interconnected struts (typically the longitudinal struts) to confer flexibility to the unexpanded stent and another pair of interconnected struts (typically non-longitudinal circumferential rings of struts) which open up to radially rigid hoop structures (in the ideal case) to confer radial rigidity to the expanded stent.
- Stents find various uses in medical procedures. For instance, stents are widely used in angioplasty. Angioplasty involves insertion of a balloon-tipped catheter into an artery at the site of a partially obstructive atherosclerotic lesion.
- Inflation of the balloon can rupture the intima and media, dramatically dilating the vessel and relieving the obstruction. About 20 to 30% of obstructions reocclude in a few days or weeks, but most can be redilated successfully. Use of stents significantly reduces the reocclusion rate.
- Angioplasty is an alternative to bypass surgery in a patient with suitable anatomic lesions. The risk is comparable with that of surgery. Mortality is 1 to 3%; myocardial infarction rate is 3 to 5%; emergency bypass for intimal dissection with recurrent obstruction is required in ⁇ 3%; and the initial success rate is 85 to 93% in experienced hands.
- Stents are also used in percutaneous endovascular therapy. Many new treatments for vascular disease (occlusions and aneurysms) avoid open surgery. These treatments may be performed by interventional radiologists, vascular surgeons, or cardiologists. The primary approach is percutaneous translumninal angioplasty (PTA), whereby a small high-pressure balloon is used to open an obstructed vessel. However, because of the high recurrence rate of obstruction, alternative methods may be necessary.
- PTA percutaneous translumninal angioplasty
- a stent such as a metallic mesh-like tube, is generally inserted into a vessel at an obstructed site. As stents can be very strong, they tend to keep vessels open much better than balloons alone.
- Stents work well in larger arteries with high flow, such as iliac and renal vessels. They work less well in smaller arteries, and in vessels in which the occlusions are long. Stents for carotid disease are being studied.
- elastic recoil wherein the vessel contracts due to the natural elasticity of the vessel wall
- neointimal hyperplasia wherein medial cells proliferate in response to immune system triggers. Stents have proven useful in reducing the incidence and/or severity of post-operative elastic recoil restenosis, as they resist the tendency of blood vessels to restenose after removal of the balloon.
- Stents have proven less useful for treatment of neointimal hyperplasia, which arises out of a complex immune response to expanding and fracturing the atherosclerotic plaque.
- neointimal hyperplasia the initial expansion and fracture of the atherosclerotic lesion initiates inflammation, which gives rise to a complex cascade of cellular events that activates the immune system, which in turn gives rise to the release of cytokines that stimulate cell multiplication in the smooth muscle layers of the vessel media. This cell stimulation eventually causes the vessel to restenose.
- Various approaches to the problem of neointimal hyperplasia have been attempted. Among these approaches are: subsequent stent placement, debulking, repeat angioplasty, and laser treatment.
- Immunosuppressant drugs such as rapamycin
- rapamycin target cells in the Gl phase, preventing initiation of DNA synthesis.
- Chemotherapeutic drugs such as paclitaxel (Taxol— Bristol-Myers Squibb) and other taxane derivatives, act on cells in the M phase, by preventing deconstruction of microtubules, thereby interrupting cell division. While these approaches present some promise, they also suffer certain limitations, such as the tendency for rapamycin and taxanes to quickly disperse from the stent site, thereby both limiting the drugs' effective duration in proximity to the stent and also risking undesirable systemic toxic effects.
- the following approach mainly comprised or consisted of three steps: (1) segmentation of stent and lumen based on A- scan analysis (Matlab), (2) scan conversion of the image (C++ for speed), (3) evaluation of strut apposition or strut coverage from A-line segmentation (A-scan lines) in the scan-converted image (Matlab).
- the program can be executed using a graphical interface for ease of use.
- Fig. la provides a graphic display that demonstrates A-scan lines containing just lumen.
- Fig. lb provides a graphic display that demonstrates A-scan lines of an uncovered strut.
- Fig. lc provides a graphic display that illustrates A-scan lines of a covered stent (the tissue over the stent is clearly visible from the profile). High intensity value, rapid rise and fall on energy and presence of shadow can be easily seen on the profile on Figs, lb and lc. Please note the different scale y- value on Figs, la-lc.
- FIG. 2a provides an image that shows candidates A-lines.
- Fig. 2b illustrates candidates A-lines after low intensity and close shadow processing using the derived maximum intensity profile and threshold as illustrated in Fig. 2e.
- Fig. 2c provides an image comprising candidate A- lines after medium and far shadow processing using the derived amount of pixels having a value over the maximum profile and threshold as illustrated in Fig. 2f and the derived shadow profile and relative threshold as illustrated in Fig. 2g .
- Fig. 2d shows the final derived positive A-lines of a strut after correction.
- Figs. 3a-3c Lumen segmentation of the A-scan lines is illustrated in Figs. 3a-3c.
- Fig. 3a provides an image comprising the raw-data of an image which has to be analysed.
- Fig. 3b provides an image after preprocessing.
- Fig. 3c shows the final lumen segmentation.
- the points 2 representing the result of single A-scan lines analysis are illustrated in Fig. 3c, as are the final results 1 which are additionally fitted using a smoothing spline filtering profile as illustrated in Fig. 3d.
- Scan conversion of the image data is illustrated in Figs. 4a and 4b.
- the latter depict an image that provides an example of scan conversion of images and relative segmentation. The latter is done for and image from a follow-up pullbacks (coverage) in Fig. 4a.
- Fig. 4b an image from a baseline pullback (fresh implanted stent) is used and converted.
- Fig. 5a provides an image that demonstrates coverage analysis: for every strut present in the image an estimation of the thickness of coverage is given with a distance. Moreover even a small strut 3 is correctly taken in account by the algorithm.
- Fig. 5b provides an image which is used for apposition analysis: for every strut present in the image an estimation of the distance from the external surface of the strut to the lumen reconstruction is given. Moreover even the presence of blood over the strut 4 is correctly managed by the algorithm.
- Figs. 6a-6d concern the stent strut apposition algorithm validation and the stent strut coverage algorithm validation.
- Fig. 6a is a graphic display of the correlation between the stent apposition algorithm against MD n.l .
- the correlation between the stent coverage algorithm against MD n. l is illustrated in Fig. 6c.
- Fig. 6b illustrates the Bland- Altman plot of the stent apposition algorithm against MD n. l.
- Fig. 6d illustrates the Bland- Altman plot of the stent coverage algorithm against MD n.l.
- Stent struts segmentation is based on A- scan lines analysis.
- a strut in OCT images is characterized by: (1) a bright reflection, (2) a shadow and (3) a rapid rise and fall of energy.
- the segmentation consists of three steps: (1) preprocessing of the image, (2) identification of candidate A-scan lines, (3) processing of the candidates.
- the calibration line must coincide with the catheter plastic border.
- the catheter can be automatically recognized and ignored from the algorithm for strut segmentation (and lumen segmentation later).
- Every A-scan line is analyzed searching for strut characteristics.
- the maximum intensity value of each line is located and recorded. If this value exceeds a very high threshold the line is labeled as a candidate.
- the second characteristic (the rapid rise and fall of the energy) is analysed in this way: the number of pixels that exceeds 3/5 of the maximum is taken into account. If this number is lower than a fixed value, the line is labeled as a candidate.
- each A-line is first processed identifying the shallowest object or, in the case of images presenting coverage, the most important peak of intensity. Then the average intensity of the pixels after this object, or peak, is computed. Also in the case if the average is inferior to a fixed value, the A-line is labeled as a candidate.
- An A-line is recorded as a candidate if it presents any of the fore- mentioned characteristics (or conditions). In this way, all lines really containing a strut are recorded as candidates, but also many other lines might be classified as candidates. To remove the non-desired lines, the characteristics of the shadow must be analysed. In-vivo images quite often present a shadow that is not very well defined (in 10-20% of the cases, the shadow can contain strong noise), but the shadow is always present. A necessary characteristic of a shadow coming from a strut, is that it is there through the whole depth of the image. In this way, taking into account the depth of the shadow allows for exclusion of false candidates (e.g. because of thrombus, plaque protrusion, blood remnants or other "objects" inside the lumen).
- the intensity level of all the pixels beyond the strut is analyzed. Pixels cannot be analyzed singularly because of the presence of noise along the shadow; they are divided into three groups: (1) close to the struts, (2) medium distance and (3) far away. The intensity of each group is analyzed and if it exceeds a fixed value, the candidate is discarded. Finally, horizontal coordinates of the located struts are identified. The algorithm takes as a starting point the coordinate founded in step b. From this point, a correction based on intensity level is performed in order to avoid errors resulting from reverberations, blood remnants over the stent (in baseline pullbacks) and misalignment of the coordinates. At the end of this last step, almost all stent struts are correctly segmented avoiding false positive results.
- the algorithm can be successfully run in both of the possible situations: baseline pullbacks (freshly implanted stents) and follow-up pullbacks (stent presenting neointima coverage).
- baseline pullbacks freshly implanted stents
- follow-up pullbacks stent presenting neointima coverage
- the main difference is how horizontal coordinates of struts are located (see step b).
- a different set of optimal parameters must be selected (see validation).
- the complexity of the algorithm (for the entire stent strut segmentation) is O(n). Real time of this algorithms running under Matlab 7.9.0 is in the order of 10 "1 seconds.
- Also lumen segmentation is based on A-scan line analysis. It consists of three steps: (1) preprocessing of the image, (2) A-line single analysis and (3) correction considering all A-lines together. a. Preprocessing
- the preprocessing plays a key role. First, all the strut positive A-scan lines are removed from the image (this happens only for the baseline pullback). Then, a three- step iterative strategy is applied.
- the image is ready to be analysed to obtain the initial lumen segmentation. Every line is analysed locating the shallowest pixel with an intensity major than 2/3 of the maximum intensity value of the line. Now, from the located points, the code moves back in the direction of the lumen (for a predefined maximum number of steps) stopping when finding the first pixel with an intensity value inferior to 2/7 of the maximum. c. Correction
- a rough lumen profile is obtained.
- all the A-scan lines must be considered together.
- a ID profile is obtained.
- this profile is filtered using a ID median filter with a very small kernel.
- a smoothing B-spline is fitted through all the points. In this way, is possible to find an approximation of the vessel hiding under the shadows; this is a crucial point for the later estimation of stent strut apposition.
- the obtained spline represents the correct lumen segmentation.
- Intracoronary OCT images are recorded as raw data.
- Raw data correspond to a rectangular image with dimensions of 504 x 976 pixels (FD-OCT).
- FD-OCT x 976 pixels
- a scan conversion is needed.
- the scan conversion proposed is based on bilinear interpolation. For reason of speed (the goal is to create images with dimensions of at least 1000 x 1000 pixels), the algorithm for scan-conversion has been implemented using language C++ and IT++ libraries.
- MEX function was made available for the Matlab user interface. The complexity of the following algorithm is 0(n ) and real time running it through Matlab 7.9.0 (using MEX Libraries) is 1.7 seconds (average).
- Example 4 Stent strut apposition and coverage
- Assessment of stent strut apposition and coverage means calculation of the distance from the external surface of the strut to the vessel wall.
- Stent strut apposition represents how far a stent strut is removed from the inner layer of the vessel wall.
- Stent strut coverage represents the thickness of the tissue overlaying the strut surface.
- the OCT image suffers from a very common problem: sunflower artifact (Bezerra et al, "Intracoronary Optical Coherence Tomography: A Comprehensive Review', in JACC: Cardiovascular Intervention (2009)). For this reason, the correct distance to evaluate is the distance perpendicular to the lumen. In order to assess strut apposition and coverage, an algorithm evaluating the perpendicular distance from the center of the stent to the lumen has been developed. If more than one distance matching these criteria exists, the minimum distance is taken into account.
- the golden standard at this moment is manual assessment performed by trained expert medical doctors (Bezerra et al 2009). Distances can be measured manually by MDs using an Offline Review Workstation (LightLab Imaging). Validation consists in comparison of individual distances manual against automatic. In our study, 108 images randomly taken from 9 different pullback were used for validation.
- the methods and systems described above according to embodiments of the present invention may be implemented in a processing that may include at least one customisable or programmable processor coupled to a memory subsystem that includes at least one form of memory, e.g., RAM, ROM, and so forth.
- the processor or processors may be a general purpose, or a special purpose processor, and may be for inclusion in a device, e.g., a chip that has other components that perform other functions.
- one or more aspects of the method according to embodiments of the present invention can be implemented in digital electronic circuitry, or in computer hardware, firmware, software, or in combinations of them.
- the processing system may include a storage subsystem that has at least one disk drive and/or CD-ROM drive and/or DVD drive.
- a user interface subsystem is preferably provided for a user to manually input information or adjust the operation. More elements such as network connections, interfaces to various devices, and so forth, may be included in some embodiments. In particular an interface is provided to receive the in vivo images captured images.
- the various elements of the processing system may be coupled in various ways, including via a bus subsystem, e.g. for simplicity a single bus, but will be understood to those in the art to include a system of at least one bus.
- the memory of the memory subsystem may at some time hold part or all of a set of instructions that when executed on the processing system implement the steps of the method embodiments described herein.
- the present invention also includes a computer program product which provides the functionality of any of the methods according to embodiments of the present invention when executed on a computing device.
- Such computer program product can be tangibly embodied non-transiently in a carrier medium carrying machine -readable code for execution by a programmable processor.
- the present invention thus relates to a carrier medium carrying a computer program product that, when executed on computing means, provides instructions for executing any of the methods as described above.
- carrier medium refers to any medium that participates in providing instructions to a processor for execution. Such a medium may take many forms, including but not limited to, non-volatile media, and transmission media.
- Non-volatile media includes, for example, optical or magnetic disks, such as a storage device which is part of mass storage.
- Computer readable media include, a CD-ROM, a DVD, a flexible disk or floppy disk, a tape, a memory chip or cartridge or any other medium from which a computer can read.
- Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processor for execution.
- the computer program product can also be transmitted via a carrier wave in a network, such as a LAN, a WAN or the Internet.
- Transmission media can take the form of acoustic or light waves, such as those generated during radio wave and infrared data communications. Transmission media include coaxial cables, copper wire and fibre optics, including the wires that comprise a bus within a computer.
- the present invention also includes a software product which when executed on a suitable computing device carries out any of the methods of the present invention.
- Suitable software can be obtained by programming in a suitable language such as C++ and compiling on a suitable compiler for the target computer processor.
- Target computer processor can be (for example but not limited to): the general purpose processor (CPU) in a computer system, a graphical processor (such as a GPU) of a computer system, a general purpose processor present in a display system, a graphical processor (such as a GPU) present in a display system, an embedded processor present in a display system, a processor present in a panel such as a LCD panel or OLED panel or plasma panel, a processor present in the driver system of a liquid crystal display panel.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Probability & Statistics with Applications (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Endoscopes (AREA)
Abstract
La présente invention concerne une nouvelle technologie de traitement d'image et un appareil de quantification et d'analyse automatiques d'images obtenues par tomographie par cohérence optique des artères coronaires.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GBGB1007250.2A GB201007250D0 (en) | 2010-04-30 | 2010-04-30 | Intracoronary optical coherence tomography images analysis |
GB1007242.9 | 2010-04-30 | ||
GB1007250.2 | 2010-04-30 | ||
GBGB1007242.9A GB201007242D0 (en) | 2010-04-30 | 2010-04-30 | Intracoronary optical coherence tomograhy images analysis |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011135103A1 true WO2011135103A1 (fr) | 2011-11-03 |
Family
ID=44352447
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2011/056982 WO2011135103A1 (fr) | 2010-04-30 | 2011-05-02 | Analyse d'images intracoronaires obtenues par tomographie par cohérence optique |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2011135103A1 (fr) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012126070A1 (fr) | 2011-03-24 | 2012-09-27 | Katholieke Universiteit Leuven | Analyse volumétrique automatique et enregistrement 3d d'images oct en section transversale d'un stent dans un vaisseau corporel |
WO2014002067A2 (fr) | 2012-06-29 | 2014-01-03 | Consiglio Nazionale Delle Ricerche | Procédé de traitement d'images de tomographie par cohérence optique |
WO2014137353A1 (fr) | 2013-03-08 | 2014-09-12 | Lightlab Imaging, Inc. | Systèmes, dispositifs et méthodes de visualisation d'endoprothèse vasculaire et de détection d'apposition incorrecte |
ES2608037A1 (es) * | 2015-10-01 | 2017-04-05 | Lucia JÁÑEZ GARCÍA | Sistema y método para segmentación y análisis automatizados de la estructura tridimensional de conductos en imágenes de tomografía computarizada |
WO2021199960A1 (fr) * | 2020-03-30 | 2021-10-07 | テルモ株式会社 | Programme, procédé de traitement d'informations, et système de traitement d'informations |
US20220292688A1 (en) * | 2021-03-15 | 2022-09-15 | Dotter Co., Ltd. | Deep learning based image segmentation method including biodegradable stent in intravascular optical tomography image |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4733665A (en) | 1985-11-07 | 1988-03-29 | Expandable Grafts Partnership | Expandable intraluminal graft, and method and apparatus for implanting an expandable intraluminal graft |
US20100094127A1 (en) * | 2008-10-14 | 2010-04-15 | Lightlab Imaging, Inc. | Methods for stent strut detection and related measurement and display using optical coherence tomography |
-
2011
- 2011-05-02 WO PCT/EP2011/056982 patent/WO2011135103A1/fr active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4733665A (en) | 1985-11-07 | 1988-03-29 | Expandable Grafts Partnership | Expandable intraluminal graft, and method and apparatus for implanting an expandable intraluminal graft |
US4733665B1 (en) | 1985-11-07 | 1994-01-11 | Expandable Grafts Partnership | Expandable intraluminal graft,and method and apparatus for implanting an expandable intraluminal graft |
US4733665C2 (en) | 1985-11-07 | 2002-01-29 | Expandable Grafts Partnership | Expandable intraluminal graft and method and apparatus for implanting an expandable intraluminal graft |
US20100094127A1 (en) * | 2008-10-14 | 2010-04-15 | Lightlab Imaging, Inc. | Methods for stent strut detection and related measurement and display using optical coherence tomography |
Non-Patent Citations (9)
Title |
---|
BEZERRA ET AL.: "Intracoronary Optical Coherence Tomography: A Comprehensive Review", JACC: CARDIOVASCULAR INTERVENTION, 2009 |
BONNEMA G. ET AL.: "An automatic algorithm for detecting stent endothelialization from volumetric optical coherence tomography", IOP PHYSICS IN MEDICINE AND BIOLOGY, vol. 53, 2008, pages 3083 - 3098, XP020133865 |
GARCIA-GARCIA ET AL.: "Virtual Histology and optical coherence tomography: from research to a broad clinical application", HEART, 2010 |
GARRET T BONNEMA ET AL: "An automatic algorithm for detecting stent endothelialization from volumetric optical coherence tomography datasets; An automatic algorithm for detecting stent endothelialization from volumetric OCT datasets", PHYSICS IN MEDICINE AND BIOLOGY, TAYLOR AND FRANCIS LTD. LONDON, GB, vol. 53, no. 12, 21 June 2008 (2008-06-21), pages 3083 - 3098, XP020133865, ISSN: 0031-9155 * |
GOZDE UNAL ET AL: "Stent implant follow-up in intravascular optical coherence tomography images", THE INTERNATIONAL JOURNAL OF CARDIAC IMAGING, KLUWER ACADEMIC PUBLISHERS, DO, vol. 26, no. 7, 24 September 2009 (2009-09-24), pages 809 - 816, XP019815013, ISSN: 1573-0743 * |
KAUFFMANN C ET AL: "In Vivo Supervised Analysis of Stent Reendothelialization From Optical Coherence Tomography", IEEE TRANSACTIONS ON MEDICAL IMAGING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 29, no. 3, 1 March 2010 (2010-03-01), pages 807 - 818, XP011304042, ISSN: 0278-0062 * |
TEARNEY ET AL.: "Three dimensional coronary artery microscopy by intra coronary optical coherence tomography", EUROPEAN HEARTH JOURNAL, 2008 |
TERASHIMA ET AL.: "Accuracy and Reproducibility of Stent-Strut Thickness Determined by Optical Coherence Spectroscopy", THE JOURNAL OF INVASIVE CARDIOLOGY, 2009 |
UNAL G. ET AL.: "Stent implant follow-up in intravascular optical coherence tomography images", INT J CARDIOVASCULAR IMAGING, 24 September 2009 (2009-09-24) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012126070A1 (fr) | 2011-03-24 | 2012-09-27 | Katholieke Universiteit Leuven | Analyse volumétrique automatique et enregistrement 3d d'images oct en section transversale d'un stent dans un vaisseau corporel |
WO2014002067A2 (fr) | 2012-06-29 | 2014-01-03 | Consiglio Nazionale Delle Ricerche | Procédé de traitement d'images de tomographie par cohérence optique |
WO2014137353A1 (fr) | 2013-03-08 | 2014-09-12 | Lightlab Imaging, Inc. | Systèmes, dispositifs et méthodes de visualisation d'endoprothèse vasculaire et de détection d'apposition incorrecte |
CN105246402A (zh) * | 2013-03-08 | 2016-01-13 | 光学实验室成像公司 | 支架可视化和贴壁不良检测系统、设备和方法 |
EP2964089A4 (fr) * | 2013-03-08 | 2016-11-30 | Lightlab Imaging Inc | Systèmes, dispositifs et méthodes de visualisation d'endoprothèse vasculaire et de détection d'apposition incorrecte |
AU2013380987B2 (en) * | 2013-03-08 | 2018-07-26 | Lightlab Imaging, Inc. | Stent visualization and malapposition detection systems, devices, and methods |
ES2608037A1 (es) * | 2015-10-01 | 2017-04-05 | Lucia JÁÑEZ GARCÍA | Sistema y método para segmentación y análisis automatizados de la estructura tridimensional de conductos en imágenes de tomografía computarizada |
WO2021199960A1 (fr) * | 2020-03-30 | 2021-10-07 | テルモ株式会社 | Programme, procédé de traitement d'informations, et système de traitement d'informations |
US20220292688A1 (en) * | 2021-03-15 | 2022-09-15 | Dotter Co., Ltd. | Deep learning based image segmentation method including biodegradable stent in intravascular optical tomography image |
US11972574B2 (en) * | 2021-03-15 | 2024-04-30 | Dotter Co., Ltd. | Deep learning based image segmentation method including biodegradable stent in intravascular optical tomography image |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7568777B2 (ja) | ステント及び血管の可視化及び診断のシステム、装置、及び方法 | |
US10335039B2 (en) | Methods for stent strut detection and related measurement and display using optical coherence tomography | |
Regar et al. | Optical coherence tomography | |
EP2934330B1 (fr) | Système de pose d'implant, et implants | |
Kume et al. | Assessment of coronary arterial plaque by optical coherence tomography | |
US7801343B2 (en) | Method and apparatus for inner wall extraction and stent strut detection using intravascular optical coherence tomography imaging | |
US20140276684A1 (en) | Atherectomy methods using coregistered sets of data | |
WO2011135103A1 (fr) | Analyse d'images intracoronaires obtenues par tomographie par cohérence optique | |
Marteslo et al. | Intravascular ultrasound for the peripheral vasculature—current applications and new horizons | |
Moshfegh et al. | Development of an innovative technology to segment luminal borders of intravascular ultrasound image sequences in a fully automated manner | |
De Franco et al. | Coronary intravascular ultrasound: implications for understanding the development and potential regression of atherosclerosis | |
Wang et al. | Automatic segmentation of vessel lumen in intravascular optical coherence tomography images | |
Sonka et al. | Computer analysis of intravascular ultrasound images | |
Wang et al. | A robust automated method to detect stent struts in 3D intravascular optical coherence tomographic image sequences | |
Ughi et al. | Automated volumetric stent analysis of in-vivo intracoronary Optical Coherence Tomography three-dimensional datasets | |
McKay et al. | Intravascular ultrasound in the coronary arteries | |
Bourezak et al. | Automatic lumen segmentation from intravascular OCT images | |
Gamal et al. | Coronary intravascular ultrasound (IVUS) | |
Malhotra et al. | Fundamentals of Intracoronary Imaging | |
Gharaibeh | COMPUTATIONAL IMAGING AS APPLIED TO CORONARY ARTERY OPTICAL CO-HERENCE TOMOGRAPHY | |
WO2017046628A1 (fr) | Dispositif et procédé d'utilisation de données ivus pour caractériser et évaluer un état de greffe vasculaire | |
EP4449444A1 (fr) | Diagnostic et sélection de traitement améliorés par détermination de propriétés de tissu à l'aide d'un ballonnement, d'une imagerie et de jumeaux numériques | |
Benenati | Intravascular ultrasound: the role in diagnostic and therapeutic procedures | |
US20160029996A1 (en) | Device and method for using ivus data to characterize and evaluate a vascular graft condition | |
Device | TCT-491 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11726722 Country of ref document: EP Kind code of ref document: A1 |
|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 11726722 Country of ref document: EP Kind code of ref document: A1 |