EP2201420A2 - System for structured illumination of a sample - Google Patents
System for structured illumination of a sampleInfo
- Publication number
- EP2201420A2 EP2201420A2 EP08870802A EP08870802A EP2201420A2 EP 2201420 A2 EP2201420 A2 EP 2201420A2 EP 08870802 A EP08870802 A EP 08870802A EP 08870802 A EP08870802 A EP 08870802A EP 2201420 A2 EP2201420 A2 EP 2201420A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- beams
- coherent
- sample
- objective
- lens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000005286 illumination Methods 0.000 title claims abstract description 30
- 230000001427 coherent effect Effects 0.000 claims abstract description 33
- 230000003287 optical effect Effects 0.000 claims abstract description 16
- 238000000386 microscopy Methods 0.000 claims abstract description 14
- 238000006073 displacement reaction Methods 0.000 description 16
- 238000005259 measurement Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 5
- LFEUVBZXUFMACD-UHFFFAOYSA-H lead(2+);trioxido(oxo)-$l^{5}-arsane Chemical compound [Pb+2].[Pb+2].[Pb+2].[O-][As]([O-])([O-])=O.[O-][As]([O-])([O-])=O LFEUVBZXUFMACD-UHFFFAOYSA-H 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004624 confocal microscopy Methods 0.000 description 1
- 238000000799 fluorescence microscopy Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0032—Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0072—Optical details of the image generation details concerning resolution or correction, including general design of CSOM objectives
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
Definitions
- the invention relates to a structured illumination system for three-dimensional microscopy of a sample.
- the illumination of the sample is structured by a movable grid.
- Such structuring allows an improvement in the axial resolution of the system compared to a so-called conventional microscope but it does not improve the lateral resolution.
- the invention more particularly relates to a structured illumination system for three-dimensional microscopy of a sample comprising:
- beam generation means arranged to generate coherent light beams
- an objective having a rear focal plane, the objective being arranged so that the sample is likely to be positioned in the objective focusing plane;
- the illumination system 1 comprises a light source 2, a diffraction grating 3 forming the beam generation means, the diffraction grating 3 being coupled to a filter 7 so as to generate only two coherent diffracted light beams 4a and 4b from the light source 2, a lens 5 arranged to focus the coherent beams 4a and 4b in the rear focal plane PFA of a microscope objective 6, a sample 18 being positioned in the focus plane PMP of the objective 6.
- the coherent beams 4a and 4b are diffracted beams having symmetrical orders p and
- An object of the invention is to improve the axial resolution in such a structured illumination system for three-dimensional microscopy of a sample.
- this document uses a simple grid to generate the diffracted beams, and it does not describe how axial displacement of the sample is performed for axial measurements.
- An object of the invention is to provide a structured illumination system for three-dimensional microscopy of a sample to improve the axial resolution compared to a conventional illumination system.
- the original approach underlying the invention is to simulate the axial displacement of the sample without mechanical displacement.
- Another object of the invention is to provide a structured illumination system for the three-dimensional microscopy of a sample for improving both the axial resolution and the lateral resolution with respect to a conventional illumination system. That is to say to achieve axial resolutions of the order of 0.3 micrometers, and lateral resolutions of the order of 0.1 microns.
- Another object of the invention is to achieve such performance while maintaining an acquisition rate compatible with the study of dynamic phenomena, that is to say greater than or equal to 1 Hertz.
- the beam generating means comprises a spatial light modulator programmed to diffracting a light signal so as to generate at least two coherent diffracted beams not symmetrical with respect to the optical axis of the objective, the spatial light modulator comprising a calculator arranged to apply a constant phase term to each of said at least two coherent beams not symmetrical with respect to the optical axis.
- the sample is illuminated by coherent but non-coherent beams. symmetrical in the axial direction. Therefore, it is possible, by a modification of the distance between the objective and the sample or an axial displacement of the illumination in the sample, to use this non-symmetry, in particular from the difference in illumination between two axial positions of the sample. This thus makes it possible to improve the axial resolution with respect to the Gustaffson et al. mentioned above, and in particular to obtain an axial resolution of less than 0.3 micrometers. According to the invention, this axial displacement is simulated by means of the spatial light modulator by applying a phase term to each of the coherent beams. Thus, the measurement does not require any mechanical displacement and the mechanical losses are therefore reduced.
- the two beams that are not symmetrical with respect to the optical axis of the objective are in particular diffracted diffraction beams of n and p diffraction order with n + p different from 0.
- the lateral resolution maintained around 0.1 micrometers, as in the Gustaffson et al. above.
- a three-dimensional structuring of the illumination has thus been realized, which makes it possible to carry out an axial coding of the illumination in addition to the lateral coding known per se.
- the beam generating means may comprise a light source capable of generating a light signal.
- the beam generating means can be arranged to generate three coherent beams, at least two coherent beams among the three coherent beams being unsymmetrical with respect to the optical axis of the objective.
- the generation of these three coherent beams makes it possible to obtain a structuring of the field symmetrical with respect to the optical axis of the objective and a gain of a factor of two in axial resolution with respect to a lighting with only two coherent beams not symmetrical.
- the beam generation means are arranged so that the three coherent beams generated by diffraction correspond to two diffracted beams of symmetrical diffraction orders and to a zero diffraction order beam.
- the symmetric order beams N and N form, with the zero diffraction order beam, two pairs of beams that are not symmetrical with respect to the optical axis that can be used in the context of the invention.
- the two diffracted beams of diffraction order symmetric diffraction orders can be chosen such that the intensity of the zero diffraction order beam is equal to four times the intensity of one of the order diffracted beams.
- symmetrical diffraction Indeed, it is demonstrated that the improvement of the axial resolution is the best in this case.
- the beams Io and IN are non-symmetrical with respect to the optical axis of the lens. Similarly, the beams I 0 and L N are unsymmetrical with respect to the optical axis of the objective.
- the light signal received from the source 9 it is possible to position a not shown afocal device between the source 9 and the spatial light modulator 10 so as to widen the signal bright, for example five to ten times.
- a sample 14 for example in the form of a fluorescent point object, is positioned in the PMP focusing plane of the objective 12 of the microscope 13 at which the three diffracted beams IN, IN and Io interfere.
- the system 8 described above allows a three-dimensional structuring of the illumination to the sample 14.
- the use of three diffraction orders reveals a Talbot effect in the field transmitted by the objective.
- the spatial light modulator 10 is programmed so as to laterally shift the interference pattern generated by the three diffracted beams in the objective focusing plane.
- This programming makes it possible to simulate a lateral displacement of a diffraction grating generating the three diffracted beams without the modulator physically moving.
- the position of the fluorescent point object is measured in a manner known per se by combining several images or their Fourier transform for different real or simulated positions of the diffraction grating, for example by difference between the intensity the fluorescence received for two real or simulated positions of the diffraction grating.
- the optical distance between the sample 14 and the objective 12 is modified.
- a piezoelectric plate 15 positioned at the level of the sample. 14 or axially moving the objective 12.
- the path of the light beams is illustrated by the illumination system according to the invention.
- the light source 9 generates a light signal in the form of a plane wave 22.
- This plane wave is diffracted by means of beam generation 21 for generating only three diffraction orders lo, IN and IN.
- These beam generation means correspond to the spatial light modulator 10 described with reference to FIG. 2.
- the diffracted beams I 0 , IN and LN are still plane waves.
- the focusing means 19, for example corresponding to a lens or achromatic doublet 19 described above converge these beams towards the back focal plane PFA of the objective 12 of microscope 13. In this way, the beams lo, IN and N L interfere in the PMP focusing plane in the form of plane waves and measurements relating to a sample 14 positioned in the PMP focusing plane can be realized.
- Beam generating means for generating three coherent beams that interfere at the objective focus plane have been described above.
- the effect of improving the axial resolution is then optimal for beams IN, IN and lo, the orders N and -N being chosen as before so that
- the system 8 described above can also easily fit on an existing microscope 13, in parallel with the existing illumination system.
- the microscope 13 may be an existing microscope with an existing objective 12, and the illumination system is adapted so that the beams IN, IN and Io are focused in the PFA rear focal plane of the objective 12.
- a new microscope having a improved resolution allowing full field observation.
Landscapes
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Microscoopes, Condenser (AREA)
Abstract
Description
SYSTÈME D'ILLUMINATION STRUCTURÉE D'UN ÉCHANTILLON STRUCTURED ILLUMINATION SYSTEM OF A SAMPLE
L'invention se rapporte à système d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon.The invention relates to a structured illumination system for three-dimensional microscopy of a sample.
La publication de Wilson et al. « confocal microscopy by aperture corrélation », 1996, décrit un tel système d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon.The publication of Wilson et al. "Confocal Microscopy by Aperture Correlation", 1996, describes such a structured illumination system for three-dimensional microscopy of a sample.
Dans cette publication, l'illumination de l'échantillon est structurée par une grille mobile. Une telle structuration permet une amélioration de la résolution axiale du système par rapport à un microscope dit classique mais elle ne permet pas d'améliorer la résolution latérale.In this publication, the illumination of the sample is structured by a movable grid. Such structuring allows an improvement in the axial resolution of the system compared to a so-called conventional microscope but it does not improve the lateral resolution.
L'invention se rapporte plus particulièrement à un système d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon comprenant :The invention more particularly relates to a structured illumination system for three-dimensional microscopy of a sample comprising:
- des moyens de génération de faisceaux agencés pour générer des faisceaux lumineux cohérents ;beam generation means arranged to generate coherent light beams;
- un objectif ayant un plan focal arrière, l'objectif étant agencé de sorte que l'échantillon soit susceptible d'être positionné dans le plan de mise au point de l'objectif ;an objective having a rear focal plane, the objective being arranged so that the sample is likely to be positioned in the objective focusing plane;
- des moyens de focalisation agencés pour focaliser les faisceaux lumineux dans le plan focal arrière de sorte que les faisceaux interfèrent de façon collimatée dans le plan de mise au point de l'objectif.focusing means arranged to focus the light beams in the rear focal plane so that the beams interfere in a collimated manner in the focus plane of the objective.
Un tel système d'illumination structurée d'un échantillon est notamment connu de la publication de Gustaffson et al. « Extended resolution fluorescence microscopy », 1999.Such a system of structured illumination of a sample is notably known from the publication of Gustaffson et al. "Extended resolution fluorescence microscopy", 1999.
Dans ce document, comme illustré figure 1 , le système d'illumination 1 comprend une source lumineuse 2, un réseau de diffraction 3 formant les moyens de génération de faisceaux, le réseau de diffraction 3 étant couplé à un filtre 7 de sorte à générer seulement deux faisceaux lumineux diffractés cohérents 4a et 4b à partir de la source lumineuse 2, une lentille 5 agencée pour focaliser les faisceaux cohérents 4a et 4b dans le plan focal arrière PFA d'un objectif 6 de microscope, un échantillon 18 étant positionné dans le plan de mise au point PMP de l'objectif 6. Les faisceaux cohérents 4a et 4b sont des faisceaux diffractés ayant des ordres symétriques p etIn this document, as illustrated in FIG. 1, the illumination system 1 comprises a light source 2, a diffraction grating 3 forming the beam generation means, the diffraction grating 3 being coupled to a filter 7 so as to generate only two coherent diffracted light beams 4a and 4b from the light source 2, a lens 5 arranged to focus the coherent beams 4a and 4b in the rear focal plane PFA of a microscope objective 6, a sample 18 being positioned in the focus plane PMP of the objective 6. The coherent beams 4a and 4b are diffracted beams having symmetrical orders p and
-P--P-
Un tel système d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon a notamment l'avantage d'avoir une résolution latérale améliorée et de permettre des mesures en plein champ.Such a structured illumination system for the three-dimensional microscopy of a sample has the particular advantage of having an improved lateral resolution and allowing measurements in the field.
Toutefois, il a l'inconvénient d'avoir une résolution axiale identique à celle d'un microscope dit classique, c'est-à-dire de l'ordre de 0,4 micromètre.However, it has the disadvantage of having an axial resolution identical to that of a so-called conventional microscope, that is to say of the order of 0.4 micrometer.
Un but de l'invention est d'améliorer la résolution axiale dans un tel système d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon.An object of the invention is to improve the axial resolution in such a structured illumination system for three-dimensional microscopy of a sample.
La demande US 2007/0171519 vise à atteindre ce but et décrit un système d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon tel que décrit ci-dessus dans lequel les faisceaux cohérents sont tels que deux des faisceaux cohérents sont non symétriques par rapport à l'axe optique de l'objectif. En particulier, la demande 2007/0171519 utilise des faisceaux d'ordres de diffraction 1 , 0 et -1 pour améliorer la résolution axiale du système d'illumination.The application US 2007/0171519 aims to achieve this goal and describes a structured illumination system for three-dimensional microscopy of a sample as described above in which the coherent beams are such that two of the coherent beams are unsymmetrical relative to each other. to the optical axis of the lens. In particular, the application 2007/0171519 uses beams of diffraction orders 1, 0 and -1 to improve the axial resolution of the illumination system.
Toutefois, ce document utilise une simple grille pour générer les faisceaux diffractés, et il ne décrit pas comment est réalisée le déplacement axial de l'échantillon pour procéder aux mesures axiales.However, this document uses a simple grid to generate the diffracted beams, and it does not describe how axial displacement of the sample is performed for axial measurements.
Or, classiquement, les déplacements sont réalisés par des systèmes mécaniques, par exemple piezo-électriques, qui provoquent d'importantes pertes de précision qui diminuent la résolution du système.However, conventionally, the movements are made by mechanical systems, for example piezo-electric, which cause significant loss of precision that reduce the resolution of the system.
Un but de l'invention est de fournir un système d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon permettant d'améliorer la résolution axiale par rapport à un système d'illumination classique.An object of the invention is to provide a structured illumination system for three-dimensional microscopy of a sample to improve the axial resolution compared to a conventional illumination system.
L'approche originale à la base de l'invention est de simuler le déplacement axial de l'échantillon sans déplacement mécanique.The original approach underlying the invention is to simulate the axial displacement of the sample without mechanical displacement.
Un autre but de l'invention est de fournir un système d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon permettant d'améliorer à la fois la résolution axiale et la résolution latérale par rapport à un système d'illumination classique, c'est-à- dire d'atteindre des résolutions axiales de l'ordre de 0,3 micromètres, et des résolutions latérales de l'ordre de 0, 1 micromètres.Another object of the invention is to provide a structured illumination system for the three-dimensional microscopy of a sample for improving both the axial resolution and the lateral resolution with respect to a conventional illumination system. that is to say to achieve axial resolutions of the order of 0.3 micrometers, and lateral resolutions of the order of 0.1 microns.
Un autre but de l'invention est de permettre d'atteindre de telles performances tout en conservant une cadence d'acquisition compatible avec l'étude de phénomènes dynamiques, c'est-à-dire supérieure ou égale à 1 Hertz.Another object of the invention is to achieve such performance while maintaining an acquisition rate compatible with the study of dynamic phenomena, that is to say greater than or equal to 1 Hertz.
Au moins un de ces buts est atteint grâce à un système d'illumination structurée pour la microscopie tridimensionnelle tel que décrit ci- dessus, dans lequel les moyens de génération de faisceaux comprennent un modulateur spatial de lumière programmé pour diffracter un signal lumineux de sorte à générer au moins deux faisceaux diffractés cohérents non symétriques par rapport à l'axe optique de l'objectif, le modulateur spatial de lumière comprenant un calculateur agencé pour appliquer un terme de phase constant à chacun desdits au moins deux faisceaux cohérents non symétriques par rapport à l'axe optique.At least one of these aims is achieved through a structured illumination system for three-dimensional microscopy as described above, wherein the beam generating means comprises a spatial light modulator programmed to diffracting a light signal so as to generate at least two coherent diffracted beams not symmetrical with respect to the optical axis of the objective, the spatial light modulator comprising a calculator arranged to apply a constant phase term to each of said at least two coherent beams not symmetrical with respect to the optical axis.
Grâce à l'invention, et notamment au fait que les faisceaux cohérents générés par les moyens de génération comprennent au moins deux faisceaux non symétriques par rapport à l'axe optique de l'objectif, l'échantillon est éclairé par des faisceaux cohérents mais non symétriques dans la direction axiale. Dès lors, il est possible, par une modification de la distance entre l'objectif et l'échantillon ou un déplacement axial de l'illumination dans l'échantillon, d'utiliser cette non symétrie à partir notamment de la différence d'illumination entre deux positions axiales de l'échantillon. Ceci permet ainsi d'améliorer la résolution axiale par rapport au système de Gustaffson et al. mentionné ci-dessus, et d'obtenir notamment une résolution axiale inférieure à 0,3 micromètres. Selon l'invention, ce déplacement axial est simulé grâce au modulateur spatial de lumière par application d'un terme de phase à chacun des faisceaux cohérents. Ainsi, la mesure ne nécessite aucun déplacement mécanique et les pertes mécaniques sont donc diminuées.Thanks to the invention, and in particular to the fact that the coherent beams generated by the generating means comprise at least two beams that are not symmetrical with respect to the optical axis of the objective, the sample is illuminated by coherent but non-coherent beams. symmetrical in the axial direction. Therefore, it is possible, by a modification of the distance between the objective and the sample or an axial displacement of the illumination in the sample, to use this non-symmetry, in particular from the difference in illumination between two axial positions of the sample. This thus makes it possible to improve the axial resolution with respect to the Gustaffson et al. mentioned above, and in particular to obtain an axial resolution of less than 0.3 micrometers. According to the invention, this axial displacement is simulated by means of the spatial light modulator by applying a phase term to each of the coherent beams. Thus, the measurement does not require any mechanical displacement and the mechanical losses are therefore reduced.
Les deux faisceaux non symétriques par rapport à l'axe optique de l'objectif sont notamment des faisceaux diffractés d'ordre de diffraction n et p avec n+p différent de 0.The two beams that are not symmetrical with respect to the optical axis of the objective are in particular diffracted diffraction beams of n and p diffraction order with n + p different from 0.
En outre, grâce à l'invention, la résolution latérale maintenue autour de 0, 1 micromètres, comme dans le système de Gustaffson et al. susmentionné.In addition, thanks to the invention, the lateral resolution maintained around 0.1 micrometers, as in the Gustaffson et al. above.
Enfin, puisque le système selon l'invention est un système d'imagerie plein champ, une cadence supérieure à 1 Hz peut être obtenue.Finally, since the system according to the invention is an imaging system full field, a rate greater than 1 Hz can be obtained.
Selon l'invention, on a donc réalisé une structuration tridimensionnelle de l'illumination qui permet de réaliser un codage axial de l'illumination en plus du codage latéral connu en soi.According to the invention, a three-dimensional structuring of the illumination has thus been realized, which makes it possible to carry out an axial coding of the illumination in addition to the lateral coding known per se.
On décrit maintenant des modes de réalisation avantageux de l'invention.Advantageous embodiments of the invention will now be described.
Selon un mode de réalisation de l'invention, les moyens de génération de faisceaux peuvent comprendre une source lumineuse apte à générer un signal lumineux.According to one embodiment of the invention, the beam generating means may comprise a light source capable of generating a light signal.
De préférence, les moyens de génération de faisceaux peuvent être agencés pour générer trois faisceaux cohérents, au moins deux faisceaux cohérents parmi les trois faisceaux cohérents étant non symétriques par rapport à l'axe optique de l'objectif. Dans le cadre de l'invention, la génération de ces trois faisceaux cohérents permet d'obtenir une structuration du champ symétrique par rapport à l'axe optique de l'objectif et un gain d'un facteur deux en résolution axiale par rapport à un éclairage avec uniquement deux faisceaux cohérents non symétriques.Preferably, the beam generating means can be arranged to generate three coherent beams, at least two coherent beams among the three coherent beams being unsymmetrical with respect to the optical axis of the objective. In the context of the invention, the generation of these three coherent beams makes it possible to obtain a structuring of the field symmetrical with respect to the optical axis of the objective and a gain of a factor of two in axial resolution with respect to a lighting with only two coherent beams not symmetrical.
De préférence, les moyens de génération de faisceaux sont agencés pour que les trois faisceaux cohérents générés par diffraction correspondent à deux faisceaux diffractés d'ordres de diffraction symétriques et à un faisceau d'ordre de diffraction zéro. Dans ce cas, les faisceaux d'ordre symétriques N et -N forment, avec le faisceau d'ordre de diffraction zéro, deux couples de faisceaux non symétriques par rapport à l'axe optique utilisables dans le cadre de l'invention.Preferably, the beam generation means are arranged so that the three coherent beams generated by diffraction correspond to two diffracted beams of symmetrical diffraction orders and to a zero diffraction order beam. In this case, the symmetric order beams N and N form, with the zero diffraction order beam, two pairs of beams that are not symmetrical with respect to the optical axis that can be used in the context of the invention.
En particulier, les deux faisceaux diffractés d'ordre de diffraction symétrique peuvent être d'intensité égale, et les deux ordres de diffraction symétriques peuvent être choisis de sorte que l'intensité du faisceau d'ordre de diffraction zéro soit égale à quatre fois l'intensité d'un des faisceaux diffractés d'ordre de diffraction symétriques. On démontre en effet que l'amélioration de la résolution axiale est la meilleure dans ce cas.In particular, the two diffracted beams of diffraction order symmetric diffraction orders can be chosen such that the intensity of the zero diffraction order beam is equal to four times the intensity of one of the order diffracted beams. symmetrical diffraction. Indeed, it is demonstrated that the improvement of the axial resolution is the best in this case.
Afin de permettre des mesures latérales dans un plan xOy perpendiculaire à l'axe optique z de l'objectif, le calculateur peut être programmé de sorte à déphaser l'un desdits au moins deux faisceaux cohérents non symétriques par rapport à l'autre. Ce mode de réalisation a l'avantage de permettre un déplacement latéral du motif d'interférence dans l'échantillon et simule donc le déplacement latéral d'un réseau de diffraction par programmation du modulateur spatial de lumière. Il permet donc de réaliser des mesures latérales sans déplacement physique des composants du système.In order to allow lateral measurements in a plane xOy perpendicular to the optical axis z of the objective, the computer can be programmed so as to phase out one of said at least two coherent beams unsymmetrical with respect to the other. This embodiment has the advantage of allowing a lateral displacement of the interference pattern in the sample and thus simulates the lateral displacement of a diffraction grating by programming the spatial light modulator. It thus makes it possible to carry out lateral measurements without physical displacement of the components of the system.
On décrit maintenant un mode de réalisation de l'invention en référence aux figures annexées dans lesquelles :An embodiment of the invention will now be described with reference to the appended figures in which:
- la figure 2 représente un système d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon selon un mode de réalisation de l'invention ;FIG. 2 represents a structured illumination system for three-dimensional microscopy of a sample according to one embodiment of the invention;
- la figure 3 représente les trajets de faisceaux lumineux dans un système tel qu'illustré en référence à la FIG. 2.FIG. 3 shows the light beam paths in a system as illustrated with reference to FIG. 2.
Sur les figures, des références identiques se rapportent, sauf indication contraire, à des caractéristiques techniques similaires.In the figures, identical references, unless otherwise indicated, relate to similar technical characteristics.
Comme illustré sur la figure 2, selon un premier mode de réalisation de l'invention, un système 8 d'illumination structurée pour la microscopie tridimensionnelle d'un échantillon comprend une source lumineuse 9 apte à générer un signal lumineux cohérent et polarisé linéairement. La source lumineuse 9 est par exemple un laser. Il comprend également un modulateur spatial de lumière 10 en transmission ou en réflexion programmé pour générer, à partir du signal lumineux reçu de la source 9, trois faisceaux diffractés d'intensité respectives IN, I-N et lo- Les faisceaux diffractés IN et LN sont des faisceaux d'ordre symétriques N, et le faisceau Io correspond à un faisceau d'ordre zéro.As illustrated in FIG. 2, according to a first embodiment of the invention, a structured illumination system 8 for the three-dimensional microscopy of a sample comprises a light source 9 able to generate a coherent and polarized light signal. linearly. The light source 9 is for example a laser. It also comprises a spatial light modulator 10 in transmission or reflection programmed to generate, from the light signal received from the source 9, three diffracted beams of respective intensity IN, IN and LO. The diffracted beams IN and LN are N symmetric order beams, and the beam Io corresponds to a zero order beam.
Les faisceaux Io et IN sont non symétriques par rapport à l'axe optique de l'objectif. De même, les faisceaux I0 et LN sont non symétriques par rapport à l'axe optique de l'objectif.The beams Io and IN are non-symmetrical with respect to the optical axis of the lens. Similarly, the beams I 0 and L N are unsymmetrical with respect to the optical axis of the objective.
L'ordre N des faisceaux diffractés IN et LN est choisi de sorte que l'intensité du faisceau d'ordre zéro soit égal à quatre fois l'intensité de ces faisceaux, soit I0=4IN=4LN. On démontre en effet que l'amélioration de la résolution axiale est la meilleure dans ce cas.The order N of the diffracted beams IN and LN is chosen so that the intensity of the zero-order beam is equal to four times the intensity of these beams, ie I 0 = 4IN = 4LN. Indeed, it is demonstrated that the improvement of the axial resolution is the best in this case.
Afin que le signal lumineux reçu de la source 9 s'adapte à la taille du modulateur spatial de lumière 10, il est possible de positionner un dispositif afocal non représenté entre la source 9 et le modulateur spatial de lumière 10 de sorte à élargir le signal lumineux, par exemple de cinq à dix fois.In order for the light signal received from the source 9 to adapt to the size of the spatial light modulator 10, it is possible to position a not shown afocal device between the source 9 and the spatial light modulator 10 so as to widen the signal bright, for example five to ten times.
En sortie du modulateur spatial de lumière 10, les faisceaux diffractés passent par un nouveau dispositif afocal 1 1 et sont focalisés dans le plan focal arrière PFA d'un objectif 12 de microscope 13 par un doublet achromatique 19. Le facteur de grandissement du dispositif afocal 1 1 est choisi pour que les angles de diffraction soit adaptés au diamètre de l'objectif 12 du microscope 1 3.At the output of the spatial light modulator 10, the diffracted beams pass through a new afocal device 11 and are focused in the rear focal plane PFA of a microscope objective 12 by an achromatic doublet 19. The magnification factor of the afocal device 1 1 is chosen so that the diffraction angles are adapted to the diameter of the objective 12 of the microscope 1 3.
Un échantillon 14 par exemple sous la forme d'un objet ponctuel fluorescent est positionné dans le plan de mise au point PMP de l'objectif 12 du microscope 13 au niveau duquel les trois faisceaux diffractés I N, I-N et Io interfèrent.A sample 14, for example in the form of a fluorescent point object, is positioned in the PMP focusing plane of the objective 12 of the microscope 13 at which the three diffracted beams IN, IN and Io interfere.
Le système 8 décrit ci-dessus permet une structuration tridimensionnelle de l'illumination vers l'échantillon 14. En effet, l'utilisation de trois ordres de diffraction fait apparaître un effet Talbot dans le champ transmis par l'objectif.The system 8 described above allows a three-dimensional structuring of the illumination to the sample 14. In fact, the use of three diffraction orders reveals a Talbot effect in the field transmitted by the objective.
En fonctionnement, pour réaliser des mesures dans le plan latéral xOy, on programme le modulateur spatial de lumière 10 de sorte à déplacer latéralement le motif d'interférence généré par les trois faisceaux diffractés dans le plan de mise au point de l'objectif. Cette programmation permet de simuler un déplacement latéral d'un réseau de diffraction générant les trois faisceaux diffractés sans que le modulateur ne se déplace physiquement. Suite à ce déplacement latéral simulé, on mesure la position de l'objet ponctuel fluorescent de façon connue en soi en combinant plusieurs images ou leur transformée de Fourier pour différentes positions réelles ou simulées du réseau de diffraction, par exemple par différence entre l'intensité de la fluorescence reçue pour deux positions réelles ou simulées du réseau de diffraction.In operation, to perform measurements in the lateral plane xOy, the spatial light modulator 10 is programmed so as to laterally shift the interference pattern generated by the three diffracted beams in the objective focusing plane. This programming makes it possible to simulate a lateral displacement of a diffraction grating generating the three diffracted beams without the modulator physically moving. Following this simulated lateral displacement, the position of the fluorescent point object is measured in a manner known per se by combining several images or their Fourier transform for different real or simulated positions of the diffraction grating, for example by difference between the intensity the fluorescence received for two real or simulated positions of the diffraction grating.
En outre, en fonctionnement, pour réaliser des mesures selon la direction axiale z, on modifie la distance optique entre l'échantillon 14 et l'objectif 12. Pour ce faire, on peut utiliser une platine piézoélectrique 15 positionnée au niveau de l'échantillon 14 ou déplacer axialement l'objectif 12. Selon l'invention, il est également possible de simuler ce déplacement en programmant le modulateur spatial de lumière 10 pour appliquer un terme de phase constant à tous les pixels du modulateur 10, ce qui en conséquence applique un terme de phase constant aux faisceaux diffractés.In addition, in operation, in order to carry out measurements in the axial direction z, the optical distance between the sample 14 and the objective 12 is modified. To this end, it is possible to use a piezoelectric plate 15 positioned at the level of the sample. 14 or axially moving the objective 12. According to the invention, it is also possible to simulate this displacement by programming the spatial light modulator 10 to apply a constant phase term to all the pixels of the modulator 10, which consequently applies a constant phase term to the diffracted beams.
Comme précédemment, et grâce à l'effet Talbot bien connu, on mesure la position axiale de l'objet ponctuel fluorescent par exemple par différence entre l'intensité de la fluorescence reçue pour deux distances réelles ou simulées entre l'objectif 12 et l'échantillon 14.As before, and thanks to the well-known Talbot effect, one measures the axial position of the fluorescent point object, for example by difference between the intensity of the fluorescence received for two real or simulated distances between the objective 12 and the sample 14.
Sur la figure 3, on a illustré le trajet des faisceaux lumineux grâce au système d'illumination selon l'invention. Selon l'invention, la source lumineuse 9 génère un signal lumineux sous la forme d'une onde plane 22. Cette onde plane est diffractée par des moyens de génération de faisceaux 21 permettant de générer uniquement trois ordres de diffraction lo, IN et I-N. Ces moyens de génération de faisceaux correspondent au modulateur spatial de lumière 10 décrit en référence à la figure 2. Les faisceaux diffractés I0, I N et LN sont encore des ondes planes. Les moyens de focalisation 19 correspondant par exemple à une lentille ou au doublet achromatique 19 décrit précédemment font converger ces faisceaux vers le plan focal arrière PFA de l'objectif 12 du microscope 13. De la sorte, les faisceaux lo, I N et LN interfèrent dans le plan de mise au point PMP sous la forme d'ondes planes et les mesures relatives à un échantillon 14 positionné dans le plan de mise au point PMP peuvent être réalisées.In FIG. 3, the path of the light beams is illustrated by the illumination system according to the invention. According to the invention, the light source 9 generates a light signal in the form of a plane wave 22. This plane wave is diffracted by means of beam generation 21 for generating only three diffraction orders lo, IN and IN. These beam generation means correspond to the spatial light modulator 10 described with reference to FIG. 2. The diffracted beams I 0 , IN and LN are still plane waves. The focusing means 19, for example corresponding to a lens or achromatic doublet 19 described above converge these beams towards the back focal plane PFA of the objective 12 of microscope 13. In this way, the beams lo, IN and N L interfere in the PMP focusing plane in the form of plane waves and measurements relating to a sample 14 positioned in the PMP focusing plane can be realized.
On décrit maintenant des variantes de l'invention.Variants of the invention are now described.
On a décrit ci-dessus des moyens de génération de faisceaux permettant de générer trois faisceaux cohérents qui interfèrent au niveau du plan de mise au point de l'objectif. L'effet d'amélioration de la résolution axiale est alors optimal pour des faisceaux IN, I-N et lo, les ordres N et -N étant choisis comme précédemment de sorte que Beam generating means for generating three coherent beams that interfere at the objective focus plane have been described above. The effect of improving the axial resolution is then optimal for beams IN, IN and lo, the orders N and -N being chosen as before so that
Toutefois, on comprend que l'effet d'amélioration de la résolution axiale est obtenu dès lors que les faisceaux diffractés sont tels qu'au moins deux faisceaux cohérents non symétriques par rapport à l'axe optique de l'objectif interfèrent au niveau du plan de mise au point PMP de l'objectif 12. En effet, dans ce cas, la symétrie axiale des faisceaux est rompue et il est possible, en déplaçant l'échantillon 14 par rapport à l'objectif 12 ou en simulant ce déplacement comme mentionné précédemment, d'obtenir une information sur la position axiale de l'échantillon 14.However, it is understood that the effect of improving the axial resolution is obtained when the diffracted beams are such that at least two coherent beams that are not symmetrical with respect to the axis lens optics interfere at the focus plane PMP of the objective 12. Indeed, in this case, the axial symmetry of the beams is broken and it is possible, by moving the sample 14 with respect to the 12 or by simulating this displacement as mentioned above, to obtain information on the axial position of the sample 14.
Au contraire, on peut noter, en référence à la figure 1 , qu'un déplacement de l'échantillon 18 par rapport à l'objectif 6 n'aurait aucun effet dans le cadre du système 1 décrit dans la publication de Gustafsson et al. puisque les deux faisceaux 4a et 4b sont symétriques par rapport à l'axe optique de l'objectif. Un tel déplacement axial ne permet donc pas de réaliser des mesures axiales précises.On the contrary, it can be noted, with reference to FIG. 1, that a displacement of the sample 18 with respect to the objective 6 would have no effect within the framework of the system 1 described in the publication of Gustafsson et al. since the two beams 4a and 4b are symmetrical with respect to the optical axis of the lens. Such axial displacement therefore makes it impossible to perform precise axial measurements.
II a été démontré que l'invention décrite précédemment permettait d'améliorer la résolution axiale d'un facteur de l'ordre de 10 par rapport à la microscopie dite classique.It has been demonstrated that the invention described above makes it possible to improve the axial resolution by a factor of the order of 10 relative to the so-called conventional microscopy.
En outre, l'utilisation d'un modulateur spatial de lumière comme décrit en référence à la figure 2 a l'avantage d'éviter les déplacements mécaniques du système et donc d'améliorer la précision des mesures.In addition, the use of a spatial light modulator as described with reference to FIG. 2 has the advantage of avoiding the mechanical displacements of the system and thus of improving the accuracy of the measurements.
Le système 8 décrit précédemment peut également facilement s'adapter sur un microscope 13 existant, en parallèle du système d'illumination existant.The system 8 described above can also easily fit on an existing microscope 13, in parallel with the existing illumination system.
Dans ce cas, dans les modes de réalisation décrits ci-dessus, le microscope 13 peut être un microscope existant avec un objectif existant 12, et on adapte le système d'illumination de sorte que les faisceaux IN, I-N et Io soient focalisés dans le plan focal arrière PFA de l'objectif 12. On forme alors un nouveau microscope ayant une résolution améliorée permettant une observation plein champ. In this case, in the embodiments described above, the microscope 13 may be an existing microscope with an existing objective 12, and the illumination system is adapted so that the beams IN, IN and Io are focused in the PFA rear focal plane of the objective 12. A new microscope having a improved resolution allowing full field observation.
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR0707299A FR2922658B1 (en) | 2007-10-18 | 2007-10-18 | STRUCTURED ILLUMINATION SYSTEM OF A SAMPLE |
| PCT/FR2008/001469 WO2009090341A2 (en) | 2007-10-18 | 2008-10-17 | System for structured illumination of a sample for three-dimensional microscopy |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP2201420A2 true EP2201420A2 (en) | 2010-06-30 |
Family
ID=39432831
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP08870802A Withdrawn EP2201420A2 (en) | 2007-10-18 | 2008-10-17 | System for structured illumination of a sample |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US8289622B2 (en) |
| EP (1) | EP2201420A2 (en) |
| JP (1) | JP2011501214A (en) |
| FR (1) | FR2922658B1 (en) |
| WO (1) | WO2009090341A2 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2922658B1 (en) * | 2007-10-18 | 2011-02-04 | Centre Nat Rech Scient | STRUCTURED ILLUMINATION SYSTEM OF A SAMPLE |
| JP5900515B2 (en) | 2012-01-18 | 2016-04-06 | 株式会社ニコン | Structured illumination device, structured illumination microscope device, structured illumination method |
| JP2014063151A (en) * | 2012-08-29 | 2014-04-10 | Canon Inc | Microscope illumination optical system and microscope having the same |
| DE102012017922B4 (en) * | 2012-09-11 | 2024-03-14 | Carl Zeiss Microscopy Gmbh | Optical arrangement and light microscope |
| CN106680271A (en) * | 2015-11-05 | 2017-05-17 | 南京理工大学 | Spatial light modulator-based naked eye stereoscopic microimaging apparatus and method |
| US11287627B2 (en) | 2017-06-30 | 2022-03-29 | Chrysanthe Preza | Multi-focal light-sheet structured illumination fluorescence microscopy system |
| WO2022094072A1 (en) * | 2020-10-28 | 2022-05-05 | Georgia Tech Research Corporation | Cell imaging systems and methods |
Family Cites Families (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4348574B2 (en) * | 1998-04-30 | 2009-10-21 | 株式会社ニコン | Dark field illumination device and dark field illumination method |
| DE19827139C2 (en) * | 1998-06-18 | 2002-01-31 | Zeiss Carl Jena Gmbh | Microscope with a short-pulse laser coupled in via an optical fiber |
| US7274446B2 (en) * | 2001-04-07 | 2007-09-25 | Carl Zeiss Jena Gmbh | Method and arrangement for the deep resolved optical recording of a sample |
| JP4844862B2 (en) * | 2001-09-14 | 2011-12-28 | 株式会社ニコン | Lattice illumination microscope |
| WO2003031951A1 (en) * | 2001-10-09 | 2003-04-17 | Ruprecht-Karls-Universität Heidelberg | Far yield light microscopical method, system and computer program product for analysing at least one object having a subwavelength size |
| US6888148B2 (en) * | 2001-12-10 | 2005-05-03 | Carl Zeiss Jena Gmbh | Arrangement for the optical capture of excited and /or back scattered light beam in a sample |
| US7312432B2 (en) * | 2002-07-08 | 2007-12-25 | Dmetrix, Inc. | Single axis illumination for multi-axis imaging system |
| DE10254139A1 (en) * | 2002-11-15 | 2004-05-27 | Carl Zeiss Jena Gmbh | Method and arrangement for the depth-resolved optical detection of a sample |
| DE10332073A1 (en) * | 2003-07-11 | 2005-02-10 | Carl Zeiss Jena Gmbh | Arrangement for the optical detection of light radiation with double objective arrangement excited and / or backscattered in a sample |
| JP4512180B2 (en) * | 2004-01-09 | 2010-07-28 | 独立行政法人理化学研究所 | Interfering device |
| US7046342B2 (en) * | 2004-01-29 | 2006-05-16 | International Business Machines Corporation | Apparatus for characterization of photoresist resolution, and method of use |
| DE102004034962A1 (en) * | 2004-07-16 | 2006-02-16 | Carl Zeiss Jena Gmbh | Microscope with increased resolution |
| US8115806B2 (en) * | 2005-03-30 | 2012-02-14 | Nikon Corporation | Image forming method and microscope device |
| US7485875B2 (en) * | 2005-07-22 | 2009-02-03 | Carl Zeiss Microimaging Gmbh | Resolution-enhanced luminescence microscopy |
| US20080158668A1 (en) * | 2005-10-07 | 2008-07-03 | Nikon Corporation | Microscope and Image Generation Method |
| EP1936422A4 (en) * | 2005-10-13 | 2013-01-16 | Nikon Corp | Microscope |
| JP2007147388A (en) * | 2005-11-25 | 2007-06-14 | Toshiba Corp | Surface measuring device |
| JP2007199572A (en) * | 2006-01-30 | 2007-08-09 | Nikon Corp | Microscope equipment |
| EP1816493A1 (en) * | 2006-02-07 | 2007-08-08 | ETH Zürich | Tunable diffraction grating |
| US7619732B2 (en) * | 2006-03-01 | 2009-11-17 | Leica Microsystems Cms Gmbh | Method and microscope for high spatial resolution examination of samples |
| WO2008030681A2 (en) * | 2006-09-08 | 2008-03-13 | Gsi Group Corporation | Interferometric position encoder employing spatial filtering of diffraction orders |
| JP5136422B2 (en) * | 2006-12-12 | 2013-02-06 | 株式会社ニコン | Microscope device and image processing method |
| EP2118698B1 (en) * | 2007-02-02 | 2018-04-04 | King's College London | Method and apparatus for improving image resolution |
| WO2008124832A1 (en) * | 2007-04-10 | 2008-10-16 | University Of Rochester | Structured illumination for imaging of stationary and non-stationary, fluorescent and non-flourescent objects |
| JP2009098215A (en) * | 2007-10-12 | 2009-05-07 | Nikon Corp | Microscope device and method for calculating phase change amount in microscope device. |
| US8072611B2 (en) * | 2007-10-12 | 2011-12-06 | Zygo Corporation | Interferometric analysis of under-resolved features |
| FR2922658B1 (en) * | 2007-10-18 | 2011-02-04 | Centre Nat Rech Scient | STRUCTURED ILLUMINATION SYSTEM OF A SAMPLE |
| DE102007063274B8 (en) * | 2007-12-20 | 2022-12-15 | Albert-Ludwigs-Universität Freiburg | microscope |
| US8115992B2 (en) * | 2007-12-31 | 2012-02-14 | Stc.Unm | Structural illumination and evanescent coupling for the extension of imaging interferometric microscopy |
| US20090219607A1 (en) * | 2008-01-17 | 2009-09-03 | Baylor College Of Medicine | Method and apparatus for enhanced resolution microscopy of living biological nanostructures |
| US8019136B2 (en) * | 2008-12-03 | 2011-09-13 | Academia Sinica | Optical sectioning microscopy |
| US8107084B2 (en) * | 2009-01-30 | 2012-01-31 | Zygo Corporation | Interference microscope with scan motion detection using fringe motion in monitor patterns |
| GB0907965D0 (en) * | 2009-05-08 | 2009-06-24 | King S College London | Imaging system |
| US8174761B2 (en) * | 2009-06-10 | 2012-05-08 | Universitat Heidelberg | Total internal reflection interferometer with laterally structured illumination |
| WO2011072175A2 (en) * | 2009-12-09 | 2011-06-16 | Applied Precision, Inc. | Method and system for fast three-dimensional structured-illumination-microscopy imaging |
| WO2011135819A1 (en) * | 2010-04-26 | 2011-11-03 | 株式会社ニコン | Structural illumination microscope device |
-
2007
- 2007-10-18 FR FR0707299A patent/FR2922658B1/en not_active Expired - Fee Related
-
2008
- 2008-10-17 JP JP2010529427A patent/JP2011501214A/en active Pending
- 2008-10-17 US US12/738,573 patent/US8289622B2/en not_active Expired - Fee Related
- 2008-10-17 EP EP08870802A patent/EP2201420A2/en not_active Withdrawn
- 2008-10-17 WO PCT/FR2008/001469 patent/WO2009090341A2/en not_active Ceased
Non-Patent Citations (1)
| Title |
|---|
| See references of WO2009090341A3 * |
Also Published As
| Publication number | Publication date |
|---|---|
| FR2922658B1 (en) | 2011-02-04 |
| WO2009090341A3 (en) | 2009-09-11 |
| US20110116163A1 (en) | 2011-05-19 |
| FR2922658A1 (en) | 2009-04-24 |
| WO2009090341A2 (en) | 2009-07-23 |
| US8289622B2 (en) | 2012-10-16 |
| JP2011501214A (en) | 2011-01-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2201420A2 (en) | System for structured illumination of a sample | |
| WO1998013715A1 (en) | Microscope generating a three-dimensional representation of an object | |
| EP2915009B1 (en) | Auto-referenced holographic imaging system | |
| EP3069185B1 (en) | Three-dimensional focusing device and method for a microscope | |
| EP3039475B1 (en) | System and method of single plane illumination microscopy | |
| WO2012050901A2 (en) | Fourier domain sensing | |
| CN103823353B (en) | Based on the sub-wavelength super-resolution digital holographic imaging systems of microsphere | |
| EP3397944B1 (en) | Device and method for bimodal observation of an object | |
| EP3602201B1 (en) | Devices and methods for optical imaging by means of off-axis digital holography | |
| EP3199941A1 (en) | Method for observing a sample by lens-free imaging | |
| EP0028548A1 (en) | Real-time optical correlation system | |
| JP2017533445A (en) | Optical telemetry device | |
| EP3371574B1 (en) | Device and method for observing an object by lensless imaging | |
| JP6154676B2 (en) | Spatial frequency reproduction device | |
| FR2942049A1 (en) | HIGH RESOLUTION SURFACE PLASMON MICROSCOPE COMPRISING A HETERODYNE FIBER INTERFEROMETER | |
| CA2617983A1 (en) | Tomographic imaging by an interferometric immersion microscope | |
| EP3903098B1 (en) | Method for characterising a sample by phase imaging | |
| FR3081552A1 (en) | DEVICE AND METHOD FOR OBSERVING A FLUORESCENT SAMPLE BY DEFOCUSED IMAGING | |
| FR3114661A1 (en) | Optical device for deflecting a light beam and inelastic scattering spectrometer comprising such a device | |
| Liu et al. | Enhancing Coherent Superoscillatory Microscopy through Complex Deconvolution | |
| Zhang et al. | Fresnel incoherent correlation holographic localization microscopy with enhanced localization accuracy by employing autofocus algorithm | |
| WO2010001047A1 (en) | Device for the optical characterisation of an object having very small dimensions | |
| CA3056969C (en) | Vibration measurement protection system | |
| Tao et al. | Interferometric focusing of guide-stars for direct wavefront sensing | |
| FR2965929A1 (en) | OPTIC MICROSCOPE IN NEAR FIELD |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20100415 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
| AX | Request for extension of the european patent |
Extension state: AL BA MK RS |
|
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
| 18D | Application deemed to be withdrawn |
Effective date: 20150501 |