EP2333602B1 - Spherical aberration correction for non-descanned applications - Google Patents
Spherical aberration correction for non-descanned applications Download PDFInfo
- Publication number
- EP2333602B1 EP2333602B1 EP10015589.4A EP10015589A EP2333602B1 EP 2333602 B1 EP2333602 B1 EP 2333602B1 EP 10015589 A EP10015589 A EP 10015589A EP 2333602 B1 EP2333602 B1 EP 2333602B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- lens
- optical system
- light
- spherical aberration
- port
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000004075 alteration Effects 0.000 title claims description 56
- 238000012937 correction Methods 0.000 title claims description 22
- 230000003287 optical effect Effects 0.000 claims description 78
- 238000005286 illumination Methods 0.000 claims description 24
- 238000003384 imaging method Methods 0.000 claims description 24
- 238000000034 method Methods 0.000 claims description 12
- 238000001514 detection method Methods 0.000 claims description 10
- 238000012634 optical imaging Methods 0.000 claims description 6
- 238000009792 diffusion process Methods 0.000 claims 1
- 238000010859 live-cell imaging Methods 0.000 claims 1
- 230000008859 change Effects 0.000 description 6
- 239000006059 cover glass Substances 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- 238000001161 time-correlated single photon counting Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 210000002858 crystal cell Anatomy 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000012528 membrane Substances 0.000 description 1
- 238000000386 microscopy Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 229920003023 plastic Polymers 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/361—Optical details, e.g. image relay to the camera or image sensor
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
- G02B27/0068—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration having means for controlling the degree of correction, e.g. using phase modulators, movable elements
Definitions
- the present invention generally relates to spherical aberration correction in optical microscopes. More specifically, the present invention relates to a device, method and use for spherical aberration correction for non-descanned detection. Even more specifically, an exemplary embodiment of the invention relates to a spherical aberration correction device combined with a multi-photon imaging system.
- High-power optical microscopes can use objectives with large numerical apertures (NA) resulting in high resolution imaging. In the case of oil or water immersion objectives these NAs can exceed 1.0.
- NA numerical aperture
- the first aberration that causes loss of signal and resolution is spherical aberration.
- Spherical aberration is the artifact in an imaging system caused by the inability of the optical system to focus axial and off-axis light from a point source to a single point.
- Modern objectives are highly corrected for spherical aberration, using multiple lens elements to eliminate the effect. However, these objectives are corrected only for a single ideal situation (e.g., for a specific cover glass thickness for samples on the cover glass).
- US 2005/0207003 A1 relates to a microscope with a wavefront modulator for correcting spherical aberrations and an optical relay for controlling a beam diameter from an objective lens.
- US2003/0063529 A1 relates to an optical head for a disk drive, wherein variation of the thickness of a protective disc layer is considered by shifting lenses in an optical relay.
- US 2003/0063379 A1 relates to a scanning optical microscope with a wavefront converting element for correcting spherical aberration.
- Examples given for the wavefront converting element are liquid crystal cells and membrane mirrors.
- US 2008/0151397 A1 is related to an optical pickup for use in an optical disc device.
- the optical pickup comprises a spherical aberration means which is formed by an optical lens made of glass or transparent plastic and a mechanism which moves the optical lens in an optical axis direction of the lens.
- US 2006/098213 A1 relates to an optical device to reduce the generation of spherical aberration, in which a spherical-aberration correction element disposed within the device behind the objective may be moved along an optical axis.
- EP 1 717 623 A1 relates to a laser condensing optical system which condenses laser light in different sections of a medium.
- the position of a light source can be changed while ensuring that the intensity and the intensity distribution of light which is incident on a pupil face of the optical system remain constant.
- EP 0 859 259 A2 is directed to an adapter for correcting spherical aberrations of objective lens.
- the adapter is attached to the objective lens imagewise or inserted between a first and second objective lens.
- JP 2005 316068 A relates to an optical system capable of changing a light source position while keeping a light quantity and a light quantity distribution incident on a pupil plane of the optical system constant.
- JP 2001 264637 A is directed to an optical system for compensating spherical aberration.
- the optical system is disposed on the image side of the objective lens.
- Object of the present invention is to provide a spherical aberration correction device, a method and a use allowing optimized aberration correction in case of scanning microscopes, in particular for multi-photon imaging.
- a common optical microscope configuration when simplified includes an infinity objective and a tube lens.
- the sample is imaged a specific distance from the objective and at the back focal length of the tube lens the magnified image is created.
- This image could be recorded by a camera or other imaging device, but in the case of non-descanned detection, the whole signal is combined and measured as a single scalar.
- the angle of the illumination beam on the back aperture of the objective is changed so that the focal point is also changed.
- Most objectives are made so that points off the axis and in the focal plane are correctly relayed to the plane of the image. Points out of the focal plane (above or below) are also relayed and measured by the non-descanned detector.
- the entire signal comes from the focal point.
- the image of the "ideal" focal plane will have spherical aberration.
- the true ideal focal plane (with no spherical aberration) will be located above or below the original plane.
- the spherical aberration free image will move further from the original plane.
- a variable optical relay can be employed to change the plane of the image volume that is recorded.
- one exemplary embodiment of the invention is directed toward a moving optical relay system for selecting a plane of interest from the sample. If this relay were to be motorized as well as the focus of the microscope, one could in an automated fashion correct for the spherical aberration in the current sample plane. Typically this would involve software to select the position of the relay based on the quality of the image.
- the first is due to the conditions of the sample - usually variations in the thickness of the cover glass. This source of aberration is usually invariant over the sample, but is very hard to predict. To correct for this, the sample must be directly measured and the best plane of interest of the image volume chosen based on the measurement of the sample at several planes.
- the second source of aberration is due to imaging deeper into the sample.
- the spherical aberration varies with depth for any given sample medium for any given objective in a known manner.
- An algorithm can be developed that will give the plane of the image volume needed for any given depth of the sample. The end result is that one has a curve that represents the change in plane location vs. sample depth and a random offset to this curve caused by the sample. The offset can be found empirically and then any depth in the sample can be corrected using the calculated curve.
- spherical aberration directly affects the PSF of the illumination which has a large effect on the multi-photon PSF.
- Often loss of signal and resolution when imaging deep is attributed to scattering, when for most samples it is due to spherical aberration.
- a multi-photon system would be able to image deeper and have better signal and resolution.
- the illumination beam which is usually a laser for multi-photon instruments which is collimated and change its divergence as it hits the back aperture of the objective.
- This optical system would have to be coupled to the scanner if it exists and usually would also involve the tube lens of the microscope.
- One exemplary variable relay system involves two positive lenses.
- the first lens is placed the distance of its focal length from the image plane. By moving this lens, the desired image plane can be selected.
- the second lens is placed its focal length from the detector.
- the image plane that is the focal length of the first lens away will be relayed at infinity to the second lens which images it to an image plane. In this way, the image plane can be fixed in its location, while only one lens element needs to be moved.
- this image plane is then the image plane created by the scan lens.
- the distance between the two lenses is equal to the sum of their focal lengths. As the first lens moves, this ideal situation will change, with the primary consequence being that the second lens must be of greater diameter. If positioned correctly and if the two lenses are equal, a "zero" point can be established where the original focal plane is created with no additional magnification or distortion.
- An exemplary aspect of the invention is directed toward an apparatus comprising:
- This apparatus when combined would provide a way to correct for spherical aberration in an automated fashion.
- This device has at least one exemplary advantage that when it is in the "zero" position it effectively has no effect on the image - as if the device were not present, This allows the microscope to be used in a normal fashion when spherical aberration correction is not desired or needed. Because this device can also be made with fast motion control, it will allow for spherical aberration correction without affecting the system performance.
- aspects of the invention are thus directed toward spherical aberration correction in optical microscopes.
- Non-descanned detection or detectors relate in the sense of the present invention preferably to one or more of a variety of PMT's (Photomultipliers) and/or other detectors available for applications ranging from 2-Photon imaging to time correlated single photon counting (TCSPC) analysis.
- PMT's Photomultipliers
- TCSPC time correlated single photon counting
- Still further aspects of the invention are directed toward a motorized lens system for selecting the convergence of the illumination beam on the back aperture of the objective.
- Still further aspects of the invention relate to an apparatus for a spherical aberration correction system for non-descanned detection including:
- optical system is motorized by using a moving coil actuator.
- optical system is motorized using a stepper-motor.
- the motorization control device is synchronized with a scanner and/or a detector.
- the imaging system is an optical microscope.
- the apparatus is combined with an electronic imaging device such as a camera.
- the scanning microscope is a confocal microscope.
- the scanning microscope is a multi-photon microscope.
- the present invention relates to a scanning microscope.
- Figure 1 illustrates an exemplary optical system 1 for modifying the illumination path to correct for spherical aberration according to the present invention
- the optical system in addition to well known componentry and motors/controllers, comprises a focal plane 10, a front lens 20, a back or moveable lens 30, a focal plane 50, a tube lens 60, an objective 70 and/or a focal point 80, in particular in this sequence
- a scan lens or the like creates a focal plane 10 or light is coming from a scanning device or system (not shown) and the light 5 (preferably illumination or excitation light) is collected by the front lens 20 of the optical system 1.
- an infinity conjugate relay 25 comprises or is formed by the lens 20 and the moveable lens 30.
- the light is then collimated and reaches the back or moveable lens 30, which can move along the optical axis 40 with the assistance of a motor/controller module (not shown).
- the focal plane 50 of the tube lens 60 can then be before or after the focal point from the moving lens 30.
- the result is that the convergence of the light when the light hits the back aperture of the objective 70 is or can be controlled.
- the focal point 80 moves further away from the objective or vice versa. In this manner, the position of the focal point 80 along the optical axis of the light can be controlled with motion of the lens 30.
- the infinity conjugate relay 25 forms preferably a variable optical relay or transmission means that is used to change the divergence/convergence of a light beam and/or to change the plane of an image volume that can be studied or recorded or is in focus.
- the desired image plane can be selected or changed.
- only one lens 30 has to be moved.
- the lens 30 can be moved in a position or at a "zero" point where the original focal plane is imaged with no additional magnification or distortion.
- the conjugate relay 25 or movable lens 30 can be used for other purposes alternatively or addtionally.
- FIG. 2 illustrates an exemplary environmental perspective view of the embodiment of the optical system as shown in Fig. 1 .
- the optical system includes an enclosure 200 housing a port 210, a moving lens assembly 220 and a port 230.
- This optical system or moving lens assembly 220 includes the movable lens 30, the stationary and moving lenses 20 and 30, the infinity conjugate relay 25 and/or the optical system 1 as described above.
- the input illumination beam or light enters through port 210.
- the beam or light is collimated and hits the moving lens assembly 220.
- the light passes preferably through the tube lens 60 and objective 80 which are arranged preferably within the enclosure 200 as well, Then the light exits the system or enclosure 200 at the back port 230.
- This optical system can be directly attached to an entrance port of a microscope (not shown), between, for example, a scanning system and the microscope via well known attachment mechanism(s).
- the scanning system can be in accordance with an exemplary embodiment of the invention an optical scanning system such as a laser scanning system and even more particularly a modular laser scanning system.
- An exemplary laser scanning system is a module with various inner and outer optic modules that provide a complete laser scanning attachment for a microscope.
- the modular aspect will allow the addition of laser scanning techniques to the already available techniques on the microscope.
- the laser scanning system and software that controls the system can be designed to work seamlessly with the microscope.
- the scanning system illuminates and/or scans with a light beam, in particular a laser beam, a sample which is studied by the optical imaging system, such as a microscope.
- the scanning system and the optical imaging system cooperate or the sanning system may form part of the optical imaging system.
- the optical system is preferably arranged between the scanning system and the optical imaging system.
- the systems of this invention also can cooperate and interface with a special purpose computer, a programmed microprocessor or microcontroller and peripheral integrated circuit element(s), an ASIC or other integrated circuit, a digital signal processor, a hard-wired electronic or logic circuit such as discrete element circuit, a programmable logic device such as PLD, PLA, FPGA, PAL, any comparable means, or the like.
- module as used herein can refer to any known or later developed hardware, software, firmware, or combination thereof, that is capable of performing the functionality associated with that element.
- the terms determine, calculate, and compute and variations thereof, as used herein are used interchangeable and include any type of methodology, process, technique, mathematical operational or protocol.
- control methods/systems and graphical user interfaces may be readily implemented in software/hardware using object or object-oriented software development environments that provide portable source code that can be used on a variety of computer or workstation platforms that include a processor and memory.
- the disclosed control methods may be implemented partially or fully in hardware using standard logic circuits or VLSI design. Whether software or hardware is used to implement the systems in accordance with this invention is dependent on the speed and/or efficiency requirements of the system, the particular function, and the particular software or hardware systems or microprocessor or microcomputer systems being utilized.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Microscoopes, Condenser (AREA)
Description
- The present invention generally relates to spherical aberration correction in optical microscopes. More specifically, the present invention relates to a device, method and use for spherical aberration correction for non-descanned detection. Even more specifically, an exemplary embodiment of the invention relates to a spherical aberration correction device combined with a multi-photon imaging system.
- High-power optical microscopes can use objectives with large numerical apertures (NA) resulting in high resolution imaging. In the case of oil or water immersion objectives these NAs can exceed 1.0. In any optical system, the first aberration that causes loss of signal and resolution is spherical aberration. Spherical aberration is the artifact in an imaging system caused by the inability of the optical system to focus axial and off-axis light from a point source to a single point. Modern objectives are highly corrected for spherical aberration, using multiple lens elements to eliminate the effect. However, these objectives are corrected only for a single ideal situation (e.g., for a specific cover glass thickness for samples on the cover glass). In practice, moving deeper into the sample introduces spherical aberration and is usually the limiting factor in deep imaging with these objectives. This is true especially in the case of multi-photon microscopy, which is intended for deep imaging, the sample of interest is rarely in the objective's ideal location.
-
US 2005/0207003 A1 relates to a microscope with a wavefront modulator for correcting spherical aberrations and an optical relay for controlling a beam diameter from an objective lens. -
US2003/0063529 A1 relates to an optical head for a disk drive, wherein variation of the thickness of a protective disc layer is considered by shifting lenses in an optical relay. -
US 2003/0063379 A1 relates to a scanning optical microscope with a wavefront converting element for correcting spherical aberration. Examples given for the wavefront converting element are liquid crystal cells and membrane mirrors. -
US 2008/0151397 A1 is related to an optical pickup for use in an optical disc device. The optical pickup comprises a spherical aberration means which is formed by an optical lens made of glass or transparent plastic and a mechanism which moves the optical lens in an optical axis direction of the lens. -
US 2006/098213 A1 relates to an optical device to reduce the generation of spherical aberration, in which a spherical-aberration correction element disposed within the device behind the objective may be moved along an optical axis. -
EP 1 717 623 A1 -
EP 0 859 259 A2 is directed to an adapter for correcting spherical aberrations of objective lens. The adapter is attached to the objective lens imagewise or inserted between a first and second objective lens. -
JP 2005 316068 A -
JP 2001 264637 A - Object of the present invention is to provide a spherical aberration correction device, a method and a use allowing optimized aberration correction in case of scanning microscopes, in particular for multi-photon imaging.
- The above object is achieved by a spherical aberration correction device according to
claim 1, by a method according to claim 13 or by a use according to claim 15. Preferred embodiments are subject of the subclaims. - A common optical microscope configuration when simplified includes an infinity objective and a tube lens. The sample is imaged a specific distance from the objective and at the back focal length of the tube lens the magnified image is created.
- This image could be recorded by a camera or other imaging device, but in the case of non-descanned detection, the whole signal is combined and measured as a single scalar. For creating an image, the angle of the illumination beam on the back aperture of the objective is changed so that the focal point is also changed. Most objectives are made so that points off the axis and in the focal plane are correctly relayed to the plane of the image. Points out of the focal plane (above or below) are also relayed and measured by the non-descanned detector. In the case of a multi-photon instrument, it is known that the entire signal comes from the focal point. By changing the convergence of the illumination beam on the back aperture of the objective, the focal point can be moved up or down along the optical axis.
- Because points above and below the ideal plane (that created by a parallel illumination at the back aperture of the objective) are no longer at the specified ideal location for the objective, spherical aberration will be introduced for these points. Consecutively worse spherical aberration will occur as the focus is moved away from the "ideal" image plane. Spherical aberration has a "direction" to it in that the point-spread-function (PSF) is distorted along the z-axis in one direction or another. Thus one can assign a positive and negative spherical aberration of varying degree.
- When the sample being imaged is no longer at the specified ideal situation for the given objective, the image of the "ideal" focal plane will have spherical aberration. The true ideal focal plane (with no spherical aberration) will be located above or below the original plane. As the sample moves further from the ideal condition, the spherical aberration free image will move further from the original plane. For any of these conditions, one should be able to move the focal point to the plane that represents the spherical aberration free focal plane. Thus by changing the convergence of the illumination light, one could correct for spherical aberration across a broad range of samples and imaging conditions. In most situations a variable optical relay can be employed to change the plane of the image volume that is recorded.
- Accordingly, one exemplary embodiment of the invention is directed toward a moving optical relay system for selecting a plane of interest from the sample. If this relay were to be motorized as well as the focus of the microscope, one could in an automated fashion correct for the spherical aberration in the current sample plane. Typically this would involve software to select the position of the relay based on the quality of the image.
- Primarily, there are two sources of spherical aberration in a given sample, The first is due to the conditions of the sample - usually variations in the thickness of the cover glass. This source of aberration is usually invariant over the sample, but is very hard to predict. To correct for this, the sample must be directly measured and the best plane of interest of the image volume chosen based on the measurement of the sample at several planes. The second source of aberration is due to imaging deeper into the sample. The spherical aberration varies with depth for any given sample medium for any given objective in a known manner. An algorithm can be developed that will give the plane of the image volume needed for any given depth of the sample. The end result is that one has a curve that represents the change in plane location vs. sample depth and a random offset to this curve caused by the sample. The offset can be found empirically and then any depth in the sample can be corrected using the calculated curve.
- In the case of multi-photon, spherical aberration directly affects the PSF of the illumination which has a large effect on the multi-photon PSF. Often loss of signal and resolution when imaging deep is attributed to scattering, when for most samples it is due to spherical aberration. When corrected for spherical aberration, a multi-photon system would be able to image deeper and have better signal and resolution.
- There are many optical ways that one could take the illumination beam which is usually a laser for multi-photon instruments which is collimated and change its divergence as it hits the back aperture of the objective. This optical system would have to be coupled to the scanner if it exists and usually would also involve the tube lens of the microscope.
- One exemplary variable relay system involves two positive lenses. The first lens is placed the distance of its focal length from the image plane. By moving this lens, the desired image plane can be selected. The second lens is placed its focal length from the detector. The image plane that is the focal length of the first lens away will be relayed at infinity to the second lens which images it to an image plane. In this way, the image plane can be fixed in its location, while only one lens element needs to be moved. For scanning based systems, this image plane is then the image plane created by the scan lens. Ideally the distance between the two lenses is equal to the sum of their focal lengths. As the first lens moves, this ideal situation will change, with the primary consequence being that the second lens must be of greater diameter. If positioned correctly and if the two lenses are equal, a "zero" point can be established where the original focal plane is created with no additional magnification or distortion.
- In accordance with another exemplary embodiment, one could use a fast, accurate linear motion device to move the first lens. This would allow the possible application where the position of the lens is continuously varied as the imaging condition varies (usually by moving deeper in the sample). For example this could allow three-dimensional imaging where each plane in z is individually corrected for spherical aberration. In practice such a device would allow for deeper imaging into a sample.
- An exemplary aspect of the invention is directed toward an apparatus comprising:
- a non-descanned optical instrument such as a multi-photon microscope; and
- a variable optical system for changing the convergence of the illumination beam on the back aperture of the objective.
- This apparatus when combined would provide a way to correct for spherical aberration in an automated fashion.
- This device has at least one exemplary advantage that when it is in the "zero" position it effectively has no effect on the image - as if the device were not present, This allows the microscope to be used in a normal fashion when spherical aberration correction is not desired or needed. Because this device can also be made with fast motion control, it will allow for spherical aberration correction without affecting the system performance.
- Aspects of the invention are thus directed toward spherical aberration correction in optical microscopes.
- Still further aspects of the invention are directed toward spherical aberration correction for non-descanned detection. Non-descanned detection or detectors relate in the sense of the present invention preferably to one or more of a variety of PMT's (Photomultipliers) and/or other detectors available for applications ranging from 2-Photon imaging to time correlated single photon counting (TCSPC) analysis.
- Even further aspects of the invention are directed toward a spherical aberration correction device combined with a multi-photon imaging system.
- Still further aspects of the invention are directed toward a motorized lens system for selecting the convergence of the illumination beam on the back aperture of the objective.
- Even further aspects of the invention are directed toward a fast linear motion device such that the desired motion can happen in less than the retrace time for a scanner system.
- Even further aspects of the invention are directed toward automated control and software for the device.
- Still further aspects of the invention relate to an apparatus for a spherical aberration correction system for non-descanned detection including:
- an optical imaging system such as a microscope for non-descanned detection such as multi-photon; and
- an optical system for selecting the convergence of the illumination beam on the back aperture of the objective.
- The aspects above, where the optical system is motorized.
- The aspects above, where the optical system is motorized by using a moving coil actuator.
- The aspects above, where the optical system is motorized using a stepper-motor.
- The aspects above, where the optical system is moved using a manual focusing device.
- The aspects above, where the motorization control device is synchronized with a scanner and/or a detector.
- The aspects above, where the means for moving the optics can do so in under the retrace time of the scanning.
- The aspects above, where the imaging system is an optical microscope.
- The aspects above, where the apparatus is combined with an electronic imaging device such as a camera.
- The aspects above, where the apparatus is combined with a scanning microscope.
- The aspects above, where the scanning microscope is a confocal microscope.
- The aspects above, where the scanning microscope is a multi-photon microscope.
- The aspects above, where the apparatus has a "zero" mode where the effective image is unaltered from the image were the apparatus not present.
- The aspects above, where the apparatus is automated and controlled with a computer program.
- The aspects above, where the computer program uses a calculated curve to determine the position of the first lens for a given sample depth.
- These and other features and advantages of this invention are described and, or are apparent from, the following detailed description of the exemplary embodiment.
- The exemplary embodiments of the invention will be described in detail, with reference to the following figures wherein:
- Figure 1
- illustrates an exemplary optical system for correcting spherical aberration by modifying the illumination path.
- Figure 2
- illustrates an exemplary embodiment of the device as illustrated in
Figure 1 . - The exemplary embodiments of this invention will be described in relation to microscopes, imaging systems, and associated components. However, it should be appreciated that, in general, known components will not be described in detail. For purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the present invention. It should be appreciated however that the present invention may be practiced in a variety of ways beyond the specific details set forth herein.
- The present invention relates to a scanning microscope.
-
Figure 1 illustrates an exemplaryoptical system 1 for modifying the illumination path to correct for spherical aberration according to the present invention, Theoptical system 1, in addition to well known componentry and motors/controllers, comprises afocal plane 10, afront lens 20, a back ormoveable lens 30, afocal plane 50, atube lens 60, an objective 70 and/or afocal point 80, in particular in this sequence - In operation, a scan lens or the like creates a
focal plane 10 or light is coming from a scanning device or system (not shown) and the light 5 (preferably illumination or excitation light) is collected by thefront lens 20 of theoptical system 1. Preferably, aninfinity conjugate relay 25 comprises or is formed by thelens 20 and themoveable lens 30. - The light is then collimated and reaches the back or
moveable lens 30, which can move along theoptical axis 40 with the assistance of a motor/controller module (not shown). Thefocal plane 50 of thetube lens 60 can then be before or after the focal point from the movinglens 30. The result is that the convergence of the light when the light hits the back aperture of the objective 70 is or can be controlled. For example, as the light changes from convergent to divergent, thefocal point 80 moves further away from the objective or vice versa. In this manner, the position of thefocal point 80 along the optical axis of the light can be controlled with motion of thelens 30. - The
infinity conjugate relay 25 forms preferably a variable optical relay or transmission means that is used to change the divergence/convergence of a light beam and/or to change the plane of an image volume that can be studied or recorded or is in focus. By moving thelens 30, the desired image plane can be selected or changed. In particular, only onelens 30 has to be moved. Ideally, thelens 30 can be moved in a position or at a "zero" point where the original focal plane is imaged with no additional magnification or distortion. However, theconjugate relay 25 ormovable lens 30 can be used for other purposes alternatively or addtionally. -
Figure 2 illustrates an exemplary environmental perspective view of the embodiment of the optical system as shown inFig. 1 . The optical system includes anenclosure 200 housing aport 210, a movinglens assembly 220 and aport 230. This optical system or movinglens assembly 220 includes themovable lens 30, the stationary and movinglenses infinity conjugate relay 25 and/or theoptical system 1 as described above. The input illumination beam or light enters throughport 210. The beam or light is collimated and hits the movinglens assembly 220. Afterwards, the light passes preferably through thetube lens 60 and objective 80 which are arranged preferably within theenclosure 200 as well, Then the light exits the system orenclosure 200 at theback port 230. This optical system can be directly attached to an entrance port of a microscope (not shown), between, for example, a scanning system and the microscope via well known attachment mechanism(s). - The scanning system can be in accordance with an exemplary embodiment of the invention an optical scanning system such as a laser scanning system and even more particularly a modular laser scanning system. An exemplary laser scanning system is a module with various inner and outer optic modules that provide a complete laser scanning attachment for a microscope. The modular aspect will allow the addition of laser scanning techniques to the already available techniques on the microscope. Importantly, the laser scanning system and software that controls the system can be designed to work seamlessly with the microscope.
- Preferably, the scanning system illuminates and/or scans with a light beam, in particular a laser beam, a sample which is studied by the optical imaging system, such as a microscope.
- Preferably, the scanning system and the optical imaging system cooperate or the sanning system may form part of the optical imaging system. The optical system is preferably arranged between the scanning system and the optical imaging system.
- The exemplary techniques illustrated herein are not limited to the specifically illustrated embodiments but can also be utilized with the other exemplary embodiments and each described feature is individually and separately claimable.
- The systems of this invention also can cooperate and interface with a special purpose computer, a programmed microprocessor or microcontroller and peripheral integrated circuit element(s), an ASIC or other integrated circuit, a digital signal processor, a hard-wired electronic or logic circuit such as discrete element circuit, a programmable logic device such as PLD, PLA, FPGA, PAL, any comparable means, or the like. The term module as used herein can refer to any known or later developed hardware, software, firmware, or combination thereof, that is capable of performing the functionality associated with that element. The terms determine, calculate, and compute and variations thereof, as used herein are used interchangeable and include any type of methodology, process, technique, mathematical operational or protocol.
- Furthermore, the disclosed system may use control methods/systems and graphical user interfaces that may be readily implemented in software/hardware using object or object-oriented software development environments that provide portable source code that can be used on a variety of computer or workstation platforms that include a processor and memory. Alternatively, the disclosed control methods may be implemented partially or fully in hardware using standard logic circuits or VLSI design. Whether software or hardware is used to implement the systems in accordance with this invention is dependent on the speed and/or efficiency requirements of the system, the particular function, and the particular software or hardware systems or microprocessor or microcomputer systems being utilized.
- It is therefore apparent that there has been provided, in accordance with the present invention an optical system, While this invention has been described in conjunction with a number of embodiments, it is evident that many alternatives, modifications and variations would be or are apparent to those of ordinary skill in the applicable arts.
Claims (13)
- A spherical aberration correction device for non-descanned detection or detectors, comprising:a scanning microscope, preferably for multi-photon imaging, adapted for non-descanned detection; andan optical system including an enclosure (200), the enclosure (200) housing a first port (210), a second port (230) and a moving lens assembly (220) including a moveable lens (30),wherein the optical system is adapted to select a convergence of illumination light (5) on a back aperture of an objective (70), wherein, as the light (5) changes from convergent to divergent, a focal point (80) moves further away from the objective (70) or vice versa, such that the convergence of illumination light (5) corrects spherical aberration,wherein the light (5) is collimated and reaches the moveable lens (30), which is configured to move along its optical axis (40), such that the position of the focal point (80) along the optical axis (40) of the light (5) can be controlled with motion of the lens (30), andwherein the optical system is directly attached via the second port (230) to an entrance port of the scanning microscope and the input illumination beam enters the optical system through the first port (210).
- Device of claim 1, wherein the optical system (1) is adapted such that the light (5) passes through a tube lens (60) and the objective (70), wherein, by moving the movable lens (30), a focal plane (50) of the tube lens (60) can be before or after the focal point from the moving lens (30).
- Device of claim 2, wherein resulting data is not processed for imaging, but is processed to provide other information about a sample including one or more of flow rates and diffusion.
- Device according to any one of the preceding claims, where the optical system is a variable optical relay, preferably wherein the optical relay is an infinity- conjugate relay.
- Device according to any one of the preceding claims, where the optical system is motorized.
- Device of claim5, wherein the optical system can move during a retrace time of a scanner or during imaging.
- Device of claim 5 or 6, where the optical system (1) is controlled electronically by a computer and/or an electronic device preferably wherein the electronic device adjusts for spherical aberration based only on image data.
- Device of claim 7, wherein software uses a stored equation or numerical formula to adjust the spherical aberration correction for any given sample depth, and/or wherein the software automatically adjusts the correction during live imaging and/or uses an empirically derived offset to the correction to account for sample conditions.
- Device according to any one of the preceding claims, wherein spherical aberration is corrected for each plane individually in a three-dimensional data set.
- Device according to any one of the preceding claims, wherein the optical imaging system (1) is not used for imaging and/or detects a signal from a single point, line or other arbitrary shape.
- Device according to any one of the preceding claims, wherein the optical system (1) comprises an enclosure housing, a front lens (20), a movable back lens (30), a tube lens (60), and an objective (70), in particular in this sequence, wherein light (5) collected by the front lens (20) from a scan lens is collimated until it reaches the movable back lens (30), the back lens (30) being movable along an optical axis (40), and preferably controllable based on a stored equation or numerical formula, to adjust spherical aberration correction, with the tube lens (60) capable of converging the light (5) when the light (5) encounters a back aperture of the objective (70).
- Method for spherical aberration correction with a spherical aberration correction device for non-descanned detection or detectors, comprising:a scanning microscope, preferably for multi-photon imaging, adapted for non-descanned detection; andan optical system including an enclosure (200), the enclosure (200) housing a first port (210), a second port (230) and a moving lens assembly (220) including a moveable lens (30),wherein the optical system selects a convergence of illumination light (5) on a back aperture of an objective (70), wherein, as the illumination light (5) changes from convergent to divergent, a focal point (80) moves further away from the objective (70) or vice versa, such that the convergence of illumination light (5) corrects spherical aberration,wherein light collected by a front lens from a scan lens is collimated until it reaches the movable lens, wherein the moveable lens is moved along an optical axis and controlled based on a stored equation or numerical formula to adjust spherical aberration correction,wherein a tube lens converges the light when the light encounters a back aperture of an objective, andwherein the optical system is directly attached via the second port (230) to an entrance port of the scanning microscope and the input illumination beam enters the optical system through the first port (210).
- Use of an optical system including an enclosure (200), the enclosure (200) housing a first port (210), a second port (230) and a moving lens assembly (220) including a moveable lens (30), wherein the optical system (1) selects a convergence of illumination light (5) on a back aperture of an objective (70), wherein, as the illumination light (5) changes from convergent to divergent, a focal point (80) moves further away from the objective (70) or vice versa, such that the convergence of illumination light (5) corrects spherical aberration, in a scanning microscope, preferably for multi-photon imaging, wherein the light (5) is collimated and reaches the moveable lens (30), which can move along the optical axis (40), such that the position of the focal point (80) along an optical axis (40) of the light (5) can be controlled with motion of the lens (30), and wherein the optical system is directly attached via the second port (230) to an entrance port of the scanning microscope and the input illumination beam enters the optical system through the first port (210).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US28625709P | 2009-12-14 | 2009-12-14 | |
US12/958,165 US8634131B2 (en) | 2009-12-14 | 2010-12-01 | Spherical aberration correction for non-descanned applications |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2333602A1 EP2333602A1 (en) | 2011-06-15 |
EP2333602B1 true EP2333602B1 (en) | 2022-07-20 |
Family
ID=43618260
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10015589.4A Active EP2333602B1 (en) | 2009-12-14 | 2010-12-14 | Spherical aberration correction for non-descanned applications |
Country Status (2)
Country | Link |
---|---|
US (2) | US8634131B2 (en) |
EP (1) | EP2333602B1 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8634131B2 (en) | 2009-12-14 | 2014-01-21 | Intelligent Imaging Innovations, Inc. | Spherical aberration correction for non-descanned applications |
EP2758765B1 (en) * | 2011-09-22 | 2020-08-12 | FOCE Technology International B.V. | Optical platelet counter method |
DE102014110208B4 (en) * | 2014-07-21 | 2022-05-25 | Leica Microsystems Cms Gmbh | scanning microscope |
DE102016108384B3 (en) * | 2016-05-04 | 2017-11-09 | Leica Microsystems Cms Gmbh | Device and method for light sheet-like illumination of a sample |
US9946066B1 (en) | 2017-01-20 | 2018-04-17 | AdlOptica Optical Systems GmbH | Optics for diffraction limited focusing inside transparent media |
JP6850684B2 (en) * | 2017-06-01 | 2021-03-31 | 株式会社日立製作所 | Optical measuring device |
US10219700B1 (en) | 2017-12-15 | 2019-03-05 | Hi Llc | Systems and methods for quasi-ballistic photon optical coherence tomography in diffusive scattering media using a lock-in camera detector |
US10368752B1 (en) | 2018-03-08 | 2019-08-06 | Hi Llc | Devices and methods to convert conventional imagers into lock-in cameras |
US11857316B2 (en) | 2018-05-07 | 2024-01-02 | Hi Llc | Non-invasive optical detection system and method |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0859259A2 (en) * | 1997-02-14 | 1998-08-19 | Nikon Corporation | Adapter for correcting spherical aberrations of objective lens |
JP2001264637A (en) * | 2000-03-21 | 2001-09-26 | Nikon Corp | Spherical aberration compensating optical system and device, and optical observation device equipped with compensating optical system or device |
US20030063379A1 (en) * | 2000-12-26 | 2003-04-03 | Hiroya Fukuyama | Scanning optical microscope |
JP2005316068A (en) * | 2004-04-28 | 2005-11-10 | Olympus Corp | Optical system |
US20060098213A1 (en) * | 2004-11-08 | 2006-05-11 | Tatsuo Itoh | Confocal optical device, and spherical-aberration correction method |
EP1717623A1 (en) * | 2004-04-28 | 2006-11-02 | Olympus Corporation | Laser focusing optical system |
US20080151397A1 (en) * | 2006-12-20 | 2008-06-26 | Yasushi Kinoshita | Optical Pickup for Use in Optical Disk Device and Method of Manufacturing the Same |
Family Cites Families (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3030861A (en) * | 1959-06-29 | 1962-04-24 | Bausch & Lomb | Variable power optical system for microscopes |
US4477156A (en) * | 1981-10-29 | 1984-10-16 | Rolin J. Gebelein | Reflecting telescope with correcting lens |
US4784488A (en) | 1986-08-27 | 1988-11-15 | Laser Precision Corporation | Modular radiation transmission apparatus for spectrometers |
US5054896A (en) * | 1988-12-19 | 1991-10-08 | Infinity Photo-Optical Corporation | Continuously focusable microscope incorporating an afocal variator optical system |
JP3299808B2 (en) * | 1993-03-29 | 2002-07-08 | オリンパス光学工業株式会社 | Immersion microscope objective lens |
US6144031A (en) | 1997-04-21 | 2000-11-07 | Inframetrics Inc. | Infrared video camera system with uncooled focal plane array and radiation shield |
JP4441831B2 (en) * | 1999-09-16 | 2010-03-31 | 株式会社ニコン | Microscope equipment |
JP4933706B2 (en) * | 2000-09-22 | 2012-05-16 | オリンパス株式会社 | microscope |
DE10120424B4 (en) | 2001-04-26 | 2004-08-05 | Leica Microsystems Heidelberg Gmbh | Scanning microscope and decoupling element |
JP3513125B2 (en) * | 2001-07-27 | 2004-03-31 | 株式会社東芝 | Optical head and optical disk device |
JP2004311742A (en) | 2003-04-08 | 2004-11-04 | Nikon Corp | Method for adjusting optical system, lighting optical device, aligner, and exposure method |
US7056034B2 (en) | 2003-12-30 | 2006-06-06 | Finisar Corporation | Passive alignment of laser with lens assembly |
JP4576137B2 (en) * | 2004-03-19 | 2010-11-04 | オリンパス株式会社 | microscope |
US7261472B2 (en) | 2005-01-12 | 2007-08-28 | Illum Technologies, Inc. | Ultra-small, form factor single fiber optical interconnect system, with push-push type insertion/withdrawal mechanism and shuttered modular connector and shuttered adapter and method for using same |
DE102005059650B4 (en) | 2005-12-14 | 2011-08-18 | Leica Microsystems CMS GmbH, 35578 | Mounting device for multiple lasers and microscope |
US7586674B2 (en) | 2006-10-17 | 2009-09-08 | Hnu-Photonics | Compuscope |
US8053711B2 (en) * | 2007-02-09 | 2011-11-08 | Ge Healthcare Bio-Sciences Corp. | System and method for adjusting the spherical aberration of objective lenses |
JP5536995B2 (en) * | 2007-07-17 | 2014-07-02 | オリンパス株式会社 | Microscope objective lens and laser scanning microscope system |
JP2010026165A (en) * | 2008-07-17 | 2010-02-04 | Olympus Corp | Laser scanning microscope |
JP2012506060A (en) * | 2008-10-14 | 2012-03-08 | サンフォード−バーナム メディカル リサーチ インスティテュート | Automated scanning cytometry using chromatic aberration for multi-plane image acquisition. |
US8659827B2 (en) * | 2009-09-22 | 2014-02-25 | Intelligent Imaging Innovations, Inc. | Spherical aberration correction for an optical microscope using a moving infinity-conjugate relay |
US8982455B2 (en) * | 2009-09-22 | 2015-03-17 | Intelligent Imaging Innovations, Inc. | Modular design of a scanning microscope attachment and accessories |
EP2496984A4 (en) * | 2009-11-03 | 2013-05-22 | Intelligent Imaging Innovations Inc | Fast, modular port switcher for an optical microscope using a galvanometer |
US8634131B2 (en) | 2009-12-14 | 2014-01-21 | Intelligent Imaging Innovations, Inc. | Spherical aberration correction for non-descanned applications |
DE102010061612B4 (en) * | 2010-12-29 | 2023-12-28 | Leica Microsystems Cms Gmbh | Method for determining scan coordinates for operating a scanning unit of a confocal scanning microscope and confocal scanning microscope |
-
2010
- 2010-12-01 US US12/958,165 patent/US8634131B2/en active Active
- 2010-12-14 EP EP10015589.4A patent/EP2333602B1/en active Active
-
2014
- 2014-01-10 US US14/152,063 patent/US9195041B2/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0859259A2 (en) * | 1997-02-14 | 1998-08-19 | Nikon Corporation | Adapter for correcting spherical aberrations of objective lens |
JP2001264637A (en) * | 2000-03-21 | 2001-09-26 | Nikon Corp | Spherical aberration compensating optical system and device, and optical observation device equipped with compensating optical system or device |
US20030063379A1 (en) * | 2000-12-26 | 2003-04-03 | Hiroya Fukuyama | Scanning optical microscope |
JP2005316068A (en) * | 2004-04-28 | 2005-11-10 | Olympus Corp | Optical system |
EP1717623A1 (en) * | 2004-04-28 | 2006-11-02 | Olympus Corporation | Laser focusing optical system |
US20060098213A1 (en) * | 2004-11-08 | 2006-05-11 | Tatsuo Itoh | Confocal optical device, and spherical-aberration correction method |
US20080151397A1 (en) * | 2006-12-20 | 2008-06-26 | Yasushi Kinoshita | Optical Pickup for Use in Optical Disk Device and Method of Manufacturing the Same |
Also Published As
Publication number | Publication date |
---|---|
US20140126047A1 (en) | 2014-05-08 |
US20110141558A1 (en) | 2011-06-16 |
US8634131B2 (en) | 2014-01-21 |
EP2333602A1 (en) | 2011-06-15 |
US9195041B2 (en) | 2015-11-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2333602B1 (en) | Spherical aberration correction for non-descanned applications | |
JP6761312B2 (en) | Chromatic aberration correction in imaging systems including variable focal length lenses | |
CN106338809B (en) | Lens of variable focal length in pancratic magnification optical system is suitable for operating frequency | |
EP1684109B1 (en) | Laser processing apparatus | |
JP4544904B2 (en) | Optical system | |
EP1717623A1 (en) | Laser focusing optical system | |
US11067783B2 (en) | Light sheet microscope and method for imaging a sample by light sheet microscopy | |
US8659827B2 (en) | Spherical aberration correction for an optical microscope using a moving infinity-conjugate relay | |
CN112074765A (en) | System, apparatus and method for automatic microscope focusing | |
WO2009153919A1 (en) | Microscope device and microscope device control program | |
EP2585869A1 (en) | Autofocus based on differential measurements | |
US10365466B2 (en) | Method and microscope for imaging a volume sample | |
CN103048779A (en) | Method and apparatus for identifying and correcting spherical aberrations in a microscope imaging beam path | |
US5270527A (en) | Method for autofocusing of microscopes and autofocusing system for microscopes | |
CN111381383A (en) | System and method for calibrating a VFL lens system using a calibration object having a planar tilted patterned surface | |
EP2420881B1 (en) | Microscope and ghosting elimination method | |
JP2002131646A (en) | Method and apparatus for phase compensation of position signal and detection signal in scanning microscopic method and scanning microscope | |
JP7428719B2 (en) | optical system for microscopes | |
JP7362904B2 (en) | Object imaging device and imaging method | |
US20230350180A1 (en) | Automatic correction of spherical aberration in selective plane illumination microscopy | |
JP2008267842A (en) | Organism observation container, biological microscope using the same, and organism observation apparatus | |
EP1972982B1 (en) | Microscope equipped with automatic focusing mechanism and method of adjusting the same | |
CN112748562B (en) | Microscope and method for determining aberrations in a microscope | |
KR20230138960A (en) | 3D imaging with improved resolution | |
JP2018503134A (en) | Optical arrangement for laser scanner system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RTI1 | Title (correction) |
Free format text: SPHERICAL ABERRATION CORRECTION FOR NON-DESCANNED APPLICATIONS |
|
17P | Request for examination filed |
Effective date: 20111205 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20180214 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602010068354 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G02B0021360000 Ipc: G02B0021000000 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G02B 27/00 20060101ALI20211213BHEP Ipc: G02B 21/36 20060101ALI20211213BHEP Ipc: G02B 21/06 20060101ALI20211213BHEP Ipc: G02B 21/00 20060101AFI20211213BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20220210 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602010068354 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1505895 Country of ref document: AT Kind code of ref document: T Effective date: 20220815 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20220720 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221121 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221020 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20221223 Year of fee payment: 13 Ref country code: FR Payment date: 20221222 Year of fee payment: 13 Ref country code: DE Payment date: 20221020 Year of fee payment: 13 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1505895 Country of ref document: AT Kind code of ref document: T Effective date: 20220720 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221120 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221021 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602010068354 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 |
|
26N | No opposition filed |
Effective date: 20230421 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20221231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221214 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221214 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20101214 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220720 |