EP1787157B1 - Apparatus for fluorescent confocal microscopy - Google Patents
Apparatus for fluorescent confocal microscopy Download PDFInfo
- Publication number
- EP1787157B1 EP1787157B1 EP05780156.5A EP05780156A EP1787157B1 EP 1787157 B1 EP1787157 B1 EP 1787157B1 EP 05780156 A EP05780156 A EP 05780156A EP 1787157 B1 EP1787157 B1 EP 1787157B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- optical
- target
- light
- fluorescent
- detector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0036—Scanning details, e.g. scanning stages
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0064—Optical details of the image generation multi-spectral or wavelength-selective arrangements, e.g. wavelength fan-out, chromatic profiling
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/008—Details of detection or image processing, including general computer control
- G02B21/0084—Details of detection or image processing, including general computer control time-scale detection, e.g. strobed, ultra-fast, heterodyne detection
Definitions
- the present invention relates to the area of optical microscopy, more specifically, the area of confocal fluorescence microscopy, and methods of obtaining images of fluorescently labelled targets by confocal fluorescence microscopy.
- fluorescence microscopes can be categorized into one of the following general classes based on how the fluorescent image information is captured and processed:
- the target is imaged using a conventional wide-field strategy as in any standard microscope, and collecting the fluorescence emission.
- the fluorescent-stained or labelled sample is illuminated with excitation light of the appropriate wavelength(s) and the emission light is used to obtain the image; optical filters and/or dichroic mirrors are used to separate the excitation and emission light.
- Structured light microscopes This is a modification of a microscope that provides an enhanced spatial resolution along an optical axis of the microscope. This feature allows for optical sectioning of the imaging specimen.
- the major component of the structured light illumination device is a one-dimensional optical grid. The grid pattern is systematically projected onto the specimen and is moved in the focal plane of the objective across the sample; the emission light is collected and compiled to create the image.
- One such "structured-light" image is generated after processing of three images of the specimen captured for different positions on the grid.
- the projected image of the grid provides a strong spatial modulation of the intensity for the object in the focal plane of the objective while the intensity modulation in the area above and below the focal plane is significantly reduced.
- the image processing algorithm eliminates the weaker signals from above or below the primary image plane as defined by the grid. The resulting image is, thus, free of any stray light or out of focus data. Further, because the structured light illumination device utilizes the illumination source of the host wide-field microscope, all fluorescence capabilities of that microscope are maintained.
- confocal microscopes utilize specialized optical systems for imaging.
- a laser operating at the excitation wavelength of the relevant fluorophore is focused to a point on the sample; simultaneously, the fluorescent emission from this illumination point is imaged onto a small-area detector. Any light emitted from all other areas of the sample is rejected by a small pinhole located in front to the detector which transmits on that light which originates from the illumination spot.
- the excitation spot and detector are scanned across the sample in a raster pattern to form a complete image.
- strategies to improve and optimize speed and throughput which are well known to those skilled in this area of art.
- Line-confocal microscopes This is a modification of the confocal microscope, wherein the fluorescence excitation source is a laser beam; however, the beam is focused onto a narrow line on the sample, rather than a single point
- the fluorescence emission is then imaged on the optical detector through the slit which acts as the spatial filter. Light emitted from any other areas of the sample remains out-of-focus and as a result is blocked by the slit.
- the line is scanned across the sample while simultaneously reading the line camera. This system can be expanded to use several lasers and several cameras simultaneously by using an appropriate optical arrangement.
- the instant invention presents a new and improved confocal fluorescence microscope.
- the new microscope has significant advantages relative to existing implementations of microscope confocal imagers.
- the instant invention has the advantages relative to conventional wide-field and confocal fluorescence imagers.
- the instant invention also addresses the drawbacks of confocal technology in terms of cost and complexity, and provides significant savings in both due to the simplicity of the components and the elimination of the need, for example, of the physical spatial filters such as pinholes or slits.
- the system is also compatible with a wide range of micro well plates including thin-bottom 96, 386, and 1536-well plates, microscope slides, and can support for a wide range of fluorescent dyes.
- the system comprises at least one, or more preferably two or more optical sources (preferably lasers) which will operate at different excitation wavelengths aligned with corresponding fluorescent or fluorescently stained or labelled targets.
- the fluorescent emission from each target is filtered using bandpass optical filters and the emission data is collected by at least one imaging device, preferably two or more imaging devices.
- the system presents certain distinct advantages over the prior wide-field fluorescence microscopes described above, including improved image quality and increased sensitivity. More specifically, in ordinary fluorescence microscopy, emission from the material above and below the focal plane fluoresces results in undesirable background fluorescence.
- CMOS imagers From Phototransduction to Image Processing, Orly Yadid-Pecht and Ralph Etienne-Cummings (Editors), Springer (Publisher), 1st editon (May 31, 2004 ).
- the detector also incorporates a rolling shutter means to limit the instantaneous area of the detector used for light detection.
- the size of this area (such as the width of the rolling shutter in case of line-confocal imaging) will typically be less than or equal to the area of illumination optically conjugated to the detector.
- the system employs at least one, and preferable two or more, light sources to provide the excitation light.
- any source capable of emitting light such as lamps, with or without filters, can be used.
- Such light sources would be well understood by those skilled in the art.
- Preferred light sources include brighter and narrow-band light sources, more preferably lasers, for such illumination.
- the excitation light is focused on the target in the form of a line rather than a single point, and the line is scanned across the surface of the target.
- line confocal imagers are known in the art, and the preferred system this confers the benefits of the conventional line system without the complexity and cost.
- the line-shaped illumination area on the imaging target can be produced by any means known to those in the art, but is preferably produced by a Powell lens.
- the line forming means is paired with a CMOS detector that is operated in the rolling shutter mode to produce a low cost, simple, and easy to use line confocal scanner
- the detector can also incorporate narrow-band laser-line-specific filters which can be used to reject the excitation light. These types of filters can be used in combination with other filters that have an optical bandwidth adjusted to an emission spectrum of the fluorophore.
- One preferred combination is to use a Rugate notch filter in series with a Schott Veril linear variable filter.
- the flexibility permits construction of a hybrid microscope which can operate in a plurality of modes.
- one mode of operation the hybrid microscope is a line-confocal microscope that will operate in the manner of the instant invention, in a second mode of operation the hybrid microscope will operate as a standard wide-field microscope when the illumination system is adjusted to illuminate the whole field view of the microscope.
- the instant confocal imaging system described previously is schematically presented in Figure 1 , and includes, as described previously one or more light sources to excite a fluorescent (or fluorescently stained or labelled) target and a one or more detectors to detect fluorescent emissions.
- the system may contain other components as would ordinarily be found in confocal and wide field microscopes. The following sections describe these and other components in more detail. For a number of the components there are multiple potential embodiments. In general the preferred embodiment depends upon the target application. For the purpose of this document the preferred target application is a high throughput cellular screening with the ability to image a wide range of fluorophores.
- the light source can, as described previously, be any source capable of delivering light of the excitation wavelength to the target, preferably one or more excitation lasers are incorporated into the system.
- the light from each of these lasers can be coupled to the rest of the optical train by either delivering the light as a free space beam of the appropriate diameter, direction and degree of collimation or via fiber optic light delivery system.
- the light is delivered as a highly collimated beam with a specified beam diameter (standard methods can be used to achieve this) or via an optical fiber (ideally a single-mode polarization preserving fiber is employed).
- each excitation laser operates in TEM00 mode, with M2 ⁇ 1.2, RMS noise 1 Hz to 10 MHz ⁇ 0.5%, and with polarization in a defined state. Any practical number of lasers can be used.
- the excitation laser light is delivered to a laser-selection module (2).
- This module selects light from one of the lasers and directs it into a beam-shaping module (3). Light from other lasers is blocked.
- Possible embodiments of the laser-selection module include, but are not limited to:
- the excitation laser light is preferably appropriately shaped by a beam shaper (3).
- Possible embodiments of the beam shaper include, but are not limited to a laser beam expander.
- a beam expander is used and its optical elements are corrected for chromatic aberration so as to minimize adjustment to the focus of the beam-expander when switching between lasers.
- the diameter of the laser beam is preferentially expanded to be equal to that of the rear pupil of the objective (7).
- the type of beam-expander employed will depend upon the specific application and can include an anamorphic prism followed by a laser beam-expander without any beam shaper, and a chromatic aberration-free mirror-based beam expander.
- the excitation laser light passes through a line-forming element (4) that converts the collimated beam of laser light into a focused beam diverging in one direction only.
- Preferred embodiments of the line-forming element include, but are not limited to, a Powell lens (as described US patent 4,826,299 ).
- the shape of the second conic-cylindrical surface is preferably specified to achieve both uniform illumination to within 10% over the range ⁇ and more than 80% transmission of the laser light through the objective (7).
- Line forming elements such as cylindrical lenses, diffraction gratings, and holographic elements can also be used.
- the scanning module provides the scanning of the excitation light in the focal plane of the objective across the field of view of the microscope.
- the excitation laser light is preferably reflected by a mirror (5) that can be tilted about an axis in the plane of Fig. 1 .
- the angle of the tilt is set by an actuator (6).
- the mirror (5) may optionally include a narrow mirror centered on, or axially offset from, the rear of the objective (7). This is a preferred embodiment, and has a preferred geometry and reflective property as follows:
- the field of view that can be achieved is large as is possible with the simple one-tilting-mirror strategy. By using two mirrors one can simultaneously change the direction of the beam and translate the beam.
- the system can also be used with an optional dichroic mirror.
- the design of the dichroic mirror will be such that the radiation from all excitation lasers is efficiently reflected, and that light in the wavelength range corresponding to fluorescence emission is efficiently transmitted.
- a multi band mirror based on Rugate technology is a preferred embodiment.
- Embodiments of the actuator (6) include, but are not limited to, a galvanometer with an integral sensor for detecting the angular position.
- the galvanometer is driven by a suitably-tuned servo system.
- the bearing system is based on flexures to effectively eliminate wear and issues with friction in the bearing. This is the preferred embodiment.
- the excitation laser light preferably passes through an objective (7).
- the objective the objective:
- a preferred embodiment includes a Plan-Fluor objective with a spherical-aberration collar.
- an objective will have a magnification in the range 15X to 30X and a focal length in the range 6.7 mm to 13.3 mm.
- the excitation laser light passes through a solid, transparent optical material (8) that supports the sample.
- the thickness, curvature and optical properties of this supporting material may vary from sample-to-sample.
- the excitation laser light is incident on the sample (9).
- the sample is illuminated by a line of laser light.
- Fluorescent material in the sample emits fluorescent light as a result of illumination by the line of light. In the preferred embodiment the distance over which the line of illumination is uniform will exceed 0.8 mm.
- the fluorescent light passes through the support (8) and is collected by the objective (7).
- the fluorescent light passes through or by the mirror (5) depending upon the embodiment of the mirror.
- the mirror (5) is a dichroic, significant rejection of laser illumination is contributed by this mirror. This rejection will reduce the blocking requirements of optical filters (11) and (14).
- the fluorescent light passes through an optional dichroic mirror (10). This mirror is used to insert the beam from the autofocus system (not shown) into the optical path.
- the fluorescent light passes through a suitable optical filter (11) that efficiently transmits the fluorescent light and blocks the wavelength of the excitation laser.
- the filter is optionally tilted about an axis perpendicular to the plane of Fig. 1 so that reflections from the filter are outside of the field of view of the camera (16).
- the actuator (12) can be used for filter changing.
- Preferred embodiments of the actuator (12) include, but are not limited to:
- Preferred embodiments of the filter (11) include, but are not limited to a Rugate notch filter. Multiple Rugate filters can be installed in the system. Each of these filters may have multiple narrow and highly-reflective bands that correspond to excitation laser wavelengths. Amongst the filters installed in the system there is at least one filter that will efficiently reflect the light emitted by every excitation laser installed in the system. Other preferred embodiments include:
- the filter (11) will not vignette the fluorescence emission.
- the fluorescent light passes through the image-forming lens (13).
- the fluorescent light passes through a suitable optical filter (14) controlled by an optional actuator (15).
- This filter efficiently transmits the fluorescent light and attenuates the light at other wavelengths.
- Potential embodiments of the filter (14) include, but are not limited to:
- the filter (14) will not vignette the fluorescence emission.
- preferred detectors include CMOS and CCD detectors which are capable of detecting the fluorescent light and generating an image.
- the detector is capable of an independent reset and readout of pixels (random access feature).
- the fluorescent emission is focused onto a CMOS detector (16) having a rolling shutter (also known as a focal-plane shutter).
- a rolling shutter also known as a focal-plane shutter.
- the laser In the line scan mode, the laser is focused to a uniformly illuminated line oriented parallel to the rows of the CMOS detector. There are control mechanisms in place (described above) that keep this line accurately centered on the area of the sample that is imaged onto the rolling shutter of the CMOS camera. This line moves as the rolling shutter moves across the camera. In this way the fluorescence emission generated by the line of illumination is collected by the sensor.
- the imager of this invention can basically be operated in two modes, sequential and simultaneous multi wavelength imaging, as described below.
- one or plurality of targets including one or plurality of fluorescent markers will be imaged by the imaging apparatus as follows.
- the fluorescent images are acquired in a sequence, using one-fluorophore-at the time approach.
- the Imaging System of this invention will be operated as follows:
- the target (9) is moved into an imaging position using an X-Y stage. Excitation radiation from the desired optical source is then focused on the target to produce a fluorescent emission.
- the position of the objective (7) is then adjusted for optimal focus manually and/or using the autofocus system.
- the detector (16) is actuated to initiate the exposure.
- the key acquisition parameters are the width of the rolling shutter and the speed at which the rolling shutter "moves" across the camera.
- filter (14) is a linear variable filter, then the position of this filter must also be changed during exposure to keep the position of the filter synchronized with the rolling shutter of the camera.
- the imaging system is configured to capture multiple fluorescent images simultaneous.
- sub grouping said wavelengths is proposed. These sub groups are selected such that the chromatic aberration of a microscope objective for each sub-group of the excitation wavelengths will be within acceptable range.
- a system requires fluorescent imaging at 670, 638, 532, 488, 405, and 374 nm excitation wavelengths.
- the total wavelengths range of ⁇ 300 nm is much wider than a corrected spectral range of a typical microscope objective and, therefore, simultaneous "in focus" imaging at all these wavelengths is not possible.
- these wavelengths can be grouped into several sub-groups such as:
- the spectral range of the excitation wavelengths within each sub-group is much narrower ( ⁇ 40 nm) and the simultaneous "in focus" imaging at the sub-group wavelengths becomes possible.
- a number of optical detectors in such a system should be equal to the number of wavelengths in a sub-group.
- Figure 2 shows an optical configuration of the system that demonstrates this approach for simultaneous imaging at two wavelengths using three sub-groups.
- the system is using six laser excitation sources that are divided into three sub-groups of two wavelengths each.
- the laser beams of the lasers in each sub-group are optically merged using one of the following methods:
- the system operates as follows:
Landscapes
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Microscoopes, Condenser (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US59081504P | 2004-07-23 | 2004-07-23 | |
| PCT/IB2005/002067 WO2006008637A1 (en) | 2004-07-23 | 2005-07-19 | Method and apparatus for fluorescent confocal microscopy |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP1787157A1 EP1787157A1 (en) | 2007-05-23 |
| EP1787157B1 true EP1787157B1 (en) | 2014-09-24 |
Family
ID=35431409
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP05780156.5A Expired - Lifetime EP1787157B1 (en) | 2004-07-23 | 2005-07-19 | Apparatus for fluorescent confocal microscopy |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US7335898B2 (enExample) |
| EP (1) | EP1787157B1 (enExample) |
| JP (2) | JP2008507719A (enExample) |
| CN (1) | CN101031837B (enExample) |
| AU (1) | AU2005264061B2 (enExample) |
| CA (1) | CA2574343C (enExample) |
| WO (1) | WO2006008637A1 (enExample) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11237370B2 (en) | 2018-04-30 | 2022-02-01 | University Of Central Florida Research Foundation, Inc. | Multiple inclined beam line-scanning imaging apparatus, methods, and applications |
| EP3283917B1 (de) | 2015-04-13 | 2022-11-30 | Leica Microsystems CMS GmbH | Verfahren und vorrichtung zum untersuchen einer probe |
Families Citing this family (125)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006085894A1 (en) * | 2005-01-31 | 2006-08-17 | Chemimage Corporation | Apparatus and method for chemical imaging of a biological sample |
| WO2007043036A1 (en) | 2005-10-11 | 2007-04-19 | Prime Sense Ltd. | Method and system for object reconstruction |
| US20110096182A1 (en) * | 2009-10-25 | 2011-04-28 | Prime Sense Ltd | Error Compensation in Three-Dimensional Mapping |
| US9330324B2 (en) | 2005-10-11 | 2016-05-03 | Apple Inc. | Error compensation in three-dimensional mapping |
| US7567346B2 (en) * | 2006-03-01 | 2009-07-28 | General Electric Company | System and method for multimode imaging |
| WO2007105215A2 (en) * | 2006-03-14 | 2007-09-20 | Prime Sense Ltd. | Depth-varying light fields for three dimensional sensing |
| CN101957994B (zh) * | 2006-03-14 | 2014-03-19 | 普莱姆传感有限公司 | 三维传感的深度变化光场 |
| CN101496033B (zh) * | 2006-03-14 | 2012-03-21 | 普莱姆森斯有限公司 | 利用散斑图案的三维传感 |
| DE102006034909A1 (de) * | 2006-07-28 | 2008-01-31 | Carl Zeiss Microimaging Gmbh | Verfahren zur Laser-Scanning-Mikroskopie und Strahlvereiniger |
| WO2008087652A2 (en) * | 2007-01-21 | 2008-07-24 | Prime Sense Ltd. | Depth mapping using multi-beam illumination |
| JP2010517056A (ja) * | 2007-01-30 | 2010-05-20 | ジーイー・ヘルスケア・バイオサイエンス・コーポレイション | 時間分解蛍光イメージングシステム |
| DE102007015063B4 (de) * | 2007-03-29 | 2019-10-17 | Carl Zeiss Microscopy Gmbh | Optische Anordnung zum Erzeugen eines Lichtblattes |
| US8150142B2 (en) * | 2007-04-02 | 2012-04-03 | Prime Sense Ltd. | Depth mapping using projected patterns |
| US8493496B2 (en) | 2007-04-02 | 2013-07-23 | Primesense Ltd. | Depth mapping using projected patterns |
| WO2009042862A1 (en) | 2007-09-28 | 2009-04-02 | Illumina, Inc | Fluorescence excitation and detection system and method |
| EP2065752A1 (en) * | 2007-11-23 | 2009-06-03 | Koninklijke Philips Electronics N.V. | Optical illumination apparatus for illuminating a sample with a line beam |
| CN101903761B (zh) * | 2007-12-19 | 2015-04-22 | 皇家飞利浦电子股份有限公司 | 检测系统和方法 |
| CN101984767B (zh) * | 2008-01-21 | 2014-01-29 | 普莱姆森斯有限公司 | 用于使零级减少的光学设计 |
| US8384997B2 (en) * | 2008-01-21 | 2013-02-26 | Primesense Ltd | Optical pattern projection |
| US8390291B2 (en) * | 2008-05-19 | 2013-03-05 | The Board Of Regents, The University Of Texas System | Apparatus and method for tracking movement of a target |
| FR2933209B1 (fr) * | 2008-06-27 | 2010-07-30 | Ecole Polytech | Procede et systeme de microscopie non-lineaire coherente a modulation de volume focal pour sonder la nanostructuration de materiaux organises |
| US8456517B2 (en) * | 2008-07-09 | 2013-06-04 | Primesense Ltd. | Integrated processor for 3D mapping |
| WO2010042576A1 (en) * | 2008-10-09 | 2010-04-15 | Ge Healthcare Bio-Sciences Corp. | A system and method for adjusting a beam expander in an imaging system |
| US8203769B2 (en) * | 2008-10-10 | 2012-06-19 | Xerox Corporation | In-line linear variable filter based spectrophotometer |
| US8462207B2 (en) * | 2009-02-12 | 2013-06-11 | Primesense Ltd. | Depth ranging with Moiré patterns |
| US8786682B2 (en) * | 2009-03-05 | 2014-07-22 | Primesense Ltd. | Reference image techniques for three-dimensional sensing |
| CN104237539A (zh) * | 2009-04-07 | 2014-12-24 | 连接Dx股份有限公司 | 用于读取救护点测试结果的手持扫描仪系统和方法 |
| US8717417B2 (en) * | 2009-04-16 | 2014-05-06 | Primesense Ltd. | Three-dimensional mapping and imaging |
| US20100291599A1 (en) * | 2009-05-18 | 2010-11-18 | Bruker Optics, Inc. | Large area scanning apparatus for analyte quantification by surface enhanced raman spectroscopy and method of use |
| WO2011013079A1 (en) | 2009-07-30 | 2011-02-03 | Primesense Ltd. | Depth mapping based on pattern matching and stereoscopic information |
| CN101661160B (zh) * | 2009-09-25 | 2014-06-18 | 山东汉和能源科技有限公司 | 单镜头一体化激光夜视仪 |
| JP5588310B2 (ja) * | 2009-11-15 | 2014-09-10 | プライムセンス リミテッド | ビームモニタ付き光学プロジェクタ |
| US8830227B2 (en) * | 2009-12-06 | 2014-09-09 | Primesense Ltd. | Depth-based gain control |
| US20110188054A1 (en) * | 2010-02-02 | 2011-08-04 | Primesense Ltd | Integrated photonics module for optical projection |
| US20110187878A1 (en) * | 2010-02-02 | 2011-08-04 | Primesense Ltd. | Synchronization of projected illumination with rolling shutter of image sensor |
| US8982182B2 (en) | 2010-03-01 | 2015-03-17 | Apple Inc. | Non-uniform spatial resource allocation for depth mapping |
| DE102010013223B4 (de) | 2010-03-29 | 2016-05-12 | Lavision Biotec Gmbh | Verfahren und Anordnung zur Mikroskopie |
| US20130087718A1 (en) * | 2010-06-28 | 2013-04-11 | Ge Healthcare Bio-Sciences Corp. | Confocal fluorescence lifetime imaging system |
| US20120002029A1 (en) * | 2010-06-30 | 2012-01-05 | Fluid Imaging Technologies, Inc. | System and method for sweeping mirror enhanced imaging flow cytometry |
| EP2589214B1 (en) | 2010-06-30 | 2019-08-14 | GE Healthcare Bio-Sciences Corp. | A system for synchronization in a line scanning imaging microscope |
| US9036158B2 (en) | 2010-08-11 | 2015-05-19 | Apple Inc. | Pattern projector |
| US9098931B2 (en) | 2010-08-11 | 2015-08-04 | Apple Inc. | Scanning projectors and image capture modules for 3D mapping |
| EP2643659B1 (en) | 2010-11-19 | 2019-12-25 | Apple Inc. | Depth mapping using time-coded illumination |
| US9131136B2 (en) | 2010-12-06 | 2015-09-08 | Apple Inc. | Lens arrays for pattern projection and imaging |
| FR2968402B1 (fr) * | 2010-12-07 | 2013-02-15 | Ecole Polytech | Systeme et procede d'imagerie multitechniques pour l'analyse chimique, biologique ou biochimique d'un echantillon. |
| CN103384845B (zh) * | 2011-03-01 | 2016-05-18 | 通用电气医疗集团生物科学公司 | 激光束选择器 |
| US9030528B2 (en) | 2011-04-04 | 2015-05-12 | Apple Inc. | Multi-zone imaging sensor and lens array |
| US8237835B1 (en) * | 2011-05-19 | 2012-08-07 | Aeon Imaging, LLC | Confocal imaging device using spatially modulated illumination with electronic rolling shutter detection |
| DE102011079941A1 (de) * | 2011-07-27 | 2013-01-31 | Leica Microsystems Cms Gmbh | Mikroskopbeleuchtungsverfahren und Mikroskop |
| DE102011079942B4 (de) * | 2011-07-27 | 2016-12-15 | Leica Microsystems Cms Gmbh | Mikroskopbeleuchtungsverfahren und Mikroskop |
| US8749796B2 (en) | 2011-08-09 | 2014-06-10 | Primesense Ltd. | Projectors of structured light |
| US8908277B2 (en) | 2011-08-09 | 2014-12-09 | Apple Inc | Lens array projector |
| DE102011052686B4 (de) | 2011-08-12 | 2013-09-05 | Leica Microsystems Cms Gmbh | Einrichtung und Verfahren zum Verteilen von Beleuchtungslicht und Detektionslicht in einem Mikroskop in Abhängigkeit des jeweiligen Polarisierungszustands und Mikroskop mit einer solchen Einrichtung |
| DE102011114500B4 (de) * | 2011-09-29 | 2022-05-05 | Fei Company | Mikroskopvorrichtung |
| US9157790B2 (en) | 2012-02-15 | 2015-10-13 | Apple Inc. | Integrated optoelectronic modules with transmitter, receiver and beam-combining optics for aligning a beam axis with a collection axis |
| US8998468B2 (en) * | 2012-03-16 | 2015-04-07 | Lumencor, Inc. | Solid state light source with hybrid optical and electrical intensity control |
| CN104221059B (zh) | 2012-03-22 | 2017-05-10 | 苹果公司 | 基于衍射感测镜子位置 |
| CN103424392A (zh) * | 2012-05-24 | 2013-12-04 | 黄书伟 | 波长分工srs显微镜 |
| US9488823B2 (en) * | 2012-06-07 | 2016-11-08 | Complete Genomics, Inc. | Techniques for scanned illumination |
| US9628676B2 (en) | 2012-06-07 | 2017-04-18 | Complete Genomics, Inc. | Imaging systems with movable scan mirrors |
| CN104781717A (zh) * | 2012-11-16 | 2015-07-15 | 分子装置有限公司 | 对显微镜设备异步排序的同时利用卷帘式快门照相机采集图像的系统和方法 |
| US9341769B2 (en) * | 2012-12-17 | 2016-05-17 | Kla-Tencor Corporation | Spectral control system |
| CN103018173B (zh) * | 2012-12-19 | 2014-12-03 | 中国科学院深圳先进技术研究院 | 结构光照明层析显微成像系统 |
| JP5639670B2 (ja) | 2013-02-01 | 2014-12-10 | 浜松ホトニクス株式会社 | 画像取得装置及び撮像装置 |
| JP6205140B2 (ja) * | 2013-03-01 | 2017-09-27 | オリンパス株式会社 | 走査型レーザ顕微鏡装置 |
| US9456746B2 (en) | 2013-03-15 | 2016-10-04 | Carl Zeiss Meditec, Inc. | Systems and methods for broad line fundus imaging |
| JP6076205B2 (ja) * | 2013-06-11 | 2017-02-08 | 浜松ホトニクス株式会社 | 画像取得装置及び画像取得装置のフォーカス方法 |
| JP6010506B2 (ja) * | 2013-06-11 | 2016-10-19 | 浜松ホトニクス株式会社 | 画像取得装置及び画像取得装置のフォーカス方法 |
| JP6433888B2 (ja) * | 2013-04-26 | 2018-12-05 | 浜松ホトニクス株式会社 | 画像取得装置、試料の合焦点情報を取得する方法及びシステム |
| WO2014174920A1 (ja) * | 2013-04-26 | 2014-10-30 | 浜松ホトニクス株式会社 | 画像取得装置及び画像取得装置のフォーカス方法 |
| WO2014174919A1 (ja) * | 2013-04-26 | 2014-10-30 | 浜松ホトニクス株式会社 | 画像取得装置及び画像取得装置のフォーカス方法 |
| HUE052489T2 (hu) | 2013-04-26 | 2021-04-28 | Hamamatsu Photonics Kk | Képfelvevõ berendezés és eljárás és rendszer fókusztérkép elõállítására minta számára |
| JP6134249B2 (ja) * | 2013-11-01 | 2017-05-24 | 浜松ホトニクス株式会社 | 画像取得装置及び画像取得装置の画像取得方法 |
| DE102013224463B4 (de) * | 2013-11-28 | 2017-01-26 | Berthold Technologies Gmbh & Co. Kg | Vorrichtung zur Ermittlung von Fluoreszenzeigenschaften von Proben |
| US9528906B1 (en) | 2013-12-19 | 2016-12-27 | Apple Inc. | Monitoring DOE performance using total internal reflection |
| CA2879598A1 (en) | 2014-01-26 | 2015-07-26 | Matthew S. Muller | Periodic fringe imaging with structured pattern illumination and electronic rolling shutter detection |
| KR101606197B1 (ko) * | 2014-05-16 | 2016-03-25 | 참엔지니어링(주) | 관찰기 및 이를 구비하는 레이저 처리장치 |
| EP3180646B1 (en) * | 2014-08-13 | 2020-04-01 | Daniel Summer Gareau | Line-scanning, sample-scanning, multimodal confocal microscope |
| US9473768B2 (en) * | 2014-09-03 | 2016-10-18 | Raytheon Company | Optical non-uniformity correction (NUC) for active mode imaging sensors |
| CN104198389B (zh) * | 2014-09-22 | 2017-02-01 | 上海理工大学 | 用于超高分辨率荧光成像的铜基悬空样品台制备方法 |
| JP6552043B2 (ja) * | 2014-11-04 | 2019-07-31 | オリンパス株式会社 | シート照明顕微鏡 |
| CN104570315B (zh) * | 2014-12-30 | 2017-06-27 | 中国科学院西安光学精密机械研究所 | 一种基于结构照明的彩色三维层析显微成像系统及方法 |
| US10168281B2 (en) * | 2015-01-27 | 2019-01-01 | Hitachi High-Technologies Corporation | Multicolor fluorescence analysis device |
| LU92740B1 (de) | 2015-06-11 | 2016-12-12 | Leica Microsystems | Abtastmikroskop |
| DE102015109645B3 (de) | 2015-06-17 | 2016-09-08 | Carl Zeiss Microscopy Gmbh | Verfahren zur Multiliniendetektion |
| DE102015111702A1 (de) * | 2015-07-20 | 2017-01-26 | Carl Zeiss Microscopy Gmbh | Hochauflösende, spektral selektive Scanning-Mikroskopie einer Probe |
| US10031328B2 (en) | 2015-07-24 | 2018-07-24 | General Electric Company | Systems and methods for image processing in optical microscopes |
| US10012831B2 (en) | 2015-08-03 | 2018-07-03 | Apple Inc. | Optical monitoring of scan parameters |
| US9983115B2 (en) | 2015-09-21 | 2018-05-29 | Fluid Imaging Technologies, Inc. | System and method for monitoring particles in a fluid using ratiometric cytometry |
| DE102015116452A1 (de) | 2015-09-29 | 2017-03-30 | Carl Zeiss Microscopy Gmbh | Mikroskop |
| CN105629453A (zh) * | 2016-03-10 | 2016-06-01 | 德诺杰亿(北京)生物科技有限公司 | 荧光显微镜 |
| CN105606581B (zh) * | 2016-03-21 | 2019-02-26 | 中国工程物理研究院激光聚变研究中心 | 一种基于超连续谱光源的多色荧光成像系统 |
| WO2017175391A1 (ja) * | 2016-04-08 | 2017-10-12 | オリンパス株式会社 | 照明装置およびこれを備えた内視鏡 |
| CN106066318A (zh) * | 2016-06-14 | 2016-11-02 | 中国科学院长春光学精密机械与物理研究所 | 一种在线测试光学元件激光损伤的方法及装置 |
| US10073004B2 (en) | 2016-09-19 | 2018-09-11 | Apple Inc. | DOE defect monitoring utilizing total internal reflection |
| DE102016119730A1 (de) | 2016-10-17 | 2018-04-19 | Carl Zeiss Microscopy Gmbh | Optikgruppe für Detektionslicht für ein Mikroskop, Verfahren zur Mikroskopie und Mikroskop |
| US10353210B2 (en) * | 2016-10-18 | 2019-07-16 | Qualcomm Incorporated | Self-aligning travelling collimating lens for sweeping laser |
| US11269122B2 (en) * | 2016-12-09 | 2022-03-08 | Leica Microsystems Cms Gmbh | Optical device having at least one spectrally selective component |
| JP6726859B2 (ja) * | 2017-02-20 | 2020-07-22 | パナソニックIpマネジメント株式会社 | 蛍光検出器及びその制御方法 |
| JP6827201B2 (ja) * | 2017-02-20 | 2021-02-10 | パナソニックIpマネジメント株式会社 | 蛍光検出器 |
| FR3068780B1 (fr) * | 2017-07-06 | 2021-05-14 | Centre Nat Etd Spatiales | Spectrophotometre hyperspectral large bande |
| CN108519329B (zh) * | 2018-03-26 | 2021-01-15 | 华中科技大学 | 一种多路扫描与探测的线共聚焦成像装置 |
| US11422292B1 (en) | 2018-06-10 | 2022-08-23 | Apple Inc. | Super-blazed diffractive optical elements with sub-wavelength structures |
| CN109030438A (zh) * | 2018-07-06 | 2018-12-18 | 广州蓝勃生物科技有限公司 | 一种用于多波长荧光检测的光路模组 |
| EP3620841A1 (en) * | 2018-09-07 | 2020-03-11 | ETH Zurich | Automated system for wide-field multiphoton microscope |
| JP7478727B2 (ja) | 2018-09-28 | 2024-05-07 | カール ツァイス メディテック インコーポレイテッド | アライメント支援のための一体化瞳カメラを有する低コスト眼底撮像器 |
| WO2020093019A2 (en) * | 2018-11-01 | 2020-05-07 | California Institute Of Technology | A multi-channel line scanner for fast large field and confocal imaging |
| CN109633883B (zh) * | 2019-01-23 | 2021-01-01 | 浙江大学 | 一种大视场高分辨的荧光显微镜物镜 |
| CN110108232B (zh) * | 2019-05-10 | 2020-12-04 | 南京理工大学 | 一种三模态数字全息显微成像系统 |
| CN110121021A (zh) * | 2019-06-28 | 2019-08-13 | 四川极智朗润科技有限公司 | 一种适用于卷帘快门相机的光学快门系统及其成像方法 |
| US11681019B2 (en) | 2019-09-18 | 2023-06-20 | Apple Inc. | Optical module with stray light baffle |
| US11506762B1 (en) | 2019-09-24 | 2022-11-22 | Apple Inc. | Optical module comprising an optical waveguide with reference light path |
| DE102019007066A1 (de) * | 2019-10-11 | 2021-04-15 | Abberior Instruments Gmbh | Verfahren und Vorrichtung zur Aberrationskorrektur in der Fluoreszenzmikroskopie |
| KR20220118301A (ko) * | 2019-12-31 | 2022-08-25 | 일루미나, 인코포레이티드 | 광학 샘플 분석에서의 오토포커스 기능 |
| US11754767B1 (en) | 2020-03-05 | 2023-09-12 | Apple Inc. | Display with overlaid waveguide |
| JP7565697B2 (ja) | 2020-03-13 | 2024-10-11 | 株式会社トプコン | 眼科装置、その制御方法、及びプログラム |
| DE102020123365A1 (de) * | 2020-09-08 | 2022-03-10 | Munich Surgical Imaging GmbH | Operationsmikroskop mit mindestens zwei Kameraeinrichtungen |
| JP7476067B2 (ja) * | 2020-09-18 | 2024-04-30 | 株式会社Screenホールディングス | 撮像装置および撮像方法 |
| KR102380565B1 (ko) * | 2020-09-18 | 2022-03-30 | (주)얼라인드제네틱스 | 시료의 형광을 검출하기 위한 시료 검사 장치 |
| WO2022197339A1 (en) | 2021-03-17 | 2022-09-22 | Apple Inc. | Waveguide-based transmitters with adjustable lighting |
| KR102609881B1 (ko) * | 2021-10-05 | 2023-12-05 | 한국광기술원 | 1차원 광센서를 이용한 2차원 형광 데이터 측정 장치 |
| DE102021134427A1 (de) | 2021-12-22 | 2023-06-22 | Carl Zeiss Microscopy Gmbh | Mikroskop und verfahren zur mikroskopie |
| US20240385421A1 (en) | 2023-05-16 | 2024-11-21 | Miltenyi Biotec B.V. & Co Kg | Method and apparatus for high resolution microscopy |
| DE102023134457A1 (de) * | 2023-12-08 | 2025-06-12 | Karl Storz Se & Co. Kg | Bildgebungsvorrichtung, insbesondere endoskopische, exoskopische und/oder mikroskopische Bildgebungsvorrichtung |
| DE102024108046A1 (de) | 2024-03-20 | 2025-09-25 | Carl Zeiss Microscopy Gmbh | Superauflösendes Mikroskop mit schneller quasikonfokaler Detektion |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05127219A (ja) * | 1991-11-05 | 1993-05-25 | Fujitsu Ltd | 電子シヤツター装置 |
| US5535052A (en) * | 1992-07-24 | 1996-07-09 | Carl-Zeiss-Stiftung | Laser microscope |
| US5612818A (en) * | 1993-09-08 | 1997-03-18 | Nikon Corporation | Confocal microscope |
| JP2000512744A (ja) * | 1996-05-16 | 2000-09-26 | アフィメトリックス,インコーポレイテッド | 標識材料を検出するシステムおよび方法 |
| US5754291A (en) * | 1996-09-19 | 1998-05-19 | Molecular Dynamics, Inc. | Micro-imaging system |
| JP3917731B2 (ja) * | 1996-11-21 | 2007-05-23 | オリンパス株式会社 | レーザ走査顕微鏡 |
| US20030036855A1 (en) | 1998-03-16 | 2003-02-20 | Praelux Incorporated, A Corporation Of New Jersey | Method and apparatus for screening chemical compounds |
| BR9908767B1 (pt) * | 1998-03-16 | 2011-09-06 | sistema de formação de imagem confocal, sistema de focalização para uso com um substrato, e, processos de examinar um objeto, e de focalização para uso com um substrato. | |
| WO2002057811A2 (en) * | 2000-12-15 | 2002-07-25 | Sloan-Kettering Institute For Cancer Research | Beam-steering of multi-chromatic light using acousto-optical deflectors and dispersion-compensatory optics |
| EP1414517A4 (en) * | 2001-06-26 | 2008-02-06 | Photomed Technologies Inc | MULTIPLE WAVELENGTH ILLUMINATOR |
| US6888148B2 (en) * | 2001-12-10 | 2005-05-03 | Carl Zeiss Jena Gmbh | Arrangement for the optical capture of excited and /or back scattered light beam in a sample |
| US6947127B2 (en) * | 2001-12-10 | 2005-09-20 | Carl Zeiss Jena Gmbh | Arrangement for the optical capture of excited and/or back scattered light beam in a sample |
| US7158294B2 (en) * | 2001-12-18 | 2007-01-02 | Olympus Optical Co., Ltd. | Laser scanning confocal microscope apparatus, image recording method, and recording medium |
| JP4185711B2 (ja) * | 2002-06-10 | 2008-11-26 | 株式会社キーエンス | 複数の光源を備えた顕微鏡 |
| GB0224067D0 (en) * | 2002-10-16 | 2002-11-27 | Perkinelmer Uk Ltd | Improvements in and relating to imaging |
| JP2006504140A (ja) * | 2002-10-22 | 2006-02-02 | ベイラー カレッジ オブ メディスィン | ランダムアクセス高速度共焦点顕微鏡 |
| DE102004034970A1 (de) * | 2004-07-16 | 2006-02-02 | Carl Zeiss Jena Gmbh | Lichtrastermikroskop und Verwendung |
-
2005
- 2005-07-19 WO PCT/IB2005/002067 patent/WO2006008637A1/en not_active Ceased
- 2005-07-19 EP EP05780156.5A patent/EP1787157B1/en not_active Expired - Lifetime
- 2005-07-19 AU AU2005264061A patent/AU2005264061B2/en not_active Ceased
- 2005-07-19 US US11/184,444 patent/US7335898B2/en active Active
- 2005-07-19 CA CA2574343A patent/CA2574343C/en not_active Expired - Fee Related
- 2005-07-19 CN CN2005800314987A patent/CN101031837B/zh not_active Expired - Lifetime
- 2005-07-19 JP JP2007522050A patent/JP2008507719A/ja active Pending
-
2012
- 2012-06-07 JP JP2012129410A patent/JP2012212155A/ja active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3283917B1 (de) | 2015-04-13 | 2022-11-30 | Leica Microsystems CMS GmbH | Verfahren und vorrichtung zum untersuchen einer probe |
| US11237370B2 (en) | 2018-04-30 | 2022-02-01 | University Of Central Florida Research Foundation, Inc. | Multiple inclined beam line-scanning imaging apparatus, methods, and applications |
Also Published As
| Publication number | Publication date |
|---|---|
| CA2574343A1 (en) | 2006-01-26 |
| WO2006008637A1 (en) | 2006-01-26 |
| CN101031837A (zh) | 2007-09-05 |
| CA2574343C (en) | 2012-05-01 |
| EP1787157A1 (en) | 2007-05-23 |
| AU2005264061B2 (en) | 2009-05-21 |
| US20060017001A1 (en) | 2006-01-26 |
| CN101031837B (zh) | 2011-06-15 |
| US7335898B2 (en) | 2008-02-26 |
| AU2005264061A1 (en) | 2006-01-26 |
| JP2012212155A (ja) | 2012-11-01 |
| JP2008507719A (ja) | 2008-03-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1787157B1 (en) | Apparatus for fluorescent confocal microscopy | |
| EP2316048B1 (en) | Optical arrangement for oblique plane microscopy | |
| JP5897563B2 (ja) | ライン走査式顕微鏡における同期用システム | |
| EP2960644B1 (en) | System and method for telecentric wide-field fluorescence imaging | |
| JP2009528577A (ja) | マルチモード撮像のシステム及び方法 | |
| WO2012159205A1 (en) | 3d pathology slide scanner | |
| US20130087718A1 (en) | Confocal fluorescence lifetime imaging system | |
| JP2007506955A (ja) | エバネッセント波照明を備えた走査顕微鏡 | |
| US20220137384A1 (en) | Microscope and method for light-field microscopy with light-sheet excitation and for confocal microscopy | |
| EP3615916A1 (en) | Scanning microscope for 3d imaging using msia | |
| CN114442298A (zh) | 用于捕获图像数据的设备和方法 | |
| JP2010271522A (ja) | 非線形光学顕微鏡 | |
| CN120359447A (zh) | 显微镜 | |
| JP3454575B2 (ja) | 走査型光学測定装置 | |
| JP2003524194A (ja) | 対象物を光学的に走査するための装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| 17P | Request for examination filed |
Effective date: 20070111 |
|
| 17Q | First examination report despatched |
Effective date: 20070605 |
|
| DAX | Request for extension of the european patent (deleted) | ||
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: GE HEALTHCARE NIAGARA INC. |
|
| APBK | Appeal reference recorded |
Free format text: ORIGINAL CODE: EPIDOSNREFNE |
|
| APBN | Date of receipt of notice of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA2E |
|
| APBR | Date of receipt of statement of grounds of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA3E |
|
| APAF | Appeal reference modified |
Free format text: ORIGINAL CODE: EPIDOSCREFNE |
|
| APBX | Invitation to file observations in appeal sent |
Free format text: ORIGINAL CODE: EPIDOSNOBA2E |
|
| APBZ | Receipt of observations in appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNOBA4E |
|
| APBT | Appeal procedure closed |
Free format text: ORIGINAL CODE: EPIDOSNNOA9E |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| INTG | Intention to grant announced |
Effective date: 20140515 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 688862 Country of ref document: AT Kind code of ref document: T Effective date: 20141015 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602005044794 Country of ref document: DE Effective date: 20141106 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20141225 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D Ref country code: NL Ref legal event code: VDEP Effective date: 20140924 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 688862 Country of ref document: AT Kind code of ref document: T Effective date: 20140924 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150124 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150126 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602005044794 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 |
|
| 26N | No opposition filed |
Effective date: 20150625 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150719 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150731 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150731 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20160331 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150731 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150719 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20050719 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140924 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: LEICA MICROSYSTEMS CMS GMBH, DE Free format text: FORMER OWNER: GE HEALTHCARE NIAGARA INC., MISSISSAUGA, CA Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: GE HEALTHCARE BIO-SCIENCES COMP., HALIFAX, CA Free format text: FORMER OWNER: GE HEALTHCARE NIAGARA INC., MISSISSAUGA, CA Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: GLOBAL LIFE SCIENCES SOLUTIONS CANADA ULC, CA Free format text: FORMER OWNER: GE HEALTHCARE NIAGARA INC., MISSISSAUGA, CA Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: GLOBAL LIFE SCIENCES SOLUTIONS USA LLC (N. D. , US Free format text: FORMER OWNER: GE HEALTHCARE NIAGARA INC., MISSISSAUGA, CA |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20200305 AND 20200311 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: LEICA MICROSYSTEMS CMS GMBH, DE Free format text: FORMER OWNER: GE HEALTHCARE BIO-SCIENCES COMP., HALIFAX, NOVA SCOTIA, CA Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: GLOBAL LIFE SCIENCES SOLUTIONS CANADA ULC, CA Free format text: FORMER OWNER: GE HEALTHCARE BIO-SCIENCES COMP., HALIFAX, NOVA SCOTIA, CA Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: GLOBAL LIFE SCIENCES SOLUTIONS USA LLC (N. D. , US Free format text: FORMER OWNER: GE HEALTHCARE BIO-SCIENCES COMP., HALIFAX, NOVA SCOTIA, CA |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20210218 AND 20210224 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: LEICA MICROSYSTEMS CMS GMBH, DE Free format text: FORMER OWNER: GLOBAL LIFE SCIENCES SOLUTIONS CANADA ULC, VANCOUVER, CA Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: GLOBAL LIFE SCIENCES SOLUTIONS USA LLC (N. D. , US Free format text: FORMER OWNER: GLOBAL LIFE SCIENCES SOLUTIONS CANADA ULC, VANCOUVER, CA |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20210701 AND 20210707 |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20220721 AND 20220727 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602005044794 Country of ref document: DE Owner name: LEICA MICROSYSTEMS CMS GMBH, DE Free format text: FORMER OWNER: GLOBAL LIFE SCIENCES SOLUTIONS USA LLC (N. D. GES. D. STAATES DELAWARE), MARLBOROUGH, MA, US |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230414 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240730 Year of fee payment: 20 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240724 Year of fee payment: 20 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R071 Ref document number: 602005044794 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: PE20 Expiry date: 20250718 |