EP3504575A1 - Verfahren zur bildgebung in einem mikroskop mit schiefer beleuchtung - Google Patents
Verfahren zur bildgebung in einem mikroskop mit schiefer beleuchtungInfo
- Publication number
- EP3504575A1 EP3504575A1 EP17755484.7A EP17755484A EP3504575A1 EP 3504575 A1 EP3504575 A1 EP 3504575A1 EP 17755484 A EP17755484 A EP 17755484A EP 3504575 A1 EP3504575 A1 EP 3504575A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- illumination
- microscope
- digital image
- contrast
- imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000005286 illumination Methods 0.000 title claims abstract description 94
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000003384 imaging method Methods 0.000 title claims abstract description 22
- 210000001747 pupil Anatomy 0.000 claims description 10
- 239000011159 matrix material Substances 0.000 claims description 3
- 230000003287 optical effect Effects 0.000 description 17
- 230000000694 effects Effects 0.000 description 5
- 238000000339 bright-field microscopy Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 239000007788 liquid Substances 0.000 description 2
- 230000005499 meniscus Effects 0.000 description 2
- 238000001000 micrograph Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000000386 microscopy Methods 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration using local operators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
- G02B21/08—Condensers
- G02B21/082—Condensers for incident illumination only
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
Definitions
- the present invention relates to a method for imaging in a microscope with oblique illumination, wherein an object is illuminated by an obliquely incident on the object plane of the microscope illumination beam path and a microscopic image of the object and a corresponding digital image signal are generated.
- the method of oblique illumination can be used to increase the contrast and to produce a plastic relief impression in low-contrast samples.
- a decentral section in the aperture diaphragm plane ie a section substantially outside the optical axis of the aperture diaphragm, is illuminated, so that the wavefronts of the illumination light pass through the preparation more or less obliquely, ie inclined in a certain angular range to the optical axis.
- the differently inclined wavefronts are not sufficient for interference in the image, which results in an edge in the object being rendered bright on one side and dark on the other side, resulting in a relief-like image impression.
- Incident light and transmitted light microscopy with oblique illumination are advantageously used for phase objects and represent a technically simple and thus cost-effective alternative to interference microscopy.
- Köhler illumination is used, with oblique illumination on one side, for example by decentration of the light Aperture, can be obtained, as proposed in DE 35 27 426 C1.
- the aperture diaphragm proposed there can be moved on both sides out of the optical axis
- Contrasting methods on the basis of the described oblique illumination are used for various low-contrast sample types, in particular also in connection with microtiter plates.
- oblique lighting When using the oblique lighting When focusing in the z-direction, ie in the direction of the optical axis of the microscope objective, there is a lateral shift of the image.
- the gain in contrast due to oblique illumination is the stronger, the more decentralized the objective pupil is illuminated.
- this leads to problems in the use of microtiter plates since on the one hand due to the depth of the wells geometrically caused shadowing and on the other hand the meniscus on the liquid surface a shift of the illuminated surface in the objective pupil as a function of the xy movement caused the sample.
- the object of the present invention is to specify a method for imaging in a microscope with slant illumination, with which the imaging of this contrasting method is improved and in particular the abovementioned disadvantages are to be avoided. Disclosure of the invention
- the present invention proposes a method for imaging in a microscope with oblique illumination with the features of claim 1.
- Advantageous embodiments are the subject of the dependent claims and the following description.
- an object is illuminated by an illumination beam path incident obliquely on the object plane.
- a microscopic image of this object is generated.
- the microscope considered here essentially has a microscope objective, with different lenses often being available for selection, as well as a tube optic.
- the microscopic image of the object can be viewed directly by a viewer and / or via a camera. To display the image on a digital camera, it is necessary to generate a digital image signal from the existing microscopic optical image.
- a digital image for example for documentation purposes, is generated without direct consideration.
- the relief-like image impression produced by the oblique illumination is again increased with increased contrast by processing the digital image signal by means of digital image processing using a convolution kernel (also referred to as convolution filter or convolution filter) to increase the contrast and from this a contrast-enhanced image digital image is generated.
- a convolution kernel also referred to as convolution filter or convolution filter
- the oblique illumination beam path is generated by illuminating a decentralized area in or near an aperture plane of an illumination arrangement of the microscope, this illuminated area being conjugate to a half pupil size one arranged entrance pupil of the microscope objective may amount.
- the illuminated area may in particular be larger than would typically be necessary to produce a sufficient contrast gain and relief impression in the case of oblique illumination imaging.
- the illuminated area is preferably 100%, in particular 70%, in particular 50% larger than necessary for imaging with oblique illumination.
- This contrast-enhanced image is then further processed to increase the contrast with the aid of digital image processing.
- a Köhler illumination arrangement can be used to produce the oblique illumination, a structure as known from the aforementioned patent DE 10 2010 042351 B4. With regard to construction and mode of operation, reference is expressly made again to this document.
- the orientation of the convolution kernel is aligned in relation to the direction of the oblique illumination in such a way that the contrast-increasing effects increase. This is especially the case when the direction from which the oblique illumination hits the sample coincides with the direction of the sequence of numbers (2, 1, -2) of the convolution kernel, here considered as a vector, assuming that the Sample and the image of the sample are aligned the same (north of the image coincides with north of the sample).
- a symmetrical square convolution kernel is used whose symmetry axis is oriented perpendicular to the direction of the oblique illumination.
- Digital image processing can be performed anywhere in the presence of a digital image signal. It is advantageous if the digital image is recorded by a camera and displayed by a central computer (CPU) or a monitor of the microscope connected to it. The digital processing then takes place, for example, anywhere between the camera and the CPU, for example directly in the camera, in a separate module between the camera and the CPU or in the CPU itself. It takes place in real time, so that the process takes place in an online image For example, it can be used for navigation in the object field.
- CPU central computer
- the information (for example, one byte for each of the colors red, green, and blue) of each image pixel is recalculated using the corresponding information of the adjacent pixels with the weight given by the convolution kernel. It is furthermore advantageous if the illuminated decentralized area in or near a (conjugate) aperture plane of an illumination arrangement of the microscope and / or the convolution kernel used is determined as a function of a microscope objective used. In this way, when using different objectives with different magnification and aperture, the relationship between slant illumination and relief filter can be adjusted by changing or adjusting apertures in said aperture plane and / or by using another convolution kernel. This can ensure sufficient illumination of the object field and shadowing can be minimized. It should be noted that the method according to the invention can be used both in a microscope with a finite imaging beam path and in a microscope with an infinite imaging beam path.
- the illumination beam path can form an incident-light illumination beam path or a transmitted-light illumination beam path.
- the invention has the advantage that it is possible to obtain a contrast-enhanced image with a relief impression without the above-described problems noticeably coming to fruition, which would be caused by oblique illumination on the one hand and digital image processing alone on the other hand.
- the lateral image shift in focusing as well as the noise and the loss of object similarity by the convolution are minimized. This effect could not be expected.
- the invention is particularly suitable for the use of samples in microtiter plates, since due to the depth of the wells and because of the liquid meniscus, neither the oblique illumination alone nor any known phase contrasting methods can be used to effectively increase the contrast.
- the differential interference contrast (DIC) is not applicable when using plastic microtiter plates because of the loss of polarization direction.
- FIG. 1 shows a schematic cross-sectional view of the structure of an oblique illumination
- FIG. 2 schematically shows an embodiment of a microscope for imaging with slanted transmitted light illumination
- FIG. 3 schematically shows an embodiment of a microscope for imaging with slant incident illumination
- FIG. 4 shows schematically the method sequence according to the invention.
- the basic principle of the oblique illumination is shown in FIG.
- the illustrated illumination arrangement has an aperture stop 101 and a condenser 103.
- a decentral area 105 of the aperture 101 is illuminated by an illumination beam path 102.
- the decentralized area 105 lies outside the optical axis 106 or lies largely outside this optical axis 106, but may contain these.
- the decisive factor is that the decentralized region 105 is not symmetrical with respect to the optical axis 106, as shown in FIG.
- the illumination light is collected by a condenser 103 and focused on the object plane 104. As shown in FIG.
- FIG. 2 shows a possible embodiment of a microscope 200 for imaging with oblique illumination, in which case the case of transmitted light illumination is shown.
- a possible embodiment of the oblique illumination in a microscope with epi-illumination can be seen in FIG.
- FIG. 2 very schematically shows a microscope 200, which has the essential components of the microscope objective 208 and the tube optics 209.
- the objective 208 defines an optical axis 206.
- the microscope 200 further comprises a microscope stage 215, on which an object is mounted in an object plane 204, which is to be examined microscopically in transmitted light.
- a camera 230 captures the microscopic optical image and converts it to a digital image.
- the digital image may be displayed on a monitor 242 for a viewer.
- the digital microscope 200 considered here has a central control unit or CPU 241 for controlling the various microscope components.
- a central control unit or CPU 241 for controlling the various microscope components.
- an aperture control 243 is shown here, which is controlled by the CPU 241. This will be discussed below.
- the CPU 241 also typically controls the microscope stage 215 to move the same, selecting a lens 218, and other components.
- the illumination arrangement of the microscope 200 comprises a light source 201, a downstream lens 202, a further lens 203 and a diaphragm 210 arranged in the aperture plane or near the aperture plane.
- the diaphragm 210 is followed by a condenser 212, which projects the illumination beam path 211 onto the object plane 204 focused.
- the beam path shown here is the realization of Köhler's transmitted light illumination.
- the diaphragm 210 is arranged in a plane conjugate to the light source 201.
- the diaphragm 210 is in an entrance pupil of the microscope objective 208 conjugated level arranged. In this way, a uniform illumination of the object plane 204 and thus of the observed preparation section is achieved.
- the light source 201 is imaged into the aperture diaphragm plane via the illumination optics consisting of the lenses 202 and 203.
- a decentered illumination beam path 211 is generated from the original illumination beam path 211 'by means of an aperture 205 located there it is also an aperture disk with different apertures, as described in detail in DE 10 2010 042 351 B4 In this respect, reference should again be made explicitly to this document with regard to construction and mode of operation.
- the corresponding digital image signal is digitally reworked in embodiments shown here in a computing unit 240.
- the arithmetic unit 240 shown here may be part of the camera 230, but also part of the CPU 241.
- the digital processing can therefore take place directly in the camera 230 or directly in the CPU 241 or, as shown here, in the arithmetic unit 240.
- the digital image processing by means of a particularly square convolution kernel can be carried out in real time, so that the processed image without noticeable delay for a user as an online image, for example, for navigation in the object field on a monitor 242 can be displayed.
- the orientation in the above example given by the direction of the sequence of numbers (2, 1, -2), which is perpendicular to the axis of symmetry (0, 1, 0), in relation to the direction of the oblique illumination, here coming from the south align to further increase the contrast increase.
- the direction of the oblique illumination is aligned with respect to the course of such structures in order to be able to represent them optimally plastically.
- the size of the illuminated region 205 of the diaphragm 210 is particularly advantageous initially to select the size of the illuminated region 205 of the diaphragm 210 in such a way that an image with oblique illumination is conventionally generated. Subsequently, the size of the region 205 can be increased, for example, until the half-side illumination of the objective pupil. This is possible due to the subsequent digital image processing without loss of image quality.
- the region 205 is enlarged, for example, by introducing a slightly larger aperture into the illumination beam path 211.
- the diaphragm 210 may be designed, for example, as an aperture wheel.
- the control of the diaphragm 210 via the aperture control 243 which in turn is controlled by the CPU 241. It is particularly preferred if the illuminated region 205 is selected to be about 50% -70% larger than is conventionally necessary for imaging with oblique illumination.
- a suitable convolution kernel is selected in particular by the CPU 241 and transferred to the arithmetic unit 240 for image processing.
- the respectively used folding core and / or the illuminated decentralized region 205 could furthermore be determined in particular depending on the microscope objective 208 used.
- the magnification ß réelle and aperture of the lens 208 may be an adapted illuminated area 205 and an adapted convolution core be advantageous. This ensures sufficient illumination of the object and shading can be minimized.
- the present structure is particularly advantageous for samples in microtiter plates, in particular those in plastic wells which are examined in transmitted light illumination.
- FIG. 3 which shows an embodiment of a microscope 200 for imaging with slant reflected illumination
- FIG. 3 shows an embodiment of a microscope 200 for imaging with slant reflected illumination
- the microscope 200 uses a lighting arrangement for reflected-light illumination.
- the illumination arrangement in turn comprises a light source 201 and downstream lenses 202, 203 and an aperture 210 arranged in the aperture plane or near the aperture plane.
- the lenses 202 and 203 define an optical axis 206 of the illumination arrangement. From the symmetric illumination beam path 211 '210 an asymmetrically opposed to the optical axis 206 area is cut out by the decentralized illuminated region 205 of the diaphragm, which is used to as an illumination path 211 for the oblique illumination.
- the two downstream lenses 213 and 207 generate a parallel illumination beam path 211, which is coupled by a beam splitter 220 in the direction of the optical axis 206 of the microscope objective 208.
- the microscope objective 208 focuses the illumination beam path 211 onto the object plane 204. All other details for imaging in the microscope 200, for digital image processing and for controlling the diaphragm 220 are in complete analogy to those of Figure 2. To avoid repetition, reference is therefore made to the statements there.
- step S1 a microscope image is taken with slant illumination.
- All information about the parameters of the oblique illumination are available to the CPU 241 and are taken into account in the next step S2 in the selection of a suitable convolution kernel.
- the parameters of the oblique illumination include magnification and aperture of the objective 208 used, as well as size, geometry and position of the illuminated region 205 of the diaphragm 210.
- Step S3 The contrast enhanced digital image may be displayed on a monitor 242 in step S4, for example.
- the method described in FIG. 4 can also be executed in the structure of a microscope according to FIG.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Optics & Photonics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Microscoopes, Condenser (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102016115856.9A DE102016115856B4 (de) | 2016-08-25 | 2016-08-25 | Verfahren zur Bildgebung in einem Mikroskop mit schiefer Beleuchtung |
PCT/EP2017/070882 WO2018036911A1 (de) | 2016-08-25 | 2017-08-17 | Verfahren zur bildgebung in einem mikroskop mit schiefer beleuchtung |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3504575A1 true EP3504575A1 (de) | 2019-07-03 |
Family
ID=59686945
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17755484.7A Withdrawn EP3504575A1 (de) | 2016-08-25 | 2017-08-17 | Verfahren zur bildgebung in einem mikroskop mit schiefer beleuchtung |
Country Status (4)
Country | Link |
---|---|
US (1) | US10823951B2 (de) |
EP (1) | EP3504575A1 (de) |
DE (1) | DE102016115856B4 (de) |
WO (1) | WO2018036911A1 (de) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2024521608A (ja) * | 2021-05-24 | 2024-06-04 | ベックマン コールター, インコーポレイテッド | 顕微鏡を通る流れを使用して撮像される試料の傾斜照明 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3527426C1 (de) | 1985-07-31 | 1986-07-10 | Dietmar 4290 Bocholt Enk | Opakilluminator für ein Mikroskop |
DE10229113A1 (de) * | 2002-06-28 | 2004-01-22 | Siemens Ag | Verfahren zur Grauwert-basierten Bildfilterung in der Computer-Tomographie |
WO2006103663A1 (en) * | 2005-03-29 | 2006-10-05 | Yoel Arieli | Spectral imaging camera and applications |
JP5814684B2 (ja) | 2010-09-03 | 2015-11-17 | オリンパス株式会社 | 位相物体の可視化方法及び可視化装置 |
DE102010042351B4 (de) * | 2010-10-12 | 2014-02-13 | Leica Microsystems Cms Gmbh | Mikroskopbeleuchtungssystem, Mikroskop und Verfahren zur schrägen Auflichtbeleuchtung |
WO2014132485A1 (ja) * | 2013-02-28 | 2014-09-04 | オリンパス株式会社 | 標本観察方法及び標本観察装置 |
US9229213B2 (en) | 2013-05-24 | 2016-01-05 | Steven E. Richfield | Coincident focus microscope having superior resolution and contrast in three dimensions |
-
2016
- 2016-08-25 DE DE102016115856.9A patent/DE102016115856B4/de active Active
-
2017
- 2017-08-17 WO PCT/EP2017/070882 patent/WO2018036911A1/de unknown
- 2017-08-17 EP EP17755484.7A patent/EP3504575A1/de not_active Withdrawn
- 2017-08-17 US US16/326,937 patent/US10823951B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
WO2018036911A1 (de) | 2018-03-01 |
DE102016115856B4 (de) | 2020-01-02 |
US10823951B2 (en) | 2020-11-03 |
US20190391380A1 (en) | 2019-12-26 |
DE102016115856A1 (de) | 2018-03-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2016030390A2 (de) | Phasenkontrast-bildgebung | |
EP3608831A1 (de) | Verfahren zur bereitstellung eines auswertungsmittels für wenigstens ein optisches anwendungssystem einer mikroskopbasierten anwendungstechnologie | |
EP3304165B1 (de) | Anordnung und verfahren zur strahlformung und zur lichtblattmikroskopie | |
WO2015001007A1 (de) | Bilderfassungsverfahren für mikroskopsystem und entsprechendes mikroskopsystem | |
EP2557451B1 (de) | Verfahren und anordnung zur optischen erfassung einer beleuchteten probe | |
WO2017191011A2 (de) | Artefaktreduktion bei der winkelselektiven beleuchtung | |
EP4325208A2 (de) | Verfahren und vorrichtung zum erfassen von verlagerungen einer probe gegenüber einem objektiv | |
EP3712670B1 (de) | Verfahren zur hochauflösenden scanning-mikroskopie | |
EP3692409A1 (de) | Konfokalmikroskop mit hoher auflösung | |
EP2465001A1 (de) | Mikroskop zur messung von totalreflexions-fluoreszenz | |
DE102019201916A1 (de) | Verfahren und Vorrichtung zur Inspektion von Nano-und Mikrostrukturen | |
DE202013011877U1 (de) | Mikroskopsystem | |
EP3504575A1 (de) | Verfahren zur bildgebung in einem mikroskop mit schiefer beleuchtung | |
DE102019109832B3 (de) | Lichtblattmikroskop und Verfahren zum Erfassen einer Messgröße | |
WO2018054944A1 (de) | Mikroskopbeleuchtungsanordnung zur strukturierten beleuchtung | |
DE602004012274T2 (de) | Rasterabbildungseinrichtung für die konfokale mikroskopie mit bildsubstraktion | |
EP3988989B1 (de) | Verfahren und mikroskop mit einer einrichtung zum erfassen von verlagerungen einer probe gegenüber einem objektiv | |
WO2019007698A1 (de) | Digitale bestimmung der fokusposition | |
DE102020204615A1 (de) | Schiefeebenemikroskop mit verbesserter Sammeleffizienz | |
EP3877797A1 (de) | Mikroskopisches durchlichtkontrastierverfahren | |
DE102007015599A1 (de) | Vermeidung von Halos um intensive Lichtquellen bei optischen Systemen, insbesondere bei Nachtsichtsystemen | |
EP3198323A1 (de) | Vorrichtung zur abbildung einer probe | |
DE102015221991A1 (de) | Mikroskopierverfahren zur Ermittlung eines Kontrastbildes und Mikroskop | |
DE102013208872A1 (de) | Verfahren zur Erzeugung eines Bildes einer Probe | |
WO2020127647A1 (de) | Fluoreszenzlichtmikroskopie mit erhöhter axialer auflösung |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190215 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230414 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20230301 |