Classifications

• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/06—Means for illuminating specimens
  • G02B21/08—Condensers
  • G02B21/12—Condensers affording bright-field illumination
  • G02B21/125—Condensers affording bright-field illumination affording both dark- and bright-field illumination
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/0004—Microscopes specially adapted for specific applications
  • G02B21/002—Scanning microscopes
  • G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
  • G02B21/0052—Optical details of the image generation
  • G02B21/0064—Optical details of the image generation multi-spectral or wavelength-selective arrangements, e.g. wavelength fan-out, chromatic profiling
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/0004—Microscopes specially adapted for specific applications
  • G02B21/002—Scanning microscopes
  • G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
  • G02B21/0052—Optical details of the image generation
  • G02B21/0068—Optical details of the image generation arrangements using polarisation
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/06—Means for illuminating specimens
  • G02B21/08—Condensers
  • G02B21/082—Condensers for incident illumination only
  • G02B21/084—Condensers for incident illumination only having annular illumination around the objective
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/06—Means for illuminating specimens
  • G02B21/08—Condensers
  • G02B21/10—Condensers affording dark-field illumination
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
  • G02B27/10—Beam splitting or combining systems
  • G02B27/1066—Beam splitting or combining systems for enhancing image performance, like resolution, pixel numbers, dual magnifications or dynamic range, by tiling, slicing or overlapping fields of view

Definitions

• the present application relates to imaging devices and to methods using a corresponding device.
• the present application relates to devices, e.g. Microscope devices for image acquisition, in which an improved result image is generated from a plurality of individual images.
• illumination is used in many cases to detect an object to be recorded, e.g. a sample to light.
• an object to be recorded e.g. a sample to light.
• Illuminated images to obtain an improved result image for example, from DE 10 2014 1 13 256 and DE 10 2014 1 13 258 of the applicant disclosed.
• a lighting device is disclosed for example in DE 39 06 555 A1 of the applicant. It is an object of the present invention to provide devices and methods which are particularly suitable for a dark field recording.
• an image pickup apparatus comprising: an image pickup device and
• a lighting device wherein the lighting device has a recess to allow a passage of light to the image pickup device, and wherein the illumination device has a plurality of independently controllable lighting sections;
• the image pickup device and the illumination device are arranged on a same side of a sample plane of the image pickup device;
• Lighting device seen from the sample plane is less than or equal to an angle defined by a numerical aperture of the image pickup device.
• Lighting sections in particular a dark field illumination can be realized from different directions.
• an advantageous illumination from different directions especially for a later
• Lighting sections may vary as long as it is less than or equal to that through the
• the angle at contant distance between adjacent illumination sections may become smaller with increasing distance from the optical axis of the image recording device, or the distances between the illumination sections may be selected such that the angle remains constant. Other types of variation are possible.
• the angle between adjacent lighting sections of the lighting device may be at least 10%, at least 20%, at least 30% or at least 50% smaller than the angle defined by the numerical aperture of the image pickup device.
• a ratio of a distance of the image pickup device to the sample plane to a distance of the illumination device to the sample plane may be in a range between 1 and 1.5, but is not limited thereto.
• the illumination device and the image recording device can thus be arranged at a similar distance from the sample plane and thus from the sample.
• the plurality of illumination sections may include a plurality of light source elements, e.g. Include light emitting diodes.
• the lighting can be flexibly adjusted.
• illumination from different directions, at different angles and by switching on a plurality of light-emitting diodes can also be realized simultaneously with different intensity.
• the light source elements may be individually and / or segmentally controllable, so as to realize the plurality of independently controllable lighting sections.
• the size and shape of the segments may be variable, e.g. by combining different numbers of light source elements into one segment. Thus, e.g. the distance between the segments and so the above-mentioned angle between adjacent ones
• Lighting sections of the lighting device can be adjusted.
• the illumination device may also comprise a planar light source and optionally controllable shading elements for darkening each of a part of the planar light source.
• the planar light source can be flat, but also curved or shaped differently.
• the illumination device may be annular with an inner diameter and a
• the device can be a further illumination device, wherein light from the further illumination device can be coupled into a beam path of the image recording device. As a result, a bright field illumination can be additionally realized.
• the further illumination device may comprise a movable light source element.
• the further illumination device may comprise a plurality of independently controllable illumination sections.
• the lighting device and / or the further lighting device may be movable, e.g. in a plane parallel to the sample plane or perpendicular thereto.
• the movement may also include tilting or rotational movement.
• Embodiments may also include various parts, e.g. various
• Lighting device to be relatively movable.
• the device may further comprise a further image recording device, wherein the further image recording device with regard to numerical aperture, working distance,
• the further image recording device can be arranged with respect to the image recording device on an opposite side of the sample plane. So can both
• the device may comprise an additional illumination device whose light can be coupled in a beam path of the further illumination device. So can be realized in terms of lighting more variation options.
• the apparatus may further comprise a control device, wherein the control device is set up to control the illumination device sequentially for activating different illumination sections in order to illuminate a sample in the sample plane at different angles and / or from different directions, and
• Lighting device to obtain a corresponding variety of images.
• the illumination from different directions makes it possible, in particular, to correct reflections that result from the illumination being arranged on the same side as the image recording device.
• the controller may be further configured to make the plurality of images into one
• controller In combining, one or more of the following may be performed by the controller:
• the control device can be further configured to evaluate a quality of the result image and, depending on the evaluation, the sequential control of the
• Lighting device and / or a selection of images for combining to modify can be adjusted dynamically depending on a result achieved when combining and, if necessary, a desired result.
• a method of image capturing comprising: capturing a plurality of images with the device as described above, wherein different illumination sections of the illumination device of the device are activated for different images of the plurality of images, and Combining the plurality of images into a resulting image with improved
• a method of image capture comprising:
• Image components are omitted when combining.
• the method may further comprise:
• the method may further include:
• the recording of the further images to be combined from the plurality of images can be triggered by selecting the further images to be combined.
• the method may further include:
• the combination parameters Performing an optimization to provide combination parameters for combining the further images to be combined, the combination parameters ensuring that the result image satisfies the increased image contrast as an optimization criterion.
• FIG. 1A is a block diagram of a device according to an embodiment
• FIG. 1B is a diagram illustrating an arrangement of illumination sections in the embodiment of FIG. 1A, FIG.
• FIG. 2A is a schematic cross-sectional view of a device according to a
• FIG. 2B is a plan view of a lighting device of the device of Fig. 2A,
• FIG. 3 is a cross-sectional view of a device according to another embodiment
• FIG. 4 shows a cross-sectional view of a device according to a further exemplary embodiment
• FIG. 5A is a cross-sectional view of a device according to another embodiment
• FIG. 5B is a schematic view of a lighting device of the embodiment of FIG. 5A;
• FIGS. 6A and 6B are schematic views of a lighting device according to an embodiment
• FIGS. 7A to 7C are diagrams for illustrating a possible activation of the illumination device of FIGS. 6A and 6B,
• Fig. 8 is a schematic cross-sectional view of a device according to another
• FIG. 9 is a schematic cross-sectional view of a device according to another
• FIGS. 10 to 12 detailed views of various implementation examples
• FIGS. 13A and 13B are flowcharts illustrating methods according to some embodiments
• FIGS. 10 to 12 detailed views of various implementation examples
• FIGS. 13A and 13B are flowcharts illustrating methods according to some embodiments
• FIGS. 10 to 12 detailed views of various implementation examples
• FIGS. 13A and 13B are flowcharts illustrating methods according to some embodiments
• FIGS. 10 to 12 detailed views of various implementation examples
• FIGS. 13A and 13B are flowcharts illustrating methods according to some embodiments
• Figs. 14 to 21 are example diagrams for illustrating the effect of various
• FIG. 1A a block diagram of a device according to an embodiment is shown.
• an image recording device 14 is used to record an image of a sample 12, which is arranged in a sample plane 11.
• the image recording device 14 of the device 10 can, for example, a
• microscope objective with an image sensor coupled thereto, but may additionally or alternatively a camera device for making macroscopic
• Overview images include.
• the application of the invention is therefore not limited to macroscopic or microscopic images, but can be applied to both types of images.
• a distance between the image recording device 14 and the sample plane 1 1 is indicated by Hobj. This distance can be measured, for example, from the sample plane 1 1 to a lens of the image recording device 14 closest to the sample or to another suitable part of the image recording device 14.
• the device 10 of FIG. 1A has a lighting device 13.
• Lighting device 13 may comprise a plurality of individually and / or in groups (also referred to as segments) controllable light source elements, such as light emitting diodes, which are arranged substantially concentrically around the image pickup device 14 around.
• controllable light source elements such as light emitting diodes, which are arranged substantially concentrically around the image pickup device 14 around.
• the light source elements are arranged symmetrically to an optical axis of the image pickup device 14, so that each
• Light source element has an associated complementary light source element, which lies on an imaginary line passing through the light source element, the complementary light source element and the optical axis, wherein the light source element and the complementary light source element have the same distance from the optical axis.
• the illumination device 13 can also have a planar light source and controllable shading elements in order to optionally darken individual parts of the planar light source. As a result, substantially the same controllability can be achieved as by individual light source elements.
• the illumination device 13 as shown in Fig. 1A having an opening to allow passage of light from the sample 12 and thus an image of the sample 12 by the image pickup device 14.
• Lighting device 13 to the sample plane 1 1 is designated in Fig. 1 with H.
• the image recording device 14 and the illumination device 13 are arranged on the same side of the sample plane 11, so that the illumination takes place in reflection (in contrast to a transmitted light illumination).
• a ratio of Hobj to H may be in the range of 1 to 1.5, but is not limited thereto.
• distances between individually controllable adjacent illumination sections e.g. individual light source elements, shading elements or groups thereof, suitably selected to a numerical aperture of the image pickup device 14. This will be explained with reference to FIG. 1 B, which shows a detail of FIG. 1A.
• Lighting device 13 this being only an example.
• an angle between these illumination sections is seen from a point of the sample plane 1 1 seen.
• 17 denotes an angle from this point of the sample plane, which is associated with the numerical aperture of the image recording device 14.
• the illumination sections are arranged and / or selected so that the angle 17 is less than or equal to the angle 18, preferably 10% smaller, 20% smaller, 30% smaller or 50% smaller. This has advantages in a combination of images for
• the angle 18 may vary for different illumination sections 13A, 13B as long as it remains less than or equal to the angle 17 defined by the numerical aperture of the imaging device. For example, the angle at contant distance between adjacent illumination sections 13A, 13B as long as it remains less than or equal to the angle 17 defined by the numerical aperture of the imaging device. For example, the angle at contant distance between adjacent illumination sections 13A, 13B as long as it remains less than or equal to the angle 17 defined by the numerical aperture of the imaging device. For example, the angle at contant distance between adjacent
• Lighting sections 13A, 13B with increasing distance from the optical axis of the image pickup device 14 become smaller, or the distances between the
• Lighting sections 13A, 13B may be selected so that the angle remains constant. Other types of variation are possible.
• the illumination device 13 is in the embodiment of FIG. 1 by a
• Control device 15 controlled.
• the control device 15 can be implemented, for example, as a correspondingly programmed computer or as a correspondingly programmed microcontroller. However, other implementations in software, firmware, hardware, or combinations thereof are possible.
• control device 15 controls the image recording device 14 and receives images from it.
• the control device 15 can control the illumination device 13 in particular in such a way that sequentially different segments of the illumination device 13 illuminate the sample 12.
• the sample 12 is sequentially illuminated from different directions and / or at different angles.
• an image is taken by the image recording device 14.
• the control device 15 combines these images into a result image, which has improved properties, for example with regard to sharpness, contrast or reflections, compared with the individual images.
• reflexes which result from the illumination of the illumination device 13 (ie, that the illumination takes place from the same side of the sample as the image acquisition)
• the result image and / or the individual images can be displayed on a display 16 and / or stored for later use. Detailed embodiments of such devices 10 are now under
• FIGS. 2 to 5 explained in more detail.
• an illustration of a controller and a display such as the controller 15 and the display 16 of FIG. 1 is omitted.
• such components may also be provided in the exemplary embodiments of FIGS. 2 to 5.
• the exemplary embodiments of FIGS. 2 to 5 concentrate in this regard on an image recording device and, in particular, on a lighting device used.
• a camera unit 20 is provided for taking an image of a sample, wherein the sample is to be arranged in a sample plane 22.
• the camera unit 20 of FIG. 2 includes an optic and an image sensor.
• a lighting device 21 is provided in order to be able to illuminate a sample in the sample plane 22 from different directions and / or at different angles.
• a distance of the illumination device 21 from the sample plane 22 is denoted by H.
• a ratio of Hobj to H may be in the range of 1.5 to 1 as in Fig. 1, but is not limited thereto.
• FIG. 2B shows a plan view of the illumination device 21 in an x-y plane parallel to the sample plane 22.
• Fig. 2B is the
• Lighting device 21 disc-shaped with a central recess which has a radius Rin.
• the radius of the disc is Rout.
• a multiplicity of individual light source elements for example light emitting diodes, can be arranged in the area of the pane. However, it is also a surface lighting, such as a surface OLED lighting, with individually switchable pixels or other type of lighting, in which segments or parts can be selectively switched on and off, possible.
• r a radius to a certain point of the illumination device, for example, to a position of a light source element, referred to. Where Rin ⁇ r ⁇ Rout.
• the outer radius Rout determines a maximum illumination angle to the vertical (z-axis in Fig. 2A) measured. The larger Rout, the larger a used illumination angle can be.
• Inner diameter Rin depends on the front dimensions of the lens 20, the distance between the camera unit 20 and the illumination device 21, and an angle at which the camera unit 20 views a sample located in the sample plane 22. More concrete examples of the illumination device 21 will be explained later with reference to FIGS. 6 and 7.
• the illumination device 21 can thus serve in particular the dark field illumination, since direct reflections (with
• the shape of the illumination device 21 in FIG. 2B is to be understood as an example only, and other shapes, such as square, rectangular, ellipsoidal, star or other basic shapes, may be used over the individual ones
• Light source elements are distributed or which contain individually switchable segments. By selectively activating and deactivating light source elements or segments of the illumination, illumination can be realized from different directions, at different angles and / or with different intensities (for example, by activation of different numbers of light source elements).
• Multiple apertures or recesses are possible when multiple lenses or multiple other imaging devices are used in an array.
• the shape of the recess may also vary and may be adapted, for example, to a shape and size of a lens used or another image recording device used.
• a non-planar arrangement of light source elements is also possible.
• Figures 3 to 5 show modifications of the apparatus of Fig. 2. To avoid repetition, like elements carry the same reference numerals and will not be explained repeatedly. Variations and modifications discussed with reference to Figures 1 and 2 are also applicable to Figures 3 to 5.
• Fig. 3 instead of the camera unit 20, a lens 30 and an image sensor 31 for
• the objective 30 can be, for example, a microscope objective for taking microscopic images or else a conventional objective for taking macroscopic overview images. Otherwise, the embodiment of FIG. 3 corresponds to the embodiment of FIG. 2A.
• a further illumination device 40 is provided. Light from the illumination device 40 is reflected by a beam splitter 41 in the lens 30 and can thus serve as a coaxial bright field illumination of a sample.
• the illumination device 40 is realized by a single light source, which for example can be movable to realize a bright field illumination from different directions. It is also possible to use a plurality of individual light sources which can be switched individually.
• FIG. 5A shows a plan view of the further illumination device 50.
• FIG. 5B shows a plan view of the further illumination device 50. In the case of FIG.
• the further illumination device 50 may be a display with individually switchable light points, for example an OLED display. By selectively activating different light sources, bright field illumination in turn can be generated from different directions. Light from the further illumination device 50 is reflected into the objective 30 via the beam splitter 30, as in FIG. 4.
• Light source elements of the further illumination device 50 may be in any
• Individual light source elements may be arranged in a rectangular or circular grid, with uniform or varying distances of groups of light source elements or individual ones
• the further illumination device 50 may be planar or a combination of planar elements or may have a spherical or aspherical shape on which the light source elements are arranged.
• the size of the light source elements of the further illumination device 50 can be selected so that it fills a back focal plane of the optical system 30, not completely fills or protrudes beyond this.
• Light source elements of the further illumination device 50 can all be switched on or off simultaneously or individually or in groups, as required for a specific measurement such as, for example, bright field measurement, contrast enhancement or obtaining z information of the sample.
• Lighting device 21 are driven, for example, for different measurements, or be controlled together with this, to a combined light and
• Contrast improvement, increase resolution and / or increase a depth of field may be advantageous.
• Illumination means 40 or 50 take place, whereby to the illumination device 21 complementary illumination angles are realized, under which additional images can be taken for a later resolution improvement.
• the lighting device 40 is movable or the lighting device 50 in different segments controllable to realize different illumination angle through the lens 30.
• the illumination device 21 and / or the further illumination device 40 or 50 may light source elements in the same spectral range or different
• Combinations of individual light source elements having different spectral properties By these light source elements are individually controlled, then in such a case, the spectral composition of the illumination can be optionally changed. Different light source elements can also be used in some
• Embodiments have different polarizations of the emitted light and / or different divergences of the radiated light beams, so as to
• the illumination device 21 and / or the further illumination device 40, 50 may be movable, e.g. in a plane parallel to the sample plane or perpendicular thereto.
• the movement may also include tilting or rotational movement.
• various parts e.g. various components
• Lighting device 40, 50 be relatively movable.
• Lighting device such as the lighting device 21 shown in FIG. 2A with an annular arrangement of light source elements, with reference to Figures 6 and 7 explained in more detail.
• Fig. 6A shows a lighting device 60 in which a plurality of light-emitting diodes 61 are arranged in a ring shape as already discussed with reference to Fig. 2B.
• the individual light-emitting diodes 61 are arranged with uniform spacing dx in the x-direction and uniform spacing dy in the y-direction, dx can be the same or different than dy.
• dx can be the same or different than dy.
• a total of 631 light emitting diodes are provided, in other embodiments, other numbers of Light-emitting diodes can be used.
• the light-emitting diodes may in particular be white-light LEDs, but may also comprise colored light-emitting diodes (for example red, green and / or blue light-emitting diodes), dx and dy may be selected, for example, in the range of 2-2.5 mm.
• the distance between the light-emitting diodes for example, as explained above with reference to FIG. 1 B suitable for a numerical aperture of an image pickup device, such as the lens 30 of Figures 3 to 5 or
• Camera unit 20 of Fig. 2A are selected.
• LEDs 61 for example, be in an overview camera.
• a greater distance between the LEDs may be selected, or only a portion of the LEDs 61 may be used.
• light-emitting diodes can also others
• Light source elements are used.
• segments of light emitting diodes 61 may be turned on or off together.
• segments 62 there are eight segments 62, with 1 through 8
• the light emitting diodes of each segment can be for some
• segments 2, 4, 5, and 7 may each comprise 10x10 light emitting diodes
• Segments 1, 3 and 6 may each comprise 58 light emitting diodes and the segment 8 may comprise 57 light emitting diodes.
• these numbers are for example only, and depending on
• Embodiment of the illumination device can be used a different division into segments with other numbers of light source elements, which can also be adapted dynamically. This will be described later with reference to FIG. 13B.
• a result image with improved contrast or a calculation of contrasts in a microscope image several images are taken in succession in exemplary embodiments, with another of the segments 62 being active for each image. These images can then be combined, for example, to obtain a result image with increased contrast, or evaluated to determine a contrast.
• the division into segments of Fig. 6B is also illustrative only, and a different layout may be used, for example with a different number of segments.
• FIGS. 7A to 7C which the LEDs are sequentially turned on according to the arrangement in lines as indicated by arrows.
• a light emitting diode 70A is turned on
• Fig. 7B showing a later time
• a light emitting diode 70B is turned on
• Fig. 7C a light emitting diode 70C is turned on.
• a sequential switch-on according to the rows a sequential switch-on according to columns or a random sequential switch-on of the LEDs can also take place.
• Elevation profile of a sample i.e., z information for purposes of autofocus adjustment
• Refocus a lens or increase the depth of field Again, several images can be taken, which are illuminated from different angles and / or from different directions, and by combining the images, a corresponding result image can be generated. Again, details will be explained later.
• the LED defines a certain angle and a certain position.
• the table below shows examples of the first 10 LEDs of the LED array 61, i.
• the light emitting diodes of the top line, r denotes the radius, as shown in Fig. 2B, and H denotes the distance between the illumination device and sample plane as it is also shown in Figures 1 to 5.
• theta denotes the illumination angle
• R denotes the distance of the light source from an intersection of the optical axis of the system with the sample plane.
• the illumination angle theta defines the numerical aperture of the illumination, which is indicated in the table NA.illum.
• FIG. 8 is based on the exemplary embodiment of FIG. 5A
• FIG. 9 is based on the exemplary embodiment of FIG. 3.
• additional image recording devices can also be provided in the exemplary embodiments of FIGS. 1, 2 or 4.
• Hobjl denotes the distance between the sample plane 22 and the objective 30 and thus corresponds to the distance Hobj of FIGS. 1 to 5.
• a further objective 80 is provided with a further image sensor (not shown), wherein the further objective 80 is arranged on an opposite side of the objective 30 relative to the sample plane 22.
• the objective 30 can have, for example, a relatively low numerical aperture and serve to record overview images.
• Lighting device 21 and / or the further illumination device 50 can be any suitable illumination device.
• Illuminations can be realized from different directions, as described above, and based on a plurality of recorded images, a result image can then be calculated in which a contrast is improved and / or reflections are corrected by the illumination.
• the objective 80 may have a higher numerical aperture and may also accommodate a plurality of images, in principle the
• Lighting devices 21 and 50 can serve for lighting. In this case, 80 transmitted light images are taken with the other lens. For others
• the further lens 80 may have its own (not shown in Fig. 8) lighting device.
• the lens 30 and the lens 80 are different from each other in terms of
• semitransparent samples can be obtained while using the lens 30 Auflichtopathic optionally with bright field illumination or dark field illumination can be obtained. In both cases, lighting can be realized at different angles.
• FIG. 9 shows an alternative to the exemplary embodiment of FIG. 8, in which the further illumination device 50 and the beam splitter 41 in the objective 30 have been omitted and an additional illumination device 91 and a beam splitter 90 are provided for the further objective 80.
• the additional illumination device 91 which in principle can be configured like the further illumination device 50, a transmitted light illumination in the bright field for the objective 30 or an incident light bright field illumination for the objective 80 is possible.
• the illumination by the further illumination device 91 can in particular provide illumination for a comparatively small image section of the objective 30.
• the range of useful angles for illumination by the additional lens 80, i. by means of the further illumination device 91 is defined by the numerical aperture of the objective 80.
• the proportion of the field of view of the objective 30, which can be illuminated in this way, can be determined by lateral displacement of the sample plane or
• Illuminator 91 or the lens 80 are increased.
• FIG. 10A shows a microscope apparatus 100 according to an embodiment
• FIG. 10B shows a detail view of the microscope apparatus 100 of FIG. 10A.
• Fig. 10 is a lens 103 with a lighting device 101, which as under
• the objective 103 may have, for example, a comparatively low numerical aperture and for the reception of
• the objective 102 is provided with discrete light source elements 104, for example light-emitting diodes, which are arranged concentrically around the objective 102. Even with the light source elements 104, illumination from different directions can be realized. With the objective 103, a sequence of overview images can then be recorded during operation, wherein the illumination device 101 for illumination consists of different
• the objective 102 can take close-up shots in parallel or sequentially to this, wherein here as well the illumination can be varied by activation of different light source elements 104 and then by combining the individual images a contrast and / or a
• Resolution can be improved and / or reflexes can be corrected.
• the individual steps, i. In particular, the individual images, can then be optimized for a particular task depending on the needs in terms of speed, image quality and performance.
• 1 1 shows various microscope objectives 1 12, 1 13 and 1 14, which with a
• Lighting device 1 1 which can be configured according to the illumination device 61 of Figures 6 and 7, can be combined. These lenses 1 12, 1 13 and 1 14 can be used with a microscope 1 10.
• the objective 1 12 can be a 5x objective
• the lighting device 1 1 in particular to the
• Front lens diameter of the 0.5x lens can be tuned, but can also be used on other lenses.
• Various illumination devices may be provided for different objectives, for example with different inside and outside diameters as shown in FIG. 2A.
• FIGS. 12A to 12C show a further combination of a corresponding one
• Lighting device 120 which in turn may be configured as the illumination device 61 of Figures 6 and 7, shown with a lens 121 for installation in a microscope 122.
• illumination devices according to the invention with different objectives and microscope systems can be used.
• FIG. 13A shows a flow chart of a corresponding method which can be carried out with the aid of the devices of FIGS. 1 to 12.
• a flow chart of a corresponding method which can be carried out with the aid of the devices of FIGS. 1 to 12.
• a corresponding method which can be carried out with the aid of the devices of FIGS. 1 to 12.
• a plurality of images are provided with
• different light source elements or groups / segments of light source elements of a lighting device can be activated sequentially, as already described above, and in each case one or more images for each
• step 131 one of the plurality of images becomes one
• Result image generated with improved image properties In particular, reflections can be removed, contrast can be improved, a z-map of the image can be created, i. a height profile, and / or the resolution can be improved.
• image parts are respectively "outshone", i.e. in which image parts, for example, pure white is present (in the case of color images, all
• Color channels e.g. red, green, blue, at the highest value. If these areas in
• a combination of the plurality of images may be used, for example, by averaging, wherein, for example, the above-identified outshone
• a reflex correction can also be made as described in detail in the German patent application DE 10 2014 1 13 256 of the applicant. Again, a plurality of images are taken for different illumination geometries, and to a part of the images, a shading operation for reflection suppression is applied, which is different from the illumination geometry used in taking the respective image, i. from
• Lighting direction and lighting angle depends.
• the modified images thus generated can be combined into a result image.
• z positions in the image can be determined, for example, as described in German Patent Application DE 10 2014 109 687 or as described in German Patent Application DE 10 2014 1 13 433.
• the lighting can come from a variety of different
• Lighting directions in particular defocused done In this case, the position of the imaged objects changes depending on the illumination direction depending on their z position. From the displacements of the objects depending on the illumination direction, a z-card can then be created. This z card can then be used for more
• Image enhancements such as those explained below, are applied.
• Illumination directions and / or illumination angles recorded and combined to produce a result image.
• DE 10 2014 1 12 648 an equalization as described in DE 10 2014 1 12 648 can be applied.
• a depth of field can also be increased as described in DE 10 2015 107 517, and / or a phase contrast image can be generated as explained in DE 10 2014 1 12 242.
• the above methods can be used individually, but also in combination with each other.
• FIG. 13B shows a flowchart of a further method, which is an extension of the method of FIG. 13A and can also be implemented in the control device 15 of FIG.
• a lighting sequence is determined with lighting patterns, i. it is determined which lighting sections (individual light source elements or also segments as described above) are activated in which order.
• step 133 a series of images is then created
• a step 134 images from the image series are then selected for a subsequent combination. These can be all images of the image series, but also only some images. This in turn can be done depending on the goal of the procedure.
• a step 135 a result image is then determined on the basis of the images selected in step 134. This can be done using the above with reference to FIG. 13A
• a step 136 it is judged whether the quality of the resultant image is satisfactory (e.g., sufficient image sharpness, reflections sufficiently corrected, etc.). If this is the case, the result image is output in a step 137. Otherwise, there are two options that can also be combined:
• step 134 it is possible to return to step 134, wherein the image selection is changed. For example, some pictures may be omitted.
• step 132 it is possible to return to step 132, wherein the illumination sequence is changed.
• size and spacing of segments used may be changed by activating or deactivating light source elements at the edge of the segments, which changes the angle 18 of FIG. 1B.
• the lighting sequence and / or the image selection can be adapted dynamically to requirements.
• FIG. 14 shows a sample image which has not been corrected and in which, for example, all light-emitting diodes of a lighting device such as the lighting device 61 of FIGS. 6 and 7 are switched on.
• Fig. 14 is at a central element 140 of the
• Example picture to see a clear spot reflex In addition, at the top left
• Figures 15 to 17 show various image series taken from the arrangement shown in Figure 14, wherein the illumination in each of Figures 15 to 17 varies from image to image.
• Figures 15A and 15B show two pictures for two different ones
• Lightings For example, in each case one half of the light source elements activated be.
• the reflex in the central element 140 then occurs at different locations, and also the reflection at the element 141 changes.
• FIGS. 16A to 16B show photographs for four different illuminations, for example in which in each case one fourth of light-emitting diodes of the illumination device 61 of FIGS. 6 and 7 is activated.
• FIG. 16B and 16C for example, no reflex occurs at the central element 140.
• FIGS. 17A to 17H show photographs with eight different illuminations, in which, for example, the eight segments which were shown in FIG. 6B,
• FIG. 18 shows an image obtained by combining a plurality of images with
• FIG. 18 shows an image in which the microscopic contrast was increased by combining a plurality of images.
• the individual images of FIGS. 15 to 17 can also be used for this purpose, wherein the results can vary depending on the group of individual images used.
• Fig. 20 shows a phase contrast image obtained by combining a plurality of images taken with different illumination.
• Phase contrast image for example, surface inhomogeneities in a metal ring 200 shown in the lower right image in the image better recognizable, and volume defects in the element 141, which is a glass ball, are visible.
• FIGS. 21A to 21F show an improvement of the resolution over a value corresponding to the numerical aperture of the objective used.
• Figures 21 A to 21 C show images obtained with a low numerical aperture optics, in the recorded area in addition reflections of the light-emitting diodes of a
• Fig. 21 B is an enlarged
• Section of Fig. 21 A, and Fig. 21 C is an enlarged detail of Fig. 21 B.
• the figures 21 D to 21 F show photographs of the detail of FIG. 21 C, which were achieved with a higher optical resolution corresponding to a higher numerical aperture.
• the resolution improves from FIG. 21D to FIG. 21F.
• a corresponding effect can be achieved when multiple images taken with the lens of FIG. 21C are combined with different illumination settings.
• Increasing the resolution also makes it possible, in particular for overview images, to enlarge a possible range for a digital zoom.
• Figs. 14 to 21 are illustrative only and the actual results obtained may vary depending on the lens taken depending on a lens used, depending on the illuminations used and the type of combination of the individual images.

Landscapes

• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Optics & Photonics (AREA)
• Chemical & Material Sciences (AREA)
• Analytical Chemistry (AREA)
• Spectroscopy & Molecular Physics (AREA)
• Microscoopes, Condenser (AREA)
• Studio Devices (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=57794253

Family Applications (1)

Country Status (6)

Families Citing this family (9)

Family Cites Families (22)

• 2015
  • 2015-12-23 DE DE102015122712.6A patent/DE102015122712B4/de active Active
• 2016
  • 2016-12-22 EP EP16825751.7A patent/EP3394656A2/de not_active Withdrawn
  • 2016-12-22 CN CN201680075911.8A patent/CN108474931B/zh active Active
  • 2016-12-22 JP JP2018532742A patent/JP6655188B2/ja active Active
  • 2016-12-22 WO PCT/EP2016/082347 patent/WO2017109053A2/de active Application Filing
  • 2016-12-22 US US16/065,263 patent/US10948705B2/en active Active

Also Published As

Similar Documents

Legal Events