EP3693786A1 - Filtre de mode holographique pour imagerie à super-résolution - Google Patents
Filtre de mode holographique pour imagerie à super-résolution Download PDFInfo
- Publication number
- EP3693786A1 EP3693786A1 EP20156780.7A EP20156780A EP3693786A1 EP 3693786 A1 EP3693786 A1 EP 3693786A1 EP 20156780 A EP20156780 A EP 20156780A EP 3693786 A1 EP3693786 A1 EP 3693786A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- light
- image
- imaging system
- optical imaging
- received
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 title description 6
- 238000000034 method Methods 0.000 claims abstract description 36
- 238000012634 optical imaging Methods 0.000 claims abstract description 35
- 238000003491 array Methods 0.000 claims abstract description 22
- 230000006870 function Effects 0.000 claims description 48
- 238000003860 storage Methods 0.000 claims description 26
- 238000005259 measurement Methods 0.000 claims description 17
- 230000015654 memory Effects 0.000 description 14
- 230000003287 optical effect Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 3
- 230000005684 electric field Effects 0.000 description 3
- 230000009021 linear effect Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 230000001427 coherent effect Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009022 nonlinear effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000003892 spreading Methods 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000004304 visual acuity Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4272—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having plural diffractive elements positioned sequentially along the optical path
- G02B27/4277—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having plural diffractive elements positioned sequentially along the optical path being separated by an air space
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/58—Optics for apodization or superresolution; Optical synthetic aperture systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/12—Generating the spectrum; Monochromators
- G01J3/18—Generating the spectrum; Monochromators using diffraction elements, e.g. grating
- G01J3/1838—Holographic gratings
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/12—Generating the spectrum; Monochromators
- G01J3/18—Generating the spectrum; Monochromators using diffraction elements, e.g. grating
- G01J3/24—Generating the spectrum; Monochromators using diffraction elements, e.g. grating using gratings profiled to favour a specific order
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/14—Beam splitting or combining systems operating by reflection only
- G02B27/141—Beam splitting or combining systems operating by reflection only using dichroic mirrors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4205—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive optical element [DOE] contributing to image formation, e.g. whereby modulation transfer function MTF or optical aberrations are relevant
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B11/00—Filters or other obturators specially adapted for photographic purposes
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B33/00—Colour photography, other than mere exposure or projection of a colour film
- G03B33/10—Simultaneous recording or projection
- G03B33/12—Simultaneous recording or projection using beam-splitting or beam-combining systems, e.g. dichroic mirrors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/13—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
- H04N23/16—Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
- G02B23/12—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices with means for image conversion or intensification
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/1006—Beam splitting or combining systems for splitting or combining different wavelengths
- G02B27/1013—Beam splitting or combining systems for splitting or combining different wavelengths for colour or multispectral image sensors, e.g. splitting an image into monochromatic image components on respective sensors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/20—Filters
- G02B5/203—Filters having holographic or diffractive elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/32—Holograms used as optical elements
Definitions
- a method includes receiving collimated light from an optical imaging system and dividing the received light into multiple bands of wavelength. Each band is refocused onto a corresponding diffraction grating having an amplitude function matched to a point spread function (PSF) of the optical imaging system. The light that is not filtered out by the diffraction grating is transmitted onto a corresponding pixel array. An image is reconstructed from data provided by the pixel arrays for each band. The intensity of light scattered by each diffraction grating may be detected, with the image being reconstructed as a function of an average value of detected intensity of scattered light used to scale the known zero-order mode profile, which is added to the image on the pixel array.
- PSF point spread function
- the functions or algorithms described herein may be implemented in software in one embodiment.
- the software may consist of computer executable instructions stored on computer readable media or computer readable storage device such as one or more non-transitory memories or other type of hardware-based storage devices, either local or networked.
- modules which may be software, hardware, firmware or any combination thereof. Multiple functions may be performed in one or more modules as desired, and the embodiments described are merely examples.
- the software may be executed on a digital signal processor, ASIC, microprocessor, or other type of processor operating on a computer system, such as a personal computer, server or other computer system, turning such computer system into a specifically programmed machine.
- the functionality can be configured to perform an operation using, for instance, software, hardware, firmware, or the like.
- the phrase “configured to” can refer to a logic circuit structure of a hardware element that is to implement the associated functionality.
- the phrase “configured to” can also refer to a logic circuit structure of a hardware element that is to implement the coding design of associated functionality of firmware or software.
- the term “module” refers to a structural element that can be implemented using any suitable hardware (e.g., a processor, among others), software (e.g., an application, among others), firmware, or any combination of hardware, software, and firmware.
- logic encompasses any functionality for performing a task. For instance, each operation illustrated in the flowcharts corresponds to logic for performing that operation.
- An operation can be performed using, software, hardware, firmware, or the like.
- component may refer to computer-related entities, hardware, and software in execution, firmware, or combination thereof.
- a component may be a process running on a processor, an object, an executable, a program, a function, a subroutine, a computer, or a combination of software and hardware.
- processor may refer to a hardware component, such as a processing unit of a computer system.
- the claimed subject matter may be implemented as a method, apparatus, or article of manufacture using standard programming and engineering techniques to produce software, firmware, hardware, or any combination thereof to control a computing device to implement the disclosed subject matter.
- article of manufacture as used herein is intended to encompass a computer program accessible from any computer-readable storage device or media.
- Computer-readable storage media can include, but are not limited to, magnetic storage devices, e.g., hard disk, floppy disk, magnetic strips, optical disk, compact disk (CD), digital versatile disk (DVD), smart cards, flash memory devices, among others.
- computer-readable media i.e., not storage media, may additionally include communication media such as transmission media for wireless signals and the like.
- a point spread function describes the response of an imaging system to a point source or a point object.
- the degree of spreading (blurring) of a point object is a measure for the quality of an imaging system.
- non-coherent imaging systems such as fluorescent microscopes, telescopes or optical microscopes
- the image formation process is linear in power and described by linear system theory. This means that when two objects A and B are imaged simultaneously, the result is equal to the sum of the independently imaged objects.
- the imaging of A is unaffected by the imaging of B and vice versa, owing to the non-interacting property of photons.
- the image of a complex object can then be seen as a convolution of the true object and the PSF.
- image formation is linear in the complex field. Recording the intensity image then can lead to cancellations or other non-linear effects.
- Finite telescope apertures act as spatial frequency filters, attenuating the amplitude of the higher spatial frequencies compared to lower spatial frequencies in an image. It is possible to construct an image processing scheme which re-amplifies the signal at higher spatial frequencies - multiplying the Fourier transform of the image by some function which is larger for higher spatial frequencies, the inverse of the filter - and thus restores the original image. "Deconvolution" algorithms do just that. But there are limits to the effectiveness of deconvolution.
- the effect of quantum noise may be mitigated by performing the measurement differently.
- the image that the telescope is attempting to capture is a map of the intensity of an optical field as a function of x and y in the image plane, and the measurement of that optical field intensity is typically done by a pixel array. Each pixel is a detector making an independent measurement of the intensity. Each measurement has an uncertainty related to the square root of the intensity at that pixel, due to quantum noise.
- the low-spatial-frequency parts of the electric field which form the image spread themselves (and their quantum noise) across many pixels, while carrying very little information about the details of the image. Since each of the measurements is independent, two neighboring pixels may read different values, which results in a spurious signal with a high spatial frequency. In this way, an electric field component which has a low spatial frequency can inject noise into the image at all spatial frequencies, since a bunch of independent measurements of its intensity are being performed at different positions.
- the lowest spatial frequency part of the image (the "zeroth order mode") is filtered out before making any measurement of the intensity. That component of the electric field is physically separated out such that it is not incident on a pixel array at all. Measurement noise will be correspondingly lower. The intensity incident on each pixel will be smaller, and so will the shot noise.
- the total power in the zeroth order mode may be separately measured with a single-pixel "bucket" detector which integrates the intensity over the whole mode profile. The known spatial distribution of that mode is used to add that component back in. The image can then be deconvolved more successfully.
- the filtered components can be amplified, and there will be less noise at those frequencies to be amplified along with the signal.
- FIG. 1 is a block diagram of a zero-mode filter system 100 for receiving light 105 from an optical imaging system 110, such as a telescope or microscope.
- the light 105 is received from an object 112 that reflects of an aperture 115 and a mirror 117 in the case of a reflecting telescope.
- the telescope may also be a refracting telescope with multiple lenses.
- the light 105 is collimated via a collimator 120 to provide collimated light 125.
- the light may already be collimated by the optical imaging system 110 via adaptive optics in some embodiments, obviating the need for a separate collimator to produce the collimated light 125.
- the collimated light 125 is provided to a beamsplitter 130 or other wavelength selective element.
- Beamsplitter 130 may be a dichroic beamsplitter that divides the light into bands, first band 132 and 133.
- First band 132 may comprise red light that is focused by a lens 135 onto a first diffraction grating 140.
- Band 133 contains the remaining light.
- the diffraction grating 140 has an amplitude function matched to the PSF of the optical imaging system 110.
- Light which is mode matched to the diffraction grating 140 is scattered at 141 onto a first detector 142.
- First detector 142 may also be referred to as a Zero Order Mode photodetector.
- beamsplitter 130 may be a diffraction grating, prism, or other means of separating the spectral components.
- the light might be collimated after being spectrally separated rather than before being separated.
- Light that is not filtered out by the diffraction grating is transmitted at 144 and focused by lens 146 as indicated at 148 onto a successive or second diffraction grating 150.
- light that gets transmitted directly through is still sometimes referred to as "forward scattering.”
- Further implementations may also utilize reflective gratings, where both the "filtered” and “unfiltered” light are reflected - just at different angles to appropriate optical components, such as detectors and further gratings.
- the second diffraction grating 150 also has an amplitude function matched to the PSF of the optical imaging system 110.
- the second diffraction grating 150 scatters mode matched light 152 onto a second detector 154 and transmits 156 light that is not filtered out by the diffraction grating via lens 158 to focus the light 160 that is not filtered out by the diffraction grating onto a third diffraction grating 162.
- Third diffraction grating 162 scatters light at 165 to a third detector 166 and transmits light that is not filtered out by the diffraction grating at 170 to a pixel array 175.
- the pixel array 175 may include a low noise charge-coupled device (CCD) to capture images.
- CCD low noise charge-coupled device
- Third diffraction grating 162 is the third in a succession of diffraction gratings having amplitude functions matched to the PSF of the optical imaging system 110.
- a number, n, of successive diffraction gratings and corresponding detectors may be used prior to transmitting the final light that is not filtered out by the diffraction grating to the pixel array 175 sufficient to scatter greater than 99% of the light in grating mode is scattered. In some embodiments, 85% or greater, or 99.9% or greater may be sufficient.
- Further beamsplitters 130' and 130" may be used to further split the light 105 into further bands indicated at 132' and 132", which may correspond to green and blue bands of light. In further embodiments, still further bands may be divided. Each of the bands is processed in the same manner as first band 132, which corresponding optical elements designated in FIG. 1 with a "'" or "''” respectively.
- FIG. 2 is a flowchart illustrating a computer assisted method 200 of generating an image from light detected from an object by an optical imaging system, such as a telescope.
- Method 200 begins by collimating at operation 210, light received from an optical imaging system.
- the received light is divided into multiple bands of wavelength, such as by a dichroic beamsplitter for each band.
- the multiple bands may correspond to red, green, and blue bands.
- Each band is refocused at operation 230 onto a corresponding diffraction grating having an amplitude function matched to a point spread function (PSF) of the optical imaging system.
- PSF point spread function
- the light that is not filtered out by the diffraction grating is transmitted at operation 240 onto a corresponding pixel array.
- the image is reconstructed from the pixel arrays for each band.
- operation 240 may include detecting an intensity of light scattered by each diffraction grating.
- Operation 250 reconstructs the image as a function of an average value of detected intensity of scattered light.
- the image may be reconstructed as a function of the average value of scattered light, the pattern on the pixel arrays, and a pattern corresponding to a source of the light received from the optical imaging system.
- the average value of light may be empirically determined.
- the diffraction grating for each band may include multiple successive amplitude function matched diffraction gratings.
- the number of successive amplitude function matched diffraction gratings for each band may include a number sufficient to scatter greater than 99% of light in grating mode.
- the diffraction gratings are a customized diffractive optical element that includes a grating pattern on which a contrast mask (an apodization filter) is imposed.
- the contrast mask matches the shape of the PSF.
- a telescope output is collimated, and dielectric stack mirrors (such as a dichroic beamsplitter) with narrowband reflectance are positioned to separate out different spectral bands.
- the collimated light is refocused from each of multiple wavelength bands to be incident on the diffraction grating with an amplitude function matched to the PSF of the telescope
- the image is computationally reconstructed via a controller coupled to receive values representative of the measured total intensity of the light in scattered mode (summed from all of the different detectors), which provides a coefficient of the lowest spatial frequency component of the image, and the intensity pattern on each pixel array from which the intensity of the higher spatial frequency components are measured.
- FIG. 3 is an image of a Gaussian hologram 300 utilized for the diffraction gratings, such as diffraction grating 140.
- the shape and size of the hologram 300 are designed to match the shape and size of the telescope PSF.
- a hologram is a photographic recording of a light field, rather than of an image formed by a lens.
- the hologram itself is not an image and is usually unintelligible when viewed under diffuse ambient light. It is an encoding of the light field as an interference pattern of seemingly random variations in the opacity, density, or surface profile of the photographic medium. The interference pattern diffracts the light into a reproduction of the original light field.
- the hologram 300 may be made by interfering SPF with a reference beam.
- Finite telescope apertures act as spatial frequency filters, attenuating the amplitude of the higher spatial frequencies compared to lower spatial frequencies in an image. This is because diffraction causes each point on the object to appear spread out on the image.
- the "point spread function” usually appears as a blurred circle, and when two such point spread functions overlap, the distinction between the two points is lost.
- the exact shape of the point spread function is determined by the Fourier transform of the aperture. Most telescopes have circular apertures with sharply defined edges, and the "blurred circle” is actually a Bessel function: a bright central disk surrounded by a series of progressively dimmer rings.
- the shape of the telescope aperture can be modified with an apodization filter.
- a Gaussian apodization filter produces a Gaussian point spread function, for instance. In every case, the bigger the telescope aperture, the smaller the point spread function.
- FIG. 4 is a block flow diagram illustrating a computer implemented deconvolution process 400 for computationally reconstructing the image.
- the zero-mode filtering system After passing through the zero-mode filtering system, the remaining light in each band is captured at the image plane on the detector array. This light would not be recognizable as the object with the zeroth order mode (equivalent in shape to the PSF) missing.
- a conventional deconvolution to reconstruct the image may then be performed using any commonly available technique (Weiner filter, Lucy-Richardson, or more advanced nonlinear methods such as neural-networks).
- the zero-order mode power measurement is read at operation 410 and added in computationally at operation 420. Note that the measurement includes amplitude noise only, since other light is transmitted and not detected.
- the image data from the pixel arrays is read. The image data, and knowledge of the PSF at operation 435 is used to perform deconvolution at operation 440. An output image is provided at operation 450 for display or storage.
- FIG. 5 is a block schematic diagram of a computer system 500 that may be used to form the controller for performing methods and algorithms according to example embodiments. All components need not be used in various embodiments.
- One example computing device in the form of a computer 500 may include a processing unit 502, memory 503, removable storage 510, and non-removable storage 512.
- the example computing device is illustrated and described as computer 500, the computing device may be in different forms in different embodiments.
- the computing device may instead be a smartphone, a tablet, smartwatch, smart storage device (SSD), or other computing device including the same or similar elements as illustrated and described with regard to FIG. 5 .
- Devices, such as smartphones, tablets, and smartwatches, are generally collectively referred to as mobile devices or user equipment.
- the storage may also or alternatively include cloud-based storage accessible via a network, such as the Internet or server-based storage.
- a network such as the Internet or server-based storage.
- an SSD may include a processor on which the parser may be run, allowing transfer of parsed, filtered data through I/O channels between the SSD and main memory.
- Memory 503 may include volatile memory 514 and non-volatile memory 508.
- Computer 500 may include - or have access to a computing environment that includes - a variety of computer-readable media, such as volatile memory 514 and non-volatile memory 508, removable storage 510 and non-removable storage 512.
- Computer storage includes random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM) or electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD ROM), Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium capable of storing computer-readable instructions.
- Computer 500 may include or have access to a computing environment that includes input interface 506, output interface 504, and a communication interface 516.
- Output interface 504 may include a display device, such as a touchscreen, that also may serve as an input device.
- the input interface 506 may include one or more of a touchscreen, touchpad, mouse, keyboard, camera, one or more device-specific buttons, one or more sensors integrated within or coupled via wired or wireless data connections to the computer 500, and other input devices.
- the computer may operate in a networked environment using a communication connection to connect to one or more remote computers, such as database servers.
- the remote computer may include a personal computer (PC), server, router, network PC, a peer device or other common data flow network switch, or the like.
- the communication connection may include a Local Area Network (LAN), a Wide Area Network (WAN), cellular, Wi-Fi, Bluetooth, or other networks.
- the various components of computer 500 are connected with a system bus 520.
- Computer-readable instructions stored on a computer-readable medium are executable by the processing unit 502 of the computer 500, such as a program 518.
- the program 518 in some embodiments comprises software to implement one or more methods and algorithms described herein.
- a hard drive, CD-ROM, and RAM are some examples of articles including a non-transitory computer-readable medium such as a storage device.
- the terms computer-readable medium and storage device do not include carrier waves to the extent carrier waves are deemed too transitory.
- Storage can also include networked storage, such as a storage area network (SAN).
- Computer program 518 along with the workspace manager 522 may be used to cause processing unit 502 to perform one or more methods or algorithms described herein.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Astronomy & Astrophysics (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201962804007P | 2019-02-11 | 2019-02-11 | |
US16/781,909 US11550164B2 (en) | 2019-02-11 | 2020-02-04 | Holographic mode filter for super-resolution imaging |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3693786A1 true EP3693786A1 (fr) | 2020-08-12 |
EP3693786B1 EP3693786B1 (fr) | 2023-05-24 |
Family
ID=69742635
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20156780.7A Active EP3693786B1 (fr) | 2019-02-11 | 2020-02-11 | Filtre de mode holographique pour imagerie à super-résolution |
Country Status (2)
Country | Link |
---|---|
US (1) | US11550164B2 (fr) |
EP (1) | EP3693786B1 (fr) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2001077629A2 (fr) * | 2000-04-12 | 2001-10-18 | Nano-Or Technologies Inc. | Analyse et mesure spatiales et spectrales de fronts d'ondes |
EP1643292A1 (fr) * | 2004-09-13 | 2006-04-05 | Agilent Technologies, Inc. | Méthode et dispositif pour améliorer la dynamique de systèmes optiques utilisant une apodisation spatiale |
US10120195B1 (en) * | 2016-07-18 | 2018-11-06 | National Technology and Engineering Solutions of Sandia, LLC | Multi-aperture optical system for high-resolution imaging |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4086616A (en) * | 1976-12-23 | 1978-04-25 | The United States Of America As Represented By The Secretary Of The Navy | All-weather multi-spectral imaging system |
US20020039231A1 (en) * | 2000-08-11 | 2002-04-04 | Optichrom Inc. | Complex grating for compensating non-uniform angular dispersion |
WO2011079126A2 (fr) * | 2009-12-23 | 2011-06-30 | Laser Biopsy, Inc. | Procédé et appareil pour système d'imagerie microscopique à large champ de vue et à rendement de collection élevé |
US8836723B2 (en) * | 2010-06-18 | 2014-09-16 | Vantage Surgical Systems, Inc. | Augmented reality methods and systems including optical merging of a plurality of component optical images |
CN106461462B (zh) * | 2014-03-21 | 2019-03-26 | 海佩尔梅德影像有限公司 | 紧凑型光传感器 |
CA2981353C (fr) * | 2015-03-30 | 2020-02-25 | Novadaq Technologies Inc. | Systeme d'imagerie grand champ a canaux multiples et systeme optique destine a etre utilise a l'interieur de ce dernier |
US11269174B2 (en) | 2019-01-08 | 2022-03-08 | Honeywell International Inc. | Endoscopic imaging |
-
2020
- 2020-02-04 US US16/781,909 patent/US11550164B2/en active Active
- 2020-02-11 EP EP20156780.7A patent/EP3693786B1/fr active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2001077629A2 (fr) * | 2000-04-12 | 2001-10-18 | Nano-Or Technologies Inc. | Analyse et mesure spatiales et spectrales de fronts d'ondes |
EP1643292A1 (fr) * | 2004-09-13 | 2006-04-05 | Agilent Technologies, Inc. | Méthode et dispositif pour améliorer la dynamique de systèmes optiques utilisant une apodisation spatiale |
US10120195B1 (en) * | 2016-07-18 | 2018-11-06 | National Technology and Engineering Solutions of Sandia, LLC | Multi-aperture optical system for high-resolution imaging |
Non-Patent Citations (1)
Title |
---|
JANEZ KOS ET AL: "Holistic spectroscopy: Complete reconstruction of a wide-field, multi-object spectroscopic image using a photonic comb", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 16 April 2018 (2018-04-16), XP080871329 * |
Also Published As
Publication number | Publication date |
---|---|
US11550164B2 (en) | 2023-01-10 |
EP3693786B1 (fr) | 2023-05-24 |
US20200256732A1 (en) | 2020-08-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Tseng et al. | Differentiable compound optics and processing pipeline optimization for end-to-end camera design | |
DeWeert et al. | Lensless coded-aperture imaging with separable Doubly-Toeplitz masks | |
US20160065915A1 (en) | Coded spectral imager | |
US8131511B2 (en) | Apparatus for registering and analyzing the spectral signature of a dynamic event | |
JP7050917B2 (ja) | 光を検出するための装置、システムおよび方法 | |
CN110692233A (zh) | 摄像装置、图像处理装置、摄像系统、图像处理方法及记录介质 | |
JP6628103B2 (ja) | デジタルホログラフィ記録装置、デジタルホログラフィ再生装置、デジタルホログラフィ記録方法、およびデジタルホログラフィ再生方法 | |
US10012953B2 (en) | Method of reconstructing a holographic image and apparatus therefor | |
EP2947433A1 (fr) | Système et procédé d'acquisition d'images hyperspectrales | |
WO2019025759A1 (fr) | Dispositif d'imagerie spectrale à ouverture codée | |
CN111527737B (zh) | 摄像装置 | |
EP2909671B1 (fr) | Procede de conception d'un imageur monovoie passif capable d'estimer la profondeur de champ | |
FR2994007B1 (fr) | Procede de fusion d'images multi-resolutions | |
US11550164B2 (en) | Holographic mode filter for super-resolution imaging | |
EP3072081B1 (fr) | Determination de la carte de profondeur image d'une scene | |
WO2019216213A1 (fr) | Dispositif et procédé de mesure spectroscopique | |
US7155354B1 (en) | Apparatus for and methods of analyzing the spectral signature of a dynamic event | |
US20190238732A1 (en) | Lens apparatus, imaging apparatus, image processing apparatus and method, and storage medium | |
FR2645976A1 (fr) | Appareil electronique d'holographie | |
Rueda et al. | Compressive spectral imaging based on colored coded apertures | |
KR102099395B1 (ko) | 디지털 홀로그래피 장치 | |
Chen et al. | A computational camera with programmable optics for snapshot high-resolution multispectral imaging | |
US8026484B2 (en) | Spectrum-forming device on an optical sensor with spatial rejection | |
MacDougall | Spatial filtering | |
WO2023053767A1 (fr) | Dispositif de traitement de données, procédé, programme, et caméra multispectrale |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200211 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20221214 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602020010994 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1569877 Country of ref document: AT Kind code of ref document: T Effective date: 20230615 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230523 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20230524 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1569877 Country of ref document: AT Kind code of ref document: T Effective date: 20230524 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230925 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230824 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230924 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230825 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602020010994 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240228 Year of fee payment: 5 Ref country code: GB Payment date: 20240220 Year of fee payment: 5 |
|
26N | No opposition filed |
Effective date: 20240227 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230524 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240226 Year of fee payment: 5 |