EP3218769A1 - Procede d'analyse comprenant la determination holographique d'une position d'une particule biologique - Google Patents
Procede d'analyse comprenant la determination holographique d'une position d'une particule biologiqueInfo
- Publication number
- EP3218769A1 EP3218769A1 EP15801133.8A EP15801133A EP3218769A1 EP 3218769 A1 EP3218769 A1 EP 3218769A1 EP 15801133 A EP15801133 A EP 15801133A EP 3218769 A1 EP3218769 A1 EP 3218769A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- particle
- interest
- optical system
- image
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000002245 particle Substances 0.000 title claims abstract description 183
- 238000004458 analytical method Methods 0.000 title claims abstract description 46
- 230000003287 optical effect Effects 0.000 claims abstract description 166
- 238000000034 method Methods 0.000 claims abstract description 27
- 238000013519 translation Methods 0.000 claims description 19
- 238000003384 imaging method Methods 0.000 claims description 15
- 230000006870 function Effects 0.000 claims description 13
- 238000010276 construction Methods 0.000 claims description 9
- 238000011161 development Methods 0.000 claims description 5
- 238000005286 illumination Methods 0.000 claims description 5
- 230000003595 spectral effect Effects 0.000 claims description 4
- 241000894006 Bacteria Species 0.000 claims description 3
- 240000004808 Saccharomyces cerevisiae Species 0.000 claims description 3
- 244000005700 microbiome Species 0.000 claims description 3
- 238000004088 simulation Methods 0.000 claims 2
- 230000005540 biological transmission Effects 0.000 abstract description 6
- 230000014616 translation Effects 0.000 description 17
- 239000011159 matrix material Substances 0.000 description 16
- 239000002609 medium Substances 0.000 description 11
- 238000005070 sampling Methods 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 239000007788 liquid Substances 0.000 description 4
- 229920001817 Agar Polymers 0.000 description 3
- 239000008272 agar Substances 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 238000011144 upstream manufacturing Methods 0.000 description 3
- 238000001069 Raman spectroscopy Methods 0.000 description 2
- 230000001427 coherent effect Effects 0.000 description 2
- 230000005284 excitation Effects 0.000 description 2
- 239000001963 growth medium Substances 0.000 description 2
- 238000001093 holography Methods 0.000 description 2
- 238000000386 microscopy Methods 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 239000000243 solution Substances 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 230000001464 adherent effect Effects 0.000 description 1
- 239000000853 adhesive Substances 0.000 description 1
- 230000001070 adhesive effect Effects 0.000 description 1
- 238000003287 bathing Methods 0.000 description 1
- 239000007853 buffer solution Substances 0.000 description 1
- 239000003153 chemical reaction reagent Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- QSHDDOUJBYECFT-UHFFFAOYSA-N mercury Chemical compound [Hg] QSHDDOUJBYECFT-UHFFFAOYSA-N 0.000 description 1
- 239000004005 microsphere Substances 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/41—Refractivity; Phase-affecting properties, e.g. optical path length
- G01N21/45—Refractivity; Phase-affecting properties, e.g. optical path length using interferometric methods; using Schlieren methods
- G01N21/453—Holographic interferometry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/47—Scattering, i.e. diffuse reflection
- G01N21/4788—Diffraction
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0402—Recording geometries or arrangements
- G03H1/041—Optical element in the object space affecting the object beam, not otherwise provided for
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0866—Digital holographic imaging, i.e. synthesizing holobjects from holograms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/97—Determining parameters from multiple pictures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/01—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials specially adapted for biological cells, e.g. blood cells
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1429—Signal processing
- G01N15/1433—Signal processing using image recognition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N2015/1006—Investigating individual particles for cytology
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
- G01N2015/144—Imaging characterised by its optical setup
- G01N2015/1445—Three-dimensional imaging, imaging in different image planes, e.g. under different angles or at different depths, e.g. by a relative motion of sample and detector, for instance by tomography
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
- G01N2015/1452—Adjustment of focus; Alignment
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
- G01N2015/1454—Optical arrangements using phase shift or interference, e.g. for improving contrast
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
- G03H2001/0033—Adaptation of holography to specific applications in hologrammetry for measuring or analysing
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
- G03H2001/005—Adaptation of holography to specific applications in microscopy, e.g. digital holographic microscope [DHM]
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0402—Recording geometries or arrangements
- G03H2001/0428—Image holography, i.e. an image of the object or holobject is recorded
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
- G03H2001/0447—In-line recording arrangement
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
- G03H2001/0452—Digital holography, i.e. recording holograms with digital recording means arranged to record an image of the object
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0465—Particular recording light; Beam shape or geometry
- G03H2001/0467—Gated recording using pulsed or low coherence light source, e.g. light in flight, first arriving light
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0866—Digital holographic imaging, i.e. synthesizing holobjects from holograms
- G03H2001/0883—Reconstruction aspect, e.g. numerical focusing
Definitions
- the present invention relates to the field of the analysis of a sample receiving biological particles, this analysis consisting in particular of determining a position of at least one of said biological particles, along an axis of the depth of the sample.
- a commonly used solution is to acquire a series of images of the sample at different depths in the sample. We then look for the image on which we observe a clear image of the biological particle.
- a disadvantage of this solution is that it does not allow to know the position of a transparent biological particle whose clear image merges with the image of the surrounding medium.
- An object of the present invention is to provide a method and a device not having this disadvantage.
- an object of the present invention is to provide a method and a device for determining the position of any biological particle, along at least one axis of the three-dimensional space.
- This objective is achieved with a method of analyzing a sample receiving biological particles, among which a particle of interest, the method being implemented in a device comprising the sample disposed between a first light source and an optical system said method comprising the steps of:
- the invention therefore advantageously comprises a step of detecting the reference point, by placing the optical system so that its focus plane is placed on the reference point, on said first interface or at the known distance thereof, and arrangement of the optical system such that the particle of interest is out of the focus plane of the optical system.
- the reference image is acquired for this arrangement of the optical system, such that the particle of interest is outside the focus plane of the optical system.
- This arrangement of the optical system can correspond directly to the arrangement of the optical system implemented to detect the reference point.
- the reference image, or defocused image is acquired directly after detection of the reference point.
- the method comprises a step of shifting the focusing plane of the optical system relative to said cue point, by a translation of a support receiving the sample relative to the optical system.
- the reference image, or defocused image is acquired after this offset step.
- the invention makes it possible to precisely know a distance between the plane of focus and said reference point. It is thus possible to precisely know a distance between the particle of interest and the focusing plane, which then makes it possible to better position an analysis device to study the particle of interest.
- the method comprises a determination of the distance between the particle of interest and said reference point, from said distance between the particle of interest and said focusing plane and said useful distance.
- It may further comprise a determination of the presence of said particle of interest in the medium from the distance between said particle of interest and said focusing plane.
- the determination of the useful distance comprises the following sub-steps: illumination of the reference point by a laser beam, said laser beam being focused by said optical system; acquiring an image on the sensor representing the reflection of the laser beam on an interface of the sample;
- the biological particles adhere to a second interface of the sample, the first and second interfaces being distinct or merged.
- the distance along an axis parallel to the optical axis of the optical system, between the position of the focusing plane associated with the reference image, and the projection of the reference point along this axis and on the second interface, is included for example between +5 ⁇ and +2000 ⁇ or between -5 ⁇ and -2000 ⁇ .
- the illuminated region may comprise a plurality of biological particles.
- the first light source typically has a spectral width of less than 200 nm.
- the method further comprises determining, from said series of reconstructed images, the position of the particle of interest in a plane orthogonal to the optical axis of the optical system.
- Each reconstructed image is formed by a real part and an imaginary part, and among the real and imaginary parts, only the imaginary parts of the reconstructed images are advantageously used to determine the distance along an axis parallel to the optical axis of the optical system, between the particle of interest and the landmark.
- Each reconstructed image may be associated with an offset along the optical axis of the optical system and with a value of a useful parameter, so as to constitute a function describing the evolution of the useful parameter according to said offset, the determination of the distance between the particle and the plan of point implementing a search of a remarkable value, in particular an extremum, a point of inflection or a zero crossing of said function.
- the optical system is advantageously displaced with respect to said particle of interest so as to focus the analysis laser beam (363) on the particle of interest. 'interest.
- the optical system is advantageously displaced with respect to said particle of interest so as to adjust the focus of a photodetector located in the image plane.
- the method may further comprise a step of counting the number of biological particles present in the sample.
- biological particles may comprise bacteria, spores, cells, yeasts or microorganisms.
- the invention also relates to a device for analyzing a sample receiving biological particles, among which a particle of interest, the device comprising:
- an imaging assembly comprising an optical system and a sensor, such that the sensor is in an image plane of the optical system, said image plane being the conjugate, by the optical system, of a focusing plane;
- a support adapted to receive the sample, arranged between the first light source and the imaging assembly;
- translational means adapted to move the support relative to the imaging means, along an axis parallel to the optical axis of the optical system
- the device may also include a laser, adapted to provide a laser beam aligned with the optical axis of the optical system, and coupled to the optical system so that the focusing point of the laser beam corresponds to the focusing plane.
- FIG. 1 illustrates a first embodiment of an analysis device according to the invention
- FIG. 2 schematically illustrates a first embodiment of an analysis method according to the invention
- FIG. 3 illustrates a second embodiment of an analysis device according to the invention
- FIG. 4 schematically illustrates a detail of a second embodiment of an analysis method according to the invention
- FIGS. 5A to 5C illustrate a detail of the method illustrated in FIG. 4;
- FIG. 6 illustrates a reference image according to the invention;
- FIG. 7 schematically illustrates a detail of a third embodiment of an analysis method according to the invention.
- FIG. 8 illustrates a profile used in a fourth embodiment of the method according to the invention. DETAILED PRESENTATION OF PARTICULAR EMBODIMENTS
- analysis method and the analysis device according to the invention will be described together, the analysis device according to the invention being adapted to the implementation of the analysis method according to the invention.
- FIG. 1 illustrates a first embodiment of an analysis device 100 according to the invention.
- FIG. 2 illustrates a first embodiment of an analysis method according to the invention, implemented in the analysis device 100.
- the analysis device 100 comprises a support 110, adapted to receive a sample 111.
- the support 110 is for example a clamp, or a transparent plate, or a plate pierced with an opening for passing light rays.
- the sample 111 is a transparent or translucent medium, that is to say having a transmission coefficient greater than or equal to 70% in the visible spectrum or more generally in a spectrum between 300 nm and 1000 nm.
- Sample 111 is delimited by interfaces, or boundaries, or boundaries between the sample and a medium in direct contact with it.
- the sample consists of a liquid such as water, a buffer solution, a liquid comprising a reagent, a culture medium, and biological particles 112 located in this liquid.
- the sample consists of a solid medium such as agar, and biological particles located on this solid medium.
- the sample consists of a gas in which there are biological particles.
- the biological particles may be located within the sample (for example bathing in a liquid), or flush on the surface of the sample (for example being located on an agar).
- the biological particles 112 denote for example bacteria, spores, cells, yeasts, or any type of microorganism.
- One of these biological particles is named particle of interest 112A.
- the sample 111 comprises a culture medium enclosed in a fluidic chamber delimited by a lower blade 113, for example a standard microscope slide, an upper blade 114, and an adhesive 115 surrounding the liner laterally. Sample 111 and connecting together the upper and lower blades.
- the upper and lower blades 113, 114 are transparent in the visible and, where appropriate, other useful wavelengths.
- the boundary between the sample and the lower blade 113 defines a lower interface 116 of the sample 111.
- the boundary between the upper blade 114 and the sample defines an upper interface 117 of the sample 111.
- a first light source 120 is located upstream of the sample 111, in the direction of propagation of the light, from the first light source 111.
- the terms upstream and downstream refer to the direction of propagation of the light, from the first light source 120 to the sample 111.
- the first light source 120 is for example a laser, a light-emitting diode, a white lamp including a mercury vapor lamp filtered or not.
- the first light source may include an optical fiber for bringing light under the lower blade 113.
- the first light source 120 is advantageously temporally coherent. It has a spectral width advantageously less than 200 nm, or even less than 100 nm or even 25 nm.
- the first light source 120 is spatially coherent.
- the first light source illuminates in transmission a region 119 of the sample.
- the particle of interest 112A is in region 119.
- An imaging assembly 130 is located downstream of the upper blade 114, in the propagation direction of the light, from the first light source to the sample 111. In the example described, the imaging assembly 130 is above sample 111.
- the imaging assembly 130 includes an optical system 131 and a sensor
- the optical system 131 consists for example of an objective, in particular a microscope objective. It has an object plane 133, also called a focus plane, and an image plane 134.
- the image plane 134 is the conjugate (or image) of the focusing plane by the optical system. In other words, an object in the focus plane is a sharp image in the image plane.
- the sensor 132 is for example a matrix sensor of the CCD or CMOS type. I l is located in the image plane 134. Thus, the sensor 132 acquires a transmission image of a part of the focusing plane 133.
- the focus plane is the object focal plane of the optical system, and the image plane is returned to infinity.
- a proximity optics for example a tube lens, makes it possible to focus the image plane on the sensor 132.
- sensor 132 groups together the sensor 132 and its proximity optics.
- the optical system 131 has an optical axis 135.
- the optical axis is orthogonal to the plane of focus and to the image plane.
- the optical axis 135 defines the depth of the sample 111. This axis connects the lower and upper interfaces 116, 117 of the sample 111.
- the optical axis 135 is substantially orthogonal to the lower and upper interfaces 116, 117
- the term interface refers to a boundary of the sample 111 studied.
- the analysis within the meaning of the invention comprises in particular a determination of the position of the particle of interest 112A along an axis parallel to the optical axis 135.
- the device 100 further comprises translation means 140, adapted to move the imaging assembly 130 along an axis parallel to the optical axis 135.
- the translation means 140 may move only the optical system 131, the sensor 132 remaining fixed.
- the translation means 140 are adapted to move the support 110 along an axis parallel to the optical axis 135.
- the translation means 140 furthermore perform translations along two other axes defining a plane orthogonal to the optical axis 135.
- the sensor 132 is connected to computing means 150, in particular a processor or a microprocessor.
- the device 100 is adapted to the implementation of the method according to the invention, illustrated schematically in FIG.
- the method includes a first step 21, determining a landmark 118.
- This step consists of choosing, or defining the landmark 118. This choice is generally arbitrary.
- the reference point is located on a first interface of the sample 111, or at a known distance from this first interface, this distance being defined along the optical axis 135.
- the cue point is located on the upper interface 117 or lower 116.
- the cue point is located on the upper interface 117 of the sample.
- the reference point is not located directly on an interface of the sample, but at a known distance from it.
- the landmark is on one side of the upper blade 114 opposite the sample, the thickness of the upper blade 114 being known.
- the calculation means 150 are connected to a memory 151 storing information relating to the reference point, in particular the distance along an axis parallel to the optical axis 135, between this reference point and said first interface and possibly its coordinates in a plane orthogonal to the optical axis 135.
- the sample 111 is then illuminated with the first light source 120, thereby forming an illuminated region 119 in the sample as described above (step 22).
- a transmission image of the illuminated region 119 is acquired using the imaging assembly 130 (step 23).
- This image is named reference image.
- the focusing plane 133 is located at a known distance D1 from the point of interest 118, this distance being defined along an axis parallel to the optical axis 135.
- the particle of interest 112A is outside plan 133.
- the focusing plane is outside the sample 111.
- the focusing plane is located between 5 ⁇ and 1500 ⁇ above or below (upstream or downstream) of the reference point, preferably between 5 ⁇ and 1000 ⁇ , or even between 5 ⁇ and 800 ⁇ .
- the distance is defined along an axis parallel to the optical axis 135.
- the focusing plane when acquiring the reference image, is located at a distance greater than 2 ⁇ , and preferably greater than 5 ⁇ , preferably in the range [5 ⁇ - 1500 ⁇ ] or [5 ⁇ - 1000 ⁇ ], or [5 ⁇ - 800 ⁇ ] of an interface delimiting the sample 111.
- it has a priori information qua nt the position of a particle. The focus plane is then shifted, relative to this a priori, a value as defined above.
- an example of a priori information is the observation of biological particles adhering to a surface, for example the upper blade 114 delimiting the sample 111.
- the knowledge of the position of the blade allows to establish a priori on the position of the particles, the latter being adherent to the face 117 of this adjacent blade of the sample.
- the reference image is said to be the image of a portion of the illuminated region, since it is formed by light rays from this illuminated region.
- the reference image is in particular a hologram, formed by the interference of light rays originating from the first light source and diffracted by a biological particle of the sample, with light rays coming from the first light source 120 and having passed through. the sample without being diffracted.
- the reference image includes in particular a hologram associated with the particle of interest.
- the calculation means 150 are connected to the sensor 132 to receive the reference image.
- a digital construction of a series of reconstructed images is implemented.
- Each reconstructed image corresponds to a predetermined offset, along the optical axis 135, of the focusing plane relative to the position of the focus plane associated with the reference image.
- each reconstructed image is computed into a reconstruction plane, associated with a predetermined offset from the focus plane. More precisely, each reconstruction plane corresponds to the image, by the optical system, of an object plane offset from the focusing plane of this predetermined offset.
- the offsets extend between two extreme positions vis-à-vis the plane of focus, these two extreme positions flanking the upper interface 117 and, more generally, the point of interest.
- These offsets can be distributed according to a regular step, in particular a step between 0.10 ⁇ and 1 ⁇ , for example 0.25 ⁇ or 0.20 ⁇ .
- the images acquired by the sensor 132 would be digitally reconstructed if the focusing plane was successively at the distances Di 1 , Di 2 ,... Di n , DU, ... Di n of the position of the plane in focus associated with the reference image.
- the reference image is an experimentally acquired image, while the reconstructed images form digital propagation images.
- the difference between the two extreme positions associated with these offsets depends on the sample 111 observed, and in particular on its thickness.
- the two extreme positions are determined so that they are located on either side of the sample 111. from a priori on the position of a particle of interest in the sample, the two extreme positions are established to be arranged on either side of this position.
- the digital reconstruction uses the Fourier transform of the reference image (possibly having undergone a preliminary treatment), to which a propagation operator is applied before returning it to real space.
- the propagation operator is a function of the offset associated with the calculated reconstructed image.
- the propagation operator is for example an integral based on the Rayleigh Sommerfeld equation.
- Wilson et al. describes an example of a digital propagation implemented from the image of a microsphere. Another example of digital propagation is described by Lee et al. in the article “Microscopy Holography of Holographically Trapped Three-dimensional Structures,” 19 February 2007 / Vol. 15, No. 4 / OPTICS EXPRESS 1505-1512.
- the reconstructed images are complex images, that is to say with a real part and an imaginary part. They comprise a set of points, each point of the image being assigned a complex magnitude.
- the computing means 150 of the device 100 according to the invention are adapted to produce, from the reference image, a digital construction of a series of reconstructed images, as described above.
- the distance between the particle of interest 112A and the reference point 118 is then determined from the series of reconstructed images, this distance being defined along an axis parallel to the axis 135 (step 25). As a variant, it is limited, from the series of reconstructed images, to the distance D ref between the particle of interest 112A and the focusing plane 133.
- the distance D re f along the optical axis 135 is calculated between the particle of interest 112A and the focusing plane associated with the reference image. Knowing the distance Di along the optical axis 135 between this plane of focus and the reference point 118, the distance DF between the particle of interest 112A and the reference point 118 is deduced along the optical axis 135.
- each reconstructed image is associated with a value of a useful parameter.
- the useful parameter being a function of a parameter of the complex intensity (or complex amplitude) of the points belonging to the reconstructed images.
- a parameter of the complex intensity (or complex amplitude) of a reconstructed image is for example the imaginary part, the real part, the module or the phase of the reconstructed image.
- these values of the useful parameter are combined in the form of a profile, representing the value of the useful parameter as a function of the offset of each reconstructed image, along the optical axis 135 with respect to the focusing plane 133.
- a remarkable value is sought on this profile, for example a maximum or a point of inflection or a passage through zero.
- This remarkable value is associated with the shift along the optical axis 135 between the particle of interest and the position of the focusing plane 133 associated with the reference image.
- the remarkable value to be searched for is a maximum and generally an extremum, to limit the effect of the uncertainty when passing through a second derivative (detection of a point of inflection), and to overcome a correction of measurement bias (detection of a zero crossing).
- the remarkable value of the useful parameter can also be a zero crossing of the function describing the evolution of this parameter as a function of the offset between the reconstructed image and the focusing plane 133, or a point of inflection of this parameter. function, or any other criteria.
- the distance D ref between the focusing plane 133 of the reference image and a particle of interest 112A is determined by the following succession of steps: - identification, on the reference image, of a hologram associated with said particle of interest,
- the distance D ref between the particle of interest 112A and the focusing plane 133 then being considered equal to this offset.
- the useful parameter may be the square of the imaginary part of the image, determined from the value of the imaginary part of the different points constituting the image.
- the useful parameter then corresponds to the average of the square of the imaginary part of the set of points constituting the image. The inventors found that such a parameter made it possible to obtain good location accuracy.
- the parameter can also include the value of the real part of the points constituting the image or their module, or the square of these different quantities.
- the inventors have shown that it is possible to locate the position, along the optical axis 135, of a particle of interest 112A, this position corresponding to a remarkable value of the useful parameter, and for example:
- a zero crossing for example when we observe the evolution, along the optical axis 135, of the real part of the image or its square.
- the identification of a remarkable value of said parameter of interest makes it possible to conclude that a particle of interest 112A is present in the medium, in the offset range under consideration, the distance between the particle of interest. interest 112A and the focus plane D ref is not necessarily stored.
- Each particle of interest 112A corresponds to a hologram on the reference image. It is then possible to select a region of interest limited to a hologram, and to apply the previously described steps to each region of interest associated with a hologram.
- the calculation means 150 output the distance DF, along the axis 135, between the particle of interest 112A and the reference point 118.
- the use of digital propagation makes it possible to reduce the number of images of the sample to be acquired. In particular, the acquisition of a single image is sufficient.
- the method according to the invention is therefore particularly fast and automatable.
- the particle of interest when the particle of interest is in the plane of focus of the optical system, its image can not be distinguished from the image of the surrounding medium (the surrounding medium corresponding to the sample portion 111 surrounding the particle of interest). This is for example the case when the particle of interest is immersed in a medium of the same transmission coefficient or refractive index neighbor (for example to 20%), in the spectrum of the first light source.
- the method according to the prior art as described in the introduction does not make it possible to determine the position of the particle of interest.
- the method according to the invention makes it possible to determine the position of a particle along an axis parallel to the optical axis of the optical system, even when the particle can not be distinguished from its surroundings on an image acquired when the particle is found in the development plan of the optical system.
- the method according to the invention makes it possible to associate an image and a position of the focusing plane along the optical axis 135, this position being determined with great precision (related to the pitch of the offsets implemented at the step 23). Such precision would not be easily achievable by physical, not virtual, offsets.
- the reference image may comprise the hologram of a single biological particle, which then defines the particle of interest according to the invention.
- the reference image comprises the hologram of several biological particles, one of these holograms is arbitrarily chosen to define the particle of interest according to the invention, and portions of the reconstructed images, or regions, are used. of interest, centered on one of these holograms.
- the background image corresponds for example to the image acquired by moving the sample in a plane parallel to the plane of focus, during the image taking.
- the background image is an average image formed from several static images obtained for several positions of the sample in a plane parallel to the focusing plane.
- the reference image is divided by the background image. This results in a standardized reference image.
- Such normalization improves the results of the method.
- digital propagation is carried out from the reference image used directly, or from the standard reference image as defined above.
- t p (z) TF- 1 ⁇ TF (U 0 ) XH (z) ⁇
- U Q the image used to carry out the digital propagation (here the reference image or the standardized reference image), TF the transformed Fourier operator, TF '1 the inverse Fourier transformed operator, X the multiplication term futures of matrices, and H a propagation operator based on the Rayleigh Sommerfeld integral.
- H (u, v, z) exp [- ⁇ z ⁇ * Im (jp (u, v)) + i * z * Re (p (u, v))] with
- ⁇ p ⁇ u, v) kx A p x (V l - u 2 - v 2 - l), and k - T
- N x and N y the number of pixels along x, y, respectively, in the image
- ⁇ 1 the central wavelength of the first light source.
- the position of the particle of interest along the optical axis of the optical system is then determined from the imaginary part of each reconstructed image U p (z).
- the reconstructed image or a reconstructed image portion whose square of the imaginary part (that is to say the average value of the square of the imaginary part of the different points composing the image) is maximum.
- a reconstructed image portion is a part of a reconstructed image, centered on the image of the particle of interest. If the reference image relates to several biological particles, the same reference image can be used to determine the position of each of these biological particles, each time using reconstructed images centered on a different biological particle.
- FIGS. 3 and 4 A second method and device embodiment 300 according to the invention will now be described with reference to FIGS. 3 and 4.
- Figure 3 will only be described for its differences with respect to Figure 1.
- 120, 150, 151 of FIG. 1 respectively correspond to the reference numerals 311, 320, 312A, 316, 317, 318, 330, 331, 332, 335, 320, 350, 351 of FIG.
- each of the characteristics distinguishing the device according to FIG. 3 from the device according to FIG. 1 may be isolated and combined independently with the device of FIG. 1 to form many other variants of the invention.
- the biological particles adhere directly to a second interface of the sample.
- This second interface is advantageously confused with the first interface as defined above.
- the position of the first interface relative to the second interface is preferably known, along an axis parallel to the optical axis 135. In particular, this position extending along an axis parallel to the optical axis 135 and passing through the landmark 318.
- the second interface is substantially orthogonal to the axis 335. This is in particular the lower or upper interface 316, 317 of the sample.
- the biological particles adhere to the upper interface 317.
- the upper interface is slightly inclined relative to a plane orthogonal to the axis 335, typically an angle less than 0.1 rad, or even 0.05 rad or 0.02 rad.
- the method according to the invention makes it possible to overcome the uncertainty in the positioning of the biological particles along the axis 335, when the upper blade, defining the upper interface of the sample, is inclined relative to a plane orthogonal to the axis 335. More generally, the method according to the invention makes it possible to overcome the uncertainty in the positioning of the biological particles along the axis 335, when the upper blade, defining the upper interface of the sample, is deformed relative to a orthogonal plane to the axis 335.
- This deformation may designate any deformation such that the biological particles adhering to said second interface are located inside a cylinder delimited by two plane surfaces perpendicular to the optical axis 335 and distant from less than 100 ⁇ along this axis, or even less than 50 ⁇ .
- the distance along an axis parallel to the optical axis 335, between the position of the focusing plane associated with the reference image, and the projection of the reference point 318 along this axis and on the second interface is between +5 ⁇ and +1500 ⁇ or between -5 ⁇ and -1500 ⁇ .
- this distance is between + 5 ⁇ and +1000 ⁇ ⁇ - 5 ⁇ and -1000 ⁇ , or even between + 5 ⁇ and +800 ⁇ ⁇ - 5 ⁇ and -800 ⁇ , or even between + 5 ⁇ and +200 ⁇ or - 5 ⁇ and -200 ⁇ .
- Optimal defocusing ranges are thus defined, providing an easier calculation of the distance between the particle of interest and the reference point.
- the biological particles adhere to said second interface and are located in a cylinder of limited height, it is easy to ensure that when acquiring the reference image, the particle of interest is at a distance from the plane of focus in an optimal defocus range.
- the width of the optimal defocusing ranges may depend on the characteristics of the first light source 320, in particular its spatial and temporal coherence.
- the first light source as a function of a distance along the optical axis 335, between several particles of interest that it is desired to study, so that these particles of interest are simultaneously in a range of optimal defocus.
- a white light source can be used, for an optimum defocusing range of + 5 ⁇ ⁇ +200 ⁇ , and from -5 ⁇ to -200 ⁇ . More the spectral width of the first light source is limited, the width of the optimal defocusing range increases.
- the analysis device 300 comprises means for determining the distance, along an axis parallel to the optical axis 335, between the reference point and the position of the system debugging plane. optical associated with the reference image. This distance is named useful distance.
- These means include in particular a laser 360, adapted to illuminate the reference point 318.
- a shutter 361 connected to a translation plate 362 makes it possible to close off the laser output, when it is not desired for the laser beam 363 to illuminate. landmark 318.
- the laser beam 363 is advantageously incident on the reference point, along an axis parallel to the optical axis 335.
- the laser beam 363 and the image sensor 332 are optically coupled to the same optical system 331, so that the focusing point of the laser beam corresponds to the object plane of the sensor, or focusing plane.
- the reference point is on the upper interface 317, which is why the laser beam 363 enters the sample via this upper interface 317.
- the laser beam 363 passes through a first separator blade 371, then is reflected on a second separator blade 371, before reaching the upper interface 317.
- Each separator blade may be a dichroic blade. Alternatively, a cube or a semi-reflective mirror is used.
- the useful distance is determined by implementing the following substeps illustrated in FIG. 4.
- a sub-step 41 the reference point 318 is illuminated with the aid of the laser beam. Then, the distance is adjusted, in particular along an axis parallel to the optical axis 335, between the sample and the optical system 331, so that the sensor 332 receives the image of a spot formed by the specular reflection of the image. laser beam 363 at the cue point (substep 42). This adjustment can be achieved thanks to the translation means 340 described with reference to FIG.
- the definition of the reference point 318 may depend on the arbitrary position of the laser beam 363, in a plane orthogonal to the optical axis 335.
- This adjustment implements a registration of the specular reflection of the laser beam 363 on the surface receiving the reference point.
- An example of such an adjustment is shown in FIGS. 5A-5C, the reference point being located on the upper interface 317.
- the image 5A corresponds to a position of the focusing plane 533 above the upper interface 317.
- the image obtained on the sensor is a wide and dim spot.
- the image 5B corresponds to a position of the focusing plane on the upper interface 317.
- the image obtained on the sensor is a narrow and very bright spot.
- the image 5C corresponds to a position of the plane of focus below the upper interface 317.
- the image obtained on the sensor is a wide spot and poor light.
- the analysis of the evolution of the light intensity of the specular reflection signal of the laser beam, as a function of the relative spacing between the optical system 331 and the sample 311 makes it possible to determine the position of the point of interest 318, the latter corresponding, in this example, to the focal point of the laser beam with a surface capable of reflecting the beam, in this case the face 317 or the face 315.
- the image of the most intense specular reflection and the image of the specular reflection having a secondary maximum of intensity correspond to the configurations in which the object plane passes through the intersection of the laser beam and respectively, the face of the upper blade 314 opposite the sample, and the face of the upper blade 314 adjacent to the sample.
- the method may comprise a sub-step 43, consisting in moving the support receiving the sample relative to the imaging means by a known distance and along the optical axis 335.
- This substep may be useful for placing a particle of interest in an optimal defocusing range as defined above.
- FIG. 3 shows the laser beam 364 reflected on the upper interface 317, and imaged on the sensor by the optical system 331. The reflected laser beam 364 is reflected on the second separator plate 372, then on the first separator plate 371 .
- the computing means 351 receive as input an image acquired by the sensor 351, when the shutter 361 is open, and the first light source 320 is off. They control the translation means 340 to implement the substep 42, and if necessary the substep 43.
- the method according to the invention also comprises a determination, from the series of reconstructed images, of the position of the particle of interest in a plane orthogonal to the optical axis of the optical system.
- a determination from the series of reconstructed images, of the position of the particle of interest in a plane orthogonal to the optical axis of the optical system.
- the translation means 340 may implement a translation along two axes together defining a plane orthogonal to the optical axis 335. It is thus possible to locate successively several particles of interest of the same sample. After a single step of determining a landmark, the following series of steps are implemented several times as described above:
- FIG. 3 also makes it possible to illustrate an additional analysis step implemented in a method and a device according to the invention.
- the device 300 includes means for positioning the waist of the laser beam 363 (or neck, i.e., location of the narrowest diameter laser beam) on the particle of interest.
- the radiation emitted by the particle of interest is collected by the optical system 331 and received by a spectrometer 380 which analyzes this radiation.
- the spectrometer 380 is for example a spectrometer analyzing the Raman scattering or a fluorescence spectrometer. In this type of analysis, it is preferable that the excitation laser beam is centered on the examined particle. This avoids disturbance of the Raman scattering spectrum by the vicinity of the particle.
- the positioning of the waist of the laser beam 363 is implemented by means of translation means such as a translation plate (not shown), adapted to move the sample relative to the imaging means 331.
- translation means such as a translation plate (not shown), adapted to move the sample relative to the imaging means 331.
- These translation means can be formed by the translation means 340.
- the translation means are controlled by the calculation means 350.
- the calculation means 350 use the position of the particle of interest relative to the reference point to position the system debugging plane. 331 optics on the particle of interest.
- the imaging means are moved relative to the particle of interest to focus an analysis laser beam in a plane orthogonal to the optical axis of the imaging means, this plane receiving said particle of interest, and the waist of the analysis laser beam is moved in this plane so as to place it exactly on the particle of interest.
- a laser source separate from the laser 360 can be used to analyze the particle of interest.
- a photodetector 332, optically coupled to the optical system 331, may be used, for example to collect a fluorescence signal emitted by the particle of interest 112A in response to an excitation signal.
- the knowledge of one of the previously mentioned distances allows the focusing of the optical system on the particle, optimizing the collection of the fluorescence signal by the photodetector 332.
- a medium has a plurality of particles of interest.
- the distance Dref or DF corresponding to each particle of interest 112A of the sample is determined and stored.
- the relative positioning of the optical system 331 is adjusted so that the focusing plane of this optical system comprises the particle of interest. This adjustment is made, successively, for each particle of interest, so as to optimize the analysis.
- FIG. 6 illustrates an example of a reference image according to the invention.
- the abscissa and ordinate axes are graduated in pixels.
- FIG. 7 a detailed example of the steps used to determine, from a first series of reconstructed images, the distance between the particle of interest and the reference point, according to FIG. an axis parallel to the optical axis of the optical system.
- H (u, v, z) exp [- ⁇ z ⁇ * Im (j> (u, v)) + i * z * Re (p (u, v))]
- Each useful reconstructed image corresponds to the same matrix of pixels. Depending on the useful reconstructed image, the intensity associated with each pixel varies.
- An image of the gradients 720 corresponding to the difference between the image of the maxima and the image of the minima is then calculated.
- This step can be carried out using a first matrix, one dimension of which corresponds to the pixels, and the other dimension corresponds to the shift of the focusing plane associated with the useful reconstructed image.
- This offset is measured along the optical axis of the optical system, named axis (Oz) in the following.
- the first matrix has XY columns and N rows.
- the image of the minima then corresponds to a second matrix XY columns and 1 line.
- the image of maxima corresponds to a third matrix XY columns and 1 line.
- the image of the gradients corresponds to a fourth matrix XY columns and 1 line, equal to the difference between the third and the second matrices.
- Pixels with a strong intensity gradient along the axis (Oz) are selected.
- An average gradient associated with these pixels is defined.
- the position of the highest values of this average gradient roughly defines the position of the biological particles along the axis (Oz).
- the columns with the highest values can be selected in the fourth matrix.
- Figure 730 illustrates the fifth matrix in the form of a profile in which the x-axis is an offset along the axis (Oz), and the y-axis is the corresponding value in the fifth matrix.
- Sub-step 73 defines an average position along the axis (Oz) of several biological particles imaged on the reference image. This average position defines an approximate position of a particle of interest according to the invention, assuming that the biological particles are located substantially in the same plane orthogonal to the axis (Oz).
- a gradient is used along the axis (Oz) associated with a selection of pixels each having a strong gradient along this axis.
- the maximum of the gradient associated with this selection is therefore all the easier to spot.
- One of the images of the first series of useful reconstructed images is selected, that associated with the position along the axis (Oz), calculated in the substep 73.
- a thresholding is performed to obtain a binary image 740.
- the coordinates of the binary objects highlighted by the thresholding are recorded.
- An approximate position of each biological particle is thus calculated in a plane orthogonal to the axis (Oz).
- This step may comprise a step of interpolating each binary object by an ellipse, in order to further calculate an approximate geometrical shape of each binary object, and therefore of each biological particle.
- the particle of interest is arbitrarily chosen by arbitrarily choosing one of the binary objects.
- An approximate position of the particle of interest has therefore been determined in a plane orthogonal to the axis (Oz).
- a region of interest comprising this single binary object is defined on the binary image 740.
- the region of interest is defined by pixel positions.
- the region of interest is for example a square of 16 * 16 pixels.
- This step is implemented from the first series of useful reconstructed images, by selecting in each useful reconstructed image a region corresponding to the region of interest as defined above.
- this step is implemented from a second series of useful reconstructed images.
- Each image of the second series of useful reconstructed images is formed by the square of the imaginary part of an image of a second series of reconstructed images.
- the second series of reconstructed images is associated with a sampling step along the axis (Oz), less than the sampling interval of the first series of reconstructed images.
- Each image of the second series of reconstructed images corresponds to the region of interest as defined above.
- the amplitude of the sampling range along the axis (Oz) associated with the second series of reconstructed images is less than the amplitude of the sampling range associated with the first series of reconstructed images.
- the second set of reconstructed images can be calculated only for finding a precise position of the particle of interest.
- Sub-steps 72 and 73 are implemented on the second set of reconstructed useful images to calculate a precise position of the particle of interest along the axis (Oz).
- Figure 750 corresponds to Figure 730, replacing the first set of reconstructed useful images with the second set of useful reconstructed images.
- a precise position of the particle of interest is calculated in a plane orthogonal to the axis (Oz). For this, we select from the images of the second series of useful reconstructed images, that associated with the precise position of the particle of interest along the axis (Oz).
- a thresholding is performed to obtain a new binary image. Then, we find the coordinates of the center of the binary object highlighted by the thresholding.
- a useful reconstructed image is then defined as being the squared module of the corresponding reconstructed image.
- Each useful reconstructed image is then defined as the squared module of the corresponding reconstructed image.
- An image of the gradients is then formed as defined above, and the approximate positions of the biological particles are deduced, by thresholding, in a plane orthogonal to the axis (Oz).
- the image obtained here by thresholding is named the first thresholded image.
- the approximate position of the particle of interest is defined in a plane orthogonal to the axis (Oz).
- first binary object associated with a biological particle.
- a first region of interest receiving this single binary object is defined.
- a region corresponding to this first region of interest is selected in each useful reconstructed image.
- the position is sought along the axis (Oz) of the image having a maximum value of standard deviation. This position defines an approximate position of the particle of interest along the axis (Oz), assuming that all the biological particles are located substantially in the same plane orthogonal to the axis (Oz).
- the particle of interest is defined by arbitrarily choosing a second binary object. By searching for the center of this second binary object, we deduce the precise position of the particle of interest, in a plane orthogonal to the axis (Oz).
- the distance along this axis is calculated between the particle of interest and the focusing plane associated with the axis. reference image.
- the calculation makes it possible to determine the absolute value of the distance, along an axis parallel to the axis 135, between the particle of interest and the focusing plane associated with the reference image. Then we choose one or the other sign knowing the experimental setup.
- a series of secondary images is determined, each secondary image being formed by the real part of a corresponding reconstructed image; in the same way as in the sub-step 72 illustrated in FIG. 7, the series of secondary images (three-dimensional matrix) is transformed into a two-dimensional matrix, one dimension corresponding to the pixels, and the other dimension corresponds to an offset along the axis (Oz).
- the pixels having a strong intensity gradient along the axis (Oz) are selected.
- An average gradient associated with these pixels is thus defined. It is this gradient which is illustrated in FIG. 8.
- the abscissa axis is an offset along the axis (Oz), in particular a shift of the focusing plane relative to the position of the focusing plane associated with the reference image.
- the y-axis refers to the real part of the secondary images.
- the sign of the distance along an axis parallel to the axis 135 is determined between the particle of interest and the focusing plane associated with the reference image:
- the reference image is below the focusing plane (in the direction of propagation of the light).
- the digital construction step of a series of reconstructed images may implement other propagation operators than those exemplified.
- the series of reconstructed images may also be exploited in different ways, to deduce the distance between the focus plane associated with the reference image, and the particle of interest.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Pathology (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Dispersion Chemistry (AREA)
- Computing Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Geometry (AREA)
- Computer Graphics (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1460947A FR3028616A1 (fr) | 2014-11-13 | 2014-11-13 | Procede d'analyse comprenant la determination d'une position d'une particule biologique. |
PCT/EP2015/076530 WO2016075279A1 (fr) | 2014-11-13 | 2015-11-13 | Procede d'analyse comprenant la determination holographique d'une position d'une particule biologique |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3218769A1 true EP3218769A1 (fr) | 2017-09-20 |
EP3218769B1 EP3218769B1 (fr) | 2019-03-20 |
Family
ID=52423893
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15801133.8A Active EP3218769B1 (fr) | 2014-11-13 | 2015-11-13 | Procede d'analyse comprenant la determination holographique d'une position d'une particule biologique. |
Country Status (6)
Country | Link |
---|---|
US (1) | US10255688B2 (fr) |
EP (1) | EP3218769B1 (fr) |
JP (1) | JP6649379B2 (fr) |
CN (1) | CN107003229B (fr) |
FR (1) | FR3028616A1 (fr) |
WO (1) | WO2016075279A1 (fr) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10401793B2 (en) * | 2010-06-17 | 2019-09-03 | Purdue Research Foundation | Digital holographic method of measuring cellular activity and measuring apparatus with improved stability |
FR3044415B1 (fr) * | 2015-11-27 | 2017-12-01 | Biomerieux Sa | Procede de determination de la reaction d'un microorganisme a son exposition a un antibiotique |
WO2017130613A1 (fr) * | 2016-01-27 | 2017-08-03 | 株式会社 日立ハイテクノロジーズ | Dispositif d'observation |
FR3049348B1 (fr) * | 2016-03-23 | 2023-08-11 | Commissariat Energie Atomique | Procede de caracterisation d’une particule dans un echantillon |
EP3252455A1 (fr) * | 2016-05-30 | 2017-12-06 | Biomérieux | Dispositif et procede d'acquisition d'une particule presente dans un echantillon |
FR3075370B1 (fr) | 2017-12-15 | 2021-03-05 | Biomerieux Sa | Procede de calibration d'un dispositif d'analyse et dispositif associe |
JP7054343B2 (ja) * | 2017-12-26 | 2022-04-13 | 川崎重工業株式会社 | 分注装置及び分注方法 |
US10895843B2 (en) * | 2018-03-02 | 2021-01-19 | Regents Of The University Of Minnesota | System, devices, and methods for digital holography |
EP3575773A1 (fr) * | 2018-05-28 | 2019-12-04 | Universität für Bodenkultur Wien | Procédé permettant de déterminer une distribution de particules tridimensionnelles dans un milieu |
CN110044898A (zh) * | 2019-03-29 | 2019-07-23 | 江苏大学 | 一种基于反射增强衍射的全息病害孢子检测装置与方法 |
CN113495470A (zh) * | 2020-03-18 | 2021-10-12 | 中央大学 | 使用全像光学元件的无透镜数字全像取像系统 |
EP3922979B1 (fr) * | 2020-06-08 | 2023-06-07 | Universität für Bodenkultur Wien | Procédé de détermination d'une longueur focale d'une particule dans un milieu |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8331019B2 (en) * | 2007-01-26 | 2012-12-11 | New York University | Holographic microscopy of holographically trapped three-dimensional nanorod structures |
EP2329324B1 (fr) * | 2008-10-03 | 2014-01-29 | Universite Libre De Bruxelles | Procédé pour étudier des objets nanométriques utilisant la microscopie holographique |
FR2958298B1 (fr) * | 2010-04-06 | 2014-10-17 | Commissariat Energie Atomique | Procede de detection d'amas de particules biologiques |
US10921255B2 (en) * | 2014-12-09 | 2021-02-16 | Bioaxial Sas | Optical measuring device and process |
FR3030749B1 (fr) * | 2014-12-19 | 2020-01-03 | Commissariat A L'energie Atomique Et Aux Energies Alternatives | Methode d'identification de particules biologiques par piles d'images holographiques defocalisees |
FR3031180A1 (fr) * | 2014-12-30 | 2016-07-01 | Commissariat Energie Atomique | Methode et dispositf de controle de la position d'une particule transparente par pile d'images holographiques |
US10690898B2 (en) * | 2016-09-15 | 2020-06-23 | Molecular Devices (Austria) GmbH | Light-field microscope with selective-plane illumination |
-
2014
- 2014-11-13 FR FR1460947A patent/FR3028616A1/fr active Pending
-
2015
- 2015-11-13 WO PCT/EP2015/076530 patent/WO2016075279A1/fr active Application Filing
- 2015-11-13 JP JP2017525989A patent/JP6649379B2/ja active Active
- 2015-11-13 CN CN201580067724.0A patent/CN107003229B/zh active Active
- 2015-11-13 EP EP15801133.8A patent/EP3218769B1/fr active Active
- 2015-11-13 US US15/526,092 patent/US10255688B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
JP6649379B2 (ja) | 2020-02-19 |
US10255688B2 (en) | 2019-04-09 |
WO2016075279A1 (fr) | 2016-05-19 |
EP3218769B1 (fr) | 2019-03-20 |
CN107003229B (zh) | 2020-02-18 |
JP2018502283A (ja) | 2018-01-25 |
CN107003229A (zh) | 2017-08-01 |
FR3028616A1 (fr) | 2016-05-20 |
US20170309036A1 (en) | 2017-10-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3218769B1 (fr) | Procede d'analyse comprenant la determination holographique d'une position d'une particule biologique. | |
EP3274689B1 (fr) | Procédé et dispositif d'analyse de particules | |
EP3234550B1 (fr) | Méthode d'identification de particules biologiques par piles d'images holographiques défocalisées | |
EP3274694B1 (fr) | Procédé de détermination de l'état d'une cellule | |
EP3241014B1 (fr) | Système d'analyse d'un échantillon transparent avec contrôle de position, et procédé associé | |
EP3465153B1 (fr) | Dispositif et procede d'acquisition d'une particule presente dans un echantillon | |
FR3049348A1 (fr) | Procede de caracterisation d’une particule dans un echantillon | |
EP3519899B1 (fr) | Dispositif d'observation d'un échantillon et procédé d'observation d'un échantillon | |
EP3559631B1 (fr) | Procédé de numération de particules dans un échantillon par imagerie sans lentille | |
EP3637194B1 (fr) | Procédé de détermination de paramètres d'une particule | |
EP3584560A1 (fr) | Procédé d'observation d'un échantillon par imagerie sans lentille, avec prise en compte d'une dispersion spatiale dans l'échantillon | |
EP3397944B1 (fr) | Dispositif et procédé d'observation bimodale d'un objet | |
WO2018060589A1 (fr) | Procédé de numération de leucocytes dans un échantillon | |
WO2021260321A1 (fr) | Procédé de mise au point pour système d'imagerie holographique | |
EP3724725B1 (fr) | Procede de calibration d'un dispositif d'analyse et dispositif associe | |
EP3462381A1 (fr) | Procédé de détection de microorganismes dans un échantillon | |
FR3081552A1 (fr) | Dispositif et procede d'observation d'un echantillon fluorescent par imagerie defocalisee | |
EP3545362B1 (fr) | Procédé de formation d'une image de haute résolution par imagerie sans lentille | |
WO2019243725A1 (fr) | Procede et dispositif de comptage de thrombocytes dans un echantillon | |
EP4307051A1 (fr) | Procede et systeme de caracterisation de microorganismes par microscopie holographique numerique | |
FR3085474A1 (fr) | Methode de mesure de la rugosite de ligne d'un reseau de lignes par diffraction de rayons x |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20170517 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602015026856 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G03H0001080000 Ipc: G03H0001040000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G03H 1/04 20060101AFI20180911BHEP |
|
INTG | Intention to grant announced |
Effective date: 20181010 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015026856 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1111155 Country of ref document: AT Kind code of ref document: T Effective date: 20190415 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20190320 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190620 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190621 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190620 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1111155 Country of ref document: AT Kind code of ref document: T Effective date: 20190320 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190720 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190720 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015026856 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
26N | No opposition filed |
Effective date: 20200102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191113 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191130 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191130 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20191130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20151113 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190320 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20231123 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20231120 Year of fee payment: 9 Ref country code: DE Payment date: 20231120 Year of fee payment: 9 |