EP3899669A1 - Procédé de caractérisation d'une particule à partir d'un hologramme - Google Patents
Procédé de caractérisation d'une particule à partir d'un hologrammeInfo
- Publication number
- EP3899669A1 EP3899669A1 EP19842872.4A EP19842872A EP3899669A1 EP 3899669 A1 EP3899669 A1 EP 3899669A1 EP 19842872 A EP19842872 A EP 19842872A EP 3899669 A1 EP3899669 A1 EP 3899669A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- sample
- particle
- interest
- diffraction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0866—Digital holographic imaging, i.e. synthesizing holobjects from holograms
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1468—Optical investigation techniques, e.g. flow cytometry with spatial resolution of the texture or inner structure of the particle
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N2015/1006—Investigating individual particles for cytology
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
- G01N2015/144—Imaging characterised by its optical setup
- G01N2015/1445—Three-dimensional imaging, imaging in different image planes, e.g. under different angles or at different depths, e.g. by a relative motion of sample and detector, for instance by tomography
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
- G01N2015/1447—Spatial selection
- G01N2015/145—Spatial selection by pattern of light, e.g. fringe pattern
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
- G01N2015/1454—Optical arrangements using phase shift or interference, e.g. for improving contrast
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
- G03H2001/0033—Adaptation of holography to specific applications in hologrammetry for measuring or analysing
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
- G03H2001/0447—In-line recording arrangement
Definitions
- the technical field of the invention is the characterization of particles, for example biological particles, from an image.
- the image of the sample can be acquired according to an imaging configuration without a lens, no image forming optics being disposed between the sample and the image sensor.
- each particle produces a diffraction pattern, the latter representing a signature of the particle.
- the document WO2008090330 describes such a configuration, when the source used is a light-emitting diode. In this document, it is shown that this imaging modality confers a high field of observation, and allows rapid identification of cells or bacteria using a simple device.
- Document US7465560 describes a device making it possible to identify bacterial colonies as a function of a diffraction pattern formed on an image sensor.
- the bacterial colony examined is illuminated using a laser beam.
- This document shows that a diffraction pattern constitutes a signature of a bacterial colony.
- a diffraction pattern can be classified, for example by using a decomposition according to Zernike polynomials. This is for example described in US8787633 or in WO2014184390.
- the image acquired by the image sensor can be the subject of a reconstruction, called holographic reconstruction, making it possible to obtain a sharper image of the particles.
- holographic reconstruction makes it possible to obtain a sharper image of the particles.
- sophisticated algorithms of holographic propagation making it possible to obtain a so-called reconstructed image of the sample, are described in WO2016189257 or in WO2017162985.
- a difficulty may arise when the sample contains a high concentration of particles. Indeed, on the image acquired by the image sensor, the diffraction figures corresponding respectively to each particle, can be superimposed. As a result, a characterization of the particles, from their respective diffraction figures, becomes more difficult to implement.
- the inventors have sought to improve the methods described above, by allowing a characterization of particles from the diffraction patterns associated with each of them.
- the method is particularly suitable for a sample in which, due to the density of the particles, the diffraction patterns associated with each of them overlap.
- a first object of the invention is a method for characterizing a particle present in a sample, the sample lying between an image sensor and a light source, the image sensor extending along a plane of detection, the method comprising the following steps:
- step f application of a propagation operator to the extracted complex image formed during step e), so as to obtain, in a propagation plane, an elementary diffraction pattern of the particle selected during step c ), so that the elementary diffraction pattern obtained is isolated from elementary diffraction patterns of other particles present in the sample;
- the elementary diffraction pattern can take the form of a complex image.
- the propagation plane can be the detection plane. However, it may also be a plane located at a distance from the sample less than or greater than the distance between the sample and the detection plane. According to one embodiment,
- step c) comprises, at each iteration, an application of a holographic propagation operator to an image of the exposure light wave, in the detection plane, so as to obtain a complex expression of the light wave exposure, in at least one plane along which the sample extends, forming the complex image;
- Step d) comprises, from the reconstructed complex image, obtaining an observation image, the particle of interest being selected on the observation image.
- Step f) can include the application of a holographic propagation operator to the region of interest selected during step e), so as to obtain the elementary diffraction figure, corresponding to the particle of interest, in the propagation plane, the part of the reconstructed complex image located outside the region of interest not being propagated.
- the method can include an estimate of a distance between the particle of interest and the detection plane, so that during step f), the propagation operator takes into account the distance thus estimated.
- step f) the propagation is carried out by considering a predetermined propagation distance.
- a complex elementary diffraction figure is obtained, in the reconstruction plane, of the particle selected during step c).
- the characterization is then carried out from the phase or module of the complex elementary diffraction figure, or from its real part or from its imaginary part.
- Step g) may include the determination of an axial profile, representing a radial average of the elementary diffraction pattern.
- Step g) can include:
- step f a comparison of the elementary diffraction figure, obtained during step f), with at least one diffraction figure modeled by considering a particle whose refractive index and / or size are known;
- step f taking into account diffraction figures obtained using known particles, or modeled diffraction figures, during a phase d 'learning.
- step g) comprises a decomposition of the elementary diffraction figure, according to a base of Zernike polynomials, so as to obtain coordinates of the elementary diffraction figure in the base;
- the characterization of the particle of interest is carried out as a function of the coordinates of the elementary detection figure.
- the characterization can be carried out as a function of modeled diffraction figures, for each diffraction figure corresponding to a particle of which a parameter is known, the parameter being a size and / or a refractive index, the characterization aiming to determine a value of the parameter for the particle of interest analyzed.
- the modeling can notably be based on an assumption according to which the particle is spherical.
- the method can include an iterative adjustment of the parameter of the particle, each iteration comprising:
- a set of parameters is taken into account, the set of parameters comprising a distance between the particle and the detection plane.
- a second object of the invention is a device for observing a sample, the sample comprising particles, the device comprising:
- a light source configured to illuminate the sample
- a sample holder configured to receive the sample
- an image sensor arranged such that when the sample is placed on the support, it extends between the image sensor and the light source, the image sensor being configured to acquire an image of the 'sample;
- a processor configured to implement steps c) to f) or c) to g) of a method according to the first object of the invention, from an image acquired by the image sensor.
- no image forming optics are disposed between the image sensor and the processor.
- the device comprises an optical system extending between the sample and the image sensor, the optical system defining an image plane and an object plane, the device comprising means for adjusting the optical system, or the sample, or the image sensor, so that:
- the detection plane is offset from the image plane
- Figure 1 shows a first device for implementing the invention.
- FIG. 2 shows the main steps of a method implementing the invention
- FIG. 3A is an example of an image acquired by the sensor.
- FIG. 3B is an image of the module of a complex image reconstructed, in a plane along which the sample extends, from the image acquired by the sensor.
- FIG. 3C is an image of the phase of a complex image reconstructed, in a plane along which the sample extends, from the image acquired by the sensor.
- Figure 3D is an image of the module of a complex image extracted from a region of interest, corresponding to a particle of interest, of the reconstructed complex image.
- FIG. 3E is an image of the phase of a complex image extracted from a region of interest, corresponding to a particle of interest, of the reconstructed complex image.
- FIG. 3F shows an image of the module of a diffraction figure propagated from the extracted complex image.
- Figure 4 shows an example of a radial mean representative of the modulus of a diffraction pattern.
- FIG. 5A illustrates the results of tests carried out on a sample comprising blood particles.
- FIG. 5B illustrates the results of tests carried out on a sample comprising blood particles.
- FIG. 5C illustrates the results of tests carried out on a sample comprising blood particles.
- FIG. 5D illustrates the results of tests carried out on a sample comprising blood particles.
- Figure 6 shows another device for implementing the invention.
- FIG. 1 represents an example of a device according to the invention.
- a light source 11 is configured to emit a light wave 12, known as an incident light wave, propagating in the direction of a sample 10, along an axis of propagation Z.
- the light wave is emitted according to a spectral band of illumination Dl.
- Sample 10 is a sample that we wish to characterize. It includes in particular a 10m medium in which 10 p particles are immersed.
- the medium 10m can be a liquid medium. It can include a body fluid, obtained for example from blood or urine or lymph or cerebrospinal fluid. It can also be a culture medium, comprising nutrients allowing the development of microorganisms or cells.
- particle is meant in particular, and in a non-exhaustive manner:
- a cell whether it is a culture cell or a body cell, for example a blood cell;
- a microorganism for example a bacterium or a yeast or a microalga
- a solid particle for example a microbead, the microbead being able to be functionalized, so as to promote grafting with an analyte
- a particle forming an emulsion in the 10m medium in particular a particle insoluble in the 10m medium, an example being a lipid droplet in an aqueous medium.
- a 10 p particle can be solid or liquid.
- the invention relates more particularly to particles whose size is less than 1 mm, or even 100 ⁇ m, even 50 ⁇ m.
- particle size is meant a diameter or a diagonal.
- a determine the nature of a particle that is to say classify this particle among one or more predetermined classes
- an optical property of one or more particles for example the refractive index or an optical transmission property, or an optical thickness (product of the thickness by the refractive index);
- the method can also include a count of particles according to their characterization.
- the sample 10 is, in this example, contained in a fluid chamber 15.
- the fluid chamber 15 is for example a fluid chamber of the Countess or Cellvision, Gene type.
- Frame ® of thickness e 100 pm.
- the thickness e of the sample 10, along the propagation axis typically varies between 10 ⁇ m and 1 cm, and is preferably between 20 ⁇ m and 500 ⁇ m.
- the sample extends along a plane Pi 0 , called the plane of the sample, perpendicular to the axis of propagation Z.
- the plane of the sample is defined by the axes X and Y represented in FIG. 1.
- the sample is maintained on a support 10s at a distance d from an image sensor 16.
- the concentration of particles can vary between 50 per microliter and 100,000 per microliter.
- the distance D between the light source 11 and the fluid chamber 15 is preferably greater than 1 cm. It is preferably between 2 and 30 cm.
- the light source 11, seen by the sample is considered to be punctual. This means that its diameter (or its diagonal) is preferably less than a tenth, better a hundredth of the distance between the fluid chamber 15 and the light source.
- the light source is a light emitting diode. It is generally associated with diaphragm 18, or spatial filter.
- the aperture of the diaphragm is typically between 5 pm and 1 mm, preferably between 50 pm and 500 pm.
- the diaphragm is supplied by Thorla bs under the reference P150S and its diameter is 150 ⁇ m.
- the diaphragm can be replaced by an optical fiber, a first end of which is placed opposite the light source 11 and a second end of which is placed opposite the sample 10.
- the device represented in FIG. 1 also includes a diffuser 17 , disposed between the light source 11 and the diaphragm 18.
- the function of such a diffuser is to distribute the light beam produced by an elementary light source 11 according to a cone of angle a.
- the use of such a diffuser is described in WO2016078946.
- the angle of diffusion a varies between 10 ° and 80 °.
- the light source can be a laser source, such as a laser diode. In this case, it is not useful to associate a spatial filter or a diffuser.
- the light source is a laser source, it is advantageously used as described in application WO2017109428.
- the emission spectral band D1 of the incident light wave 12 has a width less than 100 nm, or even less than 50 nm.
- spectral bandwidth is meant a width at half height of said spectral band.
- the sample 10 is placed between the light source 11 and the image sensor 16 previously mentioned.
- the image sensor 16 defines a detection plane Po, preferably extending parallel to, or substantially parallel to the plane Pio along which extends the sample.
- substantially parallel means that the two elements may not be strictly parallel, an angular tolerance of a few degrees, less than 20 ° or 10 ° being allowed.
- the image sensor 16 is able to form an image lo of the sample 10 according to the detection plane Po.
- it is an image sensor 16 comprising a matrix of pixels, of CCD or CMOS type.
- the detection plane Po preferably extends perpendicularly to the axis of propagation Z of the incident light wave 12.
- the distance d between the sample 10 and the pixel matrix of the image sensor 16 is preferably between 50 pm and 2 cm, preferably between 100 pm and 2 mm.
- the particles 10 p present in the sample can generate a diffracted wave 13, capable of producing, at the level of the detection plane. Po, interference, in particular with a part 12 ′ of the incident light wave 12 transmitted by the sample. Furthermore, the sample can absorb part of the incident light wave 12.
- the light wave 14, transmitted by the sample, and to which the image sensor 16 is exposed designated by the term "wave exposure ", may include:
- each interference pattern can be associated with a particle 10 p of the sample.
- the processor is a microprocessor connected to a programmable memory 22 in which is stored a sequence of instructions for perform the image processing and calculation operations described in this description.
- the processor can be coupled to a screen 24 allowing the display of images acquired by the image sensor 16 or calculated by the processor 20.
- each interference figure can be used to characterize the particle with which it is associated. This is described in documents US8787633 or WO2014184390 cited in the prior art. However, when the quantity of particles present in the sample is large, the interference figures overlap, which no longer allows correct characterization by implementing the methods of the prior art.
- CMOS IDS UI-1924LE sensor comprising 3840 by 2748 pixels, the size of each pixel being 1.67 pm x 1.67 pm, providing a useful detection area of approximately 30 mm 2 ;
- distance between the sample and the image sensor between 1 mm and 1.5 mm.
- Step 100 acquisition of the image I 0 by the image sensor.
- Image I 0 comprises different elementary diffraction figures superimposed on each other.
- FIG. 3A represents such an image.
- the methods of characterizing diffraction patterns presented in the documents of the prior art are not applicable, because of the too high density of the particles in the sample.
- Step 110 reconstruction of a complex image A 10 in the plane of the sample. From the image I 0 obtained during step 100, a holographic reconstruction algorithm is used to obtain a complex image A 10 , preferably in a reconstruction plane Pi 0 , along which the sample extends.
- the complex image A 10 corresponds to a complex expression of the exposure light wave 14 in the reconstruction plane considered.
- This step can in particular to implement an iterative algorithm as described in WO2017162985, and more precisely in steps 110 to 150 described in this application.
- the acquired image, or of an image resulting from a previous iteration is propagated in the reconstruction plane, in this case the plane of the sample, at each iteration.
- a complex image propagated in the plane of the sample is thus obtained.
- a noise level in the reconstructed complex image is then determined, then a complex image is adjusted in the plane of the sample, making it possible to reduce the noise level in the complex image propagated in the plane of the sample.
- the adjustment is carried out by minimizing a criterion quantifying a level of noise in the complex image propagated in the plane of the sample.
- the adjustment notably consists in adjusting the phase of the exposure light wave, in the plane of the sample.
- the complex image estimated in the detection plane, during each iteration is used, during the next iteration, by being propagated in the plane of the sample. The inventors have observed that the implementation of such an iterative algorithm leads to particularly efficient results.
- an iterative algorithm can be implemented as described in WO2016189257. Such an algorithm assumes that an image of the sample is formed in several spectral bands.
- the phase of the exposure light wave 14 is gradually adjusted in the detection plane.
- the adjustment of the phase is carried out by iterations by averaging, during each iteration, the phase of light waves reconstructed in the plane of the sample, according to different spectral bands.
- the adjustment of the phase is carried out by iteration so as to minimize, during each iteration, the noise of reconstruction of a complex image reconstructed in the plane of the sample.
- observation image I 10 is an image making it possible to visually represent the complex reconstructed image A 10. It may be:
- I 10 Im (A 10 ), Im designating the operator imaginary part;
- an observation image is an image formed of scalar quantities obtained from a complex image, the latter being formed of complex quantities.
- FIGS. 3B and 3C respectively represent an observation image I 10 corresponding to the module or to the phase of a part of a complex image A 10 reconstructed, in the plane of the sample, from the hologram represented on Figure 3A.
- the observation image I 10 of FIG. 3B obtained by the module of the reconstructed complex image, makes it possible to separate each particle from one another. It makes it possible to select a particle of interest 10 p, i which one wishes to characterize.
- Step 120 selection of a region of interest ROI, ⁇ , corresponding to the particle of interest 10 pi .
- observation image I 10 is obtained from a complex image A 10 reconstructed in a reconstruction plane Pi 0 passing through the sample 10.
- the spatial resolution of the image of observation I 10 allows an easy separation of the particles 10 p between them.
- a user can select a particle.
- the selection can also be made by a microprocessor, by applying an image segmentation algorithm, so as to isolate regions of interest from the background of the image.
- the segmentation can be carried out by thresholding, for example an Otsu thresholding or a Bradley thresholding.
- the region of interest ROh then corresponds to a particle, or to a group of particles close to each other, forming the same trace on the complex reconstructed image, the latter case corresponding in particular to the formation of a bacterial colony.
- step 120 there is a region of interest ROh of the observation image / 10 , which corresponds to a particle of interest 10 p, i which one wishes to characterize.
- the region of interest ROh can also be applied to the complex reconstructed image A 10 , so as to extract from this image only the region of interest corresponding to the particle of interest 10 pi .
- the region of interest ROI is centered on the particle of interest 10 pi , or on the group of particles considered.
- Step 130 Extraction of a part of the complex image located in the region of interest ROI, selected during step 120, so as to obtain a complex image extracted A 10 i .
- the part of the image thus extracted forms a thumbnail.
- Figures 3D and 3E respectively show the mod mod (A 10 i ) and the arg phase (A 10 i ) of the extracted complex image Zl 10 i .
- the extracted complex image includes the region of interest ROh of the complex reconstructed image Aw.
- the pixels arranged around the region of interest are representative of an average background level obtained in the reconstructed complex image A 10 .
- the pixels of the extracted complex image A 10 i arranged around the region of interest ROI can be fixed at an arbitrary value, for example a gray level equal to 1.
- the propagation plan can in particular be the detection plan, which is considered below. However, this is not necessary.
- the propagation plane, in which the extracted complex image is propagated can be different from the detection plane.
- the region of interest ROh is extracted from a complex image A 10 obtained according to a holographic reconstruction algorithm comprising a gradual adjustment of the phase of the exposure light wave. It can therefore be assumed that in the region of interest extracted, the value of the phase is correctly estimated. Also, the exposure light wave 14 is correctly described in the region of interest extracted ROh.
- the region of interest ROh can then be propagated by simply using a holographic propagation operator h, known in the field of holography, for example a Fresnel operator, such as:
- z represents a coordinate along the propagation axis Z.
- the propagation can comprise a convolution of the complex image extracted, comprising the region of interest ROI ,, by the propagation operator h, so that:
- a 0 is the elementary diffraction figure obtained in the detection plane Po;
- a 10 i is the complex image extracted, comprising the region of interest ROh, from the reconstructed complex image A 10 .
- the region of interest ROI, of the complex image A 10 is propagated in the propagation plane (in this example the propagation plane), so as to obtain an elementary diffraction pattern corresponding to the particle d interest isolated from other particles.
- This step makes it possible to obtain an image representing the elementary diffraction figure A oi corresponding to the particle of interest 10 p, i without this figure being superimposed on the diffraction figures corresponding to the other particles 10 p of the sample, in particular the particles arranged in the vicinity of the particle of interest 10 p, i .
- An elementary diffraction pattern is obtained, which allows a more reliable characterization of the particle of interest 10 pi .
- the elementary diffraction figure A oi is a complex image, that is to say formed of complex amplitudes, from which we can extract the module, or the phase, or the real part, or the imaginary part, so as to obtain an observation diffraction figure I Q i .
- FIG. 3F is an observation diffraction figure I Q i obtained from the module of an elementary diffraction figure A 0 i , the latter being obtained by propagation of the complex image extracted A 10 i represented in the 3D figures and 3E, in the propagation plane, which in this example is the detection plane.
- the particles are not necessarily coplanar.
- several observation images I 10 z are formed with each observation image being associated with a reconstruction distance z relative to the detection plane Po.
- Each image d 'observation / 10 z results from a complex image A 10 z obtained by the implementation of an iterative holographic reconstruction algorithm from the image I 0 formed in the detection plane Po.
- the difference between two distances of successive reconstruction z can be between a few pm and a few tens of pm.
- the distance z can be determined by numerical focusing, consisting in determining the distance at which the trace of the particle of interest 10 p, i , on the different observation images / 10 z , is the sharpest.
- the region of interest ROI, corresponding to each particle of interest 10 p, i is extracted from the observation image / 10 z. formed at the distance z t associated with the particle.
- the propagation of the region of interest ROI is then carried out by taking into account, in the propagation operator, the propagation distance z t associated with the particle of interest 10 p, i .
- the propagation of the complex image extracted is carried out by considering a constant and predetermined propagation distance.
- the particles of interest 10 p, i are propagated according to different propagation planes.
- the invention thus allows, for each particle of interest 10 p, i a formation of an elementary diffraction figure A oi taking into account the distance z ; between the particle of interest and the detection plane Po.
- the particle of interest 10 pi is characterized using the elementary diffraction figure A oi resulting from step 140.
- the characterization of the particle of interest 10 p, i is carried out from diffraction figures corresponding to known particles, the latter being either modeled or acquired experimentally.
- the characterization can constitute a classification of the particle of interest 10 p, i from predetermined particle classes.
- the classification can assume a learning phase, carried out using one or more training samples, comprising known particles.
- the characterization may use deep learning type techniques, usually designated by the term "deep learning”.
- a classification is implemented which supposes a reduction in the dimensionality of the elementary diffraction figure A oi .
- a first solution is to perform a radial average of the elementary diffraction pattern, by considering for example the module or the phase of the diffraction pattern.
- This solution is particularly suitable for spherical objects. Indeed, each diffraction figure has a certain symmetry around a center of the diffraction figure. It is possible to present the diffraction pattern according to a radial mean, consisting in averaging the value of the pixels located at the same distance from the center of the diffraction pattern.
- FIG. 4 represents such a radial mean (curve a), obtained by considering the module of the elementary diffraction figure.
- the radial mean takes the form of an intensity profile developed in the detection plane, transverse to the elementary diffraction pattern, and passing through the center of the latter.
- the brace shows the part of the radial mean with a signal-to-noise ratio and sufficient spatial sampling to be able to be used to characterize the particle of interest.
- the use of the radial mean makes it possible to bring back the information present in the elementary diffraction figure in the form of a function whose variable r represents the distance with respect to the center of the diffraction figure.
- the variable r corresponds to the abscissa of Figure 4.
- Another solution is a projection of an observation image resulting from the elementary diffraction figure A oi , according to a base of Zernike polynomials.
- the elementary diffraction pattern is decomposed according to a predetermined number of Zernike polynomials Z TM n being an integer corresponding to the order of the polynomial, m being an integer such that m ⁇ n and such that n— m is even .
- Zernike polynomials are known to those skilled in the art, and their use has been described in US8787633 or in WO2014184390.
- the decomposition makes it possible to obtain coordinates in a base defined by the considered polynomials.
- the decomposition is carried out under 15 polynomials, we obtain a vector Vi of dimension (15, 1).
- the classification of the elementary diffraction figure A oi is carried out using the vector resulting from the decomposition.
- one carries out a decomposition of the module and the phase of the elementary diffraction figure A oi one obtains a vector of dimension (30, 1).
- geometric parameter it is understood a perimeter, a radius or diameter, an area, an eccentricity, an estimate of the volume from the area.
- the geometric parameter of the particle can be obtained by considering the complex image A 10 reconstructed in the plane of the sample, during step 120, or an observation image I 10 obtained from the complex image reconstructed .
- a dimension of the particle of interest has been estimated from the image of the module of the complex image extracted A 10 i represented in FIG. 3D.
- an optical characteristic for example an absorbance level, a value of refractive index or of diffraction power.
- the elementary diffraction figure A oi or its projection, whether it is a radial mean or a base of polynomials, can be compared to diffraction figures obtained experimentally using known calibration particles. It can also be compared to diffraction figures obtained by numerical modeling. According to such an embodiment, a database is created comprising modeled diffraction figures. For this, we take into account several parameter values of a particle. Then we model, by numerical modeling, a diffraction figure obtained at the level of the detection plane. Such modeling can notably be based on Mie theory.
- Mie's theory is an elastic diffusion model allowing to obtain a solution to Maxwell's equations describing a light wave diffracted by a spherical particle illuminated by a monochromatic incident light wave of wavelength l.
- Re and Im are respectively the real part and imaginary part operators.
- the particle is also characterized by its size (radius or diameter).
- the particles analyzed are spherical, or made spherical by the addition of a spherizing agent.
- a progressive adjustment of the parameters of the modeled particle, in particular the refractive index and the size is carried out so that the modeled diffraction figure progressively approaches the elementary diffraction figure corresponding to the particle. of interest.
- the progressive adjustment can be done by iteration, by determining, with each iteration, a difference between the elementary diffraction figure and a modeled diffraction figure. The difference can be gradually reduced by implementing a gradient descent type algorithm. This makes it possible to carry out a progressive adjustment of the modeling parameters so as to progressively reduce the difference between the modeled diffraction figure and the elementary diffraction figure.
- the modeling parameters can be: the size (radius or diameter), the refractive index, and possibly the distance between the particle and the detection plane. The more the distance between the particle and the detection plane is known, the more precisely the elementary diffraction pattern is reconstructed.
- curve b has been represented, corresponding to a radial average of the modulus of an elementary diffraction figure simulated by Mie theory, for a particle of radius 2.59 pm and of refractive index 1.43 . This illustrates the possibility of characterizing a particle of interest, from modeled elementary diffraction figures.
- the classification of an elementary diffraction figure obtained for a particle of interest can be carried out by an algorithm of SVM type (Support Vector Machine), after a learning phase carried out on the basis of figures of diffraction models.
- SVM type Small Vector Machine
- Other classification algorithms notably supervised, for example by PCA (Principal Component Analysis), can also be applied.
- modeled diffraction figures can also be envisaged during the characterization by a decomposition according to a base of polynomials.
- the inventors have implemented a method as previously described for characterizing blood particles, in this case red blood cells.
- Each sample consisted of blood diluted 1/600 th in a sphering reagent.
- the concentration of red blood cells, before dilution, was 2.41 10 6 red blood cells per mm 3 .
- the average globular volume was 92 pm 3 .
- the sample extended over a range of distances between 1050 and 1200 ⁇ m from the image sensor. Steps 100 to 150, previously described, were applied. 1000 particles of interest have been distinguished, each of them corresponding to a red blood cell.
- a distance z, of each particle of interest relative to the detection plane has been estimated, using complex images reconstructed at different distances.
- An elementary diffraction figure A oi has been formed for each particle of interest, taking into account the distance having been associated with it.
- the inventors have established a relationship between the refractive index, at 405 nm, and the hemoglobin concentration in a particle.
- the radius we considered the radius, the refractive index (depending on the hemoglobin concentration) as well as the distance from the detection plane.
- FIG. 5A represents a distribution of the hemoglobin level of the particles (ordinate axis) as a function of the distance from the detection plane (abscissa axis).
- the hemoglobin level is expressed in g / dL.
- FIG. 5B represents a distribution of the particle radius (ordinate axis) as a function of the distance from the detection plane (abscissa axis). The particle radius is expressed in pm.
- FIG. 5C represents a histogram of the number of particles (ordinate axis) as a function of the distance from the detection plane (abscissa axis). The distance is expressed in pm.
- the method described above was implemented on different types of blood particles (red blood cells, white blood cells, platelets) placed in a sample of blood purified in Dextran.
- Dextran has the effect of causing aggregation of red blood cells, which leads to sedimentation of the latter.
- the supernatant plasma depleted in red blood cell compared to the initial blood, is recovered. It is then diluted to l / 10 'th in PBS tampn.
- the concentration of white blood cells, red blood cells and platelets was respectively 5.1 10 3 per mm 3 , 0.02 10 6 per mm 3 , 198.10 3 per mm 3 .
- elementary diffraction figures have been formed by implementing steps 100 to 150 described above.
- FIG. 5D positions each particle of interest characterized in a reference frame whose abscissa axis corresponds to the radius (in pm) and the ordinate axis represents the rate hemoglobin. This identifies red blood cells (set a), white blood cells (set b) and platelets (set c).
- the inventors implemented the method as previously described on different samples, comprising different types of white blood cells (leukocytes), divided into four classes:
- class 1 lymphocytes
- class 2 monocytes
- class 3 neutrophils
- class 4 eosinophils.
- the following table shows the classification results.
- the classes associated with each row and each column correspond respectively to the real classes and to the classes determined by measurement. The classification performance was deemed satisfactory.
- Figure 6 shows schematically another device allowing an implementation of the invention.
- the device of Figure 6 includes an optical system 19 for image formation.
- the optical system 19 defines an image plane and an object plane.
- the optical system can be a lens or objective.
- the image sensor When acquiring the image of the sample, the image sensor is arranged in a defocused configuration.
- the detection plane is offset from the image plane and / or the plane along which the sample extends is offset from the object plane.
- the offset is generally small, preferably being less than 1mm, and typically in the range 50 ⁇ m - 500 ⁇ m.
- the invention may be implemented on different types of samples, for example in the field of diagnostics, biology, or environmental control, or in different industrial sectors, for example the food industry or the control of processes.
Landscapes
- Chemical & Material Sciences (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Immunology (AREA)
- Dispersion Chemistry (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Engineering & Computer Science (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Holo Graphy (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR1873260A FR3090107B1 (fr) | 2018-12-18 | 2018-12-18 | Procédé de caractérisation d'une particule à partir d'un hologramme. |
| PCT/FR2019/053096 WO2020128282A1 (fr) | 2018-12-18 | 2019-12-16 | Procédé de caractérisation d'une particule à partir d'un hologramme |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| EP3899669A1 true EP3899669A1 (fr) | 2021-10-27 |
| EP3899669B1 EP3899669B1 (fr) | 2025-04-23 |
| EP3899669C0 EP3899669C0 (fr) | 2025-04-23 |
Family
ID=66641058
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP19842872.4A Active EP3899669B1 (fr) | 2018-12-18 | 2019-12-16 | Procédé de caractérisation d'une particule à partir d'un hologramme |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US12135273B2 (fr) |
| EP (1) | EP3899669B1 (fr) |
| FR (1) | FR3090107B1 (fr) |
| WO (1) | WO2020128282A1 (fr) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR3116061A1 (fr) | 2020-11-06 | 2022-05-13 | Commissariat A L'energie Atomique Et Aux Energies Alternatives | Procédé de détection d’un évènement cellulaire |
| FR3131376B1 (fr) * | 2021-12-29 | 2023-11-10 | Commissariat Energie Atomique | Procédé d’estimation d’une distribution spatiale tridimensionnelle de fluorescence, à l’intérieur d’un objet. |
| FR3154495B1 (fr) * | 2023-10-23 | 2025-09-05 | Commissariat Energie Atomique | Procédé de détection de particules présentes dans un liquide |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7465560B2 (en) | 2004-11-30 | 2008-12-16 | Purdue Research Foundation | System and method for rapid detection and characterization of bacterial colonies using forward light scattering |
| US7616320B2 (en) * | 2006-03-15 | 2009-11-10 | Bahram Javidi | Method and apparatus for recognition of microorganisms using holographic microscopy |
| US8087284B2 (en) * | 2006-10-11 | 2012-01-03 | Massachusetts Institute Of Technology | Method and apparatus for measuring particle characteristics through mass detection |
| US8787633B2 (en) | 2007-01-16 | 2014-07-22 | Purdue Research Foundation | System and method of organism identification |
| GB0701201D0 (en) | 2007-01-22 | 2007-02-28 | Cancer Rec Tech Ltd | Cell mapping and tracking |
| US7627392B2 (en) * | 2007-08-30 | 2009-12-01 | Tokyo Electron Limited | Automated process control using parameters determined with approximation and fine diffraction models |
| FR3005736B1 (fr) | 2013-05-17 | 2016-02-12 | Commissariat Energie Atomique | Procede d'observation d'organismes et systeme associe. |
| FR3018355B1 (fr) * | 2014-03-05 | 2017-06-09 | Commissariat Energie Atomique | Procede et systeme de caracterisation d'un etat d'adhesion de particules, telles que des cellules |
| FR3028951B1 (fr) | 2014-11-21 | 2017-01-06 | Commissariat Energie Atomique | Systeme d'imagerie sans lentille comprenant une diode, un diaphragme et un diffuseur entre la diode et le diaphragme |
| FR3036800B1 (fr) | 2015-05-28 | 2020-02-28 | Commissariat A L'energie Atomique Et Aux Energies Alternatives | Procede d’observation d’un echantillon |
| FR3046238B1 (fr) | 2015-12-24 | 2018-01-26 | Commissariat A L'energie Atomique Et Aux Energies Alternatives | Procede d’observation d’un echantillon par imagerie sans lentille |
| FR3049347B1 (fr) | 2016-03-23 | 2018-04-27 | Commissariat A L'energie Atomique Et Aux Energies Alternatives | Procede d’observation d’un echantillon par calcul d’une image complexe |
| FR3060746B1 (fr) * | 2016-12-21 | 2019-05-24 | Commissariat A L'energie Atomique Et Aux Energies Alternatives | Procede de numeration de particules dans un echantillon par imagerie sans lentille |
| FR3066503B1 (fr) * | 2017-05-22 | 2021-05-07 | Commissariat Energie Atomique | Procede d'analyse de microorganismes |
| US11566993B2 (en) * | 2018-01-24 | 2023-01-31 | University Of Connecticut | Automated cell identification using shearing interferometry |
-
2018
- 2018-12-18 FR FR1873260A patent/FR3090107B1/fr active Active
-
2019
- 2019-12-16 US US17/414,801 patent/US12135273B2/en active Active
- 2019-12-16 EP EP19842872.4A patent/EP3899669B1/fr active Active
- 2019-12-16 WO PCT/FR2019/053096 patent/WO2020128282A1/fr not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020128282A1 (fr) | 2020-06-25 |
| FR3090107A1 (fr) | 2020-06-19 |
| EP3899669B1 (fr) | 2025-04-23 |
| US20220018756A1 (en) | 2022-01-20 |
| FR3090107B1 (fr) | 2020-12-25 |
| EP3899669C0 (fr) | 2025-04-23 |
| US12135273B2 (en) | 2024-11-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3559631B1 (fr) | Procédé de numération de particules dans un échantillon par imagerie sans lentille | |
| EP3433679B1 (fr) | Procédé d'observation d'un échantillon par calcul d'une image complexe | |
| EP3433678A1 (fr) | Procédé de caractérisation holographique d'une particule dans un échantillon | |
| EP3637194B1 (fr) | Procédé de détermination de paramètres d'une particule | |
| EP3218769B1 (fr) | Procede d'analyse comprenant la determination holographique d'une position d'une particule biologique. | |
| WO2016151249A1 (fr) | Procédé de détermination de l'état d'une cellule | |
| EP3899669B1 (fr) | Procédé de caractérisation d'une particule à partir d'un hologramme | |
| EP3584560A1 (fr) | Procédé d'observation d'un échantillon par imagerie sans lentille, avec prise en compte d'une dispersion spatiale dans l'échantillon | |
| EP3304214A1 (fr) | Procédé d'observation d'un échantillon | |
| EP3640743B1 (fr) | Procédé d'observation d'un échantillon | |
| EP3631416B1 (fr) | Procédé d'analyse de microorganismes | |
| EP3520022B1 (fr) | Procédé de numération de leucocytes dans un échantillon | |
| EP3754431B1 (fr) | Procédé de reconstruction holographique | |
| EP4307051B1 (fr) | Procede et systeme de caracterisation de microorganismes par microscopie holographique numerique | |
| EP4268120A1 (fr) | Procédé de caractérisation de spermatozoïdes | |
| EP3462381A1 (fr) | Procédé de détection de microorganismes dans un échantillon | |
| FR3034524A1 (fr) | Procede de determination du niveau d'agglutination de particules dans un echantillon | |
| WO2019243725A1 (fr) | Procede et dispositif de comptage de thrombocytes dans un echantillon | |
| EP4562593B1 (fr) | Dispositif de detection de particules en imagerie sans lentille | |
| EP4502732A1 (fr) | Procédé et système de caractérisation de microorganismes par microscopie holographique numérique | |
| WO2025027155A1 (fr) | Procédé et système de caractérisation de microorganismes par microscopie holographique numérique | |
| WO2024013202A1 (fr) | Procede et systeme de caracterisation de microorganismes par microscopie holographique numerique | |
| WO2025168581A1 (fr) | Comptage cellulaire |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20210615 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01N 15/10 20060101ALN20240416BHEP Ipc: G01N 15/14 20060101ALN20240416BHEP Ipc: G01N 15/1434 20240101ALN20240416BHEP Ipc: G01N 21/82 20060101ALI20240416BHEP Ipc: G01N 21/27 20060101ALI20240416BHEP Ipc: G03H 1/04 20060101ALI20240416BHEP Ipc: G03H 1/08 20060101ALI20240416BHEP Ipc: G03H 1/00 20060101AFI20240416BHEP |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20240611 |
|
| RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: IPRASENSE SAS Owner name: HORIBA ABX SAS Owner name: COMMISSARIAT A L'ENERGIE ATOMIQUE ET AUXENERGIES ALTERNATIVES |
|
| GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: IPRASENSE SAS Owner name: HORIBA ABX SAS Owner name: COMMISSARIAT A L'ENERGIE ATOMIQUE ET AUX ENERGIESALTERNATIVES |
|
| INTC | Intention to grant announced (deleted) | ||
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01N 15/10 20060101ALN20241031BHEP Ipc: G01N 15/14 20060101ALN20241031BHEP Ipc: G01N 15/1434 20240101ALN20241031BHEP Ipc: G01N 21/82 20060101ALI20241031BHEP Ipc: G01N 21/27 20060101ALI20241031BHEP Ipc: G03H 1/04 20060101ALI20241031BHEP Ipc: G03H 1/08 20060101ALI20241031BHEP Ipc: G03H 1/00 20060101AFI20241031BHEP |
|
| INTG | Intention to grant announced |
Effective date: 20241118 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602019069101 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
| U01 | Request for unitary effect filed |
Effective date: 20250515 |
|
| RAP4 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: IPRASENSE SAS Owner name: HORIBA ABX SAS Owner name: COMMISSARIAT A L'ENERGIE ATOMIQUE ET AUX ENERGIESALTERNATIVES |
|
| U07 | Unitary effect registered |
Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT RO SE SI Effective date: 20250522 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250423 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250723 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250724 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250423 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250423 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250723 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250823 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250423 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250423 |
|
| U20 | Renewal fee for the european patent with unitary effect paid |
Year of fee payment: 7 Effective date: 20251217 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250423 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: L10 Free format text: ST27 STATUS EVENT CODE: U-0-0-L10-L00 (AS PROVIDED BY THE NATIONAL OFFICE) Effective date: 20260304 |
|
| 26N | No opposition filed |
Effective date: 20260126 |