EP2619547A1 - Vorrichtung und verfahren zur optischen charakterisierung von materialien - Google Patents
Vorrichtung und verfahren zur optischen charakterisierung von materialienInfo
- Publication number
- EP2619547A1 EP2619547A1 EP11760701.0A EP11760701A EP2619547A1 EP 2619547 A1 EP2619547 A1 EP 2619547A1 EP 11760701 A EP11760701 A EP 11760701A EP 2619547 A1 EP2619547 A1 EP 2619547A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sample
- elements
- light
- detection unit
- illumination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/21—Polarisation-affecting properties
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1429—Signal processing
- G01N15/1433—Signal processing using image recognition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
- G01N2015/144—Imaging characterised by its optical setup
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N2021/845—Objects on a conveyor
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/04—Batch operation; multisample devices
- G01N2201/0438—Linear motion, sequential
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/06—Illumination; Optics
- G01N2201/061—Sources
- G01N2201/06113—Coherent sources; lasers
Definitions
- the present invention relates to an apparatus and method for optically characterizing a sample and / or the material (s) thereof.
- the characterization is carried out on the basis of the evaluation of the polarization of light which is irradiated onto the sample and reflected by the sample.
- the device and the method can be used in particular for the surface inspection or for the sorting of bulk material by evaluating the polarization of the reflected light.
- Object of the present invention is to provide apparatus and methods for the optical characterization of samples, in particular on the art of
- Reflectometry or ellipsometry or based on polarimetric devices so that the samples (especially non-planar samples or specimens, for example in the form of bulk materials) can be easily and reliably characterized in terms of their / their material / ien.
- the task is also the,
- the present invention utilizes as a basis the techniques of reflectometry known to those skilled in the art or the
- a basic idea of the present invention is based on identifying for and for those surface elements of the sample which reflect the light irradiated onto the sample into a detection unit designed to detect the light
- the sample is illuminated with preferably monochromatic light.
- Reflection elements preferably monochromatic light.
- monochromatic light is not absolutely necessary, but usually better suited for example for samples with dispersion.
- the term light reflected by the sample is understood as meaning all light emitted by the sample, which is finally received by means of the device according to the invention and can be used for the evaluation.
- the reflected light is thus usually the sum of different light fractions, namely, in particular, light fractions scattered on the sample, light fractions diffusely reflected on the specimen and at the sample specularly reflected Lichtantei ⁇ len.
- the light coming to the detection unit due to a specular reflection is also referred to as re fllected light: this light thus relates to light those surface elements of the sample which reflect the incident light on the sample in the detection unit, meeting the reflection condition.
- An inventive device for the optical characterization of a sample (or one or more
- a lighting unit aligned for illuminating the sample may be directed to a sample space section or space volume into which the sample is introduced for illumination).
- This device moreover comprises a detection unit which is capable of detecting a plurality of different (preferably:
- this device comprises an evaluation unit.
- This can be realized, for example, as a computer program in a personal computer.
- the evaluation unit as part of the detection unit (for example as an evaluation program integrated in a camera). With this evaluation unit are in the recorded by the detection unit imaging data
- This device is thus for formed surface images of the sample or a sample portion formed) those imaged surface elements of the sample identifiable, their reflected light received in the detection unit light on a reflection of the incident
- Light is based on the sample.
- These surface elements of the sample are also referred to hereinafter as reflection elements, in contrast to those surface elements of the sample which, due to physical effects other than reflection (for example by light scattering), reflect light back into the aperture of the detection unit.
- the evaluation unit of this device according to the invention is finally designed so that the detected different polarization components can be evaluated just for the reflection elements in order to obtain the desired optical characterization of the sample.
- this device On the basis of this evaluation, it is then possible, for example, with this device according to the invention, to separate objects or object areas which have a narrowly tolerated range of optical material constants from objects with different optical material constants (sorting device) or to maintain optical material constants, e.g. to automatically check in a production process.
- An essential feature of the solution according to the invention described above is thus that, if desired, e.g. by using an evaluation unit with appropriate computing capacity, too
- the automatic recognition as to whether a particular surface element (ie an observed object point) is a reflection element, ie fulfilling the above-mentioned reflection condition for the orientation of its surface normal, can, for example as described in detail below, be reflected, for example, by an intensity check of the total of the surface element imaged or proven intensity.
- a sample is not necessarily understood to mean a single physical object, but in a sample it may very generally also be a stream of many individual, moving objects of different materials (ie a sample stream in the context of a sorting or characterization) Bulk material, so a bulk flow) act.
- a lighting unit used in the context of the invention does not necessarily have to be a single light source, but several suitably arranged light sources which illuminate one and the same sample can also be used in parallel become. As a rule, the reflection condition is fulfilled for each of the light sources used.
- reflected light is understood to mean all those light components which are incident on light sources irradiated by the illumination unit and impinging on the sample. Parts go back and are not sorbed by the sample ⁇ , but by any processes (reflection, scattering, ...) leave the sample or its surface - usually in a direction other than the direction of incidence - again and thus outside the sample can be detected.
- the illumination unit and the detection unit at the Brewster angle, if the characterization task when using the device according to the invention consists in recognizing the presence of a defined material or individual elements of this defined material identify a sample comprising a plurality of objects of different materials (the Brewster angle set in the device is then the Brewster angle of that material).
- This arrangement below the Brewster angle is advantageous, in particular, for the reason that the beam components reflected on samples or sample elements of this material merely comprise one
- the evaluation unit is designed so that in the recorded image data first the reflection elements are identifiable before the detected different polarization components can be evaluated for these (or on the basis of) identified reflection elements.
- the reflection elements can be ascertained on the basis of an evaluation of the overall intensities of the individual surface elements (or the image pixels of the images detected by the detection unit) by identifying those surface elements as reflection elements whose total intensity (sum of the intensities of all detected polarization components) is above a defined threshold value (eg the threshold value can be defined as the intensity value above which the intensity of 20% of all imaged surface elements lies). Only for the reflection elements identified in this way are the different (eg orthogonal) polarization components evaluated, eg viewed separately, or viewed with regard to their intensity ratios.
- all imaged surface elements (these include both imaged surface elements of the sample and imaged surface elements of not belonging to the sample, but still imaged structures) first the detected different polarization components, for example separately or to consider according to their conditions and for For (for example by thresholding) ⁇ values to determine those surface elements of the sample which are reflective elements.
- all surface elements whose intensity exceeds a predetermined threshold value for a defined polarization component in the image data can be defined as reflection elements.
- the different polarization components are then further evaluated (for example by forming the intensities in different polarization components corresponding to the imaging data or polarization fields acquired by the detection unit) in order to carry out the optical characterization of the sample.
- the inventive device is designed so that the
- Determination of the reflection elements are used. It is also possible to use the total intensity of all detected by the detection unit polarization components of the light for imaging light for identification of the reflection elements.
- those surface elements are identified as reflection elements whose associated image values in the images acquired by the detection unit are in total above a predefined threshold value.
- a threshold value can be defined for example as 90% / 10% -threshold, that are defined by the fact that 90% of the total intensity values of all illustra ⁇ ter surface elements are below this threshold value and 10% above.
- the reflective elements can also be defined on the basis of their position in accordance with the different Po ⁇ larisa tion of play (or corresponding to the received total intensity) produced images of the sample: For this purpose, the position of the FLAE ⁇ chenetti (eg, taking into account their intensities) relative to each other and / or relative to one or more reference point (s) are evaluated in the images of the sample. In particular, center points or edge points of images of the sample can serve as reference points.
- a contemplated surface element is a reflection element of the sample, it can then be determined-in addition to the above-described threshold value-that the reflection elements must be located within the thus-detected outlines of individual sample elements.
- those surface elements whose intensity or brightness is below the above-described, adjustable threshold, not reflection elements but scattering elements.
- surface elements are not reflection elements of the sample. Further evaluation of these surface elements is therefore not meaningful.
- the evaluation of the identified reflection elements for the purpose of optical characterization of the sample is carried out as follows: From different, for the identified reflection elements of the Detektionsseinhei t polarization shares (eg from two mutually orthogonal linear polarization fractions) a relationship is formed. This can be done, for example, by dividing the intensity value in the image recorded for a first polarization component by the intensity value of the corresponding reflection element in the image recorded for a second, different (eg, orthogonal) polarization component for all the surface elements identified as reflective elements ,
- the ratio thus formed exceeds or falls below a certain value for a certain minimum number of reflection elements (relative to the total number of surface elements and / or reflection elements), then a statement can be made about the presence or absence of a defined material in Take the sample: If, for example, a reflection condition for the reflection ele- on the other hand, in the triangle formed by the detection unit, the illumination unit and the sample, set the angle between the optical axis of the detection unit on the one hand and the optical axis of the illumination unit to twice the Brewster angle of a searched material (the reflection elements are then those surface elements the sample whose normal halves the angle between the two aforementioned axes), all those reflection elements that can be assigned to the sought material reflect only polarized light components parallel to the surface of the sample, but not light components with a polarization direction perpendicular thereto. However, this can be detected via a corresponding threshold setting for the ratio calculated as described above, so that it is possible to distinguish sample elements of the sought-after material from sample elements made of a different
- the ratio of intensities of different polarization components is within a certain range in order to distinguish defined materials from other materials.
- the absolute number of pixels or area elements in the imaging data recorded by the detection unit for which the ratio calculated as described above exceeds or falls below a threshold value, can also be used as the sorting criterion.
- Decisive in the case of the previously described embodiments of the invention is the consideration that, even with irregular surfaces of samples (eg of bulk materials), it is necessary for each object or
- Element of the sample at least one point, so a surface element, which meets the reflection condition, with which the object can thus be characterized.
- Lighting unit has only a single lighting element (for example, a single monochromatic light source, see Example 1 below).
- the illumination unit may also comprise a plurality of individual illumination elements, which are designed to illuminate the sample with incident light from different directions.
- the angle between the detection unit or its optical axis, on the one hand, and the respective illumination element or its optical axis, on the other hand can be identical in all lighting elements in the triangle defined by the detection unit, the corresponding illumination element and the sample.
- two or four individual lighting elements can be used.
- the illumination elements can be arranged on the side of the sample opposite the detection unit and in a plane which is preferably aligned perpendicular to the optical axis of the detection unit.
- the individual illumination elements can be arranged at equidistant angular intervals on a circle around the optical axis of the detection unit in this plane.
- they can be arranged at angular intervals of 90 ° on a circle around the optical axis of the detection unit around.
- the angular relationships described above for the lighting unit eg setting to a Brewster angle for a defined material
- All devices for optical characterization described in the context of the present invention can be designed as a sample by suitably providing further components (for example sample storage units, etc.) for surface testing of planar coatings.
- the devices for characterizing, differentiating and / or separating individual elements of a sample comprising a large number of elements can be done, for example, by arranging the illumination unit and the detection unit for illuminating and imaging a free fall-distance piece, for example below a vibrator for bulk material.
- conveyor belt sections on which bulk material is transported can also be illuminated by the lighting unit and scanned by the detection unit.
- the latter devices can then also be used, in particular, to sort out sample elements which are separated from one or more predefined material parameters (s) (the one for the optical Characterization by evaluation of Reflexionsele ⁇ elements is / are determined), be formed.
- the devices according to the invention described above can be designed as a laser scanner system with a sample or the sample space section in which this sample is arranged, one or two-dimensional scanning abscannenden lighting unit based on one or more laser (s) and with one or more suitable receiving unit (s ) as a detection unit.
- illumination unit or illumination element Alternatively, however, it is also possible to use one or more monochromatic light sources as illumination unit or illumination element (s).
- the illumination of the sample is advantageously carried out with one or more defined wavelength (s) in the visible range; however, in principle it is also conceivable, e.g. Infrared radiation to use for lighting, if then the receiving units are adjusted accordingly.
- a camera used in a reflection arrangement as described above with which, for example, two orthogonal polarization components can be detected for each scanned surface element, one out be two single cameras existing camera.
- a polarizing optical element for example, prism or beam splitter
- the light of the one polarization component is then directed by the polarizing optical element to the one single camera, the light of the other polarization component to the other of the two individual cameras. It is advantageous to provide a pixel adjustment to match the position of the detected reflection elements in the images of the two individual cameras.
- a multi-cell camera may be provided, wherein in the beam path in front of this camera, a number of polarizers corresponding to the number of lines of the camera is provided.
- the two or more polarization directions are detected by the camera: Before the individual lines of the camera alternately polarizers of one type and the other type are arranged with two different polarizers, so alternately on the camera lines each light of a first polarization and a second part, for example, orthogonal to the first polarization component Polarization component is mapped.
- a camera may be used which comprises a polarization strip filter or a polarization mosaic filter in the beam path in front of its sensor chip.
- a filter decomposes the light reflected from the sample into the different polarization components, which are then directed line by line or according to the mosaic arrangement of the filter onto the respective sensor cells of the camera chip (which sensor cells of the chip receive light of which polarization component is known from US Pat that the evaluation can be done accordingly).
- a plurality of differently polarized illumination subunits e.g., single lamps
- the individual illumination subunits are switched on and off in succession, thus illuminating the sample one after the other for a predefined period of time.
- the individual polarization components are then detected during different, precisely defined time intervals of the entire camera surface of a non-polarization-sensitive camera (preferably, a multicellular camera is used), the differently polarized illuminations are thus virtually flashed. If the device is used for moving samples (bulk material flow), the flash frequency or the frequency of the switching between the individual illumination
- Subunits advantageously synchronize with the sample speed.
- This synchronization has the following advantage:
- the sample is in the sampling (eg on a corresponding drop distance or flight path in a parabola-like ejection of a Conveyor belt) in motion, that is, the image of the sample shifts in the individual to the Auswer ⁇ tion temporally successive recorded camera images in these camera images, so changes its location in the individual camera images.
- Another camera-based system structure according to the invention for the illumination unit and the detection unit uses an LED illumination in which the individual LED illumination elements which emit light of a wavelength are arranged such that for each pixel or for each imaged surface element entire sample surface to be scanned (entire camera image) the same reflection condition is given. This can be achieved by different inclination angle of the individual LED elements in a bar, by an arrangement of these elements on a curved board or flat arrangement of the LED elements by a lens attachment.
- the illumination unit used with means for changing and / or adjusting the polarization of the illumination for example LC element as used in LC displays.
- the illumination of the sample can then, as in the above-described "flash", carried out successively with different polarization states. For each loading leuchtungs-polarization state can as described above, captures various polarization components for Reflexionselernente and are ranked from ⁇ then.
- the illumination unit and the detection unit together with a polarization-preserving retroreflector: in the case of a laser used as illumination unit in the form of a laser scanner and a receiver designed as a suitable detection unit (in particular a polarization-maintaining beam splitter for splitting the incident laser light into two Partial beam paths and, in these Railstrahlengän ⁇ gene, polarizing optical elements may have), the illumination unit and the detection unit may also be formed as an integrated transmitting and receiving unit.
- a retroreflector is then to be provided, with the combined transmitting and receiving unit and the retroreflector being designed and arranged as follows: In the combined transmitting and receiving unit, the transmitter and receiver beam paths are coupled to the same axis via a beam splitter. The transmitter illuminates the sample, and the portions of the beam reflected by the sample (that is, scattered, diffusely reflected, or specularly reflected) are reflected back into the retroreflector and pass, preferably via the reflector
- the receiver is in the above-described case
- Retroreflector arranged. This has the advantage that, as long as the beam components pass through the object into the combined transmitting and receiving unit, the radiation is reflected twice on the sample or on the object. There is thus an improved
- the detection unit then comprises a receiver suitable for receiving the laser light returned by the sample with one or more optical elements for separating the received laser light according to the different polarization components.
- a plurality of receiving elements are formed, the number of which corresponds to the number of sub-beams resulting from the separation.
- the evaluation unit can determine, for example by checking the received total intensity, whether surface elements are reflection elements of the sample, that is to say fulfill the reflection condition.
- the evaluation unit of the above-described devices for optical characterization according to the invention is designed such that the reflection elements of the sample can be identified with it (for example by evaluating the total intensity received by each object point as a criterion for whether the corresponding object point fulfills the reflection condition, ie has the necessary orientation for further evaluation of its surface).
- the reflection elements are then further evaluated by means of the evaluation unit for the optical characterization of the sample, ie one or more processing stages are provided in order to carry out an overall characterization of the sample by evaluating the significant surface elements or the reflection elements.
- additional delay elements eg ⁇ / 4 plates
- additional delay elements eg ⁇ / 4 plates
- further beam splitters or filters in front of the detection unit or its light-sensitive surface.
- Alignment, adjustment and arrangement of such delay elements and / or beam splitters or filters can be carried out so that the determination of further Stoes parameters is possible.
- a monochromatic coherent illumination unit can also be used
- the sample is to be placed between the illumination unit and the detector.
- the retroreflector is behind the sample.
- this is a
- the device can therefore also be used as a transmission system or
- the device according to the invention for optical characterization comprises the following elements: a laser (illumination unit) aligned with incident light for one or two-dimensional scanning of a sample space section in which the sample can be introduced. To receive the reflected by the sample light is to receive
- Laser light suitable receiver provided as a detection unit.
- This receiver comprises a first, preferably polarization-maintaining beam splitter for splitting the laser light incident on the receiver into a first and a second partial beam path.
- a polarizing optical element for example polarizing prism or polarizing beam splitter
- one receiving element is provided in the beam path of each of the two polarization components thus separated, with which the respective polarization component can be detected (thus a total of four receiving elements are provided, two in each of the above-described
- Partial ray paths Only in one of the two Partial beam paths, moreover, a polarization-changing element is provided after the beam ⁇ divider and in front of the polarizing optical element, with which the polarization of this partial beam path can be changed.
- This change element may in particular be a retardation plate, which is preferably formed as a ⁇ / 4 plate.
- the evaluation unit of the device is designed so that it can be used to completely determine the polarization state of the light reflected from the sample for the optical characterization of the same on the basis of the different polarization components detected by the plurality of receiver elements of the receiver.
- the beam splitter, the polarizing optical elements, the modifying element and the four receiving elements can be arranged, arranged and adjusted such that three out of four Stokes parameters of the reflected back
- Light can be calculated from the detected different polarization shares. Since the incident laser light is completely polarized, the determination of three of the four Stokes parameters is sufficient to obtain the fourth (assuming a constraint for monochromatic, coherent light)
- Light can then be e.g. Different materials of different sample elements of a bulk sample can be identified and distinguished.
- FIG. 1 shows a first embodiment of a device according to the invention using a single lighting element as a lighting unit.
- Figure 2 shows another embodiment of the invention, in which the lighting unit consists of two separate lighting elements.
- FIGS. 3a to 3d show examples of the identification of a defined material in a bulk material flow of different materials.
- FIG. 4 shows an example of a device according to the invention designed as a test system for coatings.
- Figure 5 shows another embodiment of the invention, which is designed to fully characterize the polarization state of the reflected light.
- FIG. 1 a shows a device according to the invention designed to characterize individual sample elements or specimens P in the form of a bulk material sorting system.
- the individual objects of the bulk material flow or the sample P are transported on a flat conveyor belt 30, the outer surface on which the elements of the sample P come to rest, is white. This serves to better identify the individual sample elements in the image (see below).
- the conveyor belt 30 is driven by two rollers 31, 32; the transport of the sample elements P takes place here in the image to the right (arrows); other elements of the bulk material sorting device (eg blowing units or collecting container for the Probenele ⁇ elements of different materials) are not shown here.
- the illumination unit 2 of the device shown comprises a monochromatic light source 21, which is embodied here as an LED strip emitting in the green region (550 nra).
- a diffuser 22 is arranged, which reduces the modeling of the LED structure 21. in the
- the lighting unit 2 also has a polarizer 23 on.
- the optical axis of the lighting unit 2 consisting of the elements 21, 22 and 23 is designated here by the reference numeral 2o.
- the corresponding conveyor belt section is provided here with the reference numeral 7.
- the detection unit 3 of the system shown is arranged in the same half space as the lighting unit 2 (ie in the half space above the conveyor belt 30), however, based on the conveyor belt section 7 illuminated by the lighting unit 2 or the sample space section 1 seen, arranged on the lighting unit 2 opposite side of this half-space.
- the optical axis of the detection unit 3 designed as a polarization camera is designated here by the reference numeral 3o.
- the illumination unit 2 or its optical axis 2o, the center of the sample space section 1 or the illuminated conveyor belt section 7 and the detection unit 3 or the optical axis 3o dersel ⁇ ben form an isosceles triangle whose long side through the connecting line light source 2 - detection unit 3 and its catheters through the connecting lines light source 2 - sample space section 1, 7 and sample space section 1, 7 - detection unit
- the detection unit 3 is an evaluation unit
- the operation of the device shown in Fig. La) will be described below.
- the device is set to distinguish sample elements made of zirconium from sample elements made of glass.
- the angle ⁇ ⁇ 63 ° was set to the Brewster angle of the material zirconium.
- the evaluation or optical characterization is based on the idea that the illumination unit
- each sample element P there is at least one surface element whose normal is parallel to the normal N or to the normal
- Bisector of the two optical axes 2o, 3o is aligned.
- the incident radiation E strikes the surface of the sample element P just below the Brewster angle ⁇ ⁇ of zirconia.
- Fig. Lb outlines how those surface elements for which this reflection condition is met, which are reflection elements 5 of the sample elements P, of other imaged surface elements of the sample or imaged surface elements of the background or the conveyor belt surface (these surface elements are summarized below as
- scattered light from scattering elements 6 can be distinguished from reflected light from reflection elements 5 by evaluating the intensity of a polarization component recorded by the polarization camera 3 (see below) or by evaluating the incident total intensities of all detected polarization components. So be it therefore the reflection elements act 5, for example, a significantly higher on the corresponding picture element of the Polari ⁇ sationsannon 3 incident total intensity as the diffusion elements 6.
- the two types 5, 6 may of area elements by setting a saustimm ⁇ th threshold value (for example, of an average intensity can be determined over the entire image) can be distinguished.
- Surface elements 5 which fulfill the reflection condition are therefore particularly bright in the figure. These surface elements 5 alone are then further evaluated to characterize the sample P or its individual sample elements. To make sure that it is with the specific
- Reflecting elements 5 are actually also imaged surface elements of sample elements P (and not, for example, on the white background or on the surface of the conveyor belt 30 reflected light components), the position of the potential candidates for reflection elements 5 in the entire recorded image can be further evaluated by the For example, the position, size and shape of the individual sample elements of the sample P can be ascertained (search for closed curves in the image derived once or twice and treated with threshold value) by means of image processing algorithms known to those skilled in the art. Reflection elements R can then be only those surface elements or points in the image that come to rest within the image of a sample element or within such closed curves. For the determination of the reflection elements 5, therefore, a combination of intensity and position evaluations can be used (only particularly bright surface elements in the middle region of the image of a bulk material object P can thus be found in FIG System of Fig. 1 reflection elements 5).
- the further evaluation of the identified reflection elements 5 in the image of the camera 3 and the sample material characterization based thereon then take place as follows:
- the polarization camera 3 is designed to separate two orthogonal polarization components, namely the polarization component of the incident parallel to the plane of incidence of the reflection elements 5 (plane parallel to the conveyor belt surface) Light E and the perpendicular thereto incident polarization component. If an imaged sample element P is an element made of zirconium, then, since the Brewster condition is satisfied here, only polarized light is reflected parallel to the plane described above.
- FIG. 3d show examples of the differentiation of diamond and quartz glass ( Figures 3a to 3c) and of zirconium crystals in a bulk flow P of such crystals, broken glass and metal rings ( Figure 3d).
- the polarizer 23 has been adjusted for Fig. 3d such that the conveyor belt surface
- FIG. 3a shows, as can be seen from the Fresnel formulas, by calculation of curves for the relative reflection
- the figure clearly shows the different Brewster angles for the two materials; For the separation of the two substances can thus an order under the Brewster angle ⁇ ⁇ of the sought
- An increase in the sensitivity for the separation of the two substances can be done by adjusting the lighting.
- the illumination by means of the polarizer 23 can be set such that for the contaminant (for example glass or metal) the two reflected intensities are equal.
- This setting can be done by means of the polarizer 23 so, then an impurity sample in the
- FIG. 3b once again shows the degree of reflection for the example of diamond / quartz glass, likewise (cf., FIG. 3a) as a function of the angle of incidence ⁇ .
- the blue-to-red channel ratio is then highest on the zirconium crystal surface-facing surface elements 5 aligned parallel to the conveyor belt surface.
- the ratio can thus be used to identify the zirconium crystals in the individual sample elements of the bulk material flow.
- Zirconia crystals are marked.
- the glass shards (further irregular elements in FIG. 3d on the left) and a metal ring present in the bulk material flow (FIG. 3d, top left) remain dark, so are not identified.
- FIG. 4 outlines a further test procedure that can be achieved with the device according to the invention shown in FIG. 1: Paper / gauze is coated with petroleum jelly during production. We are looking for one
- the polarization degree of the imaged surface elements can thus be calculated from the intensities B of the blue channel and the intensities R of the red channel as follows: B / (B + R).
- the coated area fraction of the total area fraction can be evaluated.
- a diffuser 22a, 22b and a polarizer 23a, 23b are arranged behind each illumination element 2a, 2b in a manner similar to that shown in FIG.
- the detection unit 3 and the evaluation unit 4 (not shown here) are similar to the case described in FIG. 1 (differences see below).
- the device shown is designed as a bulk material sorting device in which the bulk material (of which only a single sample element P is shown here) passes through a sample space section 1 in the form of a free fall section 6f below a vibrator (not shown).
- the optical axis 3o of the polarization camera 3 lies here in a horizontal plane perpendicular to the direction of fall F of the sample elements P.
- a lighting element 2a, 2b (together with the associated diffuser 22a, 22b and polarizer 23a, 23b ) arranged.
- the angle between the two optical axes 2oa and 2ob of the two illumination elements 2a, 2b and the horizontal plane described above is the same, the illumination elements 2a, 2b and the camera 3 are arranged so that their optical axes 2oa, 2ob and 3o in a plane perpendicular to the horizontal plane described above.
- the bisector N a separates the angle subtended by the two optical axes 2oa and 3o or the angle of incidence E a of the upper illumination element 2 a and the reflection direction Z 1 into two equal angles ⁇ & ⁇ , de corresponding to the Brewster angle ⁇ ⁇ be formed in the sample stream P to be identified material.
- the bisector N b separates the through the optical axis 2ob of the lower illumination element 2 b (ie the incident light E b ) and the optical axis 3 o of the polarization camera 3 (or the corresponding reflected reflected imaged light portion Z1) spanned angle into two equal angle sections 0 bB .
- Q aB Q b applies here. Both illumination elements 2 a and 2 b are therefore at one and the same angle
- the reflection condition for the subsystem consisting of the illumination unit 2a and the camera 3 is fulfilled at a later time than for the further subsystem consisting of the illumination element 2b and the camera 3: If a sample element P fails the fall distance F shown
- surface elements lying on its rear side meet the reflection condition, ie are reflection elements 5, if the sample element P under consideration is positioned with its rear side at the level of the horizontal plane of the optical axis 3o, ie this horizontal plane is straight
- reflection elements 5 candidate surface elements of the sample P must thus be in the images continuously recorded by the camera 3o first on the front and then on the back of the imaged object (which can be identified by eg gradient-based image processing mechanisms based on its outline).
- the conditions for identifying the reflection elements 5 differ from those of the system shown in FIG. 1, in which the reflection elements 5 must lie approximately in the middle of the images of the individual identified sample elements.
- the evaluation of the different polarization components for the identified reflection elements for the optical characterization of the sample P can be carried out quite analogously as in the case described for FIG.
- a lighting unit which, instead of two lighting elements 2 a, 2 b, comprises four lighting elements which are arranged in a plane perpendicular to the optical axis 3 o and equidistant on a circle around this optical axis 3 o (angular distances of individual lighting elements 90 °) are arranged. Similar to the case shown in FIG. 2, illumination then takes place in such a way that surface elements on the edge of the objects P from four cardinal directions are intensity-based on whether they have matching surface normals N. Thus, a characterization of the falling sample elements P of the bulk material flow with up to four points is possible.
- Brewster angle 9 aB QbB eg by blue Stammele ⁇ elements at a second, later time (scanning the front), red pixels at a first later time (scanning the left and right sides) and by further blue pixels to a third, even later time (scanning the back) marked.
- FIG. 5 shows a further device according to the invention for the optical characterization of a flat, layered sample P in a sample space section 1 on the basis of a laser scanner system.
- the laser 2 which scans the sample space section 1 perpendicularly to the direction of incidence E of the light as the illumination unit, emits light at the angle of incidence ⁇ (angle between the sample normal N and the direction of incidence E of the laser light) onto the sample surface of the sample P. See Figure 5 top right, the one
- Section perpendicular through the irradiated sample surface shows and Figure 5 right center, which shows a plan view of the irradiated sample surface, ie a view in the direction of the normal N.
- the light Z reflected under the corresponding angle of reflection ⁇ (reflection law) is fed to the receiver 3 shown in FIG. 5, left and center, for evaluation.
- the device shown in FIG. 5 is based on the consideration that the emission laser 2 of the scanner shown emits monochromatic, coherent radiation, so that the radiation received by the sample
- the receiver 3 shown now comprises in the beam direction of the reflected light component Z in the beam path successively the following components:
- a concave mirror 40 designed to focus the light component Z reflected on the sample surface P onto a beam splitter plate 8.
- the polarization-maintaining beam splitter plate 8 with the respective 50% of the incident, reflected radiation Z is divided into a first partial beam path Tl and a second partial beam path T2.
- Delay plate ( ⁇ / 4 plate) 9 which directs the light of the first partial beam path Tl to a first polarization beam splitter 10a, which is designed to distinguish two mutually orthogonal polarization components of the incident light.
- the first of these two polarization components is detected with a first receiving element IIa, the other of these two polarization components with a further receiving element IIb (intensity detectors).
- the second partial beam path T2 is basically the same as the first partial beam path T1.
- the delay plate 9 is omitted, so that in this partial beam path only a second polarization beam splitter 10b and two further receiving elements 11c and lld are arranged, with which the two mutually orthogonal polarization components in the second partial beam path T2 are detectable.
- the four receiving elements IIa to lld are then connected via birectal signal lines with an evaluation unit 4 (not shown).
- the polarization state of the reflected radiation Z can thus be completely characterized as follows:
- the intensities Io and Igo are determined for two linear, mutually orthogonal polarization components.
- the combination of the retardation plate 9 and the divider 10a gives a
- Beam splitter for splitting the incident light into right circular and left circular polarized
- V IRZ - ILZ /
- the optical characterization apparatus shown in FIG. 5 thus enables the calculation of the complete state of polarization of the reflected light component Z from the received signal intensities of the four receiver elements IIa to IId. Since the polarization state of the reflected light Z depends on the sample material of the sample P being examined, the material characterization apparatus of the sample P shown in Fig. 5 can be used.
- the receiver beam path and the transmitter beam path are realized in the same housing (integrated transmitter and receiver unit), a corresponding characterization of the material can take place, provided that the light reflected on the sample hits a retro-reflector which returns the beams back to the combined transmission Receiver unit reflected. In contrast to the arrangement with separate transmitter and receiver, however, the light is reflected twice on the sample. The polarization effects on the
Landscapes
- Chemical & Material Sciences (AREA)
- Immunology (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- General Physics & Mathematics (AREA)
- Dispersion Chemistry (AREA)
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Computer Vision & Pattern Recognition (AREA)
Abstract
Description
Claims
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP14192072.8A EP2848916B1 (de) | 2010-09-24 | 2011-09-09 | Vorrichtung und Verfahren zur optischen Charakterisierung von Materialien |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102010046438A DE102010046438A1 (de) | 2010-09-24 | 2010-09-24 | Vorrichtung und Verfahren zur optischen Charakterisierung von Materialien |
| PCT/EP2011/004553 WO2012038036A1 (de) | 2010-09-24 | 2011-09-09 | Vorrichtung und verfahren zur optischen charakterisierung von materialien |
Related Child Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP14192072.8A Division EP2848916B1 (de) | 2010-09-24 | 2011-09-09 | Vorrichtung und Verfahren zur optischen Charakterisierung von Materialien |
| EP14192072.8A Division-Into EP2848916B1 (de) | 2010-09-24 | 2011-09-09 | Vorrichtung und Verfahren zur optischen Charakterisierung von Materialien |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP2619547A1 true EP2619547A1 (de) | 2013-07-31 |
| EP2619547B1 EP2619547B1 (de) | 2017-08-09 |
Family
ID=44675527
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP11760701.0A Active EP2619547B1 (de) | 2010-09-24 | 2011-09-09 | Vorrichtung und verfahren zur optischen charakterisierung von materialien |
| EP14192072.8A Active EP2848916B1 (de) | 2010-09-24 | 2011-09-09 | Vorrichtung und Verfahren zur optischen Charakterisierung von Materialien |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP14192072.8A Active EP2848916B1 (de) | 2010-09-24 | 2011-09-09 | Vorrichtung und Verfahren zur optischen Charakterisierung von Materialien |
Country Status (4)
| Country | Link |
|---|---|
| US (3) | US9222879B2 (de) |
| EP (2) | EP2619547B1 (de) |
| DE (1) | DE102010046438A1 (de) |
| WO (1) | WO2012038036A1 (de) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102012010190B4 (de) | 2011-07-18 | 2022-08-18 | Lufthansa Technik Aktiengesellschaft | Verfahren, Vorrichtung und Endoskop sowieAufsatz |
| FR2994263B1 (fr) * | 2012-08-02 | 2018-09-07 | Vit | Procede et dispositif d'identification de materiaux dans une scene |
| DE102014112886A1 (de) * | 2014-09-08 | 2016-03-24 | Khs Gmbh | Polarisationskamera zur Überwachung von Förderbändern |
| WO2017207681A2 (de) | 2016-06-02 | 2017-12-07 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Konfigurierbares retroreflex-sensorsystem zur verbesserten charakterisierung der eigenschaften einer probe, entsprechendes verfahren und entsprechende verwendung |
| DE102016210482A1 (de) | 2016-06-14 | 2017-12-14 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Optisches Sortiersystem sowie entsprechendes Sortierverfahren |
| EP4206651B1 (de) | 2021-12-28 | 2026-01-28 | Tata Consultancy Services Limited | Verfahren und vorrichtung zur polarimetrischen mueller-matrix-charakterisierung transparenter objekte |
| DE102023001792A1 (de) | 2023-02-06 | 2024-08-08 | Matthias Hartrumpf | Verfahren zur Prüfung transparenter, reflektierender oder glänzender Proben mittels Laserscan |
| DE102023119233A1 (de) * | 2023-07-20 | 2025-01-23 | Emg Automation Gmbh | Vorrichtung und Verfahren zur Bestimmung von flächigen dielektrischen Auflagen auf Substraten in Echtzeit |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AT380814B (de) | 1984-09-10 | 1986-07-10 | Andritz Ag Maschf | Sortiereinrichtung zum trennen von in zufallsverteilung anfallenden, nach farbe, helligkeitswert, groesse oder dergleichen verschiedenen partikeln |
| US5028138A (en) * | 1989-05-23 | 1991-07-02 | Wolff Lawrence B | Method of and apparatus for obtaining object data by machine vision form polarization information |
| JPH05113371A (ja) * | 1991-08-29 | 1993-05-07 | Nkk Corp | エリプソパラメータ測定方法及びエリプソメータ |
| DE4317513A1 (de) | 1993-05-26 | 1994-12-01 | Select Ingenieurgesellschaft F | Verfahren und Vorrichtung zur selektiven Trennung von Körpern und Anwendung des Verfahrens |
| US5442446A (en) * | 1994-08-19 | 1995-08-15 | Owens-Brockaway Glass Container Inc. | Inspection of transparent containers |
| DE19614108C1 (de) * | 1996-04-10 | 1997-10-23 | Fraunhofer Ges Forschung | Anordnung zur Vermessung der Koordinaten eines an einem Objekt angebrachten Retroreflektors |
| US7123357B2 (en) * | 1997-09-22 | 2006-10-17 | Candela Instruments | Method of detecting and classifying scratches and particles on thin film disks or wafers |
| US5936734A (en) * | 1997-12-23 | 1999-08-10 | J.A. Woollam Co. Inc. | Analysis of partially polarized electromagnetic radiation in ellipsometer and polarimeter systems |
| US7061601B2 (en) * | 1999-07-02 | 2006-06-13 | Kla-Tencor Technologies Corporation | System and method for double sided optical inspection of thin film disks or wafers |
| DE10102359A1 (de) * | 2001-01-19 | 2002-08-01 | Siemens Ag | Schaltungsanordnung mit in Chips angeordneten Halbleiterbauelementen |
| US8059276B2 (en) * | 2003-02-28 | 2011-11-15 | J.A. Woollam Co., Inc | Ellipsometric investigation and analysis of textured samples |
| EP1660849A2 (de) * | 2003-08-06 | 2006-05-31 | Russell Chipman | Erweitertes polarisationsabbildungsverfahren, vorrichtung und computerprogrammprodukt für netzhautabbildung, flüssigkristall-prüfung, aktiv-fernmessung und andere anwendungen |
| EP1619465A1 (de) * | 2004-07-19 | 2006-01-25 | Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek Tno | Vorrichtung und Verfahren zur optischen Überwachung von Schichten |
| US7768643B1 (en) * | 2006-03-30 | 2010-08-03 | Key Technology, Inc. | Apparatus and method for classifying and sorting articles |
| FR2902575B1 (fr) * | 2006-06-14 | 2008-09-05 | Ion Beam Services Sa | Appareil de caracterisation optique du dopage d'un substrat |
| EP1988373A1 (de) * | 2007-05-02 | 2008-11-05 | National University of Ireland Galway | Vektorielles Polarimetrieverfahren und Vorrichtung zum Analysieren des aus der Interaktion zwischen einem fokussierten Beleuchtungsfeld und einer zu beobachtenden Probe resultierenden dreidimensionalen elektromagnetischen Feldes |
| CA2697636C (en) | 2007-09-03 | 2015-11-03 | Belgian Electronic Sorting Technology, N.V. | Sorting device with a broad spectrum light source and according method |
| DE202007014466U1 (de) | 2007-10-16 | 2008-01-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung zur Klassifizierung transparenter Bestandteile in einem Materialstrom |
| US8078410B2 (en) * | 2007-11-01 | 2011-12-13 | Lockheed Martin Coherent Technologies, Inc. | Sensing using polarization diversity and wavelength dependent backscatter |
| DE102007062052A1 (de) | 2007-12-21 | 2009-06-25 | Siemens Ag | Schichtdickenmessung an transparenten Schichten |
-
2010
- 2010-09-24 DE DE102010046438A patent/DE102010046438A1/de not_active Ceased
-
2011
- 2011-09-09 WO PCT/EP2011/004553 patent/WO2012038036A1/de not_active Ceased
- 2011-09-09 EP EP11760701.0A patent/EP2619547B1/de active Active
- 2011-09-09 US US13/818,188 patent/US9222879B2/en active Active
- 2011-09-09 EP EP14192072.8A patent/EP2848916B1/de active Active
-
2015
- 2015-08-27 US US14/837,012 patent/US20160054217A1/en not_active Abandoned
-
2017
- 2017-08-07 US US15/670,297 patent/US20170336316A1/en not_active Abandoned
Non-Patent Citations (1)
| Title |
|---|
| See references of WO2012038036A1 * |
Also Published As
| Publication number | Publication date |
|---|---|
| US9222879B2 (en) | 2015-12-29 |
| WO2012038036A1 (de) | 2012-03-29 |
| US20160054217A1 (en) | 2016-02-25 |
| EP2848916B1 (de) | 2018-08-22 |
| US20130222803A1 (en) | 2013-08-29 |
| EP2848916A1 (de) | 2015-03-18 |
| DE102010046438A1 (de) | 2012-03-29 |
| EP2619547B1 (de) | 2017-08-09 |
| US20170336316A1 (en) | 2017-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2848916B1 (de) | Vorrichtung und Verfahren zur optischen Charakterisierung von Materialien | |
| DE19717488C2 (de) | Vorrichtung zur Inspektion der Oberfläche von Objekten | |
| DE69530831T2 (de) | Vereisungs- und Schneedetektorsystem für Oberflächen die spiegelnd Licht reflektieren | |
| DE69731651T2 (de) | Sortiervorrichtung | |
| DE19511534C2 (de) | Verfahren und Vorrichtung zur Erfassung von 3D-Fehlstellen bei der automatischen Inspektion von Oberflächen mit Hilfe farbtüchtiger Bildauswertungssysteme | |
| DE102009000528B4 (de) | Inspektionsvorrichtung und -verfahren für die optische Untersuchung von Objektoberflächen, insbesondere von Waferoberflächen | |
| DE112014004645T5 (de) | System und Verfahren zur Inspektion feuchter Kontaktlinsen | |
| DE69411308T2 (de) | Verfahren und Vorrichtung zur automatischen Sortierung von Produkten, hauptsächlich von Früchten oder Gemüsen | |
| DE102014108789B4 (de) | Mehrstufiges Verfahren zur Untersuchung von Oberflächen sowie entsprechende Vorrichtung | |
| DE202007014466U1 (de) | Vorrichtung zur Klassifizierung transparenter Bestandteile in einem Materialstrom | |
| DE102009044151A1 (de) | Vorrichtung zur optischen Waferinspektion | |
| EP3039411B1 (de) | Anordnung zur analyse eines durch brechung und reflexion an einem schmuckstein hervorgerufenen lichtmusters | |
| EP2144052A1 (de) | Verfahren und Vorrichtung zum Detektieren und Klassifizieren von Defekten | |
| DE69530925T2 (de) | Anordnung und verfahren zum nachweis von fehlern im holz | |
| DE10163657A1 (de) | Vorrichtung und Verfahren zur Untersuchung dünner Schichten | |
| DE102018202051A1 (de) | Vorrichtung zum automatischen Prüfen von Linsen und Verfahren zum automatischen Prüfen einer Vielzahl von Linsen | |
| EP3465145A2 (de) | Konfigurierbares retroreflex-sensorsystem zur verbesserten charakterisierung der eigenschaften einer probe | |
| DE102019201272B4 (de) | Vorrichtung, Vermessungssystem und Verfahren zur Erfassung einer zumindest teilweise spiegelnden Oberfläche unter Verwendung zweier Spiegelungsmuster | |
| DE102015105128B4 (de) | Verfahren und Vorrichtung zur Messung des Glanzgrads und/oder der Mattheit von Gegenständen | |
| DE102008044991B4 (de) | Verfahren und Vorrichtung zur dreidimensionalen Erfassung von Objektoberflächen | |
| DE102011103253B4 (de) | Anordnung zur optischen Bestimmung einer Probe und entsprechendes Verfahren | |
| EP4643114A1 (de) | Vorrichtung und verfahren zur detektion und/oder analyse von partikeln | |
| DE102023107276A1 (de) | Verfahren und Untersuchungssystem zur Materialuntersuchung flächiger Objekte | |
| EP1197926B1 (de) | Verfahren zur Erkennung eines Prägebilds einer Münze in einem Münzautomaten | |
| DE102004018856A1 (de) | Vorrichtung zur Prüfung von Banknoten |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20130418 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAX | Request for extension of the european patent (deleted) | ||
| 17Q | First examination report despatched |
Effective date: 20140704 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20170313 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 917378 Country of ref document: AT Kind code of ref document: T Effective date: 20170815 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502011012778 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 7 |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20170809 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171109 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171110 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171209 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171109 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502011012778 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20170930 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170909 |
|
| 26N | No opposition filed |
Effective date: 20180511 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170930 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170909 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170930 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170930 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 917378 Country of ref document: AT Kind code of ref document: T Effective date: 20170909 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170909 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20110909 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170809 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170809 |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Free format text: CASE NUMBER: UPC_APP_327395/2023 Effective date: 20230524 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20250917 Year of fee payment: 15 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20250918 Year of fee payment: 15 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20250922 Year of fee payment: 15 |