EP3811063A1 - Device and method for detecting and/or evaluating articles or products - Google Patents
Device and method for detecting and/or evaluating articles or productsInfo
- Publication number
- EP3811063A1 EP3811063A1 EP19731272.1A EP19731272A EP3811063A1 EP 3811063 A1 EP3811063 A1 EP 3811063A1 EP 19731272 A EP19731272 A EP 19731272A EP 3811063 A1 EP3811063 A1 EP 3811063A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- products
- radiation
- detector array
- detectors
- raman
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/65—Raman scattering
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8806—Specially adapted optical and illumination features
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/89—Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles
- G01N21/8901—Optical details; Scanning details
- G01N21/8903—Optical details; Scanning details using a multiple detector array
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N2021/6463—Optics
- G01N2021/6471—Special filters, filter wheel
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N2021/845—Objects on a conveyor
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8806—Specially adapted optical and illumination features
- G01N2021/8845—Multiple wavelengths of illumination or detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
- G01N2021/8887—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques
Definitions
- the invention relates to a device and a method for recognizing and / or evaluating products or products. These can be different products or products that are or have been manufactured industrially. In the case of an evaluation, the quality can preferably be checked and, if necessary, a classification, sorting or assignment can be carried out.
- one or more products or products are irradiated with a laser beam emitted by a laser beam source such that Raman or fluorescent radiation is generated on surfaces or areas of the surface of products or products.
- the generated Raman or fluorescent radiation is aimed at a detector array designed for spatially resolved detection of this radiation.
- detectors of the detector array can be arranged in a row which, for example, is aligned perpendicular to the direction of advance movement of a stream of products or products or in a row and column arrangement, with which a detection across the width of the stream can preferably be possible.
- the products or products are at least approximately monochromatic electromagnetic radiation, the central wavelength of which is selected such that there is no influence on the Raman or fluorescent radiation Detection takes place, preferably directed over the width of the individual products or products emitted by several diodes emitting this electromagnetic radiation.
- the individual detectors of the detector array are designed for spatially resolved detection of electromagnetic radiation reflected or scattered by the products or products.
- An optical filter or a beam splitter is arranged between the products or the detector array and is designed such that electromagnetic radiation with the wavelength of the laser beam does not strike the detectors of the detector array.
- An optical filter can be a bandpass or edge filter. With a beam splitter, electromagnetic radiation from the wavelength range of the laser radiation of the laser beam can be deflected such that this wavelength range of the laser radiation cannot strike detectors of the detector array.
- the irradiation and detection takes place during a relative movement between the products or products, the focus area of the laser beam, the electromagnetic radiation-emitting diodes and the detectors of the detector array.
- the products or products are moved and all other components mentioned can be rigidly attached.
- At least the detectors of the detector array are connected to an electronic evaluation unit.
- the electronic evaluation unit is designed for spatially and spectrally resolved evaluation of intensities of Raman or fluorescence radiation detected with detectors of the detector array and for carrying out an image analysis to determine the shape and position detection of individual products or products.
- the laser beam for exciting Raman or fluorescent radiation can be swiveled by at least one or at least one axis rotatable reflective element or by means of a line-shaped optical lens, across the width in which products or products are arranged.
- Swiveling reflective elements can be so-called scanner or galvo mirrors.
- a rotatable reflecting element can have several planar reflecting surfaces distributed over its circumference, onto which a beam can be directed successively during the rotation. It can have the shape of a polygon mirror, on the circumferential surface of which several reflecting flat surfaces are arranged one after the other in the direction of rotation.
- a reflective element which can be pivoted about at least one axis or a reflective element which can be rotated about an axis of rotation should be designed or controlled in such a way that the movement of the focus area of the laser beam during the generation of Raman or fluorescent radiation takes place at a frequency which is greater than the frequency, with which the detection takes place.
- the electronic evaluation unit should advantageously be used to detect spectral intensity differences of intensities detected with detectors of at least one wavelength and / or to extract parameters, in particular by means of a multivariate or chemometric data analysis, preferably with a main component analysis, discriminant analysis, support vector method, a neural network, cluster analysis , random forest method.
- HIS systems Classic hyperspectral image systems
- Inexpensive silicon-based detectors can be used.
- the respective samples to be sorted can be excited optically without contact using a laser beam.
- RAMAN scattering or fluorescence is excited.
- the laser wavelength should be selected so that
- the signals of the RAMAN scattering / fluorescence can be detected in the optimal range of the detectors. This can be the area with the highest quantum efficiency.
- a further area of the detector array can be used for the shape detection, the central wavelength (ZWL) of a line with the diodes of which can be emitted at least approximately monochromatic electromagnetic radiation can be chosen in this way that the RAMAN / fluorescence signals detected with detectors are not influenced.
- ZWL central wavelength
- detectors that are sensitive in a wavelength range between 400 nm - 1000 nm, laser radiation at a wavelength of 532 nm can be used.
- RAMAN / fluorescence can be detected up to approx. 700 nm and diodes with ZWL of 850 nm can be used for irradiation and then for image analysis.
- the data recorded on individual detectors can be processed separately.
- the parameters required for the respective task can be extracted from the spectra recorded with the detectors in a spatially resolved manner. These can be obtained both from spectral intensity differences (at one or more wavelengths) and as a clear criterion for multivariate / chemometric data analysis (e.g. main component analysis, discriminant analysis, support vector method, neural networks [deep learning methods], cluster analysis, random forest Methods etc.).
- multivariate / chemometric data analysis e.g. main component analysis, discriminant analysis, support vector method, neural networks [deep learning methods], cluster analysis, random forest Methods etc.
- the determined shape, color, layer, surface, material and position / location parameters and / or data obtained from the image analysis can again together with the knowledge gained from the spectral evaluation for further sample classification / sample evaluation for samples, that are formed with several articles or products can be used.
- the laser beam (coherent, monochromatic point source) can be guided by means of a scanner mirror (galvanoscanner or rotating mirror) across the width of the current formed with products or products or onto the surface of individual products or products, which is done at a significantly higher speed than the recording frequency should
- a scanner mirror galvanoscanner or rotating mirror
- an optical line lens can also be used, so that the intensity applied per location point, per unit of time decreases o
- the laser beam can be introduced obliquely or vertically via a dichroic beam splitter o
- An optical edge or notch filter can be arranged in front of the HSI system be with which the excitation wavelength can be masked out for the detectors, otherwise overexposure and signal superimposition can occur
- Diodes for example a row of diodes, can be inserted on one or two sides of an observation line, the angle is variable (shading may have to be taken into account)
- the intrinsic combination of mechanical imaging (diode rows) and imaging spectroscopy (HSI system) for the evaluation enables a complex determination of evaluation characteristics, in particular taking into account the shape / uniformity of the different products or products.
- the invention is therefore based on a laser excitation, the simultaneous Detection of RAMAN and / or fluorescence signals as well as data for shape recognition / image acquisition in an unused spectral range of detectors. Previously, this had to be done in two separate optical test systems (spectroscopy system + machine vision system). This enables a completely new type of optical inspection of surfaces, components (general: industrial products).
- the invention can be used in the quality and process control of industrial products, such as
- Figure 1 shows an example of a device according to the invention in a schematic representation.
- a laser beam 1 with a wavelength of 532 nm is pivotable about an axis, the laser beam 1 reflecting element 6 via a current directed with products 3.
- the focal spot of the laser beam 1 is directed over the entire width of the current moving in one direction, which is formed with the products 3.
- the movement of the focal spot takes place perpendicular to the direction of advance of the current.
- Raman scattering is generated and / or fluorescent radiation is excited.
- This electromagnetic radiation has a central wavelength of 850 nm and a scattering around this wavelength of ⁇ 10%.
- This irradiation preferably takes place in the area of the surfaces of the products 3, in which no Raman scattering or fluorescent radiation is detected.
- a detector array 4 is arranged, which is formed with a plurality of detectors arranged in a row or in a row and column arrangement.
- the detectors are designed in such a way that they enable spatially and spectrally resolved detection of intensities.
- a spectral spatially resolved analysis and a spatially resolved image analysis are thus possible.
- the measurement signals of the individual detectors are fed to an electronic evaluation unit (not shown), with which products 3 can be evaluated, for example, from certain materials or with certain shapes or colors / color combinations.
- an optical filter 5 is arranged between the area irradiated with the laser beam 1 and the detector array 4, which can be used to prevent reflected and scattered laser radiation from striking the detectors of the detector array 4 and can adversely affect the actual measurement signals.
- the optical filter 5 is an edge filter that is almost completely transparent only for electromagnetic radiation with wavelengths greater than 532 nm.
- the evaluation can be done using a PC.
- the recorded data from the detector must be transmitted via a sufficiently fast data connection.
- the software must be able to evaluate the data at the speed of acquisition.
- the procedure for the evaluation can be defined as a 'recipe', or it can be freely defined in advance. Ideally, only the results of the evaluation are saved, the original data are discarded. In addition to the results of the detection, other data such as location information and time stamps can also be recorded and passed on.
Landscapes
- Health & Medical Sciences (AREA)
- Analytical Chemistry (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Textile Engineering (AREA)
- Engineering & Computer Science (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102018210019.5A DE102018210019B4 (en) | 2018-06-20 | 2018-06-20 | Device and method for recognizing and / or evaluating products or products |
PCT/EP2019/065742 WO2019243199A1 (en) | 2018-06-20 | 2019-06-14 | Device and method for detecting and/or evaluating articles or products |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3811063A1 true EP3811063A1 (en) | 2021-04-28 |
Family
ID=66912864
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19731272.1A Withdrawn EP3811063A1 (en) | 2018-06-20 | 2019-06-14 | Device and method for detecting and/or evaluating articles or products |
Country Status (5)
Country | Link |
---|---|
US (1) | US20210318243A1 (en) |
EP (1) | EP3811063A1 (en) |
JP (1) | JP2021527826A (en) |
DE (1) | DE102018210019B4 (en) |
WO (1) | WO2019243199A1 (en) |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5073495A (en) * | 1988-10-21 | 1991-12-17 | Large Scale Biology Corporation | Apparatus for isolating cloned vectors and cells having a recovery device |
US5508200A (en) * | 1992-10-19 | 1996-04-16 | Tiffany; Thomas | Method and apparatus for conducting multiple chemical assays |
DE4426490C2 (en) * | 1993-07-27 | 1996-10-24 | Hohla Kristian | Method for analyzing metallic parts that are moved by a transport unit and device for carrying out the method |
ES2218937T3 (en) * | 1994-06-16 | 2004-11-16 | Dade Behring Marburg Gmbh | PROCEDURE AND DEVICE FOR MIXING LIQUIDS. |
WO1999036576A1 (en) * | 1998-01-20 | 1999-07-22 | Packard Bioscience Company | Gel pad arrays and methods and systems for making them |
US20030119193A1 (en) * | 2001-04-25 | 2003-06-26 | Robert Hess | System and method for high throughput screening of droplets |
DE502004008634D1 (en) * | 2003-01-10 | 2009-01-22 | Schott Ag | METHOD AND DEVICE FOR SELECTION OF RECYCLING GLASS |
US7181055B2 (en) * | 2003-08-15 | 2007-02-20 | Holger Lange | Systems and methods for registering reflectance and fluorescence hyperspectral imagery |
CA2685158C (en) * | 2007-04-25 | 2017-09-26 | The United States Of America, As Represented By The Secretary Of Agricture | Simultaneous acquisition of fluorescence and reflectance imaging techniques with a single imaging device |
DE102008059788B4 (en) * | 2008-12-01 | 2018-03-08 | Olympus Soft Imaging Solutions Gmbh | Analysis and classification of biological or biochemical objects on the basis of time series images, applicable to cytometric time-lapse cell analysis in image-based cytometry |
DE102009057119A1 (en) * | 2009-12-08 | 2011-06-09 | Titech Gmbh | Apparatus and method for the separation of heavy, with undesirable compositions accumulating chunks |
WO2012139088A2 (en) * | 2011-04-08 | 2012-10-11 | Accusentry, Inc. | System and method for generating multiple, interlaced images using a single scanning camera with multiple, alternating light sources |
EP2791660A1 (en) * | 2011-12-12 | 2014-10-22 | Visys NV | A system and a method for individually inspecting objects in a stream of products and a sorting apparatus comprising such system |
DE102016114465B4 (en) * | 2016-08-04 | 2022-12-01 | Hydro Aluminium Recycling Deutschland Gmbh | Apparatus and method for alloy analysis of metal scrap fragments |
-
2018
- 2018-06-20 DE DE102018210019.5A patent/DE102018210019B4/en active Active
-
2019
- 2019-06-14 US US17/252,759 patent/US20210318243A1/en not_active Abandoned
- 2019-06-14 WO PCT/EP2019/065742 patent/WO2019243199A1/en unknown
- 2019-06-14 JP JP2020570943A patent/JP2021527826A/en active Pending
- 2019-06-14 EP EP19731272.1A patent/EP3811063A1/en not_active Withdrawn
Also Published As
Publication number | Publication date |
---|---|
DE102018210019B4 (en) | 2020-04-02 |
DE102018210019A1 (en) | 2019-12-24 |
US20210318243A1 (en) | 2021-10-14 |
JP2021527826A (en) | 2021-10-14 |
WO2019243199A1 (en) | 2019-12-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE102009000528B4 (en) | Inspection device and method for the optical examination of object surfaces, in particular of wafer surfaces | |
EP3164695B1 (en) | Method and device for determining a material type and/or surface characteristics of a workpiece | |
DE112015005826B4 (en) | MULTICOLOR FLUORESCENCE ANALYZER | |
DE112015000627B4 (en) | Microspectroscopic device | |
DE102014018726A1 (en) | Apparatus and method for testing feature substances | |
EP3392650B1 (en) | Device for spectroscopic analysis | |
DE102014103640A1 (en) | Apparatus and method for examining surface properties | |
EP2895844B1 (en) | Apparatus with an arrangement of optical elements | |
EP3371577A1 (en) | Arrangement for determining the surface quality of component surfaces | |
EP2551663A1 (en) | Method and device for inspecting coatings with effect pigments | |
US10663393B2 (en) | Spectrum inspecting apparatus | |
DE60214561T2 (en) | Fluorimetric multi-parameter analysis in a parallel multi-focus arrangement | |
EP1441218A2 (en) | Method for detecting fluorescent light | |
EP3811063A1 (en) | Device and method for detecting and/or evaluating articles or products | |
DE19610393A1 (en) | Identification and/or classification of precious stones using light spectrometer | |
DE3720387C1 (en) | Method and device for examining the physical properties of thin layers by means of polarised light | |
EP3325941B1 (en) | Assembly for determining the permeation rate of a sample | |
DE102012019471B4 (en) | Device and method for determining material properties | |
DE102006032404B4 (en) | Apparatus and method for determining surface properties | |
DE102004051311B4 (en) | Apparatus and method for performing fluorescence and emission spectrometry | |
DE102006018287B4 (en) | Apparatus and method for the spectral analytical evaluation of materials or objects in a material or object stream | |
DE102006032405B4 (en) | Determination of surface properties with slope correction | |
DE102021122713A1 (en) | Device and method for inspecting surfaces with wavelength analysis | |
CN114199377A (en) | Near-infrared nanometer enhanced spectrometer | |
DE102010022631A1 (en) | Measuring device for spectroscopy, has light emitting diode for generating light for executing spectroscopy and detection unit for receiving light |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20210113 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20210928 |
|
RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V. |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20220608 |