EP3175428A1 - Procédé d'extraction de motifs non périodiques masques par des motifs périodiques, et dispositif mettant en oeuvre le procédé - Google Patents
Procédé d'extraction de motifs non périodiques masques par des motifs périodiques, et dispositif mettant en oeuvre le procédéInfo
- Publication number
- EP3175428A1 EP3175428A1 EP15749755.3A EP15749755A EP3175428A1 EP 3175428 A1 EP3175428 A1 EP 3175428A1 EP 15749755 A EP15749755 A EP 15749755A EP 3175428 A1 EP3175428 A1 EP 3175428A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- amplitude spectrum
- measurement signal
- amplitude
- spectrum
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 75
- 238000001228 spectrum Methods 0.000 claims abstract description 163
- 238000005259 measurement Methods 0.000 claims abstract description 78
- 238000001914 filtration Methods 0.000 claims abstract description 33
- 238000004458 analytical method Methods 0.000 claims abstract description 11
- 230000000877 morphologic effect Effects 0.000 claims abstract description 8
- 230000000737 periodic effect Effects 0.000 claims description 63
- 230000008569 process Effects 0.000 claims description 11
- 238000003384 imaging method Methods 0.000 claims description 7
- 238000004364 calculation method Methods 0.000 claims description 6
- 230000006835 compression Effects 0.000 claims description 6
- 238000007906 compression Methods 0.000 claims description 6
- 230000006870 function Effects 0.000 description 30
- 235000012431 wafers Nutrition 0.000 description 28
- 230000003595 spectral effect Effects 0.000 description 10
- 238000012545 processing Methods 0.000 description 9
- 230000009466 transformation Effects 0.000 description 6
- 238000013459 approach Methods 0.000 description 5
- 239000012634 fragment Substances 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 230000000873 masking effect Effects 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 230000011218 segmentation Effects 0.000 description 4
- 230000007547 defect Effects 0.000 description 3
- 238000004377 microelectronic Methods 0.000 description 3
- 238000000844 transformation Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000003908 quality control method Methods 0.000 description 2
- 230000003252 repetitive effect Effects 0.000 description 2
- 239000004753 textile Substances 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000014616 translation Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 1
- 230000010339 dilation Effects 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000007670 refining Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 229940095676 wafer product Drugs 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
- G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
- G06K19/06009—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/10—Image enhancement or restoration using non-spatial domain filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/16—Image preprocessing
- G06V30/162—Quantising the image signal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/16—Image preprocessing
- G06V30/164—Noise filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/16—Image preprocessing
- G06V30/168—Smoothing or thinning of the pattern; Skeletonisation
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L21/00—Processes or apparatus adapted for the manufacture or treatment of semiconductor or solid state devices or of parts thereof
- H01L21/67—Apparatus specially adapted for handling semiconductor or electric solid state devices during manufacture or treatment thereof; Apparatus specially adapted for handling wafers during manufacture or treatment of semiconductor or electric solid state devices or components ; Apparatus not specifically provided for elsewhere
- H01L21/67005—Apparatus not specifically provided for elsewhere
- H01L21/67242—Apparatus for monitoring, sorting or marking
- H01L21/67294—Apparatus for monitoring, sorting or marking using identification means, e.g. labels on substrates or labels on containers
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L23/00—Details of semiconductor or other solid state devices
- H01L23/544—Marks applied to semiconductor devices or parts, e.g. registration marks, alignment structures, wafer maps
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/02—Preprocessing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/02—Preprocessing
- G06F2218/04—Denoising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20056—Discrete and fast Fourier transform, [DFT, FFT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30141—Printed circuit board [PCB]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30148—Semiconductor; IC; Wafer
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L2223/00—Details relating to semiconductor or other solid state devices covered by the group H01L23/00
- H01L2223/544—Marks applied to semiconductor devices or parts
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L2223/00—Details relating to semiconductor or other solid state devices covered by the group H01L23/00
- H01L2223/544—Marks applied to semiconductor devices or parts
- H01L2223/54406—Marks applied to semiconductor devices or parts comprising alphanumeric information
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L2223/00—Details relating to semiconductor or other solid state devices covered by the group H01L23/00
- H01L2223/544—Marks applied to semiconductor devices or parts
- H01L2223/54413—Marks applied to semiconductor devices or parts comprising digital information, e.g. bar codes, data matrix
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L2223/00—Details relating to semiconductor or other solid state devices covered by the group H01L23/00
- H01L2223/544—Marks applied to semiconductor devices or parts
- H01L2223/54433—Marks applied to semiconductor devices or parts containing identification or tracking information
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L2223/00—Details relating to semiconductor or other solid state devices covered by the group H01L23/00
- H01L2223/544—Marks applied to semiconductor devices or parts
- H01L2223/54453—Marks applied to semiconductor devices or parts for use prior to dicing
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L2924/00—Indexing scheme for arrangements or methods for connecting or disconnecting semiconductor or solid-state bodies as covered by H01L24/00
- H01L2924/0001—Technical content checked by a classifier
- H01L2924/0002—Not covered by any one of groups H01L24/00, H01L24/00 and H01L2224/00
Definitions
- the present invention relates to a process for processing signals or images making it possible to extract non-periodic patterns masked by periodic patterns.
- It relates more particularly to a method of processing images from microelectronics to distinguish aperiodic structures such as characters, masked by periodic structures.
- the field of the invention is more particularly but in a nonlimiting manner that of signal or image processing for applications in the microelectronics industry.
- the wafers are engraved on the rear face with an identification pattern such as a 1D or 2D barcode, or alphanumeric characters.
- An image of the identification pattern is made by means of a camera. This image is then processed by a character recognition (OCR) or barcode reading program (for example) that decodes the identification pattern information and automatically provides the product identifier.
- OCR character recognition
- barcode reading program for example
- the wafers-products are glued on wafers supports which are perforated in the form of a periodic matrix of perforations.
- the identification pattern present on the wafer-product or possibly on the wafer support appears only partially because of the presence of the matrix of perforations.
- Another known approach is to use a wavelet transform to compute frequency characteristics of the periodic pattern and filter the image accordingly.
- the difference between the filtered image (which retains only the periodic pattern) and the initial image reveals the desired non-periodic elements.
- This approach is effective for a periodic pattern with a relatively small elementary pattern compared to the size of the desired aperiodic elements (support size of the base wavelet) and which can be simply translated by statistics directly related to the parameters of the wavelet used (for example in the field of textile quality control: angle and spatial frequency).
- the wafers during the process frequently include sets of periodic structures (transistors, etched patterns, ...) in the middle of which it may be necessary to identify aperiodic elements (defects, ).
- the object of the present invention is to propose a process for processing signals or images which makes it possible to separate, in said signals or images, non-periodic patterns at least partially masked by periodic patterns, and these periodic patterns.
- Another object of the present invention is to provide a signal or image processing method which makes it possible to extract, in said signals or images, non-periodic patterns which are at least partially masked by periodic patterns.
- Another object of the present invention is to propose a process for processing signals or images which makes it possible to distinguish, in wafer images, non-periodic patterns which are at least partially masked by periodic patterns, and these periodic patterns.
- Another object of the present invention is to provide a method for processing signals or images that makes it possible to extract identification patterns engraved or inscribed on wafers and at least partially masked by a periodic structure.
- the object of the present invention is also to propose a process for processing signals or images that makes it possible to separate identification patterns engraved or inscribed on wafers and at least partially masked by a periodic structure.
- This objective is achieved with a method for extracting information of interest from a measurement signal comprising a disturbance pattern of a periodic nature, characterized in that it comprises steps:
- the measurement signal may include, but not be limited to:
- a one-dimensional signal for example in the form of a function or a curve with an amplitude f (x) as a function of a position or a time along an axis x.
- This may be for example an intensity profile
- a two-dimensional signal for example in the form of an image with an intensity or a pixel value I (x, y) as a function of a position (x, y) in the plane of the image. It may be for example a grayscale image.
- the periodic perturbation pattern may comprise a pattern, defined for example by variations in amplitude or intensity of the function f (x) or the image I (x, y), which has a repetitive nature and whose frequency spectrum has peaks.
- the information of interest may be aperiodic or have periodicities. It is simply necessary that it does not generate significant peaks in the frequency spectrum of the signal or the image. This condition is generally satisfied when the information of interest is located (or has a restricted extent) in the spatial or temporal domain with respect to the disturbance pattern. If it is aperiodic, it does not generate a significant peak in the spectral domain, and if it is localized it generates at most only peaks of very low energy, and therefore of amplitude much smaller than the amplitude of the frequency peaks due to the motive. of disturbance.
- the amplitude spectrum of the measurement signal can be defined, without limitation, as being the frequency spectrum module of the measurement signal.
- the frequency spectrum can be obtained by performing a Fourier transform (one-dimensional 1D or two-dimensional 2D as appropriate) of the measurement signal.
- This Fourier transform can be performed directly on the measurement signal.
- the Fourier transform can be performed on an apodized or windowed measurement signal.
- the measurement signal is multiplied by a 1D or 2D window function with progressive edges (triangular or of Gaussian shape for example) which makes it possible to avoid sudden transitions at the ends, sources of spectrum folding and spectral noise. .
- the method according to the invention may comprise a step of generating the amplitude spectrum of the measurement signal with an application of dynamic compression to the amplitude of the frequency spectrum of said measurement signal.
- the amplitude spectrum can thus be obtained by applying a dynamic compression function to the frequency spectrum module. This reduces the dynamics and improves peak detection.
- the method according to the invention may comprise a step of multiplying a frequency spectrum of the measurement signal by the filtering function.
- the filtering function is generated so as to be representative of the frequency components of the disturbance pattern. It thus reproduces at least some of the essential spectral components of the disturbance pattern.
- This multiplication operation is performed preferably on the complete frequency spectrum (module and phase) of the measurement signal. It is performed symmetrically for the positive and negative frequencies so as to respect the Hermitian symmetry of the frequency spectrum of the measurement signal.
- the method according to the invention may comprise a step of searching, in an amplitude spectrum of the measurement signal, of zones called "maxima to h" respectively corresponding sets of related points around local amplitude maxima satisfying a minimum height criterion with respect to the nearest local amplitude minima.
- zones of maxima at h can for example be defined as sets of points that can be connected to the local maximum by a non-descending path, that is to say along the difference between two adjacent points in the direction of the local maximum. is always the same sign.
- the notion of local maxima can correspond to amplitude maxima. It should be noted, however, that in the context of the invention this notion may be interpreted differently according to the convention adopted.
- the local maxima can thus for example correspond to local extrema according to a convention of amplitude, sign and / or direction of predetermined variation.
- the minimum height criterion may in particular be defined as a predetermined fraction of the maximum amplitude of the amplitude spectrum of the measurement signal.
- the method according to the invention may comprise steps:
- the method according to the invention can comprise steps:
- the calculation of the amplitude spectrum of the peaks may further comprise a step of applying a threshold, the values below said threshold being set to zero.
- the method according to the invention may further comprise a step of generating a filtering function from the amplitude spectrum of the peaks, with a non-zero constant value in the areas of the amplitude spectrum of the peaks with a greater amplitude. at a predetermined binarization threshold, and a zero value elsewhere.
- the method according to the invention may furthermore comprise a step of filling local minima of shallow depth with:
- the method according to the invention can comprise steps:
- the registration may be performed in particular in enlargement or in homothety, and / or in rotation.
- the method according to the invention can be implemented with a measurement signal comprising an image of one of the following types: image of at least a part of a wafer, image of at least a portion of an assembly of wafers, image of at least a portion of a wafer fixed on a wafer support.
- It may include a step of extracting information of interest from one of the following forms: identification information, alphanumeric characters, writing signs, 1D bar code, 2D bar code, QR code.
- the invention may thus relate to a method for extracting information of interest, in particular information of interest of one of the following forms: identification information, alphanumeric characters, writing signs , 1D bar code, 2D bar code, QR code, of a measurement signal, in particular a measurement signal comprising an image of one of the following types: image of at least a part of a wafer, image of at least a portion of a wafer assembly, image of at least a portion of a wafer attached to a wafer carrier, which measurement signal comprises a periodic perturbation pattern.
- the method according to the invention may comprise a step of extracting information of interest such as one or more isolated or singular elements, for example from a manufacturing process (tracks, vias, waveguides, ...) or corresponding to defects (cracks, 7), an image comprising a reason of disturbance of nature periodic or a repetitive structure such as a set of transistors, etched components, a diffraction grating.
- a device for extracting information of interest from a measurement signal comprising a periodic perturbation pattern comprising imaging means for acquiring a measurement signal in the form of an image. , and calculating means arranged for:
- the method according to the invention is therefore based on a principle which consists in subtracting from the signal or the original measurement image a filtered version of this signal or this image which essentially contains the periodic perturbation pattern.
- the filtering is performed in the frequency domain, preferably globally over the entire signal or image.
- the periodic pattern can be taken in its entirety, and the filtering is then effective regardless of the complexity of this pattern.
- the filtering function is generated by implementing an analysis of the amplitude spectrum of the measurement signal based on morphological criteria.
- the invention implements tools from mathematical morphology techniques or more generally form analysis.
- the method according to the invention also has the advantage that it does not require knowledge of the characteristics of the texture or the structure of the periodic pattern.
- FIG. 1 illustrates a mode of implementation of the method according to the invention to identify references of wafers stuck on perforated supports
- FIG. 2 illustrates a general block diagram of the method according to the invention
- FIG. 3 illustrates the generation of the filtering function according to a first embodiment of the invention
- FIG. 4 illustrates the generation of the filtering function according to a second embodiment of the invention
- FIG. 5 illustrates a variant applicable to the first and second embodiments of the invention
- FIG. 6 illustrates results obtained with the method according to the invention, with FIG. 6a first initial image, FIG. 6b the corresponding filtered image, FIG. 6c a second initial image and FIG. 6d the corresponding filtered image.
- this identification code 11 comprises alphanumeric characters.
- the wafers 10 are glued to glass supports 12. These supports 12 are perforated in the form of a periodic pattern 13 of perforations.
- the identification pattern 11 present on the wafer 10 under the support 12 appears only partially because of the presence of the periodic pattern 13 of perforations. This identification pattern 11 is therefore partially hidden by the support 12, either because it is partially covered by the support 12, or because it is only partially printed or etched on the support 12 in its solid areas.
- an imaging device that comprises a camera 14 (or any other imaging means) and calculation means 15, for example based on a microprocessor or a computer:
- an image of the identification pattern 11 is acquired with the camera 14; the image is processed to extract the identification pattern 11 (segmentation);
- the information of the identification pattern 11 is extracted to obtain the identifier 16 of the wafer 10, for example by means of a software of character recognition (OCR) or bar code reading if necessary.
- OCR optical character recognition
- the method according to the invention therefore comprises a step 21 for acquiring or obtaining a measurement signal in the form of an initial image I, which comprises information of interest 11 (the identification code 11) partially masked by a periodic perturbation pattern 13 (the periodic pattern 13).
- the initial image I can be directly acquired by the camera 14, or be derived from storage means (hard disk, memory, etc.).
- an initial image I is considered in which the identification code 11 appears dark on a light background, and the periodic pattern 13, which is in the form of a periodic matrix of holes 13. , is dark too.
- the intensity level of the holes of the periodic pattern 13 may be equivalent to that of the character fragments of the identification code 13, which prevents spatial segmentation by gray level according to known methods.
- An apodized image I a is then constructed , which corresponds to the initial image I in which the intensity of the pixels over a margin of width A is reduced to tend towards a constant value (for example 0) at the edge of the image.
- the apodization function can be for example a Gaussian, or more simply a linear decrease.
- the apodized image I a is obtained by multiplication of the initial image I by the apodization function.
- the advantage of this apodization step (which is not necessary, however) is to limit the edge effects when calculating the Fourier transform: as the digital Fourier transform assumes a periodic image, any discontinuity between the edges left and right (and up and down) of the image leads to the appearance of virtual frequencies by a spectrum aliasing effect. It is therefore preferable to use an apodization function which has a spectrum essentially limited to low frequencies.
- the method according to the invention also comprises a step 22 for calculating the frequency spectrum F of the initial image I.
- This frequency spectrum F is obtained by means of a two-dimensional digital Fourier transform calculation.
- the frequency spectrum F is therefore a complex image with Hermitian symmetry.
- the method according to the invention then comprises a step 23 for calculating a spectrum of amplitude F m of the initial image I.
- this amplitude spectrum F m corresponds to the logarithm of the standard or frequency spectrum module F:
- the interest of taking the logarithm of the modulus of the frequency spectrum F and not just its modulus is that it introduces a compression of the dynamics of the amplitude spectrum F m .
- the spectral intensity in the frequency spectrum F around the zero frequency is of several orders of magnitude above that of the high frequencies: the logarithmic compression makes it possible to reduce the dynamics to a smaller extent.
- the method according to the invention also comprises a step 24 of generating a filtering function representative of the frequency components of the periodic perturbation pattern 13.
- This filtering function is obtained by implementing an analysis of the amplitude spectrum F m on the basis of morphological criteria. Several variants of this analysis are possible within the scope of the invention. They will be described later.
- the peaks of the amplitude spectrum F m which correspond to the characteristic frequencies of the periodic pattern 13 are selected by implementing morphological criteria and / or methods derived from the mathematical morphology;
- bit mask B which represents precisely the selection in the amplitude spectrum F m of the frequency peaks corresponding to the characteristic frequencies of the periodic pattern 13.
- This bit mask comprises non-zero values (for example one) for the frequencies corresponding to the zones of the selected frequency peaks and zero values (zero) for the other frequencies.
- the method according to the invention also comprises a step 25 of masking the frequency spectrum F by the bit mask B to generate a filtered frequency spectrum F B.
- This masking can be achieved for example by an operation of multiplication of the frequency spectrum F by the bit mask B:
- any complex element of F that does not belong to B is set to zero in F B , and kept otherwise.
- This masking operation is performed in such a way as to preserve the Hermitian symmetry of the frequency spectrum F in the filtered frequency spectrum F B.
- F B Hermitian symmetry
- the method according to the invention also comprises a step 26 for calculating the inverse two-dimensional Fourier transform of the filtered frequency spectrum F B.
- a so-called "perturbation" image J is thus obtained which is real if the Hermitian symmetry of the frequency spectrum F has been respected during the masking.
- the disturbance image J corresponds to the initial image I (or more precisely of the apodized initial image I a ) filtered from all the non-periodic elements (or low spectral energy) of I.
- the perturbation image J comprises therefore essentially the periodic disturbance pattern 13.
- This disturbance image J also retains the illumination variations of the initial image I because the very low frequencies belong to the peak whose peak is the zero frequency.
- the method according to the invention also comprises a step 27 for calculating a filtered image R, corresponding to a pixel-by-pixel difference between the disturbance image J and the initial image I (or more precisely the initial image apodized I a ):
- the character fragments 11 appear sharp and brilliant, or at least much more discernible than in the measurement image I.
- OCR segmentation and character recognition
- this generation mode of the bit mask B is illustrated by one-dimensional curves.
- Such curves may for example be representative of a profile along a frequency axis of the amplitude spectrum F m .
- a first step we search, in the amplitude spectrum F m (curve 30), the zones 34 called "from maxima to h". These zones 34, also called h-maxima according to the terminology of the mathematical morphology, respectively correspond to sets of connected points around local amplitude maxima 33 which satisfy a minimum height criterion h with respect to the local amplitude minima. the closest.
- the criterion of minimum height h is defined as being a fraction of the maximum amplitude of the amplitude spectrum F m .
- h is set at 25% of this maximum amplitude.
- an off-axis amplitude spectrum F d (curve 31) is generated which corresponds to the amplitude spectrum F m offset in amplitude towards the lower amplitudes of h:
- a clipped amplitude spectrum F e is then calculated by performing a geodesic reconstruction of the shifted amplitude spectrum F d in the amplitude spectrum F m .
- This geodesic reconstruction is defined as a repetition until reaching the spectrum of amplitude F m of a dilation of the amplitude spectrum offset F d with a structuring element g plane parallel to the frequency plane (or one-dimensional parallel to the axis frequencies in case of one-dimensional geodesic reconstruction).
- this geodesic reconstruction can be written: SU Pn > o ⁇ (e g Fn T (F d ) ⁇ ,
- the result of the geodesic reconstruction of the shifted amplitude spectrum F d in the amplitude spectrum F m is illustrated by the curve 32.
- This clipped amplitude spectrum F e curve thus corresponds to the spectrum of amplitude F m clipped h-maximum areas 34 (that is to say clipped at amplitudes less than h to the amplitude of local maxima 33 that satisfy the h-maxima criterion).
- An amplitude spectrum of the zones of maxima is then calculated at h F m h by making the difference between the amplitude spectrum F m and the clipped amplitude spectrum F e corresponding to the geodesic reconstruction E g Fm (F d ) .
- the amplitude spectrum of the maxima zones is binarized at h F mh with respect to a predefined binarization threshold.
- a mask B is thus obtained with non-zero values (for example one) in the zones greater than the binarization threshold and zero values in the zones below the binarization threshold. If this binarization threshold is set to zero as illustrated in FIG. 3, the non-zero areas of mask B correspond to h-maxima 34.
- bit mask B With reference to FIG. 4, we will now describe in detail a second generation mode of the bit mask B.
- this generation mode of the bit mask B is illustrated by one-dimensional curves.
- Such curves may for example be representative of a profile along a frequency axis of the amplitude spectrum F m .
- a spectrum of minima F min (curve 42) which has the value of local minima 41 at the corresponding frequencies and a value of zero at the other frequencies.
- a basic amplitude spectrum F b is then calculated by performing a geodesic reconstruction of the spectrum of minima F min in the amplitude spectrum F m .
- the geodesic reconstruction is defined as a repetition until reaching the spectrum of amplitude F m of an expansion of the spectrum of minima F min with a structuring element g plane parallel to the plane of frequencies (or one-dimensional parallel to the frequency axis in the case of one-dimensional geodesic reconstruction).
- E g Fm (F min ) sup n > o ⁇ (e g Fm ) n (F min ) ⁇ ,
- An amplitude spectrum of the peaks F p is then calculated by difference between the amplitude spectrum F m and the basic amplitude spectrum F b . This spectrum of amplitude of the peaks F p is illustrated by the curve 44.
- this binarization threshold h p may, for example, be set as a fraction of the maximum amplitude of the amplitude spectrum of the peaks F p .
- this binarization threshold h p is set at 50% of the maximum amplitude of the amplitude spectrum of the peaks F p , so as to reject the low amplitude peaks.
- a mask B is thus obtained with non-zero values (for example one) in the zones greater than the binarization threshold h p and zero values in the zones below the binarization threshold.
- a mask B is obtained which is well representative of the spectral zones in which the energy due to the periodic pattern 13 is important. It is thus possible to take into account not only the position of the frequency peaks but also their width or their extent. This allows a reconstruction of the periodic pattern 13 very accurate and very faithful.
- the method according to the invention may comprise an additional step of filling the shallow local minima of the amplitude spectrum F m .
- This step can be implemented with the first mode or with the second generation mode of the bit mask B.
- the purpose of this variant is to eliminate the artifacts that may appear when the amplitude spectrum F m comprises very close peaks, partially merged.
- bit mask B is generated according to the methods described with reference to FIGS. 3 and FIG. 4 from a filled amplitude spectrum F mc instead of using the amplitude spectrum F m .
- the amplitude spectrum filled F mc is calculated as follows:
- an amplitude spectrum inverted and offset F mid is then generated, by shifting the inverted amplitude spectrum F mi towards the small amplitudes by a quantity h c representative of the minimum depth to be filled;
- the amplitude amplitude spectrum F mc (curve 54) is obtained by performing amplitude symmetry on the inverted amplitude spectrum F mci .
- the filled amplitude spectrum F mc thus obtained corresponds to the amplitude spectrum F m in which the minima with a depth up to the quantity h c (or in other words the h-minima with a depth parameter between 0 and h c ) are filled. It should be noted that h-minima with a depth greater than h c are not affected.
- a predetermined reference filtering function is used, in the form of a reference mask B r .
- This reference mask B r is a binary mask representative of the frequency components of the periodic perturbation pattern 13. It is determined from a reference image.
- This reference image can be obtained in different ways. It can be for example:
- the reference binary mask B r is generated.
- a reference binary mask B r is well representative of the spectral zones in which the energy due to the periodic pattern 13 is important, which takes into account not only the position of the frequency peaks but also their width or their extent.
- a reference bit mask B r can thus be calculated once and for all.
- the imaging conditions of this periodic pattern 13 may be different between the reference image and the initial image I.
- these Differences in imaging conditions can be essentially modeled by at least one transformation among a translation, a rotation and a magnification or a homothety.
- the initial image I can be directly acquired by the camera 14, or be derived from storage means (hard disk, memory, etc.).
- This detection can be performed with a simple algorithm since it can be limited to detecting the position of the most important frequency peaks (essentially due to the periodic pattern 13).
- a frequency-domain registration of the reference bit mask B r is then performed so that it adapts or corresponds at best to the main local maxima of the amplitude spectrum F m .
- this registration can be carried out with a limited set of transformations since one can limit oneself to the transformations which concern the Fourier transform module: homotheties along the frequency axis (s) with the zero frequency for origin and / or rotation around it zero frequency.
- it is not necessary to take into account the translations in the space of the initial image I which affect only the phase of the Fourier transform.
- the transformation function T comprises a transformation or a combination of transformations among: one or more homotheties along the frequency axis or axes with the zero frequency for origin and / or a rotation around the zero frequency.
- the registration may be performed according to known methods, for example by minimizing a least squares error function.
- Fig. 6 illustrates results obtained with the method according to the invention.
- the images presented are details of processed images.
- Figs. 6a and Figs. 6c show initial images I obtained with a camera 14 on wafers 10 glued on glass supports 12, perforated in the form of a periodic pattern 13 of perforations.
- the identification pattern 11 present is difficult to read on these images, in particular on that of FIG. 6c.
- Figs. 6b and FIG. 6d show filtered images R obtained with the method according to the invention in its mode of implementation described in relation to FIG. 3, and applied respectively to the initial images I of FIGS. 6a and Figs. 6c.
- the method according to the invention greatly improves the readability of the identification pattern 11, both for a human eye and for a processing with a character recognition algorithm (OCR).
- OCR character recognition algorithm
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Computer Hardware Design (AREA)
- Power Engineering (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1457369A FR3024568B1 (fr) | 2014-07-30 | 2014-07-30 | Procede d'extraction de motifs non periodiques masques par des motifs periodiques, et dispositif mettant en oeuvre le procede |
PCT/EP2015/067343 WO2016016289A1 (fr) | 2014-07-30 | 2015-07-29 | Procede d'extraction de motifs non periodiques masques par des motifs periodiques, et dispositif mettant en oeuvre le procede |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3175428A1 true EP3175428A1 (fr) | 2017-06-07 |
Family
ID=52273225
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15749755.3A Withdrawn EP3175428A1 (fr) | 2014-07-30 | 2015-07-29 | Procédé d'extraction de motifs non périodiques masques par des motifs périodiques, et dispositif mettant en oeuvre le procédé |
Country Status (7)
Country | Link |
---|---|
US (1) | US20170161887A1 (fr) |
EP (1) | EP3175428A1 (fr) |
KR (1) | KR20170037963A (fr) |
CN (1) | CN106575356A (fr) |
FR (1) | FR3024568B1 (fr) |
TW (1) | TW201617972A (fr) |
WO (1) | WO2016016289A1 (fr) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113251945B (zh) * | 2021-05-17 | 2022-07-12 | 东北大学秦皇岛分校 | 一种线轮廓成像装置的解调方法及成像装置 |
CN117933970A (zh) * | 2023-09-15 | 2024-04-26 | 浙江恒逸石化有限公司 | 丝路巡检设备的控制方法、装置、设备以及存储介质 |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5513275A (en) * | 1993-01-12 | 1996-04-30 | Board Of Trustees Of The Leland Stanford Junior University | Automated direct patterned wafer inspection |
US6192160B1 (en) * | 1996-09-19 | 2001-02-20 | Hyundai Microelectronics Co., Ltd. | Hardware architectures for image dilation and erosion operations |
US5943551A (en) * | 1997-09-04 | 1999-08-24 | Texas Instruments Incorporated | Apparatus and method for detecting defects on silicon dies on a silicon wafer |
DE10115502A1 (de) * | 2001-03-29 | 2002-10-10 | Promos Technologies Inc | Raumfilterverfahren zur Fehleruntersuchung eines Geräts |
JP3754933B2 (ja) * | 2001-06-19 | 2006-03-15 | キヤノン株式会社 | 画像処理装置、画像処理システム、画像処理方法、プログラム及び記憶媒体 |
JP2003150954A (ja) * | 2001-11-14 | 2003-05-23 | Fuji Photo Film Co Ltd | 周期的パターン抑制処理方法および装置 |
KR100429804B1 (ko) * | 2001-12-29 | 2004-05-03 | 삼성전자주식회사 | 적응적 영상 노이즈 감쇄 장치 및 그 방법 |
JP2009195512A (ja) * | 2008-02-22 | 2009-09-03 | Fujifilm Corp | 放射線画像処理装置 |
US20100225011A1 (en) * | 2009-03-06 | 2010-09-09 | Taiwan Semiconductor Manufacturing Company, Ltd. | System and Method for Integrated Circuit Fabrication |
EP2821010A4 (fr) * | 2012-02-27 | 2015-11-25 | Fujifilm Corp | Dispositif et procédé de traitement d'image |
CN103679643B (zh) * | 2013-06-03 | 2016-06-29 | 哈尔滨工程大学 | 一种多条纹噪声定位滤除方法 |
-
2014
- 2014-07-30 FR FR1457369A patent/FR3024568B1/fr active Active
-
2015
- 2015-07-27 TW TW104124195A patent/TW201617972A/zh unknown
- 2015-07-29 WO PCT/EP2015/067343 patent/WO2016016289A1/fr active Application Filing
- 2015-07-29 US US15/325,684 patent/US20170161887A1/en not_active Abandoned
- 2015-07-29 EP EP15749755.3A patent/EP3175428A1/fr not_active Withdrawn
- 2015-07-29 CN CN201580040396.5A patent/CN106575356A/zh active Pending
- 2015-07-29 KR KR1020177002430A patent/KR20170037963A/ko unknown
Also Published As
Publication number | Publication date |
---|---|
FR3024568B1 (fr) | 2021-06-18 |
CN106575356A (zh) | 2017-04-19 |
FR3024568A1 (fr) | 2016-02-05 |
US20170161887A1 (en) | 2017-06-08 |
KR20170037963A (ko) | 2017-04-05 |
WO2016016289A1 (fr) | 2016-02-04 |
TW201617972A (zh) | 2016-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
BE1017547A6 (fr) | Compression d'images numeriques de documents scannes. | |
EP2710555B1 (fr) | Méthode de détermination des éléments en relief présents sur la surface d'un pneumatique | |
Hassan et al. | Real-time image dehazing by superpixels segmentation and guidance filter | |
EP3572976A1 (fr) | Procede de traitement d'un flux d'images video | |
EP2145293A2 (fr) | Dispositif de comptage de cartes | |
Deshpande et al. | A novel modified cepstral based technique for blind estimation of motion blur | |
FR3047103A1 (fr) | Procede de detection de cibles au sol et en mouvement dans un flux video acquis par une camera aeroportee | |
EP3175428A1 (fr) | Procédé d'extraction de motifs non périodiques masques par des motifs périodiques, et dispositif mettant en oeuvre le procédé | |
Ansari et al. | A novel approach for scene text extraction from synthesized hazy natural images | |
FR3050300A1 (fr) | Procede et dispositif de detection automatique de zones de pollution sur une surface d'eau | |
Moghaddam | Out of focus blur estimation using genetic algorithm | |
FR2950451A1 (fr) | Algorithme de detection des points de contour dans une image | |
EP3314574A1 (fr) | Procédé de segmentation d'image | |
EP4260228A1 (fr) | Procédé de vérification d'une image numérique | |
EP1525553A2 (fr) | Procede et systeme de localisation automatique de zones de texte dans une image | |
WO2017001765A1 (fr) | Procédé de segmentation d'image | |
Zhu et al. | Passive millimeter wave image denoising based on adaptive manifolds | |
EP2884456B1 (fr) | Procédé de réstitution du mouvement haute fréquence de la ligne de visée d'un imageur | |
Wang et al. | Coherence enhancing diffusion and windowed Fourier filtering for fringe patterns denoising (II) | |
Parlewar et al. | An Efficient Saliency Detection Using Wavelet Fusion | |
Parlewar et al. | An Efficient Saliency Detection Using Wavelet Fusion Check for updates | |
Rathore et al. | A Review Paper on Guided Image Filtering Technique | |
Ahn et al. | Adaptive object-region-based image pre-processing for a noise removal algorithm | |
FR3075437A1 (fr) | Procede de synthese d'images | |
EP4276750A1 (fr) | Procédé et dispositif de traitement d'image pour la localisation de gouttes représentatives de défauts ou irrégularités |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
17P | Request for examination filed |
Effective date: 20170125 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: UNITY SEMICONDUCTOR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20210202 |