WO2020102611A1 - Using deep learning based defect detection and classification schemes for pixel level image quantification - Google Patents
Using deep learning based defect detection and classification schemes for pixel level image quantification Download PDFInfo
- Publication number
- WO2020102611A1 WO2020102611A1 PCT/US2019/061578 US2019061578W WO2020102611A1 WO 2020102611 A1 WO2020102611 A1 WO 2020102611A1 US 2019061578 W US2019061578 W US 2019061578W WO 2020102611 A1 WO2020102611 A1 WO 2020102611A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- processor
- pixels
- defects
- wafer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01J—ELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
- H01J37/00—Discharge tubes with provision for introducing objects or material to be exposed to the discharge, e.g. for the purpose of examination or processing thereof
- H01J37/02—Details
- H01J37/22—Optical, image processing or photographic arrangements associated with the tube
- H01J37/222—Image processing arrangements associated with the tube
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/9501—Semiconductor wafers
- G01N21/9505—Wafer internal defects, e.g. microcracks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01J—ELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
- H01J37/00—Discharge tubes with provision for introducing objects or material to be exposed to the discharge, e.g. for the purpose of examination or processing thereof
- H01J37/26—Electron or ion microscopes; Electron or ion diffraction tubes
- H01J37/28—Electron or ion microscopes; Electron or ion diffraction tubes with scanning beams
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
- G06T2207/10061—Microscopic image from scanning electron microscope
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30148—Semiconductor; IC; Wafer
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01J—ELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
- H01J2237/00—Discharge tubes exposing object to beam, e.g. for analysis treatment, etching, imaging
- H01J2237/22—Treatment of data
- H01J2237/221—Image processing
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01J—ELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
- H01J2237/00—Discharge tubes exposing object to beam, e.g. for analysis treatment, etching, imaging
- H01J2237/244—Detection characterized by the detecting means
- H01J2237/2448—Secondary particle detectors
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01J—ELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
- H01J2237/00—Discharge tubes exposing object to beam, e.g. for analysis treatment, etching, imaging
- H01J2237/26—Electron or ion microscopes
- H01J2237/28—Scanning microscopes
- H01J2237/2803—Scanning microscopes characterised by the imaging method
- H01J2237/2806—Secondary charged particle
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01J—ELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
- H01J2237/00—Discharge tubes exposing object to beam, e.g. for analysis treatment, etching, imaging
- H01J2237/26—Electron or ion microscopes
- H01J2237/28—Scanning microscopes
- H01J2237/2809—Scanning microscopes characterised by the imaging problems involved
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01J—ELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
- H01J2237/00—Discharge tubes exposing object to beam, e.g. for analysis treatment, etching, imaging
- H01J2237/26—Electron or ion microscopes
- H01J2237/28—Scanning microscopes
- H01J2237/2813—Scanning microscopes characterised by the application
- H01J2237/2817—Pattern inspection
Definitions
- Fabricating semiconductor devices typically includes processing a semiconductor wafer using a large number of fabrication processes to foim various features and multiple levels of the semiconductor devices.
- lithography is a semiconductor fabrication process that involves transferring a pattern from a reticle to a photoresist arranged on a semiconductor wafer. Additional examples of semiconductor fabrication processes include, but are not limited to, chemical-mechanical polishing (CMP), etch, deposition, and ion implantation. Multiple semiconductor devices may be fabricated in an arrangement on a single semiconductor wafer and then separated into individual semiconductor devices.
- CMP chemical-mechanical polishing
- Inspection processes are used at various steps during semiconductor manufacturing to detect defects on wafers to promote higher yield in the manufacturing process and, thus, higher profits. Inspection has always been an important part of fabricating semiconductor devices such as integrated circuits (ICs). However, as the dimensions of semiconductor devices decrease, inspection becomes even more important to the successful manufacture of acceptable semiconductor devices because smaller defects can cause the devices to fail. For instance, as the dimensions of
- process induced failures tend to be systematic. That is, process-induced fai lines tend to fail at predetermined design patterns often repeated many times within the design. Elimination of spatiaily-systematic, electricaUy-relevant defects can have an impact on yield.
- Defect review typically involves high resolution imaging and classification of defects that were flagged by an inspection process using either a. high magnification optical system or a scanning electron microscope (SEM). Defect review is typically performed at discrete locations on specimens where defects have been detected by inspection. The higher resolution data for the defects generated by defect review is more suitable for determining attributes of the defects such as profile, roughness, or more accurate size information.
- SEM scanning electron microscope
- Optical inspection of a semiconductor wafer during manufacturing is generally a slow, manual process.
- Defect teams at semiconductor fabrication plant usually use optical tools for wafer inspection, but typically perform SEM review of defects for verification.
- SEM review of defects for verification.
- Fabs use automatic detection and classification schemes to save the time and effort involved in defect classification.
- the automatic detection and classification schemes have limitations and are not a replacement for a human classification. Besides requiring large computation power, automatic detection and classification schemes are prone to nuisance or instances of multiple, non-important defects.
- An optimal inspection recipe for a semiconductor layer should detect as many defects of interest (DOIs) as possible while maintaining a substantially low nuisance rate.
- DOIs defects of interest
- pixel level quantification of defects used edge detection and computation or grey level difference based algorithms. These techniques are not flexible for process variation- induced changes in the structures of interest. Grey level changes caused by imaging artefacts are known to induce sources of error in the computation. Distinguishing between similar looking intended and process-induced random defect modes may be challenging or even impossible. [0010] Therefore, improved techniques and systems for defect detection and classification are needed.
- a system in a first embodiment.
- the system comprises an electron beam source that generates an electron beam ; a stage configured to hold a wafer in a path of the electron beam; a detector configured to receive the election beam returned from the wafer; and a processor in electronic communication with the detector.
- the processor is configured to represent a heat map of probable defects in an image as a matrix of defect probability index corresponding to each pixel and quantify a number of pixels in the image that exceed a corresponding threshold in the matrix.
- the image is generated from data received from the detector.
- the system can further include a deep learning module operated by the processor.
- the deep learning module can be configured to receive the image, perform defect detection on the image, and perfonn defect classification on the image. [0013] In an instance, the processor is further configured to determine the heat map.
- the corresponding threshold for one of the pixels can be at a same location on the image as the one of the pixels.
- the quantifying can be used in pixel level image quantification.
- the probable defects can be EUV stochastics or critical dimension defects.
- the image may be a scanning electron microscope image
- a method is provided in a second embodiment.
- the method comprises repr esenting a heat map of probable defects in an image as a matrix of defect probability index corresponding to each pixel using a processor and quantifying, using the processor, a number of pixels in the image that exceed a corresponding threshold in the matrix.
- the image is generated from data received from a detector.
- the method can further include receiving the image at the processor, performing defect detection on the image using a deep learning module of the processor, and performing defect classification on the image using the deep learning module of the processor. [0020] In an instance, the method further includes determining the heat map using the processor. [0021] The corresponding threshold for one of the pixels can be at a same location on the image as the one of the pixels. [0022] The quantifying can be used in pixel level image quantification. [0023] The probable defects can be EUV stochastics or critical dimension defects. [0024] The image may be a scanning electron microscope image.
- the method further comprises directing an electron beam at the wafer, collecting electrons returned from the wafer with a detector, and generating, using the processor, the image of the wafer.
- a non- transitory computer readable medium storing a program can be configured to instruct a processor to execute the method of the second embodiment.
- FIG. 1 is a flowchart of an embodiment of a method in accordance with the present disclosure
- FIG. 2 is an exemplary SEM image:
- FIG. 3 includes another exemplary SEM image with two bottom bridges (left), results of a conventional algorithm (center), and results of a SMARTS algorithm (right);
- FIG. 4 is an exemplary wafer heat map
- FIG. 5 illustrates a chart of deviation percentage for diameter of individual contact holes from the average diameter of the 1x1 mm SEM field of view (upper left), a binary image showing the pixels that are considered defective after being thresholded (upper right), the 1x1 fun SEM image of the 10x10 contact hole matrix (bottom right), and results (bottom left) for the region of FIG. 4 with the thick box and value of 16.7;
- FIG. 6 illustrates a chart of deviation percentage for diameter of individual contact holes from the average diameter of the 1x1 mm SEM field of view (upper left), a binary image showing the pixels that are considered defective after being thresholded (upper right), the 1x1 ;mi SEM image of the 10x10 contact hole matrix (bottom right), and results (bottom left) for the region of FIG. 4 with the thick box and value of 19.4;
- FIG. 7 illustrates a chart of deviation percentage for diameter of individual contact holes from the average diameter of the 1x1 mm SEM field of view (upper left), a binary image showing the pixels that are considered defective after being thresholded (upper right), the 1x1 mm SEM image of the 10x10 contact hole matrix (bottom right), and results (bottom left) for the region of FIG. 4 with the thick box and value of 15.7;
- FIG. 8 illustrates a chart of deviation percentage for diameter of individual contact holes from the average diameter of the 1x1 mm SEM field of view (upper left), a binary image showing the pixels that are considered defective after being thresholded (upper right), the 1x1 mm SEM image of the 10x10 contact hole matrix (bottom right), and results (bottom left) for the region of FIG. 4 with the thick box and value of 17.1 ;
- FIG. 9 is a chart of critical dimension diameter of the contact holes in the SEM image of FIG. 5;
- FIG. 10 is a chart of critical dimension diameter of the contact holes in the SEM image of FIG. 6;
- FIG. 11 is a chart of critical dimension diameter of the contact holes in the SEM image of FIG. 7;
- FIG. 12 is a chart of critical dimension diameter of the contact holes in the SEM image of FIG. 8;
- FIG. 13 is a table of results for the images of FIGS. 5-8.
- FIG. 14 is a block diagram of a system in accordance with the present disclosure.
- Embodiments disclosed herein use deep learning-based defect detection and/or classification networks for pixel level image quantification.
- deep learning can be used for pixel level quantification of SEM images. This can be used in applications like extreme ultraviolet (EUV) stochastics rate quantification or critical dimension (CD)
- Embodiments disclosed herein can be integrated in the existing defect detection or classification schemes for review tools or inspection tools.
- Deep learning-based defect detection and classification algorithms can provide pixel level SEM image quantifica tion.
- a pixel level quantification of images may be needed by semiconductor manufacturers.
- pixel level quantification can be used with critical dimension measurements when a particular geometric parameter of the structure like pattern width, gap, distance, or diameter is measured by quantifying the number of pixels between two edges or comers of a structure.
- Pixel level quantification also can be used with EUV stochastics.
- An objective of an EUV stochastics application is to quantify the number of defective pixels in a given SEM image that give raise to particular defect modes. These defective pixels are neither hard repeaters nor are they completely random, like process defects.
- quantifying the images may be needed to provide desired results.
- Pixel level accuracy may be needed because the number of failed pixels and good pixels are counted.
- Stochastics for example, can be caused by molecular level inaccuracies in the patterning process, which leads to pixel or even sub-pixel level failures on the wafer.
- Deep learning-based defect detection and classification algorithms can provide quantification of SEM images at a pixel level accuracy.
- Embodiments disclosed herein use deep learning-based defect detection and classification (like SMARTS from KLA-Tencor Corporation) for pixel quantification. This is achieved by training a particular image set in an appropriate way such that the deep learning algorithm only flags DOIs, while not flagging the random process induced defects even though they are structurally or morphologically similar to the DOIs.
- deep learning-based defect detection and classification like SMARTS from KLA-Tencor Corporation
- FIG. 1 is a flowchart of an embodiment of a method 100.
- a heat map of probable defects in an image is represented as a matrix of defect probability index corresponding to each pixel.
- the probable defects may be EUV stochastics, critical dimension defects, bridges, line breaks, protrusions, missing contacts, merged contacts, shrunk contacts, or other types of defects.
- the image is generated from data received from a detector, such as a detector in an SEM.
- the image can be a grey level image or can be a black and white image.
- the matrix can be zeroes and ones. Zeroes may correspond to defects.
- differences can be artificially induced (e.g., artefacts) or process variations. Such differences may not be defects.
- Step 102 a number of pixels in the image that exceed a corresponding threshold in the matrix are quantified.
- the corresponding threshold for one of the pixels may be at a same location on the image as that pixel. Tims, each pixel may have a threshold, part of an image may have a threshold, or a whole image may have a threshold.
- Step 102 can quantify a number of pixels that fail in an image or part of an image. The quantification can be expressed as a number or as a percentage of the total pixels. Pixels less than a threshold are considered not defective while pixels equal to or more than the threshold are considered defective in this instance, though pixels equal to or less than the threshold may be considered defective in another instance.
- a nuisance rate can be nmed to required levels using the detection threshold parameter.
- the threshold can be tuned depending on the application or desired sensitivity.
- Quantifying the pixels may use or include pixel level image quantification.
- the steps 101 and 102 can be performed in real-time during defect detection and defect classification. Steps 101 and 102 may be performed on a processor .
- the method 100 may be stored on a non-transitory computer readable medium, such as the electronic data storage unit 209 in FIG. 14.
- the image is received at the processor.
- Defect detection and defect classification are performed on the image using a deep learning module of the processor.
- the heat map may be generated by the processor.
- the deep learning module can be tr ained with, for example, exemplary images with defect codes.
- contact hole inrages are used to train the deep learning module. The contact hole size relative to an ideal size for the contact holes can be used to identify defects.
- Defect detection and classification may provide a quantitative output.
- Thequantitative output can be used for quantification.
- Non-quantitative output may be more difficult to use for quantification calculations.
- Deep learning-based pixel quantification can be sensitive to real DOIs while successfully ignoring random process induced variations.
- Embodiments disclosed herein can be accurate down to +/- 2% accuracy in critical dimension predictions from a training set, which is much lower than error budgets in existing techniques. In an instance using embodiments disclosed herein, sensitivity down to +/- 1% accuracy in critical dimension predictions beyond intended or random process induced critical dimension modulations is possible.
- the embodiments disclosed herein can be integrated in existing detection platforms or classifica tion pla tforms and can use of the existing parameter space for optinrization.
- test layer of EUV contact hole (CH) array after development inspection (ADI) step post-lithography
- CH EUV contact hole
- ADI development inspection
- the techniques disclosed herein can be valid for any non-ADI step.
- H test set uses an SEM image with a 0.5 mm field of view.
- the SEM image can have 100 contact holes like that shown in FIG. 2 or can have other numbers of contact holes.
- the deep learning based defect detection algorithm is trained and used to identify contact holes in a verification set of images that are smaller than the rest of the contact holes in a particular ⁇ image by a certain percent. If the deep learning approach can identify defective contact holes, then it can be used to quantify the number of defective pixels in an image. Pixel level quantification has many applications, including quantifying the EUV stochastics failure rate. EUV stochastics failures can exhibit themselves by critical dimension variation of structrrres over smaller scale areas or by having missing structures (e.g., pixels) in images.
- a focus exposure matrix (FEM) wafer of contact hole amtys exposed by EUV lithography can be used as a test material for this example.
- FEM focus exposure matrix
- One SEM image 0.5 mm field of view
- Each SEM image may have 100 contact holes in it.
- this heat map is converted into a matrix of probability indices that represent the probability of each pixel being defective (e.g., on a scale from
- a training set can be further optimized by, for example, factoring in images with varying average critical dimension (e.g., diameter) to reduce nuisance further.
- D2DB enabled training such as with design clips as reference, also can result in a nuisance reduction for pixel level quantification.
- D2DB is a technique of defect detection where the semiconductor or device design is used as a reference. A SEM image or an optical patch is compared to the design clip of the particular location and any anomaly in the images with respect to the design is flagged as defective pixel(s).
- Tlie deep learning algorithm may be sensitive to smalt critical dimension changes, so it may be used to assess local critical dimension variations across a structure. Besides providing a way to quantify defects, determining the quantification can be implemented to improve performance of the algorithm used for pixel level defect detection.
- FIGS. 3-13 illustrate timing a nuisance rate to required levels using the detection threshold parameter.
- the threshold (Thr) is different to provide optimal detection results.
- FIG. 3 includes an exemplary SEM image with two bottom bridges (left), results of a conventional algoritiim (center), and results of a SMARTS algorithm (right).
- the SMARTS deep- learning engine can detect and classify defects in SEM images better than conventional algorithms.
- the conventional algorithm in FIG. 3 has high noise.
- FIG. 4 is an exemplary wafer heat map of mean diameter (e.g., critical dimension) of
- EUV stochastics are present in this example.
- the EUV stochastics can be a gating factor for EUV in high volume manufacturing.
- EUV lithography (13.5 nm light) can be a scaling enabler ( ⁇ 7 nm node).
- the stochastics can be random (e.g., local and/or global) structural variations.
- the root causes can be materials, scanner parameters, or structural dependencies.
- FIG. 5-8 shows a percent deviation of diameter for individual contact hole from the average diameter of the 1x1 mm SEM field of view.
- the top right image in FIGS 5-8 shows a binary image showing the pixels that are considered defective after being thresholded. Pixels that are missing on the shrunk contact holes, if present, would have made the diameter of these contacts similar to the average diameter of the SEM field of view. This is used to calculate the number of pixels that failed.
- the bottom left image in FIGS. 5-8 shows contact holes that are smaller by more than 10% from the average diameter of the SEM field of view, which are tagged with a -1. The contacts that are tagged as 0 are not sliruuk by more than 10% from the average of the SEM field of view.
- FIG. 5 corresponds to the region of FIG. 4 with the thick box and value of 16.7.
- FIG. 6 corresponds to the region of FIG. 4 with the thick box and value of 19.4.
- FIG. 7 corresponds to the region of FIG. 4 with the thick box and value of 15.7.
- FIG. 8 corresponds to the region of FIG. 4 with the thick box and value of 17.1.
- labels A-F represent the following.
- A represents a real defect capture (CH shrink > 10%)
- C represents a gross nuisance (CH shrink ⁇ 10%).
- E represents a defect type that is not annotated.
- F represents a gross miss (CH shrink » 10%).
- FIG. 9 is a chart of critical dimension diameter of the contact holes in the SEM image of FIG. 5.
- FIG. 10 is a chart of critical dimension diameter of the contact holes in the SEM image of
- FIG. 6 is a chart of critical dimension diameter of the contact holes in the SEM image of FIG. 7.
- FIG. 12 is a cliart of critical dimension diameter of the contact holes in the SEM image of FIG. 8.
- FIG. 13 is a table of results for the images of FIGS. 5-8. As seen in the results,
- FIG. 14 is a block diagram of a system 200.
- the system 200 includes a wafer inspection tool (which includes the electron column 201) configured to generate images of a wafer
- the system 200 also can be configitred as a. review tool instead of an inspection tool.
- the wafer inspection tool includes an output acquisition subsystem that includes at least an energy source and a detector.
- the output acquisition subsystem may be an electron beam- based output acquisition subsystem.
- the energy directed to the wafer 204 includes elections, and the energy detected from the wafer 204 includes electrons.
- the energy source may be an electron beam source.
- the output acquisition subsystem includes electron column 201, which is coupled to computer subsystem 202.
- a stage 210 may hold the wafer 204.
- the electron column 201 includes an electron beam source 203 configured to generate electrons that are focused to wafer 204 by one or more elements 205.
- the electron beam source 203 may include, for example, a cathode source or emitter tip.
- the one or more elements 205 may include, for example, a gim lens, an anode, a beam limiting aperture, a gate valve, a beam current selection aperture, an objective lens, and a scanning subsystem, all of which may include any such suitable elements known in the art.
- Electrons returned from the wafer 204 e.g., secondary electrons
- One or more elements 206 may include, for example, a scanning subsystem, which may be the same scanning subsystem included in element(s) 205.
- the electron column 201 also may include any other suitable elements known in the art.
- the electron column 201 is shown in FIG. 14 as being configured such that the electrons are directed to live wafer 204 at an oblique angle of incidence and are scattered from the wafer 204 at another oblique angle, the electron beam may be directed to and scattered from the wafer 204 at any suitable angles.
- the electron beam-based output acquisition subsystem may be configured to use multiple modes to generate images of the wafer 204 (e.g., with different illumination angles, collection angles, etc.). The multiple modes of the electron beam-based output acquisition subsystem may be different in any image genera tion parameters of the output acquisition subsystem.
- Computer subsystem 202 may be coupled to detector 207 as described above.
- the detector 207 may detect electrons returned from the surface of the wafer 204 thereby Ibmiing electron beam images of the wafer 204.
- the electron beam images may include any suitable electron beam images.
- Computer subsystem 202 may be configured to perform any of the functions described herein using the output of the detector 207 and/or the electron beam images.
- Computer subsystem 202 may be configured to perform any additional step(s) described herein.
- a system 200 that includes the output acquisition subsystem shown in FIG. 14 may be further configured as described herein.
- FIG. 14 is provided herein to generally illustrate a configuration of an electron beam-based output acquisition subsystem that may be used in the embodiments described herein.
- the electron beam-based output acquisition subsystem configuration described herein may be altered to optimize the performance of the output acquisition subsystem as is normally performed when designing a commercial output acquisition system.
- the systems described herein may be implemented using an existing system (e.g., by adding functionality described herein to an existing system).
- the methods described herein may be provided as optional functionality of the system (e.g., in addition to other functionality of the system).
- the system described herein may be designed as a completely new system.
- the output acquisition subsystem may be an ion beam-based output acquisition subsystem.
- Such an output acquisition subsystem may be configured as shown in FIG. 14 except that the electron beam source may be replaced with any suitable ion beam source known in the art.
- the output acquisition subsystem may be any other suitable ion beam-based output acquisition subsystem such as those included in commercially available focused ion beam (FIB) systems, helium ion microscopy (HIM) systems, and secondary ion mass spectroscopy (SIMS) systems.
- FIB focused ion beam
- HIM helium ion microscopy
- SIMS secondary ion mass spectroscopy
- the computer subsystem 202 includes a processor 208 and an electronic data storage unit 209.
- the processor 208 may include a microprocessor, a microcontroller, or other devices.
- the computer subsystem 202 may be coupled to the components of the system 200 in any suitable manner (e.g., via one or more transmission media, wiiich may include wired and/or wireless transmission media) such that the processor 208 can receive output.
- the processor 208 may be configured to perform a number of functions using the output.
- the wafer inspection tool can receive instructions or other information from the processor 208.
- the processor 208 and/or the electronic data storage unit 209 optionally may be in electronic communication with another wafer inspection tool, a wafer metrology tool, or a wafer review tool (not illustrated) to receive additional information or send instructions.
- the processor 208 is in electronic communication with the wafer inspection tool, such as the detector 207.
- the processor 208 may be configured to process images generated using measurements fr om the detector 207 and quantify a number of pixels in the image that exceed a corresponding threshold in the matrix. For example, tiie processor may perform embodiments of the method 100.
- the computer subsystem 202, other system(s), or other subsystem(s) described herein may be part of various systems, including a personal computer system, image computer, mainfr ame computer system, workstation, network appliance, internet appliance, or other device.
- the subsystem(s) or system(s) may also include any suitable processor known in the art, such as a parallel processor.
- the subsystem(s) or system(s) may include a platform with highspeed processing and software, either as a standalone or a networked tool.
- the processor 208 and electronic data storage unit 209 may be disposed in or otherwise part of the system 200 or another device.
- the processor 208 and electronic data storage unit 209 may be part of a standalone control unit or in a centralized quality control unit. Multiple processors 208 or electronic data storage units 209 may be used.
- the processor 208 may be implemented in practice by any combination of hardware, software, and firmware. Also, its functions as described herein may be performed by one unit, or divided up among different components, each of which may be implemented in turn by any combination of hardware, software and firmware. Progr am code or instructions for the processor 208 to implemeut various methods and functions may be stored in readable storage media, such as a memory in the electronic data storage unit 209 or other memory.
- the system 200 includes more than one computer subsystem 202, then the different subsystems may be coupled to each other such that images, data, information, instructions, etc, can be sent between the subsystems.
- one subsystem may be coupled to additional subsystem(s) by any suitable transmission media, which may include any suitable wired and/or wireless transmission media known in the art.
- Two or more of such subsystems may also be effectively coupled by a shared computer-readable storage medium (not shown).
- the processor 208 may be configured to perform a number of fimctious using the output of the system 200 or other output. For instance, the processor 208 may be configured to send the output to an electronic data storage unit 209 or another storage medium. The processor 208 may be further configured as described herein.
- the processor 208 or computer subsystem 202 may be part of a defect review system, an inspection system, a metrology system, or some other type of system.
- the embodiments disclosed herein describe some configurations that can be tailored in a number of manners for systems having different capabilities that are more or less suitable for different applications.
- the processor 208 may be configured according to any of the embodiments described herein.
- the processor 208 also may be configur ed to perform other functions or additional steps using the output of the system 200 or using ima ges or data from other sources.
- the processor 208 is in electronic communication with the detector 207.
- the processor 208 is configured to represent a heat map of probable defects in an image as a matrix of defect probability index corresponding to each pixel.
- the processor 208 also is configured to quantify a number of pixels in the image that exceed a corresponding threshold in the matrix.
- the corresponding direshold for one of the pixels is at a same loca tion as that pixel.
- the processor 208 also can be configured to determine the heat map.
- the processor 208 may operate a deep learning module that is configured to receive an image, perform defect detection on the image, and perform defect classification on the image.
- the deep learning module may be a neural network, such as a convolution neural network, or some other type of deep learning system.
- the processor 208 may be conumuiicatively coupled to any of the various components or sub-systems of system 200 in any manner known in the art. Moreover, the processor
- the 208 may be configured to receive and/or acquire data or information from other systems (e.g., inspection results fionr an inspection system such as a review tool, a remote database including design data and the like) by a transmission medium that may include wired and/or wireless portions. In this manner, the transmission medium may serve as a data link between the processor 208 and other subsystems of the system 200 or systems external to system 200.
- other systems e.g., inspection results fionr an inspection system such as a review tool, a remote database including design data and the like
- the transmission medium may serve as a data link between the processor 208 and other subsystems of the system 200 or systems external to system 200.
- Various steps, functions, and'or operations of system 200 and the methods disclosed herein are carried out by one or more of the following: electronic circuits, logic gates, multiplexers, programmable logic devices, ASICs, analog or digital controls/switches, microcontrollers, or computing systems.
- Program instructions implementing methods such as those described herein may be transmitted over or stored on carrier medium.
- the carrier medium nray include a storage medium such as a read-only memory, a random access memory, a magnetic or optical disk, a nou- volatile memory, a solid state memory, a magnetic tape, and the like.
- a carrier medium nray inchrde a transmission medium such as a wire, cable, or wireless transmission link.
- each of the steps of the method may be performed as described herein.
- the methods also may include any other step(s) that can be performed by the processor and/or computer subsystem(s) or system(s) described herein.
- the steps can be performed by one or more computer" systems, which may be configtired according to any of the embodiments described herein.
- the methods described above may be performed by any of the system embodiments described herein.
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Analytical Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Quality & Reliability (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- Immunology (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Testing Or Measuring Of Semiconductors Or The Like (AREA)
- Analysing Materials By The Use Of Radiation (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020217018222A KR102513717B1 (ko) | 2018-11-15 | 2019-11-15 | 픽셀 레벨 이미지 정량화를 위한 딥 러닝 기반 결함 검출 및 분류 스킴의 사용 |
| JP2021526582A JP7216822B2 (ja) | 2018-11-15 | 2019-11-15 | 画素レベル画像定量のための深層学習式欠陥検出及び分類方式の使用 |
| CN201980073377.0A CN112969911B (zh) | 2018-11-15 | 2019-11-15 | 使用基于深度学习的缺陷检测及分类方案进行像素级图像量化 |
| EP19884619.8A EP3870959A4 (en) | 2018-11-15 | 2019-11-15 | USING DEEP LEARNING-BASED ERROR DETECTION AND CLASSIFICATION METHODS TO QUANTIFY IMAGE AT THE PIXEL LEVEL |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| IN201841042919 | 2018-11-15 | ||
| IN201841042919 | 2018-11-15 | ||
| US16/249,337 US10672588B1 (en) | 2018-11-15 | 2019-01-16 | Using deep learning based defect detection and classification schemes for pixel level image quantification |
| US16/249,337 | 2019-01-16 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020102611A1 true WO2020102611A1 (en) | 2020-05-22 |
Family
ID=70727871
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2019/061578 Ceased WO2020102611A1 (en) | 2018-11-15 | 2019-11-15 | Using deep learning based defect detection and classification schemes for pixel level image quantification |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US10672588B1 (https=) |
| EP (1) | EP3870959A4 (https=) |
| JP (1) | JP7216822B2 (https=) |
| KR (1) | KR102513717B1 (https=) |
| CN (1) | CN112969911B (https=) |
| TW (1) | TWI805868B (https=) |
| WO (1) | WO2020102611A1 (https=) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112884769A (zh) * | 2021-04-12 | 2021-06-01 | 深圳中科飞测科技股份有限公司 | 图像处理方法、装置、光学系统和计算机可读存储介质 |
Families Citing this family (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10546160B2 (en) | 2018-01-05 | 2020-01-28 | Datamax-O'neil Corporation | Methods, apparatuses, and systems for providing print quality feedback and controlling print quality of machine-readable indicia |
| US10803264B2 (en) | 2018-01-05 | 2020-10-13 | Datamax-O'neil Corporation | Method, apparatus, and system for characterizing an optical system |
| US10834283B2 (en) | 2018-01-05 | 2020-11-10 | Datamax-O'neil Corporation | Methods, apparatuses, and systems for detecting printing defects and contaminated components of a printer |
| US10795618B2 (en) | 2018-01-05 | 2020-10-06 | Datamax-O'neil Corporation | Methods, apparatuses, and systems for verifying printed image and improving print quality |
| US11501424B2 (en) * | 2019-11-18 | 2022-11-15 | Stmicroelectronics (Rousset) Sas | Neural network training device, system and method |
| US11200659B2 (en) | 2019-11-18 | 2021-12-14 | Stmicroelectronics (Rousset) Sas | Neural network training device, system and method |
| US11449711B2 (en) * | 2020-01-02 | 2022-09-20 | Applied Materials Isreal Ltd. | Machine learning-based defect detection of a specimen |
| US11651981B2 (en) * | 2020-08-18 | 2023-05-16 | Taiwan Semiconductor Manufacturing Co., Ltd. | Method and system for map-free inspection of semiconductor devices |
| US20220101114A1 (en) * | 2020-09-27 | 2022-03-31 | Kla Corporation | Interpretable deep learning-based defect detection and classification |
| KR20220127004A (ko) | 2021-03-10 | 2022-09-19 | 삼성전자주식회사 | 확률론적 콘투어 예측 시스템 및 확률론적 콘투어 예측 시스템의 제공 방법 및 확률론적 콘투어 예측 시스템을 이용한 EUV(Extreme Ultra violet) 마스크의 제공 방법 |
| WO2022207181A1 (en) * | 2021-03-30 | 2022-10-06 | Asml Netherlands B.V. | Improved charged particle image inspection |
| US20220335288A1 (en) * | 2021-04-16 | 2022-10-20 | Micron Technology, Inc. | Systems, apparatuses and methods for detecting and classifying patterns of heatmaps |
| FR3125156B1 (fr) * | 2021-07-12 | 2023-11-10 | Safran | Controle non destructif d’une piece |
| JP7034529B1 (ja) * | 2021-08-13 | 2022-03-14 | 株式会社ハシマ | 学習モデルの生成方法、学習モデル、検査装置、検査方法およびコンピュータプログラム |
| KR20230029409A (ko) * | 2021-08-24 | 2023-03-03 | 삼성전자주식회사 | 반도체 장치의 제조를 위한 방법, 전자 장치 및 전자 장치의 동작 방법 |
| EP4148499A1 (en) * | 2021-09-09 | 2023-03-15 | ASML Netherlands B.V. | Patterning device defect detection systems and methods |
| CN113935982B (zh) * | 2021-10-27 | 2024-06-14 | 征图新视(江苏)科技股份有限公司 | 基于深度学习的印刷质量检测分析系统 |
| CN115222658B (zh) * | 2022-06-01 | 2025-12-02 | 湖南长步道光学科技有限公司 | 一种多工位并行镜片缺陷检测方法和装置 |
| CN115965574B (zh) * | 2022-08-31 | 2025-03-14 | 东方晶源微电子科技(北京)股份有限公司 | 基于设计版图的扫描电子显微镜图像缺陷检测方法、装置 |
| US12136225B2 (en) * | 2022-09-09 | 2024-11-05 | Applied Materials, Inc. | Clog detection via image analytics |
| US20240169514A1 (en) * | 2022-11-21 | 2024-05-23 | Onto Innovation Inc. | Defect detection in manufactured articles using multi-channel images |
| TWI839046B (zh) * | 2022-12-26 | 2024-04-11 | 華邦電子股份有限公司 | 膜層中的縫隙的檢測方法 |
| CN116993669B (zh) * | 2023-06-29 | 2024-11-08 | 东方晶源微电子科技(上海)有限公司 | 扫描电镜图像缺陷的确定方法及装置 |
| CN116840238A (zh) * | 2023-07-04 | 2023-10-03 | 杭州中为光电技术有限公司 | 一种硅棒检测设备、检测方法及切割方法 |
| US12561791B2 (en) * | 2023-09-26 | 2026-02-24 | Kla Corporation | Method to calibrate, predict, and control stochastic defects in EUV lithography |
| KR102693776B1 (ko) | 2023-11-14 | 2024-08-09 | 주식회사 파이비스 | 딥러닝 모델을 기반으로 오브젝트의 결함을 검출하기 위한 장치 및 방법 |
| CN120411120B (zh) * | 2025-07-07 | 2025-08-29 | 中科方寸知微(南京)科技有限公司 | 一种基于深度学习图像分割算法的输电图像缺陷检测及缺陷去重的方法及系统 |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6067376A (en) * | 1998-01-16 | 2000-05-23 | Cognex Corporation | Classifying pixels of an image |
| US6292582B1 (en) * | 1996-05-31 | 2001-09-18 | Lin Youling | Method and system for identifying defects in a semiconductor |
| US20030023404A1 (en) * | 2000-11-22 | 2003-01-30 | Osama Moselhi | Method and apparatus for the automated detection and classification of defects in sewer pipes |
| US20040120569A1 (en) * | 2002-12-20 | 2004-06-24 | Taiwan Semiconductor Manufacturing Co., Ltd. | Progressive self-learning defect review and classification method |
| US20060078191A1 (en) | 2004-09-29 | 2006-04-13 | Dainippon Screen Mfg. Co., Ltd. | Apparatus and method for detecting defect on object |
| US20170177997A1 (en) | 2015-12-22 | 2017-06-22 | Applied Materials Israel Ltd. | Method of deep learining-based examination of a semiconductor specimen and system thereof |
| KR20180094111A (ko) * | 2016-01-11 | 2018-08-22 | 케이엘에이-텐코 코포레이션 | 이미지 기반 표본 프로세스 제어 |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3749090B2 (ja) * | 2000-07-06 | 2006-02-22 | 大日本スクリーン製造株式会社 | パターン検査装置 |
| US7109483B2 (en) * | 2000-11-17 | 2006-09-19 | Ebara Corporation | Method for inspecting substrate, substrate inspecting system and electron beam apparatus |
| TWI370501B (en) | 2003-11-10 | 2012-08-11 | Hermes Microvision Inc | Method and system for monitoring ic process |
| JP2012217139A (ja) * | 2011-03-30 | 2012-11-08 | Sony Corp | 画像理装置および方法、並びにプログラム |
| JP5707291B2 (ja) * | 2011-09-29 | 2015-04-30 | 株式会社日立ハイテクノロジーズ | 画像分類支援を行う荷電粒子線装置 |
| US10186026B2 (en) * | 2015-11-17 | 2019-01-22 | Kla-Tencor Corp. | Single image detection |
| US10223615B2 (en) * | 2016-08-23 | 2019-03-05 | Dongfang Jingyuan Electron Limited | Learning based defect classification |
| US11580398B2 (en) * | 2016-10-14 | 2023-02-14 | KLA-Tenor Corp. | Diagnostic systems and methods for deep learning models configured for semiconductor applications |
| US10031997B1 (en) * | 2016-11-29 | 2018-07-24 | Taiwan Semiconductor Manufacturing Co., Ltd. | Forecasting wafer defects using frequency domain analysis |
| US10395362B2 (en) * | 2017-04-07 | 2019-08-27 | Kla-Tencor Corp. | Contour based defect detection |
-
2019
- 2019-01-16 US US16/249,337 patent/US10672588B1/en active Active
- 2019-11-15 TW TW108141684A patent/TWI805868B/zh active
- 2019-11-15 WO PCT/US2019/061578 patent/WO2020102611A1/en not_active Ceased
- 2019-11-15 EP EP19884619.8A patent/EP3870959A4/en active Pending
- 2019-11-15 CN CN201980073377.0A patent/CN112969911B/zh active Active
- 2019-11-15 JP JP2021526582A patent/JP7216822B2/ja active Active
- 2019-11-15 KR KR1020217018222A patent/KR102513717B1/ko active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6292582B1 (en) * | 1996-05-31 | 2001-09-18 | Lin Youling | Method and system for identifying defects in a semiconductor |
| US6067376A (en) * | 1998-01-16 | 2000-05-23 | Cognex Corporation | Classifying pixels of an image |
| US20030023404A1 (en) * | 2000-11-22 | 2003-01-30 | Osama Moselhi | Method and apparatus for the automated detection and classification of defects in sewer pipes |
| US20040120569A1 (en) * | 2002-12-20 | 2004-06-24 | Taiwan Semiconductor Manufacturing Co., Ltd. | Progressive self-learning defect review and classification method |
| US20060078191A1 (en) | 2004-09-29 | 2006-04-13 | Dainippon Screen Mfg. Co., Ltd. | Apparatus and method for detecting defect on object |
| US20170177997A1 (en) | 2015-12-22 | 2017-06-22 | Applied Materials Israel Ltd. | Method of deep learining-based examination of a semiconductor specimen and system thereof |
| KR20180094111A (ko) * | 2016-01-11 | 2018-08-22 | 케이엘에이-텐코 코포레이션 | 이미지 기반 표본 프로세스 제어 |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112884769A (zh) * | 2021-04-12 | 2021-06-01 | 深圳中科飞测科技股份有限公司 | 图像处理方法、装置、光学系统和计算机可读存储介质 |
| CN112884769B (zh) * | 2021-04-12 | 2021-09-28 | 深圳中科飞测科技股份有限公司 | 图像处理方法、装置、光学系统和计算机可读存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| TWI805868B (zh) | 2023-06-21 |
| KR20210080567A (ko) | 2021-06-30 |
| CN112969911A (zh) | 2021-06-15 |
| JP7216822B2 (ja) | 2023-02-01 |
| EP3870959A4 (en) | 2022-07-27 |
| EP3870959A1 (en) | 2021-09-01 |
| TW202033954A (zh) | 2020-09-16 |
| JP2022507543A (ja) | 2022-01-18 |
| US10672588B1 (en) | 2020-06-02 |
| CN112969911B (zh) | 2022-09-06 |
| US20200161081A1 (en) | 2020-05-21 |
| KR102513717B1 (ko) | 2023-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10672588B1 (en) | Using deep learning based defect detection and classification schemes for pixel level image quantification | |
| JP5695924B2 (ja) | 欠陥推定装置および欠陥推定方法並びに検査装置および検査方法 | |
| JP5591675B2 (ja) | 検査装置および検査方法 | |
| KR102905111B1 (ko) | 머신 러닝을 사용한 웨이퍼 검사용 예측 이미지 생성 시스템 및 방법 | |
| TWI769371B (zh) | 用於半導體裝置之檢測方法及系統,以及其非暫時性電腦可讀媒體 | |
| KR102513715B1 (ko) | 반도체 제조에서 확률적 불량 메트릭의 사용 | |
| US7904845B2 (en) | Determining locations on a wafer to be reviewed during defect review | |
| TWI683103B (zh) | 於樣品上判定所關注圖案之一或多個特性 | |
| WO2022230338A1 (ja) | 欠陥を検出するシステム、及びコンピュータ可読媒体 | |
| US11010886B2 (en) | Systems and methods for automatic correction of drift between inspection and design for massive pattern searching | |
| US10692690B2 (en) | Care areas for improved electron beam defect detection | |
| US12561791B2 (en) | Method to calibrate, predict, and control stochastic defects in EUV lithography | |
| JP5859039B2 (ja) | 検査装置 | |
| CN112292753B (zh) | 用于更好的设计对准的目标选择改进 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19884619 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2021526582 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2019884619 Country of ref document: EP Effective date: 20210524 |
|
| ENP | Entry into the national phase |
Ref document number: 20217018222 Country of ref document: KR Kind code of ref document: A |