WO2019191342A1 - Mode selection for inspection - Google Patents

Mode selection for inspection Download PDF

Info

Publication number
WO2019191342A1
WO2019191342A1 PCT/US2019/024445 US2019024445W WO2019191342A1 WO 2019191342 A1 WO2019191342 A1 WO 2019191342A1 US 2019024445 W US2019024445 W US 2019024445W WO 2019191342 A1 WO2019191342 A1 WO 2019191342A1
Authority
WO
WIPO (PCT)
Prior art keywords
specimen
separability
multiple modes
modes
inspection
Prior art date
Application number
PCT/US2019/024445
Other languages
English (en)
French (fr)
Inventor
Martin Plihal
Saravanan Paramasivam
Ankit Jain
Prasanti Uppaluri
Raghavan Konuru
Original Assignee
Kla-Tencor Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kla-Tencor Corporation filed Critical Kla-Tencor Corporation
Priority to KR1020207030456A priority Critical patent/KR102472309B1/ko
Priority to CN201980017247.5A priority patent/CN111837228B/zh
Publication of WO2019191342A1 publication Critical patent/WO2019191342A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L21/00Processes or apparatus adapted for the manufacture or treatment of semiconductor or solid state devices or of parts thereof
    • H01L21/67Apparatus specially adapted for handling semiconductor or electric solid state devices during manufacture or treatment thereof; Apparatus specially adapted for handling wafers during manufacture or treatment of semiconductor or electric solid state devices or components ; Apparatus not specifically provided for elsewhere
    • H01L21/67005Apparatus not specifically provided for elsewhere
    • H01L21/67242Apparatus for monitoring, sorting or marking
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8806Specially adapted optical and illumination features
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/9501Semiconductor wafers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/956Inspecting patterns on the surface of objects
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G05B19/41875Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by quality surveillance of production
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L22/00Testing or measuring during manufacture or treatment; Reliability measurements, i.e. testing of parts without further processing to modify the parts as such; Structural arrangements therefor
    • H01L22/20Sequence of activities consisting of a plurality of measurements, corrections, marking or sorting steps
    • H01L22/26Acting in response to an ongoing measurement without interruption of processing, e.g. endpoint detection, in-situ thickness measurement
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L22/00Testing or measuring during manufacture or treatment; Reliability measurements, i.e. testing of parts without further processing to modify the parts as such; Structural arrangements therefor
    • H01L22/30Structural arrangements specially adapted for testing or measuring during manufacture or treatment, or specially adapted for reliability measurements
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8806Specially adapted optical and illumination features
    • G01N2021/8845Multiple wavelengths of illumination or detection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8854Grading and classifying of flaws
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/37Measurements
    • G05B2219/37224Inspect wafer
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/45Nc applications
    • G05B2219/45031Manufacturing semiconductor wafers
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L22/00Testing or measuring during manufacture or treatment; Reliability measurements, i.e. testing of parts without further processing to modify the parts as such; Structural arrangements therefor
    • H01L22/10Measuring as part of the manufacturing process
    • H01L22/12Measuring as part of the manufacturing process for structural parameters, e.g. thickness, line width, refractive index, temperature, warp, bond strength, defects, optical inspection, electrical measurement of structural dimensions, metallurgic measurement of diffusions
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • This invention generally relates to methods and systems for selecting a mode for inspection of a specimen
  • inspection systems have adjustable output acquisition (e.g., data, signal, and/or image acquisition) parameters such that different parameters can be used to detect different defects or avoid sources of unwanted (nuisance) events.
  • adjustable output acquisition e.g., data, signal, and/or image acquisition
  • Optics mode selection is preceded by defect discovery, which provides a set of defects and nuisances for the optics selector (OS) session.
  • Defect discovery today is performed by scanning a setup specimen with a relatively diverse set of optics modes (typically around 10) and“hot detection thresholds” to improve the chances of discovering all defect types. The discovery itself largely relies on diversity sampling performed on the individual hot scans.
  • DOIs defects of interest
  • sensitivity limiting nuisances a set of the most important defects of interest (DOIs) and sensitivity limiting nuisances is chosen for OS session. This selection is performed by a human expert typically by choosing the smallest DOI examples (based on scanning electron microscope (SEM) images) and nuisances that show similarity to the DOIs based on optical patches and defect atributes.
  • SEM scanning electron microscope
  • the set of modes for OS may also be selected in largely haphazard ways using learned best known methods (BKMs), some theoretical rules for which modes should provide good signal for the defects identified during discovery, and experience and intuition of the person performing the OS analysis.
  • BKMs learned best known methods
  • the currently used methods are entirely manual and subjective.
  • the currently used methods and systems are also neither systematic nor exhaustive, and they are substantially time consuming.
  • Another disadvantage of the currently used systems and methods is that they do not take defect and nuisance separability into account.
  • the currently used systems and methods rely on a human expert’s ability to sift through substantially large amounts of data to find the most relevant defect set, on which to perform the optics mode selection analysis.
  • human experts do not have the ability to process all of the information or the data volume to make the best decisions.
  • only limited useful information is available to users to make decisions.
  • One embodiment relates to a system configured to select a mode for inspection of a specimen.
  • the system includes an inspection subsystem configured for generating output for a specimen by scanning the specimen with energy and detecting energy from the specimen during the scanning.
  • the inspection subsystem is also configured for generating the output with multiple modes defined by different values of at least one parameter of the inspection subsystem used for generating the output.
  • the system also includes one or more computer subsystems configured for determining a separability- score for each of one or more of the multiple modes thereby generating one or more separability scores.
  • the separability score for each of the one or more modes is defined by a difference between results of a classifier for defects having a first defect of interest (DOI) type detected on the specimen using the output generated with one of the multiple modes and the results of the classifier for nuisances detected on the specimen using the output generated with the one of the multiple modes.
  • DOI defect of interest
  • the computer subsystern(s) are also configured for selecting a subset of the multiple modes of the inspection subsystem for inspection of other specimens of the same type as the specimen based on the one or more separability scores.
  • the system may be further configured as described herein.
  • Another embodiment relates to a computer-implemented method for selecting a mode for inspection of a specimen.
  • the method includes steps for each of the functions of the one or more computer subsystems described above.
  • the steps of the method are performed by one or more computer subsystems.
  • the method may be performed as described further herein.
  • the method may include any other step(s) of any other method(s) described herein.
  • the method may be performed by any of the systems described herein.
  • An additional embodiment relates to a non-transitory computer-readable medium storing program instructions executed on a computer system for performing a computer- implemented method for selecting a mode for inspection of a specimen.
  • the computer- implemented method includes the steps of the method described above.
  • the computer- readable medium may be further configured as described herein.
  • the steps of the computer-implemented method may be performed as described further herein.
  • the computer-implemented method for which the program instructions are executable may include any other step(s) of any other method(s) described herein.
  • Figs. 1 and 2 are schematic diagrams illustrating side views of embodiments of a system configured as described herein; and Fig. 3 is a block diagram illustrating one embodiment of a non-transitory computer-readable medium storing program instructions executed on a computer system for performing one or more of the computer-implemented methods described herein. While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are sho wn by way of example in the drawings and will herein be described in detail. It should be understood, however, that the drawings and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and alternatives failing within the spirit and scope of the present invention as defined by the appended claims.
  • One embodiment relates to a system configured to select a mode for inspection of a specimen.
  • optical i.e., light based
  • the embodiments described herein may be used for selecting any other mode (e.g., electron beam, ion beam, x-ray, etc.) for inspection of a specimen such as a wafer or reticle.
  • the specimen includes a wafer.
  • the specimen includes a reticle.
  • the wafer and the reticle may include any wafer and reticle known in the art.
  • the embodiments may select one or more modes that are ultimately used in the inspection.
  • S/N signal-to-noise ratio
  • OS is typically a list of defects that are used to guide the user towards the best optics mode(s).
  • the input is substantially subjective depending on the user, as well.
  • a user looks at the scanning electron microscope (SEM) images of the defects and chooses which defects to use for OS.
  • the embodiments described herein have a number of important differences from the currently used methods and systems for OS.
  • the embodiments described herein provide improved optics mode selection based on the results of adaptive discovery.
  • the embodiments described herein also introduce quantitative analysis of detect discovery scans to guide the selection of optics modes for the OS session in a number of ways.
  • the embodiments add defect and nuisance separability and optionally discovery efficiency to each detect type (or one or more defect types) and each discovery optics mode (or one or more discovery optics modes).
  • the embodiments described herein may also use these metrics along with existing criteria to select the best defect set for an OS session.
  • the embodiments described herein may, for each DOI type, provide defect and nuisance separability trends for the discovery modes.
  • Nuisances as that term is used herein are defects that a user does not care about and/or events that are detected hut are not actually defects. Nuisances that are detected as events but are not actually defects may be detected due to non-defect noise sources on a specimen (e.g., line edge roughness (LER), relatively small critical dimension (CD) variation in patterned features, thickness variations, etc.) and/or due to margmalities m the inspection system itself or its configuration used for inspection. Generally, therefore, the goal of inspection is not to detect nuisances on specimens such as wafers.
  • LER line edge roughness
  • CD critical dimension
  • the system includes an inspection subsystem configured for generating output for a specimen by scanning the specimen with energy and detecting energy from the specimen during the scanning.
  • the inspection subsystem is configured for generating the output with multiple modes defined by different values of at least one parameter of the inspection subsystem used for generating the output.
  • the inspection subsystem may include at least an energy source and one or more detectors.
  • the energy source is configured to generate energy that is directed to the specimen during the scanning.
  • the one or more detectors are configured to detect energy from the specimen during the scanning and to generate the output responsive to the detected energy.
  • inspection subsystem 10 includes an illumination subsystem configured to direct light to specimen 14.
  • the illumination subsystem includes at least one light source.
  • the illumination subsystem includes light source 16.
  • the illumination subsystem is configured to direct the light to the specimen at one or more angles of incidence, which may include one or more oblique angles and/or one or more normal angles.
  • light from light source 16 is directed through optical element 18 and then lens 20 to beam splitter 21, which directs the light to specimen 14 at a normal angle of incidence.
  • the angle of incidence may include any suitable angle of incidence, which may vary depending on, for instance, characteristics of the specimen and the defects to be detected on the specimen.
  • the illumination subsystem may be configured to direct the light to the specimen at different angles of incidence at different times.
  • the inspection subsystem may be configured to alter one or more characteristics of one or more elements of the illumination subsystem such that the light can be directed to the specimen at an angle of incidence that is different than that shown in Fig. 1.
  • the inspection subsystem may be configured to move light source 16, optical element 18, and lens 20 such that the light is directed to the specimen at a different angle of incidence.
  • the inspection subsystem may be configured to direct light to the specimen at more than one angle of incidence at the same time.
  • the illumination subsystem may include more than one illumination channel, one of the illumination channels may include light source 16, optical element 18, and lens 20 as shown in Fig. 1 and another of the illumination channels (not shown) may include similar elements, which may be configured differently or the same, or may include at least a light source and possibly one or more other components such as those described further herein.
  • the illumination subsystem may include only one light source (e.g., source 16 shown in Fig. 1) and light from the light source may be separated into different optical paths (e.g., based on wavelength, polarization, etc.) by one or more optical elements (not shown) of the illumination subsystem. Light in each of the different optical paths may then be directed to the specimen. Multiple illumination channels may ⁇ be configured to direct light to the specimen at the same tune or at different times (e.g., when different illumination channels are used to sequentially illuminate the specimen).
  • the same illumination channel may be configured to direct light to the specimen with different characteristics at different times.
  • optical element 18 may be configured as a spectral filter and the properties of the spectral filter can be changed in a variety of different w3 ⁇ 4ys (e.g., by s 3 ⁇ 4pping out the spectral filter) such that different wavelengths of light can be directed to the specimen at different times.
  • the illumination subsystem may have any other suitable configuration known in the art for directing the light having different or the same characteristics to the specimen at different or the same angles of incidence sequentially or simultaneously.
  • light source 16 may include a BBP light source.
  • the light generated by the light source and directed to the specimen may include broadband light.
  • the light source may include any other suitable light source such as a laser, which may include any suitable laser known in the art and may be configured to generate light at any suitable waveiength(s) known in the art.
  • the laser may be configured to generate light that is monochromatic or nearly- monochromatie. In this manner, the laser may be a narrowband laser.
  • the light source may also include a polychromatic light source that generates light at multiple discrete wavelengths or wavebands.
  • Lens 20 Light from optical element 18 may be focused to beam splitter 21 by lens 20.
  • lens 20 is shown in Fig. 1 as a single refractive optical element, it is to be understood that, in practice, lens 20 may include a number of refractive and/or reflective optical elements that in combination focus the light from the optical element to the specimen.
  • the illumination subsystem shown in Fig. 1 and described herein may include any other suitable optical elements (not shown). Examples of such optical elements include, but are not limited to, polarizing component(s), spectral fiiter(s), spatial filter(s), reflective optical element(s), apodizer(s), beam splitter(s), aperture(s), and the like, which may include any such suitable optical elements known in the art.
  • the system may he configured to alter one or more of the elements of the illumination subsystem based on the type of illumination to be used for inspection.
  • the inspection subsystem may also include a scanning subsystem configured to cause the light to be scanned over the specimen.
  • the inspection subsystem may include stage 22 on which specimen 14 is disposed during inspection.
  • the scanning subsystem may include any suitable mechanical and/or robotic assembly (that includes stage 22) that can be configured to move the specimen such that the light can be scanned over the specimen.
  • the inspection subsystem may be configured such that one or more optical elements of the inspection subsystem perform some scanning of the light over the specimen. The light may be scanned over the specimen in any suitable fashion.
  • the inspection subsystem further includes one or more detection channels. At least one of the one or more detection channels includes a detector configured to detect light from the specimen due to illumination of the specimen by the inspection subsystem and to generate output responsive to the detected light.
  • the inspection subsystem shown in Fig. 1 includes two detection channels, one formed by collector 24, element 26, and detector 28 and another formed by collector 30, element 32, and detector 34 As shown in Fig. 1 , the two detection channels are configured to collect and detect light at different angles of collection. In some instances, one detection channel is configured to detect specularly reflected light, and the other detection channel is configured to detect light that is not specularly reflected (e.g , scattered, diffracted, etc.) from the specimen. However, two or more of the detection channels may be configured to detect the same type of light from the specimen (e.g., specularly reflected light).
  • Fig. 1 shows an embodiment of the inspection subsystem that includes two detection channels
  • the inspection subsystem may include a different number of detection channels (e.g., only one detection channel or two or more detection channels).
  • each of the collectors are shown in Fig. 1 as single refractive optical elements, it is to be understood that each of the collectors may include one or more refractive optical elements) and/or one or more reflective optical element/ s).
  • the one or more detection channels may include any suitable detectors known m the art such as photo-multiplier tubes (PMTs), charge coupled devices (CCDs), and time delay integration (TDI) cameras.
  • the detectors may also include non-imaging detectors or imaging detectors. If the detectors are non-imagmg detectors, each of the detectors may be configured to detect certain characteristics of the light such as intensity but may not be configured to detect such characteristics as a function of position within the imaging plane.
  • the output that is generated by each of the detectors included in each of the detection channels of the inspection subsystem may be signals or data, but not image signals or image data.
  • a computer subsystem such as computer subsystem 36 of the system may be configured to generate images of the specimen from the non-imaging output of the detectors.
  • the detectors may be configured as imaging detectors that are configured to generate image signals or image data. Therefore, the system may be configured to generate the output described herein in a number of ways.
  • Fig. 1 is provided herein to generally illustrate a configuration of an inspection subsystem that may be included in the system embodiments described herein.
  • the inspection subsystem configuration described herein may be altered to optimize the performance of the system as is normally performed when designing a commercial inspection system.
  • the systems described herein may ⁇ be implemented using an existing inspection system (e.g., by adding functionality described herein to an existing inspection system) such as the 28xx and 29xx series of tools that are commercially- available from KLA, Milpitas, Calif.
  • the methods described herein may be provided as optional functionality of the system (e.g., in addition to other functionality of the system).
  • the system described herein may be designed“from scratch” to provide a completely new system.
  • Computer subsystem 36 of the system may be coupled to the detectors of the inspection subsystem m any suitable manner (e.g., via one or more transmission media, which may include“wared” and/or“wireless” transmission media) such that the computer subsystem can receive the output generated by the detectors during scanning of the specimen.
  • Computer subsystem 36 may be configured to perform a number of functions using the output of the detectors as described herein and any other functions described further herein. This computer subsystem may be further configured as described herein.
  • This computer subsystem (as well as other computer subsystems described herein) may also be referred to herein as computer system(s).
  • Each of the computer subsystem(s) or system (s) described herein may take various forms, including a personal computer system, image computer, mainframe computer system, workstation, network appliance, Internet appliance, or other device.
  • the term“computer system” may be broadly defined to encompass any device having one or more processors, which executes instructions from a memory medium.
  • the computer subsystem(s) or system(s) may also include any suitable processor known in the art such as a parallel processor.
  • the computer subsystem(s) or system(s) may include a computer platform with high speed processing and software, either as a standalone or a networked tool.
  • the different computer subsystems may be coupled to each other such that images, data, information, instructions, etc. can be sent between the computer subsystems as described further herein.
  • computer subsystem 36 may be coupled to computer subsystem(s) 102 (as shown by the dashed line in Fig. 1 ) by any suitable transmission media, which may include any suitable wired and/or wireless transmission media known in the art. Two or more of such computer subsystems may also be effectively coupled by a shared computer-readable storage medium (not shown).
  • the inspection subsystem is described above as being an optical or light- based inspection subsystem, the inspection subsystem may be an electron beam-based inspection subsystem.
  • the energy scanned over the specimen includes electrons, and the energy detected from the specimen includes electrons.
  • the energy source may be an electron beam source.
  • the inspection subsystem includes electron column 122, which is coupled to computer subsystem 124.
  • the electron column includes electron beam source 126 configured to generate electrons that are focused to specimen 128 by one or more elements 130.
  • the electron beam source may include, for example, a cathode source or emitter tip, and one or more elements 130 may include, for example, a gun lens, an anode, a beam limiting aperture, a gate valve, a beam current selection aperture, an objective lens, and a scanning subsystem, all of which may include any such suitable elements known in the art.
  • Electrons returned from the specimen may be focused by one or more elements 132 to detector 134.
  • One or more elements 132 may include, for example, a scanning subsystem, which may be the same scanning subsystem included in element(s) 130.
  • the electron column may include any other suitable elements known in the art.
  • the electron column may be further configured as described in U.S. Patent Nos. 8,664,594 issued April 4, 2014 to Jiang et al., 8,692,204 issued April 8, 2014 to Kojitna et al., 8,698,093 issued April 1 5, 2014 to Gubbens et al., and 8,716,662 issued May 6, 2014 to MacDonald et al, which are incorporated by reference as if fully set forth herein.
  • the electron column is shown in Fig. 2 as being configured such that the electrons are directed to the specimen at an oblique angle of incidence and are detected from the specimen at another oblique angle
  • the electron beam may be directed to and detected from the specimen at any suitable angles.
  • the electron beam-based subsystem may be configured to use multiple modes to generate images of the specimen (e.g., with different illumination angles, collection angles, etc.). The multiple modes of the electron beam subsystem may be different in any image generation parameters of the subsystem.
  • Computer subsystem 124 may be coupled to detector 134 as described above.
  • the detector may detect electrons returned from the surface of the specimen thereby formmg electron beam mages of the specimen.
  • the electron beam images may include any suitable electron beam images.
  • Computer subsystem 124 may be configured to perform any of the functions described herein using the output of the detector and/or the electron beam images. Computer subsystem 124 may be configured to perform any additional step(s) described herein.
  • a system that includes the inspection subsystem shown in Fig. 2 may be further configured as described herein.
  • Fig. 2 is provided herein to generally illustrate a configuration of an electron beam inspection subsystem that may be included in the embodiments described herein.
  • the electron beam inspection subsystem configuration described herein may be altered to optimize the performance of the inspection subsystem as is normally performed when designing a commercial inspection system.
  • the systems described herein may be implemented using an existing inspection system (e.g., by adding functionality described herein to an existing inspection system).
  • the methods described herein may be provided as optional functionality of the system (e.g., in addition to other functionality of the system).
  • the system described herein may be designed“from scratch” to provide a completely new system.
  • the inspection subsystem may be an ion beam-based inspection subsystem.
  • Such an inspection subsystem may be configured as shown in Fig. 2 except that the electron beam source may be replaced with any suitable ion beam source known in the art.
  • the inspection subsystem may be any other suitable ion beam-based subsystem such as those included in commercially available focused ion beam (FIB) systems, helium ion microscopy (HIM) systems, and secondary ion mass spectroscopy (SIMS) systems.
  • FIB focused ion beam
  • HIM helium ion microscopy
  • SIMS secondary ion mass spectroscopy
  • the inspection subsystem is configured for scanning energy (e.g., light, electrons, etc.) over a physical version of the specimen thereby generating actual output or images for the physical version of the specimen.
  • the inspection subsystem may be configured as an“actual” tool, rather than a“virtual” tool.
  • a storage medium (not shown) and computer subsystem(s) 102 shown m Fig. 1 may be configured as a“virtual” tool.
  • Systems and methods configured as“virtual” inspection tools are described in commonly assigned U.S. Patent Nos. 8,126,255 issued on February 28, 2012 to Bhaskar et al.
  • the inspection subsystem is configured to generate output for the specimen with multiple modes.
  • a“mode” can be defined by the values of parameters of the inspection subsystem used for generating output (e.g., images) for a specimen. Therefore, modes that are different may be different in the values for at least one of the imaging parameters of the inspection subsystem.
  • different modes may use at least one different wavelength of light for illumination. The modes may be different in the illumination wavelengths as described further herein (e.g., by using different light sources, different spectral filters, etc.) for different modes.
  • different modes uses different illumination channels of the inspection subsystem.
  • the inspection subsystem may include more than one illumination channel.
  • different illumination channels may be used for different modes.
  • the modes may also or alternatively be different in one or more collection/detection parameters of the inspection subsystem.
  • the inspection subsystem may be configured to scan the specimen with the different modes in the same scan or different scans, e.g., depending on the capability of using multiple modes to scan the specimen at the same time.
  • the embodiments described herein provide a new optics mode selection setup analyzer (OMSSA).
  • OMSSA optics mode selection setup analyzer
  • the new OMSSA is configured to have one or more critical capabilities that are missing today.
  • the embodiments provide quantitative analysis of optics modes from discovery scans.
  • the one or more computer subsystems are configured for determining a separability score for each of one or more of the multiple modes thereby generating one or more separability scores.
  • the separability score for each of the one or more modes is defined by a difference between results of a classifier for defects having a first defect of interest (DOI) type detected on the specimen using the output generated with one of the multiple modes and the results of the classifier for nuisances detected on the specimen using the output generated with the one of the multiple modes. Therefore, the embodiments described herein may use a defect-nuisance separability score as an OS metric.
  • DOI defect of interest
  • a separability score may be determined for each combination (or one or more combinations) of a DOI type and an optical mode.
  • Each separability score may be determined for only one DOI type such as bridges (and not other DOI types such as residue, missing features, etc.), or each separability score may be determined for more than one DOI type (e.g., all of the DOIs having any type). Therefore, the determined separability score(s) may include a separability score for a first defect type and a first optical mode, the first defect type and a second optical mode, ... , the first defect type and th
  • the separability score(s) may include a separability score for all DOIs and a first optical mode, all the DOIs and a second optical mode, etc.
  • the computer subsystem(s) may determine the separability score(s) by training a classifier (or nuisance filter) and then determining the“margin” the classifier has for DOI- nuisancesance separation.
  • The“margin” can be thought of as the“average distance” of DOIs from nuisances in the classification (or nuisance filter) space.
  • the margin may also be quantified in another manner such as median, mean, robust average, etc. distance between DOIs and nuisances in the classification (or nuisance filter) space.
  • tins distance may be measured in terms of classification confidence (the more confident the classifier is in classifying nuisances as nuisances and DOIs as DOIs, the higher the margin).
  • classification confidence measures the perpendicular distance to the classification boundary (in some arbitrary, but consistent units), winch separates one group of events (those determined to be DOIs) from another group of detected events (those determined to be nuisances).
  • the computer subsystem(s) may find the average confidence of all DOIs (specific types) and subtract that from the confidence value at which the nuisance floor appears (this typically shows up as a relatively sharp onset of detectivity at a particular confidence value). It would be the value of this difference that the computer subsystem(s) would track across optics modes. The higher the value, the higher the separability.
  • the computer subsystem(s) may consider a set of signal attributes (after defect segmentation) instead of confidence, but otherwise the computer subsystem(s) may perform this step as described herein.
  • the computer subsystem(s) are configured for detecting events on the specimen using the output generated during the scanning with the multiple modes and for inputting the events into the classifier to thereby separate the events into the defects and the nuisances.
  • the embodiments described herein may be configured to perform one or more discovery scans (i.e., scans of the specimen meant to “discover” defects and nuisances on the specimen).
  • the discovery scan(s) may include one or more scans (i.e., a scan with optics mode 1 , ... , a scan with optics mode n). The scans may be performed as described further herein using any of the embodiments of the inspection subsystem described herein.
  • the one or more computer subsystems may be configured for detecting events on the specimen based on the output generated by one or more detectors of the inspection subsystem during the scanning with the multiple modes.
  • the events may be detected on the specimen in any suitable manner (e.g., by applying a threshold to the output and identifying output having one or more values above the threshold as an event and not identifying output having one or more values below the threshold as an event).
  • the defects and nuisances into which the events detected on the specimen are separated may include any defects and nuisances known m the art.
  • Defect discovery today is performed by scanning a setup specimen with a relatively diverse set of optics modes (typically around 10) and“hot detection thresholds” to improve the chances of discovering all defect types.
  • the discovery itself largely relies on diversity sampling performed on the individual hot scans.
  • A“hot” threshold can be generally defined as a threshold that is at, within, or substantially near the noise floor of the output generated by the inspection subsystem for the specimen.
  • the event detection can be quite a bit more aggressive (hotter) than would normally be performed for a tuned inspection recipe, so that more events, including defects and nuisance events, are detected than desired in a tuned inspection. In this manner, such scans would not normally be useful for production monitoring due to the substantially high nuisance defect detection.
  • the classifier is configured as a nuisance filter.
  • the classifier may be configured as a nuisance filter and/or defect classifier.
  • the configuration of the classifier may vary depending on the inspection and/or specimen for which OS is being performed.
  • the classifier may label detected events as actual defects, nuisances, and not-actual defects (e.g., noise). If the classifier is a nuisance filter, then the classifier may label detected events as actual defects and nuisances (winch can be generally defined as described further herein as noise and/or actual defects that the user does not actually care about).
  • the classifier may label the detected events with defect IDs, e.g., class codes, that indicate different types of defects such as bridges, particles, scratches, missing features, roughness, etc.
  • Defect classifiers may also label defects with a particular type of defect and also separate them from nuisances thereby functioning as a defect classifier and nuisance filter.
  • the classifier and/or nuisance filter may include various types of classifiers and nuisance filters.
  • the classifier or nuisance filter may be configured as a decision tree or a random forest type classifier.
  • the classifier and nuisance filter may also be a machine learning type of classifier or nuisance filter. In this manner, the classifier and nuisance filter may be a machine learning model.
  • the classifier and nuisance filter may also include any other type of automatic defect classifier (ADC) known in the art. Additional examples of classifiers that may be used as the classifier and nuisance filter m the embodiments described herein are described in U.S. Patent Application Publication Nos.
  • the machine learning model may include any deep learning model known in the art, including for example, a neural network, a convolutional neural network, a generative model, etc. Examples of suitable machine learning models that may be used as the classifier in the embodiments described herein are described in commonly owned U.S. Patent Application Publication Nos.
  • 2017/0140524 published May 1 8, 2017 by Karsenti et al., 2017/0148226 published May 25, 2017 by Zhang et al, 2017/0193400 published July 6, 2017 by Bhaskar et al., 2017/0193680 published July 6, 2017 by Zhang et al., 2017/0194126 published July 6, 2017 by Bhaskar et al., 2017/0200260 published July 13, 2017 by Bhaskar et al, 2017/0200264 published July 13, 2017 by Park et al.,
  • 2017/0200265 published July 13, 2017 by Bhaskar et al, 2017/0345140 published November 30, 2017 by Zhang et al., 2017/0351952 published December 7, 2017 by Zhang et al, 2018/0107928 published April 19, 2018 by Zhang et al., 2018/0293721 published October 11 , 2018 by Gupta et al, 2018/033051 1 published November 15, 2018 by Ha et al, 2019/0005629 published January 3, 2019 by Dandiana et al, and
  • the computer subsystem(s) are configured for detecting events on the specimen using the output generated during the scanning with the multiple modes as input to a defect detection method, inputting the events into the classifier to thereby separate the events into the defects and the nuisances, altering one or more parameters of the defect detection method, repeating the detecting the events step with the one or more altered parameters of the defect detection method, and inputting the events detected by the detecting step and the repeating the detecting step into the classifier to thereby separate the events into the defects and the nuisances.
  • the event detection (and thereby defect detection) may be altered in a kind of in- situ or feedback loop during event detection, e.g , to detect more events, defects, and nuisances and/or to try to detect different kinds of events, defect, and nuisances.
  • the embodiments described herein may therefore be configured for adaptive discovery.
  • the computer subsystem(s) may perform adaptive discovery independently on each mode while cross-auto-labeling discovered defects to all modes.
  • Cross-auto- labeling may include labeling ail of the images generated by any two or more of the modes at the same location at which a defect was detected defect images. For example, if a first mode detects a defect at location x, the computer subsystem(s) may label any other images generated with any other modes at location x as defect images regardless of whether those other modes detected the defect at location x.
  • Adaptive discovery uses active learning and a classifier. At the end of discovery, adaptive discovery may produce a converged classifier that can be applied as a nuisance filter to the inspection with the corresponding optics modes.
  • Adaptive discovery and/or finding defects and nuisances on the specimen for use in the embodiments described herein may be performed as described in the above- referenced publication by He et al. in addition, the embodiments described herein may be configured for discovering and/or finding defects and nuisances that can be used as a training set for additional steps described herein as described in U.S. Patent Application Publication Nos. 2014/0133737 by Plihal et al. published May 15, 2014, 2015/0276618 by Plihal et al. published October 1, 2015, 2016/0110857 by Plihal et al. published April 21, 2016, 2016/0123898 by Chen et al. published May 5, 2016, and 2018/0106732 by Plihal et al. published April 19, 2018, which are incorporated by reference as if fully set forth herein.
  • the embodiments described herein may be further configured as described in these publications.
  • altering the one or more parameters of the defect detection method includes identifying a portion of the multiple modes expected (or known) to be capable of detecting the defects in greater numbers than another portion of the multiple modes and selecting only the output generated during the scanning performed with the identifi ed portion of the multiple modes as the input to the defect detection method .
  • The“portion” of the multiple m odes may include one or more of the multiple modes and in this case fewer than all of the multiple modes.
  • the computer subsystem(s) may perform such identifying and selecting to drive the defect discovery process to convergence and data sufficiency in rnode(s) that have capability to detect the defects.
  • the one or more computer subsystem (s) may analyze classifier convergence on each mode.
  • the one or more computer subsystems may analyze the data sufficiency of each of the important defect types. For example, the performance of classifiers (such as machine learning classifiers described further herein) improves with the size of the training set up to a certain point beyond which the classifier reaches its optimal performance on the data. It is, therefore, advantageous to provide “sufficient” training data to reach this optimal performance of the classifier. That point may be commonly referred to as“data sufficiency”
  • the computer subsystem(s) may measure data sufficiency by monitoring the“convergence” of the classifier as the training set is increased by the computer subsystem(s). The“convergence” of the classifier may be determined and monitored m any suitable manner known in the art.
  • the computer subsystem(s) may monitor and alter the discovery process to meet the data sufficiency threshold because when comparing DOI-to-nuisance separability of different modes, the DOls and nuisances are preferably classified by a classifier that has converged to get substantially accurate data for other steps (OS) performed using the data.
  • OS steps
  • the computer subsystem(s) are configured for detecting events on the specimen using the output generated during the scanning with the multiple modes and for inputting the events into the classifier to thereby separate the events into the defects and the nuisances.
  • the computer subsystem(s) are configured for displaying the defects and the nuisances to a user and receiving a selection of one or more of the defects and one or more of the nuisances from the user.
  • the computer subsystem(s) may be configured for diagnostics and visualization of discovery results. In the diagnostics and visualization of discovery results phase, a user may identify important DOI types.
  • the computer subsystem(s) may display the defects and nuisances to the user using any suitable graphical user interface (GUI) on any suitable display device (not shown).
  • GUI graphical user interface
  • the computer subsystem(s) may also display the defects and nuisances in a variety of different ways, e.g., displaying the defects and nuisances in groups based on which mode detected them, displaying subgroups of the defects and nuisances that have one or more similar characteristics such as size, location in a design for the specimen, shape, texture, grey level intensity, etc.
  • the computer subsystem(s) may display any results generated for the defects and nuisances (including patch images (i.e., relatively small images grabbed at the locations of the defects and nuisances) and any characteristics of the defects and nuisances determined by the computer subsystem(s) or the classifier).
  • the computer subsystem(s) may recei ve the selection of the defect(s) and nuisance(s) from the user with any suitable input device (not shown) such as a keyboard, mouse, touch screen, electronic pen, etc.
  • the computer subsystem(s) may also display one or more options for the user such as one or more tags or labels that can be assigned to the defects or nuisances to indicate which ones are important and which ones are not.
  • the computer subsystem(s) are configured for receiving input from the user indicating which of the one or more of the defects have the same type. This input may be received by the computer subsystem(s) in the same manner as described above (e.g., using an input device manipulated by the user possibly with one or more options displayed m the display device).
  • a user may identify important DOI types and group them based on similarity. In general, a“group” of DOIs may be the same as a“type” of DOI.
  • the user does not necessarily have to organize the DOIs by type m this step.
  • the user may group DOIs based on similarity (e.g., how similar they look to a user and/or if the user thinks they may have the same DOI type), but the user may also choose (knowingly or unknowingly) to group DOIs that are similar in some respects even if they have different DOI types.
  • the term“DOI group” may be used interchangeably with the term DOI type, some examples of which include vertical tip-to- tip bridge, horizontal open, residue, etc.
  • the (manual) classification assigned to the defects does not al ways align with the types for OS.
  • the embodiments described herein may be configured to allow the user to group the defects in any manner that they would like and can analyze any such defect groupings as described herein.
  • the defect groupings input by the user may also be modified by the classifier when the defects in the user assigned groups are input to the classifier.
  • the user also may or may not indicate which of the nuisances have the same type and/or may group one or more of the nuisances.
  • the types or groups of nuisances may include, for example, a group of nuisances that the user labels as actual defects that the user does not care about, a group of nuisances that the user labels as noise, etc.
  • the user may also configure the desired number of defects (and possibly nuisances) for OS session image grabs. In this manner, the user may perform“similarity of types” grouping and then decide which defect type(s) should be used m OS to select the mode.
  • the computer subsystem(s) are configured for determining another separability score for each of the one or more of the defect types selected by the user thereby generating one or more other separability scores, and the other separability score for each of the one or more of the defects is defined by a difference between the results of the classifier for one of the defects selected by the user and detected on the specimen using the output generated with the one of the multiple modes compared to the results of the classifier for the nuisances detected on the specimen using the output generated with the one of the modes.
  • the one or more computer subsystem(s) may determine a separability score for each important DOI type selected by the user on each mode.
  • the separability scores described herein may be determined on a DOX ⁇ to ⁇ DOI basis (or per DOI) and for each of the different modes.
  • a separability score may be determined for a first DOI detected in a first optical mode, the first DOI detected in a second optical mode, and so on, and the separability score may be determined for a second DOI detected in the first optical mode, the second DOI detected in the second optical mode, and so on for as many combinations of DOIs and optics modes that are interesting and/or selected as described herein.
  • These and other separability scores described herein may also be determined for one or more DOIs compared to all of the nuisances detected with a mode in which the one or more DOIs were detected. For example, in order for an optics mode to be able to detect ail (or as many) of the DOI instances that it can, each (or at least many) of the DOI instances must be separable from all of the nuisances in that mode (otherwise when the inspection is setup for that mode, it will be impossible to detect DOIs without also detecting nuisances and to not detect any nuisances without also missing DOIs).
  • the separability scores described herein may be determined for one or more DOIs compared to all of the nuisances detected in the same mode as the DOIs for which the separability scores are being determined.
  • the computer subsystem(s) are configured for selecting a subset of the one or more of the defects selected by the user based on the one or more other separability scores to thereby select at least one of the one or more of the defects having the lo west values of the one or more other separability scores, and selecting the subset of the multiple modes is performed based on the one or more separability scores m combination with the one or more other separability scores.
  • the subset of the one or more of the defects may include a single defect, one or more of the defects, a portion of the defects, or even a substantial portion of the defects.
  • the computer subsystem(s) may generate a ranked list of the best defect candidates for each important DOI group.
  • the best DOIs for OS will typically be defects that have a relatively low confidence of being DOI, i.e., low separability (confidence) values.
  • These defects may be selected for use in OS because those are the defects that are relatively difficult to separate from nuisances. These defects tend to be relatively small defects that are difficult to detect (e.g., due to relatively weak signals).
  • the computer subsystem(s) may generate a more detailed breakdown of DOI examples with the sensitivity-limiting nuisance examples by optics mode (i.e., different nuisance sources limit sensitivity to the DOI in different modes). In this manner, the computer subsystem(s) may be configured to perform a comprehensive analysis of the user-selected DOI types to identify the best set of DOI and nuisance events for all of the candidate modes from discovery scans.
  • the embodiments described herein may select the best set (or subset) of defects for OS session.
  • the OMSSA may also rank one or more of the optics modes for OS analysis.
  • the selected set of defects (and possibly nuisances) along with the selected set (or subset) of optics modes may be used for OS as described further herein.
  • the computer subsystems ⁇ may perform fully automated defect selection and mode ranking.
  • search criteria refers to the automated way of selecting defects for OS).
  • OMSSA and OS may vary from that described herein (e.g., so that they are entirely integrated to function seamlessly together as a single unit (as in a single software package or module), they are closely integrated so that they appear to function as a single unit even though they are different units, or they may be more loosely integrated so that they appear to function as different units and/or are configured as different units). For example, there may be a more or less interactive and adaptive link between OMSSA and OS image collection flows.
  • the computer subsystem(s) are configured for determining a discovery efficiency for each of the one or more of the multiple modes thereby generating one or more discovery efficiencies, and the discovery efficiency for each of the one or more modes is defined by a number of DOIs captured using the output generated with one of the modes. “Discovery efficiency” as that term is used herein can therefore also be defined as how many DOIs were actually captured in the mode at the end of the discovery process. Therefore, in a way, discovery efficiency and separability may go hand-in-hand (e.g., a mode that achieves a better DOI-nuisance separation than other modes will also generally be capable of a higher discovery efficiency than the other modes).
  • the computer subsystem(s) may use the discovery efficiency scores based on the data generated during adaptive discovery for defect selection for OS and for ranking optics modes, which may be performed as described further herein.
  • the computer subsystern(s) are configured for determining a characteristic of the one or more separability scores for at least a portion of the multiple modes.
  • the characteristic may be, for example, a trend in one or more of the quantitative measures described herein.
  • the characteristic may be an optics mode trend quantified through separability strength (DOI-nuisance separability) and optionally discovery efficiency for each of the important DOI types.
  • the computer subsystem/ s) may provide mode separability trends and/or separability trends for one or more DOIs types. These trends can be used to aid the mode selection for OS session.
  • the computer subsystem(s) may provide optics mode trends for each DOI group in terms of signal, DOI-nuisanee separability, and discovery efficiency.
  • the trends may be expressed or even quantified based on a change in one or more of the scores or quantitative measures described herein as a function of mode. So the trends may show how much a score or measure changes from mode to mode. The trends may also show how much a score or measure changes from mode to mode in a particular direction (from highest to lowest or vice versa). Different scores or measures may be expressed or quantified in different directions depending on what they are.
  • trends may be used to characterize the optics modes from best to worst by showing the trends from highest to lowest DOI-nuisanee separability and/or highest to lowest discovery efficiency, but that is not always the case.
  • a trend characterizing the optics modes from best to worst may be determined based on the score or quantitative measure from lowest to highest (e.g., if the optics modes are being examined for trends in amounts of nuisances detected in the optics modes).
  • the trends may be generated, described, demonstrated, quantified, etc. in any suitable manner, e.g., graphically, sorted in list form in a data structure, etc.
  • the one or more computer subsystems are further configured for selecting a subset of the multiple modes of the inspection subsystem for inspection of other specimens of the same type as the specimen based on the one or more separability scores. Selecting the subset of the multiple modes that will actually be used for the inspection of the other specimens may be performed as described further herein.
  • the OMSSA produces output that can be used for OS, and the output of the OS may be the subset of the multiple modes of the inspection subsystem used for the inspection.
  • the output from discovery analysis may include a list of defects (DOI) and corresponding sensitivity-limiting nuisance examples for OS analysis.
  • the output may include signal, separability, and discovery efficiency trends among the discovery modes to aid the mode selection of OS analysis.
  • the OS may be performed then in any suitable manner and as described further herein.
  • the computer subsystem(s) may also select (and/or rank) modes based on the separability and discovery 7 efficiency scores. For example, in one embodiment, selecting the subset of the multiple modes is performed based on the one or more separability- scores in combination with the one or more discovery efficiencies.
  • any of the scores or other quantitative measures determined by the computer subsystem(s) may be used to determine trends or another characteristic of the optics modes. The trends may also be determined as a change from mode-to-mode, e.g., from best to worst or from worst to best depending on the score or measure.
  • the trends may effectively rank the optics modes based on those trends from best to worst or vice versa.
  • the trends and/or ranks of the optics modes based on one score or measure can be used in combination with another score or measure to then re-rank the optics modes based on the more than one score or rank.
  • the optics modes may then be selected by the computer subsystem(s) for OS session based on the modified rankings of the optics modes.
  • the computer subsystem(s) are configured for determining an overall metric for each of the one or more of the multiple modes thereby generating one or more overall metrics, and the overall metric for each of the one or more modes is defined as a function of the separability score and the discovery effici ency for one of the modes.
  • the discovery effici ency and the separability metric maybe merged into one combined metric.
  • the overall metric may be determined based on any other suitable function of the separability score, the discovery efficiency, any other scores or quantitative measures described herein, trends, ranks, etc.
  • Such functions may include, for example, a weighted sum, a difference, a product, a polynomial, an average, and the like.
  • selecting the subset of the multiple modes is performed based on the one or more overall metrics thereby- also selecting the subset of the multiple modes based on the one or more separability scores. Selecting the subset of the multiple modes based on the one or more overall metrics may be performed as described further herein. The subset may be only one of the modes or more than one of the modes.
  • selecting the subset of the multiple modes includes selecting an initial subset of the multiple modes based on the one or more separability scores, performing the scanning with the initial subset of the multiple modes, repeating the determining the separability score step for the initial subset of the multiple modes, and selecting a final subset of the multiple modes for the inspection of the other specimens of the same type as the specimen based on the one or more separability scores determined for the initial subset of the multiple modes. For example, after the QMSSA or OS session, QMSSA or OS may output a few (e.g., 3 to 5) top modes.
  • the computer subsystem(s) may use the inspection subsystem to perform another specimen scan or scans with adaptive discovery, which may be performed as described further herein.
  • This adaptive discovery may include the defects already found in the OMSSA phase of the embodiments.
  • the computer subsystem(s) may then repeat the separability analysis in OMSSA to arrive at the top mode. That top mode or modes may then be designated as the final subset of the multiple modes and used for inspection of the other specimens. For example, each defect type may have its own optimal mode, which in turn could lead to multi-pass (multi-optics mode) inspection.
  • the embodiments described herein have a number of advantages over other currently used methods and systems for mode selection.
  • the embodiments described herein define new defect-nuisance separability and discovery efficiency metrics for each defect type and optics mode based on information generated during adaptive discovery. This type of quantitative scoring methodology is not available today during OS setup sessions.
  • the data generated during adaptive discovery may also be mined to make more comprehensive and more accurate determinations about which defects should be used in the OS session and which modes should not be explored further or at all.
  • the embodiments described herein provide information for OS that is far more granular than is currently available. The analytic pow3 ⁇ 4r of OMSSA will make it possible to identify the best nuisance events to analyze across all of the modes for each defect type.
  • Each optics mode may have a different type of nuisance that limits the sensitivity to the DOI.
  • OMSSA can find the union of all nuisance events needed for all of the optics modes.
  • the embodiments described herein reduce the time-to- results and increase the ease of use of the OS compared to currently used and other possible methods and systems for OS.
  • one alternative to the embodiments described herein is to eliminate OS image grab and analysis entirely and instead perforin discovery with more modes.
  • OS image grabs are substantially expensive, e.g., taking about 5 hours to about 8 hours of tool time with manual analysis afterwards.
  • Another embodiment relates to a computer-implemented method for selecting a mode for inspection of a specimen.
  • the method includes determining a separability score for each of one or more of multiple modes of an inspection subsystem thereby generating one or more of the separability scores.
  • the separability score for each of the one or more modes is defined as described herein.
  • the inspection subsystem is configured as described herein.
  • the method also includes selecting a subset of the multiple modes of the inspection subsystem for inspection of other specimens of the same type as the specimen based on the one or more separability scores.
  • the determining the separability score step and the selecting the subset step are performed by the computer system.
  • the method may also include any other step(s) that can be performed by the inspection subsystem and/or computer subsystem(s) or system(s) described herein.
  • the steps of the method are performed by one or more computer subsystems, which may be configured according to any of the embodiments described herein.
  • the method described above may be performed by any of the system embodiments described herein.
  • An additional embodiment relates to a non-transitory computer-readable medium storing program instructions executed on a computer system for performing a computer- implemented method for selecting a mode for inspection of a specimen.
  • m Fig. 3 includes program instructions 302 executable on computer system 304.
  • the computer-implemented method may include any step(s) of any method(s) described herein.
  • Program instructions 302 implementing methods such as those described herein may be stored on computer-readable medium 300.
  • the computer-readable medium may be a storage medium such as a magnetic or optical disk, a magnetic tape, or any other suitable non-transitory computer-readable medium known in the art.
  • the program instructions may be implemented in any of various ways, including procedure-based techniques, component-based techniques, and/or object-oriented techniques, among others.
  • the program instructions may be implemented using ActiveX controls, C++ objects, JavaBeans, Microsoft Foundation Classes (“MFC”), SSE (Streaming SIMD Extension) or other technologies or methodologies, as desired.
  • MFC Microsoft Foundation Classes
  • SSE Streaming SIMD Extension
  • Computer system 304 may be configured according to any of the embodiments described herein.
  • All of the methods described herein may include storing results of one or more steps of the method embodiments in a computer-readable storage medium.
  • the results may include any of the results described herein and may be stored in any manner known in the art.
  • the storage medium may include any storage medium described herein or any other suitable storage medium known in the art.
  • the results can be accessed in the storage medium and used by any of the method or system embodiments described herein, formatted for display to a user, used by another software module, method, or system, etc.
  • information for the selected mode(s) may be stored in an inspection recipe such that when the inspection is performed for the other specimens with the inspection recipe, the selected mode(s) will be used for generating the output for the other specimens.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Manufacturing & Machinery (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Power Engineering (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Computer Hardware Design (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Condensed Matter Physics & Semiconductors (AREA)
  • Quality & Reliability (AREA)
  • Automation & Control Theory (AREA)
  • General Engineering & Computer Science (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Testing Or Measuring Of Semiconductors Or The Like (AREA)
  • Oscillators With Electromechanical Resonators (AREA)
  • Transition And Organic Metals Composition Catalysts For Addition Polymerization (AREA)
  • Electrotherapy Devices (AREA)
PCT/US2019/024445 2018-03-28 2019-03-28 Mode selection for inspection WO2019191342A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020207030456A KR102472309B1 (ko) 2018-03-28 2019-03-28 검사를 위한 모드 선택
CN201980017247.5A CN111837228B (zh) 2018-03-28 2019-03-28 用于检验的模式选择的方法和系统

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
IN201841011800 2018-03-28
IN201841011800 2018-03-28
US201862728705P 2018-09-07 2018-09-07
US62/728,705 2018-09-07
US16/364,098 2019-03-25
US16/364,098 US10670536B2 (en) 2018-03-28 2019-03-25 Mode selection for inspection

Publications (1)

Publication Number Publication Date
WO2019191342A1 true WO2019191342A1 (en) 2019-10-03

Family

ID=68057078

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/024445 WO2019191342A1 (en) 2018-03-28 2019-03-28 Mode selection for inspection

Country Status (5)

Country Link
US (1) US10670536B2 (zh)
KR (1) KR102472309B1 (zh)
CN (1) CN111837228B (zh)
TW (1) TWI791806B (zh)
WO (1) WO2019191342A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210341396A1 (en) * 2020-04-29 2021-11-04 Samsung Electronics Co., Ltd. Wafer inspection apparatus and method

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10867108B2 (en) 2018-09-18 2020-12-15 Taiwan Semiconductor Manufacturing Co., Ltd. Optical mode optimization for wafer inspection
US10801968B2 (en) 2018-10-26 2020-10-13 Kla-Tencor Corporation Algorithm selector based on image frames
US11379969B2 (en) * 2019-08-01 2022-07-05 Kla Corporation Method for process monitoring with optical inspections
US11415531B2 (en) * 2019-10-11 2022-08-16 KLA Corp. Statistical learning-based mode selection for multi-mode inspection
US20230345115A1 (en) * 2020-09-21 2023-10-26 Molecular Devices, Llc Method and system of developing an imaging configuration to optimize performance of a microscopy system
DE102021207130A1 (de) * 2021-07-07 2023-01-12 Zf Friedrichshafen Ag System, Verfahren und Computerprogramm zur automatisierten Befundung wenigstens eines Bauteils

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060007434A1 (en) * 2004-07-12 2006-01-12 Dov Furman Multi mode inspection method and apparatus
US20110050703A1 (en) * 2009-08-25 2011-03-03 Siemens Corporation Method and system for interactive segmentation using texture and intensity cues
US20150042983A1 (en) * 2013-08-08 2015-02-12 Camtek Ltd. Multiple mode system and method for evaluating a substrate
US20160025648A1 (en) * 2014-07-22 2016-01-28 Kla-Tencor Corporation Virtual Inspection Systems with Multiple Modes
US20160123898A1 (en) * 2014-11-04 2016-05-05 Kla-Tencor Corporation Wafer Defect Discovery

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002303586A (ja) * 2001-04-03 2002-10-18 Hitachi Ltd 欠陥検査方法及び欠陥検査装置
EP1697729B1 (en) * 2003-09-04 2010-11-10 KLA-Tencor Corporation Methods for inspection of a specimen using different inspection parameters
US7570797B1 (en) * 2005-05-10 2009-08-04 Kla-Tencor Technologies Corp. Methods and systems for generating an inspection process for an inspection system
US8698093B1 (en) 2007-01-19 2014-04-15 Kla-Tencor Corporation Objective lens with deflector plates immersed in electrostatic lens field
US8126255B2 (en) 2007-09-20 2012-02-28 Kla-Tencor Corp. Systems and methods for creating persistent data for a wafer and for using persistent data for inspection-related functions
US8664594B1 (en) 2011-04-18 2014-03-04 Kla-Tencor Corporation Electron-optical system for high-speed and high-sensitivity inspections
US8692204B2 (en) 2011-04-26 2014-04-08 Kla-Tencor Corporation Apparatus and methods for electron beam detection
US8716662B1 (en) 2012-07-16 2014-05-06 Kla-Tencor Corporation Methods and apparatus to review defects using scanning electron microscope with multiple electron beam configurations
US8948494B2 (en) 2012-11-12 2015-02-03 Kla-Tencor Corp. Unbiased wafer defect samples
US9222895B2 (en) 2013-02-25 2015-12-29 Kla-Tencor Corp. Generalized virtual inspector
US9310320B2 (en) * 2013-04-15 2016-04-12 Kla-Tencor Corp. Based sampling and binning for yield critical defects
US9430743B2 (en) 2014-03-06 2016-08-30 Kla-Tencor Corp. Composite defect classifier
US9613411B2 (en) 2014-03-17 2017-04-04 Kla-Tencor Corp. Creating defect classifiers and nuisance filters
US10338004B2 (en) 2014-03-27 2019-07-02 KLA—Tencor Corp. Production sample shaping that preserves re-normalizability
US9582869B2 (en) 2014-10-19 2017-02-28 Kla-Tencor Corp. Dynamic binning for diversification and defect discovery
US9835566B2 (en) * 2015-03-03 2017-12-05 Kla-Tencor Corp. Adaptive nuisance filter
US20170069075A1 (en) * 2015-09-04 2017-03-09 Canon Kabushiki Kaisha Classifier generation apparatus, defective/non-defective determination method, and program
US10436720B2 (en) 2015-09-18 2019-10-08 KLA-Tenfor Corp. Adaptive automatic defect classification
US10186026B2 (en) 2015-11-17 2019-01-22 Kla-Tencor Corp. Single image detection
US9965901B2 (en) 2015-11-19 2018-05-08 KLA—Tencor Corp. Generating simulated images from design information
US11580375B2 (en) 2015-12-31 2023-02-14 Kla-Tencor Corp. Accelerated training of a machine learning based model for semiconductor applications
US9916965B2 (en) 2015-12-31 2018-03-13 Kla-Tencor Corp. Hybrid inspectors
US10648924B2 (en) 2016-01-04 2020-05-12 Kla-Tencor Corp. Generating high resolution images from low resolution images for semiconductor applications
US10043261B2 (en) 2016-01-11 2018-08-07 Kla-Tencor Corp. Generating simulated output for a specimen
US10181185B2 (en) 2016-01-11 2019-01-15 Kla-Tencor Corp. Image based specimen process control
US10360477B2 (en) 2016-01-11 2019-07-23 Kla-Tencor Corp. Accelerating semiconductor-related computations using learning based models
US10395356B2 (en) 2016-05-25 2019-08-27 Kla-Tencor Corp. Generating simulated images from input images for semiconductor applications
US10346740B2 (en) 2016-06-01 2019-07-09 Kla-Tencor Corp. Systems and methods incorporating a neural network and a forward physical model for semiconductor applications
US11580398B2 (en) 2016-10-14 2023-02-14 KLA-Tenor Corp. Diagnostic systems and methods for deep learning models configured for semiconductor applications
US10267748B2 (en) 2016-10-17 2019-04-23 Kla-Tencor Corp. Optimizing training sets used for setting up inspection-related algorithms
US10395362B2 (en) 2017-04-07 2019-08-27 Kla-Tencor Corp. Contour based defect detection
US10733744B2 (en) 2017-05-11 2020-08-04 Kla-Tencor Corp. Learning based approach for aligning images acquired with different modalities
US10769761B2 (en) 2017-06-30 2020-09-08 Kla-Tencor Corp. Generating high resolution images from low resolution images for semiconductor applications
US10607119B2 (en) 2017-09-06 2020-03-31 Kla-Tencor Corp. Unified neural network for defect detection and classification
US10748271B2 (en) * 2018-04-25 2020-08-18 Applied Materials Israel Ltd. Method of defect classification and system thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060007434A1 (en) * 2004-07-12 2006-01-12 Dov Furman Multi mode inspection method and apparatus
US20110050703A1 (en) * 2009-08-25 2011-03-03 Siemens Corporation Method and system for interactive segmentation using texture and intensity cues
US20150042983A1 (en) * 2013-08-08 2015-02-12 Camtek Ltd. Multiple mode system and method for evaluating a substrate
US20160025648A1 (en) * 2014-07-22 2016-01-28 Kla-Tencor Corporation Virtual Inspection Systems with Multiple Modes
US20160123898A1 (en) * 2014-11-04 2016-05-05 Kla-Tencor Corporation Wafer Defect Discovery

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210341396A1 (en) * 2020-04-29 2021-11-04 Samsung Electronics Co., Ltd. Wafer inspection apparatus and method
US11579096B2 (en) * 2020-04-29 2023-02-14 Samsung Electronics Co., Ltd. Wafer inspection apparatus and method

Also Published As

Publication number Publication date
KR102472309B1 (ko) 2022-11-29
CN111837228B (zh) 2021-11-30
KR20200127259A (ko) 2020-11-10
TWI791806B (zh) 2023-02-11
US10670536B2 (en) 2020-06-02
US20190302031A1 (en) 2019-10-03
TW202004936A (zh) 2020-01-16
CN111837228A (zh) 2020-10-27

Similar Documents

Publication Publication Date Title
US10670536B2 (en) Mode selection for inspection
US9518934B2 (en) Wafer defect discovery
CN106537125B (zh) 具有多种模式的虚拟检验系统
US10267748B2 (en) Optimizing training sets used for setting up inspection-related algorithms
JP7200113B2 (ja) 深くスタック化された層を有するウェハにおいて欠陥分類器を訓練して適用するためのシステムと方法
JP5619776B2 (ja) ウエハの検査のための1つまたは複数のパラメータの選択方法
TWI673489B (zh) 以使用一適應性滋擾過濾器產生針對一樣本之檢驗結果之系統及方法,以及非暫時性電腦可讀媒體
US10832396B2 (en) And noise based care areas
CN109844919B (zh) 优化用于设置检验相关算法的训练组
US11415531B2 (en) Statistical learning-based mode selection for multi-mode inspection
TWI833854B (zh) 用於多模式半導體檢測的光學模式選擇

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19775767

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20207030456

Country of ref document: KR

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 19775767

Country of ref document: EP

Kind code of ref document: A1