SG11201901334SA - Convolutional neural network-based mode selection and defect classification for image fusion - Google Patents

Convolutional neural network-based mode selection and defect classification for image fusion

Info

Publication number
SG11201901334SA
SG11201901334SA SG11201901334SA SG11201901334SA SG11201901334SA SG 11201901334S A SG11201901334S A SG 11201901334SA SG 11201901334S A SG11201901334S A SG 11201901334SA SG 11201901334S A SG11201901334S A SG 11201901334SA SG 11201901334S A SG11201901334S A SG 11201901334SA
Authority
SG
Singapore
Prior art keywords
international
convolutional neural
defects
pct
image
Prior art date
Application number
SG11201901334SA
Other languages
English (en)
Inventor
Bjorn Brauer
Original Assignee
Kla Tencor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kla Tencor Corp filed Critical Kla Tencor Corp
Publication of SG11201901334SA publication Critical patent/SG11201901334SA/en

Links

Classifications

    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L22/00Testing or measuring during manufacture or treatment; Reliability measurements, i.e. testing of parts without further processing to modify the parts as such; Structural arrangements therefor
    • H01L22/10Measuring as part of the manufacturing process
    • H01L22/12Measuring as part of the manufacturing process for structural parameters, e.g. thickness, line width, refractive index, temperature, warp, bond strength, defects, optical inspection, electrical measurement of structural dimensions, metallurgic measurement of diffusions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/19Recognition using electronic means
    • G06V30/192Recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references
    • G06V30/194References adjustable by an adaptive method, e.g. learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/9501Semiconductor wafers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133Distances to prototypes
    • G06F18/24143Distances to neighbourhood prototypes, e.g. restricted Coulomb energy networks [RCEN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/001Industrial image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/19Recognition using electronic means
    • G06V30/191Design or setup of recognition systems or techniques; Extraction of features in feature space; Clustering techniques; Blind source separation
    • G06V30/19173Classification techniques
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L22/00Testing or measuring during manufacture or treatment; Reliability measurements, i.e. testing of parts without further processing to modify the parts as such; Structural arrangements therefor
    • H01L22/20Sequence of activities consisting of a plurality of measurements, corrections, marking or sorting steps
    • H01L22/24Optical enhancement of defects or not directly visible states, e.g. selective electrolytic deposition, bubbles in liquids, light emission, colour change
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L22/00Testing or measuring during manufacture or treatment; Reliability measurements, i.e. testing of parts without further processing to modify the parts as such; Structural arrangements therefor
    • H01L22/30Structural arrangements specially adapted for testing or measuring during manufacture or treatment, or specially adapted for reliability measurements
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8854Grading and classifying of flaws
    • G01N2021/8867Grading and classifying of flaws using sequentially two or more inspection runs, e.g. coarse and fine, or detecting then analysing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30148Semiconductor; IC; Wafer

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Multimedia (AREA)
  • Pathology (AREA)
  • Immunology (AREA)
  • Biochemistry (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Manufacturing & Machinery (AREA)
  • Power Engineering (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Databases & Information Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Testing Or Measuring Of Semiconductors Or The Like (AREA)
SG11201901334SA 2016-09-14 2017-09-13 Convolutional neural network-based mode selection and defect classification for image fusion SG11201901334SA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662394744P 2016-09-14 2016-09-14
US15/371,882 US10115040B2 (en) 2016-09-14 2016-12-07 Convolutional neural network-based mode selection and defect classification for image fusion
PCT/US2017/051405 WO2018053031A1 (en) 2016-09-14 2017-09-13 Convolutional neural network-based mode selection and defect classification for image fusion

Publications (1)

Publication Number Publication Date
SG11201901334SA true SG11201901334SA (en) 2019-04-29

Family

ID=61560270

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201901334SA SG11201901334SA (en) 2016-09-14 2017-09-13 Convolutional neural network-based mode selection and defect classification for image fusion

Country Status (8)

Country Link
US (1) US10115040B2 (zh)
JP (1) JP6901565B2 (zh)
KR (1) KR102235581B1 (zh)
CN (1) CN109690749B (zh)
IL (1) IL264874B (zh)
SG (1) SG11201901334SA (zh)
TW (1) TWI733900B (zh)
WO (1) WO2018053031A1 (zh)

Families Citing this family (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10740939B1 (en) * 2016-12-09 2020-08-11 Snap Inc. Fast image style transfers
JP6668278B2 (ja) 2017-02-20 2020-03-18 株式会社日立ハイテク 試料観察装置および試料観察方法
EP3489892B1 (en) * 2017-11-24 2022-01-05 Ficosa Adas, S.L.U. Determining clean or dirty captured images
WO2019159324A1 (ja) * 2018-02-16 2019-08-22 パナソニックIpマネジメント株式会社 処理方法およびそれを利用した処理装置
US10599951B2 (en) 2018-03-28 2020-03-24 Kla-Tencor Corp. Training a neural network for defect detection in low resolution images
US11151711B2 (en) * 2018-06-06 2021-10-19 Kla-Tencor Corporation Cross layer common-unique analysis for nuisance filtering
CN110663971B (zh) * 2018-07-02 2022-03-29 天津工业大学 基于双分支深度融合卷积神经网络的红枣品质分类方法
CN109003239B (zh) * 2018-07-04 2022-03-29 华南理工大学 一种基于迁移学习神经网络的多光谱图像锐化方法
EP3598474A1 (en) * 2018-07-19 2020-01-22 FEI Company Adaptive specimen image acquisition using an artificial neural network
US11668655B2 (en) 2018-07-20 2023-06-06 Kla Corporation Multimode defect classification in semiconductor inspection
CN109239075B (zh) * 2018-08-27 2021-11-30 北京百度网讯科技有限公司 电池检测方法及装置
TWI690859B (zh) * 2018-09-10 2020-04-11 陳柏蒼 利用圖形辨識量測水位之方法及其系統
US10867108B2 (en) * 2018-09-18 2020-12-15 Taiwan Semiconductor Manufacturing Co., Ltd. Optical mode optimization for wafer inspection
CN109492628B (zh) * 2018-10-08 2021-11-16 杭州电子科技大学 一种应用于课堂违纪抓取的球形定位系统的实现方法
JP2022504937A (ja) * 2018-10-19 2022-01-13 ジェネンテック, インコーポレイテッド 畳み込みニューラルネットワークによる凍結乾燥製剤における欠陥検出
CN109115805A (zh) * 2018-10-25 2019-01-01 广东华中科技大学工业技术研究院 基于超声和光学双成像的透明构件缺陷检测装置及方法
WO2020082396A1 (zh) * 2018-10-27 2020-04-30 合刃科技(深圳)有限公司 一种检测方法和检测装置
CN109598287B (zh) * 2018-10-30 2021-06-08 中国科学院自动化研究所 基于深度卷积生成对抗网络样本生成的外观瑕疵检测方法
US11151707B2 (en) 2018-12-07 2021-10-19 Kla Corporation System and method for difference filter and aperture selection using shallow deep learning
TWI694414B (zh) * 2018-12-18 2020-05-21 國立成功大學 卷積神經網路分析方法、電腦程式產品與電子裝置
US11010885B2 (en) * 2018-12-18 2021-05-18 Kla Corporation Optical-mode selection for multi-mode semiconductor inspection
US11379967B2 (en) * 2019-01-18 2022-07-05 Kla Corporation Methods and systems for inspection of semiconductor structures with automatically generated defect features
CN109902584B (zh) * 2019-01-28 2022-02-22 深圳大学 一种口罩缺陷的识别方法、装置、设备及存储介质
WO2020166076A1 (ja) * 2019-02-15 2020-08-20 株式会社日立ハイテク 構造推定システム、構造推定プログラム
CN112001211B (zh) * 2019-05-27 2024-04-19 商汤集团有限公司 对象检测方法、装置、设备及计算机可读存储介质
CN110246131A (zh) * 2019-06-21 2019-09-17 成都卡普数据服务有限责任公司 基于卷积神经网络的导线分股缺陷图像识别方法
US11151412B2 (en) * 2019-07-01 2021-10-19 Everseen Limited Systems and methods for determining actions performed by objects within images
US11527005B2 (en) 2019-07-22 2022-12-13 Samsung Electronics Co., Ltd. Video depth estimation based on temporal attention
WO2021040409A1 (ko) * 2019-08-27 2021-03-04 삼성전자 주식회사 광학 검사 방법 및 이를 이용한 장치
US11580650B2 (en) 2019-10-01 2023-02-14 KLA Corp. Multi-imaging mode image alignment
US11415531B2 (en) 2019-10-11 2022-08-16 KLA Corp. Statistical learning-based mode selection for multi-mode inspection
US11087449B2 (en) * 2019-10-24 2021-08-10 KLA Corp. Deep learning networks for nuisance filtering
KR20220074927A (ko) * 2019-10-31 2022-06-03 칼 짜이스 에스엠테 게엠베하 고형상비 구조의 형상 편차를 측정하기 위한 fib-sem 3d 단층 촬영
CN114787878A (zh) 2019-11-12 2022-07-22 光明机器公司 用于制造测试的图像分析系统
US20210158223A1 (en) * 2019-11-22 2021-05-27 Kla Corporation Finding Semiconductor Defects Using Convolutional Context Attributes
JP2021089219A (ja) * 2019-12-05 2021-06-10 東洋製罐グループホールディングス株式会社 画像検査システム、及び画像検査方法
US11961219B2 (en) 2020-02-27 2024-04-16 KLA Corp. Generative adversarial networks (GANs) for simulating specimen images
US11151710B1 (en) * 2020-05-04 2021-10-19 Applied Materials Israel Ltd. Automatic selection of algorithmic modules for examination of a specimen
US11769242B2 (en) 2020-05-21 2023-09-26 Kla Corporation Mode selection and defect detection training
TWI777173B (zh) * 2020-06-01 2022-09-11 汎銓科技股份有限公司 人工智慧辨識之半導體影像量測方法
JP7332810B2 (ja) * 2020-07-09 2023-08-23 株式会社日立ハイテク パターンマッチング装置、パターン測定システム、パターンマッチングプログラム
US11889222B2 (en) * 2020-07-23 2024-01-30 Malay Kundu Multilayer three-dimensional presentation
US11328410B2 (en) 2020-08-03 2022-05-10 KLA Corp. Deep generative models for optical or other mode selection
CN112734692B (zh) * 2020-12-17 2023-12-22 国网信息通信产业集团有限公司 一种变电设备缺陷识别方法及装置
CN113012123A (zh) * 2021-03-13 2021-06-22 山东大学 碳纤维复合材料缺陷损伤分类识别与定量分析方法及系统
CN113077444A (zh) * 2021-04-01 2021-07-06 复旦大学 一种基于cnn的超声无损检测图像缺陷分类方法
CN114170230B (zh) * 2022-02-14 2022-04-29 清华大学 基于可变形卷积与特征融合的玻璃缺陷检测方法与装置
CN115239712B (zh) * 2022-09-21 2023-01-31 季华实验室 电路板表面缺陷检测方法、装置、电子设备及存储介质
CN116051542B (zh) * 2023-03-06 2023-07-14 深圳市深视智能科技有限公司 缺陷检测方法及缺陷检测装置

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7333650B2 (en) * 2003-05-29 2008-02-19 Nidek Co., Ltd. Defect inspection apparatus
WO2008086282A2 (en) 2007-01-05 2008-07-17 Kla-Tencor Corporation Methods and systems for using electrical information for a device being fabricated on a wafer to perform one or more defect-related functions
JP6185693B2 (ja) * 2008-06-11 2017-08-23 ケーエルエー−テンカー・コーポレーションKla−Tencor Corporation ウェーハー上の設計欠陥および工程欠陥の検出、ウェーハー上の欠陥の精査、設計内の1つ以上の特徴を工程監視特徴として使用するための選択、またはそのいくつかの組み合わせのためのシステムおよび方法
JP5509581B2 (ja) 2008-11-27 2014-06-04 信越半導体株式会社 半導体ウェーハの評価方法
US8223327B2 (en) 2009-01-26 2012-07-17 Kla-Tencor Corp. Systems and methods for detecting defects on a wafer
US8605275B2 (en) * 2009-01-26 2013-12-10 Kla-Tencor Corp. Detecting defects on a wafer
US8896832B2 (en) 2010-06-17 2014-11-25 Kla-Tencor Corp. Discrete polarization scatterometry
US9401013B2 (en) * 2012-02-03 2016-07-26 Applied Materials Israel, Ltd. Method of design-based defect classification and system thereof
JP6009956B2 (ja) * 2013-01-31 2016-10-19 株式会社日立ハイテクノロジーズ 欠陥検査装置および欠陥検査方法
US9222895B2 (en) * 2013-02-25 2015-12-29 Kla-Tencor Corp. Generalized virtual inspector
US8984450B2 (en) * 2013-03-14 2015-03-17 Taiwan Semiconductor Manufacturing Company, Ltd. Method and apparatus for extracting systematic defects
US9726617B2 (en) * 2013-06-04 2017-08-08 Kla-Tencor Corporation Apparatus and methods for finding a best aperture and mode to enhance defect detection
US10290088B2 (en) * 2014-02-14 2019-05-14 Kla-Tencor Corporation Wafer and lot based hierarchical method combining customized metrics with a global classification methodology to monitor process tool condition at extremely high throughput
WO2015138130A1 (en) * 2014-03-10 2015-09-17 Applied Materials, Inc. Pixel blending for multiple charged-particle beam lithography
CN104977313A (zh) * 2014-04-09 2015-10-14 四川省特种设备检验研究院 一种焊缝x射线图像缺陷检测与识别方法和装置
US9401016B2 (en) 2014-05-12 2016-07-26 Kla-Tencor Corp. Using high resolution full die image data for inspection

Also Published As

Publication number Publication date
KR102235581B1 (ko) 2021-04-01
JP2019530117A (ja) 2019-10-17
JP6901565B2 (ja) 2021-07-14
US10115040B2 (en) 2018-10-30
US20180075594A1 (en) 2018-03-15
TW201824417A (zh) 2018-07-01
KR20190042739A (ko) 2019-04-24
CN109690749B (zh) 2020-05-29
WO2018053031A1 (en) 2018-03-22
IL264874B (en) 2021-02-28
TWI733900B (zh) 2021-07-21
CN109690749A (zh) 2019-04-26

Similar Documents

Publication Publication Date Title
SG11201901334SA (en) Convolutional neural network-based mode selection and defect classification for image fusion
SG11201900509YA (en) Simultaneous capturing of overlay signals from multiple targets
SG11201907090WA (en) Affine motion information derivation
SG11201903141QA (en) Business processing method and apparatus
SG11201900804WA (en) System and method for generating multi-channel tunable illumination from a broadband source
SG11201811405QA (en) Improved differentiation method
SG11201807369UA (en) System and method for beam adjustment request
SG11201805532XA (en) Multivalent and multispecific 41bb-binding fusion proteins
SG11201909541WA (en) Chimeric antibody/t-cell receptor constructs and uses thereof
SG11201907912YA (en) An appliance operation signal processing system and method
SG11201806541RA (en) Image classification and labeling
SG11201906521UA (en) Method for sex sorting of mosquitoes and apparatus therefor
SG11201906315TA (en) Image recognition method and apparatus based on augmented reality
SG11201907394UA (en) Two-dimensional code generation method and device, and two-dimensional code recognition method and device
SG11201903715XA (en) High sensitivity repeater defect detection
SG11201710238QA (en) Autonomic incident triage prioritization by performance modifier and temporal decay parameters
SG11201907091PA (en) Intra-prediction mode propagation
SG11201906372PA (en) Computer-implemented system and method for generating and extracting user related data stored on a blockchain
SG11201906656PA (en) A data-driven system for optimal vehicle fleet dimensioning, ride-sharing, and real-time dispatching based on shareability networks
SG11201908675PA (en) Computer-implemented system and method for performing transaction mixing on a blockchain
SG11201901168UA (en) Apparatuses and methods including ferroelectric memory and for operating ferroelectric memory
SG11201811333RA (en) Solid inspection apparatus and method of use
SG11201903172TA (en) Lens examination equipment and method
SG11201909561RA (en) Octree-based convolutional neural network
SG11201807325UA (en) Optimizing range of aircraft docking system