JP2023501062A - 異常機器トレース検出および分類 - Google Patents
異常機器トレース検出および分類 Download PDFInfo
- Publication number
- JP2023501062A JP2023501062A JP2022520973A JP2022520973A JP2023501062A JP 2023501062 A JP2023501062 A JP 2023501062A JP 2022520973 A JP2022520973 A JP 2022520973A JP 2022520973 A JP2022520973 A JP 2022520973A JP 2023501062 A JP2023501062 A JP 2023501062A
- Authority
- JP
- Japan
- Prior art keywords
- traces
- trace
- anomalies
- modified
- original
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title abstract description 27
- 230000002547 anomalous effect Effects 0.000 title description 17
- 238000010801 machine learning Methods 0.000 claims abstract description 16
- 239000004065 semiconductor Substances 0.000 claims abstract description 10
- 238000000034 method Methods 0.000 claims description 25
- 230000008569 process Effects 0.000 claims description 18
- 230000009471 action Effects 0.000 claims description 10
- 230000000153 supplemental effect Effects 0.000 claims description 5
- 238000012549 training Methods 0.000 claims description 3
- 230000002159 abnormal effect Effects 0.000 abstract description 11
- 238000005284 basis set Methods 0.000 description 10
- 238000013459 approach Methods 0.000 description 8
- 238000013145 classification model Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 4
- 238000012552 review Methods 0.000 description 4
- 238000003070 Statistical process control Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 208000032368 Device malfunction Diseases 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000002790 cross-validation Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 238000000491 multivariate analysis Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000007473 univariate analysis Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/079—Root cause analysis, i.e. error or fault diagnosis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
- G06F11/0736—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in functional embedded systems, i.e. in a data processing system designed as a combination of hardware and software dedicated to performing a certain function
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0751—Error or fault detection not based on redundancy
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0766—Error or fault reporting or storing
- G06F11/0778—Dumping, i.e. gathering error/state information after a fault for later diagnosis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/211—Selection of the most significant subset of features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/40—Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L21/00—Processes or apparatus adapted for the manufacture or treatment of semiconductor or solid state devices or of parts thereof
- H01L21/02—Manufacture or treatment of semiconductor devices or of parts thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N7/00—Computing arrangements based on specific mathematical models
- G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Software Systems (AREA)
- Biomedical Technology (AREA)
- Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Mathematical Physics (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Manufacturing & Machinery (AREA)
- Computer Hardware Design (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Power Engineering (AREA)
- Human Computer Interaction (AREA)
- Testing And Monitoring For Control Systems (AREA)
- Debugging And Monitoring (AREA)
- Testing Or Measuring Of Semiconductors Or The Like (AREA)
Abstract
Description
本出願は、参照によってその全体が本願に組み込まれる、2019年10月6日に出願された“Equipment Trouble Prevention(ETP):An effective approach to Anomalous Equipment Trace Detection and Classification without Prior Labeling”と題された米国仮特許出願第62/911346号からの優先権を主張するものである。
Claims (10)
- 半導体機器トレースデータにおける異常を検出および分類するためのプロセスであって、
それぞれの半導体機器センサから複数のオリジナルトレースを受信することと、
前記複数のオリジナルトレースのうち少なくとも第1のトレースセットにおける複数の異常を識別することと、
第1の標的特徴に基づいて前記第1のトレースセットの各々を修正することと、
前記修正された第1のトレースセットの各々から基底特徴セットを生成することと、
前記修正された第1のトレースセットおよび前記基底特徴セットから複数の再現されたトレースを作成することと、
前記複数の異常の各々に分類を割り当てることと
を備えるプロセス。 - 前記第1のオリジナルトレースセット、前記修正されたトレース、および前記再現されたトレースに基づいて異常を検出および分類するために機械学習モデルを訓練することと、
半導体機器の動作環境に前記機械学習モデルを展開することと
を更に備える、請求項1に記載のプロセス。 - 前記それぞれの半導体機器センサから追加のトレースを受信することと、
前記追加のトレースの第1のセットにおいて追加の異常を識別することと、
統計的特性の基本セットを除去するために前記追加のトレースを修正することと、
前記修正された追加のトレースから前記基底特徴セットを生成することと、
前記修正された追加のトレースから再現された追加のトレースを作成することと、
前記第1のオリジナルトレースセット、前記修正された追加のトレース、および前記再現された追加のトレースに基づいて、前記機械学習モデルを更新することと
を更に備える、請求項2に記載のプロセス。 - 前記複数のオリジナルトレースの前記第1のセットを、前記第1の事前定義された標的特徴との効果的な相関性を有するものとして識別すること
を更に備える、請求項1に記載のプロセス。 - 前記複数のオリジナルトレースの前記第1のセットを、複数の事前定義された標的特徴との効果的な相関性を有するものとして識別すること
を更に備える、請求項1に記載のプロセス。 - 前記第1のトレースセットの統計的特性のセットを計算することと、
前記統計的特性のセットを除去するために前記第1のトレースセットを修正することと、
前記修正された第1のトレースセットに関するアルゴリズム的解法を計算することと
を備え、
前記アルゴリズム的解法および前記統計的特性のセットが前記基底特徴セットを形成する、請求項1に記載のプロセス。 - 前記基底特徴セットにおいて捕捉されない未知のトレース変動として残差特徴を決定することと、
前記第1の標的特徴に既知の影響を及ぼす補足特徴を決定することと、
前記第1のオリジナルトレースセット、前記修正された追加のトレース、前記再現された追加のトレース、前記基底特徴セット、前記残差特徴、および前記補足特徴に基づいて、前記機械学習モデルを更新することと
を更に備える、請求項3に記載のプロセス。 - 前記複数のオリジナルトレースは、大部分が通常のトレースを含み、前記複数の異常は、わずかな異常しか示さない、請求項1に記載のプロセス。
- 選択されたトレース異常をレビューするためのグラフィックユーザインタフェースを提供することと、
前記グラフィックユーザインタフェースからの第1の入力として、前記選択されたトレース異常に関連する複数の事前定義されたクラスの1つを受信することと、
前記グラフィックユーザインタフェースからの第2の入力として、前記選択されたトレース異常に割り当てられる複数の事前定義されたアクションの1つを受信することと
を更に備える、請求項1に記載のプロセス。 - プロセッサによって実行されると、前記プロセッサに、
それぞれの半導体機器センサから複数のオリジナルトレースを受信させ、
前記複数のオリジナルトレースのうち少なくとも第1のトレースセットにおける複数の異常を識別させ、
第1の標的特徴に基づいて前記第1のトレースセットの各々を修正させ、
前記修正された第1のトレースセットの各々から基底特徴セットを生成させ、
前記修正された第1のトレースセットおよび前記基底特徴セットから複数の再現されたトレースを作成させ、
前記複数の異常の各々に分類を割り当てさせる
命令を有する、非一時的コンピュータ可読媒体。
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201962911346P | 2019-10-06 | 2019-10-06 | |
US62/911,346 | 2019-10-06 | ||
PCT/US2020/054431 WO2021071854A1 (en) | 2019-10-06 | 2020-10-06 | Anomalous equipment trace detection and classification |
Publications (3)
Publication Number | Publication Date |
---|---|
JP2023501062A true JP2023501062A (ja) | 2023-01-18 |
JPWO2021071854A5 JPWO2021071854A5 (ja) | 2023-10-16 |
JP7470784B2 JP7470784B2 (ja) | 2024-04-18 |
Family
ID=75274106
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2022520973A Active JP7470784B2 (ja) | 2019-10-06 | 2020-10-06 | 異常機器トレース検出および分類 |
Country Status (5)
Country | Link |
---|---|
US (2) | US11609812B2 (ja) |
JP (1) | JP7470784B2 (ja) |
KR (1) | KR102627062B1 (ja) |
CN (1) | CN114600087A (ja) |
WO (1) | WO2021071854A1 (ja) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11227209B2 (en) * | 2019-07-31 | 2022-01-18 | Dell Products L.P. | Systems and methods for predicting information handling resource failures using deep recurrent neural network with a modified gated recurrent unit having missing data imputation |
US11176019B2 (en) * | 2020-04-01 | 2021-11-16 | International Business Machines Corporation | Automated breakpoint creation |
WO2022221109A1 (en) * | 2021-04-14 | 2022-10-20 | Amgen Inc. | Automated outlier removal for multivariate modeling |
CN113516174B (zh) * | 2021-06-03 | 2022-04-19 | 清华大学 | 调用链异常检测方法、计算机设备以及可读存储介质 |
CN113807441B (zh) * | 2021-09-17 | 2023-10-27 | 长鑫存储技术有限公司 | 半导体结构制备中的异常传感器监测方法及其装置 |
US11961030B2 (en) | 2022-01-27 | 2024-04-16 | Applied Materials, Inc. | Diagnostic tool to tool matching methods for manufacturing equipment |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4317805B2 (ja) * | 2004-09-29 | 2009-08-19 | 株式会社日立ハイテクノロジーズ | 欠陥自動分類方法及び装置 |
KR20070104331A (ko) * | 2004-10-12 | 2007-10-25 | 케이엘에이-텐코 테크놀로지스 코퍼레이션 | 표본 상의 결함들을 분류하기 위한 컴퓨터-구현 방법 및시스템 |
JP4723466B2 (ja) | 2006-12-19 | 2011-07-13 | 三菱電機株式会社 | データ処理装置及びデータ処理方法及びプログラム |
US7987150B1 (en) * | 2007-02-09 | 2011-07-26 | Siglaz | Method and apparatus for automated rule-based sourcing of substrate microfabrication defects |
US8396582B2 (en) * | 2008-03-08 | 2013-03-12 | Tokyo Electron Limited | Method and apparatus for self-learning and self-improving a semiconductor manufacturing tool |
JP5119022B2 (ja) | 2008-03-26 | 2013-01-16 | 東京瓦斯株式会社 | 可変的予測モデル構築方法、及び、可変的予測モデル構築システム |
US20130173332A1 (en) * | 2011-12-29 | 2013-07-04 | Tom Thuy Ho | Architecture for root cause analysis, prediction, and modeling and methods therefor |
US9129237B2 (en) * | 2011-12-28 | 2015-09-08 | Elitetech Technology Co., Ltd. | Integrated interfacing system and method for intelligent defect yield solutions |
US9880842B2 (en) * | 2013-03-15 | 2018-01-30 | Intel Corporation | Using control flow data structures to direct and track instruction execution |
US10430719B2 (en) | 2014-11-25 | 2019-10-01 | Stream Mosaic, Inc. | Process control techniques for semiconductor manufacturing processes |
US10436720B2 (en) * | 2015-09-18 | 2019-10-08 | KLA-Tenfor Corp. | Adaptive automatic defect classification |
US10360477B2 (en) * | 2016-01-11 | 2019-07-23 | Kla-Tencor Corp. | Accelerating semiconductor-related computations using learning based models |
US11023577B2 (en) | 2016-08-04 | 2021-06-01 | Adobe Inc. | Anomaly detection for time series data having arbitrary seasonality |
KR101970619B1 (ko) * | 2017-06-28 | 2019-04-22 | 한국과학기술연구원 | 비정상 상황 검출 방법 및 이를 수행하기 위한 시스템 |
US10656204B2 (en) | 2017-09-21 | 2020-05-19 | Pdf Solutions, Inc. | Failure detection for wire bonding in semiconductors |
KR20190040825A (ko) * | 2017-10-11 | 2019-04-19 | 주식회사 씨세론 | 데이터 처리 방법 및 장치 |
US10732883B1 (en) * | 2019-01-28 | 2020-08-04 | International Business Machines Corporation | Storage layer selection based upon information assignment |
US11232368B2 (en) * | 2019-02-20 | 2022-01-25 | Accenture Global Solutions Limited | System for predicting equipment failure events and optimizing manufacturing operations |
-
2020
- 2020-10-06 CN CN202080075571.5A patent/CN114600087A/zh active Pending
- 2020-10-06 KR KR1020227014543A patent/KR102627062B1/ko active IP Right Grant
- 2020-10-06 JP JP2022520973A patent/JP7470784B2/ja active Active
- 2020-10-06 US US17/064,422 patent/US11609812B2/en active Active
- 2020-10-06 WO PCT/US2020/054431 patent/WO2021071854A1/en active Application Filing
- 2020-10-14 US US17/070,520 patent/US20210142122A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
US20210103489A1 (en) | 2021-04-08 |
KR102627062B1 (ko) | 2024-01-18 |
CN114600087A (zh) | 2022-06-07 |
KR20220070302A (ko) | 2022-05-30 |
JP7470784B2 (ja) | 2024-04-18 |
WO2021071854A1 (en) | 2021-04-15 |
US11609812B2 (en) | 2023-03-21 |
TW202139033A (zh) | 2021-10-16 |
US20210142122A1 (en) | 2021-05-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7470784B2 (ja) | 異常機器トレース検出および分類 | |
US11080127B1 (en) | Methods and apparatus for detection of process parameter anomalies | |
JP2020119605A (ja) | 異常検出システム、異常検出方法、異常検出プログラム及び学習済モデル生成方法 | |
CN111459700B (zh) | 设备故障的诊断方法、诊断装置、诊断设备及存储介质 | |
US8732100B2 (en) | Method and apparatus for event detection permitting per event adjustment of false alarm rate | |
CN111241673B (zh) | 用于噪声环境工业设备的健康状态预测方法 | |
US10565080B2 (en) | Discriminative hidden kalman filters for classification of streaming sensor data in condition monitoring | |
CA2931624A1 (en) | Systems and methods for event detection and diagnosis | |
JP2012150820A (ja) | 予測的状態監視のための診断システムおよび方法 | |
Pavlovski et al. | Hierarchical convolutional neural networks for event classification on PMU measurements | |
JPWO2008120552A1 (ja) | 診断システム | |
JP2019204321A (ja) | 情報処理方法、情報処理装置、及びプログラム | |
Tra et al. | Outlier detection via multiclass deep autoencoding Gaussian mixture model for building chiller diagnosis | |
CN112416662A (zh) | 多时间序列数据异常检测方法与装置 | |
CN115454778A (zh) | 大规模云网络环境下的时序指标异常智能监控系统 | |
TW202211341A (zh) | 從處理追蹤預測裝備故障模式 | |
JP2003044123A (ja) | プラント診断装置 | |
JP7173284B2 (ja) | イベント監視装置、方法及びプログラム | |
Jin et al. | Data-driven resiliency solutions for boards and systems | |
US20200310897A1 (en) | Automatic optimization fault feature generation method | |
KR102486463B1 (ko) | 열화에 따른 시계열 데이터를 이용한 실시간 이상 감지 방법 및 그를 위한 장치 | |
WO2023155967A1 (en) | Thermal anomaly management | |
Hu et al. | Online sequential extreme learning machines for fault detection | |
Chandrashekar et al. | In-vivo fault analysis and real-time fault prediction for rf generators using state-of-the-art classifiers | |
CN117034125B (zh) | 一种用于大数据融合的分类管理系统及方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20221214 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20231005 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20231005 |
|
A871 | Explanation of circumstances concerning accelerated examination |
Free format text: JAPANESE INTERMEDIATE CODE: A871 Effective date: 20231005 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20231128 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20240219 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20240312 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20240408 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7470784 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |