CN102262188B - Sampling inspection method for workpieces - Google Patents
Sampling inspection method for workpieces Download PDFInfo
- Publication number
- CN102262188B CN102262188B CN 201010194099 CN201010194099A CN102262188B CN 102262188 B CN102262188 B CN 102262188B CN 201010194099 CN201010194099 CN 201010194099 CN 201010194099 A CN201010194099 A CN 201010194099A CN 102262188 B CN102262188 B CN 102262188B
- Authority
- CN
- China
- Prior art keywords
- workpiece
- historical
- process parameter
- parameter data
- algorithm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 140
- 238000005070 sampling Methods 0.000 title abstract description 9
- 238000007689 inspection Methods 0.000 title abstract 2
- 230000008569 process Effects 0.000 claims abstract description 82
- 238000004519 manufacturing process Methods 0.000 claims abstract description 9
- 238000004422 calculation algorithm Methods 0.000 claims description 59
- 238000012360 testing method Methods 0.000 claims description 34
- 238000005259 measurement Methods 0.000 claims description 30
- 238000013528 artificial neural network Methods 0.000 claims description 28
- 238000009826 distribution Methods 0.000 claims description 21
- 238000012706 support-vector machine Methods 0.000 claims description 3
- 230000000903 blocking effect Effects 0.000 claims 2
- 238000004590 computer program Methods 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 14
- 230000002159 abnormal effect Effects 0.000 description 10
- 238000007781 pre-processing Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 6
- 238000012546 transfer Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 239000000047 product Substances 0.000 description 3
- 238000013442 quality metrics Methods 0.000 description 3
- 230000000153 supplemental effect Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 238000002790 cross-validation Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 238000000611 regression analysis Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000012467 final product Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000002203 pretreatment Methods 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000009183 running Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Landscapes
- General Factory Administration (AREA)
Abstract
The invention discloses a sampling inspection method for workpieces and a computer program product. In the method, a reliance index value and a reliance index threshold value of a virtual metrology value of one workpiece and a global similarity index (GSI) value and a GSI threshold value of process parameter data of the workpiece are calculated by analyzing the process parameter data of a production machine. When the reliance index value of the workpiece is smaller than the reliance index threshold value or the GSI value of the workpiece is greater than the GSI threshold value, the workpiece can be selected to be measured.
Description
Technical field
The invention relates to a kind of method of workpiece pick test, particularly relevant for a kind of method and the computer program thereof that can effectively inspect out bad workpiece by random samples.
Background technology
Present most of semiconductor and TFT-LCD factory take the mode taken a sample test for the quality monitoring method of the product of producing board or workpiece, wherein this workpiece can be the wafer of semiconductor industry or the glass substrate of TFT-LCD industry.Complete the processing processing of several workpiece (Workpiece) when the production board after, these a little workpiece can be placed in card casket or a wafer transfer box (Front Opening Unified Pod; In FOUP, detect the quality of workpiece to be sent to measurement platform.Generally speaking, measurement platform can be selected a workpiece regularly from a plurality of workpiece (for example: 25) of whole card casket be that sample measures, for example: the unit one in the card casket.The processing procedure quality that the method for the pick test that this kind is known hypothesis is produced board is abnormal suddenly not, thereby the product that can be taken a sample test with quilt or the measurement of workpiece be inferred the quality of all products in same card casket or wafer transfer box.Yet the method for known pick test can only be learnt the quality of the workpiece that this reality is taken a sample test, and the workpiece that this reality is taken a sample test might not be the workpiece with potential risk, therefore often can produce Lou detecting (Miss Detection; MD) situation.In addition, if produce board abnormal between taking a sample test for twice, just prior art method can't in time find, thereby cause the generation of many defective productss, and cause considerable cost allowance.
In theory, if can all workpiece in same card casket or wafer transfer box all be measured, can avoid the situation of aforesaid leakage detecting, more can in time find to produce the board abnormal.Yet, each workpiece in same card casket or wafer transfer box is all carried out actual measurement quite spacious day time-consuming, need expend many manpower and materials.Moreover for wafer with hundreds of roads processing procedure or TFT-LCD factory, it is more almost the impossible task of part that wish is carried out actual measurement to each workpiece of every one processing procedure.
Therefore, occur for avoiding the problems referred to above, a kind of method and computer program thereof of workpiece pick test must be provided, measure so as to effectively selecting suitable workpiece, in order to do just in time finding when producing the board abnormal.
Summary of the invention
Therefore, an aspect of the present invention is exactly at a kind of method that workpiece pick test is provided and computer program thereof, by confidence index (the Reliance Index of judgement workpiece; RI) whether value is less than confidence indicator threshold value; Or the GSI of workpiece (Global Similarity Index; The overall similarity index) value whether greater than GSI threshold value (GSIT), is selected out suitable workpiece effectively measuring, and avoids the situation of leak detecting, and it is abnormal in time to find to produce board.
According to above-mentioned purpose of the present invention, a kind of method of workpiece pick test is proposed.In one embodiment of this invention, at first obtain the many groups of historical process parameter data of producing board, and obtain a plurality of historical measuring values from measurement platform, wherein these a little historical measuring values are respectively the measuring value of the workpiece of producing according to historical process parameter data.Then, estimate pattern and a reference model with historical process parameter data and historical measuring value, the foundation that wherein estimates pattern estimates algorithm according to one, and the foundation of reference model with reference to algorithm, estimates algorithm from different with reference to algorithm according to one.Then, input historical process parameter data to estimating pattern and reference model, and calculate a plurality of historical virtual measurement values and a plurality of historical reference predicted value.Then, calculate respectively the overlapping area between the distribution of the distribution (Distribution) of historical virtual measurement value and historical reference predicted value and produce a plurality of historical confidence desired values, wherein work as overlapping area larger, the confidence desired value is higher, represents that the confidence level of the historical virtual measurement value that corresponds to is higher.Then, calculate a confidence indicator threshold value (RI according to historical virtual measurement value, historical reference predicted value and historical measuring value
T).Then, collect to produce the process parameter data of a plurality of workpiece in the card casket that board sends, and the process parameter data of inputting each workpiece are to estimating pattern and reference model, and calculate virtual measurement value and the reference prediction value of each workpiece.Then, calculate the overlapping area between the distribution of the distribution of virtual measurement value of each workpiece and reference prediction value and produce the confidence desired value of each workpiece, wherein work as overlapping area larger, the confidence desired value is higher, represents that the confidence level of its virtual measurement value that corresponds to heals high.Then, choose its confidence desired value less than at least one first workpiece of confidence indicator threshold value in a little workpiece since then, and the first workpiece is delivered to measurement platform to detect.
According to another embodiment of the present invention, in the method for workpiece pick test, at first obtain the many groups of historical process parameter data of producing board.Then, use the historical process parameter data of this a little group, and according to a statistics apart from algorithm, set up a statistics distance mode.Then, with this historical process parameter data of a little group and historical measuring value, and the leaving-one method (Leave-One-Out in application validation-cross (Cross Validation); LOO) principle is rebuild the statistical distance pattern, and calculates corresponding GSI value, to calculate a GSI threshold value (GSI
T).Then, input the process parameter data of each workpiece to the statistical distance pattern, and calculate the GSI value of the corresponding process parameter data of virtual measurement value of each workpiece.Then, choose its GSI value greater than at least one second workpiece of GSI threshold value in a little workpiece since then, and second workpiece is sent to a measurement platform to detect.
According to above-mentioned purpose of the present invention, the computer program that a kind of interior storage is used for the workpiece pick test is separately proposed, after computing machine loads this computer program and carries out, can complete the method for workpiece pick test described above.
Therefore, use the present invention, can assess its quality possibility by the process parameter data of certain workpiece has extremely, measure effectively to select suitable workpiece, and avoid the situation of leak detecting, and it is abnormal in time to find to produce board.
Description of drawings
For above and other objects of the present invention, feature, advantage and embodiment can be become apparent, appended the description of the drawings is as follows:
Fig. 1 is the system architecture schematic diagram that illustrates the method for implementing workpiece pick test of the present invention;
Fig. 2 is the configuration diagram that illustrates the system of AVM according to an embodiment of the invention;
Fig. 3 is the schematic diagram that illustrates the confidence desired value of explanation embodiments of the invention;
Fig. 4 is the schematic diagram that illustrates the confidence indicator threshold value of explanation embodiments of the invention;
Fig. 5 illustrates the schematic flow sheet of workpiece sampling method according to an embodiment of the invention;
Fig. 6 A illustrates the virtual measurement value of application examples of the present invention and the result schematic diagram of actual amount measured value;
Fig. 6 B is the result schematic diagram that illustrates the confidence desired value of application examples of the present invention; Fig. 6 C is the result schematic diagram that illustrates the overall similarity desired value of application examples of the present invention.
[main description of reference numerals]
10: process parameter data pre-processing module 12: metric data pre-processing module
20: produce board 22: the process parameter data
30: measurement platform 40: confidence index module
50: index of similarity module 60: estimate pattern
62: two stage calculation mechanism 80: the card casket
82: workpiece 90:AVM
100: the RI and the GSI that calculate workpiece
Whether 110:RI is less than RI
TOr whether GSI is greater than GSI
T
120: determine whether measure
130: measured by measurement platform
A: overlapping area
Embodiment
Please refer to Fig. 1, it illustrates the system architecture schematic diagram of the method for implementing workpiece pick test of the present invention.The invention provides full-automatic type virtual measurement (Automatic Virtual Metrology; AVM) system 90 in producing between board 20 and measurement platform 30, measures so as to assisting measurement platform 30 to select suitable workpiece with the process parameter data 22 of all workpiece 82 in card casket 80.In one embodiment, AVM system 90 first notifies manufacturing execution system (Manufacturing Execution System; MES) code name of the workpiece selected out of (not shown), manufacturing execution system gives an order to measurement platform 30 according to the code name of this workpiece of being selected out again, so that this workpiece of being selected out is measured.In addition, in one embodiment, AVM system 90 is embedded in measurement platform 30.In another embodiment, AVM system 90 is embedded in and produces in board 20.Certainly, AVM system 90 also can carry out the workpiece sampling method independently, therefore the present invention and not subject to the limits.
Please refer to Fig. 2, it illustrates the configuration diagram of the system of AVM according to an embodiment of the invention.The AVM system 90 of the present embodiment comprises at least: process parameter data pre-processing module 10, metric data pre-processing module 12, estimate pattern 60, confidence index module 40 and index of similarity module 50.Process parameter data pre-processing module 10 is for arranging and standardization from the original process parameter data of producing board 20, and the suppressing exception data also filter out important parameter, inessential parameter is got rid of, and avoiding producing interference effect, and the impact prediction precision.Metric data pre-processing module 12 screens for the metric data from measurement platform 30, to remove exceptional value wherein.Estimating pattern 60 can utilize and estimate the phase one virtual measurement value (VM that algorithm estimates a plurality of workpiece 82 in card casket 80
I), also optionally utilize two stage calculation mechanism 62 and estimate the subordinate phase virtual measurement value (VM that algorithm estimates a plurality of workpiece 82 in card casket 80
II).The algorithm that estimates that may select has: return the various prediction algorithms such as algorithm, neural network algorithm.Confidence index module 40 is used for assessing the confidence level of virtual measurement value, and produces confidence index (RI).The process parameter data that index of similarity module 50 is used for assessing present input and the similarity degree that estimates all supplemental characteristics that are used for training modeling in pattern 60, and the index of similarity (GSI) of generation process parameter, this index of similarity judges the confidence degree of virtual measurement system in order to auxiliary confidence index.
Before estimating pattern 60 runnings, must be from producing process parameter data (historical process parameter data) that board 20 obtains and being sent to respectively process parameter data pre-processing module 10 and metric data pre-processing module 12 from the obtained quality metric data of measurement platform 30 (historical measuring value), to carry out data pre-processing.The input data that these process parameter data after pre-treatment and standardization and quality metric data are the pattern of estimating 60.Then, adopt historical process parameter data and corresponding historical quality metric data train (foundation) for example neural network (NN) estimate pattern.Estimate pattern 60 and have two stage calculation mechanism 62, in order to difference phase one virtual measurement value (VM
I) and subordinate phase virtual measurement value (VM
II) confidence desired value (RI) and the overall similarity desired value (GSI) corresponding with it.The confidence index that so-called " subordinate phase " virtual measurement value is followed with it and index of similarity are when obtaining the actual amount measured value of workpiece 82 from measurement platform, process parameter data and the actual amount measured value of workpiece 82 are added historical process parameter data and historical measuring value, again train or adjustment estimates reference model and the index of similarity module 50 statistical distance patterns of pattern 60, confidence index module 40, then recomputate the subordinate phase virtual measurement value (VM of each workpiece in card release casket 80
II) confidence index and the overall similarity index followed with it.
Below, the pattern of estimating, confidence desired value (reference model) and the relevant theoretical foundation of overall similarity desired value (statistical distance pattern) are described.
Estimate pattern and confidence index (reference model)
As shown in table 1, suppose to collect at present the data that the n group measures, comprise process data (X
i, i=1,2 ..., n) and corresponding actual amount measured value data (y
i, i=1,2 ..., n), wherein every group of process data includes p parameter (autoregressive parameter 1 is to parameter p), i.e. X
i=[x
i,1, x
i,2..., x
i,p]
TIn addition, process data when also collecting (m-n) actual production, but except y
n+1, there is no actual amount measured value data outward, namely in the workpiece of (m-n) actual production, for example only take a sample test that the first stroke workpiece carries out actual measurement, then with its actual measurement y
n+1Infer the quality of other (m-n-1) workpiece.
Table 1 raw data example
The sample number | Parameter | 1 | Parameter 2 | ? | Parameter p | The actual amount measured value |
1 | x 1,1 | x 1,2 | … | x 1,p | y 1 | |
2 | x 2,1 | x 2,2 | … | x 2,p | y 2 |
… | … | … | … | … | … |
n | x n,1 | x n,2 | … | x n,p | y n |
n+1 | x n+1,1 | x n+1,2 | … | x n+1,p | y n+1 |
n+2 | x n+2,1 | x n+2,2 | … | x n+2,p | Zip |
… | … | … | … | … | … |
m | x m,1 | x m,2 | … | x m,p | Zip |
In table 1, y
1, y
2..., y
nBe historical measuring value, y
n+1Actual amount measured value for the unit one in workpiece unit of cargo just aborning.Usually, one group of actual amount measured value (y
i, i=1,2 ..., n) for having average μ, the normality of standard deviation sigma is distributed, i.e. y
i~N (μ, σ
2).
For sample group (y
i, i=1,2 ..., average n) and standard deviation with all actual amount measured value data normalizations after, can obtain
(also being called z mark (z Scores)), wherein the average of each z mark is 0, and standard deviation is 1, namely
For actual metric data, if
More near 0, represent that metric data is more near the specification central value.Its standardized formula is as follows:
Wherein
y
iBe i group actual amount measured value data;
σ
yStandard deviation for all actual amount measured value data;
The algorithm that estimates of application neural network (NN) algorithm is herein set up the pattern that estimates of carrying out virtual measurement, and the checking of setting up with the reference prediction algorithm that for example returns algorithm this estimate the reference model of pattern.Yet the present invention also can use other algorithm for estimating algorithm or reference prediction algorithm, as long as the reference prediction algorithm is different from and estimates algorithm, therefore the present invention and not subject to the limits.Of the present inventionly estimate algorithm and the reference prediction algorithm for example can be respectively: back propagation neural network (BackPropagation Neural Network; BPNN), general recurrence neural network (General RegressionNeural Network; GRNN), neural network (Radial Basis Function NeuralNetwork at the bottom of radial basis; RBFNN), simple regression network (Simple Recurrent Network; SRN), Support Vector data description (Support Vector Data Description; SVDD), support vector machine (SupportVector Machine; SVM), multiple regression algorithm (Multiple Regression; MR); Part least square method (Partial Least Squares; PLS), non-linear inclined to one side least square method (the NonlinearIterative Partial Least Squares that substitutes; NIPALS) or generalized linear pattern (Generalized linearmodels; GLMs).
When application class neural network algorithm and multiple regression algorithm, be error sum of squares (Sum of Square Error as its condition of convergence; SSE) under minimum condition, during and n → ∞, this two-mode actual amount measured value after standardization separately is defined as
With
Its all should with real standardization after the actual amount measured value
Identical.In other words, when n → ∞,
All represent the actual amount measured value after standardization, but change its title for the purpose in response to different mode.Therefore
And
Expression
With
Be same allocated, but due to different estimation models, make the mean value of these two kinds prediction algorithms different from the estimated value of standard deviation.That is NN estimates the average estimator after mode standard
With the standard deviation estimator
Will with the multiple regression model standardization after the average estimator
With the standard deviation estimator
Different.
The confidence desired value is designed to judge the Reliability of virtual measurement value, so the confidence desired value should be taken into account the statistics distribution of virtual measurement value
Distribute with the statistics of actual amount measured value
Similarity degree between the two.Yet, when applying virtual measures, there is no the Reliability (significantly, if do not needed virtual measurement just obtain the actual amount measured value) that the actual amount measured value can be used for assessing the virtual measurement value.So the present invention adopts the statistics of being estimated by reference prediction algorithm (for example multiple regression algorithm) to distribute
Replace
Statistics distribute.Reference prediction algorithm of the present invention also can be other relevant prediction algorithm, therefore the present invention and not subject to the limits.
Please refer to Fig. 3, it illustrates the schematic diagram of the confidence desired value of explanation embodiments of the invention.Confidence desired value of the present invention is defined as the distribution of calculating the prediction (virtual measurement value) that estimates pattern (for example adopting neural network (NN) algorithm)
Distribution with the prediction (reference quantity measured value) of reference model (for example adopting the multiple regression algorithm)
Common factor area covering value (overlapping area A) between the two.Therefore, the formula of confidence desired value is as follows:
Wherein work as
When
σ is made as 1
The confidence desired value increases along with the increase of overlapping area A.This phenomenon points out to use result that the pattern of estimating obtains close to the result of using reference model to obtain, thereby corresponding virtual measurement value is more reliable.Otherwise the fiduciary level of corresponding virtual measurement value reduces along with the minimizing of overlapping area A.When by
Estimated distribution
With by
Estimated distribution
Complete when overlapping, according to statistical theory of distribution, its confidence desired value equals 1; And when two distributed almost completely separately, its confidence desired value leveled off to 0.
Below explanation estimates mode computation virtual measurement value
With
The method of distribution.
In estimating pattern, if the condition of convergence is minimum error quadratic sum (SSE), can suppose " given
Under,
The average that is assigned as equal
Variance is
Distribution ", namely given
Under,
And
The NN estimator be
The NN estimator be
Before carrying out NN and estimating the modeling of pattern, need first carry out the standardized step of process data.
It is as follows that NN estimates pattern process data standardization formula:
Wherein
x
i,jBe j process parameter in i group process data;
It is the process parameter after j standardization in i group process data;
Use the process data after this n organizes standardization
Actual amount measured value after the standardization of n group therewith
Come construction NN to estimate pattern.Then, the process data after the standardization of input m group
Estimate in pattern to NN, to obtain the virtual measurement value after corresponding standardization
Therefore,
(namely
Estimated value and
(namely
Estimated value can be calculated by formula as follows:
The basic assumption of multiple regression algorithm is " given
Under,
The average that is assigned as equal
Variance is
Distribution ", namely given
Under,
And
The multiple regression estimator be
The multiple regression estimator
For trying to achieve the process data after n organizes standardization
Actual amount measured value after the standardization of n group therewith
Between relation, must definition utilizing in multiple regression analysis the corresponding weight of these p parameter is (β
r0, β
r1, β
r2..., β
rp).Construction
With
Relation is as follows:
L
Suppose
Utilize the least square method in statistically multiple regression analysis, can try to achieve parameter beta
rEstimator
Namely
Then, multiple regression model can obtain:
Therefore, when estimating the stage, after process data is come in, can obtain its corresponding multiple regression estimated value according to formula (15)
The standard variance
The multiple regression estimator be
Have:
When the estimator of trying to achieve NN and estimate pattern
With
And the estimator of multiple regression model
With
After, can draw normality distribution diagram as shown in Figure 3, calculate to use the distribution common factor area covering value (overlapping area A) between the two of the prediction (reference quantity measured value) of the distribution of the prediction (virtual measurement value) that estimates pattern (for example adopting neural network (NN) algorithm) and reference model (for example adopting the multiple regression algorithm), can obtain the confidence desired value of each virtual measurement value.
After obtaining confidence desired value (RI), must stipulate a confidence indicator threshold value RI
T).If RI<RI
T, the degree of reliability of virtual measurement value that has this RI workpiece is low, that is have the quality of the workpiece of this RI may be abnormal, therefore need carry out actual measurement.Below describe and determine confidence indicator threshold value (RI
T) method:
Stipulating confidence indicator threshold value (RI
T) before, at first need stipulate out the maximum admissible error upper limit (E
L).The error of virtual measurement value (Error) is actual amount measured value y
iObtain with the pattern that estimated by NN
Difference, then divided by the percent of the absolute value after the mean value of all actual amount measured values, namely
Then, can specify the maximum admissible error upper limit (E according to the degree of accuracy specification of the defined error of formula (18) and virtual measurement
L).Therefore, confidence indicator threshold value (RI
T) be defined as corresponding to the maximum admissible error upper limit (E
L) confidence desired value (RI), as shown in 4 figure.That is,
μ and σ are defined in formula (4); And
σ wherein
yBe defined in formula (3).
Overall similarity index (GSI)
As mentioned above, when applying virtual measures, there is not the actual amount measured value can obtain to verify the degree of accuracy of virtual measurement value.Therefore, with the multiple regression estimated value after standardization
Actual amount measured value after the replacement standardization
Calculate confidence desired value (RI).Yet this kind replacement may cause the error of confidence desired value (RI), and in order to compensate this situation, the overall similarity index (GSI) that the present invention proposes processing procedure helps judge the degree of reliability of virtual measurement.
The concept of GSI proposed by the invention is that all the history parameters data when adopt at present equipment process data when the input of virtual measurement system with modeling are compared, and obtains a process data of inputting and the similarity degree index of all history parameters data.
The present invention can quantize similarity with various statistical distance algorithm, such as: mahalanobis distance algorithm (Mahalanobis Distance), Euclidean distance algorithm (Euclidean Distance) and center method (Centroid Method) etc.The statistical distance algorithm that mahalanobis distance is introduced 1936 Christian eras by P.C.Mahalanobis.This kind technological means is based on the kenel of the relevance between variable with identification and the different sample groups of analysis.Mahalanobis distance is in order to determine the method for the similarity between unknown sample group and known sample group, and the relevance between the method consideration data group also has yardstick unchangeability (Scale Invariant), and namely the size to measuring value is not relevant.If data have high similarity, the mahalanobis distance that calculates will be less.
The size of the GSI that utilization of the present invention calculates (mahalanobis distance) is differentiated the process data that newly advances whether similar in appearance to all process datas of modeling.If the GSI that calculates is little, represent that the process data that newly advances is similar to the process data of modeling, the virtual measurement value of the process data (high similarity) that therefore newly advances will be more accurate.Otherwise if the GSI that calculates is excessive, some is different for the process data of the process data that newly advances of expression and modeling.Thereby the quality with workpiece of the process data that newly advances (low similarity) may be abnormal, therefore need carry out actual measurement.
Estimate the standardization process parameter of pattern
Computing formula suc as formula shown in (5), (6) and (7).At first, definition example edition supplemental characteristic X
M=[x
M,1, x
M,2..., x
M,p]
T, x wherein
M,jEqual
So, each parameter of the modeling process data after standardization is 0 (that is the modeling parameters Z after standardization
M,jBe 0).In other words, Z
M=[Z
M, 1,Z
M,2..., Z
M,p]
TIn all parameters be 0.Next calculate the related coefficient between modeling parameters after each standardization.
Suppose that the related coefficient between s parameter and t parameter is rst, and k group data are wherein arranged,
After completing the related coefficient of calculating between each parameter, can obtain correlation matrix as follows:
Suppose the inverse matrix (R of R
-1) be defined as A,
So, the standardized process parameter (Z of λ pen
λ) and standardized example edition supplemental characteristic (Z
M) between mahalanobis distance
Computing formula is as follows:
(24)
Can get
After obtaining the GSI value, use leaving-one method (Leave-One-Out in validation-cross (Cross Validation); LOO) principle defines GSI threshold value (GSI
T).GSI threshold value (GSI
T) formula as follows:
So-called " leaving-one method (Leave-One-Out; LOO) principle " from whole modeling samples; extract a test sample book of reaching the standard grade as emulation; re-use remaining Sample Establishing GSI model, then use the test sample book that this newly-built GSI model reaches the standard grade for this emulation and calculate its GSI value, this is worth with GSI
LOOExpression.Then repeat above-mentioned steps until in modeling sample all each sample standard deviations calculate its corresponding GSI
LOOTherefore, in formula (26)
Representative sees through all GSI that the whole modeling samples of the former reason of LOO calculate
LOOThe for example 90% average Number of truncation (Trimmed Mean).The a value of formula (26) between 2 to 3, what it can be according to actual state fine setting, the default value of a is 3.
Workpiece sampling method of the present invention below is described.
Please refer to Fig. 5, it illustrates the schematic flow sheet of workpiece sampling method according to an embodiment of the invention.Estimate pattern, reference model and statistical distance pattern in foundation; And acquisition confidence indicator threshold value (RI
T) and GSI threshold value (GSI
T) after, the process parameter data of each workpiece in the input card casket are to the above-mentioned pattern that estimates, reference model and statistical distance pattern, to calculate confidence desired value (RI) and the GSI value (step 100) of each workpiece.Then, to each workpiece, carry out step 110, to judge that whether its confidence desired value (RI) is less than confidence indicator threshold value (RI
T); Or whether its GSI value is greater than GSI threshold value (GSI
T), if judgment result is that of step 110 is carry out step 120, the workpiece of the condition that meets step 110 is measured whether determining; Otherwise finish the workpiece sampling method of the present embodiment.If judgment result is that of step 120 is carry out step 120, by measurement platform, this workpiece is measured.In one embodiment, the method for workpiece pick test of the present invention measures the workpiece that all in casket of card meet the condition of step 110.In another embodiment, because the characteristic of each workpiece in same card casket is identical, therefore, only need certainly blocks and select at least one workpiece in the workpiece of the condition that meets step 110 in casket and measure and get final product.If the determination result is NO for step 120, finish the workpiece sampling method of the present embodiment.
Will be understood that, the method for workpiece pick test of the present invention is above-described implementation step, and interior storage of the present invention is used for the computer program of workpiece pick test, in order to complete the method for workpiece pick test described above.
Please refer to Fig. 6 A to Fig. 6 C, Fig. 6 A illustrates the virtual measurement value of application examples of the present invention and the result schematic diagram of actual amount measured value; Fig. 6 B is the result schematic diagram that illustrates the confidence desired value of application examples of the present invention; Fig. 6 C is the result schematic diagram that illustrates the overall similarity desired value of application examples of the present invention.
As shown in Figure 6A, the 1st to 100 data are the historical measuring value of the 1st to 100 workpiece, and it corresponds to respectively the historical process parameter data of many groups, estimates pattern, reference model and statistical distance pattern in order to foundation; And acquisition confidence indicator threshold value (RI
T) and GSI threshold value (GSI
T).The the 101st to 125 data are a plurality of workpiece in the card casket, and wherein the 101st workpiece taken a sample test by known mode, therefore have the actual amount measured value, sets up in order to adjustment pattern, reference model and the statistical distance pattern of estimating.The purpose of workpiece sampling method of the present invention is: effectively select out suitable workpiece measuring in the 102nd to 125 workpiece, and avoid the situation of leak detecting, and it is abnormal in time to find to produce board.
As shown in Fig. 6 B, utilize confidence desired value (RI) to judge which workpiece (representing with which data group) need be sent to measurement platform to detect.Then, as shown in Fig. 6 C, utilize overall similarity desired value (GSI) to judge the similarity degree of workpiece data and modeling data.Wherein, the 114th data group is although its RI is greater than RI
T(0.567), but its GSI greater than GSI
T(5.093), representative needs the 114th workpiece delivered to measurement platform to detect, with the situation generation of pre-leakproof detecting.And the 107th with the 120th data, because of its RI less than RI
TAnd because of its GSI greater than GSI
TTherefore, need the 107th, 120 workpiece delivered to measurement platform to detect, with the situation generation of pre-leakproof detecting.Except the 107th, 114 with 120 data because the RI of all the other workpiece is greater than RI
TAnd its GSI is less than GSI
T, representative need not detect the workpiece except the 107th, 114 and 120 workpiece, thereby uses manpower and material resources sparingly.In another embodiment, the present invention also can only select at least one workpiece and measures in the 107th, 114 and 120 workpiece.
By the invention described above preferred embodiment as can be known, the method for workpiece pick test of the present invention can be selected out suitable workpiece effectively measuring, and avoids the situation of leak detecting, and it is abnormal in time to find to produce board.
Although the present invention discloses as above with embodiment; so it is not to limit the present invention; any those of ordinary skill in this technical field; without departing from the spirit and scope of the present invention; when can be used for a variety of modifications and variations, so protection scope of the present invention is as the criterion when looking accompanying claims institutes confining spectrum.
Claims (7)
1. the method for a workpiece pick test, is characterized in that, comprises:
Obtain many groups of historical process parameter data of producing board;
Obtain a plurality of historical measuring values from a measurement platform, wherein these a plurality of historical measuring values are respectively the measuring value of the workpiece of producing according to the historical process parameter data of this many group;
Estimate pattern with these historical process parameter data of many groups and these a plurality of historical measuring values, wherein this foundation that estimates pattern estimates algorithm according to one;
Set up a reference model with these historical process parameter data of many groups and these a plurality of historical metric data, wherein with reference to algorithm, it is different with reference to algorithm from this that this estimates algorithm according to one in the foundation of this reference model;
Input should the historical process parameter data of many groups estimate pattern to this, and calculated a plurality of historical virtual measurement values;
Input should be organized historical process parameter data to this reference model more, and calculated a plurality of historical reference predicted values;
Calculate respectively the overlapping area between the distribution of the distribution of these a plurality of historical virtual measurement values and these a plurality of historical reference predicted values and produce a plurality of historical confidence desired values, wherein work as overlapping area larger, historical confidence desired value is higher, represents that the confidence level of these a plurality of historical virtual measurement values that correspond to is higher;
Historical virtual measurement values a plurality of according to this, these a plurality of historical reference predicted values and this a plurality of historical measuring values calculate a confidence indicator threshold value;
Collect the process parameter data of blocking a plurality of workpiece in casket that this production board is sent;
The process parameter data of inputting these a plurality of workpiece estimate pattern to this, and calculate a plurality of virtual measurement values of these a plurality of workpiece;
Input the process parameter data of these a plurality of workpiece to this reference model, and calculate a plurality of reference prediction values of these a plurality of workpiece;
Calculate respectively the overlapping area between the distribution of the distribution of these a plurality of virtual measurement values of these a plurality of workpiece and these a plurality of reference prediction values and produce a plurality of confidence desired values of these a plurality of workpiece, wherein work as overlapping area larger, the confidence desired value is higher, represents that the confidence level of these a plurality of virtual measurement values that correspond to is higher;
Choose its confidence desired value less than at least one first workpiece of this confidence indicator threshold value in these a plurality of workpiece; And
This at least one first workpiece of these a plurality of workpiece is delivered to this measurement platform to detect.
2. the method for workpiece pick test according to claim 1, is characterized in that, this estimates algorithm and this and selects respectively with reference to algorithm and freely return the group that algorithm and a neural network algorithm form.
3. the method for workpiece pick test according to claim 1, it is characterized in that, this estimates algorithm and this and selects respectively neural network at the bottom of freely a back propagation neural network, a general recurrence neural network, a radial basis, a simple regression network, a Support Vector data description, a support vector machine, a multiple regression algorithm, a part of least square method, one non-linearly to substitute the group that inclined to one side least square method and a generalized linear pattern form with reference to algorithm.
4. the method for workpiece pick test according to claim 1, is characterized in that, also comprises:
Using should the historical process parameter data of many groups, and according to a statistics apart from algorithm, set up a statistics distance mode;
With these historical process parameter data of many groups and this a plurality of historical measuring values, and the leaving-one method principle in the application validation-cross rebuilds this statistical distance pattern, and calculates corresponding overall similarity desired value, to calculate an overall similarity indicator threshold value;
Input the process parameter data of these a plurality of workpiece to this statistical distance pattern, and calculate the overall similarity desired value of the corresponding process parameter data of these a plurality of virtual measurement values of these a plurality of workpiece;
Choose its overall similarity desired value greater than at least one second workpiece of this overall similarity indicator threshold value in these a plurality of workpiece; And
This at least one second workpiece of these a plurality of workpiece is delivered to this measurement platform to test.
5. the method for workpiece pick test according to claim 4, is characterized in that, the group that the free mahalanobis distance algorithm of this statistical distance algorithm choosing, an Euclidean distance algorithm and a center method form.
6. the method for a workpiece pick test, is characterized in that, comprises:
Obtain many groups of historical process parameter data of producing board;
Obtain a plurality of historical measuring values from a measurement platform, wherein these a plurality of historical measuring values are respectively the measuring value of the workpiece of producing according to the historical process parameter data of this many group;
Estimate pattern with these historical process parameter data of many groups and these a plurality of historical measuring values, wherein this foundation that estimates pattern estimates algorithm according to one;
Collect the process parameter data of blocking a plurality of workpiece in casket that this production board is sent;
The process parameter data of inputting these a plurality of workpiece estimate pattern to this, and calculate a plurality of virtual measurement values of these a plurality of workpiece;
Using should the historical process parameter data of many groups, and according to a statistics apart from algorithm, set up a statistics distance mode;
With these historical process parameter data of many groups and this a plurality of historical measuring values, and the leaving-one method principle in the application validation-cross rebuilds this statistical distance pattern, and calculates corresponding overall similarity desired value, to calculate an overall similarity indicator threshold value;
Input the process parameter data of these a plurality of workpiece to this statistical distance pattern, and calculate the overall similarity desired value of the corresponding process parameter data of these a plurality of virtual measurement values of these a plurality of workpiece;
Choose its overall similarity desired value greater than at least one first workpiece of this overall similarity indicator threshold value in these a plurality of workpiece; And
This at least one first workpiece in these a plurality of workpiece is delivered to a measurement platform to detect.
7. the method for workpiece pick test according to claim 6, is characterized in that, this statistical distance algorithm is the group that the free mahalanobis distance algorithm of choosing, an Euclidean distance algorithm and a center method form.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 201010194099 CN102262188B (en) | 2010-05-28 | 2010-05-28 | Sampling inspection method for workpieces |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 201010194099 CN102262188B (en) | 2010-05-28 | 2010-05-28 | Sampling inspection method for workpieces |
Publications (2)
Publication Number | Publication Date |
---|---|
CN102262188A CN102262188A (en) | 2011-11-30 |
CN102262188B true CN102262188B (en) | 2013-06-05 |
Family
ID=45008893
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 201010194099 Expired - Fee Related CN102262188B (en) | 2010-05-28 | 2010-05-28 | Sampling inspection method for workpieces |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102262188B (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI539298B (en) * | 2015-05-27 | 2016-06-21 | 國立成功大學 | Metrology sampling method with sampling rate decision scheme and computer program product thereof |
CN108268987B (en) * | 2016-12-30 | 2021-08-06 | 郑芳田 | Method for estimating quality of various products |
CN112563152B (en) * | 2019-09-25 | 2023-01-31 | 长鑫存储技术有限公司 | Manufacturing method and system |
TWI742709B (en) * | 2020-06-04 | 2021-10-11 | 國立成功大學 | Method for predicting occurrence of tool processing event and virtual metrology application and computer program product thereof |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101067742A (en) * | 2005-10-31 | 2007-11-07 | 台湾积体电路制造股份有限公司 | Method and system for virtual metrology |
US20070282767A1 (en) * | 2006-05-10 | 2007-12-06 | Fan-Tien Cheng | Method for Evaluating Reliance Level of a Virtual Metrology System |
CN101320258A (en) * | 2007-06-08 | 2008-12-10 | 郑芳田 | Two-stage virtual measurement method |
US20090292386A1 (en) * | 2008-05-20 | 2009-11-26 | National Cheng Kung University | System and Method for Automatic Virtual Metrology |
TW201135474A (en) * | 2010-04-02 | 2011-10-16 | Foresight Technology Company Ltd | Method for sampling workpiece for inspection and computer program product performing the same |
-
2010
- 2010-05-28 CN CN 201010194099 patent/CN102262188B/en not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101067742A (en) * | 2005-10-31 | 2007-11-07 | 台湾积体电路制造股份有限公司 | Method and system for virtual metrology |
US20070282767A1 (en) * | 2006-05-10 | 2007-12-06 | Fan-Tien Cheng | Method for Evaluating Reliance Level of a Virtual Metrology System |
CN101320258A (en) * | 2007-06-08 | 2008-12-10 | 郑芳田 | Two-stage virtual measurement method |
US20090292386A1 (en) * | 2008-05-20 | 2009-11-26 | National Cheng Kung University | System and Method for Automatic Virtual Metrology |
TW201135474A (en) * | 2010-04-02 | 2011-10-16 | Foresight Technology Company Ltd | Method for sampling workpiece for inspection and computer program product performing the same |
Also Published As
Publication number | Publication date |
---|---|
CN102262188A (en) | 2011-11-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TWI539298B (en) | Metrology sampling method with sampling rate decision scheme and computer program product thereof | |
TWI521360B (en) | Metrology sampling method and computer program product thereof | |
KR101098037B1 (en) | System and method for automatic virtual metrology | |
CN102375413B (en) | Advanced process control system and method utilizing virtual metrology with reliance index | |
US7593912B2 (en) | Method for evaluating reliance level of a virtual metrology system in product manufacturing | |
TWI736696B (en) | Imaging overlay metrology method, computer program product, metrology module, and imaging overlay metrology system | |
CN101738991A (en) | Method for detecting out-of-specification quality of product and estimating actually measured value of product | |
CN102262188B (en) | Sampling inspection method for workpieces | |
CN101330030B (en) | Method for removing abnormal point of detection data | |
CN110245395B (en) | Method, system and medium for monitoring cylindrical shape error with spatial correlation | |
CN110874509A (en) | Multidimensional information fusion state evaluation method for high-end numerical control equipment | |
CN101320258B (en) | Two-stage virtual measurement method | |
CN101598754B (en) | System and method for automatic virtual metrology | |
TWI427487B (en) | Method for sampling workpiece for inspection and computer program product performing the same | |
CN113742248A (en) | Method and system for predicting organization process based on project measurement data | |
Sonmez et al. | Using accurately measured production amounts to obtain calibration curve corrections of production line speed and stoppage duration consisting of measurement errors | |
CN111914424A (en) | Design wind speed value taking method and system based on short-term wind measurement data | |
CN108415372B (en) | Thermal error compensation method for precision machine tool | |
CN115081798A (en) | PLS algorithm-based plate and strip hot finish rolling process sub-frame combined monitoring and diagnosis method | |
Arndt et al. | Analysis of Efficiency in Response Surface Designs Considering Orthogonality Deviations and Cost Models | |
Holm et al. | A step-down test for effects in unreplicated factorial designs | |
CN116050120B (en) | Landslide hidden danger activity remote sensing evaluation modeling method, system and storage medium | |
CN116433030A (en) | Rapid assessment method, system, medium and equipment for drought loss | |
Averchenkov et al. | Artificial Neural Networks as a Means of Restoring Passes in the Initial Data Array | |
Edwards | ESTIMATION BIAS AND LINEAR AGGREGATION OF NON-LINEAR RELATIONSHIPS |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C17 | Cessation of patent right | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130605 Termination date: 20140528 |