CN103913464B - A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection - Google Patents

A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection Download PDF

Info

Publication number
CN103913464B
CN103913464B CN201410104025.6A CN201410104025A CN103913464B CN 103913464 B CN103913464 B CN 103913464B CN 201410104025 A CN201410104025 A CN 201410104025A CN 103913464 B CN103913464 B CN 103913464B
Authority
CN
China
Prior art keywords
defect
image
real
array
time obtaining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410104025.6A
Other languages
Chinese (zh)
Other versions
CN103913464A (en
Inventor
王耀南
尹逊帅
贺振东
冯明涛
吴成中
陈铁建
周显恩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan University
Original Assignee
Hunan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan University filed Critical Hunan University
Priority to CN201410104025.6A priority Critical patent/CN103913464B/en
Publication of CN103913464A publication Critical patent/CN103913464A/en
Application granted granted Critical
Publication of CN103913464B publication Critical patent/CN103913464B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

The invention discloses a kind of high speed railway track surface imperfection matching process based on Machine Vision Detection, comprise step 1: obtain rail panoramic picture f (x, y); Step 2: adopt vertical projection method to extract rail surface area image f from rail panoramic picture 1(x, y); Step 3: carry out medium filtering process to rail surface area image, obtains the rail surface area image f removing noise 2(x, y); Step 4: Image semantic classification is carried out to rail surface area image; Step 5: extract image f 4defect characteristic information in (x, y); Step 6: obtain history respectively and gather the defect characteristic information in image and the defect characteristic information in real-time image acquisition; Step 7: the characteristic information of Real-time Obtaining defect is carried out matching primitives with the characteristic information of all storage defects successively, obtains the defect characteristic information of mating.This inventive method achieves high speed, the high precision coupling of rail surface defect.

Description

A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection
Technical field
The invention belongs to mechanical vision inspection technology field, particularly a kind of high speed railway track surface imperfection matching process based on Machine Vision Detection.
Background technology
In the traffic transport industry of China, railway plays huge effect.Along with the development of modern rail technology, the serviceable life of rail is more and more longer, but due to the railway network of China very huge, so the length in serviceable life of rail is indefinite, cannot unify safeguard and change.When train runs on the defective rail in surface, very easily damage train, serious also can cause train accident.In order to ensure security and the continuity of transportation by railroad, needing to carry out regular detection to rail, safeguard there being the rail of damage and changing.When train significantly raises speed and heavy haul train is started, understand the quality of rail in time, examination and controlling has just more been necessary especially in real time.
SPEED VISION detection system based on the railroad track surface imperfection of machine vision technique can detect rail surface defect high-speed, high precision, save manpower, realize the intelligent classification identification of rail defect, can safeguard that railroad track improves the suggestion instructed timely and effectively for railway interests.But also there is many problems in actual applications, wherein the redundancy of rail view data is exactly a urgent problem.Gather in the SPEED VISION detection system of railroad track surface imperfection the redundancy that there will be data in image process, show certain lengths of rail by multi collect in once gathering, or certain lengths of rail only needs preservation a in collection repeatedly.This just needs the rail information of redundancy to find and records their positional information.
In sum, the rail information of None-identified and eliminate redundancy in existing Machine Vision Inspecting System, is badly in need of a kind of matching process of high-speed iron track surface machine vision defects detection, so that eliminate redundancy information.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of high speed railway track surface imperfection matching process based on Machine Vision Detection, its object is to, and finds out the high speed railway track surface defect image by repeated acquisition and preservation.
Based on a high speed railway track surface imperfection matching process for Machine Vision Detection, comprise following step:
Step 1: obtain rail panoramic picture f (x, y);
Step 2: adopt vertical projection method to extract rail surface area image f from rail panoramic picture 1(x, y);
Step 3: carry out medium filtering process to rail surface area image, obtains the rail surface area image f removing noise 2(x, y);
Step 4: to the rail surface area image f removing noise 2(x, y) carries out binaryzation operation successively and morphology opens operation, makes f 2each division region in (x, y) bonds mutually, obtains image f 4(x, y);
Step 5: to image f 4(x, y) projects line by line and adopts blob analytical approach to obtain image f 4defect characteristic information in (x, y), described defect characteristic information comprises the shape information of defect and the positional information of defect;
Step 6: operation history collection image and real-time image acquisition being carried out respectively to step 1-step 5, obtains history respectively and gathers the defect characteristic information in image and the defect characteristic information in real-time image acquisition;
Step 7: the characteristic information of Real-time Obtaining defect is carried out matching primitives with the characteristic information of all storage defects successively, the site error Ep of acquisition Real-time Obtaining defect and storage defect and plesiomorphism degree S; Utilize fuzzy control rule according to Ep and S, obtain the defect characteristic information of mating.
In described step 6, history gathers the defect characteristic information in image, comprises shape information Dtm (m) of storage defect and the positional information Lt of storage defect m(LX, LY, RX, RY, XW, YH), m represents m storage defect, and span is that 1-M, M represent storage defect sum;
Defect characteristic information in real-time image acquisition, comprises shape information Dom (n) of Real-time Obtaining defect and the positional information Lo of Real-time Obtaining defect n(LX, LY, RX, RY, XW, YH), n represents the n-th Real-time Obtaining defect, and span is the sum that 1-N, N represent Real-time Obtaining defect;
Wherein, shape information Am (j) of each defect is according to each defect place image f 4line number j in (x, y), obtains according to following formulae discovery:
Am ( j ) = Σ y = 1 Width f 4 ( j , y ) 255 ;
Wherein, j is the integer between [1, Height], and Height is image f 4the height of (x, y), Width is image f 4(x, y) wide, LX is the left row coordinate of defect boundary rectangle, LY is the left-hand line coordinate of defect boundary rectangle, RX is the right side row-coordinate of defect boundary rectangle, RY is the right-hand column coordinate of defect boundary rectangle, the width that XW is defect and defect institute across columns, the height that YH is defect and defect institute inter-bank number.
The concrete acquisition process of the defect characteristic information of the coupling in described step 7 is as follows:
1) judge whether Real-time Obtaining defect and storage defect are same defect;
The width Lt (XW) of the width Lo (XW) of contrast Real-time Obtaining defect and storage defect, contrasts the height Lo (YH) of Real-time Obtaining defect and the height Lt (YH) of storage defect, if or then Real-time Obtaining defect and storage defect are not same defects, otherwise, then calculate the site error Ep of Real-time Obtaining defect and storage defect, judges further Real-time Obtaining defect and storage defect whether as same defect;
2) the site error Ep of Real-time Obtaining defect and storage defect is calculated:
Ep = Lt m ( RX ) | Lt m ( LX ) - Lo n ( LX ) | + Lt m ( LX ) | Lt m ( RX ) - Lo n ( RX ) | 2 Lt m ( LX ) Lo n ( RX )
If Ep>0.2, then Real-time Obtaining defect and storage defect are not same defects, otherwise, then calculate the plesiomorphism degree S of Real-time Obtaining defect and storage defect;
3) Real-time Obtaining defect is as follows with the plesiomorphism degree S computation process of storage defect:
Step a: the length of adjustment array Dom (n);
Find peak point Pkt, Pko of array Dtm (m) and array Dom (n), take peak point as the length of reference point adjustment array Dom (n), wherein, before Dtm (m) array peak point, length is LFt, after peak point, length is LBt, before Dom (n) array peak point, length is LFo, and after peak point, length is LBo;
If then illustrate that two arrays are reverse, enter step b; Otherwise, if then adjust array Dom (n), namely array Dom (n) peak point previous section is adjusted to LFt length, redundance intercepts, and lacks part and gets Dtm (m) array appropriate section polishing; Array Dom (n) peak point aft section is adjusted to LBt length, and redundance intercepts, and lacks part peek group Dtm (m) appropriate section polishing, enters step c;
Step b: array Dom (n) upset is stored, repeats step a;
Step c: the plesiomorphism degree S of calculating Real-time Obtaining defect and storage defect;
S = M Σ i = 1 M Dtm ( i ) Dom ( i ) - Σ i = 1 M Dtm ( i ) Σ i = 1 M Dom ( i ) M Σ i = 1 M Dtm ( i ) - ( Σ i = 1 M Dtm ( i ) ) 2 M Σ i = 1 M Dom ( i ) - ( Σ i = 1 M Dom ( i ) ) 2 ;
4) set membership function, Fuzzy Processing is carried out to input variable;
&mu; S ( S ) = P 1 0.8 &le; S &le; 0.9 Q 1 0.9 < S &le; 0.95 R 1 0.95 < S &le; 1.0 , &mu; EP ( EP ) = P 2 0 &le; EP &le; 0.1 Q 2 0.1 < EP &le; 0.15 R 2 0.15 < EP &le; 0.2
5) according to fuzzy reasoning table, Fuzzy Linguistic Variable U is exported, wherein, N 0expression Real-time Obtaining defect and storage defect are not same defects, P 0expression Real-time Obtaining defect and storage defect are same defects;
Table 1 fuzzy reasoning table
Numbering Input variable (S, EP) Output variable U
1 (R 1,P 2) P 0
2 (R 1,Q 2) P 0
3 (R 1,R 2) N 0
4 (Q 1,P 2) P 0
5 (Q 1,Q 2) N 0
6 (Q 1,R 2) N 0
7 (P 1,P 2) N 0
8 (P 1,Q 2) N 0
9 (P 1,R 2) N 0
6) recording output variable is N 0coupling defect characteristic information.
The specific implementation process of described step 2 is as follows:
1. add up gray-scale value by column, produces gray average array Avg (i) that rail image f (x, y) respectively arranges:
Avg ( i ) = &Sigma; x = 1 Height f ( x , i ) Height , i &Element; [ 1 , Width ] , Height is the height of image, and i is that image i-th arranges;
2. the average Avg_all of Avg (i) is calculated;
3. Avg (i) array binaryzation, compares with Avg_all one by one by Avg (i) array, is greater than Avg_all and is set to 1, is less than Avg_all and is set to 0, obtain array Avg_Val (i):
Avg _ Val ( i ) = 1 , Avg ( i ) &GreaterEqual; Avg _ all 0 , Avg ( i ) < Avg _ all ;
4. find in Avg_Val (i) array first continuous ten number be all 1 point, this marginal point Begin_Point started as rail surface image; Find after Avg_Val (i) array Begin_Point first continuous ten number be all 0 point, this marginal point End_Point started as rail surface image, intercept rail image f (x, y) the Begin_Point image arranged between End_Point and namely obtain rail surface image f 1(x, y).
The specific implementation process of described step 3 is to rail surface image f 1(x, y) carries out the median filtering operation of a time 3 × 3, removes image noise, obtains the rail surface image f of low noise 2(x, y).
The specific implementation process of described step 4 is as follows:
1. global threshold T is set, to rail surface image f 2(x, y) carries out binaryzation and obtains bianry image f 3(x, y):
f 3 ( x , y ) = 255 , f 2 ( x , y ) &GreaterEqual; T 0 , f 2 ( x , y ) < T ;
2. use the oval structure element B of 9 × 9 to bianry image f 3(x, y) carries out morphology and opens operation and obtain image f 4(x, y):
Meet " Θ " in formula and represent etching operation in mathematical morphology, symbol represent the closed procedure in mathematical morphology, the single division region in image is bonded mutually.
Beneficial effect
Provided by the inventionly provide a kind of high speed railway track surface imperfection matching process based on Machine Vision Detection, compared with prior art, its outstanding advantage is:
(1) matching speed is fast
The present invention takes into full account the actual conditions of rail surface image, and first use vertical projection method to extract rail surface region, the method can obtain rail surface region quickly and accurately; Then denoising is carried out to rail area image, now partial arithmetic amount is saved to the denoising of rail region denoising comparison panoramic picture; To the bianry image horizontal projection obtained, the defect shape information that data volume is minimum can be obtained, for subsequent treatment decreases computation burden; By the site error of defect and target, pre-matching is carried out to defect, improves the efficiency of subsequent match;
(2) accuracy of detection is high
The present invention carries out the coupling of fuzzy algorithm by the positional information of defect and shape information to defect, and only have positional information and shape information all to reach when high precision conforms to and be just identified coupling, precision is high, eliminates and much disturbs; Also remain more details information, therefore rail surface defects detection result is also more accurate simultaneously;
The present invention can realize high speed, the high precision coupling of rail surface defect, and easy and existing defect recognition algorithm merges mutually, realizes efficiently, detect rail surface defect accurately.
Accompanying drawing explanation
Fig. 1 is overall procedure schematic diagram of the present invention;
Fig. 2 is the two width rail images taken at different time same rail defect, and wherein, figure (a) is the rail image stored, the rail image that figure (b) is Real-time Collection;
Fig. 3 is the perspective view that figure (a) rail image in Fig. 2 carries out vertical projection acquisition;
Fig. 4 is for finding rail surface image border point schematic diagram in Fig. 3;
Fig. 5 is for obtaining the rail surface image of figure (a) in Fig. 2;
Fig. 6 is the binary map of Fig. 5;
Fig. 7 is the forward feature array comparison diagram of storage defect feature array and Real-time Obtaining defect;
Fig. 8 is the opposite feature array comparison diagram of storage defect feature array and Real-time Obtaining defect.
Embodiment
Below in conjunction with drawings and Examples, the present invention is further illustrated.
Embodiment 1
As shown in Figure 1, be the process flow diagram of a kind of high speed railway track surface imperfection matching process based on Machine Vision Detection of the present invention, concrete steps are as follows:
Step 1: obtain rail panoramic picture f (x, y);
Line scan camera carry ON TRAINS, controls collected by camera image by the scrambler on wheel, to make camera trigger rate and train speed match, ensures that the rail panoramic picture be spliced into contains complete rail surface defect information.
As shown in Figure 2, to the two width rail images that same rail defect is taken at different time, wherein, figure (a) is the rail image stored, the rail image that figure (b) is Real-time Collection;
Step 2: adopt vertical projection method to extract rail surface area image f from rail panoramic picture 1(x, y);
(1) to scheming (a) cumulative gray-scale value by column in Fig. 2, gray average array Avg (i) that rail image f (x, y) respectively arranges is produced:
Avg ( i ) = &Sigma; x = 1 Height f ( x , i ) Height , i &Element; [ 1 , Width ] , Height is the height of image, and i is that image i-th arranges;
Fig. 3 is the schematic diagram of each row gray average array Avg (i) of rail image f (x, y), and wherein horizontal ordinate is the columns i of rail image, and ordinate is gray average Avg (i) that image respectively arranges;
(2) the average Avg_all of Avg (i) is calculated:
Avg _ Val ( i ) = 1 , Avg ( i ) &GreaterEqual; Avg _ all 0 , Avg ( i ) < Avg _ all ; Width is the wide of image;
(3) Avg (i) array binaryzation, compares with Avg_all one by one by Avg (i) array, is greater than Avg_all and is set to 1, is less than Avg_all and is set to 0, obtain array Avg_Val (i): Avg _ Val ( i ) = 1 , Avg ( i ) &GreaterEqual; Avg _ all 0 , Avg ( i ) < Avg _ all ; As shown in Figure 4, wherein horizontal ordinate is the columns i of image to array Avg_Val (i), and ordinate is the binary value Avg_Val (i) of the gray average that image respectively arranges;
(4) find in Avg_Val (i) array first continuous ten number be all 1 point, this marginal point Begin_Point started as rail surface image; Find after Avg_Val (i) array Begin_Point first continuous ten number be all 0 point, this marginal point End_Point started as rail surface image, intercept rail image f (x, y) the Begin_Point image arranged between End_Point and namely obtain rail surface image f 1(x, y); As shown in Figure 5;
Step 3: medium filtering process rail surface area image being carried out to a time 3 × 3, obtains the rail surface area image f removing noise 2(x, y);
Step 4: to the rail surface area image f removing noise 2(x, y) carries out binaryzation operation successively and morphology opens operation, makes f 2each division region in (x, y) bonds mutually, obtains image f 4(x, y), as shown in Figure 6;
(1) global threshold T=150 is set, to rail surface image f 2(x, y) carries out binaryzation and obtains bianry image f 3(x, y):
f 3 ( x , y ) = 255 , f 2 ( x , y ) &GreaterEqual; T 0 , f 2 ( x , y ) < T ;
(2) use the oval structure element B of 9 × 9 to bianry image f 3(x, y) carries out morphology and opens operation and obtain image f 4(x, y):
Meet " Θ " in formula and represent etching operation in mathematical morphology, symbol represent the closed procedure in mathematical morphology, the single division region in image is bonded mutually;
Step 5: to image f 4(x, y) projects line by line and adopts blob analytical approach to obtain image f 4defect characteristic information in (x, y), described defect characteristic information comprises the shape information of defect and the positional information of defect;
Step 6: operation history collection image and real-time image acquisition being carried out respectively to step 1-step 5, obtains history respectively and gathers the defect characteristic information in image and the defect characteristic information in real-time image acquisition;
Described history gathers the defect characteristic information in image, comprises shape information Dtm (m) of storage defect and the positional information Lt of storage defect m(LX, LY, RX, RY, XW, YH), m represents m storage defect, and span is that 1-M, M represent storage defect sum;
Defect characteristic information in real-time image acquisition, comprises shape information Dom (n) of Real-time Obtaining defect and the positional information Lo of Real-time Obtaining defect n(LX, LY, RX, RY, XW, YH), n represents the n-th Real-time Obtaining defect, and span is the sum that 1-N, N represent Real-time Obtaining defect;
Wherein, shape information Am (j) of each defect is according to each defect place image f 4line number j in (x, y), obtains according to following formulae discovery:
Am ( j ) = &Sigma; y = 1 Width f 4 ( j , y ) 255 ;
Wherein, j is the integer between [1, Height], and Height is image f 4the height of (x, y), Width is image f 4(x, y) wide, LX is the left row coordinate of defect boundary rectangle, LY is the left-hand line coordinate of defect boundary rectangle, RX is the right side row-coordinate of defect boundary rectangle, RY is the right-hand column coordinate of defect boundary rectangle, the width that XW is defect and defect institute across columns, the height that YH is defect and defect institute inter-bank number.
Step 7: the characteristic information of Real-time Obtaining defect is carried out matching primitives with the characteristic information of all storage defects successively, the site error Ep of acquisition Real-time Obtaining defect and storage defect and plesiomorphism degree S; Utilize fuzzy control rule according to Ep and S, obtain the defect characteristic information of mating;
The concrete acquisition process of the defect characteristic information of coupling is as follows:
1) judge whether Real-time Obtaining defect and storage defect are same defect;
The width Lt (XW) of the width Lo (XW) of contrast Real-time Obtaining defect and storage defect, contrasts the height Lo (YH) of Real-time Obtaining defect and the height Lt (YH) of storage defect, if or then Real-time Obtaining defect and storage defect are not same defects, otherwise, then calculate the site error Ep of Real-time Obtaining defect and storage defect, judges further Real-time Obtaining defect and storage defect whether as same defect;
2) the site error Ep of Real-time Obtaining defect and storage defect is calculated:
Ep = Lt m ( RX ) | Lt m ( LX ) - Lo n ( LX ) | + Lt m ( LX ) | Lt m ( RX ) - Lo n ( RX ) | 2 Lt m ( LX ) Lo n ( RX )
If Ep>0.2, then Real-time Obtaining defect and storage defect are not same defects, otherwise, then calculate the plesiomorphism degree S of Real-time Obtaining defect and storage defect;
3) Real-time Obtaining defect is as follows with the plesiomorphism degree S computation process of storage defect:
Step a: the length of adjustment array Dom (n);
Find peak point Pkt, Pko of array Dtm (m) and array Dom (n), take peak point as the length of reference point adjustment array Dom (n), wherein, before Dtm (m) array peak point, length is LFt, after peak point, length is LBt, before Dom (n) array peak point, length is LFo, and after peak point, length is LBo;
If then illustrate that two arrays are reverse, enter step b; Otherwise, if then adjust array Dom (n), namely array Dom (n) peak point previous section is adjusted to LFt length, redundance intercepts, and lacks part and gets Dtm (m) array appropriate section polishing; Array Dom (n) peak point aft section is adjusted to LBt length, and redundance intercepts, and lacks part peek group Dtm (m) appropriate section polishing, enters step c;
Step b: array Dom (n) upset is stored, repeats step a;
Step c: the plesiomorphism degree S of calculating Real-time Obtaining defect and storage defect;
S = M &Sigma; i = 1 M Dtm ( i ) Dom ( i ) - &Sigma; i = 1 M Dtm ( i ) &Sigma; i = 1 M Dom ( i ) M &Sigma; i = 1 M Dtm ( i ) - ( &Sigma; i = 1 M Dtm ( i ) ) 2 M &Sigma; i = 1 M Dom ( i ) - ( &Sigma; i = 1 M Dom ( i ) ) 2 ;
As shown in Figure 7, be the forward feature array comparison diagram of storage defect feature array and Real-time Obtaining defect, wherein, solid line is storage defect feature array, and dotted line is the forward feature array of Real-time Obtaining defect; Wherein, horizontal ordinate is defect characteristic array sequence, and ordinate is defect characteristic array value;
As shown in Figure 8, be the opposite feature array comparison diagram of storage defect feature array and Real-time Obtaining defect, wherein, solid line is storage defect feature array, and dotted line is the opposite feature array of Real-time Obtaining defect; Wherein, horizontal ordinate is defect characteristic array sequence, and ordinate is defect characteristic array value;
4) set membership function, Fuzzy Processing is carried out to input variable;
&mu; S ( S ) = P 1 0.8 &le; S &le; 0.9 Q 1 0.9 < S &le; 0.95 R 1 0.95 < S &le; 1.0 , &mu; EP ( EP ) = P 2 0 &le; EP &le; 0.1 Q 2 0.1 < EP &le; 0.15 R 2 0.15 < EP &le; 0.2
5) according to fuzzy reasoning table, Fuzzy Linguistic Variable U is exported, wherein, N 0expression Real-time Obtaining defect and storage defect are not same defects, P 0expression Real-time Obtaining defect and storage defect are same defects;
Table 1 fuzzy reasoning table
Numbering Input variable (S, EP) Output variable U
1 (R 1,P 2) P 0
2 (R 1,Q 2) P 0
3 (R 1,R 2) N 0
4 (Q 1,P 2) P 0
5 (Q 1,Q 2) N 0
6 (Q 1,R 2) N 0
7 (P 1,P 2) N 0
8 (P 1,Q 2) N 0
9 (P 1,R 2) N 0
6) recording output variable is N 0coupling defect characteristic information.
Two groups of data in the figure 7, from same defect, obtain under different acquisition conditions.Can see that the variation tendency of two groups of data is inconsistent, same similarity is also very low.Analysis reason is known, and this problem is caused by the direction gathered.
By Real-time Obtaining defect characteristic array reversion in Fig. 7, obtain the opposite feature array of defect.Can find out the opposite feature array of target signature array and defect in fig. 8, variation tendency is consistent, and similarity is very high.
Comparison diagram 7 and Fig. 8, can find out, the direction difference of same defect owing to gathering, its similarity may be very low, and after one of them feature array being reversed, similarity can recover normal.Therefore, when the similarity of calculating two groups of defect characteristic arrays, in once calculating, similarity is very low, recalculates after needing reversion array; When determining whether same defect characteristic, need to carry out twice calculating to similarity, using the high result of calculation of similarity as basis for estimation, could accurately find identical defect.

Claims (6)

1., based on a high speed railway track surface imperfection matching process for Machine Vision Detection, it is characterized in that, comprise following step:
Step 1: obtain rail panoramic picture f (x, y);
Step 2: adopt vertical projection method to extract rail surface area image f from rail panoramic picture 1(x, y);
Step 3: carry out medium filtering process to rail surface area image, obtains the rail surface area image f removing noise 2(x, y);
Step 4: to the rail surface area image f removing noise 2(x, y) carries out binaryzation operation successively and morphology opens operation, makes f 2each division region in (x, y) bonds mutually, obtains image f 4(x, y);
Step 5: to image f 4(x, y) projects line by line and adopts blob analytical approach to obtain image f 4defect characteristic information in (x, y), described defect characteristic information comprises the shape information of defect and the positional information of defect;
Step 6: operation history collection image and real-time image acquisition being carried out respectively to step 1-step 5, obtains history respectively and gathers the defect characteristic information in image and the defect characteristic information in real-time image acquisition;
Step 7: the characteristic information of Real-time Obtaining defect is carried out matching primitives with the characteristic information of all storage defects successively, the site error Ep of acquisition Real-time Obtaining defect and storage defect and plesiomorphism degree S; Utilize fuzzy control rule according to Ep and S, obtain the defect characteristic information of mating.
2. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 1, it is characterized in that, in described step 6, history gathers the defect characteristic information in image, comprises shape information Dtm (m) of storage defect and the positional information Lt of storage defect m(LX, LY, RX, RY, XW, YH), m represents m storage defect, and span is that 1-M, M represent storage defect sum;
Defect characteristic information in real-time image acquisition, comprises shape information Dom (n) of Real-time Obtaining defect and the positional information Lo of Real-time Obtaining defect n(LX, LY, RX, RY, XW, YH), n represents the n-th Real-time Obtaining defect, and span is the sum that 1-N, N represent Real-time Obtaining defect;
Wherein, shape information Am (j) of each defect is according to each defect place image f 4line number j in (x, y), obtains according to following formulae discovery:
A m ( j ) = &Sigma; y = 1 W i d t h f 4 ( j , y ) 255 ;
Wherein, j is the integer between [1, Height], and Height is image f 4the height of (x, y), Width is image f 4(x, y) wide, LX is the left row coordinate of defect boundary rectangle, LY is the left-hand line coordinate of defect boundary rectangle, RX is the right side row-coordinate of defect boundary rectangle, RY is the right-hand column coordinate of defect boundary rectangle, the width that XW is defect and defect institute across columns, the height that YH is defect and defect institute inter-bank number.
3. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 2, it is characterized in that, the concrete acquisition process of the defect characteristic information of the coupling in described step 7 is as follows:
1) judge whether Real-time Obtaining defect and storage defect are same defect;
The width Lo of contrast Real-time Obtaining defect n(XW) and the width Lt of storage defect m(XW) the height Lo of Real-time Obtaining defect, is contrasted n(YH) and the height Lt of storage defect m(YH), if or then Real-time Obtaining defect and storage defect are not same defects, otherwise, then calculate the site error Ep of Real-time Obtaining defect and storage defect, judges further Real-time Obtaining defect and storage defect whether as same defect;
2) the site error Ep of Real-time Obtaining defect and storage defect is calculated:
E p = Lt m ( R X ) | Lt m ( L X ) - Lo n ( L X ) | + Lt m ( L X ) | Lt m ( R X ) - Lo n ( R X ) | 2 Lt m ( L X ) Lo n ( R X )
If Ep>0.2, then Real-time Obtaining defect and storage defect are not same defects, otherwise, then calculate the plesiomorphism degree S of Real-time Obtaining defect and storage defect;
3) Real-time Obtaining defect is as follows with the plesiomorphism degree S computation process of storage defect:
Step a: the length of adjustment array Dom (n);
Find peak point Pkt, Pko of array Dtm (m) and array Dom (n), take peak point as the length of reference point adjustment array Dom (n), wherein, before Dtm (m) array peak point, length is LFt, after peak point, length is LBt, before Dom (n) array peak point, length is LFo, and after peak point, length is LBo;
If then illustrate that two arrays are reverse, enter step b; Otherwise, if then adjust array Dom (n), namely array Dom (n) peak point previous section is adjusted to LFt length, redundance intercepts, and lacks part and gets Dtm (m) array appropriate section polishing; Array Dom (n) peak point aft section is adjusted to LBt length, and redundance intercepts, and lacks part peek group Dtm (m) appropriate section polishing, enters step c;
Step b: array Dom (n) upset is stored, repeats step a;
Step c: the plesiomorphism degree S of calculating Real-time Obtaining defect and storage defect;
S = M &Sigma; i = 1 M D t m ( i ) D o m ( i ) - &Sigma; i = 1 M D t m ( i ) &Sigma; i = 1 M D o m ( i ) M &Sigma; i = 1 M D t m ( i ) - ( &Sigma; i = 1 M D t m ( i ) ) 2 M &Sigma; i = 1 M D o m ( i ) - ( &Sigma; i = 1 M D o m ( i ) ) 2 ;
4) set membership function, Fuzzy Processing is carried out to input variable;
&mu; S ( S ) = P 1 0.8 &le; S &le; 0.9 Q 1 0.9 < S &le; 0.95 R 1 0.95 < S &le; 1.0 &mu; E P ( E P ) = P 2 0 &le; E P &le; 0.1 Q 2 0.1 < E P &le; 0.15 R 2 0.15 < E P &le; 0.2
5) according to fuzzy reasoning table, Fuzzy Linguistic Variable U is exported, wherein, N 0expression Real-time Obtaining defect and storage defect are not same defects, P 0expression Real-time Obtaining defect and storage defect are same defects;
Table 1 fuzzy reasoning table
Numbering Input variable (S, EP) Output variable U 1 (R 1,P 2) P 0 2 (R 1,Q 2) P 0 3 (R 1,R 2) N 0 4 (Q 1,P 2) P 0 5 (Q 1,Q 2) N 0 6 (Q 1,R 2) N 0 7 (P 1,P 2) N 0 8 (P 1,Q 2) N 0 9 (P 1,R 2) N 0
6) recording output variable is N 0coupling defect characteristic information.
4. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 3, it is characterized in that, the specific implementation process of described step 2 is as follows:
1. add up gray-scale value by column, produces gray average array Avg (i) that rail image f (x, y) respectively arranges:
i ∈ [1, Width], Height are the height of image, and i is that image i-th arranges;
2. the average Avg_all of Avg (i) is calculated;
3. Avg (i) array binaryzation, compares with Avg_all one by one by Avg (i) array, is greater than Avg_all and is set to 1, is less than Avg_all and is set to 0, obtain array Avg_Val (i):
A v g _ V a l ( i ) = 1 , A v g ( i ) &GreaterEqual; A v g _ a l l 0 , A v g ( i ) < A v g _ a l l ;
4. find in Avg_Val (i) array first continuous ten number be all 1 point, this marginal point Begin_Point started as rail surface image; Find after Avg_Val (i) array Begin_Point first continuous ten number be all 0 point, this marginal point End_Point started as rail surface image, intercept rail image f (x, y) the Begin_Point image arranged between End_Point and namely obtain rail surface image f 1(x, y).
5. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 4, is characterized in that, the specific implementation process of described step 3 is to rail surface image f 1(x, y) carries out the median filtering operation of a time 3 × 3, removes image noise, obtains the rail surface image f of low noise 2(x, y).
6. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 5, it is characterized in that, the specific implementation process of described step 4 is as follows:
1. global threshold T is set, to rail surface image f 2(x, y) carries out binaryzation and obtains bianry image f 3(x, y):
f 3 ( x , y ) = 255 , f 2 ( x , y ) &GreaterEqual; T 0 , f 2 ( x , y ) < T ;
2. use the oval structure element B of 9 × 9 to bianry image f 3(x, y) carries out morphology and opens operation and obtain image f 4(x, y):
f 4(x,y)=f 3(x,y)оB=(f 3(x,y)ΘB)⊕B;
Meet " Θ " in formula and represent etching operation in mathematical morphology, symbol " ⊕ " represents the closed procedure in mathematical morphology, and the single division region in image is bonded mutually.
CN201410104025.6A 2014-03-20 2014-03-20 A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection Active CN103913464B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410104025.6A CN103913464B (en) 2014-03-20 2014-03-20 A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410104025.6A CN103913464B (en) 2014-03-20 2014-03-20 A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection

Publications (2)

Publication Number Publication Date
CN103913464A CN103913464A (en) 2014-07-09
CN103913464B true CN103913464B (en) 2016-01-20

Family

ID=51039306

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410104025.6A Active CN103913464B (en) 2014-03-20 2014-03-20 A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection

Country Status (1)

Country Link
CN (1) CN103913464B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104201953B (en) * 2014-09-02 2016-08-17 东南大学 Steam turbine output mechanical power control method in a kind of generating set
CN107392093B (en) * 2017-06-14 2019-01-01 北京遥感设备研究所 A kind of rail identifying system combined based on machine learning and gray projection algorithm
CN108648171A (en) * 2018-04-02 2018-10-12 成都精工华耀科技有限公司 A kind of sleeper using linear array images binaryzation region projection positions and method of counting
CN110136180B (en) * 2019-05-16 2021-07-02 东莞职业技术学院 Image template matching system and algorithm based on Choquet integral
CN112906733B (en) * 2021-01-08 2022-06-03 湖南大学 Two-stage double-check bounded-bias correlation real-time template matching method
CN114166855B (en) * 2022-02-11 2022-04-29 南京邮电大学 Real-time rail defect detection method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0126060D0 (en) * 2001-10-31 2001-12-19 Tekgenuity Ltd Improvements in and relating to monitoring apparatus
CN102854191B (en) * 2012-07-18 2014-09-10 湖南大学 Real-time visual detection and identification method for high speed rail surface defect

Also Published As

Publication number Publication date
CN103913464A (en) 2014-07-09

Similar Documents

Publication Publication Date Title
CN103913464B (en) A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection
CN102854191B (en) Real-time visual detection and identification method for high speed rail surface defect
CN110348445B (en) Instance segmentation method fusing void convolution and edge information
Zheng et al. A defect detection method for rail surface and fasteners based on deep convolutional neural network
Liang et al. Defect detection of rail surface with deep convolutional neural networks
CN109376572A (en) Real-time vehicle detection and trace tracking method in traffic video based on deep learning
Jie et al. Real-time rail head surface defect detection: A geometrical approach
CN111260629A (en) Pantograph structure abnormity detection algorithm based on image processing
CN109489724A (en) A kind of tunnel safe train operation environment comprehensive detection device and detection method
CN104392432A (en) Histogram of oriented gradient-based display panel defect detection method
CN104990925A (en) Defect detecting method based on gradient multiple threshold value optimization
CN103985182A (en) Automatic public transport passenger flow counting method and system
CN104268588A (en) Automatic detection method for brake shoe borer loss fault of railway wagon
CN111080614A (en) Method for identifying damage to rim and tread of railway wagon wheel
CN107727658A (en) Pantograph crackle on-line measuring device and method based on image procossing
Wu et al. Automatic railroad track components inspection using hybrid deep learning framework
CN107590486A (en) Motion estimate method and system, bicycle flow statistical method and equipment
CN115527170A (en) Method and system for identifying closing fault of door stopper handle of automatic freight car derailing brake device
AlNaimi et al. IoT based on-the-fly visual defect detection in railway tracks
CN111881914B (en) License plate character segmentation method and system based on self-learning threshold
CN109215059A (en) Local data&#39;s correlating method of moving vehicle tracking in a kind of video of taking photo by plane
CN109993741B (en) Steel rail welding seam contour automatic positioning method based on K-means clustering
CN105389579A (en) Method for automatically identifying loss fault of cutout cock handle of train
Bojarczak Visual algorithms for automatic detection of squat flaws in railway rails
CN114037834B (en) Semantic segmentation method and device based on fusion of vibration signal and RGB image

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant