CN103913464A - High speed railway track surface defect coupling method based on machine visual inspection - Google Patents

High speed railway track surface defect coupling method based on machine visual inspection Download PDF

Info

Publication number
CN103913464A
CN103913464A CN201410104025.6A CN201410104025A CN103913464A CN 103913464 A CN103913464 A CN 103913464A CN 201410104025 A CN201410104025 A CN 201410104025A CN 103913464 A CN103913464 A CN 103913464A
Authority
CN
China
Prior art keywords
defect
image
real
array
avg
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410104025.6A
Other languages
Chinese (zh)
Other versions
CN103913464B (en
Inventor
王耀南
尹逊帅
贺振东
冯明涛
吴成中
陈铁建
周显恩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan University
Original Assignee
Hunan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan University filed Critical Hunan University
Priority to CN201410104025.6A priority Critical patent/CN103913464B/en
Publication of CN103913464A publication Critical patent/CN103913464A/en
Application granted granted Critical
Publication of CN103913464B publication Critical patent/CN103913464B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

The invention discloses a high speed railway track surface defect coupling method based on machine visual inspection, which comprises the following steps: 1) obtaining a rail panoramic image f(x,y); 2)employing a vertical projection method for extracting a rail surface area image f1(x,y) in the rail panoramic image; 3)performing median filter treatment on the rail surface area image to obtain a rail surface area image f2(x,y) through noise removal; 4)performing image preprocessing on the rail surface area image; 5)extracting the defect characteristic information in an image f4(x,y); 6)respectively obtaining the defect characteristic information in a history acquisition image and the defect characteristic information in a real-time acquisition image; and 7)coupling the characteristic information capable of performing real-time defect acquisition with all the characteristic information with stored defect in order and calculating to obtain the coupled defect characteristic information. The method realizes the high speed and high precision coupling for the rail surface defect.

Description

A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection
Technical field
The invention belongs to mechanical vision inspection technology field, particularly a kind of high speed railway track surface imperfection matching process based on Machine Vision Detection.
Background technology
In the traffic transport industry of China, railway is being brought into play huge effect.Along with the development of modern rail technology, the serviceable life of rail is more and more longer, but because the railway network of China is very huge, so the length in serviceable life of rail is indefinite, cannot unify to safeguard and change.When train moves on the defective rail in surface, very easily damage train, the serious train accident that also can cause.In order to guarantee security and the continuity of transportation by railroad, need to carry out regular detection to rail, to there being the rail of damage safeguard and change.Significantly raise speed and heavy haul train start in the situation that at train, understand in time the quality of rail, examination and controlling has just more been necessary especially in real time.
The SPEED VISION detection system of the railroad track surface imperfection based on machine vision technique can detect rail surface imperfection high-speed, high precision, save manpower, realize the intelligent classification identification of rail defect, can improve the suggestion of instructing for railway interests safeguards railroad track timely and effectively.But also have in actual applications many problems, wherein the redundancy of rail view data is exactly a urgent problem.Gather in the SPEED VISION detection system of railroad track surface imperfection the redundancy that there will be data in image process, show certain lengths of rail in once gathering by multi collect, or certain lengths of rail only needs to preserve a in collection repeatedly.This just need to find the rail information of redundancy record their positional information.
In sum, the rail information of None-identified and eliminate redundancy in existing Machine Vision Inspecting System, is badly in need of a kind of matching process of high-speed iron track surface machine vision defects detection, so that eliminate redundancy information.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of high speed railway track surface imperfection matching process based on Machine Vision Detection, and its object is, finds out the high speed railway track surface imperfection image that is repeated collection and preserves.
A high speed railway track surface imperfection matching process based on Machine Vision Detection, comprises following step:
Step 1: obtain rail panoramic picture f (x, y);
Step 2: adopt vertical projection method to extract rail surf zone image f from rail panoramic picture 1(x, y);
Step 3: rail surf zone image is carried out to medium filtering processing, obtain the rail surf zone image f that removes noise 2(x, y);
Step 4: to removing the rail surf zone image f of noise 2(x, y) carries out successively binaryzation operation and morphology is opened operation, makes f 2each division region in (x, y) is mutually bonding, obtains image f 4(x, y);
Step 5: to image f 4(x, y) carries out projection line by line and adopts blob analytical approach to obtain image f 4defect characteristic information in (x, y), described defect characteristic information comprises the shape information of defect and the positional information of defect;
Step 6: history collection image and real-time image acquisition are carried out respectively to the operation of step 1-step 5, respectively the defect characteristic information in the historical collection of acquisition image and the defect characteristic information in real-time image acquisition;
Step 7: the characteristic information of Real-time Obtaining defect is mated to calculating with the characteristic information of all storage defect successively, obtain Real-time Obtaining defect and site error Ep and the plesiomorphism degree S of storage defect; Utilize fuzzy control rule according to Ep and S, obtain the defect characteristic information of coupling.
The historical defect characteristic information gathering in image in described step 6, comprises the shape information Dtm (m) of storage defect and the positional information Lt of storage defect m(LX, LY, RX, RY, XW, YH), m represents m storage defect, and span is 1-M, and M represents storage defect sum;
Defect characteristic information in real-time image acquisition, comprises the shape information Dom (n) of Real-time Obtaining defect and the positional information Lo of Real-time Obtaining defect n(LX, LY, RX, RY, XW, YH), n represents n Real-time Obtaining defect, and span is 1-N, and N represents the sum of Real-time Obtaining defect;
Wherein, the shape information Am (j) of each defect is according to each defect place image f 4line number j in (x, y), calculates and obtains according to following formula:
Am ( j ) = Σ y = 1 Width f 4 ( j , y ) 255 ;
Wherein, j is the integer between [1, Height], and Height is image f 4the height of (x, y), Width is image f 4(x, y) wide, LX is the left row coordinate of defect boundary rectangle, LY is the left-hand line coordinate of defect boundary rectangle, RX is the right side row-coordinate of defect boundary rectangle, RY is the right-hand column coordinate of defect boundary rectangle, the width that XW is defect be defect institute across columns, the height that YH is defect is defect institute inter-bank number.
The concrete acquisition process of the defect characteristic information of the coupling in described step 7 is as follows:
1) judge whether Real-time Obtaining defect and storage defect are same defect;
The width Lo (XW) of contrast Real-time Obtaining defect and the width Lt (XW) of storage defect, the height Lo (YH) of contrast Real-time Obtaining defect and the height Lt (YH) of storage defect, if or real-time Obtaining defect is not same defect with storage defect, otherwise, calculate Real-time Obtaining defect and the site error Ep of storage defect, further judge whether Real-time Obtaining defect and storage defect are same defect;
2) calculating Real-time Obtaining defect and the site error Ep of storage defect:
Ep = Lt m ( RX ) | Lt m ( LX ) - Lo n ( LX ) | + Lt m ( LX ) | Lt m ( RX ) - Lo n ( RX ) | 2 Lt m ( LX ) Lo n ( RX )
If Ep>0.2, Real-time Obtaining defect is not same defect with storage defect, otherwise, calculate Real-time Obtaining defect and the plesiomorphism degree S of storage defect;
3) Real-time Obtaining defect is as follows with the plesiomorphism degree S computation process of storage defect:
Step a: the length of adjusting array Dom (n);
Find peak point Pkt, the Pko of array Dtm (m) and array Dom (n), adjust the length of array Dom (n) take peak point as reference point, wherein, before Dtm (m) array peak point, length is LFt, after peak point, length is LBt, before Dom (n) array peak point, length is LFo, and length is LBo after peak point;
If illustrate that two arrays are reverse, enter step b; Otherwise, if adjust array Dom (n), array Dom (n) peak point previous section is adjusted into LFt length, redundance intercepts, and lacks part and gets Dtm (m) array appropriate section polishing; Array Dom (n) peak point aft section is adjusted into LBt length, and redundance intercepts, and lacks part peek group Dtm (m) appropriate section polishing, enters step c;
Step b: by array Dom (n) upset storage, repeating step a;
Step c: calculating Real-time Obtaining defect and the plesiomorphism degree S of storage defect;
S = M Σ i = 1 M Dtm ( i ) Dom ( i ) - Σ i = 1 M Dtm ( i ) Σ i = 1 M Dom ( i ) M Σ i = 1 M Dtm ( i ) - ( Σ i = 1 M Dtm ( i ) ) 2 M Σ i = 1 M Dom ( i ) - ( Σ i = 1 M Dom ( i ) ) 2 ;
4) set membership function, input variable is carried out to Fuzzy Processing;
&mu; S ( S ) = P 1 0.8 &le; S &le; 0.9 Q 1 0.9 < S &le; 0.95 R 1 0.95 < S &le; 1.0 , &mu; EP ( EP ) = P 2 0 &le; EP &le; 0.1 Q 2 0.1 < EP &le; 0.15 R 2 0.15 < EP &le; 0.2
5) according to fuzzy reasoning table, output fuzzy language variable U, wherein, N 0expression Real-time Obtaining defect and storage defect are not same defects, P 0expression Real-time Obtaining defect and storage defect are same defects;
Table 1 fuzzy reasoning table
Numbering Input variable (S, EP) Output variable U
1 (R 1,P 2) P 0
2 (R 1,Q 2) P 0
3 (R 1,R 2) N 0
4 (Q 1,P 2) P 0
5 (Q 1,Q 2) N 0
6 (Q 1,R 2) N 0
7 (P 1,P 2) N 0
8 (P 1,Q 2) N 0
9 (P 1,R 2) N 0
6) recording output variable is N 0coupling defect characteristic information.
The specific implementation process of described step 2 is as follows:
1. cumulative gray-scale value by column, produces the gray average array Avg (i) of the each row of rail image f (x, y):
Avg ( i ) = &Sigma; x = 1 Height f ( x , i ) Height , i &Element; [ 1 , Width ] , Height is the height of image, and i is image i row;
2. calculate the average Avg_all of Avg (i);
3. Avg (i) array binaryzation, by Avg (i) array one by one with Avg_all comparison, be greater than Avg_all and be made as 1, be less than Avg_all and be made as 0, obtain array Avg_Val (i):
Avg _ Val ( i ) = 1 , Avg ( i ) &GreaterEqual; Avg _ all 0 , Avg ( i ) < Avg _ all ;
4. in Avg_Val (i) array, finding first continuous ten numbers is all 1 point, the marginal point Begin_Point that this starts as rail surface image; After Avg_Val (i) array Begin_Point, finding first continuous ten numbers is all 0 point, the marginal point End_Point that this starts as rail surface image, the image that intercepting rail image f (x, y) Begin_Point is listed as between End_Point obtains rail surface image f 1(x, y).
The specific implementation process of described step 3 is to rail surface image f 1(x, y) carries out the medium filtering operation of a time 3 × 3, removes image noise, obtains the rail surface image f of low noise 2(x, y).
The specific implementation process of described step 4 is as follows:
1. set global threshold T, to rail surface image f 2(x, y) carries out binaryzation and obtains bianry image f 3(x, y):
f 3 ( x , y ) = 255 , f 2 ( x , y ) &GreaterEqual; T 0 , f 2 ( x , y ) < T ;
2. use 9 × 9 oval structure element B to bianry image f 3(x, y) carries out morphology and opens operation and obtain image f 4(x, y):
In formula, meet " Θ " and represent the corrosion operation in mathematical morphology, symbol represent the closed procedure in mathematical morphology, make the single division region in image obtain mutually bonding.
Beneficial effect
Provided by the inventionly provide a kind of high speed railway track surface imperfection matching process based on Machine Vision Detection, compared with prior art, its outstanding advantage is:
(1) matching speed is fast
The present invention takes into full account the actual conditions of rail surface image, first uses vertical projection method to extract rail surf zone, and the method can obtain rail surf zone quickly and accurately; Then rail area image is carried out to denoising, now to rail region denoising comparison panoramic picture, partial arithmetic amount is saved in denoising; To the bianry image horizontal projection obtaining, can obtain the minimum defect shape information of data volume, for subsequent treatment has reduced computation burden; By the site error of defect and target, defect is carried out to pre-matching, improve the efficiency of follow-up coupling;
(2) accuracy of detection is high
The positional information of the present invention by defect and shape information carry out the coupling of fuzzy algorithm to defect, only have positional information and shape information all to reach when high precision conforms to and be just identified coupling, and precision is high, eliminates much and disturbs; Also retained more details information, therefore rail surface defects detection result is also more accurate simultaneously;
The present invention can realize high speed, the high precision coupling of rail surface imperfection, and easy and existing defect recognition algorithm merges mutually, and realization detects rail surface imperfection efficiently, accurately.
Accompanying drawing explanation
Fig. 1 is overall procedure schematic diagram of the present invention;
Fig. 2 is the two width rail images that same rail defect is taken at different time, wherein, and the rail image of figure (a) for having stored, the rail image that figure (b) is Real-time Collection;
Fig. 3 is the perspective view that figure (a) the rail image in Fig. 2 carries out vertical projection acquisition;
Fig. 4 is for finding rail surface image marginal point schematic diagram in Fig. 3;
Fig. 5 is for obtaining the rail surface image of figure (a) in Fig. 2;
Fig. 6 is the binary map of Fig. 5;
Fig. 7 is the forward feature array comparison diagram of storage defect feature array and Real-time Obtaining defect;
Fig. 8 is the opposite feature array comparison diagram of storage defect feature array and Real-time Obtaining defect.
Embodiment
Below in conjunction with drawings and Examples, the present invention is further illustrated.
Embodiment 1
As shown in Figure 1, be the process flow diagram of a kind of high speed railway track surface imperfection matching process based on Machine Vision Detection of the present invention, concrete steps are as follows:
Step 1: obtain rail panoramic picture f (x, y);
Line scan camera carry ON TRAINS, by the scrambler control collected by camera image on wheel, so that camera trigger rate and train speed match, guarantees that the rail panoramic picture being spliced into has comprised complete rail surface imperfection information.
As shown in Figure 2, the two width rail images that same rail defect is taken at different time, wherein, the rail image of figure (a) for having stored, the rail image that figure (b) is Real-time Collection;
Step 2: adopt vertical projection method to extract rail surf zone image f from rail panoramic picture 1(x, y);
(1), to the cumulative gray-scale value by column of figure (a) in Fig. 2, produce the gray average array Avg (i) of the each row of rail image f (x, y):
Avg ( i ) = &Sigma; x = 1 Height f ( x , i ) Height , i &Element; [ 1 , Width ] , Height is the height of image, and i is image i row;
Fig. 3 is the schematic diagram of the each row gray average of rail image f (x, y) array Avg (i), and wherein horizontal ordinate is the columns i of rail image, and ordinate is the gray average Avg (i) of the each row of image;
(2) the average Avg_all of calculating Avg (i):
Avg _ Val ( i ) = 1 , Avg ( i ) &GreaterEqual; Avg _ all 0 , Avg ( i ) < Avg _ all ; Width is the wide of image;
(3) Avg (i) array binaryzation, by Avg (i) array one by one with Avg_all comparison, be greater than Avg_all and be made as 1, be less than Avg_all and be made as 0, obtain array Avg_Val (i): Avg _ Val ( i ) = 1 , Avg ( i ) &GreaterEqual; Avg _ all 0 , Avg ( i ) < Avg _ all ; Array Avg_Val (i) as shown in Figure 4, the columns i that wherein horizontal ordinate is image, ordinate is the binary value Avg_Val (i) of the gray average of the each row of image;
(4) in Avg_Val (i) array, finding first continuous ten numbers is all 1 point, the marginal point Begin_Point that this starts as rail surface image; After Avg_Val (i) array Begin_Point, finding first continuous ten numbers is all 0 point, the marginal point End_Point that this starts as rail surface image, the image that intercepting rail image f (x, y) Begin_Point is listed as between End_Point obtains rail surface image f 1(x, y); As shown in Figure 5;
Step 3: rail surf zone image is carried out to the medium filtering processing of a time 3 × 3, obtain the rail surf zone image f that removes noise 2(x, y);
Step 4: to removing the rail surf zone image f of noise 2(x, y) carries out successively binaryzation operation and morphology is opened operation, makes f 2each division region in (x, y) is mutually bonding, obtains image f 4(x, y), as shown in Figure 6;
(1) set global threshold T=150, to rail surface image f 2(x, y) carries out binaryzation and obtains bianry image f 3(x, y):
f 3 ( x , y ) = 255 , f 2 ( x , y ) &GreaterEqual; T 0 , f 2 ( x , y ) < T ;
(2) the oval structure element B of use 9 × 9 is to bianry image f 3(x, y) carries out morphology and opens operation and obtain image f 4(x, y):
In formula, meet " Θ " and represent the corrosion operation in mathematical morphology, symbol represent the closed procedure in mathematical morphology, make the single division region in image obtain mutually bonding;
Step 5: to image f 4(x, y) carries out projection line by line and adopts blob analytical approach to obtain image f 4defect characteristic information in (x, y), described defect characteristic information comprises the shape information of defect and the positional information of defect;
Step 6: history collection image and real-time image acquisition are carried out respectively to the operation of step 1-step 5, respectively the defect characteristic information in the historical collection of acquisition image and the defect characteristic information in real-time image acquisition;
The described historical defect characteristic information gathering in image, comprises the shape information Dtm (m) of storage defect and the positional information Lt of storage defect m(LX, LY, RX, RY, XW, YH), m represents m storage defect, and span is 1-M, and M represents storage defect sum;
Defect characteristic information in real-time image acquisition, comprises the shape information Dom (n) of Real-time Obtaining defect and the positional information Lo of Real-time Obtaining defect n(LX, LY, RX, RY, XW, YH), n represents n Real-time Obtaining defect, and span is 1-N, and N represents the sum of Real-time Obtaining defect;
Wherein, the shape information Am (j) of each defect is according to each defect place image f 4line number j in (x, y), calculates and obtains according to following formula:
Am ( j ) = &Sigma; y = 1 Width f 4 ( j , y ) 255 ;
Wherein, j is the integer between [1, Height], and Height is image f 4the height of (x, y), Width is image f 4(x, y) wide, LX is the left row coordinate of defect boundary rectangle, LY is the left-hand line coordinate of defect boundary rectangle, RX is the right side row-coordinate of defect boundary rectangle, RY is the right-hand column coordinate of defect boundary rectangle, the width that XW is defect be defect institute across columns, the height that YH is defect is defect institute inter-bank number.
Step 7: the characteristic information of Real-time Obtaining defect is mated to calculating with the characteristic information of all storage defect successively, obtain Real-time Obtaining defect and site error Ep and the plesiomorphism degree S of storage defect; Utilize fuzzy control rule according to Ep and S, obtain the defect characteristic information of coupling;
The concrete acquisition process of the defect characteristic information of coupling is as follows:
1) judge whether Real-time Obtaining defect and storage defect are same defect;
The width Lo (XW) of contrast Real-time Obtaining defect and the width Lt (XW) of storage defect, the height Lo (YH) of contrast Real-time Obtaining defect and the height Lt (YH) of storage defect, if or real-time Obtaining defect is not same defect with storage defect, otherwise, calculate Real-time Obtaining defect and the site error Ep of storage defect, further judge whether Real-time Obtaining defect and storage defect are same defect;
2) calculating Real-time Obtaining defect and the site error Ep of storage defect:
Ep = Lt m ( RX ) | Lt m ( LX ) - Lo n ( LX ) | + Lt m ( LX ) | Lt m ( RX ) - Lo n ( RX ) | 2 Lt m ( LX ) Lo n ( RX )
If Ep>0.2, Real-time Obtaining defect is not same defect with storage defect, otherwise, calculate Real-time Obtaining defect and the plesiomorphism degree S of storage defect;
3) Real-time Obtaining defect is as follows with the plesiomorphism degree S computation process of storage defect:
Step a: the length of adjusting array Dom (n);
Find peak point Pkt, the Pko of array Dtm (m) and array Dom (n), adjust the length of array Dom (n) take peak point as reference point, wherein, before Dtm (m) array peak point, length is LFt, after peak point, length is LBt, before Dom (n) array peak point, length is LFo, and length is LBo after peak point;
If illustrate that two arrays are reverse, enter step b; Otherwise, if adjust array Dom (n), array Dom (n) peak point previous section is adjusted into LFt length, redundance intercepts, and lacks part and gets Dtm (m) array appropriate section polishing; Array Dom (n) peak point aft section is adjusted into LBt length, and redundance intercepts, and lacks part peek group Dtm (m) appropriate section polishing, enters step c;
Step b: by array Dom (n) upset storage, repeating step a;
Step c: calculating Real-time Obtaining defect and the plesiomorphism degree S of storage defect;
S = M &Sigma; i = 1 M Dtm ( i ) Dom ( i ) - &Sigma; i = 1 M Dtm ( i ) &Sigma; i = 1 M Dom ( i ) M &Sigma; i = 1 M Dtm ( i ) - ( &Sigma; i = 1 M Dtm ( i ) ) 2 M &Sigma; i = 1 M Dom ( i ) - ( &Sigma; i = 1 M Dom ( i ) ) 2 ;
As shown in Figure 7, be the forward feature array comparison diagram of storage defect feature array and Real-time Obtaining defect, wherein, solid line is storage defect feature array, dotted line is the forward feature array of Real-time Obtaining defect; Wherein, horizontal ordinate is defect characteristic array sequence, and ordinate is defect characteristic array value;
As shown in Figure 8, be the opposite feature array comparison diagram of storage defect feature array and Real-time Obtaining defect, wherein, solid line is storage defect feature array, dotted line is the opposite feature array of Real-time Obtaining defect; Wherein, horizontal ordinate is defect characteristic array sequence, and ordinate is defect characteristic array value;
4) set membership function, input variable is carried out to Fuzzy Processing;
&mu; S ( S ) = P 1 0.8 &le; S &le; 0.9 Q 1 0.9 < S &le; 0.95 R 1 0.95 < S &le; 1.0 , &mu; EP ( EP ) = P 2 0 &le; EP &le; 0.1 Q 2 0.1 < EP &le; 0.15 R 2 0.15 < EP &le; 0.2
5) according to fuzzy reasoning table, output fuzzy language variable U, wherein, N 0expression Real-time Obtaining defect and storage defect are not same defects, P 0expression Real-time Obtaining defect and storage defect are same defects;
Table 1 fuzzy reasoning table
Numbering Input variable (S, EP) Output variable U
1 (R 1,P 2) P 0
2 (R 1,Q 2) P 0
3 (R 1,R 2) N 0
4 (Q 1,P 2) P 0
5 (Q 1,Q 2) N 0
6 (Q 1,R 2) N 0
7 (P 1,P 2) N 0
8 (P 1,Q 2) N 0
9 (P 1,R 2) N 0
6) recording output variable is N 0coupling defect characteristic information.
Two groups of data in Fig. 7, from same defect, obtain under different acquisition conditions.The variation tendency that can see two groups of data is inconsistent, and same similarity is also very low.Analysis reason is known, and this problem is to be caused by the direction gathering.
By Real-time Obtaining defect characteristic array reversion in Fig. 7, obtain the opposite feature array of defect.The opposite feature array that can find out target signature array and defect in Fig. 8, variation tendency is consistent, and similarity is very high.
Comparison diagram 7 and Fig. 8, can find out, same defect is due to the direction difference gathering, and its similarity may be very low, and by after one of them feature array reversion, it is normal that similarity can be recovered.Therefore,, in the time calculating the similarity of two groups of defect characteristic arrays, in once calculating, similarity is very low, after the array of need to reversing, recalculates; While determining whether same defect characteristic, need to carry out twice calculating to similarity, using the high result of calculation of similarity as basis for estimation, could accurately find identical defect.

Claims (6)

1. the high speed railway track surface imperfection matching process based on Machine Vision Detection, is characterized in that, comprises following step:
Step 1: obtain rail panoramic picture f (x, y);
Step 2: adopt vertical projection method to extract rail surf zone image f from rail panoramic picture 1(x, y);
Step 3: rail surf zone image is carried out to medium filtering processing, obtain the rail surf zone image f that removes noise 2(x, y);
Step 4: to removing the rail surf zone image f of noise 2(x, y) carries out successively binaryzation operation and morphology is opened operation, makes f 2each division region in (x, y) is mutually bonding, obtains image f 4(x, y);
Step 5: to image f 4(x, y) carries out projection line by line and adopts blob analytical approach to obtain image f 4defect characteristic information in (x, y), described defect characteristic information comprises the shape information of defect and the positional information of defect;
Step 6: history collection image and real-time image acquisition are carried out respectively to the operation of step 1-step 5, respectively the defect characteristic information in the historical collection of acquisition image and the defect characteristic information in real-time image acquisition;
Step 7: the characteristic information of Real-time Obtaining defect is mated to calculating with the characteristic information of all storage defect successively, obtain Real-time Obtaining defect and site error Ep and the plesiomorphism degree S of storage defect; Utilize fuzzy control rule according to Ep and S, obtain the defect characteristic information of coupling.
2. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 1, it is characterized in that, the historical defect characteristic information gathering in image in described step 6, comprises the shape information Dtm (m) of storage defect and the positional information Lt of storage defect m(LX, LY, RX, RY, XW, YH), m represents m storage defect, and span is 1-M, and M represents storage defect sum;
Defect characteristic information in real-time image acquisition, comprises the shape information Dom (n) of Real-time Obtaining defect and the positional information Lo of Real-time Obtaining defect n(LX, LY, RX, RY, XW, YH), n represents n Real-time Obtaining defect, and span is 1-N, and N represents the sum of Real-time Obtaining defect;
Wherein, the shape information Am (j) of each defect is according to each defect place image f 4line number j in (x, y), calculates and obtains according to following formula:
Am ( j ) = &Sigma; y = 1 Width f 4 ( j , y ) 255 ;
Wherein, j is the integer between [1, Height], and Height is image f 4the height of (x, y), Width is image f 4(x, y) wide, LX is the left row coordinate of defect boundary rectangle, LY is the left-hand line coordinate of defect boundary rectangle, RX is the right side row-coordinate of defect boundary rectangle, RY is the right-hand column coordinate of defect boundary rectangle, the width that XW is defect be defect institute across columns, the height that YH is defect is defect institute inter-bank number.
3. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 2, is characterized in that, the concrete acquisition process of the defect characteristic information of the coupling in described step 7 is as follows:
1) judge whether Real-time Obtaining defect and storage defect are same defect;
The width Lo (XW) of contrast Real-time Obtaining defect and the width Lt (XW) of storage defect, the height Lo (YH) of contrast Real-time Obtaining defect and the height Lt (YH) of storage defect, if or real-time Obtaining defect is not same defect with storage defect, otherwise, calculate Real-time Obtaining defect and the site error Ep of storage defect, further judge whether Real-time Obtaining defect and storage defect are same defect;
2) calculating Real-time Obtaining defect and the site error Ep of storage defect:
Ep = Lt m ( RX ) | Lt m ( LX ) - Lo n ( LX ) | + Lt m ( LX ) | Lt m ( RX ) - Lo n ( RX ) | 2 Lt m ( LX ) Lo n ( RX )
If Ep>0.2, Real-time Obtaining defect is not same defect with storage defect, otherwise, calculate Real-time Obtaining defect and the plesiomorphism degree S of storage defect;
3) Real-time Obtaining defect is as follows with the plesiomorphism degree S computation process of storage defect:
Step a: the length of adjusting array Dom (n);
Find peak point Pkt, the Pko of array Dtm (m) and array Dom (n), adjust the length of array Dom (n) take peak point as reference point, wherein, before Dtm (m) array peak point, length is LFt, after peak point, length is LBt, before Dom (n) array peak point, length is LFo, and length is LBo after peak point;
If illustrate that two arrays are reverse, enter step b; Otherwise, if adjust array Dom (n), array Dom (n) peak point previous section is adjusted into LFt length, redundance intercepts, and lacks part and gets Dtm (m) array appropriate section polishing; Array Dom (n) peak point aft section is adjusted into LBt length, and redundance intercepts, and lacks part peek group Dtm (m) appropriate section polishing, enters step c;
Step b: by array Dom (n) upset storage, repeating step a;
Step c: calculating Real-time Obtaining defect and the plesiomorphism degree S of storage defect;
S = M &Sigma; i = 1 M Dtm ( i ) Dom ( i ) - &Sigma; i = 1 M Dtm ( i ) &Sigma; i = 1 M Dom ( i ) M &Sigma; i = 1 M Dtm ( i ) - ( &Sigma; i = 1 M Dtm ( i ) ) 2 M &Sigma; i = 1 M Dom ( i ) - ( &Sigma; i = 1 M Dom ( i ) ) 2 ;
4) set membership function, input variable is carried out to Fuzzy Processing;
&mu; S ( S ) = P 1 0.8 &le; S &le; 0.9 Q 1 0.9 < S &le; 0.95 R 1 0.95 < S &le; 1.0 , &mu; EP ( EP ) = P 2 0 &le; EP &le; 0.1 Q 2 0.1 < EP &le; 0.15 R 2 0.15 < EP &le; 0.2
5) according to fuzzy reasoning table, output fuzzy language variable U, wherein, N 0expression Real-time Obtaining defect and storage defect are not same defects, P 0expression Real-time Obtaining defect and storage defect are same defects;
Table 1 fuzzy reasoning table
Numbering Input variable (S, EP) Output variable U 1 (R 1,P 2) P 0 2 (R 1,Q 2) P 0 3 (R 1,R 2) N 0 4 (Q 1,P 2) P 0 5 (Q 1,Q 2) N 0 6 (Q 1,R 2) N 0 7 (P 1,P 2) N 0 8 (P 1,Q 2) N 0 9 (P 1,R 2) N 0
6) recording output variable is N 0coupling defect characteristic information.
4. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 3, is characterized in that, the specific implementation process of described step 2 is as follows:
1. cumulative gray-scale value by column, produces the gray average array Avg (i) of the each row of rail image f (x, y):
Avg ( i ) = &Sigma; x = 1 Height f ( x , i ) Height , i &Element; [ 1 , Width ] , Height is the height of image, and i is image i row;
2. calculate the average Avg_all of Avg (i);
3. Avg (i) array binaryzation, by Avg (i) array one by one with Avg_all comparison, be greater than Avg_all and be made as 1, be less than Avg_all and be made as 0, obtain array Avg_Val (i):
Avg _ Val ( i ) = 1 , Avg ( i ) &GreaterEqual; Avg _ all 0 , Avg ( i ) < Avg _ all ;
4. in Avg_Val (i) array, finding first continuous ten numbers is all 1 point, the marginal point Begin_Point that this starts as rail surface image; After Avg_Val (i) array Begin_Point, finding first continuous ten numbers is all 0 point, the marginal point End_Point that this starts as rail surface image, the image that intercepting rail image f (x, y) Begin_Point is listed as between End_Point obtains rail surface image f 1(x, y).
5. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 4, is characterized in that, the specific implementation process of described step 3 is to rail surface image f 1(x, y) carries out the medium filtering operation of a time 3 × 3, removes image noise, obtains the rail surface image f of low noise 2(x, y).
6. the high speed railway track surface imperfection matching process based on Machine Vision Detection according to claim 5, is characterized in that, the specific implementation process of described step 4 is as follows:
1. set global threshold T, to rail surface image f 2(x, y) carries out binaryzation and obtains bianry image f 3(x, y):
f 3 ( x , y ) = 255 , f 2 ( x , y ) &GreaterEqual; T 0 , f 2 ( x , y ) < T ;
2. use 9 × 9 oval structure element B to bianry image f 3(x, y) carries out morphology and opens operation and obtain image f 4(x, y):
In formula, meet " Θ " and represent the corrosion operation in mathematical morphology, symbol represent the closed procedure in mathematical morphology, make the single division region in image obtain mutually bonding.
CN201410104025.6A 2014-03-20 2014-03-20 A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection Active CN103913464B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410104025.6A CN103913464B (en) 2014-03-20 2014-03-20 A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410104025.6A CN103913464B (en) 2014-03-20 2014-03-20 A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection

Publications (2)

Publication Number Publication Date
CN103913464A true CN103913464A (en) 2014-07-09
CN103913464B CN103913464B (en) 2016-01-20

Family

ID=51039306

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410104025.6A Active CN103913464B (en) 2014-03-20 2014-03-20 A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection

Country Status (1)

Country Link
CN (1) CN103913464B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104201953B (en) * 2014-09-02 2016-08-17 东南大学 Steam turbine output mechanical power control method in a kind of generating set
CN107392093A (en) * 2017-06-14 2017-11-24 北京遥感设备研究所 A kind of rail identifying system being combined based on machine learning and gray projection algorithm
CN108648171A (en) * 2018-04-02 2018-10-12 成都精工华耀科技有限公司 A kind of sleeper using linear array images binaryzation region projection positions and method of counting
CN110136180A (en) * 2019-05-16 2019-08-16 东莞职业技术学院 Image template matching system and algorithm based on Choquet integral
CN112906733A (en) * 2021-01-08 2021-06-04 湖南大学 Two-stage double-check bounded partial correlation real-time template matching method
CN114166855A (en) * 2022-02-11 2022-03-11 南京邮电大学 Real-time rail defect detection method
CN118096735A (en) * 2024-04-23 2024-05-28 大连华璟科技有限公司 Livestock and veterinary vision detection system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2383635A (en) * 2001-10-31 2003-07-02 Tekgenuity Ltd Chromatic analysis of measured acoustic signals from a system
CN102854191A (en) * 2012-07-18 2013-01-02 湖南大学 Real-time visual detection and identification method for high speed rail surface defect

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2383635A (en) * 2001-10-31 2003-07-02 Tekgenuity Ltd Chromatic analysis of measured acoustic signals from a system
CN102854191A (en) * 2012-07-18 2013-01-02 湖南大学 Real-time visual detection and identification method for high speed rail surface defect

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
唐湘娜 等: "铁轨表面缺陷的视觉检测与识别算法", 《计算机工程》 *
肖昌炎 等: "线扫描铁轨表面缺陷成像与检测", 《湖南大学学报》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104201953B (en) * 2014-09-02 2016-08-17 东南大学 Steam turbine output mechanical power control method in a kind of generating set
CN107392093A (en) * 2017-06-14 2017-11-24 北京遥感设备研究所 A kind of rail identifying system being combined based on machine learning and gray projection algorithm
CN107392093B (en) * 2017-06-14 2019-01-01 北京遥感设备研究所 A kind of rail identifying system combined based on machine learning and gray projection algorithm
CN108648171A (en) * 2018-04-02 2018-10-12 成都精工华耀科技有限公司 A kind of sleeper using linear array images binaryzation region projection positions and method of counting
CN110136180A (en) * 2019-05-16 2019-08-16 东莞职业技术学院 Image template matching system and algorithm based on Choquet integral
CN110136180B (en) * 2019-05-16 2021-07-02 东莞职业技术学院 Image template matching system and algorithm based on Choquet integral
CN112906733A (en) * 2021-01-08 2021-06-04 湖南大学 Two-stage double-check bounded partial correlation real-time template matching method
CN112906733B (en) * 2021-01-08 2022-06-03 湖南大学 Two-stage double-check bounded-bias correlation real-time template matching method
CN114166855A (en) * 2022-02-11 2022-03-11 南京邮电大学 Real-time rail defect detection method
CN118096735A (en) * 2024-04-23 2024-05-28 大连华璟科技有限公司 Livestock and veterinary vision detection system
CN118096735B (en) * 2024-04-23 2024-06-25 大连华璟科技有限公司 Livestock and veterinary vision detection system

Also Published As

Publication number Publication date
CN103913464B (en) 2016-01-20

Similar Documents

Publication Publication Date Title
CN103913464B (en) A kind of high speed railway track surface imperfection matching process based on Machine Vision Detection
CN102854191B (en) Real-time visual detection and identification method for high speed rail surface defect
Liang et al. Defect detection of rail surface with deep convolutional neural networks
CN102737252B (en) Method for detecting faults caused by foreign body pollution between electrified railway insulator plates based on affine invariant moment
CN108460764A (en) The ultrasonoscopy intelligent scissor method enhanced based on automatic context and data
CN111260629A (en) Pantograph structure abnormity detection algorithm based on image processing
CN109489724A (en) A kind of tunnel safe train operation environment comprehensive detection device and detection method
CN105205821A (en) Weld image segmentation method
CN112061171B (en) Embedded GPU-based track defect online inspection method and inspection device
CN111079734B (en) Method for detecting foreign matters in triangular holes of railway wagon
CN104239870A (en) Curve arc segmentation based ellipse detection method
CN108204985A (en) A kind of shield tunnel mileage localization method
CN110232682A (en) A kind of track foreign body detecting method based on image
CN115527170A (en) Method and system for identifying closing fault of door stopper handle of automatic freight car derailing brake device
AlNaimi et al. IoT based on-the-fly visual defect detection in railway tracks
CN103699876A (en) Method and device for identifying vehicle number based on linear array CCD (Charge Coupled Device) images
CN117314921B (en) RFID-based starting point detection and treatment method for track inspection equipment
CN111881914B (en) License plate character segmentation method and system based on self-learning threshold
CN105389579B (en) A kind of train cutout cock handle loss failure automatic identifying method
CN115564388A (en) Green construction method for subway rail connecting main body
CN109591846A (en) A kind of wheel tread online test method
CN104361344B (en) A kind of seamless track steel rail defect identification method based on interval graph picture
Arain et al. Rail surface faults identification from low quality image data using machine learning algorithms
CN115541588B (en) Image segmentation-based pantograph carbon slide plate abrasion estimation method and device
CN113674213B (en) Subway tunnel crack identification method based on rotating target detection technology

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant