CN204882391U - Damaged automatic identification equipment in vehicular road surface based on image processing - Google Patents
Damaged automatic identification equipment in vehicular road surface based on image processing Download PDFInfo
- Publication number
- CN204882391U CN204882391U CN201520598168.7U CN201520598168U CN204882391U CN 204882391 U CN204882391 U CN 204882391U CN 201520598168 U CN201520598168 U CN 201520598168U CN 204882391 U CN204882391 U CN 204882391U
- Authority
- CN
- China
- Prior art keywords
- image
- road surface
- line
- digital camera
- gps
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The utility model discloses a damaged automatic identification equipment in vehicular road surface based on image processing, including image gathering module, data processing module, power module and GPS signal send -receiver device, image gathering module includes linear array camera, rotary encoder, LED illumination element, facilities control console, and data processing module includes image acquisition card, GPS data pre processing unit, industrial computer. The utility model discloses pulse signal according to rotary encoder produces triggers linear array camera, and the road surface precision of images is high, avoids utilizing GPS positioning system to trigger and shoots, the unfavorable situation that can't trigger in conditions of sheltering from such as tunnel, trees. The road surface is shot simultaneously about adopting double -line battle array camera, has reduced road surface image mosaicking's complexity, and the image is spliced in succession in image easy realization in road surface to the integration of road surface image about reaching. The mileage is rectified as supplementary rotary encoder to the GPS locating information, and the GPS information on the corresponding road surface of filing is favorable to looking over of damaged road surface of later stage, the location in geographical position.
Description
Technical field
The utility model relates to road damage testing technology, particularly a kind of vehicular road surface breakage automatic identification equipment based on image procossing.
Background technology
Along with China's expanding economy, all trades and professions all have huge demand to communications and transportation.Good Highway Environment has become the key factor of promoting national economic development.Along with the continuous increase of national highway mileage number, for guarantee the highway built can obtain good maintenance, play maximum value, guarantee the people's traffic trip time life and property safety, must to use and road long neglected and in disrepair carry out Road Detection frequent.The damage testing on road surface, as the one in various roads checking and appraising index, has material impact to the security of road.If can Timeliness coverage and detect the breakage of road, road maintenance unit takes corresponding maintenance measures, then can reduce the generation of traffic hazard, increase the road occupation time limit, reduce the fuel consume of driving, improve ride comfort.
Current road surface breakage detection technique mainly contains manual detection, laser detection, detects this three kinds of utility models based on Digital Image Processing.
Manual detection requires testing staff to on-the-spot comprising damaged length and width to the damaged condition of damaged road surface, record is carried out in area, position, and arranges the Data classification of record and tabulate.This detection utility model, owing to having a great difference with the individual evaluation standard of testing staff, causes testing result to have too strong subjectivity, and wastes time and energy, seldom adopt at present.
Laser measuring technology relies on Laser emission specific wavelength laser, and laser receiver real-time reception is by the laser of road reflection simultaneously.Because crack area exists diffuse reflection, the light intensity received is different from the light intensity on normal road surface, carries out failure evaluation according to this feature.Defect is that ambient light effects is comparatively large, influenced under sunshine condition.
Detection technique based on Digital Image Processing was developing in recent years, mainly contained based on area array CCD camera and linear array CCD camera.Both road surface breakage detection gordian techniquies are substantially identical, but not only needing image mosaic at road horizontal direction based on the image after area array CCD camera collection, and also need splicing at road longitudinal direction, the location of damaged crack location is compared with employing linear array CCD camera, do not have the latter accurate, area array cameras also needs to be processed into the unfavorable factors such as image distortion.Pick-up unit great majority numerous are at present the outdoor collection road image of inspection vehicle in advance, and then by software or indoors artificial operational processes, are in semi-automatic state, and detection accuracy still has larger associating with human factor.
In sum, need one more efficiently, more accurate road surface breakage pick-up unit.
Summary of the invention
The technical matters that the utility model solves is to provide a kind of vehicular road surface breakage automatic identification equipment based on image procossing, to solve the shortcoming in above-mentioned background technology, to improve the detection speed of road damage testing, improve accuracy of detection, reduce testing cost.
For achieving the above object, the utility model adopts following technical scheme to realize:
A kind of vehicular road surface breakage automatic identification equipment based on image procossing, comprise image capture module, data processing module, power module and gps signal R-T unit, described image capture module comprises line-scan digital camera, trigger the rotary encoder that line-scan digital camera is taken pictures, for line-scan digital camera provides the LED illumination unit of light source, the facilities control console of control line array camera acquisition parameters and LED illumination unit intensity of illumination, described line-scan digital camera is arranged on the afterbody of inspection vehicle, comprise shooting direction parallel and adopt the First Line array camera of taking a photograph downward and the second line-scan digital camera, described rotary encoder is arranged on hub for vehicle wheel axis outer, described data processing module comprises image pick-up card, gps data pretreatment unit, industrial computer, described image pick-up card comprises the first image pick-up card and the second image pick-up card being connected the second line-scan digital camera that connect First Line array camera, described gps data pretreatment unit connects gps signal R-T unit and gps signal is carried out pre-service and obtains GPS locating information, described image pick-up card is connected industrial computer with gps data pretreatment unit, graphics processing unit is provided with in industrial computer, graphics processing unit comprises and carries out Real-time Collection for road pavement image, transmission, splicing, display, store A module and merge for road pavement image, damaged identification automatically, classification, the B module of statistics and report generation, described power module is connected with image capture module, data processing module, gps signal R-T unit.
The shooting angle of First Line array camera described in the utility model, the second line-scan digital camera for become 36 ° with vertical direction, some juxtaposition of image that First Line array camera, the second line-scan digital camera photograph.
Gps signal R-T unit described in the utility model is arranged on the top of inspection vehicle.
GPS locating information described in the utility model comprises the speed of a motor vehicle, direction, longitude, latitude and time.
Image pick-up card described in the utility model is connected with line-scan digital camera by cameralink connecting line.
Rotary encoder described in the utility model adopts the structure of fast disassembly type.
LED illumination unit described in the utility model is arranged on below line-scan digital camera, and is arranged on the afterbody of inspection vehicle.
Beneficial effect:
Adopt the utility model, according to the pulse signal that rotary encoder produces, make wheel often advance 1mm triggering line-scan digital camera shooting, pavement image precision is high, avoid utilizing GPS positioning system to trigger to take pictures, in the unfavorable situation that the obstruction conditions such as tunnel, trees cannot trigger.Adopt road surface, twin-line array camera left and right to take, reduce the complexity of pavement image splicing, pavement image easily realizes continuous stitching image, and the fusion of left and right pavement image simultaneously.GPS locating information is as auxiliary rotary encoder, and correct mileage, the GPS information of file corresponding road surface, is conducive to checking of later stage damaged road surface, the location in geographic position.At graphics processing unit, devise two modules, module in charge inspection vehicle on the spot collection site pavement image time Real-time Collection, transmission, display, storage, pavement image in another one module in charge process database, carries out breakage and automatically identifies.
Accompanying drawing explanation
Fig. 1 is structural representation of the present utility model.
Fig. 2 is the process flow diagram of graphics processing unit in the utility model.
Fig. 3 is vehicle-mounted distribution form rear view in preferred embodiment of the present utility model.
Fig. 4 is vehicle-mounted distribution form side view in preferred embodiment of the present utility model.
Embodiment
In order to make technological means of the present utility model, reach object and effect is easy to understand, to develop simultaneously embodiment below in conjunction with accompanying drawing, set forth the utility model further.
See a kind of vehicular road surface breakage automatic identification equipment based on image procossing shown in Fig. 1-4, this device is configured on an inspection vehicle, car is integrated with power module, image capture module, data processing module and gps signal R-T unit.
Power module is connected with image capture module, data processing module, gps signal R-T unit, and power module is image capture module, all submodules in data processing module and gps signal R-T unit provide stable power supply.
Image capture module comprises five submodules, be First Line array camera, the second line-scan digital camera, rotary encoder, LED illumination unit, facilities control console respectively, rotary encoder, facilities control console, LED illumination unit are all connected with First Line array camera and the second line-scan digital camera; Rotary encoder is arranged on hub for vehicle wheel axis outer, with wheel synchronous rotary, wheel often advances a segment distance, produce trigger pip, trigger pip synchronously passes to First Line array camera, the second line-scan digital camera, trigger First Line array camera, the second line-scan digital camera takes pictures, and by the image transmitting that collects to data processing module; LED illumination unit is used for providing floor light for First Line array camera, the second line-scan digital camera, gets rid of the interference of extraneous other light sources; Facilities control console is connected with First Line array camera, the second line-scan digital camera and LED illumination unit, for controlling the switch of the acquisition parameters of First Line array camera and the second line-scan digital camera, the intensity of illumination of LED illumination unit and each submodule.
Data processing module comprises five submodules, be the first image pick-up card, the second image pick-up card, gps data pretreatment unit, industrial computer, graphics processing unit respectively, the first image pick-up card, the second image pick-up card, gps data pretreatment unit are all connected with industrial computer, first image pick-up card is connected with First Line array camera by cameralink connecting line, second image pick-up card is connected with the second line-scan digital camera by cameralink connecting line, the image data transmission that photographs is given the first image pick-up card by cameralink connecting line by First Line array camera, the image data transmission that photographs is given the second image pick-up card by cameralink connecting line by the second line-scan digital camera, first image pick-up card and the second image pick-up card process view data, industrial computer internal memory is transferred to after process, industrial computer carries out splicing to linear array images and generates continuous pavement image, and synthesize an image with fixing frame number, be saved in industrial computer hard disk respectively, gps data pretreatment unit is connected with gps signal R-T unit, gps signal R-T unit receives GPS information, and GPS information is passed to gps data pretreatment unit and carry out pre-service, GPS information is transferred to industrial computer and preserves by gps data pretreatment unit again, graphics processing unit is responsible for compressing view data, transmit, storing, and road pavement image carries out automatic damaged type identification, classification, statistics and auto report completing.
In image capture module, rotary encoder adopts the industrial encoders of ultrahigh resolution, need the inspection vehicle reached required by device 1mm rotary encoder of often advancing forward to send a pulse, trigger action First Line array camera and the second line-scan digital camera are taken pictures simultaneously.Rotary encoder is arranged on the outer, hub spindle center of wheel on rear side of inspection vehicle, uses the version of quick detach.In the present embodiment, rotary encoder adopts should section EC58A10 type scrambler, and this scrambler has 3600 high resolving power often turned, and can meet vehicle body and often to advance 1mm, trigger the requirement of primary line array camera shooting.The trigger pip of rotary encoder is by processing synchronous transmission to First Line array camera and the second line-scan digital camera.
First Line array camera, the second line-scan digital camera adopt BASLERspL4096-140km camera, major parameter: resolution is 1*4096, black and white, CameraLink interface shape, camera lens adopts Nikon AF-S50mmf/1.8G model, and the parameter of two line-scan digital cameras is identical.Two line-scan digital cameras are placed side by side on the structural member of body tail increase, 2400mm place, vertical range ground, ensure that the direction of two line-scan digital camera shootings becomes 36 degree of angles with vertical direction, and it is coplanar during shooting, height adjustable, two line-scan digital cameras take some juxtaposition of image obtained, and the scope of two line-scan digital camera shootings covers the track of 3.75m width.
LED illumination unit uses continuous print to carry out floor light without the LED illumination unit road pavement of stroboscopic, it is floor light light source during two line-scan digital camera shootings, for getting rid of the interference of extraneous natural light, brightness, the stroboscopic time of LED illumination unit are controlled by facilities control console.LED illumination unit is arranged in 300mm place, vertical range bottom surface, U-shaped shape, ensures the enough intensity of illumination in road surface that is taken.
In data processing module, industrial computer adopts in this example and grinds magnificent cabinet, grind magnificent mainboard PCE-7210G2 mainboard, grind magnificent PCE-5B12-64B1E industry base plate, Intel Duo 2QX9650 processor, PCI2394 board (rotary encoder step-by-step counting).First image pick-up card and the second image pick-up card all adopt MatroxSoliosXCL type CameraLink interface image capture card, and two boards are all inserted on the corresponding draw-in groove of mainboard.
Gps signal R-T unit adopts GPS, and for receiving the locating information that satellite exports, locating information comprises the speed of current detection car, direction, longitude, latitude and positioning time.GPS selects GARMINeTrexLengendC type GPS.GPS is placed on roof, resolve receiving the GPS information obtained, using the mileage information of GPS as auxiliary parameter, correct the mileage produced by rotary encoder, these information are saved in the database of industrial computer along with pavement image data are named successively according to time sequencing.
Graphics processing unit is be erected at the process software on industrial computer platform, carry out gathering for road pavement image, transmit, store and image data processing, report generation.Graphics processing unit comprises two submodules: A module is pavement image Real-time Collection, transmission, display, memory module, and B module is the damaged identification module automatically of pavement image.
The treatment scheme of A module is:
Step 11: obtain the first image pick-up card and the second image pick-up card gather the view data be sent in industrial computer internal memory, the splicing of every this view data of 1024 frames is fused into a continuous print pavement image;
Step 12: the window interface pavement image after fusion being presented in real time software;
Step 13: by all pavement images according to time sequencing, name preservation successively according to naming rule;
Step 14: simultaneously preserve pile No. mileage information with step 11, step 12, step 13, and the GPS information in each corresponding moment of image, for the normal operation of the automatic failure evaluation module of module B provides condition.
The treatment scheme of B module is:
Step 21: adopt Harris angle point road pavement image to carry out feature extraction, and adopt the Processing Algorithm of images match, splicing is carried out to road left and right pavement image and merges;
Step 22: obtain illumination background, removes image irradiation difference, obtains the image after Histogram equalization;
Step 23: by image filtering denoising, carrying out image threshold segmentation, the process of dilation and erosion, finally extracts the breakage image on road surface;
Step 24: according to the training of damaged type data, damaged type is classified, adds up, pile No. position, automatic mark place, damaged road surface region and mileage number, the final detection form automatically generated required by country.
More than show and describe ultimate principle of the present utility model and principal character and advantage of the present utility model.The technician of the industry should understand; the utility model is not restricted to the described embodiments; what describe in above-described embodiment and instructions just illustrates principle of the present utility model; under the prerequisite not departing from the utility model spirit and scope; the utility model also has various changes and modifications, and these changes and improvements all fall within the scope of claimed the utility model.The claimed scope of the utility model is defined by appending claims and equivalent thereof.
Claims (7)
1. the vehicular road surface breakage automatic identification equipment based on image procossing, it is characterized in that, comprise image capture module, data processing module, power module and gps signal R-T unit, described image capture module comprises line-scan digital camera, trigger the rotary encoder that line-scan digital camera is taken pictures, for line-scan digital camera provides the LED illumination unit of light source, the facilities control console of control line array camera acquisition parameters and LED illumination unit intensity of illumination, described line-scan digital camera is arranged on the afterbody of inspection vehicle, comprise shooting direction parallel and adopt the First Line array camera of taking a photograph downward and the second line-scan digital camera, described rotary encoder is arranged on hub for vehicle wheel axis outer, described data processing module comprises image pick-up card, gps data pretreatment unit, industrial computer, described image pick-up card comprises the first image pick-up card and the second image pick-up card being connected the second line-scan digital camera that connect First Line array camera, described gps data pretreatment unit connects gps signal R-T unit and gps signal is carried out pre-service and obtains GPS locating information, described image pick-up card is connected industrial computer with gps data pretreatment unit, graphics processing unit is provided with in industrial computer, graphics processing unit comprises and carries out Real-time Collection for road pavement image, transmission, splicing, display, store A module and merge for road pavement image, damaged identification automatically, classification, the B module of statistics and report generation, described power module is connected with image capture module, data processing module, gps signal R-T unit.
2. a kind of vehicular road surface breakage automatic identification equipment based on image procossing according to claim 1, it is characterized in that, described First Line array camera, the shooting angle of the second line-scan digital camera are for become 36 with vertical direction
0, some juxtaposition of image that First Line array camera, the second line-scan digital camera photograph.
3. a kind of vehicular road surface breakage automatic identification equipment based on image procossing according to claim 1, it is characterized in that, described gps signal R-T unit is arranged on the top of inspection vehicle.
4. a kind of vehicular road surface breakage automatic identification equipment based on image procossing according to claim 1, it is characterized in that, described GPS locating information comprises the speed of a motor vehicle, direction, longitude, latitude and time.
5. a kind of vehicular road surface breakage automatic identification equipment based on image procossing according to claim 1, is characterized in that, described image pick-up card is connected with line-scan digital camera by cameralink connecting line.
6. a kind of vehicular road surface breakage automatic identification equipment based on image procossing according to claim 1, is characterized in that, described rotary encoder adopts the structure of fast disassembly type.
7. a kind of vehicular road surface breakage automatic identification equipment based on image procossing according to claim 1, it is characterized in that, described LED illumination unit is arranged on below line-scan digital camera, and is arranged on the afterbody of inspection vehicle.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201520598168.7U CN204882391U (en) | 2015-08-11 | 2015-08-11 | Damaged automatic identification equipment in vehicular road surface based on image processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201520598168.7U CN204882391U (en) | 2015-08-11 | 2015-08-11 | Damaged automatic identification equipment in vehicular road surface based on image processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN204882391U true CN204882391U (en) | 2015-12-16 |
Family
ID=54826752
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201520598168.7U Expired - Fee Related CN204882391U (en) | 2015-08-11 | 2015-08-11 | Damaged automatic identification equipment in vehicular road surface based on image processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN204882391U (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105572755A (en) * | 2016-02-04 | 2016-05-11 | 福建福光股份有限公司 | Airport runway foreign matter detection device and detection method thereof |
| CN105891220A (en) * | 2016-06-02 | 2016-08-24 | 昆山市交通工程试验检测中心有限公司 | Pavement marker line defect detecting device and detecting method thereof |
| CN106657764A (en) * | 2016-10-14 | 2017-05-10 | 山西省交通科学研究院 | Car-mounted adjustment platform used for tunnel image acquisition and the implementation method thereof |
| CN107316064A (en) * | 2017-06-26 | 2017-11-03 | 长安大学 | A kind of asphalt pavement crack classifying identification method based on convolutional neural networks |
| CN107798293A (en) * | 2017-09-20 | 2018-03-13 | 罗明帅 | A kind of crack on road detection means |
| CN107966454A (en) * | 2017-12-25 | 2018-04-27 | 陕西科技大学 | A kind of end plug defect detecting device and detection method based on FPGA |
| CN109975501A (en) * | 2019-03-22 | 2019-07-05 | 中国铁建大桥工程局集团有限公司 | A kind of inspection car for sponge city |
| CN110515339A (en) * | 2019-10-08 | 2019-11-29 | 上海市东方海事工程技术有限公司 | A kind of Multi-path synchronous triggering device, tunnel area array cameras and tunnel cruising inspection system |
| CN114019950A (en) * | 2021-09-29 | 2022-02-08 | 哈尔滨工业大学 | Tunnel structure apparent disease intelligent inspection robot |
-
2015
- 2015-08-11 CN CN201520598168.7U patent/CN204882391U/en not_active Expired - Fee Related
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105572755A (en) * | 2016-02-04 | 2016-05-11 | 福建福光股份有限公司 | Airport runway foreign matter detection device and detection method thereof |
| CN105891220A (en) * | 2016-06-02 | 2016-08-24 | 昆山市交通工程试验检测中心有限公司 | Pavement marker line defect detecting device and detecting method thereof |
| CN106657764A (en) * | 2016-10-14 | 2017-05-10 | 山西省交通科学研究院 | Car-mounted adjustment platform used for tunnel image acquisition and the implementation method thereof |
| CN106657764B (en) * | 2016-10-14 | 2019-08-09 | 山西省交通科学研究院 | A kind of vehicular adjusting platform and its implementation method for tunnel Image Acquisition |
| CN107316064A (en) * | 2017-06-26 | 2017-11-03 | 长安大学 | A kind of asphalt pavement crack classifying identification method based on convolutional neural networks |
| CN107316064B (en) * | 2017-06-26 | 2020-07-14 | 长安大学 | Asphalt pavement crack classification and identification method based on convolutional neural network |
| CN107798293A (en) * | 2017-09-20 | 2018-03-13 | 罗明帅 | A kind of crack on road detection means |
| CN107966454A (en) * | 2017-12-25 | 2018-04-27 | 陕西科技大学 | A kind of end plug defect detecting device and detection method based on FPGA |
| CN109975501A (en) * | 2019-03-22 | 2019-07-05 | 中国铁建大桥工程局集团有限公司 | A kind of inspection car for sponge city |
| CN109975501B (en) * | 2019-03-22 | 2022-03-15 | 中国铁建大桥工程局集团有限公司 | A patrol and examine car for sponge city |
| CN110515339A (en) * | 2019-10-08 | 2019-11-29 | 上海市东方海事工程技术有限公司 | A kind of Multi-path synchronous triggering device, tunnel area array cameras and tunnel cruising inspection system |
| CN114019950A (en) * | 2021-09-29 | 2022-02-08 | 哈尔滨工业大学 | Tunnel structure apparent disease intelligent inspection robot |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN204882391U (en) | Damaged automatic identification equipment in vehicular road surface based on image processing | |
| CN105067633A (en) | Vehicle-mounted type automatic pavement damage recognition device based on image processing and application method | |
| Bijelic et al. | Seeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather | |
| Choi et al. | KAIST multi-spectral day/night data set for autonomous and assisted driving | |
| CA2747337C (en) | Multiple object speed tracking system | |
| CN102737236B (en) | Method for automatically acquiring vehicle training sample based on multi-modal sensor data | |
| CN100507970C (en) | Red light overriding detection system and method based on digital video camera | |
| CN103640595B (en) | A kind of railway protective hurdle net automatic detection system and failure evaluation method | |
| CN110910354A (en) | Road detection vehicle and road detection method and device | |
| CN103808723A (en) | Exhaust gas blackness automatic detection device for diesel vehicles | |
| CN108198417B (en) | A kind of road cruising inspection system based on unmanned plane | |
| CN205862589U (en) | A kind of automatic Vehicle Recognition System | |
| CN110046584B (en) | Road crack detection device and detection method based on unmanned aerial vehicle inspection | |
| CN107102004A (en) | A kind of tunnel detector | |
| CN104967769B (en) | A kind of vehicle bottom scanning system and method | |
| CN107941170A (en) | Road detection apparatus and system | |
| Diaz-Ruiz et al. | Ithaca365: Dataset and driving perception under repeated and challenging weather conditions | |
| CN104713526A (en) | Method for detecting types of foreign matters on power transmission line | |
| CN105300358A (en) | Foreign object type detection platform on power transmission line | |
| CN111400533A (en) | Image screening method and device, electronic equipment and storage medium | |
| CN101719982A (en) | Road real image and road surface image acquisition system based on GIS | |
| CN205737579U (en) | Train operation composite image information detection device | |
| JP2022003335A (en) | Deterioration diagnostic device, deterioration diagnostic system, deterioration diagnostic method, and program | |
| CN109784309A (en) | A kind of advertisement board on highway identifying system and method based on in-vehicle camera | |
| CN107621229A (en) | Real-time railroad track width measure system and method based on face battle array black and white camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20151216 Termination date: 20170811 |