CN112330557A - Bridge monitoring method of non-contact close-range image - Google Patents
Bridge monitoring method of non-contact close-range image Download PDFInfo
- Publication number
- CN112330557A CN112330557A CN202011208870.XA CN202011208870A CN112330557A CN 112330557 A CN112330557 A CN 112330557A CN 202011208870 A CN202011208870 A CN 202011208870A CN 112330557 A CN112330557 A CN 112330557A
- Authority
- CN
- China
- Prior art keywords
- camera
- bridge
- image
- background server
- main camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 33
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000001914 filtration Methods 0.000 claims abstract description 4
- 230000008569 process Effects 0.000 claims description 5
- 230000008859 change Effects 0.000 claims description 2
- 238000006073 displacement reaction Methods 0.000 claims description 2
- 238000005286 illumination Methods 0.000 claims description 2
- 238000003384 imaging method Methods 0.000 claims description 2
- 230000003287 optical effect Effects 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 claims description 2
- 238000009434 installation Methods 0.000 abstract description 4
- 239000000463 material Substances 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 229920000049 Carbon (fiber) Polymers 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000004917 carbon fiber Substances 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 229910001285 shape-memory alloy Inorganic materials 0.000 description 1
- 239000002520 smart material Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a bridge monitoring method of non-contact close-range images, which comprises the steps of firstly, utilizing a front-end binocular camera to carry out regular video image acquisition on a monitored bridge pier and a bridge body; based on the collected video image, performing high-precision distortion correction on a main lens of the binocular camera by using a panoramic calibration field, filtering various noise interferences, and then restoring the image through image reconstruction; the recovered image data is remotely transmitted to a background server, and the background server performs real-time calculation on the settlement and offset of a rear-end bridge; and the background server outputs the calculation result in a chart or a format specified by a user. The method improves the monitoring precision, reduces the strength and cost of manual conventional monitoring, is convenient to operate, has low use and installation cost, and is particularly suitable for popularization and application.
Description
Technical Field
The invention relates to the technical field of bridge monitoring, in particular to a bridge monitoring method of a non-contact close-range image.
Background
Currently, bridge structure health monitoring sensors for bridge monitoring include two types, local monitoring and overall monitoring, and are mainly used for local monitoring of optical fibers, piezoelectric smart materials and sensing elements, such as optical fibers, resistance strain wires, fatigue life wires, piezoelectric materials, carbon fibers, semiconductor materials, shape memory alloys and the like. They adopt the surface attachment or embedding mode to sense the important part and important component of the structure and obtain the parameter signal reflecting the local structure characteristics. Although the sensor has many advantages, the sensor can only realize point-type or line-type distributed measurement, the surface-type or body-type measurement in the true sense is difficult to realize, and the acquired signal can only reflect the characteristics of a local structure.
In the prior art, the bridge settlement and the bridge deviation are generally realized by using a contact sensor, the scheme has high monitoring cost and low automation degree, manual intervention is often required, most of close-range monitoring sites adopt manual photographing observation and single-camera or double-camera three-dimensional calculation, and the precision and the cost are greatly limited.
Disclosure of Invention
The invention aims to provide a bridge monitoring method of a non-contact close-range image, which improves the monitoring precision, reduces the strength and cost of manual conventional monitoring, is convenient to operate, has low use and installation cost, and is particularly suitable for popularization and application.
The purpose of the invention is realized by the following technical scheme:
a bridge monitoring method of a non-contact close-range image comprises the following steps:
step 1, regularly acquiring video images of a monitored pier and a bridge body by using a front-end binocular camera;
step 2, based on the collected video image, carrying out high-precision distortion correction on a main camera of the binocular camera by using a panoramic calibration field, filtering various noise interferences, and then restoring the image through image reconstruction;
and 4, the background server outputs the calculation result in a chart or a format specified by a user.
According to the technical scheme provided by the invention, the method improves the monitoring precision, reduces the strength and cost of manual conventional monitoring, is convenient to operate, has low use and installation cost, and is particularly suitable for popularization and application.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
Fig. 1 is a schematic flow chart of a bridge monitoring method using a non-contact close-range image according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention are clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
The following will further describe an embodiment of the present invention in detail with reference to the accompanying drawings, and as shown in fig. 1, a schematic flow chart of a bridge monitoring method for a non-contact close-range image provided by the embodiment of the present invention is shown, where the method includes:
step 1, regularly acquiring video images of a monitored pier and a bridge body by using a front-end binocular camera;
step 2, based on the collected video image, carrying out high-precision distortion correction on a main camera of the binocular camera by using a panoramic calibration field, filtering various noise interferences, and then restoring the image through image reconstruction;
in this step, the process of correcting the main camera of the binocular camera with high-precision distortion by using the panoramic calibration field specifically includes:
firstly, adjusting the focal distance to the farthest, the nearest and the middle, and respectively detecting three groups of distortion parameters, namely (x0, y0, f, k1, k2, p1, p2, a, p); the parameter is mainly used for correcting distortion variation of a camera lens, so that an obtained image is free of distortion, and the deformation monitoring precision of a bridge is improved; wherein, (x0, y0) is the principal point-like coordinates; f is the focal length of the lens; k1, k2 are radial distortion parameters of the lens; p1, p2 are tangential distortion parameters of the lens; a, p are non-square correction coefficients of the pixel; and then, directly fitting all parameters of the lens in the maximum and minimum focal length ranges through the distortion parameters of the three groups of lenses, and correcting the distortion to improve the monitoring precision.
Then at least 10 groups of pictures are taken on each focal section, and the distortion parameters on the corresponding focal sections are calculated by the 10 groups of pictures;
fitting distortion quantities of different field focusing positions by a high-order polynomial, and performing primary distortion correction in the first step; in the specific implementation, the adjustable range of the focal length of the lens preferably takes a plurality of technical distortion parameters of the position, which is beneficial to improving field fitting;
on the basis of the primary distortion correction of the first step, wavelet transformation is carried out on the original image, and noise interference factors caused by illumination and vibration are filtered.
In the specific implementation, the relative positions of the main camera and the auxiliary camera are calibrated mutually in the binocular camera, and the specific process is as follows:
the focal lengths of the main camera and the auxiliary camera of the binocular camera are set to be different, the focal length of the main camera is longer, and the focal length of the auxiliary camera is short but the visual field range is wider;
when the main camera and the auxiliary camera are aligned to the target of the monitored bridge, because the main camera and the auxiliary camera both shoot the same target, the tiny change in the binocular camera is reflected on the image through the cameras with different focal sections;
and then the relative variation of the main camera and the auxiliary camera is calculated through the calibrated distortion parameters, the optical collinear equation and the focal length resolution, and the imaging error caused by the small structural variation of the main camera is corrected.
specifically, two comparison images obtained by the main camera and the auxiliary camera are seamlessly superposed through feature matching and integral image registration, the displacement of the target is extracted, and the purpose of deformation monitoring is achieved.
And 4, the background server outputs the calculation result in a chart or a format specified by a user.
It is noted that those skilled in the art will recognize that embodiments of the present invention are not described in detail herein.
In conclusion, the bridge monitoring method provided by the embodiment of the invention improves the monitoring precision, reduces the strength and cost of manual conventional monitoring, is convenient to operate, has low use and installation cost, and is particularly suitable for popularization and application.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (4)
1. A bridge monitoring method of a non-contact close-range image is characterized by comprising the following steps:
step 1, regularly acquiring video images of a monitored pier and a bridge body by using a front-end binocular camera;
step 2, based on the collected video image, carrying out high-precision distortion correction on a main camera of the binocular camera by using a panoramic calibration field, filtering various noise interferences, and then restoring the image through image reconstruction;
step 3, remotely transmitting the recovered image data to a background server, and carrying out real-time calculation on the settlement and offset of the rear-end bridge body by the background server;
and 4, the background server outputs the calculation result in a chart or a format specified by a user.
2. The bridge monitoring method of the non-contact close-range image according to claim 1, wherein in the step 2, the process of performing high-precision distortion correction on the main camera of the binocular camera by using the panoramic calibration field specifically comprises:
firstly, adjusting the focal length to the farthest, the nearest and the middle, and respectively detecting three groups of distortion parameters;
then at least 10 groups of pictures are taken on each focal section, and the distortion parameters on the corresponding focal sections are calculated by the 10 groups of pictures;
fitting distortion quantities of different field focusing positions by a high-order polynomial, and performing primary distortion correction in the first step;
on the basis of the primary distortion correction of the first step, wavelet transformation is carried out on the original image, and noise interference factors caused by illumination and vibration are filtered.
3. The bridge monitoring method of the non-contact close-range image according to claim 1, wherein the inside of the binocular camera is mutually calibrated by adopting relative positions of a main camera and a secondary camera, and the specific process is as follows:
the focal lengths of the main camera and the auxiliary camera of the binocular camera are set to be different, the focal length of the main camera is longer, and the focal length of the auxiliary camera is short but the visual field range is wider;
when the main camera and the auxiliary camera are aligned to the target of the monitored bridge, because the main camera and the auxiliary camera both shoot the same target, the tiny change in the binocular camera is reflected on the image through the cameras with different focal sections;
and then the relative variation of the main camera and the auxiliary camera is calculated through the calibrated distortion parameters, the optical collinear equation and the focal length resolution, and the imaging error caused by the small structural variation of the main camera is corrected.
4. The bridge monitoring method of the non-contact close-range image according to claim 1, wherein in step 3, the process of the background server performing real-time calculation of the settlement and offset of the rear-end bridge body specifically comprises:
through feature matching and integral image registration, seamless superposition of two comparison images obtained by the main camera and the auxiliary camera is realized, the displacement of the target is extracted, and the purpose of deformation monitoring is achieved.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011208870.XA CN112330557A (en) | 2020-11-03 | 2020-11-03 | Bridge monitoring method of non-contact close-range image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011208870.XA CN112330557A (en) | 2020-11-03 | 2020-11-03 | Bridge monitoring method of non-contact close-range image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112330557A true CN112330557A (en) | 2021-02-05 |
Family
ID=74322834
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011208870.XA Pending CN112330557A (en) | 2020-11-03 | 2020-11-03 | Bridge monitoring method of non-contact close-range image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112330557A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114067533A (en) * | 2021-11-27 | 2022-02-18 | 四川大学 | Geological disaster photographing monitoring and early warning method |
| CN114383574A (en) * | 2021-12-29 | 2022-04-22 | 中国测绘科学研究院 | Binocular rapid three-dimensional measurement method for unmanned aerial vehicle |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108759699A (en) * | 2018-03-27 | 2018-11-06 | 西安交通大学 | A kind of measurement method and system of big visual field masonry structure material three-dimensional whole field deformation |
| CN110533618A (en) * | 2019-09-03 | 2019-12-03 | 西安奇维科技有限公司 | A kind of method and photographic means of lens distortion correction |
| CN110906904A (en) * | 2019-12-13 | 2020-03-24 | 中铁四局集团第五工程有限公司 | Bridge pier settlement monitoring system and monitoring method thereof |
| CN211042730U (en) * | 2019-09-26 | 2020-07-17 | 杭州鲁尔物联科技有限公司 | Bridge displacement monitoring system based on visual perception |
-
2020
- 2020-11-03 CN CN202011208870.XA patent/CN112330557A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108759699A (en) * | 2018-03-27 | 2018-11-06 | 西安交通大学 | A kind of measurement method and system of big visual field masonry structure material three-dimensional whole field deformation |
| CN110533618A (en) * | 2019-09-03 | 2019-12-03 | 西安奇维科技有限公司 | A kind of method and photographic means of lens distortion correction |
| CN211042730U (en) * | 2019-09-26 | 2020-07-17 | 杭州鲁尔物联科技有限公司 | Bridge displacement monitoring system based on visual perception |
| CN110906904A (en) * | 2019-12-13 | 2020-03-24 | 中铁四局集团第五工程有限公司 | Bridge pier settlement monitoring system and monitoring method thereof |
Non-Patent Citations (2)
| Title |
|---|
| 孙懋珩等: "基于双目视觉的基坑位移监测方案", 《计算机工程与设计》 * |
| 尚洋等: "基于视觉抗扰动测量空间目标位置姿态", 《宇航学报》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114067533A (en) * | 2021-11-27 | 2022-02-18 | 四川大学 | Geological disaster photographing monitoring and early warning method |
| CN114383574A (en) * | 2021-12-29 | 2022-04-22 | 中国测绘科学研究院 | Binocular rapid three-dimensional measurement method for unmanned aerial vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109035309B (en) | Stereoscopic vision-based pose registration method between binocular camera and laser radar | |
| US9348111B2 (en) | Automatic detection of lens deviations | |
| JP4440341B2 (en) | Calibration method, calibration apparatus, and calibration system including the apparatus | |
| JP3983573B2 (en) | Stereo image characteristic inspection system | |
| JP6209833B2 (en) | Inspection tool, inspection method, stereo camera production method and system | |
| CN112330557A (en) | Bridge monitoring method of non-contact close-range image | |
| JP6044868B2 (en) | Stereo camera calibration apparatus and method, and distance measurement apparatus | |
| CN109373912B (en) | Binocular vision-based non-contact six-degree-of-freedom displacement measurement method | |
| CN106780391B (en) | Distortion correction algorithm for optical system of full-view three-dimensional measuring instrument | |
| JP6975003B2 (en) | Peripheral monitoring device and its calibration method | |
| US20020122117A1 (en) | Camera device, camera system and image processing method | |
| CN111288967A (en) | Remote high-precision displacement detection method based on machine vision | |
| JPWO2018042954A1 (en) | In-vehicle camera, adjustment method of in-vehicle camera, in-vehicle camera system | |
| JP2006322853A (en) | Distance measuring device, distance measuring method and distance measuring program | |
| JP2011149931A (en) | Distance image acquisition device | |
| JP2011117787A (en) | Distance image input device and device for monitoring vehicle exterior | |
| JP4422206B2 (en) | Ranging device and ranging method | |
| CN114219866A (en) | Binocular structured light three-dimensional reconstruction method, reconstruction system and reconstruction equipment | |
| JP2002262156A (en) | Camera, camera system and image processing method | |
| JP2016099247A (en) | Distance detection device, imaging device, and distance detection method | |
| JP2014202661A (en) | Range finder | |
| JP2009168461A (en) | Camera calibration device | |
| CN116668665A (en) | Measuring device, moving device, measuring method, and storage medium | |
| WO2022014215A1 (en) | Processing device and vehicle-mounted camera device | |
| JP5046004B2 (en) | Non-contact vibration measurement system, non-contact vibration measurement method, and computer program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210205 |