CN111598955A - Mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry - Google Patents

Mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry Download PDF

Info

Publication number
CN111598955A
CN111598955A CN202010363104.4A CN202010363104A CN111598955A CN 111598955 A CN111598955 A CN 111598955A CN 202010363104 A CN202010363104 A CN 202010363104A CN 111598955 A CN111598955 A CN 111598955A
Authority
CN
China
Prior art keywords
data
camera
module
mobile terminal
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010363104.4A
Other languages
Chinese (zh)
Inventor
石杏喜
冯韬
张末
李吉珊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Science and Technology
Original Assignee
Nanjing University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Science and Technology filed Critical Nanjing University of Science and Technology
Priority to CN202010363104.4A priority Critical patent/CN111598955A/en
Publication of CN111598955A publication Critical patent/CN111598955A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/46Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462Salient features, e.g. scale invariant feature transforms [SIFT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/757Matching configurations of points or features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/32Indexing scheme for image data processing or generation, in general involving image mosaicing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Image Processing (AREA)

Abstract

The invention belongs to the field of foundation pit monitoring, and particularly relates to a mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry. The monitoring system is based on mobile terminal, includes: the data input and storage module: the system is used for inputting data, downloading the data from the cloud and uploading the data; the camera calibration module: the system is used for obtaining the internal and external orientation elements of the camera and adjusting the shooting attribute of the camera; the picture screening and processing module comprises: the method is used for processing the gray scale, the size and the light sensation of the photo, extracting the features of the photo, matching the features and splicing the photo; the picture analysis module: the method is used for data calculation, obtaining internal and external orientation elements and coordinates of a target point, and judging the rationality of a result; a database: for storing and providing data; cloud artificial intelligence technology module: the system is used for being linked with a client database and providing cloud information and artificial intelligence analysis data. The invention can realize the function of rapidly monitoring the safety of the foundation pit, effectively save the monitoring time of the foundation pit, save the management cost, improve the monitoring effect and ensure the construction safety of the foundation pit.

Description

Mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry
Technical Field
The invention belongs to the field of foundation pit monitoring, and particularly relates to a mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry.
Background
With the rapid development of economy in China, the number of engineering construction projects is increasing, and the construction scale is also increasing. Therefore, engineers need to design various different schemes to protect the foundation pit, so as to avoid the situation that the side slope is unstable, collapses and slips to threaten the life and property safety of people and cause national economic loss.
In recent years, with the rapid development of close-range photogrammetry technology, it is becoming a new type of non-contact measurement means. Compared with the traditional monitoring method, the close-range photogrammetry technology has the advantages of instantly acquiring the geometric and physical information of the measured object, having less field work and the like. However, the dedicated measuring camera is expensive, complex to operate and poor in portability, so that the conventional close-range photogrammetry device has more restrictions on the use environment and poor popularity, and the development and application of the close-range photogrammetry technology in the field of foundation pit monitoring are limited. In addition, the existing close-range photogrammetry configuration is generally an independent measuring device or a linkage system of a computer and the measuring device, and has limited computing capability, lacks a cloud database, lacks cloud intelligent dynamic analysis capability based on big data, and cannot realize dynamic early warning and dynamic management of the big data.
Disclosure of Invention
The invention aims to provide a mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry.
The technical solution for realizing the purpose of the invention is as follows: the utility model provides a mobile terminal intelligence foundation ditch monitoring system based on photogrammetry, monitoring system is based on mobile terminal, includes:
the data input and storage module: the system is used for inputting data, downloading the data from the cloud and uploading the data;
the camera calibration module: the system is used for obtaining the internal and external orientation elements of the camera and adjusting the shooting attribute of the camera;
the picture screening and processing module comprises: the method is used for processing the gray scale, the size and the light sensation of the photo, extracting the features of the photo, matching the features and splicing the photo;
the picture analysis module: the method is used for data calculation, obtaining internal and external orientation elements and coordinates of a target point, and judging the rationality of a result;
a database: for storing data and providing data;
cloud artificial intelligence technology module: the system is used for being linked with a client database and providing cloud information and artificial intelligence analysis data.
A method for monitoring a foundation pit by using the detection system comprises the following steps:
step (1): performing self-checking on a camera of the mobile terminal through a camera checking module;
step (2): inputting field basic data through a data input and storage module;
and (3): analyzing the field data through a camera calibration module, and adjusting various parameters of a camera of the mobile terminal;
and (4): acquiring a live photo based on the functions of a camera and an album of the mobile terminal;
and (5): primarily processing the photos through a picture screening and processing module to synthesize a state to be analyzed;
and (6): analyzing the photos processed by the picture screening and processing module through a picture analysis module to obtain data;
and (7): the cloud artificial intelligence technology module is combined with the database to dynamically compare and analyze the data obtained by the picture analysis module;
and (8): the cloud artificial intelligence technology module judges whether early warning is needed or not;
and (9): and storing the data in a database and uploading the data to the cloud.
Further, the self-calibration in the step (1) obtains the optical distortion parameters of the camera by using a vanishing point method or a DLT method.
Further, in the step (3), the focal length and the zooming characteristic of the camera are automatically adjusted according to the self-checking in the step (1) and the basic data input in the step (2).
Further, in the step (5), the images are spliced and synthesized through a mobile terminal image size processing function and an SIFT feature matching algorithm.
Further, the steps of extracting the SIFT feature vectors in the SIFT feature matching algorithm are as follows
Step (5-1): gaussian filtering is carried out to construct an image scale space;
step (5-2): detecting an extreme value of the scale space;
step (5-3): refining extreme value feature vectors;
step (5-4): removing unstable points and edge points;
step (5-5): the main direction of the extreme point gradient;
step (5-6): and (4) describing the characteristics of the extreme point region.
Further, resolving each parameter by adopting a DLT algorithm in photogrammetry in the step (6) and obtaining the measured data;
the original formula is:
Figure BDA0002475779540000031
the original formula is converted into:
Figure BDA0002475779540000032
in the formula: (x ', y') -coordinate measurements of the image points in the frame coordinate system;
(x, y) -image plane rectangular coordinates of the image point;
(XA,YA,ZA) -object space coordinates of ground points corresponding to the image points;
(XS,YS,ZS) The object space coordinates of the photographic center are also the exterior orientation linear element of the image;
ai,bi,ci-exterior orientation angle element of image
Figure BDA0002475779540000033
9 direction cosines consisting of omega and kappa;
x0,y0f is the internal orientation element of the image;
Figure BDA0002475779540000034
li is eleven coefficients, which are a function of the extrinsic orientation element, the principal distance.
When the object space coordinates of more than 6 control points and the coordinate system coordinates of corresponding image points are known, the numerical values of eleven parameters can be solved by a computer according to the principle of least square method, and if eleven parameters and the coordinate system coordinates of the undetermined point are known, the object space coordinates (X, Y, Z) of the undetermined point can be solved by the method.
Compared with the prior art, the invention has the remarkable advantages that:
the invention provides a mobile client intelligent foundation pit monitoring system based on a photogrammetry technology, which realizes the function of quickly monitoring a foundation pit, further effectively shortens and saves the foundation pit monitoring time, saves the management cost, improves the monitoring effect and ensures the construction safety of the foundation pit; in addition, the early warning and the subsequent use of related personnel can be conveniently and timely carried out through data sharing and dynamic analysis.
Drawings
FIG. 1 is a schematic diagram of the working process of the detection system of the present invention.
Detailed Description
The present invention is described in further detail below with reference to the attached drawing figures.
A mobile client intelligent foundation pit monitoring system based on photogrammetry technology comprises: visualizing an operation interface of the mobile client; a data input and storage module; a camera calibration module; the picture screening and processing module; a picture analysis module; a cloud artificial intelligence technology module; a database.
Visual mobile client operation interface: for operational process streamlining and visualization;
the data input and storage module: the system is used for manually inputting data, downloading the data from the cloud and uploading the data;
camera calibration module (including camera self-calibration): the system is used for obtaining the internal and external orientation elements of the camera and adjusting the shooting attribute of the camera;
the picture screening and processing module comprises: the method is used for processing the gray scale, the size and the light sensation of the photo, extracting the features of the photo, matching the features and splicing the photo;
the picture analysis module: the method is used for data calculation, obtaining internal and external orientation elements and coordinates of a target point, and judging the rationality of a result;
cloud artificial intelligence technology module: the system is used for linking with a client database, providing cloud information and analyzing data by artificial intelligence;
a database: for storing data and for providing data.
A method for monitoring a foundation pit by using the detection system is characterized by comprising the following steps:
step (1): performing self-checking on a camera of the mobile terminal through a camera checking module; step 1, selecting a vanishing point method or a DLT method to obtain optical distortion parameters of a camera according to user requirements;
step (2): inputting field basic data through a data input and storage module;
and (3): analyzing the field data through a camera calibration module, and adjusting various parameters of a camera of the mobile terminal; and (3) automatically adjusting the focal length and the zooming characteristic of the camera according to the self-checking in the step (1) and the basic data input in the step (2).
And (4): acquiring a live photo based on the functions of a camera and an album of the mobile terminal;
and (5): primarily processing the photos through a picture screening and processing module to synthesize a state to be analyzed; and splicing and synthesizing the images through a mobile terminal image size processing function and an SIFT feature matching algorithm. The SIFT feature vector in the SIFT feature matching algorithm is extracted as follows
Gaussian filtering is carried out to construct an image scale space;
detecting an extreme value of the scale space;
refining extreme value feature vectors;
removing unstable points and edge points;
the main direction of the extreme point gradient;
and (4) describing the characteristics of the extreme point region.
And (6): analyzing the photos processed by the picture screening and processing module through a picture analysis module to obtain data;
resolving each parameter by adopting a DLT algorithm in photogrammetry, and obtaining measured data;
the original formula is:
Figure BDA0002475779540000051
the original formula is converted into:
Figure BDA0002475779540000052
in the formula: (x ', y') -coordinate measurements of the image points in the frame coordinate system;
(x, y) -image plane rectangular coordinates of the image point;
(XA,YA,ZA) -object space coordinates of ground points corresponding to the image points;
(XS,YS,ZS) The object space coordinates of the photographic center are also the exterior orientation linear element of the image;
ai-exterior orientation angle element of image
Figure BDA0002475779540000053
9 direction cosines consisting of omega and kappa;
x0,y0f is the internal orientation element of the image;
Figure BDA0002475779540000054
li is eleven coefficients, which are a function of the extrinsic orientation element, the principal distance.
When the object space coordinates of more than 6 control points and the coordinate system coordinates of corresponding image points are known, the numerical values of eleven parameters can be solved by a computer according to the principle of least square method, and if eleven parameters and the coordinate system coordinates of the undetermined point are known, the object space coordinates (X, Y, Z) of the undetermined point can be solved by the method.
The relational expression has the advantages that the expression (2) can be changed into a linear form, so the calculation procedure is simple and the calculation speed is high;
the data analysis process carries out error analysis, and prompts or guides to operate again for obvious unreasonable errors.
And (7): the cloud artificial intelligence technology module is combined with the database to dynamically compare and analyze the data obtained by the picture analysis module; and (4) comparing the result obtained in the step (6) with the specification requirements and cloud data in the database, giving specific prompts to the potential hazards possibly generated by the measured items, and carrying out preliminary analysis on possible reasons of problems.
And (8): the cloud artificial intelligence technology module judges whether early warning is needed or not;
and (9): and storing the data in a database and uploading the data to the cloud.
The invention provides a mobile client intelligent foundation pit monitoring system based on a photogrammetry technology, which realizes the function of quickly monitoring a foundation pit, further effectively shortens and saves the foundation pit monitoring time, saves the management cost, improves the monitoring effect and ensures the construction safety of the foundation pit; in addition, the early warning and the subsequent use of related personnel can be conveniently and timely carried out through data sharing and dynamic analysis.

Claims (7)

1. The utility model provides a mobile terminal intelligence foundation ditch monitoring system based on photogrammetry, a serial communication port, monitoring system is based on mobile terminal, includes:
the data input and storage module: the system is used for inputting data, downloading the data from the cloud and uploading the data;
the camera calibration module: the system is used for obtaining the internal and external orientation elements of the camera and adjusting the shooting attribute of the camera;
the picture screening and processing module comprises: the method is used for processing the gray scale, the size and the light sensation of the photo, extracting the features of the photo, matching the features and splicing the photo;
the picture analysis module: the method is used for data calculation, obtaining internal and external orientation elements and coordinates of a target point, and judging the rationality of a result;
a database: for storing data and providing data;
cloud artificial intelligence technology module: the system is used for being linked with a client database and providing cloud information and artificial intelligence analysis data.
2. A method of pit monitoring using the detection system of claim 1, comprising the steps of:
step (1): performing self-checking on a camera of the mobile terminal through a camera checking module;
step (2): inputting field basic data through a data input and storage module;
and (3): analyzing the field data through a camera calibration module, and adjusting various parameters of a camera of the mobile terminal;
and (4): acquiring a live photo based on the functions of a camera and an album of the mobile terminal;
and (5): primarily processing the photos through a picture screening and processing module to synthesize a state to be analyzed;
and (6): analyzing the photos processed by the picture screening and processing module through a picture analysis module to obtain data;
and (7): the cloud artificial intelligence technology module is combined with the database to dynamically compare and analyze the data obtained by the picture analysis module;
and (8): the cloud artificial intelligence technology module judges whether early warning is needed or not;
and (9): and storing the data in a database and uploading the data to the cloud.
3. The method according to claim 2, wherein the self-calibration in step (1) obtains the optical distortion parameters of the camera by using a vanishing point method or a DLT method.
4. The method according to claim 2, wherein in the step (3), the focal length and zoom characteristics of the camera are automatically adjusted according to the basic data input in the step (1) self-calibration and the step (2).
5. The method according to claim 2, wherein the images are stitched and synthesized in the step (5) through a mobile terminal image size processing function and a SIFT feature matching algorithm.
6. The method of claim 5, wherein the SIFT feature vector in the SIFT feature matching algorithm is extracted as follows
Step (5-1): gaussian filtering is carried out to construct an image scale space;
step (5-2): detecting an extreme value of the scale space;
step (5-3): refining extreme value feature vectors;
step (5-4): removing unstable points and edge points;
step (5-5): the main direction of the extreme point gradient;
step (5-6): and (4) describing the characteristics of the extreme point region.
7. The method according to claim 2, wherein the step (6) adopts DLT algorithm in photogrammetry to solve each parameter and obtain the measured data;
the original formula is:
Figure FDA0002475779530000021
the original formula is converted into:
Figure FDA0002475779530000022
in the formula: (x ', y') -coordinate measurements of the image points in the frame coordinate system;
(x, y) -image plane rectangular coordinates of the image point;
(XA,YA,ZA) -object space coordinates of ground points corresponding to the image points;
(XS,YS,ZS) The object space coordinates of the photographic center are also the exterior orientation linear element of the image;
ai-exterior orientation angle element of image
Figure FDA0002475779530000023
9 direction cosines consisting of omega and kappa;
x0,y0f is the internal orientation element of the image;
Figure FDA0002475779530000031
li is eleven coefficients, which are a function of the foreign orientation element, principal distance;
when the object space coordinates of more than 6 control points and the coordinate system coordinates of corresponding image points are known, the numerical values of eleven parameters can be solved by a computer according to the principle of least square method, and if eleven parameters and the coordinate system coordinates of the undetermined point are known, the object space coordinates (X, Y, Z) of the undetermined point can be solved by the method.
CN202010363104.4A 2020-04-30 2020-04-30 Mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry Pending CN111598955A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010363104.4A CN111598955A (en) 2020-04-30 2020-04-30 Mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010363104.4A CN111598955A (en) 2020-04-30 2020-04-30 Mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry

Publications (1)

Publication Number Publication Date
CN111598955A true CN111598955A (en) 2020-08-28

Family

ID=72190968

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010363104.4A Pending CN111598955A (en) 2020-04-30 2020-04-30 Mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry

Country Status (1)

Country Link
CN (1) CN111598955A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112177062A (en) * 2020-09-26 2021-01-05 福建省华实建设工程有限公司 Remote intelligent monitoring system and monitoring method for building foundation pit
CN115619849A (en) * 2022-12-15 2023-01-17 昆山轩诺电子包装材料有限公司 Full-automatic processing detection system based on carrier band

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1794786A (en) * 2005-10-28 2006-06-28 中国水电顾问集团中南勘测设计研究院 Geologic digital image eliting and recording system and its use method
CN107450426A (en) * 2017-08-01 2017-12-08 中国建筑第八工程局有限公司 Foundation pit construction deformable statistical analysis method and system
CN110306605A (en) * 2019-06-18 2019-10-08 武汉建工集团股份有限公司 A kind of early warning system for base pit engineering automatic monitoring

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1794786A (en) * 2005-10-28 2006-06-28 中国水电顾问集团中南勘测设计研究院 Geologic digital image eliting and recording system and its use method
CN107450426A (en) * 2017-08-01 2017-12-08 中国建筑第八工程局有限公司 Foundation pit construction deformable statistical analysis method and system
CN110306605A (en) * 2019-06-18 2019-10-08 武汉建工集团股份有限公司 A kind of early warning system for base pit engineering automatic monitoring

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李桂南: "手机云服务的立体视觉沥青路面变形检测研究", 《中国优秀硕士论文全文数据库》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112177062A (en) * 2020-09-26 2021-01-05 福建省华实建设工程有限公司 Remote intelligent monitoring system and monitoring method for building foundation pit
CN115619849A (en) * 2022-12-15 2023-01-17 昆山轩诺电子包装材料有限公司 Full-automatic processing detection system based on carrier band

Similar Documents

Publication Publication Date Title
CN102901444B (en) Method for detecting component size based on matching pursuit (MP) wavelet filtering and detecting system thereof
WO2021136386A1 (en) Data processing method, terminal, and server
CN102509304A (en) Intelligent optimization-based camera calibration method
CN113435282B (en) Unmanned aerial vehicle image ear recognition method based on deep learning
CN106530271A (en) Infrared image significance detection method
CN111598955A (en) Mobile terminal intelligent foundation pit monitoring system and method based on photogrammetry
CN112014413A (en) Mobile phone glass cover plate window area defect detection method based on machine vision
CN112946679B (en) Unmanned aerial vehicle mapping jelly effect detection method and system based on artificial intelligence
WO2020093631A1 (en) Antenna downtilt angle measurement method based on depth instance segmentation network
Sun et al. Remote estimation of grafted apple tree trunk diameter in modern orchard with RGB and point cloud based on SOLOv2
CN110634137A (en) Bridge deformation monitoring method, device and equipment based on visual perception
CN111104850A (en) Remote sensing image building automatic extraction method and system based on residual error network
CN113792725B (en) Component detection device and method
CN113781481A (en) Method and device for non-contact measurement of shape and size of object and electronic equipment
CN113362467A (en) Point cloud preprocessing and ShuffleNet-based mobile terminal three-dimensional pose estimation method
CN110930393A (en) Chip material pipe counting method, device and system based on machine vision
CN116721288A (en) Helmet detection method and system based on YOLOv5
CN116051537A (en) Crop plant height measurement method based on monocular depth estimation
US11315265B2 (en) Fingertip detection method, fingertip detection device, and medium
CN110910379B (en) Incomplete detection method and device
Li et al. Low-cost 3D building modeling via image processing
CN110276260A (en) A kind of commodity detection method based on depth camera
Xu et al. Research on target detection methods under the concept of deep learning
CN116309849B (en) Crane positioning method based on visual radar
Li Edge color difference detection of color image based on artificial intelligence technology

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination