CN116758465A - Gas pipeline vehicle-mounted inspection system based on dynamic AI vision - Google Patents

Gas pipeline vehicle-mounted inspection system based on dynamic AI vision Download PDF

Info

Publication number
CN116758465A
CN116758465A CN202310161320.4A CN202310161320A CN116758465A CN 116758465 A CN116758465 A CN 116758465A CN 202310161320 A CN202310161320 A CN 202310161320A CN 116758465 A CN116758465 A CN 116758465A
Authority
CN
China
Prior art keywords
module
identification
construction
recognition
dynamic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310161320.4A
Other languages
Chinese (zh)
Inventor
李伟联
高通
冯少广
陆能开
胡敏乐
程峰
胡壮槟
邓枝成
曾金发
叶城俊
林嘉和
梁志通
陈荣杰
袁逸军
潘伟滔
陈露
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Foran Technology Co ltd
Foshan Sanshui Gas Co ltd
Original Assignee
Guangdong Foran Technology Co ltd
Foshan Sanshui Gas Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Foran Technology Co ltd, Foshan Sanshui Gas Co ltd filed Critical Guangdong Foran Technology Co ltd
Priority to CN202310161320.4A priority Critical patent/CN116758465A/en
Publication of CN116758465A publication Critical patent/CN116758465A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/22Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/20Checking timed patrols, e.g. of watchman

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

The invention discloses a dynamic AI vision-based gas pipeline vehicle-mounted inspection system, which comprises inspection equipment and terminal equipment, wherein the inspection equipment comprises a camera for collecting image information of a construction area and a relay processing device, and the relay processing device comprises a processing module for processing the image information, an alarm module for alarming a monitoring area, an AI identification unit for identifying and classifying the construction area, a serial port communication module for communicating with the camera, a wireless communication module for communicating with the terminal equipment and a power supply module for supplying power; according to the invention, the vehicle-mounted dynamic identification inspection is realized, and the identification result is transmitted to the terminal equipment through the wireless communication module, so that a worker at the terminal equipment can grasp the condition of the construction area in real time and can carry out alarm and other treatments according to the condition of the construction area, so that the gas pipeline is ensured not to be damaged, the intelligent identification of the construction condition near the gas pipeline is realized, and the intelligent degree is high.

Description

Gas pipeline vehicle-mounted inspection system based on dynamic AI vision
Technical Field
The invention relates to the technical field of fuel gas, in particular to a fuel gas pipeline vehicle-mounted inspection system based on dynamic AI vision.
Background
With the continuous development of cities, natural gas pipe networks are continuously expanded, and the gas pipe networks in the current I area are distributed over two streets and five towns, so that underground gas pipe networks are complicated. In order to prevent the damage of a third party, I invest a large amount of manpower to patrol the gas pipe network.
At present, no intelligent inspection equipment for the buried gas pipe network has been found in society, and similar unmanned aerial vehicle AI inspection equipment with a power supply system is provided, but the AI system model is single, and high-precision equipment is required. Meanwhile, the unmanned aerial vehicle is only suitable for inspection in open field environments and is not suitable for working in the air in cities.
The publication number is CN108256598A, a construction monitoring method is disclosed, which comprises the following steps: step one: registering the identity information of all constructors; step two: identifying the identity information of constructors, and allowing the constructors to enter a construction area; step three: recording a site structure of a construction site, dividing a safety area, and monitoring structural potential safety hazards of the site in real time; step four: remote monitoring of construction sites and command construction; step five: and tracking and shooting the construction process, analyzing the construction information in real time, and automatically classifying and archiving. The electronic tag containing the identity information of the constructor can be used for comparing with preset information, constructors entering the construction site can be accurately managed, remote management of the construction site is facilitated, potential safety hazards of the construction site are monitored in real time, construction processes are recorded and analyzed in real time, safety of the construction site is improved to a certain extent, and the constructors and the manager can communicate with the site conveniently through voice communication and an infrared camera, so that errors possibly caused by simple voice communication are avoided. The method can not realize the monitoring and identification of various conditions, articles and personnel in the construction area.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide a vehicle-mounted inspection system of a gas pipeline based on dynamic AI vision, which has high intelligent degree.
In order to achieve the above purpose, the present invention provides the following solutions: the system comprises inspection equipment and terminal equipment, wherein the inspection equipment comprises a camera and a relay processing device, the camera is used for collecting image information of a construction area, the relay processing device comprises a processing module for processing the image information, an alarm module for alarming a monitoring area, an AI (analog to digital) identification unit for identifying and classifying the construction area, a serial port communication module for communicating with the camera, a wireless communication module for communicating with the terminal equipment and a power supply module for supplying power; the terminal equipment is used for receiving information sent by the inspection equipment and remotely controlling the inspection equipment; after the AI identification unit identifies the monitoring area information, the inspection equipment sends the identified video and image to the terminal equipment.
The beneficial effects of the invention are as follows: realize dynamic intelligent identification, this inspection system is through setting up inspection equipment, terminal equipment, wherein, utilize the camera of inspection equipment in order to accurately collect the video and the image of construction region, then carry out discernment through the AI identification cell of inspection equipment to video and the picture that the camera carried, enclose the worker in order to accurately discern the building site, construction machinery, construction tool, gas pipe sign etc., realize on-vehicle dynamic identification inspection, rethread wireless communication module carries the recognition result to terminal equipment, make the staff of terminal equipment department grasp the construction region condition in real time, and can report to the police etc. according to the construction region condition and handle, so as to ensure that the gas pipeline can not be destroyed, realize the intelligent identification of the nearby construction condition of gas pipeline, intelligent degree is high.
Further, a plurality of sensors are arranged in the camera. By adopting the structure, the invention realizes the collection of different types of videos and images.
Further, the information includes one or more of a construction vehicle, a construction article, a covered construction site, a constructor, a miniature construction site, a video and an image of a construction font.
Further, the AI identification unit comprises a first identification module, a second identification module, a third identification module, a fourth identification module, a fifth identification module and a sixth identification module;
the first identification module is used for identifying the engineering vehicle;
the second identification module is used for identifying construction articles;
the third identification module is used for identifying the enclosing construction site;
the fourth identification module is used for identifying constructors;
the fifth identification module is used for identifying a small-sized worksite;
and the sixth identification module is used for identifying the construction fonts.
Further, the AI identification unit includes a target detection algorithm, where the target detection algorithm is used to control the first identification module, the second identification module, the third identification module, the fourth identification module, the fifth identification module, and the sixth identification module to identify the image, and the target detection algorithm includes an input end module, a reference network module, a neg network module, and a Head output layer module, where the input end modules are respectively basic network modules, the reference network module is connected with the neg network module, and the neg network module is connected with the Head output layer module.
Further, the relay processing device further comprises a GPS module, and the GPS module is used for positioning the inspection equipment. After the structure is adopted, the inspection equipment has a positioning function, so that a worker can conveniently control the mobile inspection equipment remotely.
In the invention, the method for identifying the construction area by the inspection system comprises the following steps:
s1, setting a construction area to be monitored in the background, setting coordinates, and monitoring the construction area in real time;
s2, extracting a high-definition image from a video frame sequence shot in a construction area through a camera, and then sending the high-definition image to an AI identification unit through a serial port communication module for identification;
s3, presetting an information comparison image in the background, and then enabling a processing module to operate a first recognition module, a second recognition module, a third recognition module, a fourth recognition module, a fifth recognition module and a sixth recognition module in the AI recognition unit in parallel;
s4, the AI recognition unit performs comparison judgment on the high-definition image and the preset information comparison image based on a target detection algorithm of the depth convolution network, so that dynamic target recognition is completed at the edge end;
s5, sending the identified result to the terminal equipment through the wireless communication module, and controlling the alarm module to alarm by a background personnel according to the result.
Drawings
Fig. 1 is a block diagram of the present invention.
Fig. 2 is a schematic diagram of the objective algorithm of the present invention.
Description of the embodiments
The following description of the embodiments of the present invention will be made more complete and less obvious to those skilled in the art, based on the embodiments of the present invention, for a part, but not all of the embodiments of the present invention, without making any inventive effort.
In the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Referring to fig. 1, a vehicle-mounted inspection system of a gas pipeline based on dynamic AI vision comprises inspection equipment and terminal equipment, wherein the inspection equipment comprises a camera for collecting image information of a construction area and a relay processing device, and the relay processing device comprises a processing module for processing the image information, an alarm module for alarming a monitoring area, an AI (analog input) identification unit for identifying and classifying the construction area, a serial port communication module for communicating with the camera, a wireless communication module for communicating with the terminal equipment and a power supply module for supplying power; the terminal equipment is used for receiving the information sent by the inspection equipment and remotely controlling the inspection equipment; after the AI identification unit identifies the monitoring area information, the inspection equipment sends the identified video and image to the terminal equipment.
In this embodiment, a plurality of sensors are provided in the camera.
In this embodiment, the information includes one or more of a construction vehicle, a construction article, a covered construction site, a constructor, a small construction site, a video and an image of a construction font.
In this embodiment, the AI identification unit includes a first identification module, a second identification module, a third identification module, a fourth identification module, a fifth identification module, and a sixth identification module;
the first identification module is used for identifying the engineering vehicle; engineering vehicles such as pick-up cards, common trucks, box trucks, bulldozers, fork trucks, cranes, road rollers, excavators, concrete trucks, pipe push bench, drilling rigs and the like can be identified.
The second identification module is used for identifying the construction article; construction articles such as construction fence, road cone, iron horse guardrail, anti-collision barrel, ice cream barrel, plastic isolation pier, construction warning board and the like can be identified.
The third identification module is used for identifying the enclosing construction site; articles such as enclosed construction sites and the like, such as blue large fences, can be identified; the enclosing change of the same construction site at different times can be compared and identified.
The fourth identification module is used for identifying constructors; the personnel wearing the safety helmet and wearing the specific clothes can be identified.
The fifth identification module is used for identifying the miniature construction site; the small-sized excavation construction site surrounded by the gas construction fence can be identified.
And the sixth identification module is used for identifying the construction fonts. The warning board with the construction two words and other warning marks can be identified.
In this embodiment, the AI identification unit includes a target detection algorithm, where the target detection algorithm is used to control the first identification module, the second identification module, the third identification module, the fourth identification module, the fifth identification module, and the sixth identification module to identify images, and the target detection algorithm includes an input end module, a reference network module, a neg network module, and a Head output layer module, where the input end modules are respectively basic network modules, the reference network module is connected to the neg network module, and the neg network module is connected to the Head output layer module;
the target detection algorithm adopts a YOLOV5 algorithm, wherein an input end module: in the model training stage, adding functions, mainly comprising the steps of Mosaic data enhancement, self-adaptive anchor frame calculation and self-adaptive picture scaling;
reference network module: fusing partial functions and structures in other detection algorithms, wherein the partial functions and structures mainly comprise a Focus structure and a CSP structure;
the Neck network module: the target detection network often inserts layers between the BackBone and the last Head output layer module, and adds an FPN+PAN structure;
head output layer module: the anchor frame mechanism of the output layer module is the same as that of YOLOv4, and the main improvement is the Loss function giou_loss during training and diou_nms of prediction frame screening.
In this embodiment, the relay processing apparatus further includes a GPS module, where the GPS module is configured to locate the inspection device.
In this embodiment, the method for identifying a construction area by the inspection system includes the following steps:
s1, setting a construction area to be monitored in the background, setting coordinates, and monitoring the construction area in real time.
S2, extracting high-definition images from a video frame sequence shot in a construction area through a camera, enabling a plurality of sensors in the camera to rapidly move different types of videos and pictures in the construction area so as to accurately acquire the high-definition images and the videos, and then sending relevant high-definition images to a processing module through a serial port communication module.
S3, presetting an information comparison image in the background, and then enabling the processing module to operate a first recognition module, a second recognition module, a third recognition module, a fourth recognition module, a fifth recognition module and a sixth recognition module in the AI recognition unit in parallel.
S4, the AI recognition unit is based on a target detection algorithm of the deep convolutional network, and then the first recognition module, the second recognition module, the third recognition module, the fourth recognition module, the fifth recognition module and the sixth recognition module sequentially conduct comparison judgment on the high-definition image and the preset information comparison image, so that dynamic target recognition is completed at the edge end.
S5, sending the identified result to the terminal equipment through the wireless communication module, and controlling the alarm module to alarm by a background personnel according to the result.
The method comprises the steps that a background person can determine the position of the inspection equipment through a GPS module, then the background person can control a vehicle with the inspection equipment to move in a construction area according to the condition of a construction site so as to accurately collect information of the construction area, ensure whether a gas pipeline is damaged or not and give an alarm in time.
The above-described embodiments are merely preferred embodiments of the present invention, and are not intended to limit the present invention in any way. Any person skilled in the art can make many more possible variations and modifications of the technical solution of the present invention or modify equivalent embodiments without departing from the scope of the technical solution of the present invention by using the technical content disclosed above. Therefore, all equivalent changes according to the inventive concept are covered by the protection scope of the invention without departing from the technical scheme of the invention.

Claims (7)

1. The utility model provides a on-vehicle system of patrolling and examining of gas line based on dynamic AI vision, includes equipment, terminal equipment, its characterized in that patrols and examines: the inspection equipment comprises a camera and a relay processing device, wherein the camera is used for collecting image information of a construction area, the relay processing device comprises a processing module used for processing the image information, an alarm module used for alarming a monitoring area, an AI (analog to digital) identification unit used for identifying and classifying the construction area, a serial port communication module used for communicating with the camera, a wireless communication module used for communicating with terminal equipment and a power supply module used for supplying power; the terminal equipment is used for receiving information sent by the inspection equipment and remotely controlling the inspection equipment; after the AI identification unit identifies the monitoring area information, the inspection equipment sends the identified video and image to the terminal equipment.
2. The dynamic AI vision-based gas line vehicle-mounted inspection system of claim 1, wherein: a plurality of sensors are arranged in the camera.
3. The dynamic AI vision-based gas line vehicle-mounted inspection system of claim 2, wherein: the information comprises one or more of a video and an image of an engineering vehicle, a construction article, a surrounding construction site, a constructor, a small construction site and a construction font.
4. The fuel gas line vehicle-mounted inspection system based on dynamic AI vision according to claim 3, wherein: the AI identification unit comprises a first identification module, a second identification module, a third identification module, a fourth identification module, a fifth identification module and a sixth identification module;
the first identification module is used for identifying the engineering vehicle;
the second identification module is used for identifying construction articles;
the third identification module is used for identifying the enclosing construction site;
the fourth identification module is used for identifying constructors;
the fifth identification module is used for identifying a small-sized worksite;
and the sixth identification module is used for identifying the construction fonts.
5. The dynamic AI vision-based on-board inspection system for gas pipelines of claim 4, wherein: the AI recognition unit comprises a target detection algorithm, wherein the target detection algorithm is used for controlling a first recognition module, a second recognition module, a third recognition module, a fourth recognition module, a fifth recognition module and a sixth recognition module to recognize images, the target detection algorithm comprises an input end module, a reference network module, a Neck network module and a Head output layer module, the input end modules are respectively basic network modules, the reference network module is connected with the Neck network module, and the Neck network module is connected with the Head output layer module.
6. The dynamic AI vision-based on-board inspection system for gas pipelines of claim 5, wherein: the relay processing device further comprises a GPS module, wherein the GPS module is used for positioning the inspection equipment.
7. The dynamic AI vision-based on-board inspection system for gas pipelines of claim 6, wherein: the method for identifying the construction area by the inspection system comprises the following steps:
s1, setting a construction area to be monitored in the background, setting coordinates, and monitoring the construction area in real time;
s2, extracting a high-definition image from a video frame sequence shot in a construction area through a camera, and then sending the high-definition image to an AI identification unit through a serial port communication module for identification;
s3, presetting an information comparison image in the background, and then enabling a processing module to operate a first recognition module, a second recognition module, a third recognition module, a fourth recognition module, a fifth recognition module and a sixth recognition module in the AI recognition unit in parallel;
s4, the AI recognition unit performs comparison judgment on the high-definition image and the preset information comparison image based on a target detection algorithm of the depth convolution network, so that dynamic target recognition is completed at the edge end;
s5, sending the identified result to the terminal equipment through the wireless communication module, and controlling the alarm module to alarm by a background personnel according to the result.
CN202310161320.4A 2023-02-24 2023-02-24 Gas pipeline vehicle-mounted inspection system based on dynamic AI vision Pending CN116758465A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310161320.4A CN116758465A (en) 2023-02-24 2023-02-24 Gas pipeline vehicle-mounted inspection system based on dynamic AI vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310161320.4A CN116758465A (en) 2023-02-24 2023-02-24 Gas pipeline vehicle-mounted inspection system based on dynamic AI vision

Publications (1)

Publication Number Publication Date
CN116758465A true CN116758465A (en) 2023-09-15

Family

ID=87959620

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310161320.4A Pending CN116758465A (en) 2023-02-24 2023-02-24 Gas pipeline vehicle-mounted inspection system based on dynamic AI vision

Country Status (1)

Country Link
CN (1) CN116758465A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117372919A (en) * 2023-09-22 2024-01-09 北京市燃气集团有限责任公司 Third party construction threat detection method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117372919A (en) * 2023-09-22 2024-01-09 北京市燃气集团有限责任公司 Third party construction threat detection method and device
CN117372919B (en) * 2023-09-22 2024-07-19 北京市燃气集团有限责任公司 Third party construction threat detection method and device

Similar Documents

Publication Publication Date Title
CN103886189B (en) Patrolling result data processing system and method used for unmanned aerial vehicle patrolling
CN109284739B (en) Power transmission line external damage prevention early warning method and system based on deep learning
CN113203049B (en) Intelligent monitoring and early warning system and method for pipeline safety
CN106954042A (en) A kind of unmanned plane rail track inspection device, system and method
CN110703760B (en) Newly-added suspicious object detection method for security inspection robot
CN112270267A (en) Camera shooting recognition system capable of automatically capturing line faults
CN102496232A (en) Transmission facility monitoring method and system
JP3466169B2 (en) Management system for roads and surrounding facilities
CN113988647A (en) Municipal works wisdom building site management system based on BIM
CN116758465A (en) Gas pipeline vehicle-mounted inspection system based on dynamic AI vision
CN111163294A (en) Building safety channel monitoring system and method for artificial intelligence target recognition
CN114445780A (en) Detection method and device for bare soil covering, and training method and device for recognition model
CN114812403A (en) Large-span steel structure hoisting deformation monitoring method based on unmanned aerial vehicle and machine vision
CN111783579A (en) Unmanned aerial vehicle visual analysis-based detection system for crossing fence by constructors
CN116846059A (en) Edge detection system for power grid inspection and monitoring
CN115880231A (en) Power transmission line hidden danger detection method and system based on deep learning
CN118196624A (en) Intelligent safety helmet identification system and method for construction site
KR101542134B1 (en) The apparatus and method of surveillance a rock fall based on smart video analytic
CN117791864A (en) Remote inspection system for power line
CN117768610A (en) High-speed railway perimeter intrusion risk monitoring method and system based on multi-target recognition
CN117876950A (en) Substation operation behavior management and control method and device based on 3D perimeter analysis
CN210511074U (en) Full-intelligent oil-gas pipeline inspection system based on unmanned aerial vehicle remote sensing and deep learning
CN113359829A (en) Unmanned aerial vehicle power plant intelligent inspection method based on big data
CN116052356A (en) Intelligent building site monitor platform
CN116347274A (en) Method, device and system for searching optical fiber route

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination