CN114998768B - Intelligent construction site management system and method based on unmanned aerial vehicle - Google Patents
Intelligent construction site management system and method based on unmanned aerial vehicle Download PDFInfo
- Publication number
- CN114998768B CN114998768B CN202210625373.2A CN202210625373A CN114998768B CN 114998768 B CN114998768 B CN 114998768B CN 202210625373 A CN202210625373 A CN 202210625373A CN 114998768 B CN114998768 B CN 114998768B
- Authority
- CN
- China
- Prior art keywords
- video
- marker
- unmanned aerial
- model
- aerial vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/17—Terrestrial scenes taken from planes or by drones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Remote Sensing (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses an intelligent construction site management system and method based on an unmanned aerial vehicle, and relates to the field of engineering management, in particular to an intelligent construction site management system and method based on the unmanned aerial vehicle; the system and the method determine coordinates of each key point position in the video by identifying the building in the video and comparing the building with the building in the BIM model, and calculate real-time coordinates of the marker by using the coordinates of each key point position, thereby generating a corresponding marker model in the BIM model; in the system, a large number of cameras are not required to be installed, and monitoring videos can be shot through the arranged unmanned aerial vehicles; and the project manager can directly call the BIM model and the marker model updated in real time, visually know the distribution of constructors and the in-out conditions of vehicles, large-scale equipment and large-scale materials, select a certain marker, quickly check the corresponding moving track and related monitoring videos, and greatly improve the management efficiency and the supervision effect.
Description
Technical Field
The invention relates to the field of engineering management, in particular to an intelligent construction site management system and method based on an unmanned aerial vehicle.
Background
In the construction process of various buildings, the safety inspection of the construction site mainly depends on regular or irregular patrol of safety personnel. Because the scale of the construction engineering is larger and larger, and the structure of the building is more and more complex, personnel can hardly check the surface in place, and careless omission easily occurs, so that the risk exists; some parts of a plurality of buildings are not easy to be close to each other manually, and difficulty is brought to safety inspection.
With the development of unmanned aerial vehicle technology, unmanned aerial vehicle aerial photography has gained more and more wide application, and it has powerful image ability, obtains the image information of high image quality. However, the application of the aerial photography of the unmanned aerial vehicle in engineering projects is still in the perfection stage at present, and how to effectively combine the shooting technology of the unmanned aerial vehicle in safety inspection and project supervision is a problem which is difficult to break through.
Disclosure of Invention
The invention aims to avoid the defects in the prior art and provides an intelligent construction site management system and method based on an unmanned aerial vehicle.
The purpose of the invention is realized by the following technical scheme:
therefore, according to one aspect of the present disclosure, an intelligent building site management method based on an unmanned aerial vehicle is provided, which includes the following steps:
s1: determining the coordinates and the shooting range of the shooting site of each unmanned aerial vehicle;
s2: acquiring a video shot by an unmanned aerial vehicle, identifying buildings in the video, comparing the video with the buildings in the BIM model, and determining coordinates of each key point location in the video;
s3: identifying the attribute of the marker in the video, and calculating the real-time coordinate corresponding to each marker according to the coordinate of each key point in the video;
s4: generating a corresponding marker model in the BIM according to the attribute of each marker and the corresponding real-time coordinate;
s5: and selecting a marker model from the BIM model to obtain a corresponding video.
Specifically, the method further comprises the following steps after the step S2: and cutting the video shot by the unmanned aerial vehicle according to the determined display area to generate a plurality of monitoring videos.
More specifically, step S2 includes the steps of:
s21: acquiring a video shot by an unmanned aerial vehicle, identifying a building, and generating a first building contour line;
s22: calling a corresponding BIM (building information modeling) according to the determined shooting range, and generating a second building contour line;
s23: and comparing the first building contour line with the second building contour line, and determining the coordinates corresponding to each key point in the first building contour line.
Above, the attributes of the marker include: people, vehicle, large-scale equipment and large-scale material, the marker model that corresponds includes: character model, vehicle model, large-scale equipment model and large-scale material model.
Specifically, step S3 includes: if the identified marker is a person, identifying the identity information of the person through AI face identification; and if the identified marker is a vehicle, identifying corresponding license plate number information through AI license plate identification.
As above, the video acquired in step S2 includes a visible light video and a thermal imaging video.
According to another aspect of the present disclosure, there is provided an intelligent building site management device based on an unmanned aerial vehicle, including: the system comprises a data acquisition unit and a terminal server; the data acquisition unit is connected with the terminal server and used for acquiring the video shot by the unmanned aerial vehicle and sending the video to the terminal server; the terminal server includes: the device comprises a storage module, a video cutting module, a matching module, an identification module, a model generation module and a tracking module; the storage module is used for storing the BIM model and videos shot by the unmanned aerial vehicle; the video cutting module is used for cutting videos shot by the unmanned aerial vehicle according to the display area to generate a plurality of monitoring videos; the matching module is used for identifying buildings in the video in a block mode, comparing the buildings with the buildings in the BIM model and determining coordinates of each key point position in the video; the identification module is used for identifying the attributes of the markers in the video and calculating the real-time coordinates corresponding to the markers according to the coordinates of the key point positions in the video; the model generation module is used for generating a corresponding marker model in the BIM according to the attribute of each marker and the corresponding real-time coordinate; the tracking module is used for generating an activity track according to the determined real-time coordinates of each time point of the marker, and calling the corresponding monitoring video according to the time sequence.
Specifically, the video that unmanned aerial vehicle shot includes: visible light video and thermal imaging video;
the terminal server also comprises an alarm module; the alarm module is used for judging whether a fire point exists according to the acquired thermal imaging video.
According to yet another aspect of the present disclosure, there is provided a computing device comprising a memory, a processor and computer instructions stored on the memory and executable on the processor, the processor implementing the steps of a method for unmanned-based intelligent worksite management as described above when executing the instructions.
According to another aspect of the present disclosure, there is provided a computer readable storage medium storing computer instructions which, when executed by a processor, implement the steps of a drone-based intelligent worksite management method as described above.
The invention has the beneficial effects that: a building in a video is identified and compared with a building in a BIM (building information modeling) model, coordinates of each key point position in the video are determined, and real-time coordinates of a marker are calculated by using the coordinates of each key point position, so that a corresponding marker model is generated in the BIM model; in the system, a large number of cameras are not required to be installed, and monitoring videos can be shot through the arranged unmanned aerial vehicles; and the project manager can directly call the BIM model and the marker model updated in real time, visually know the distribution of constructors and the in-out conditions of vehicles, large-scale equipment and large-scale materials, select a certain marker, quickly check the corresponding moving track and related monitoring videos, and greatly improve the management efficiency and the supervision effect.
Drawings
The invention may be better understood by describing exemplary embodiments of the disclosure in conjunction with the following drawings, in which:
FIG. 1 is a schematic flow chart of a method for intelligent site management based on unmanned aerial vehicles according to a first embodiment of the disclosure;
FIG. 2 is a schematic diagram of program modules of an intelligent unmanned-aerial-vehicle-based worksite management apparatus according to an embodiment of the disclosure;
fig. 3 is a schematic diagram illustrating a hardware structure of a computing device according to a first embodiment of the disclosure.
Detailed Description
While specific embodiments of the invention will be described below, it should be noted that in the course of the detailed description of these embodiments, in order to provide a concise and concise description, all features of an actual implementation may not be described in detail. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions are made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Unless otherwise defined, technical or scientific terms used in the claims and the specification should have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The use of "first," "second," and similar terms in the description and claims of the present application do not denote any order, quantity, or importance, but rather the terms are used to distinguish one element from another. The terms "a" or "an," and the like, do not denote a limitation of quantity, but rather denote the presence of at least one. The word "comprise" or "comprises", and the like, means that the element or item listed before "comprises" or "comprising" covers the element or item listed after "comprising" or "comprises" and its equivalent, and does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, nor are they restricted to direct or indirect connections.
Example one
Referring to fig. 1, the present embodiment provides an intelligent building site management method based on an unmanned aerial vehicle, including the following steps:
s1: determining the coordinates and the shooting range of the shooting site of each unmanned aerial vehicle; according to the shooting range and the shooting precision of the camera of the unmanned aerial vehicle, a plurality of unmanned aerial vehicles are arranged on the periphery of the building, the three-dimensional coordinates and the shooting range (corresponding shooting area in the BIM model) of the shooting site corresponding to each unmanned aerial vehicle are determined, and the shooting site of each unmanned aerial vehicle is associated with the corresponding shooting area in the BIM model, so that information between the video shot by the unmanned aerial vehicle and the BIM model is realized. Wherein, in order to facilitate the follow-up location to the marker, each unmanned aerial vehicle can be in the fixed shooting in the position of setting for.
The shooting area corresponding to the shooting site corresponding to each unmanned aerial vehicle in the BIM model is determined through the step S1, so that the matching difficulty of matching the video of the unmanned aerial vehicle and the BIM model in the subsequent step S2 and the complexity of calculation can be effectively simplified.
S2: acquiring a video shot by an unmanned aerial vehicle, identifying buildings in the video, comparing the video with the buildings in the BIM model, and determining coordinates of each key point location in the video; specifically, the step S2 includes the steps of:
s21: acquiring a video shot by an unmanned aerial vehicle, identifying a building, and generating a first building contour line;
s22: calling a corresponding BIM (building information model) according to the determined shooting range, and generating a second building contour line;
s23: and comparing the first building contour line with the second building contour line, and determining the coordinates corresponding to each key point in the first building contour line.
The key points correspond to corner points of the building, i.e. by identifying and matching the corner points on the first building contour line and the second building contour line. Because the three-dimensional coordinates of each corner point on the second building contour line are determined in the BIM model, the coordinates corresponding to each corner point on the first building contour line can be obtained as long as the identification and matching of each corner point on the first building contour line and the second building contour line are completed. In the step S1, since the corresponding shooting area of each shooting site in the BIM model is fixed, the method is simple to calculate and easy to implement, and can effectively ensure the accuracy of the coordinates of each corner point on the first building contour line.
Furthermore, after the coordinates of each corner point on the first building contour line are determined, the coordinates of each point on the first building contour line can be further calculated, so that the subsequent calculation is facilitated.
S31: identifying the attribute of the marker in the video, and calculating the real-time coordinate corresponding to each marker according to the coordinate of each key point in the video; that is, coordinate information is collected for each identified marker in each unit time, so that the corresponding activity track information of each marker is formed.
Specifically, the attributes of the marker include: people, vehicles, large equipment and large materials.
Further, step S31 includes: if the identified marker is a person, identifying the identity information of the person through AI face identification; and if the identified marker is a vehicle, identifying corresponding license plate number information through AI license plate identification.
Additionally, the following steps are included after step S2:
s32: and cutting the video shot by the unmanned aerial vehicle according to the determined display area to generate a plurality of monitoring videos, and calculating the coordinates of four corner points of each monitoring video according to the coordinates of each key point position in the video. The video that the adoption high definition digtal camera of super wide visual angle that unmanned aerial vehicle carried on shot, if look over through direct display, need carry out the managers and zoom the operation, look over very unchangeably. Therefore, the monitoring video is automatically pre-cut by the system through presetting each displayed area to generate the monitoring video, and management personnel can conveniently check the monitoring video.
S4: generating a corresponding marker model in the BIM according to the attribute of each marker and the corresponding real-time coordinate; namely, generating corresponding marker model data in the BIM model data, which comprises: marker attributes, basic body (geometry and color) and real-time coordinates of the model; wherein the marker model comprises: character model, vehicle model, large-scale equipment model and large-scale material model. By combining the basic body of the model corresponding to the attribute of each marker and the corresponding motion trail information obtained in step S31, a dynamic marker model with a real-time motion trail of the model can be generated in the BIM model.
S5: selecting a marker model or a region in the BIM to obtain a corresponding monitoring video;
specifically, the surveillance videos can be matched (the real-time coordinates of the markers belong to the coordinate ranges of the four corners of which surveillance video the real-time coordinates of the markers belong to) according to the real-time coordinates of the markers and the coordinates of the four corners of each surveillance video, and the corresponding surveillance videos are called and spliced according to the moving tracks corresponding to the real-time coordinates of the markers. The manager can quickly view the monitoring video of the activity track related to the marker by selecting the marker.
Additionally, the video obtained in step S2 includes a visible light video and a thermal imaging video; if the construction is night construction, or rainy or foggy weather, in steps S3 to S5, the thermal imaging video is used instead of the visible light video.
With continued reference to fig. 2, an unmanned aerial vehicle-based intelligent worksite management system is illustrated, which in this embodiment may include or be divided into one or more program modules, which are stored in a storage medium and executed by one or more processors, to implement the present invention and a method of unmanned aerial vehicle-based intelligent worksite management as described above. The program module refers to a series of computer program instruction segments capable of achieving specific functions, and is more suitable for describing the execution process of intelligent building site management in a storage medium based on the unmanned aerial vehicle than the program itself. The following description will specifically describe the functions of the program modules of the present embodiment:
an wisdom building site management device based on unmanned aerial vehicle includes: the system comprises a data acquisition unit and a terminal server;
the data acquisition unit is connected with the terminal server and used for acquiring the video shot by the unmanned aerial vehicle and sending the video to the terminal server; the terminal server includes: the device comprises a storage module, an information interaction module, a video cutting module, a matching module, an identification module, a model generation module and a tracking module.
The information interaction module is used for carrying out information interaction with each user side.
The storage module is used for storing the BIM model and videos shot by the unmanned aerial vehicle. Specifically, unmanned aerial vehicle is provided with main camera and thermal imaging camera, is used for shooing visible light video and thermal imaging video respectively.
And the matching module is used for identifying the buildings in the video, comparing the buildings with the buildings in the BIM model and determining the coordinates of each key point in the video.
The video cutting module is used for cutting videos shot by the unmanned aerial vehicle according to the display area to generate a plurality of monitoring videos, and coordinates of four corner points of each monitoring video are calculated according to coordinates of each key point position in the videos. When the engineering management personnel need to check the monitoring video, the monitoring video in the corresponding area can be called only by selecting the corresponding display area in the BIM, and manual zooming is not needed.
The identification module is used for identifying the attributes of the markers in the video and calculating the real-time coordinates corresponding to the markers according to the coordinates of the key point positions in the video. The identification module comprises an AI face identification unit and an AI license plate identification unit, and the AI face identification unit and the AI license plate identification unit are respectively used for identifying identity information of people and license plate information of vehicles.
And the model generation module is used for generating a corresponding marker model in the BIM according to the attribute of each marker and the corresponding real-time coordinate.
The tracking module is used for generating an activity track according to the determined real-time coordinates of each time point of the marker, and calling the corresponding monitoring video according to the time sequence. According to the real-time coordinates of the marker and the coordinates of the four corners of each monitoring video, the monitoring videos can be matched (the real-time coordinates of the marker belong to the coordinate range of the four corners of which monitoring video), and according to the moving track corresponding to the real-time coordinates of the marker, the corresponding monitoring videos are called and spliced, so that automatic video tracking of a certain marker can be realized.
Further, if the identification module identifies large equipment or large materials, the motion track is automatically generated according to the corresponding real-time coordinates, and the corresponding monitoring videos are taken according to the time sequence for cutting and splicing.
The terminal server also comprises an alarm module; the alarm module is used for judging whether a fire point exists according to the acquired thermal imaging video. Specifically, in the alarm module, a corresponding temperature threshold, a time threshold, and a range threshold may be set to identify whether a fire point exists in the video, and if the fire point is determined, an alarm popup may be generated at a user side corresponding to the operator on duty.
The BIM model data and the model and real-time data corresponding to each marker can be called from the terminal server by a manager through the user side and displayed through the user side. The manager can see the real-time distribution of specific characters, vehicles, large-scale equipment and large-scale materials in the displayed three-dimensional BIM model through the user side. Meanwhile, a specific area in the BIM model can be clicked to obtain a corresponding real-time monitoring video, and the corresponding monitoring video can be watched for playback.
Additionally, the manager can input the identity information of the constructors of the management cores through the user side; furthermore, the marked persons can be screened according to the determined identity information of the constructors, so that whether each constructor in the pipe core range enters the construction site for construction or not at present and which building part is located for construction can be quickly and accurately known. Furthermore, a certain constructor can be selected to track the movement track, and related monitoring videos can be quickly acquired, so that the working efficiency and the working state of the constructor can be known, managers can conveniently check or review the construction process of the constructor in time, and whether the work meets the standard requirements and whether illegal operations exist or not can be immediately and timely judged; when a manager guides site construction in a certain building area, the manager can also monitor the construction area with a longer distance in real time, so that a lot of time is not wasted in running in a construction site, and the construction management efficiency and the management quality of the manager can be greatly improved.
The embodiment also provides a computer device, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a rack server, a blade server, a tower server or a rack server (including an independent server or a server cluster composed of a plurality of servers) capable of executing programs, and the like. The computer device 20 of the present embodiment includes at least, but is not limited to: a memory 21, a processor 22, which may be communicatively coupled to each other via a system bus, as shown in FIG. 3. It is noted that fig. 3 only shows the computer device 20 with components 21-22, but it is to be understood that not all shown components are required to be implemented, and that more or less components may alternatively be implemented.
In the present embodiment, the memory 21 (i.e., a readable storage medium) includes a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the storage 21 may be an internal storage unit of the computer device 20, such as a hard disk or a memory of the computer device 20. In other embodiments, the memory 21 may also be an external storage device of the computer device 20, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, provided on the computer device 20. Of course, the memory 21 may also include both internal and external storage devices of the computer device 20. In this embodiment, the memory 21 is generally used for storing an operating system and various application software installed on the computer device 20, such as program codes of the intelligent building site management apparatus based on the unmanned aerial vehicle according to the first embodiment. Further, the memory 21 may also be used to temporarily store various types of data that have been output or are to be output.
Processor 22 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data Processing chip in some embodiments. The processor 22 generally functions to control the overall operation of the computer device 20. In this embodiment, the processor 22 is configured to run the program codes stored in the memory 21 or process data, for example, run an intelligent site management apparatus based on an unmanned aerial vehicle, so as to implement the intelligent site management method based on an unmanned aerial vehicle according to the first embodiment.
The present embodiment also provides a computer-readable storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, a server, an App application store, etc., on which a computer program is stored, which when executed by a processor implements corresponding functions. The computer-readable storage medium of this embodiment is used to store an intelligent building site management apparatus based on an unmanned aerial vehicle, and when executed by a processor, the intelligent building site management method based on an unmanned aerial vehicle of this embodiment is implemented.
In summary, the intelligent building site management system and method based on the unmanned aerial vehicle determine the coordinates of each key point in the video by identifying the building in the video and comparing the building with the building in the BIM model, and calculate the real-time coordinates of the marker by using the coordinates of each key point, so as to generate the corresponding marker model in the BIM model; in the system, a large number of cameras are not required to be installed, and monitoring videos can be shot through the arranged unmanned aerial vehicles; and the project manager can directly call the BIM model and the marker model updated in real time, visually know the distribution of constructors and the in-out conditions of vehicles, large-scale equipment and large-scale materials, select a certain marker, quickly check the corresponding moving track and related monitoring videos, and simultaneously monitor a plurality of construction areas in real time without wasting a large amount of time in the construction site, so that the construction management efficiency and the management quality of the managers can be greatly improved.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps in the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
It will be understood by those skilled in the art that all or part of the steps carried out in the method of implementing the above embodiments may be implemented by hardware related instructions of a program, which may be stored in a computer readable medium, and the program, when executed, includes one or a combination of the steps of the method embodiments.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example" or "some examples" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (9)
1. An intelligent construction site management method based on an unmanned aerial vehicle is characterized by comprising the following steps:
s1: determining the coordinates and the shooting range of the shooting site of each unmanned aerial vehicle;
s2: acquiring a video shot by an unmanned aerial vehicle, identifying buildings in the video, comparing the video with the buildings in the BIM model, and determining coordinates of each key point location in the video;
s3: identifying the attribute of the marker in the video, and calculating the real-time coordinate corresponding to each marker according to the coordinate of each key point in the video;
s4: generating a corresponding marker model in the BIM according to the attribute of each marker and the corresponding real-time coordinate;
s5: selecting a marker model from the BIM model to obtain a corresponding video;
wherein the step S2 further comprises the steps of:
s21: acquiring a video shot by an unmanned aerial vehicle, identifying a building, and generating a first building contour line;
s22: calling a corresponding BIM (building information model) according to the determined shooting range, and generating a second building contour line;
s23: and comparing the first building contour line with the second building contour line, and determining the coordinates corresponding to each key point in the first building contour line.
2. The intelligent building site management method based on unmanned aerial vehicle as claimed in claim 1, wherein step S2 is followed by the following steps:
and cutting the video shot by the unmanned aerial vehicle according to the determined display area to generate a plurality of monitoring videos.
3. An intelligent unmanned-aerial-vehicle-based worksite management method according to claim 1 or 2, comprising:
the attributes of the marker include: people, vehicle, large-scale equipment and large-scale material, the marker model that corresponds includes: character model, vehicle model, large-scale equipment model and large-scale material model.
4. The unmanned-aerial-vehicle-based intelligent worksite management method of claim 3, wherein the step S3 comprises:
if the identified marker is a person, identifying the identity information of the person through AI face identification;
if the identified marker is a vehicle, identifying the corresponding license plate number information through AI license plate identification.
5. An intelligent building site management method based on unmanned aerial vehicle according to claim 1 or 2, characterized in that:
the video acquired in the step S2 comprises a visible light video and a thermal imaging video.
6. An intelligent unmanned-aerial-vehicle-based worksite management device adopting the intelligent unmanned-aerial-vehicle-based worksite management method of any one of claims 1 to 5, comprising: the system comprises a data acquisition unit and a terminal server;
the data acquisition unit is connected with the terminal server and is used for acquiring videos shot by the unmanned aerial vehicle and sending the videos to the terminal server;
the terminal server includes: the device comprises a storage module, a video cutting module, a matching module, an identification module, a model generation module and a tracking module;
the storage module is used for storing a BIM (building information modeling) model and videos shot by the unmanned aerial vehicle;
the video cutting module is used for cutting videos shot by the unmanned aerial vehicle according to a determined display area to generate a plurality of monitoring videos;
the matching module is used for identifying buildings in the video, comparing the buildings with the buildings in the BIM model and determining the coordinates of each key point in the video;
the identification module is used for identifying the attributes of the markers in the video and calculating the real-time coordinates corresponding to the markers according to the coordinates of the key point positions in the video;
the model generation module is used for generating a corresponding marker model in the BIM according to the attribute of each marker and the corresponding real-time coordinate;
the tracking module is used for generating a motion track according to the determined real-time coordinates of each time point of the marker, and calling the corresponding monitoring video according to the time sequence.
7. The intelligent unmanned-aerial-vehicle-based worksite management device of claim 6, wherein:
the video that unmanned aerial vehicle shot includes: visible light video and thermal imaging video;
the terminal server also comprises an alarm module; the alarm module is used for judging whether a fire point exists according to the acquired thermal imaging video.
8. A computing device comprising a memory, a processor and computer instructions stored on the memory and executable on the processor, wherein the processor implements the steps of the method of any one of claims 1 to 5 when executing the instructions.
9. A computer-readable storage medium storing computer instructions, which when executed by a processor, perform the steps of the method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210625373.2A CN114998768B (en) | 2022-06-02 | 2022-06-02 | Intelligent construction site management system and method based on unmanned aerial vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210625373.2A CN114998768B (en) | 2022-06-02 | 2022-06-02 | Intelligent construction site management system and method based on unmanned aerial vehicle |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114998768A CN114998768A (en) | 2022-09-02 |
| CN114998768B true CN114998768B (en) | 2023-04-04 |
Family
ID=83030412
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210625373.2A Active CN114998768B (en) | 2022-06-02 | 2022-06-02 | Intelligent construction site management system and method based on unmanned aerial vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114998768B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117152592B (en) * | 2023-10-26 | 2024-01-30 | 青岛澳西智能科技有限公司 | Building information and fire information visualization system and method |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9070216B2 (en) * | 2011-12-14 | 2015-06-30 | The Board Of Trustees Of The University Of Illinois | Four-dimensional augmented reality models for interactive visualization and automated construction progress monitoring |
| US9942521B2 (en) * | 2012-01-13 | 2018-04-10 | Honeywell International Inc. | Automatic configuration of cameras in building information modeling |
| CN109840600A (en) * | 2018-12-29 | 2019-06-04 | 天津大学 | The feeder channel unmanned plane of BIM auxiliary cooperates with cruising inspection system online |
| CN111192321B (en) * | 2019-12-31 | 2023-09-22 | 武汉市城建工程有限公司 | Target three-dimensional positioning method and device |
| CN111986234A (en) * | 2020-08-20 | 2020-11-24 | 各珍珍 | Self-adaptive resolution ratio livestock video information processing method based on artificial intelligence |
| CN214014375U (en) * | 2020-11-11 | 2021-08-20 | 河南清鸿建设咨询有限公司 | Wisdom building site construction monitoring system based on BIM |
| CN112561987B (en) * | 2020-12-18 | 2023-03-24 | 万翼科技有限公司 | Personnel position display method and related device |
| CN113256269A (en) * | 2021-06-21 | 2021-08-13 | 广东鼎耀工程技术有限公司 | Engineering management system based on BIM, cloud computing and big data technology |
| CN114511592A (en) * | 2022-01-21 | 2022-05-17 | 海纳云物联科技有限公司 | Personnel trajectory tracking method and system based on RGBD camera and BIM system |
-
2022
- 2022-06-02 CN CN202210625373.2A patent/CN114998768B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN114998768A (en) | 2022-09-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Han et al. | Potential of big visual data and building information modeling for construction performance analytics: An exploratory study | |
| CN109978409B (en) | Multi-engineering enterprise-level intelligent construction site block chain management method | |
| CN107392937B (en) | Target tracking method and device and electronic equipment | |
| US20220130145A1 (en) | Systems and methods for generating of 3d information on a user display from processing of sensor data for objects, components or features of interest in a scene and user navigation thereon | |
| CN112929602B (en) | Data monitoring method and device based on image processing and related equipment | |
| Tang et al. | Video-based motion trajectory forecasting method for proactive construction safety monitoring systems | |
| CN112766210A (en) | Safety monitoring method and device for building construction and storage medium | |
| CN114998768B (en) | Intelligent construction site management system and method based on unmanned aerial vehicle | |
| JP7270808B2 (en) | Vehicle parking violation identification method, device, electronic device, storage medium and computer program | |
| Kim | Visual analytics for operation-level construction monitoring and documentation: State-of-the-art technologies, research challenges, and future directions | |
| Assadzadeh et al. | Automatic far‐field camera calibration for construction scene analysis | |
| CN111860522A (en) | Identity card picture processing method and device, terminal and storage medium | |
| CN114186011A (en) | Management method and device based on electronic fence, computer equipment and storage medium | |
| Yang et al. | Automatic detection of falling hazard from surveillance videos based on computer vision and building information modeling | |
| CN115578685A (en) | Three-dimensional model-based area monitoring method, system, equipment and storage medium | |
| CN116229688A (en) | Engineering construction safety risk early warning method and system | |
| CN113469872B (en) | Region display method, device, equipment and storage medium | |
| CN112506155A (en) | PC component production simulation and intelligent control system | |
| CN113742441A (en) | Rapid updating method and system for electronic house map | |
| CN115984516B (en) | Augmented reality method based on SLAM algorithm and related equipment | |
| CN116453061A (en) | Remote pig selling supervision method, device and equipment based on image recognition | |
| CN115982824A (en) | Construction site worker space management method and device, electronic equipment and storage medium | |
| CN111107307A (en) | Video fusion method, system, terminal and medium based on homography transformation | |
| CN112848312B (en) | Method and device for detecting three-dimensional model object, computer equipment and storage medium | |
| CN114170373A (en) | Target object labeling method, processor, device and mixing station |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |