CN116030428A - Method and device for monitoring danger alarm of construction site area - Google Patents
Method and device for monitoring danger alarm of construction site area Download PDFInfo
- Publication number
- CN116030428A CN116030428A CN202310327757.0A CN202310327757A CN116030428A CN 116030428 A CN116030428 A CN 116030428A CN 202310327757 A CN202310327757 A CN 202310327757A CN 116030428 A CN116030428 A CN 116030428A
- Authority
- CN
- China
- Prior art keywords
- information
- scene
- scene graph
- filtering
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000010276 construction Methods 0.000 title claims abstract description 39
- 238000012544 monitoring process Methods 0.000 title claims abstract description 23
- 238000001914 filtration Methods 0.000 claims abstract description 85
- 238000001514 detection method Methods 0.000 claims abstract description 26
- 230000008859 change Effects 0.000 claims abstract description 18
- 238000012545 processing Methods 0.000 claims abstract description 15
- 230000003287 optical effect Effects 0.000 claims description 15
- 238000000605 extraction Methods 0.000 claims description 11
- 230000000750 progressive effect Effects 0.000 claims description 9
- 238000012806 monitoring device Methods 0.000 claims description 8
- 230000006870 function Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 8
- 238000003860 storage Methods 0.000 description 8
- 230000001960 triggered effect Effects 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 229910052744 lithium Inorganic materials 0.000 description 3
- 239000002893 slag Substances 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000013135 deep learning Methods 0.000 description 2
- 238000010304 firing Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Image Analysis (AREA)
Abstract
The invention relates to a method and a device for monitoring hazard alarm of a construction site area, comprising the following steps: disposing a hazard detection device in a to-be-detected construction site area so as to detect the area layout of the construction site area in real time through the hazard detection device; acquiring a scene graph of a construction site area according to the area layout, identifying scene information in the scene graph, and extracting information features of the scene information; tracking the change information of the scene information in real time, updating the characteristic information in real time to obtain updated characteristic information, and performing filtering processing on the updated characteristic information to obtain filtering information; inquiring the state of the targets in the filtering information, calculating the relative distance between all the targets in the filtering information, judging the dangerous coefficient of all the targets in the filtering information by combining the state of the targets and the relative distance, and triggering an alarm instruction in the dangerous alarm device when the dangerous coefficient is larger than a preset condition so as to perform real-time early warning on the construction area through the alarm instruction. The invention can improve the dangerous monitoring efficiency of the construction site area.
Description
Technical Field
The invention relates to the field of safety precaution, in particular to a method and a device for monitoring dangerous alarms in a construction area.
Background
The informatization degree of the construction site area is low, intelligent management is weak, and supervision areas are small, so that many potential safety hazards existing in the construction site area cannot be well solved, accidents happen sometimes, and therefore a method for efficiently detecting dangerous situations of the construction site area is needed, and accordingly an alarm is sent out timely to avoid damage to lives and properties.
At present, a dangerous alarm method for a construction site area is generally based on a target positioning method to be detected, and the method is mainly based on a visual image algorithm and a multi-sensor fusion algorithm, however, the process of target determination by using the method is complex and environmental information cannot be fully utilized, so that the positioning efficiency of the target to be detected is low, and the detection efficiency of dangerous situations of the construction site area is low.
Disclosure of Invention
In order to solve the technical problems, the invention provides a method for monitoring the danger of a construction site area, which can improve the efficiency of monitoring the danger of the construction site area.
In a first aspect, the present invention provides a method for monitoring a hazard alarm in a worksite region, comprising:
disposing a hazard detection device in a to-be-detected site area so as to detect the area layout of the site area in real time through the hazard detection device;
acquiring a scene graph of the site area according to the area layout, identifying scene information in the scene graph, and extracting information features of the scene information;
tracking the change information of the scene information in real time, updating the characteristic information in real time to obtain updated characteristic information, and performing filtering processing on the updated characteristic information to obtain filtering information;
inquiring the state of the targets in the filtering information, calculating the relative distance between all the targets in the filtering information, judging the risk coefficient of all the targets in the filtering information by combining the state of the targets and the relative distance, and triggering an alarm instruction in a risk alarm device when the risk coefficient is larger than a preset condition so as to perform real-time early warning on the site area through the alarm instruction.
In a possible implementation manner of the first aspect, the acquiring the region layout includes acquiring the region layout
A scene graph of a worksite region comprising:
dividing the to-be-detected construction site area into a plurality of component parts according to the area layout, and extracting target parts in the component parts;
collecting the optical signal of the target part to obtain a target optical signal, converting the target optical signal into an electric signal, and converting the electric signal into an analog signal;
and compiling the analog signal to obtain a scene graph of the site area.
In a possible implementation manner of the first aspect, the identifying scene information in the scene graph includes:
carrying out graying treatment on the scene graph to obtain a gray scene graph, and carrying out binarization on the gray scene graph to obtain a binarized scene graph;
denoising the binarized scene graph to obtain a denoised scene graph, performing image enhancement on the denoised scene graph to obtain an enhanced scene graph, and reading scene information in the enhanced scene graph.
In a possible implementation manner of the first aspect, the extracting information features of the scene information includes:
performing region division on the scene graph of the scene information to obtain a division scene graph, and performing standardization processing on the division scene graph to obtain a standard scene graph;
calculating pixel gradients in the standard scene graph, and forming the pixel gradients into different areas according to gradient sizes to obtain a plurality of pixel areas;
and extracting pixel characters in the pixel areas, and connecting the pixel characters to obtain information characteristics of the scene information.
In a possible implementation manner of the first aspect, the real-time tracking of the change information of the scene information includes:
extracting an information target corresponding to the scene information, and positioning the information target to obtain positioning target information;
and acquiring the positioning target information image in real time, and updating the positioning target information image in real time in a database corresponding to the scene information to obtain the change information of the scene information.
In a possible implementation manner of the first aspect, the filtering the updated feature information to obtain filtering information includes:
and filtering the updated characteristic information by using the following formula:
wherein ,
representing filtering information, n representing the number of pixels of the updated feature information, x representing the pixel x in the updated feature information, y representing the pixel y in the updated feature information,/-, and>
representing the mean filter function>
Representing the original pixel area of the updated characteristic information.
In a possible implementation manner of the first aspect, the querying the target state in the filtering information includes:
extracting continuous frames of a target in the filtering information, initializing a cluster center of the continuous frames, and correcting the cluster center to obtain a corrected cluster center;
and constructing a space progressive model of a corresponding information target in the filtering information according to the modified clustering center, and detecting the movement of the information target by using the space progressive model to obtain a target state in the filtering information.
In a second aspect, the present invention provides a worksite area hazard alarm monitoring device, the device comprising:
the device deployment module is used for deploying a hazard detection device in a to-be-detected site area so as to detect the area layout of the site area in real time through the hazard detection device;
the feature extraction module is used for collecting a scene graph of the construction site area according to the area layout, identifying scene information in the scene graph and extracting information features of the scene information;
the information filtering module is used for tracking the change information of the scene information in real time, updating the characteristic information in real time to obtain updated characteristic information, and filtering the updated characteristic information to obtain filtering information;
and the danger alarm module is used for inquiring the state of the targets in the filtering information, calculating the relative distance between all the targets in the filtering information, judging the danger coefficient of all the targets in the filtering information by combining the state of the targets and the relative distance, and triggering an alarm instruction in the danger alarm device when the danger coefficient is greater than a preset condition so as to perform real-time early warning on the site area through the alarm instruction.
Compared with the prior art, the technical principle and beneficial effect of this scheme lie in:
according to the technical scheme, firstly, a hazard detection device is deployed in a to-be-detected building site area, so that the area layout of the building site area can be detected in real time through the hazard detection device, a basic technical support can be made for hazard monitoring of the to-be-detected building site area, further, safety conditions and hazard real-time alarming of the building site area are monitored in real time, all information of the building site area can be known by collecting a scene graph of the building site area according to the area layout, and further, effective information existing in a current scene of the building site area is identified according to the scene graph;
secondly, the embodiment of the invention can know various objects existing in the to-be-detected construction area currently by identifying the scene information in the scene graph so as to facilitate the subsequent extraction of target objects, and can know the specificity and uniqueness of the targets corresponding to the scene information by extracting the information characteristics of the scene information so as to facilitate the real-time tracking and observation according to the characteristics of the targets; the situation that targets are lost or identity is misplaced due to the fact that the targets are mutually blocked by the change information of the scene information is tracked in real time;
furthermore, in the embodiment of the invention, by filtering the updated characteristic information, the obtained filtering information can filter unnecessary information to prevent the excessive information from causing recognition influence on the current target, and judging the dangerous coefficients of all targets in the filtering information by combining the target state and the relative distance, so that whether all targets in the filtering information are in a dangerous state or not can be known, and a dangerous alarm is triggered according to the dangerous coefficients, and when the dangerous coefficients are larger than a preset condition, a warning instruction in a dangerous alarm device is triggered, so that real-time early warning of the construction area can be performed through the warning instruction to timely give out an alarm prompt, accidents are prevented, and loss of life and property is avoided.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a schematic flow chart of a method for monitoring a hazard alarm in a worksite area according to an embodiment of the present invention;
FIG. 2 is a schematic block diagram of a worksite area hazard alarm monitoring device according to an embodiment of the present invention;
fig. 3 is a schematic diagram of an internal structure of an electronic device for implementing a method for monitoring a hazard alarm in a worksite according to an embodiment of the present invention.
Detailed Description
It should be understood that the detailed description is presented by way of example only and is not intended to limit the invention.
The embodiment of the invention provides a method for monitoring hazard in a construction site area, and an execution subject of the method for monitoring hazard in the construction site area comprises at least one of electronic equipment which can be configured to execute the method provided by the embodiment of the invention, such as a server side, a terminal and the like. In other words, the worksite region hazard alarm monitoring method may be performed by software or hardware installed at a terminal device or a server device, and the software may be a blockchain platform. The service end includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, and the like. The server may be an independent server, or may be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms.
Referring to fig. 1, a flow chart of a method for monitoring a hazard alarm in a construction area according to an embodiment of the invention is shown. The method for monitoring the danger alarm of the construction area depicted in fig. 1 comprises the following steps S1-S4:
s1, disposing a hazard detection device in a to-be-detected site area so as to detect the area layout of the site area in real time through the hazard detection device.
According to the embodiment of the invention, the danger detection device is deployed in the to-be-detected building site area, so that the area layout of the building site area can be detected in real time by the danger detection device, a basic technical support can be made for the danger monitoring of the to-be-detected building site area, and the safety condition and the danger of the building site area can be monitored in real time.
The dangerous monitoring device comprises an image acquisition instrument, an alarm, an image processor, an information storage device and the like, and the regional layout refers to the spatial layout of the to-be-detected construction site region, such as a manual passage, fire-fighting equipment, a rest area, a parking point of the construction site equipment, a working place and the like.
S2, acquiring a scene graph of the construction site area according to the area layout, identifying scene information in the scene graph, and extracting information features of the scene information.
According to the embodiment of the invention, all information of the site area can be known by collecting the scene graph of the site area according to the area layout, and further, effective information existing in the current scene of the site area is identified according to the scene graph.
As one embodiment of the present invention, the acquiring the scene graph of the worksite region according to the region layout includes: dividing the to-be-detected construction site area into a plurality of component parts according to the area layout, extracting target parts in the component parts, collecting optical signals of the target parts to obtain target optical signals, converting the target optical signals into electric signals, converting the electric signals into analog signals, and compiling the analog signals to obtain a scene graph of the construction site area.
The target part refers to a region to be detected in a work area, such as a work area equipment operation region and a region with potential safety hazards, and in addition, the work area is not in a detection range, such as a rest region, the optical signal refers to a signal source of a scene, the electric signal refers to a signal taking current, voltage and magnetic waves as carriers, is a carrier for transmitting information to a computer, and the analog signal refers to information expressed by continuously-changing physical quantities, so that visual reaction can be performed in the computer.
Optionally, the to-be-detected construction site area is divided into a plurality of component parts according to the area layout and according to a preset interval distribution rule, the extracting of the target parts in the component parts is achieved through an extraction script generated by java language, the optical signals of the target parts are collected through a ccd image sensor, the conversion of the target optical signals into electric signals is achieved through a photosensitive tube, the conversion of the electric signals into analog signals is achieved through an optical fiber transceiver, and the compiling of the analog signals is achieved through binary codes.
Further, according to the embodiment of the invention, various objects existing in the to-be-detected field area can be known through the identification of the scene information in the scene graph, so that the target object can be extracted later.
As one embodiment of the present invention, the identifying scene information in the scene graph includes: and carrying out graying treatment on the scene graph to obtain a gray scene graph, carrying out binarization on the gray scene graph to obtain a binarization scene graph, denoising the binarization scene graph to obtain a denoising scene graph, carrying out image enhancement on the denoising scene graph to obtain an enhancement scene graph, and reading scene information in the enhancement scene graph.
The image enhancement is to enhance the characteristics in the image so as to facilitate the identification of the image information.
Optionally, the gray level processing of the scene graph is implemented by a component method, the binarizing of the gray level scene graph is implemented by a binary function, the binary function is generated by Java, the binarized scene graph is denoised by a linear filtering method, the linear filtering method is generated by a linear filter, the denoised scene graph is enhanced by a frequency domain method, and the reading of the scene information gaussian filter in the enhanced scene graph is implemented.
According to the embodiment of the invention, the specificity and the uniqueness of the target corresponding to the scene information can be known by extracting the information characteristics of the scene information, so that real-time tracking and observation can be realized according to the characteristics of the target.
As an embodiment of the present invention, the extracting information features of the scene information includes: dividing a scene graph of the scene information into areas to obtain a divided scene graph, carrying out standardization processing on the divided scene graph to obtain a standard scene graph, calculating pixel gradients in the standard scene graph, forming different areas by the pixel gradients according to gradient sizes to obtain a plurality of pixel areas, extracting pixel characters in the pixel areas, and connecting the pixel characters to obtain information features of the scene information.
The method comprises the steps of dividing a scene graph of scene information into 16 areas through a mean value clustering algorithm of a deep learning network, forming different areas by pixel gradients according to gradient sizes through a sift algorithm, extracting pixel characters in the pixel areas through a character extraction script, generating the character extraction script by java, and connecting the pixel characters through a character connecting tool.
As an optional embodiment of the invention, the normalizing the partitioning scene graph includes:
and carrying out standardization processing on the division scene graph by using the following formula:
wherein 
Representing a standard scene graph, y representing pixel points y, which divide the scene graph,/-for>
A dot value representing the pixel point y.
Further, in yet another alternative embodiment of the present invention, the calculating the pixel gradient in the standard scene graph includes:
pixel gradients in the standard scene graph are calculated using the following formula:
wherein ,
representing pixel gradient +.>
Representing the limit function, f representing the gradient magnitude of the pixel gradient, x representing the gradient vector, and p representing the pixel point p in the standard scene graph.
S3, tracking the change information of the scene information in real time, updating the feature information in real time to obtain updated feature information, and performing filtering processing on the updated feature information to obtain filtering information.
The invention can prevent the situation of losing the target or miscut of identity and the like caused by mutual shielding among multiple targets by tracking the change information of the scene information in real time.
The change information refers to different states of the scene information corresponding to the moving or running target, which are expressed at different times.
As one embodiment of the present invention, the real-time tracking of the change information of the scene information includes: extracting an information target corresponding to the scene information, positioning the information target to obtain positioning target information, collecting the positioning target information image in real time, and updating the positioning target information image in real time in a database corresponding to the scene information to obtain the change information of the scene information.
Optionally, the information targets corresponding to the scene information are extracted through feature extraction, the positioning of the information targets is realized through a human image positioning instrument, the positioning target information images are acquired through an image acquisition instrument,
furthermore, in the embodiment of the invention, the feature information is updated in real time to obtain updated feature information, so that the information of the target in the scene graph can be updated timely, and the error in judging the target caused by untimely information updating is prevented.
As an optional embodiment of the invention, the feature information is updated in real time, and the updated feature information is obtained by continuously identifying and outputting the feature information in real time through a convolution layer in the deep learning network.
Furthermore, in the embodiment of the invention, the filtering information is obtained by filtering the updated characteristic information, so that unnecessary information can be filtered out, and the condition that the excessive information causes the recognition influence on the current target is prevented. Wherein, the filtering refers to eliminating specific wave frequency bands in the signal.
As an embodiment of the present invention, the filtering the updated feature information to obtain filtered information includes:
and filtering the updated characteristic information by using the following formula:
wherein ,
representing filtering information, n representing the number of pixels of the updated feature information, x representing the pixel x in the updated feature information, y representing the pixel y in the updated feature information,/-, and>
representing the mean filter function>
Representing the original pixel area of the updated characteristic information.
S4, inquiring the state of the targets in the filtering information, calculating the relative distance between all the targets in the filtering information, judging the dangerous coefficient of all the targets in the filtering information by combining the state of the targets and the relative distance, and triggering a warning instruction in a dangerous warning device when the dangerous coefficient is larger than a preset condition so as to perform real-time warning on the site area through the warning instruction.
According to the embodiment of the invention, the behavior of the target can be known through the state of the target by inquiring the target state in the filtering information, so that whether the target in the target scene has dangerous conditions or not can be judged.
The target state refers to a state where a target is currently located, such as a state where a person is walking, and a state where a machine is running.
As one embodiment of the present invention, the querying the target state in the filtering information includes: extracting continuous frames of a target in the filtering information, initializing a cluster center of the continuous frames, and correcting the cluster center to obtain a corrected cluster center; and constructing a space progressive model of a corresponding information target in the filtering information according to the modified clustering center, and detecting the movement of the information target by using the space progressive model to obtain a target state in the filtering information.
The continuous frames refer to continuous image frames, the clustering center refers to aggregation of similar points in the images, and the spatial progressive model refers to an algorithm function.
Optionally, the continuous frames of the target in the filtering information are extracted by a python language generated image frame extraction tool, a spatial progressive model of the corresponding information target in the filtering information is constructed by a deep neural network, and the motion detection of the information target by using the spatial progressive model is implemented by an optical flow method, and it is noted that the optical flow method is a relatively mature technology at present, so that details are not repeated here.
Further, in yet another alternative embodiment of the present invention, the modifying the cluster center includes:
the cluster center is modified using the following formula:
wherein ,
represents a modified cluster center, n represents the number of consecutive frames of the cluster center, +.>
Euclidean distance +.>
A matrix representing the cluster center, i representing the i-th center point in the cluster center,j represents the j coordinate point of the cluster center, < +.>
Representing the extremum formula.
Furthermore, the embodiment of the invention can calculate the relative distances of all targets in the filtering information conveniently by calculating the relative distances.
As an embodiment of the present invention, the calculating the relative distances of all objects in the filtering information includes:
the relative distances of all targets in the filtered information are calculated using the following formula:
wherein ,
representing the relative distance of all objects in the filter information, n representing the dimension of the filter image of the filter information, x representing the corresponding object x in the filter image, y representing the corresponding object y in the filter image,/->
Representing the pixel point corresponding to the target x in the filtered image, and y represents the pixel point corresponding to the target y in the filtered image.
According to the embodiment of the invention, the risk coefficients of all the targets in the filtering information can be judged by combining the target states and the relative distances, so that whether all the targets in the filtering information are in the risk states or not can be known, and a risk alarm can be triggered according to the risk coefficients.
The risk factor is determined based on the detected current state of the target, such as being active, and is determined to be dangerous when the distance is not greater than the safe distance from the device in operation.
According to the further embodiment of the invention, when the danger coefficient is larger than the preset condition, the warning instruction in the danger warning device is triggered, so that the real-time warning of the site area can be performed through the warning instruction, warning reminding can be timely sent out, accidents are prevented, and loss of lives and properties is avoided. The risk coefficient may be set to 1, or may be set according to an actual application scenario.
Further, as an optional embodiment of the present invention, the triggering of the alarm command in the hazard alarm device to perform real-time early warning of the site area through the alarm command receives the real-time alarm of the alarm command through the alarm device in the hazard detection device.
According to the technical scheme, firstly, a hazard detection device is deployed in a to-be-detected building site area, so that the area layout of the building site area can be detected in real time through the hazard detection device, a basic technical support can be made for hazard monitoring of the to-be-detected building site area, the safety condition and hazard real-time alarm of the building site area are monitored in real time, all information of the building site area can be known by collecting a scene graph of the building site area according to the area layout, and effective information existing in a current scene of the building site area is identified according to the scene graph; secondly, the embodiment of the invention can know various objects existing in the to-be-detected construction area currently by identifying the scene information in the scene graph so as to facilitate the subsequent extraction of target objects, and can know the specificity and uniqueness of the targets corresponding to the scene information by extracting the information characteristics of the scene information so as to facilitate the real-time tracking and observation according to the characteristics of the targets; the situation that targets are lost or identity is misplaced due to the fact that the targets are mutually blocked by the change information of the scene information is tracked in real time; furthermore, in the embodiment of the invention, by filtering the updated characteristic information, the obtained filtering information can filter unnecessary information to prevent the excessive information from causing recognition influence on the current target, and judging the dangerous coefficients of all targets in the filtering information by combining the target state and the relative distance, so that whether all targets in the filtering information are in a dangerous state or not can be known, and a dangerous alarm is triggered according to the dangerous coefficients, and when the dangerous coefficients are larger than a preset condition, a warning instruction in a dangerous alarm device is triggered, so that real-time early warning of the construction area can be performed through the warning instruction to timely give out an alarm prompt, accidents are prevented, and loss of life and property is avoided. Therefore, the method for monitoring the danger alarm of the construction site area can improve the efficiency of monitoring the danger alarm of the construction site area.
As shown in fig. 2, a functional block diagram of the hazard warning and monitoring device for a work area according to the present invention is shown.
The worksite region hazard alarm monitoring device 200 of the present invention may be installed in an electronic apparatus. Depending on the functions implemented, the worksite area hazard alarm monitoring device may include a device deployment module 201, a feature extraction module 202, an information filtering module 203, and a hazard alarm module 204.
The module of the invention, which may also be referred to as a unit, refers to a series of computer program segments, which are stored in the memory of the electronic device, capable of being executed by the processor of the electronic device and of performing a fixed function.
In the embodiment of the present invention, the functions of each module/unit are as follows:
the device deployment module 201 is configured to deploy a hazard detection device in a site area to be detected, so as to detect an area layout of the site area in real time through the hazard detection device;
the feature extraction module 202 is configured to collect a scene graph of the site area according to the area layout, identify scene information in the scene graph, and extract information features of the scene information;
the information filtering module 203 is configured to track the change information of the scene information in real time, update the feature information in real time to obtain updated feature information, and perform filtering processing on the updated feature information to obtain filtering information;
the hazard alarm module 204 is configured to query a target state in the filtering information, calculate relative distances between all targets in the filtering information, and determine hazard coefficients of all targets in the filtering information by combining the target state and the relative distances, and trigger an alarm instruction in the hazard alarm device when the hazard coefficients are greater than a preset condition, so as to perform real-time early warning of the site area through the alarm instruction.
In detail, the modules in the construction site area hazard alarm monitoring device 200 in the embodiment of the present invention use the same technical means as the construction site area hazard alarm monitoring method described in fig. 1, and can produce the same technical effects, which are not described herein.
Fig. 3 is a schematic structural diagram of an electronic device for implementing the method for monitoring the danger alarm of the construction area according to the present invention.
The electronic device may include a processor 30, a memory 31, a communication bus 32, and a communication interface 33, and may also include a computer program, such as a fired lithium slag forging program, stored in the memory 31 and executable on the processor 30.
The processor 30 may be formed by an integrated circuit in some embodiments, for example, a single packaged integrated circuit, or may be formed by a plurality of integrated circuits packaged with the same function or different functions, including one or more central processing units (Central Processing Unit, CPU), a microprocessor, a digital processing chip, a graphics processor, a combination of various control chips, and so on. The processor 30 is a Control Unit (Control Unit) of the electronic device, connects various components of the entire electronic device using various interfaces and lines, and executes various functions of the electronic device and processes data by running or executing programs or modules (e.g., executing a firing lithium slag forging program, etc.) stored in the memory 31, and calling data stored in the memory 31.
The memory 31 includes at least one type of readable storage medium including flash memory, a removable hard disk, a multimedia card, a card memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, etc. The memory 31 may in some embodiments be an internal storage unit of the electronic device, such as a mobile hard disk of the electronic device. The memory 31 may also be an external storage device of the electronic device in other embodiments, for example, a plug-in mobile hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the electronic device. Further, the memory 31 may also include both an internal storage unit and an external storage device of the electronic device. The memory 31 may be used not only for storing application software installed in an electronic device and various data such as codes of a firing lithium slag forging program, etc., but also for temporarily storing data that has been output or is to be output.
The communication bus 32 may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus, or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, among others. The bus may be classified as an address bus, a data bus, a control bus, etc. The bus is arranged to enable a connection communication between the memory 31 and at least one processor 30 or the like.
The communication interface 33 is used for communication between the electronic device and other devices, including a network interface and a user interface. Optionally, the network interface may include a wired interface and/or a wireless interface (e.g., WI-FI interface, bluetooth interface, etc.), typically used to establish a communication connection between the electronic device and other electronic devices. The user interface may be a Display (Display), an input unit such as a Keyboard (Keyboard), or alternatively a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, or the like. The display may also be referred to as a display screen or display unit, as appropriate, for displaying information processed in the electronic device and for displaying a visual user interface.
Fig. 3 shows only an electronic device with components, and it will be understood by those skilled in the art that the structure shown in fig. 3 is not limiting of the electronic device and may include fewer or more components than shown, or may combine certain components, or a different arrangement of components.
The present invention also provides a computer readable storage medium storing a computer program which, when executed by a processor of an electronic device, can implement the method of:
disposing a hazard detection device in a to-be-detected site area so as to detect the area layout of the site area in real time through the hazard detection device;
acquiring a scene graph of the site area according to the area layout, identifying scene information in the scene graph, and extracting information features of the scene information;
tracking the change information of the scene information in real time, updating the characteristic information in real time to obtain updated characteristic information, and performing filtering processing on the updated characteristic information to obtain filtering information;
inquiring the state of the targets in the filtering information, calculating the relative distance between all the targets in the filtering information, judging the risk coefficient of all the targets in the filtering information by combining the state of the targets and the relative distance, and triggering an alarm instruction in a risk alarm device when the risk coefficient is larger than a preset condition so as to perform real-time early warning on the site area through the alarm instruction.
The foregoing is only a specific embodiment of the invention to enable those skilled in the art to understand or practice the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for hazard alarm monitoring in a worksite area, the method comprising:
disposing a hazard detection device in a to-be-detected site area so as to detect the area layout of the site area in real time through the hazard detection device;
acquiring a scene graph of the site area according to the area layout, identifying scene information in the scene graph, and extracting information features of the scene information;
tracking the change information of the scene information in real time, updating the characteristic information in real time to obtain updated characteristic information, and performing filtering processing on the updated characteristic information to obtain filtering information;
inquiring the state of the targets in the filtering information, calculating the relative distance between all the targets in the filtering information, judging the risk coefficient of all the targets in the filtering information by combining the state of the targets and the relative distance, and triggering an alarm instruction in a risk alarm device when the risk coefficient is larger than a preset condition so as to perform real-time early warning on the site area through the alarm instruction.
2. The method of claim 1, wherein the acquiring a scene graph of the worksite region according to the region layout comprises:
dividing the to-be-detected construction site area into a plurality of component parts according to the area layout, and extracting target parts in the component parts;
collecting the optical signal of the target part to obtain a target optical signal, converting the target optical signal into an electric signal, and converting the electric signal into an analog signal;
and compiling the analog signal to obtain a scene graph of the site area.
3. The method of claim 1, wherein the identifying scene information in the scene graph comprises:
carrying out graying treatment on the scene graph to obtain a gray scene graph, and carrying out binarization on the gray scene graph to obtain a binarized scene graph;
denoising the binarized scene graph to obtain a denoised scene graph, performing image enhancement on the denoised scene graph to obtain an enhanced scene graph, and reading scene information in the enhanced scene graph.
4. The method of claim 1, wherein the extracting information features of the scene information comprises:
performing region division on the scene graph of the scene information to obtain a division scene graph, and performing standardization processing on the division scene graph to obtain a standard scene graph;
calculating pixel gradients in the standard scene graph, and forming the pixel gradients into different areas according to gradient sizes to obtain a plurality of pixel areas;
and extracting pixel characters in the pixel areas, and connecting the pixel characters to obtain information characteristics of the scene information.
5. The method of claim 1, wherein the real-time tracking of the change information of the scene information comprises:
extracting an information target corresponding to the scene information, and positioning the information target to obtain positioning target information;
and acquiring the positioning target information image in real time, and updating the positioning target information image in real time in a database corresponding to the scene information to obtain the change information of the scene information.
6. The method of claim 1, wherein filtering the updated characteristic information to obtain filtered information comprises:
and filtering the updated characteristic information by using the following formula:
wherein ,
representing filtering information, n representing pixel point of updated characteristic informationThe number, x, represents the pixel x in the updated feature information, and y represents the pixel y,/in the updated feature information>
Representing the mean filter function>
Representing the original pixel area of the updated characteristic information.
7. The method of claim 1, wherein said querying the target state in the filtered information comprises:
extracting continuous frames of a target in the filtering information, initializing a cluster center of the continuous frames, and correcting the cluster center to obtain a corrected cluster center;
and constructing a space progressive model of a corresponding information target in the filtering information according to the modified clustering center, and detecting the movement of the information target by using the space progressive model to obtain a target state in the filtering information.
8. The method of claim 1, wherein said calculating the relative distances of all objects in the filtered information comprises:
the relative distances of all targets in the filtered information are calculated using the following formula:
wherein ,
representing the relative distance of all objects in the filter information, n representing the dimension of the filter image of the filter information, x representing the corresponding object x in the filter image, y representing the corresponding object y in the filter image,/->
Representation filteringAnd the pixel point corresponding to the target x in the image, and y represents the pixel point corresponding to the target y in the filtered image.
9. The method of claim 4, wherein said normalizing said partitioned scene graph comprises:
and carrying out standardization processing on the division scene graph by using the following formula:
wherein 
Representing a standard scene graph, y representing pixel points y, which divide the scene graph,/-for>
A dot value representing the pixel point y.
10. A worksite area hazard alarm monitoring device, the device comprising:
the device deployment module is used for deploying a hazard detection device in a to-be-detected site area so as to detect the area layout of the site area in real time through the hazard detection device;
the feature extraction module is used for collecting a scene graph of the construction site area according to the area layout, identifying scene information in the scene graph and extracting information features of the scene information
The information filtering module is used for tracking the change information of the scene information in real time, updating the characteristic information in real time to obtain updated characteristic information, and filtering the updated characteristic information to obtain filtering information;
and the danger alarm module is used for inquiring the state of the targets in the filtering information, calculating the relative distance between all the targets in the filtering information, judging the danger coefficient of all the targets in the filtering information by combining the state of the targets and the relative distance, and triggering an alarm instruction in the danger alarm device when the danger coefficient is greater than a preset condition so as to perform real-time early warning on the site area through the alarm instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310327757.0A CN116030428B (en) | 2023-03-30 | 2023-03-30 | Method and device for monitoring danger alarm of construction site area |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310327757.0A CN116030428B (en) | 2023-03-30 | 2023-03-30 | Method and device for monitoring danger alarm of construction site area |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116030428A true CN116030428A (en) | 2023-04-28 |
| CN116030428B CN116030428B (en) | 2023-06-30 |
Family
ID=86076316
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310327757.0A Active CN116030428B (en) | 2023-03-30 | 2023-03-30 | Method and device for monitoring danger alarm of construction site area |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116030428B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6005625A (en) * | 1994-08-22 | 1999-12-21 | Nec Corporation | Method and system for processing data on motion pictures by motion compensation combined with image segmentation |
| CN103985138A (en) * | 2014-05-14 | 2014-08-13 | 苏州盛景空间信息技术有限公司 | Long-sequence image SIFT feature point tracking algorithm based on Kalman filter |
| US20190360177A1 (en) * | 2017-02-17 | 2019-11-28 | Sumitomo Heavy Industries, Ltd. | Surroundings monitoring system for work machine |
| CN111563474A (en) * | 2020-05-18 | 2020-08-21 | 北京茵沃汽车科技有限公司 | Obstacle detection method and system based on vehicle-mounted fisheye lens under motion background |
| CN112799339A (en) * | 2020-12-31 | 2021-05-14 | 西南石油大学 | Method for early warning workers and dynamic danger sources based on machine vision technology |
| CN114463932A (en) * | 2022-01-14 | 2022-05-10 | 国网江苏省电力工程咨询有限公司 | Non-contact construction safety distance active dynamic recognition early warning system and method |
| CN115272425A (en) * | 2022-08-29 | 2022-11-01 | 中铁云网信息科技有限公司 | Railway construction site area intrusion detection method and system based on three-dimensional point cloud |
| CN115866658A (en) * | 2023-02-06 | 2023-03-28 | 湖北工业大学 | Traffic prediction method and system based on dynamic spatiotemporal hypergraph convolutional network |
-
2023
- 2023-03-30 CN CN202310327757.0A patent/CN116030428B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6005625A (en) * | 1994-08-22 | 1999-12-21 | Nec Corporation | Method and system for processing data on motion pictures by motion compensation combined with image segmentation |
| CN103985138A (en) * | 2014-05-14 | 2014-08-13 | 苏州盛景空间信息技术有限公司 | Long-sequence image SIFT feature point tracking algorithm based on Kalman filter |
| US20190360177A1 (en) * | 2017-02-17 | 2019-11-28 | Sumitomo Heavy Industries, Ltd. | Surroundings monitoring system for work machine |
| CN111563474A (en) * | 2020-05-18 | 2020-08-21 | 北京茵沃汽车科技有限公司 | Obstacle detection method and system based on vehicle-mounted fisheye lens under motion background |
| CN112799339A (en) * | 2020-12-31 | 2021-05-14 | 西南石油大学 | Method for early warning workers and dynamic danger sources based on machine vision technology |
| CN114463932A (en) * | 2022-01-14 | 2022-05-10 | 国网江苏省电力工程咨询有限公司 | Non-contact construction safety distance active dynamic recognition early warning system and method |
| CN115272425A (en) * | 2022-08-29 | 2022-11-01 | 中铁云网信息科技有限公司 | Railway construction site area intrusion detection method and system based on three-dimensional point cloud |
| CN115866658A (en) * | 2023-02-06 | 2023-03-28 | 湖北工业大学 | Traffic prediction method and system based on dynamic spatiotemporal hypergraph convolutional network |
Non-Patent Citations (1)
| Title |
|---|
| 高寒 等: "基于机器视觉的施工危险区域侵入行为识别方法", 《土木工程与管理学报》, pages 123 - 128 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116030428B (en) | 2023-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9940509B2 (en) | Object detection method and object detection apparatus | |
| CN106952303B (en) | Vehicle distance detection method, device and system | |
| KR101897923B1 (en) | System for providing identify target object based on neural network learning model, method thereof, and computer readable storage having the same | |
| CN108229353B (en) | Human body image classification method and apparatus, electronic device, storage medium, and program | |
| CN110533699B (en) | Dynamic multi-frame velocity measurement method for pixel change based on optical flow method | |
| CN112784725B (en) | Pedestrian anti-collision early warning method, device, storage medium and stacker | |
| CN113255626B (en) | Intelligent tower crane structure state detection method and device based on scanned image analysis | |
| CN112132216B (en) | Vehicle type recognition method and device, electronic equipment and storage medium | |
| CN111582032A (en) | Pedestrian detection method and device, terminal equipment and storage medium | |
| Srividhya et al. | [Retracted] A Machine Learning Algorithm to Automate Vehicle Classification and License Plate Detection | |
| CN114241370A (en) | Intrusion identification method and device based on digital twin transformer substation and computer equipment | |
| CN114049568A (en) | Object shape change detection method, device, equipment and medium based on image comparison | |
| CN115995037A (en) | Signal lamp state detection method, device, equipment, medium and product | |
| CN113569812A (en) | Unknown obstacle identification method and device and electronic equipment | |
| CN116030428B (en) | Method and device for monitoring danger alarm of construction site area | |
| Irhebhude et al. | Speed breakers, road marking detection and recognition using image processing techniques | |
| CN115578431B (en) | Image depth processing method and device, electronic equipment and medium | |
| CN110222652B (en) | Pedestrian detection method and device and electronic equipment | |
| CN116311000A (en) | Firework detection method, device, equipment and storage medium | |
| CN116933002A (en) | Action detection method and device, terminal equipment and storage medium | |
| CN116822929A (en) | Alarm method, alarm device, electronic equipment and storage medium | |
| CN114708498A (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
| CN113792671A (en) | Method and device for detecting face synthetic image, electronic equipment and medium | |
| CN112861711A (en) | Regional intrusion detection method and device, electronic equipment and storage medium | |
| CN113420631A (en) | Safety alarm method and device based on image recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |