CN114964650A - Gas leakage alarm method and device based on acoustic imaging - Google Patents
Gas leakage alarm method and device based on acoustic imaging Download PDFInfo
- Publication number
- CN114964650A CN114964650A CN202210914554.7A CN202210914554A CN114964650A CN 114964650 A CN114964650 A CN 114964650A CN 202210914554 A CN202210914554 A CN 202210914554A CN 114964650 A CN114964650 A CN 114964650A
- Authority
- CN
- China
- Prior art keywords
- sound pressure
- coordinates
- pressure source
- preset range
- detected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M3/00—Investigating fluid-tightness of structures
- G01M3/02—Investigating fluid-tightness of structures by using fluid or vacuum
- G01M3/04—Investigating fluid-tightness of structures by using fluid or vacuum by detecting the presence of fluid at the leakage point
- G01M3/24—Investigating fluid-tightness of structures by using fluid or vacuum by detecting the presence of fluid at the leakage point using infrasonic, sonic, or ultrasonic vibrations
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/12—Alarms for ensuring the safety of persons responsive to undesired emission of substances, e.g. pollution alarms
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Environmental & Geological Engineering (AREA)
- General Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Emergency Alarm Devices (AREA)
Abstract
The embodiment of the invention provides a gas leakage alarm method and device based on acoustic imaging, wherein the method comprises the following steps: receiving audio data and video data of a region to be detected; calculating a background noise value according to the audio data, and acquiring a fixed sound pressure threshold value to obtain a relative sound pressure intensity threshold value of the area to be detected; acquiring coordinates of a sound pressure source with the maximum sound pressure intensity in the audio data in the image data; judging whether the maximum sound pressure intensity is greater than a relative sound pressure intensity threshold value or not, and when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold value and the exceeding time length exceeds the preset alarm time length, keeping the coordinates of the sound pressure source within the preset range of the image data within the exceeding time length; and generating corresponding image alarm information by combining image data according to the standard exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity. By adopting the method, when the gas leakage is detected, the sound at the leakage position is picked up, the sound source position is judged and displayed in combination with the image, and the gas leakage point can be conveniently determined by personnel through a simple operation mode.
Description
Technical Field
The invention relates to the technical field of acoustic imaging, in particular to a gas leakage alarm method and device based on acoustic imaging.
Background
Along with electron technology's rapid development, more and more gas alarm system also develops to intellectuality, and most gas transportation device, for example gas pipeline when having gas leakage, all have corresponding method to detect to the gas leakage type of difference usually, let that the staff that corresponds can be timely handle gas leakage.
However, the conventional gas leakage detection method has some defects, for example, when gas leaks, sound of gas flow or environmental noise may exist, which may affect the judgment of gas leakage; the judgment of the gas leakage may be affected, for example, when the leakage is detected, the corresponding staff may not be informed of the leakage site clearly in the first time due to the complexity in the gas pipeline.
Disclosure of Invention
Aiming at the problems in the prior art, the embodiment of the invention provides a gas leakage alarm method and device based on acoustic imaging.
The embodiment of the invention provides a gas leakage alarm method based on acoustic imaging, which comprises the following steps:
receiving audio data of a to-be-detected area acquired by a preset microphone module and video data of the to-be-detected area acquired by a preset camera module;
calculating a background noise value of the area to be detected according to the audio data, acquiring a preset fixed sound pressure threshold value of the area to be detected, and calculating a relative sound pressure intensity threshold value of the area to be detected according to the fixed sound pressure threshold value and the background noise value;
acquiring the maximum sound pressure intensity in the current frame in the audio data, and determining the coordinates of a sound pressure source of the maximum sound pressure intensity in the image data by combining the image data of the video data in the current frame;
judging whether the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold or not, and detecting whether the coordinate of the sound pressure source is always within a preset range of image data within the exceeding time length when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold and the exceeding time length is detected to exceed the preset alarm time length in the audio data;
and when the coordinates of the sound pressure source are always within the preset range of the image data, generating corresponding image alarm information according to the standard exceeding time length, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data, and sending the image alarm information to a binding terminal.
In one embodiment, the method further comprises:
when the coordinates of the sound pressure source appear in the preset range and outside the preset range of the image data within the standard exceeding duration, detecting whether the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source within the preset range have a coordinate proximity relation;
when the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source inside the preset range do not have a coordinate adjacent relation, dividing the area to be detected into a plurality of areas according to the coordinates of the sound pressure source inside the preset range and the coordinates of the sound pressure source outside the preset range, and respectively receiving audio data and video data corresponding to the plurality of areas.
In one embodiment, the method further comprises:
and acquiring the number of preset pixels, and detecting whether the number of pixels corresponding to the coordinates of the sound pressure source is less than the number of preset pixels.
In one embodiment, the method further comprises:
obtaining the general sound pressure intensity of the area to be detected, estimating the gas leakage speed according to the general sound pressure intensity and the maximum sound pressure intensity, and estimating the gas leakage quantity according to the gas leakage speed and the standard exceeding duration;
generating corresponding image alarm information according to the standard exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity by combining the image data, wherein the image alarm information comprises:
and generating corresponding image alarm information by combining the image data according to the standard exceeding duration, the coordinates of the sound pressure source, the maximum sound pressure intensity, the gas leakage speed and the gas leakage amount.
In one embodiment, the method further comprises:
calculating the root mean square in the time period corresponding to the audio data as a background noise value;
or selecting a median in a time period corresponding to the audio data as a background noise value;
or selecting the fixed value in the audio data as a background noise value.
The embodiment of the invention provides a gas leakage alarm device based on acoustic imaging, which comprises:
the receiving module is used for receiving audio data of the area to be detected, which is acquired by a preset microphone module, and video data of the area to be detected, which is acquired by a preset camera module;
the calculation module is used for calculating a background noise value of the area to be detected according to the audio data, acquiring a preset fixed sound pressure threshold value of the area to be detected, and calculating a relative sound pressure intensity threshold value of the area to be detected according to the fixed sound pressure threshold value and the background noise value;
the acquisition module is used for acquiring the maximum sound pressure intensity in the current frame in the audio data and determining the coordinates of the sound pressure source of the maximum sound pressure intensity in the image data by combining the image data of the video data in the current frame;
the judging module is used for judging whether the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold or not, and detecting whether the coordinate of the sound pressure source is always within the preset range of the image data within the exceeding time length when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold and the exceeding time length is detected to exceed the preset alarm time length in the audio data;
and the alarm module is used for generating corresponding image alarm information according to the standard exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data when the coordinates of the sound pressure source are always within the preset range of the image data, and sending the image alarm information to the binding terminal.
In one embodiment, the apparatus further comprises:
the detection module is used for detecting whether the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source within the preset range have a coordinate proximity relation when the coordinates of the sound pressure source appear within the preset range and outside the preset range of the image data within the standard exceeding duration;
and the dividing module is used for dividing the area to be detected into a plurality of areas according to the coordinates of the sound pressure source within the preset range and the coordinates of the sound pressure source outside the preset range, and respectively receiving audio data and video data corresponding to the plurality of areas when the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source within the preset range do not have a coordinate proximity relation.
In one embodiment, the apparatus further comprises:
and the second acquisition module is used for acquiring the number of preset pixels and detecting whether the number of pixels corresponding to the coordinates of the sound pressure source is less than the number of preset pixels.
The embodiment of the invention provides electronic equipment, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor executes the program to realize the steps of the gas leakage alarm method based on the acoustic imaging.
Embodiments of the present invention provide a non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor, implements the steps of the above-described gas leak alarm method based on acoustic imaging.
The gas leakage alarm method and device based on acoustic imaging provided by the embodiment of the invention receive audio data of a region to be detected, which is acquired by a preset microphone module, and video data of the region to be detected, which is acquired by a preset camera module; calculating a background noise value of the to-be-detected region according to the audio data, acquiring a preset fixed sound pressure threshold value of the to-be-detected region, and calculating a relative sound pressure intensity threshold value of the to-be-detected region according to the fixed sound pressure threshold value and the background noise value; acquiring the maximum sound pressure intensity in the current frame in the audio data, and determining the coordinates of a sound pressure source of the maximum sound pressure intensity in the image data by combining the image data of the video data in the current frame; judging whether the maximum sound pressure intensity is greater than a relative sound pressure intensity threshold or not, and detecting whether the coordinate of a sound pressure source is always within a preset range of image data within an excessive time when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold and the excessive time when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold is detected to exceed a preset alarm time in audio data; and when the coordinates of the sound pressure source are always within the preset range of the image data, generating corresponding image alarm information according to the standard exceeding time length, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data, and sending the image alarm information to the binding terminal. Therefore, when the gas leakage is detected, the sound of the leakage position can be picked up, the sound source position is judged and displayed by combining the image, the personnel can conveniently determine the gas leakage point by a simple operation mode, and simultaneously, because of the complexity and uncertainty of the existing environmental factors, certain noise exists in the detection environment, so that whether real leakage occurs or not can not be accurately judged under the condition of detecting gas leakage due to the influence of noise and the like, the method can judge whether stable gas leakage occurs at a certain position or not under the influence of environmental background noise, detecting the leakage position for a duration and a stable sound source position to generate accurate gas leakage alarm warning, and further carrying out estimation calculation of leakage quantity and leakage speed and the like on the stable gas leakage alarm source, and finally displaying the result in an image picture for a person to accurately obtain information.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart of a gas leakage alarm method based on acoustic imaging according to an embodiment of the present invention;
FIG. 2 is a block diagram of a gas leakage alarm device based on acoustic imaging according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device in an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart of a gas leakage alarm method based on acoustic imaging according to an embodiment of the present invention, and as shown in fig. 1, a gas leakage alarm method based on acoustic imaging according to an embodiment of the present invention includes:
step S101, receiving audio data of a region to be detected collected by a preset microphone module and video data of the region to be detected collected by a preset camera module.
Specifically, the audio data of the region to be detected collected by the preset microphone module and the video data of the region to be detected collected by the preset camera module are received, wherein the audio data collection can be realized through a front-end microphone or a microphone array, and the video data can be realized through a camera.
Step S102, calculating a background noise value of the area to be detected according to the audio data, acquiring a preset fixed sound pressure threshold value of the area to be detected, and calculating a relative sound pressure intensity threshold value of the area to be detected according to the fixed sound pressure threshold value and the background noise value.
Specifically, a background noise value of the region to be detected is calculated according to the audio data, where the background noise value is the environmental noise of the region to be detected, and the calculation method may be, for example: calculating the root mean square in the time period corresponding to the audio data as a background noise value; selecting a median in a time period corresponding to the audio data as a background noise value; selecting a fixed value in the audio data as a background noise value, then obtaining a preset fixed sound pressure threshold value of the to-be-detected area, wherein the fixed sound pressure threshold value can be a maximum threshold value of the to-be-detected area when gas works, for example, a sound pressure value at the maximum transportation speed in a gas transportation pipeline is the fixed sound pressure threshold value, and calculating according to the fixed sound pressure threshold value and the background noise value to obtain a relative sound pressure intensity threshold value of the to-be-detected area, namely the fixed sound pressure threshold value comprises the maximum threshold value of the environment noise and the gas when the gas works.
Step S103, acquiring the maximum sound pressure intensity in the current frame in the audio data, and determining the coordinates of the sound pressure source of the maximum sound pressure intensity in the image data by combining the image data of the video data in the current frame.
Specifically, the maximum sound pressure intensity of the current frame in the audio data is obtained, where the current frame may be data of each frame in the audio data, or may also be data of the latest frame in the audio data, and the specific position of the sound pressure source of the maximum sound pressure intensity in the image data is determined by combining the image data of the video data in the current frame, so as to determine the coordinate emitting the maximum sound pressure intensity.
And step S104, judging whether the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold, and when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold and the exceeding time length of the maximum sound pressure intensity greater than the relative sound pressure intensity threshold in the audio data exceeds the preset alarm time length, detecting whether the coordinates of the sound pressure source are always within the preset range of the image data within the exceeding time length.
Specifically, whether the maximum sound pressure intensity is greater than a relative sound pressure threshold or not is judged, when the maximum sound pressure intensity is greater than the relative sound pressure threshold, it is indicated that the audio data of the region to be detected is abnormal, whether the exceeding time length of the abnormal audio data in the audio data exceeds a preset alarm time length or not is detected, when the exceeding time length of the abnormal audio data exceeds the preset alarm time length, it is indicated that gas leakage occurs in the region to be detected at a high probability, but the audio data is not abnormal due to some transient burst factors, whether the coordinate of the sound pressure source is always within the preset range of the image data within the exceeding time length is detected, wherein whether the coordinate of the sound pressure source is always within the preset range of the image data is detected, whether the sound source is within a small image range or not is detected, for example, the number of preset pixels is obtained, and whether the number of the pixels corresponding to the coordinate of the sound pressure source is smaller than the number of the preset pixels or not is detected, i.e. whether it is within N pixels.
In addition, when the coordinates of the sound pressure source appear in the preset range of the image data and also appear outside the preset range of the image data within the time length exceeding the standard, whether the coordinates of the sound pressure source outside the preset range are in a coordinate proximity relation with the coordinates of the sound pressure source within the preset range is detected, for example, the coordinates of the sound pressure source outside the preset range are close to or surround the coordinates of the sound pressure source within the preset range, when the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source within the preset range are in a coordinate proximity relation, the range of gas leakage is larger, the preset range is reset, and for example, the preset range is determined according to the sound pressure source; when the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source inside the preset range do not have a coordinate proximity relationship, it is indicated that there may be a plurality of leaks in the region to be detected, the region to be detected needs to be divided into a plurality of regions according to the coordinates of the sound pressure source inside the preset range and the coordinates of the sound pressure source outside the preset range, the audio data and the video data corresponding to the plurality of regions are respectively received, and subsequent gas leakage detection is performed on the plurality of regions again.
And S105, when the coordinates of the sound pressure source are always within the preset range of the image data, generating corresponding image alarm information according to the standard-exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data, and sending the image alarm information to a binding terminal.
Specifically, when the standard-exceeding time length is within, the coordinates of the sound pressure source are always within the preset range of the image data, and it is indicated that gas leakage occurs within the preset range, the information can be identified on the image data according to the standard-exceeding time length (leakage time), the coordinates of the sound pressure source (leakage position), and the maximum sound pressure intensity (leakage severity), in combination with the image data, so as to generate corresponding image alarm information, and the image alarm information is sent to the binding terminal for the reference of the working personnel, so as to deal with the gas leakage in time.
In addition, generating corresponding image alarm information, can also acquire the general sound pressure intensity of waiting to detect the regional during operation at ordinary times, estimate the speed of gas leakage according to general sound pressure intensity and maximum sound pressure intensity, and estimate the gas leakage volume according to gas leakage speed and time length that exceeds standard, then when generating corresponding image alarm information, the speed and the gas leakage volume of sign gas leakage on image data, further let the staff know the on-the-spot leakage condition, for example when the gas is toxic gas, when the gas leakage volume does not reach the certain degree, the staff can get into the scene fast and accomplish on-the-spot rescue, and when the gas leakage volume reaches certain degree, get into the scene and just need make safeguard measure.
The gas leakage alarm method based on acoustic imaging provided by the embodiment of the invention receives audio data of a to-be-detected area acquired by a preset microphone module and video data of the to-be-detected area acquired by a preset camera module; calculating a background noise value of the to-be-detected region according to the audio data, acquiring a preset fixed sound pressure threshold value of the to-be-detected region, and calculating a relative sound pressure intensity threshold value of the to-be-detected region according to the fixed sound pressure threshold value and the background noise value; acquiring the maximum sound pressure intensity in the current frame in the audio data, and determining the coordinates of a sound pressure source of the maximum sound pressure intensity in the image data by combining the image data of the video data in the current frame; judging whether the maximum sound pressure intensity is greater than a relative sound pressure intensity threshold or not, and when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold and the exceeding time length of the maximum sound pressure intensity greater than the relative sound pressure intensity threshold in the audio data exceeds the preset alarm time length, detecting whether the coordinates of a sound pressure source are always in the preset range of the image data within the exceeding time length; when the coordinates of the sound pressure source are always within the preset range of the image data, generating corresponding image alarm information according to the standard-exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data, and sending the image alarm information to the binding terminal. Therefore, when the gas leakage is detected, the sound of the leakage position can be picked up, the sound source position is judged and displayed by combining the image, the personnel can conveniently determine the gas leakage point by a simple operation mode, and simultaneously, because of the complexity and uncertainty of the existing environmental factors, certain noise exists in the detection environment, so that whether real leakage occurs or not can not be accurately judged under the condition of detecting gas leakage due to the influence of noise and the like, the method can judge whether stable gas leakage occurs at a certain position or not under the influence of environmental background noise, detecting the leakage position for a duration and a stable sound source position, generating an accurate gas leakage alarm warning, and further carrying out estimation calculation of leakage quantity and leakage speed and the like on the stable gas leakage alarm source, and finally displaying the result in an image picture for a person to accurately obtain information.
Fig. 2 is a gas leakage alarm device based on acoustic imaging according to an embodiment of the present invention, including: the device comprises a receiving module S201, a calculating module S202, an obtaining module S203, a judging module S204 and an alarming module S205, wherein:
the receiving module S201 is configured to receive audio data of the to-be-detected region collected by the preset microphone module and video data of the to-be-detected region collected by the preset camera module.
The calculating module S202 is configured to calculate a background noise value of the to-be-detected region according to the audio data, obtain a preset fixed sound pressure threshold of the to-be-detected region, and calculate a relative sound pressure threshold of the to-be-detected region according to the fixed sound pressure threshold and the background noise value.
An obtaining module S203, configured to obtain a maximum sound pressure intensity in the current frame in the audio data, and determine, in combination with the image data of the current frame of the video data, a coordinate of a sound pressure source of the maximum sound pressure intensity in the image data.
A determining module S204, configured to determine whether the maximum sound pressure intensity is greater than the relative sound pressure threshold, and when it is detected that an excessive time duration during which the maximum sound pressure intensity is greater than the relative sound pressure threshold exceeds a preset alarm time duration in the audio data, detect whether a coordinate of the sound pressure source is always within a preset range of the image data within the excessive time duration.
And the alarm module S205 is configured to generate corresponding image alarm information according to the standard-exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data when the coordinates of the sound pressure source are always within the preset range of the image data, and send the image alarm information to the binding terminal.
In one embodiment, the apparatus may further comprise:
and the detection module is used for detecting whether the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source within the preset range have a coordinate proximity relation when the coordinates of the sound pressure source appear within the preset range and outside the preset range of the image data within the standard exceeding time length.
And the dividing module is used for dividing the area to be detected into a plurality of areas according to the coordinates of the sound pressure source within the preset range and the coordinates of the sound pressure source outside the preset range, and respectively receiving audio data and video data corresponding to the plurality of areas when the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source within the preset range do not have a coordinate proximity relation.
In one embodiment, the apparatus may further comprise:
and the second acquisition module is used for acquiring the number of preset pixels and detecting whether the number of pixels corresponding to the coordinates of the sound pressure source is less than the number of the preset pixels.
For specific definition of the gas leakage alarm device based on acoustic imaging, reference may be made to the above definition of the gas leakage alarm method based on acoustic imaging, which is not described herein again. The modules in the gas leakage alarm device based on acoustic imaging can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
Fig. 3 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 3: a processor (processor)301, a memory (memory)302, a communication Interface (Communications Interface)303 and a communication bus 304, wherein the processor 301, the memory 302 and the communication Interface 303 complete communication with each other through the communication bus 304. The processor 301 may call logic instructions in the memory 302 to perform the following method: receiving audio data of a to-be-detected area acquired by a preset microphone module and video data of the to-be-detected area acquired by a preset camera module; calculating a background noise value of the to-be-detected region according to the audio data, acquiring a preset fixed sound pressure threshold value of the to-be-detected region, and calculating a relative sound pressure intensity threshold value of the to-be-detected region according to the fixed sound pressure threshold value and the background noise value; acquiring the maximum sound pressure intensity in the current frame in the audio data, and determining the coordinates of a sound pressure source of the maximum sound pressure intensity in the image data by combining the image data of the video data in the current frame; judging whether the maximum sound pressure intensity is greater than a relative sound pressure intensity threshold or not, and detecting whether the coordinate of a sound pressure source is always within a preset range of image data within an excessive time when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold and the excessive time when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold is detected to exceed a preset alarm time in audio data; and when the coordinates of the sound pressure source are always within the preset range of the image data, generating corresponding image alarm information according to the standard exceeding time length, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data, and sending the image alarm information to the binding terminal.
Furthermore, the logic instructions in the memory 302 may be implemented in software functional units and stored in a computer readable storage medium when sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, an embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program is implemented to perform the transmission method provided in the foregoing embodiments when executed by a processor, and for example, the method includes: receiving audio data of a to-be-detected area acquired by a preset microphone module and video data of the to-be-detected area acquired by a preset camera module; calculating a background noise value of the to-be-detected region according to the audio data, acquiring a preset fixed sound pressure threshold value of the to-be-detected region, and calculating a relative sound pressure intensity threshold value of the to-be-detected region according to the fixed sound pressure threshold value and the background noise value; acquiring the maximum sound pressure intensity in the current frame in the audio data, and determining the coordinates of a sound pressure source of the maximum sound pressure intensity in the image data by combining the image data of the video data in the current frame; judging whether the maximum sound pressure intensity is greater than a relative sound pressure intensity threshold or not, and detecting whether the coordinate of a sound pressure source is always within a preset range of image data within an excessive time when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold and the excessive time when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold is detected to exceed a preset alarm time in audio data; when the coordinates of the sound pressure source are always within the preset range of the image data, generating corresponding image alarm information according to the standard-exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data, and sending the image alarm information to the binding terminal.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A gas leakage alarm method based on acoustic imaging is characterized by comprising the following steps:
receiving audio data of a to-be-detected area acquired by a preset microphone module and video data of the to-be-detected area acquired by a preset camera module;
calculating a background noise value of the area to be detected according to the audio data, acquiring a preset fixed sound pressure threshold value of the area to be detected, and calculating a relative sound pressure intensity threshold value of the area to be detected according to the fixed sound pressure threshold value and the background noise value;
acquiring the maximum sound pressure intensity in the current frame in the audio data, and determining the coordinates of a sound pressure source of the maximum sound pressure intensity in the image data by combining the image data of the video data in the current frame;
judging whether the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold or not, and detecting whether the coordinate of the sound pressure source is always within a preset range of image data within the exceeding time length when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold and the exceeding time length is detected to exceed the preset alarm time length in the audio data;
and when the coordinates of the sound pressure source are always within the preset range of the image data, generating corresponding image alarm information according to the standard exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data, and sending the image alarm information to a binding terminal.
2. The acoustic imaging based gas leak warning method according to claim 1, wherein the detecting whether the coordinates of the sound pressure source are always within a preset range of image data within the excessive time period further comprises:
when the coordinates of the sound pressure source appear in the preset range and out of the preset range of the image data within the standard exceeding duration, detecting whether the coordinates of the sound pressure source out of the preset range and the coordinates of the sound pressure source in the preset range have a coordinate proximity relation or not;
when the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source inside the preset range do not have a coordinate adjacent relation, dividing the area to be detected into a plurality of areas according to the coordinates of the sound pressure source inside the preset range and the coordinates of the sound pressure source outside the preset range, and respectively receiving audio data and video data corresponding to the plurality of areas.
3. The acoustic imaging-based gas leak warning method according to claim 1, wherein the detecting whether the coordinates of the sound pressure source are within a preset range of image data includes:
and acquiring the number of preset pixels, and detecting whether the number of pixels corresponding to the coordinates of the sound pressure source is less than the number of the preset pixels.
4. The acoustic imaging based gas leak alarm method of claim 1, further comprising:
obtaining the general sound pressure intensity of the area to be detected, estimating the gas leakage speed according to the general sound pressure intensity and the maximum sound pressure intensity, and estimating the gas leakage quantity according to the gas leakage speed and the standard exceeding duration;
generating corresponding image alarm information according to the standard exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity by combining the image data, wherein the image alarm information comprises:
and generating corresponding image alarm information by combining the image data according to the standard exceeding duration, the coordinates of the sound pressure source, the maximum sound pressure intensity, the gas leakage speed and the gas leakage amount.
5. The gas leakage alarm method based on acoustic imaging according to claim 1, wherein the calculating the noise floor value of the area to be detected according to the audio data comprises:
calculating the root mean square in the time period corresponding to the audio data as a background noise value;
or selecting a median in a time period corresponding to the audio data as a background noise value;
or selecting the fixed value in the audio data as a background noise value.
6. A gas leak alarm device based on acoustic imaging, the device comprising:
the receiving module is used for receiving audio data of the area to be detected, which is acquired by a preset microphone module, and video data of the area to be detected, which is acquired by a preset camera module;
the calculation module is used for calculating a background noise value of the area to be detected according to the audio data, acquiring a preset fixed sound pressure threshold value of the area to be detected, and calculating a relative sound pressure intensity threshold value of the area to be detected according to the fixed sound pressure threshold value and the background noise value;
the acquisition module is used for acquiring the maximum sound pressure intensity in the current frame in the audio data and determining the coordinates of the sound pressure source of the maximum sound pressure intensity in the image data by combining the image data of the video data in the current frame;
the judging module is used for judging whether the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold or not, and detecting whether the coordinate of the sound pressure source is always within the preset range of the image data within the exceeding time length when the maximum sound pressure intensity is greater than the relative sound pressure intensity threshold and the exceeding time length is detected to exceed the preset alarm time length in the audio data;
and the alarm module is used for generating corresponding image alarm information according to the standard exceeding duration, the coordinates of the sound pressure source and the maximum sound pressure intensity in combination with the image data when the coordinates of the sound pressure source are always within the preset range of the image data, and sending the image alarm information to the binding terminal.
7. The acoustic imaging based gas leak warning device as claimed in claim 6, wherein the device further comprises:
the detection module is used for detecting whether the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source within the preset range have a coordinate adjacent relation when the coordinates of the sound pressure source appear within the preset range and outside the preset range of the image data within the standard exceeding duration;
and the dividing module is used for dividing the area to be detected into a plurality of areas according to the coordinates of the sound pressure source within the preset range and the coordinates of the sound pressure source outside the preset range, and respectively receiving audio data and video data corresponding to the plurality of areas when the coordinates of the sound pressure source outside the preset range and the coordinates of the sound pressure source within the preset range do not have a coordinate proximity relation.
8. The acoustic imaging based gas leak warning device as claimed in claim 6, wherein the device further comprises:
and the second acquisition module is used for acquiring the number of preset pixels and detecting whether the number of pixels corresponding to the coordinates of the sound pressure source is less than the number of preset pixels.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program performs the steps of the gas leak alarm method based on acoustic imaging according to any of claims 1 to 5.
10. A non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor implements the steps of the acoustic imaging based gas leak alarm method according to any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210914554.7A CN114964650B (en) | 2022-08-01 | 2022-08-01 | Gas leakage alarm method and device based on acoustic imaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210914554.7A CN114964650B (en) | 2022-08-01 | 2022-08-01 | Gas leakage alarm method and device based on acoustic imaging |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114964650A true CN114964650A (en) | 2022-08-30 |
| CN114964650B CN114964650B (en) | 2022-11-18 |
Family
ID=82968687
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210914554.7A Active CN114964650B (en) | 2022-08-01 | 2022-08-01 | Gas leakage alarm method and device based on acoustic imaging |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114964650B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115615624A (en) * | 2022-12-13 | 2023-01-17 | 杭州兆华电子股份有限公司 | Equipment leakage detection method and system based on unmanned inspection device |
| CN115655631A (en) * | 2022-12-12 | 2023-01-31 | 杭州兆华电子股份有限公司 | Method and device for detecting voiceprint in wind tunnel environment based on hydraulic generator |
| CN115662083A (en) * | 2022-12-12 | 2023-01-31 | 杭州兆华电子股份有限公司 | Unmanned inspection type alarm system and method based on acoustic imaging |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB1452788A (en) * | 1972-11-06 | 1976-10-13 | Exxon Research Engineering Co | Acoustic leak location and detection system and method |
| KR20090122131A (en) * | 2008-05-22 | 2009-11-26 | 경희대학교 산학협력단 | Leak monitoring system using vision and acoustic information |
| KR101399881B1 (en) * | 2013-03-28 | 2014-05-27 | 현대제철 주식회사 | Apparatus for detecting air leakage in sinter process |
| CN105351756A (en) * | 2015-11-23 | 2016-02-24 | 杨璐馨 | Pipeline leakage recognizing and positioning system and method based on sound wave imaging |
| JP2017175474A (en) * | 2016-03-24 | 2017-09-28 | パナソニックＩｐマネジメント株式会社 | Monitoring system and monitoring method |
| CN107223332A (en) * | 2015-03-19 | 2017-09-29 | 英特尔公司 | Audio-visual scene analysis based on acoustics camera |
| CN109642937A (en) * | 2016-09-23 | 2019-04-16 | 杰富意钢铁株式会社 | The orientation calibration device of ultrasound source and the analysis method for being overlapped image |
| CN110830771A (en) * | 2019-11-11 | 2020-02-21 | 广州国音智能科技有限公司 | Intelligent monitoring method, device, equipment and computer readable storage medium |
| CN113592773A (en) * | 2021-06-25 | 2021-11-02 | 东莞市鑫泰仪器仪表有限公司 | Wireless acoustic imaging method and device for valve leakage monitoring |
| CN114323481A (en) * | 2021-12-31 | 2022-04-12 | 北京卫星环境工程研究所 | Gas multi-source leakage sound image localization method and sound image localization system |
| CN114495975A (en) * | 2022-01-27 | 2022-05-13 | 贵州盘江煤层气开发利用有限责任公司 | Abnormal sound source positioning method and device based on sound pressure amplitude ratio |
| CN114563141A (en) * | 2022-02-25 | 2022-05-31 | 中国建筑标准设计研究院有限公司 | Active detection method for sealing performance and leak point position of doors |
-
2022
- 2022-08-01 CN CN202210914554.7A patent/CN114964650B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB1452788A (en) * | 1972-11-06 | 1976-10-13 | Exxon Research Engineering Co | Acoustic leak location and detection system and method |
| KR20090122131A (en) * | 2008-05-22 | 2009-11-26 | 경희대학교 산학협력단 | Leak monitoring system using vision and acoustic information |
| KR101399881B1 (en) * | 2013-03-28 | 2014-05-27 | 현대제철 주식회사 | Apparatus for detecting air leakage in sinter process |
| CN107223332A (en) * | 2015-03-19 | 2017-09-29 | 英特尔公司 | Audio-visual scene analysis based on acoustics camera |
| CN105351756A (en) * | 2015-11-23 | 2016-02-24 | 杨璐馨 | Pipeline leakage recognizing and positioning system and method based on sound wave imaging |
| JP2017175474A (en) * | 2016-03-24 | 2017-09-28 | パナソニックＩｐマネジメント株式会社 | Monitoring system and monitoring method |
| CN109642937A (en) * | 2016-09-23 | 2019-04-16 | 杰富意钢铁株式会社 | The orientation calibration device of ultrasound source and the analysis method for being overlapped image |
| CN110830771A (en) * | 2019-11-11 | 2020-02-21 | 广州国音智能科技有限公司 | Intelligent monitoring method, device, equipment and computer readable storage medium |
| CN113592773A (en) * | 2021-06-25 | 2021-11-02 | 东莞市鑫泰仪器仪表有限公司 | Wireless acoustic imaging method and device for valve leakage monitoring |
| CN114323481A (en) * | 2021-12-31 | 2022-04-12 | 北京卫星环境工程研究所 | Gas multi-source leakage sound image localization method and sound image localization system |
| CN114495975A (en) * | 2022-01-27 | 2022-05-13 | 贵州盘江煤层气开发利用有限责任公司 | Abnormal sound source positioning method and device based on sound pressure amplitude ratio |
| CN114563141A (en) * | 2022-02-25 | 2022-05-31 | 中国建筑标准设计研究院有限公司 | Active detection method for sealing performance and leak point position of doors |
Non-Patent Citations (2)
| Title |
|---|
| SAJJAD AHMAD 等: "A Method for Pipeline Leak Detection Based on Acoustic Imaging and Deep Learning", 《SENSORS》 * |
| 熊超辉 等: "基于声成像的气体泄漏源定位技术研究", 《2018全国声学设计创新技术与文化建筑声学工程学术会议》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115655631A (en) * | 2022-12-12 | 2023-01-31 | 杭州兆华电子股份有限公司 | Method and device for detecting voiceprint in wind tunnel environment based on hydraulic generator |
| CN115662083A (en) * | 2022-12-12 | 2023-01-31 | 杭州兆华电子股份有限公司 | Unmanned inspection type alarm system and method based on acoustic imaging |
| CN115655631B (en) * | 2022-12-12 | 2023-04-07 | 杭州兆华电子股份有限公司 | Method and device for detecting voiceprint in wind tunnel environment based on hydraulic generator |
| CN115615624A (en) * | 2022-12-13 | 2023-01-17 | 杭州兆华电子股份有限公司 | Equipment leakage detection method and system based on unmanned inspection device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114964650B (en) | 2022-11-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114964650B (en) | Gas leakage alarm method and device based on acoustic imaging | |
| CN110475124B (en) | Video jamming detection method and device | |
| JP2017536764A5 (en) | ||
| CN113470018B (en) | Hub defect identification method, electronic device, device and readable storage medium | |
| CN108109132A (en) | A kind of image analysis method and device | |
| CN102740121A (en) | Video quality diagnosis control system and method applied to video monitoring network | |
| CN113762229B (en) | Intelligent identification method and system for building equipment in building site | |
| CN113505643A (en) | Violation target detection method and related device | |
| CN115731165A (en) | Detection system and method for lithium battery online size point inspection | |
| CN113344906B (en) | Camera evaluation method and device in vehicle-road cooperation, road side equipment and cloud control platform | |
| CN116721516A (en) | Early warning method, device and storage medium based on video monitoring | |
| CN113807209B (en) | Parking space detection method and device, electronic equipment and storage medium | |
| JP2007315911A (en) | Lightning electric field amount calculation device and method, program, computer-readable recording medium | |
| CN114204680B (en) | Multi-type automatic detection equipment fusion remote diagnosis system and method | |
| CN114550256A (en) | Method, device and equipment for detecting tiny target and computer readable medium | |
| JP2000121539A (en) | Particle monitor system and particle detection method and recording medium storing particle detection program | |
| CN115457530A (en) | External damage prevention method, external damage prevention device and external damage prevention system for power transmission line | |
| CN115683046A (en) | Distance measuring method, distance measuring device, sensor and computer readable storage medium | |
| CN115131315A (en) | Image change detection method, device, equipment and storage medium | |
| CN114708193A (en) | Powder leakage detection method and device for soft connection device, electronic equipment and storage medium | |
| CN112529829B (en) | Training method and device for burr positioning and burr detection model | |
| CN113340352A (en) | Valve hall monitoring method, device and system | |
| CN114913243B (en) | Distortion detection method, device and medium for optical material | |
| CN114331956A (en) | Pipeline detection method and device, electronic equipment and storage medium | |
| JP2005106744A (en) | Image analysis apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |