CN115396640A - Firework setting-off safety monitoring system and method - Google Patents
Firework setting-off safety monitoring system and method Download PDFInfo
- Publication number
- CN115396640A CN115396640A CN202211348185.6A CN202211348185A CN115396640A CN 115396640 A CN115396640 A CN 115396640A CN 202211348185 A CN202211348185 A CN 202211348185A CN 115396640 A CN115396640 A CN 115396640A
- Authority
- CN
- China
- Prior art keywords
- setting
- firework
- acousto
- monitoring
- optic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 108
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000008859 change Effects 0.000 claims abstract description 75
- 238000004364 calculation method Methods 0.000 claims abstract description 7
- 238000000605 extraction Methods 0.000 claims description 18
- 230000002194 synthesizing effect Effects 0.000 claims description 6
- 238000013075 data extraction Methods 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 abstract description 7
- 238000012806 monitoring device Methods 0.000 description 22
- 238000004880 explosion Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 3
- 244000025254 Cannabis sativa Species 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000000843 powder Substances 0.000 description 1
- 239000002994 raw material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B17/00—Fire alarms; Alarms responsive to explosion
- G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
- G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/012—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using recorded signals, e.g. speech
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Alarm Systems (AREA)
Abstract
The invention is suitable for the technical field of data transmission, and particularly relates to a firework setting-off safety monitoring system and a method, wherein the method comprises the following steps: acquiring video monitoring data corresponding to a fixed ignition point, wherein the video monitoring data at least comprises three groups of fixed point monitoring videos; recording acousto-optic data in the fixed point monitoring video to generate an acousto-optic change curve; extracting the firework setting-off characteristics according to the acousto-optic change curve, and judging whether setting-off monitoring is carried out or not; and calculating the position of the firework set-off point, generating the over-range set-off position information, and giving an alarm. The method and the device have the advantages that the fixed setting-off point is subjected to video monitoring, so that whether the firework is set off or not is determined according to the obtained sound information and video picture information, the setting-off position of the firework is further calculated, whether the setting-off place of the firework is in the safe range or not is determined according to the calculation result, and therefore an alarm is given when the setting-off position exceeds the safe range, the setting-off safety of the firework is greatly improved, and the convenience is greatly improved.
Description
Technical Field
The invention belongs to the technical field of data transmission, and particularly relates to a firework setting-off safety monitoring system and method.
Background
The fireworks are also called fireworks, fireworks and firecracker, and defined according to the standard-safety and quality of Chinese fireworks and crackers as follows: the firework powder is used as a raw material for producing the acousto-optic color entertainment products. The invention is invented earlier by people working in China, and is often used in ceremonies or performances.
As many people set off firecrackers anywhere, the firecrackers can be cleaned up by sanitation workers the next day later. Once the flame is not extinguished, the trees and grass which are thoroughly dried are very easy to ignite under the long-time drought condition in the current northern area, and a fire disaster occurs.
In order to solve the safety problem of fireworks setting off, the firework setting off device is usually designed in a mode of setting a fixed setting off point, but is difficult to monitor all the set-off persons, and the safety is difficult to guarantee.
Disclosure of Invention
The embodiment of the invention aims to provide a firework setting-off safety monitoring method, and aims to solve the problems that all set-off persons are difficult to monitor and the safety is difficult to guarantee in a fixed setting-off point mode.
The embodiment of the invention is realized in such a way that a firework setting-off safety monitoring method comprises the following steps:
acquiring video monitoring data corresponding to a fixed ignition point, wherein the video monitoring data at least comprises three groups of fixed point monitoring videos;
recording acousto-optic data in the fixed point monitoring video to generate an acousto-optic change curve;
extracting the firework setting-off characteristics according to the acousto-optic change curve, and judging whether setting-off monitoring is carried out or not;
and calculating the position of the firework setting-off point, generating information of the setting-off position exceeding the range, and giving an alarm.
Preferably, the step of recording the acousto-optic data in the fixed-point monitoring video to generate an acousto-optic change curve specifically includes:
analyzing the fixed-point monitoring video, and extracting audio data and video data;
generating a sound characteristic curve according to the audio data;
and generating a brightness change curve according to the video data, and synthesizing an acousto-optic change curve according to the sound characteristic curve and the brightness change curve, wherein the acousto-optic change curve takes time as a horizontal axis.
Preferably, the step of extracting the firework setting-off characteristics according to the acousto-optic change curve and judging whether setting-off monitoring is performed specifically comprises:
extracting audio features according to the acousto-optic change curve, identifying the audio features, and judging whether specific sound features exist or not;
extracting picture features according to the acousto-optic change curve, judging the features of the picture, and judging whether specific picture features exist or not;
and obtaining the firework setting-off characteristics according to the specific sound characteristics and the specific picture characteristics, and judging whether setting-off monitoring is carried out or not.
Preferably, the step of calculating the position of the firework setting off point, generating the over-range setting off position information, and giving an alarm specifically comprises:
determining the corresponding relation between the specific sound characteristics and the specific picture characteristics to form a characteristic pair;
calculating the time difference of the specific sound characteristic and the specific picture characteristic in the characteristic pair, and calculating the setting-off distance according to the time difference and a preset parameter;
and constructing a three-dimensional model according to the setting-off distance, generating the over-range setting-off position information, and giving an alarm.
Preferably, when the position of the firework ignition point does not exceed the preset range, no alarm is given.
Preferably, the alarm is issued by voice and notifies a manager.
Another object of an embodiment of the present invention is to provide a firework setting-off safety monitoring system, which includes:
the data acquisition module is used for acquiring video monitoring data corresponding to the fixed set-off point, and the video monitoring data at least comprises three groups of fixed point monitoring videos;
the acousto-optic recording module is used for recording acousto-optic data in the fixed point monitoring video to generate an acousto-optic change curve;
the monitoring and judging module is used for extracting the firework setting-off characteristics according to the acousto-optic change curve and judging whether setting-off monitoring is carried out or not;
and the over-range alarm module is used for calculating the position of the firework set-off point, generating over-range set-off position information and giving an alarm.
Preferably, the acousto-optic recording module includes:
the data extraction unit is used for analyzing the fixed-point monitoring video and extracting audio data and video data;
the audio characteristic extraction unit is used for generating a sound characteristic curve according to the audio data;
and the picture characteristic extraction unit is used for generating a brightness change curve according to the video data and synthesizing an acousto-optic change curve according to the sound characteristic curve and the brightness change curve, wherein the acousto-optic change curve takes time as a horizontal axis.
Preferably, the monitoring and determining module includes:
the first characteristic identification unit is used for extracting audio characteristics according to the acousto-optic change curve, identifying the audio characteristics and judging whether specific sound characteristics exist or not;
the second characteristic identification unit is used for extracting picture characteristics according to the acousto-optic change curve, judging the characteristics of the picture characteristics and judging whether specific picture characteristics exist or not;
and the characteristic judging unit is used for obtaining the firework setting-off characteristics according to the specific sound characteristics and the specific picture characteristics and judging whether setting-off monitoring is carried out or not.
Preferably, the out-of-range alarm module comprises:
the feature matching unit is used for determining the corresponding relation between the specific sound features and the specific picture features to form feature pairs;
the distance calculation unit is used for calculating the time difference of the specific sound characteristic and the specific picture characteristic in the characteristic pair and calculating the setting-off distance according to the time difference and preset parameters;
and the setting-off warning unit is used for constructing a three-dimensional model according to the setting-off distance, generating the over-range setting-off position information and giving an alarm.
According to the firework setting-off safety monitoring method provided by the embodiment of the invention, the fixed setting-off point is subjected to video monitoring, so that whether the firework is set off or not is determined according to the obtained sound information and video picture information, the position of the firework setting-off point is further calculated, and whether the firework setting-off point is in the safety range or not is determined according to the calculation result, so that an alarm is given when the setting-off position exceeds the safety range, the firework setting-off safety is greatly improved, and the convenience is greatly improved.
Drawings
Fig. 1 is a flowchart of a firework setting-off safety monitoring method according to an embodiment of the invention;
FIG. 2 is a flowchart illustrating steps of recording acousto-optic data in a fixed-point surveillance video and generating an acousto-optic change curve according to an embodiment of the present invention;
FIG. 3 is a flowchart of the steps of extracting the setting-off characteristics of the fireworks according to the acousto-optic variation curve and determining whether to perform setting-off monitoring according to the embodiment of the invention;
FIG. 4 is a flowchart of the steps of calculating the position of the set-off point of the fireworks, generating the over-range set-off position information, and issuing an alarm according to the embodiment of the present invention;
fig. 5 is an architecture diagram of a firework setting-off safety monitoring system according to an embodiment of the invention;
FIG. 6 is a diagram illustrating an architecture of an acousto-optic recording module according to an embodiment of the present invention;
fig. 7 is an architecture diagram of a monitoring and determining module according to an embodiment of the present invention;
fig. 8 is an architecture diagram of an out-of-range alarm module according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the invention.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements should not be limited by these terms unless otherwise specified. These terms are only used to distinguish one element from another. For example, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script, without departing from the scope of the present application.
As many people set off firecrackers anywhere, the firecrackers can be cleaned up by sanitation workers the next day later. Once the flame is not extinguished, the trees and grass which are thoroughly dried are very easy to ignite under the long-time drought condition in the current northern area, and a fire disaster occurs. In order to solve the safety problem that fireworks were touched off, solve through the mode that sets up fixed set off point usually, but be difficult to monitor all the people who set off, the security is difficult to the guarantee.
The method and the device have the advantages that the fixed setting-off point is subjected to video monitoring, so that whether the firework is set off or not is determined according to the obtained sound information and video picture information, the position of the setting-off point of the firework is further calculated, whether the setting-off point of the firework is in the safe range or not is determined according to the calculation result, and therefore an alarm is given when the setting-off position exceeds the safe range, the safety of setting off the firework is greatly improved, and the convenience is greatly improved.
As shown in fig. 1, a flowchart of a firework setting-off safety monitoring method provided in an embodiment of the present invention is shown, where the method includes:
s100, video monitoring data corresponding to the fixed set-off point is obtained, and the video monitoring data at least comprises three groups of fixed point monitoring videos.
In the step, video monitoring data corresponding to the fixed set-off point is obtained, monitoring devices are arranged at the set-off positions, the fixed set-off points are shot by the monitoring devices, the sky part is shot when the fixed set-off points are shot, at least three groups of monitoring devices are arranged for determining the set-off positions of fireworks, the three groups of monitoring devices form a triangle, three groups of fixed-point monitoring videos can be obtained when the set-point monitoring devices work, and the fixed-point monitoring videos contain the audio information obtained through recording.
S200, recording acousto-optic data in the fixed point monitoring video to generate an acousto-optic change curve.
In the step, the acousto-optic data in the fixed-point monitoring video is recorded, and in the firework setting-off process, huge explosion sound and bright firework can be generated, so that the brightness information in the picture is recorded in real time, the sound information is synchronously recorded, the time is taken as a horizontal axis, and the brightness and the sound are taken as vertical axes, so that two groups of curves are drawn, namely acousto-optic change curves are obtained, and whether the firework is set off or not can be judged by utilizing the acousto-optic change curves.
And S300, extracting the setting-off characteristics of the fireworks according to the acousto-optic change curve, and judging whether setting-off monitoring is carried out or not.
In the step, the firework setting-off characteristics are extracted according to the acousto-optic change curve, in order to judge whether the firework is set off or not through sound and pictures, specifically, the sound characteristics and the picture characteristics are extracted, the sound characteristics and the picture characteristics are compared with the characteristics in a preset database, when the sound characteristics and the picture characteristics are simultaneously matched, the fact that the firework setting-off behavior exists in the current video monitoring picture is judged, when the fact that the firework setting-off behavior exists is judged, setting-off monitoring is started, and the whole setting-off process is monitored.
S400, calculating the position of the firework setting-off point, generating the information of the setting-off position exceeding the range, and giving an alarm.
In the step, the position of the firework setting-off point is calculated, sound and strong light are generated when the firework is set off, the sound needs a certain time to be transmitted from the setting-off point to the monitoring device, the strong light needs a certain time to be transmitted from the setting-off point to the monitoring device, but the transmission time of the sound and the transmission time of the light are different, the sound waves and the light are transmitted in different speeds in the air, so the distance between the setting-off point and the monitoring device can be calculated according to the time of receiving the sound and the time of receiving the strong light in the video, three groups of monitoring devices are arranged, three groups of fixed point monitoring videos are arranged, three groups of distances are obtained, the relative position between the monitoring devices is determined, a three-dimensional coordinate system is constructed, the distance is used as the center to construct a sphere, the setting-off point of the firework is in the overlapping area of the three spheres, an alarm is sent, and the position is informed to a manager.
As shown in fig. 2, as a preferred embodiment of the present invention, the step of recording the acousto-optic data in the fixed-point surveillance video and generating an acousto-optic change curve specifically includes:
s201, analyzing the fixed point monitoring video, and extracting audio data and video data.
In this step, the fixed-point surveillance video is analyzed, specifically, the audio track of the fixed-point surveillance video is extracted, so as to obtain audio track data, and the pictures in the fixed-point surveillance video are extracted separately, so as to obtain audio data and video data.
And S202, generating a sound characteristic curve according to the audio data.
In this step, a sound characteristic curve is generated according to the audio data, the audio data is filtered, the noise in the audio data is removed, and then a curve is constructed by using time as a horizontal axis, so that the sound characteristic curve is obtained.
And S203, generating a brightness change curve according to the video data, and synthesizing an acousto-optic change curve according to the sound characteristic curve and the brightness change curve, wherein the acousto-optic change curve takes time as a horizontal axis.
In this step, a luminance change curve is generated according to video data, a picture is divided into regions according to pixels, specifically, the video data is subjected to gray processing, so that adjacent pixels with a gray value difference value smaller than a preset value are divided into the same region, luminance statistics is performed according to the regions, luminance change in the pixel region is determined, a luminance change curve is constructed for each pixel region, an acousto-optic change curve is synthesized according to a sound characteristic curve and the luminance change curve, that is, the sound characteristic curve and the luminance change curve are simultaneously drawn in the same coordinate system, and time axes of the sound characteristic curve and the luminance change curve are kept to be coincident.
As shown in fig. 3, as a preferred embodiment of the present invention, the step of extracting the firework setting-off characteristics according to the acousto-optic variation curve and determining whether to perform setting-off monitoring specifically includes:
s301, extracting audio features according to the acousto-optic change curve, identifying the audio features, and judging whether specific sound features exist.
In the step, audio features are extracted according to the acousto-optic change curve, specifically, the audio features are obtained by performing the audio features, whether the current audio features are in the database or not is judged by inquiring the preset database, the audio features corresponding to the preset fireworks explosion are stored in the database, and if matching items exist, the fact that the fireworks explosion sound exists in the current monitoring video is indicated.
S302, extracting picture features according to the acousto-optic change curve, judging the features of the picture, and judging whether specific picture features exist.
In the step, the image characteristic is extracted according to the acousto-optic change curve, and because the brightness of the fireworks is changed suddenly when the fireworks explode, the characteristic extraction is carried out on the brightness curve so as to obtain the image characteristic, whether a corresponding matching item exists in the database or not is inquired, and if the matching item exists, the fact that the current monitoring video contains severe light intensity change is indicated, so that the specific image characteristic is obtained.
And S303, acquiring the firework setting-off characteristics according to the specific sound characteristics and the specific picture characteristics, and judging whether setting-off monitoring is carried out or not.
In the step, the firework setting-off characteristics are obtained according to the specific sound characteristics and the specific picture characteristics, when the specific picture characteristics and the specific sound characteristics exist at the same time, the time difference between the specific picture characteristics and the specific sound characteristics is calculated, when the time difference is smaller than a threshold value, the firework setting-off condition exists, otherwise, the firework setting-off condition does not exist, and when the time difference exceeds the threshold value, the firework setting-off position is far away, or the sound and picture conditions caused by other non-firework setting-off conditions exist.
As shown in fig. 4, as a preferred embodiment of the present invention, the step of calculating the position of the firework ignition point, generating the information of the over-range ignition position, and issuing an alarm specifically includes:
s401, determining the corresponding relation between the specific sound characteristics and the specific picture characteristics to form a characteristic pair.
In the step, the corresponding relation between the specific sound features and the specific picture features is determined, because a plurality of explosion points exist in the firework setting-off process, each explosion point corresponds to one specific sound feature and one specific picture feature, and a feature pair is determined according to the extraction sequence of the specific sound features and the specific picture features, namely the first specific sound feature and the first specific picture feature form one feature pair.
S402, calculating the time difference of the specific sound feature and the specific picture feature in the feature pair, and calculating the setting-off distance according to the time difference and the preset parameter.
In the step, the time difference between the specific sound characteristic and the specific picture characteristic in the characteristic pair is calculated, the propagation speed of sound in the air is adjusted, the transmission speed of light in the air is adjusted, the distance is used as an unknown number, and if the time difference is a, the light speed is b, the sound speed is c and the distance is x, obtaining a calculation formula a = (x/c) - (x/b) so as to calculate the set-off distance, and if the three sets of fixed point monitoring videos obtain three sets of set-off distances.
And S403, constructing a three-dimensional model according to the setting-off distance, generating the over-range setting-off position information, and giving an alarm.
In the step, a three-dimensional model is built according to the setting-off distance, a three-dimensional coordinate system is built, the positions of the three groups of monitoring devices are determined, the spheres are built by taking the three groups of setting-off distances as the radiuses, the overlapping areas among the three groups of spheres are determined, the projections of the overlapping areas on the planes determined by the X axis and the Y axis are taken as the areas where the setting-off positions of the fireworks are located, the information of the setting-off positions exceeding the range is obtained, an alarm is given, the alarm is given out through voice, and managers are informed.
As shown in fig. 5, the firework setting-off safety monitoring system provided in the embodiment of the present invention includes:
the data acquisition module 100 is configured to acquire video monitoring data corresponding to the fixed set-off point, where the video monitoring data at least includes three groups of fixed point monitoring videos.
In this system, the data acquisition module 100 acquires video monitoring data corresponding to a fixed set-off point, sets a monitoring device at a defined set-off position, and utilizes the monitoring device to shoot the fixed set-off point, including shooting the sky part during shooting, and sets at least three sets of monitoring devices for determining the set-off position of fireworks, wherein the three sets of monitoring devices form a triangle, and when in operation, three sets of fixed-point monitoring videos can be obtained, and the fixed-point monitoring videos include audio information obtained by recording.
And the acousto-optic recording module 200 is used for recording acousto-optic data in the fixed point monitoring video to generate an acousto-optic change curve.
In the system, the acousto-optic recording module 200 records acousto-optic data in the fixed-point monitoring video, and can generate huge explosion sound and bright fireworks in the firework setting-off process, so that the brightness information in the picture is recorded in real time, the sound information is synchronously recorded, the time is taken as a horizontal axis, and the brightness and the sound are taken as vertical axes, so that two groups of curves are obtained by drawing, namely acousto-optic change curves, and whether the fireworks are set-off or not can be judged by utilizing the acousto-optic change curves.
And the monitoring and judging module 300 is used for extracting the firework setting-off characteristics according to the acousto-optic change curve and judging whether setting-off monitoring is carried out.
In the system, the monitoring and judging module 300 extracts firework setting-off characteristics according to the acousto-optic change curve, specifically, in order to judge whether the firework is set off through sound and pictures, the sound characteristics and the picture characteristics are extracted, the sound characteristics and the picture characteristics are compared with the characteristics in a preset database, when the sound characteristics and the picture characteristics are simultaneously matched, it is judged that a firework setting-off behavior exists in a current video monitoring picture, and when it is judged that the firework setting-off behavior exists, setting-off monitoring is started, and the whole setting-off process is monitored.
And the over-range alarm module 400 is used for calculating the position of the firework set-off point, generating over-range set-off position information and giving an alarm.
In the system, the over-range alarm module 400 calculates the position of the firework set-off point, because sound and strong light are generated when the firework is set off, and the sound needs a certain time to be transmitted from the set-off point to the monitoring device, and the strong light also needs a certain time to be transmitted from the set-off point to the monitoring device, but the transmission time of the sound and the transmission time of the light are different, because the sound waves and the light are transmitted in the air at different speeds, the distance between the firework set-off point and the monitoring device can be calculated according to the time of receiving the sound and the time of receiving the strong light in the video, because three groups of monitoring devices are arranged, three groups of fixed point monitoring videos are arranged, three groups of distances are obtained, and the relative position between the monitoring devices is determined, so that a three-dimensional coordinate system is constructed, a sphere is constructed by taking each monitoring device as a center and taking the distance as a radius, and the firework set-off point is in a three spherical overlapping area, so that an alarm is given, and the position is informed to a manager.
As shown in fig. 6, as a preferred embodiment of the present invention, the acousto-optic recording module 200 includes:
the data extraction unit 201 is configured to parse the fixed-point monitoring video, and extract audio data and video data.
In this module, the data extraction unit 201 extracts audio features according to the acousto-optic variation curve, specifically, obtains audio features by performing the audio features, determines whether the current audio features are in the database by querying a preset database, and stores the audio features corresponding to the preset fireworks explosion in the database, and if there is a matching item, it indicates that there is the sound of the fireworks explosion in the current monitoring video.
An audio feature extraction unit 202, configured to generate a sound feature curve according to the audio data.
In this module, the audio feature extraction unit 202 performs image feature extraction according to the acousto-optic change curve, and since the brightness of the firework explodes, the brightness curve is subjected to feature extraction to obtain image features, and similarly, whether a corresponding matching item exists in the database is queried, and if the matching item exists, it is determined that the current monitoring video includes a sharp light intensity change, so as to obtain specific image features.
And the picture characteristic extraction unit 203 is used for generating a brightness change curve according to the video data and synthesizing an acousto-optic change curve according to the sound characteristic curve and the brightness change curve, wherein the acousto-optic change curve takes time as a horizontal axis.
In this module, the picture feature extraction unit 203 obtains the firework setting-off feature according to the specific sound feature and the specific picture feature, when the specific picture feature and the specific sound feature exist at the same time, the time difference between the specific picture feature and the specific sound feature is calculated, when the time difference is smaller than a threshold value, the firework setting-off situation exists, otherwise, the time difference does not exist, and when the time difference exceeds the threshold value, the firework setting-off position is far away, or the sound and picture situations caused by other non-firework setting-off situations exist.
As shown in fig. 7, as a preferred embodiment of the present invention, the monitoring decision module 300 includes:
the first feature recognition unit 301 is configured to perform audio feature extraction according to the acousto-optic variation curve, perform audio feature recognition, and determine whether a specific sound feature exists.
In this module, the first feature recognition unit 301 performs audio feature extraction according to the acousto-optic change curve, specifically, obtains audio features by performing audio features, determines whether the current audio features are in the database by querying a preset database, and stores the audio features corresponding to the preset fireworks explosion in the database, if a matching item exists, it indicates that there is sound of the fireworks explosion in the current monitoring video.
The second feature recognition unit 302 is configured to perform image feature extraction according to the acousto-optic change curve, perform feature determination on the image feature, and determine whether a specific image feature exists.
In this module, the second feature recognition unit 302 performs image feature extraction according to the acousto-optic change curve, and since the brightness of the firework explodes, the brightness curve is subjected to feature extraction to obtain image features, and similarly, whether a corresponding matching item exists in the database is queried, and if the matching item exists, it is determined that the current monitoring video includes a severe light intensity change, so as to obtain specific image features.
And the characteristic judging unit 303 is configured to obtain a firework setting-off characteristic according to the specific sound characteristic and the specific picture characteristic, and judge whether setting-off monitoring is performed.
In this module, the characteristic determining unit 303 obtains a firework setting-off characteristic according to the specific sound characteristic and the specific picture characteristic, calculates a time difference between the specific picture characteristic and the specific sound characteristic when the specific picture characteristic and the specific sound characteristic exist at the same time, indicates that a firework setting-off exists when the time difference is smaller than a threshold, and does not exist otherwise, and indicates that the firework setting-off position is too far or that a sound and a picture caused by other non-firework setting-off exist when the time difference exceeds the threshold.
As shown in fig. 8, the out-of-range alarm module 400, as a preferred embodiment of the present invention, includes:
a feature matching unit 401, configured to determine a corresponding relationship between the specific sound feature and the specific picture feature to form a feature pair.
In this module, the feature matching unit 401 determines the correspondence between the specific sound features and the specific image features, and since a plurality of explosion points exist during the firework setting off process, each explosion point corresponds to one specific sound feature and one specific image feature, and determines a feature pair according to the extraction sequence of the specific sound features and the specific image features, that is, a feature pair is formed by the first specific sound feature and the first specific image feature.
And a distance calculating unit 402, configured to calculate a time difference between the specific sound feature and the specific picture feature in the feature pair, and calculate a set-off distance according to the time difference and a preset parameter.
In this module, the distance calculating unit 402 calculates the time difference between the specific sound feature and the specific picture feature in the feature pair, and then adjusts the propagation speed of sound in the air, and further adjusts the speed of light transmitted in the air, and taking the distance as an unknown number, the time difference is a, the light speed is b, the sound speed is c, and the distance is x, obtaining a calculation formula a = (x/c) - (x/b), and calculating to obtain the set-off distance, wherein the three sets of fixed point monitoring videos obtain three sets of set-off distances.
And a setting-off warning unit 403, configured to construct a three-dimensional model according to the setting-off distance, generate over-range setting-off position information, and send an alarm.
In this module, the setting-off warning unit 403 constructs a three-dimensional model according to the setting-off distance, constructs a three-dimensional coordinate system, determines the positions of three groups of monitoring devices, constructs a sphere by using the three groups of setting-off distances as radii, determines a coincidence region between the three groups of spheres, and takes the projection of the coincidence region on a plane determined by an X axis and a Y axis as the region where the setting-off position of the firework is located, so as to obtain the information of the setting-off position beyond the range, and sends out an alarm which is sent out by voice, and notifies a manager.
All possible combinations of the technical features of the above embodiments may not be described for the sake of brevity, but should be considered as within the scope of the present disclosure as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is specific and detailed, but not to be understood as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (10)
1. A firework setting-off safety monitoring method is characterized by comprising the following steps:
acquiring video monitoring data corresponding to a fixed set-off point, wherein the video monitoring data at least comprises three groups of fixed point monitoring videos;
recording acousto-optic data in the fixed-point monitoring video to generate an acousto-optic change curve;
extracting the firework setting-off characteristics according to the acousto-optic change curve, and judging whether setting-off monitoring is carried out or not;
and calculating the position of the firework setting-off point, generating information of the setting-off position exceeding the range, and giving an alarm.
2. The firework setting-off safety monitoring method as claimed in claim 1, wherein the step of recording acousto-optic data in the fixed point monitoring video to generate an acousto-optic change curve specifically comprises:
analyzing the fixed-point monitoring video, and extracting audio data and video data;
generating a sound characteristic curve according to the audio data;
and generating a brightness change curve according to the video data, and synthesizing an acousto-optic change curve according to the sound characteristic curve and the brightness change curve, wherein the acousto-optic change curve takes time as a horizontal axis.
3. The firework setting-off safety monitoring method as claimed in claim 1, wherein the step of extracting firework setting-off characteristics according to acousto-optic variation curves and determining whether setting-off monitoring is performed specifically comprises:
extracting audio features according to the acousto-optic change curve, identifying the audio features, and judging whether specific sound features exist or not;
extracting picture features according to the acousto-optic change curve, judging the features of the picture, and judging whether specific picture features exist or not;
and obtaining the firework setting-off characteristics according to the specific sound characteristics and the specific picture characteristics, and judging whether setting-off monitoring is carried out or not.
4. A firework setting-off safety monitoring method as claimed in claim 3, wherein the steps of calculating the position of the setting-off point of the firework, generating the information of the setting-off position beyond the range, and giving an alarm comprise:
determining the corresponding relation between the specific sound characteristics and the specific picture characteristics to form a characteristic pair;
calculating the time difference of the specific sound characteristic and the specific picture characteristic in the characteristic pair, and calculating the setting-off distance according to the time difference and a preset parameter;
and constructing a three-dimensional model according to the setting-off distance, generating the over-range setting-off position information, and giving an alarm.
5. A firework setting-off safety monitoring method as claimed in claim 1, wherein no alarm is given when the position of the setting-off point of the firework is not beyond a preset range.
6. A firework setting off safety monitoring method as claimed in claim 1, wherein the alarm is issued by voice and notifies a manager.
7. A firework setting off safety monitoring system is characterized in that the system comprises:
the data acquisition module is used for acquiring video monitoring data corresponding to the fixed set-off point, and the video monitoring data at least comprises three groups of fixed point monitoring videos;
the acousto-optic recording module is used for recording acousto-optic data in the fixed point monitoring video to generate an acousto-optic change curve;
the monitoring and judging module is used for extracting the firework setting-off characteristics according to the acousto-optic change curve and judging whether setting-off monitoring is carried out or not;
and the over-range alarm module is used for calculating the position of the firework set-off point, generating over-range set-off position information and sending an alarm.
8. A firework setting off safety monitoring system as recited in claim 7, wherein the acousto-optic recording module comprises:
the data extraction unit is used for analyzing the fixed-point monitoring video and extracting audio data and video data;
the audio characteristic extraction unit is used for generating a sound characteristic curve according to the audio data;
and the picture characteristic extraction unit is used for generating a brightness change curve according to the video data and synthesizing an acousto-optic change curve according to the sound characteristic curve and the brightness change curve, wherein the acousto-optic change curve takes time as a horizontal axis.
9. A firework setting off safety monitoring system as recited in claim 7, wherein the monitoring and determining module comprises:
the first characteristic identification unit is used for extracting audio characteristics according to the acousto-optic change curve, identifying the audio characteristics and judging whether specific sound characteristics exist or not;
the second characteristic identification unit is used for extracting picture characteristics according to the acousto-optic change curve, judging the characteristics of the picture characteristics and judging whether specific picture characteristics exist or not;
and the characteristic judging unit is used for obtaining the firework setting-off characteristics according to the specific sound characteristics and the specific picture characteristics and judging whether setting-off monitoring is carried out or not.
10. A firework setting off safety monitoring system as recited in claim 9, wherein the over-range warning module comprises:
the feature matching unit is used for determining the corresponding relation between the specific sound features and the specific picture features to form feature pairs;
the distance calculation unit is used for calculating the time difference of the specific sound characteristic and the specific picture characteristic in the characteristic pair and calculating the setting-off distance according to the time difference and preset parameters;
and the setting-off warning unit is used for constructing a three-dimensional model according to the setting-off distance, generating the over-range setting-off position information and giving an alarm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211348185.6A CN115396640B (en) | 2022-10-31 | 2022-10-31 | Firework setting-off safety monitoring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211348185.6A CN115396640B (en) | 2022-10-31 | 2022-10-31 | Firework setting-off safety monitoring system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115396640A true CN115396640A (en) | 2022-11-25 |
| CN115396640B CN115396640B (en) | 2023-02-17 |
Family
ID=84114978
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211348185.6A Active CN115396640B (en) | 2022-10-31 | 2022-10-31 | Firework setting-off safety monitoring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115396640B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202993986U (en) * | 2012-11-16 | 2013-06-12 | 浏阳市新年烟花制造有限公司 | Firework setting off node safety monitoring system |
| US20180066927A1 (en) * | 2016-09-02 | 2018-03-08 | Titan International Technologies, Ltd. | Automated detonation of fireworks |
| CN109727430A (en) * | 2019-01-16 | 2019-05-07 | 余珊 | Site safety alarm system |
| CN111781585A (en) * | 2020-06-09 | 2020-10-16 | 浙江大华技术股份有限公司 | Method for determining firework setting-off position and image acquisition equipment |
| CN215416972U (en) * | 2020-12-14 | 2022-01-04 | 北京沃东天骏信息技术有限公司 | Fireworks and crackers setting off recognition system |
-
2022
- 2022-10-31 CN CN202211348185.6A patent/CN115396640B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202993986U (en) * | 2012-11-16 | 2013-06-12 | 浏阳市新年烟花制造有限公司 | Firework setting off node safety monitoring system |
| US20180066927A1 (en) * | 2016-09-02 | 2018-03-08 | Titan International Technologies, Ltd. | Automated detonation of fireworks |
| CN109727430A (en) * | 2019-01-16 | 2019-05-07 | 余珊 | Site safety alarm system |
| CN111781585A (en) * | 2020-06-09 | 2020-10-16 | 浙江大华技术股份有限公司 | Method for determining firework setting-off position and image acquisition equipment |
| CN215416972U (en) * | 2020-12-14 | 2022-01-04 | 北京沃东天骏信息技术有限公司 | Fireworks and crackers setting off recognition system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115396640B (en) | 2023-02-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106600888B (en) | Automatic forest fire detection method and system | |
| KR101168760B1 (en) | Flame detecting method and device | |
| CN103150856B (en) | Fire flame video monitoring and early warning system | |
| CN109034156B (en) | Bullet point positioning method based on image recognition | |
| US7868772B2 (en) | Flame detecting method and device | |
| CN108334801A (en) | A kind of method for recognizing fire disaster, device and fire alarm system | |
| CN105872757A (en) | Method and apparatus for reminding safe television watching distance | |
| CN102819735A (en) | Flame detection method based on video frame image | |
| CN110867046A (en) | Intelligent car washer video monitoring and early warning system based on cloud computing | |
| CN102117484B (en) | Processing system, processing method and image classification method using image color information | |
| KR101420130B1 (en) | Identification of friend or foe system based on image processing, and control method of the same | |
| CN112257554B (en) | Forest fire recognition method, system, program and storage medium based on multiple spectra | |
| CN111144252B (en) | Monitoring and early warning method for people stream analysis | |
| CN113499553B (en) | Fire extinguishing method, device, equipment and storage medium based on portable unmanned aerial vehicle | |
| CN110519560B (en) | Intelligent early warning method, device and system | |
| Toreyin et al. | Wildfire detection using LMS based active learning | |
| CN112699801A (en) | Fire identification method and system based on video image | |
| CN110135347A (en) | A kind of flame identification method based on video image | |
| CN115396640B (en) | Firework setting-off safety monitoring system and method | |
| Naimeng et al. | Smoke detection for early forest fire in aerial photography based on GMM background and wavelet energy | |
| CN113627321A (en) | Image identification method and device based on artificial intelligence and computer equipment | |
| CN114534146A (en) | Control method and system for automatically searching for ground based on flame of mobile electric fire-fighting robot | |
| CN112132870A (en) | Early smoke detection method for forest fire | |
| CN116757999A (en) | Shooting counting and explosion point identification method based on infrared camera | |
| CN110660187B (en) | Forest fire alarm monitoring system based on edge calculation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |