CN112382051A - Wisdom house security protection system based on block chain - Google Patents
Wisdom house security protection system based on block chain Download PDFInfo
- Publication number
- CN112382051A CN112382051A CN202011251820.XA CN202011251820A CN112382051A CN 112382051 A CN112382051 A CN 112382051A CN 202011251820 A CN202011251820 A CN 202011251820A CN 112382051 A CN112382051 A CN 112382051A
- Authority
- CN
- China
- Prior art keywords
- module
- sound
- ultrasonic
- abnormal sound
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002159 abnormal effect Effects 0.000 claims abstract description 105
- 238000007781 pre-processing Methods 0.000 claims abstract description 25
- 238000012544 monitoring process Methods 0.000 claims abstract description 15
- 230000006855 networking Effects 0.000 claims abstract description 10
- 230000005236 sound signal Effects 0.000 claims description 42
- 238000012545 processing Methods 0.000 claims description 35
- 238000000034 method Methods 0.000 claims description 23
- 238000001228 spectrum Methods 0.000 claims description 19
- 230000004044 response Effects 0.000 claims description 16
- 230000003595 spectral effect Effects 0.000 claims description 11
- 238000003491 array Methods 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 claims description 7
- 230000009466 transformation Effects 0.000 claims description 7
- 238000001914 filtration Methods 0.000 claims description 6
- 238000009432 framing Methods 0.000 claims description 6
- 238000010606 normalization Methods 0.000 claims description 6
- 238000004519 manufacturing process Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 3
- 230000002238 attenuated effect Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000012937 correction Methods 0.000 claims description 3
- 230000004807 localization Effects 0.000 claims description 3
- 238000011410 subtraction method Methods 0.000 claims description 3
- 230000001815 facial effect Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 2
- 230000009471 action Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000002035 prolonged effect Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000003908 quality control method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0438—Sensor means for detecting
- G08B21/0492—Sensor dual technology, i.e. two or more technologies collaborate to extract unsafe condition, e.g. video tracking and RFID tracking
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0233—System arrangements with pre-alarms, e.g. when a first distance is exceeded
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0438—Sensor means for detecting
- G08B21/0469—Presence detectors to detect unsafe condition, e.g. infrared sensor, microphone
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Gerontology & Geriatric Medicine (AREA)
- Child & Adolescent Psychology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
The invention discloses a smart house security system based on a block chain, which is characterized by comprising the following components in parts by weight: the sound positioning module is used for judging whether abnormal sounds occur or not and realizing a positioning function on the abnormal sounds; the face recognition module is used for recognizing the face and judging whether the face is a house owner; the alarm condition sensing module is used for monitoring whether dangerous conditions occur in the house; the networking alarm module is used for sending alarm information to residents and security personnel when an alarm condition occurs and providing abnormal position information; block chain database: the face information of residents and workers in the community is stored; the sound positioning module comprises a microphone array module, a sound acquisition module, a sound preprocessing module and an abnormal sound positioning module; the invention has the effects of making the residential security system run more stably and operate more safely.
Description
Technical Field
The invention relates to the technical field of intelligent security, in particular to an intelligent house security system based on a block chain.
Background
In recent years, with the continuous improvement of living standard of people, the living conditions of people are changed greatly, and with the upgrading of living environment of people, people pay more and more attention to personal safety and property safety of people and put higher requirements on safety of people, families and residential districts; meanwhile, the rapid development of economy is accompanied by the rapid increase of urban floating population, a new problem is added to urban social security, a safety precaution system is required to ensure the safety of a cell and prevent the occurrence of a robbery event, the security mode of civil air defense is difficult to adapt to our requirements, and intelligent security becomes the current development trend;
video monitoring systems are widely used in public places such as banks, shopping malls, stations, traffic intersections and the like, but actual monitoring tasks still need to be completed by more workers, and the existing video monitoring systems usually only record video images, provide unexplained video images, can only be used for obtaining evidence afterwards, and do not fully play the real-time and initiative of monitoring. In order to analyze, track and judge a monitored object in real time, prompt and report when an abnormal event occurs, and provide support for timely decision and correct action of government departments and the safety field, the intellectualization of video monitoring is particularly important; meanwhile, the block chain is also an air port technology in an exploration phase, and how to enable the residential security system to run more stably and operate more safely becomes a technical problem which needs to be solved urgently.
In the above, an intelligent house security system based on a block chain is urgently needed.
Disclosure of Invention
The invention aims to provide an intelligent house security system based on a block chain, so as to solve the problems in the background technology.
In order to solve the technical problems, the invention provides the following technical scheme: a wisdom house security protection system based on block chain includes:
the sound positioning module is used for judging whether abnormal sounds occur or not and realizing a positioning function on the abnormal sounds;
the face recognition module is used for recognizing the face and judging whether the face is a house owner;
the alarm condition sensing module is used for monitoring whether dangerous conditions occur in the house;
the networking alarm module is used for sending alarm information to residents and security personnel when an alarm condition occurs and providing abnormal position information;
block chain database: the face information of the residents and the staff in the community is stored.
Further, the sound positioning module comprises a microphone array module, a sound acquisition module, a sound preprocessing module and an abnormal sound positioning module;
the microphone array module comprises a microphone unit and a preamplifier unit; the microphone unit is used for collecting sound signals and converting the collected sound signals into analog electric signals to be output;
the signal acquisition module is connected with the preamplifier unit and is used for converting an analog electric signal into a digital signal, and the preamplifier unit is used for selecting a required sound source signal and amplifying the sound source signal to a rated level; secondly, various tone quality controls are carried out to beautify the sound, so that the collected sound can be more easily identified, and the accuracy of the sound positioning module is increased;
the signal preprocessing module is connected with the signal acquisition module and is used for preprocessing the sound acquired by the signal acquisition module;
the abnormal sound positioning module is connected with the signal preprocessing module and used for judging whether the sound collected by the signal collecting module belongs to abnormal sound or not, positioning the abnormal sound and judging whether the sound belongs to the abnormal sound or not, so that the long-term processing opening state of the camera of the image collecting unit can be avoided, the camera is opened only when the sound is judged to be the abnormal sound, and the service life of the camera is effectively prolonged.
Further, the face recognition module comprises an image acquisition unit, an image processing unit and an image comparison unit;
the image acquisition unit comprises a rotatable camera and is used for acquiring a human face image;
the image processing unit is used for preprocessing the collected face image to obtain an optimized image and extracting a face characteristic vector in the image;
the image comparison unit is used for comparing the face feature vector extracted from the image processing unit with a block chain database, and the block chain database stores face information of each resident in the cell, so that illegal intrusion of external personnel can be effectively prevented, the safety of the cell is greatly improved, and great convenience is provided for the work development of security personnel;
furthermore, the alarm condition sensing module comprises a first ultrasonic module, a second ultrasonic module and a calculating unit;
the first ultrasonic module is used for measuring the height of a resident;
the second ultrasonic module is used for measuring the distance between the child and the balcony window;
the first ultrasonic module comprises a first ultrasonic transmitting unit and a first ultrasonic receiving unit;
the first ultrasonic transmitting unit is used for transmitting ultrasonic waves to the head of a resident; the first ultrasonic receiving unit is used for receiving ultrasonic waves reflected from the head direction of the resident;
the second ultrasonic module comprises a second ultrasonic transmitting unit and a second ultrasonic receiving unit;
the second ultrasonic transmitting unit is used for transmitting ultrasonic waves to the direction of the child; the second ultrasonic receiving unit is used for receiving ultrasonic waves reflected from the direction of the child;
the computing unit is used for processing the data obtained by the first ultrasonic module and the second ultrasonic module.
Furthermore, the networking alarm module is wirelessly connected with monitoring facilities of security personnel and is connected with a database of a public security system, so that the alarm condition is provided in time.
A smart home security method based on a block chain comprises the following steps:
s1, judging whether an abnormal sound signal appears in the monitoring range through the sound positioning module, if the abnormal sound signal is judged, rapidly controlling the camera module to rotate to the abnormal sounding direction for checking, and through abnormal sound positioning, the camera can more accurately acquire images and videos, so that the identification accuracy is improved;
s2, the camera module collects videos and images in the abnormal sound production direction, carries out face recognition on the collected images, and if the recognition fails, carries out step S5; if successful, the alarm is released and the step S3 is performed;
s3, further recognizing the face, if the face is recognized as a child and moves to a balcony dangerous area, opening an ultrasonic ranging module of a balcony, if the distance between the child and the balcony exceeds a preset threshold value, starting acousto-optic early warning to remind parents of possible danger and stopping in time, and only when the face recognition module judges that the person close to the balcony window is the child, automatically starting the ultrasonic ranging module to prevent false alarm;
s4, sending an illegal intrusion warning message to a networking warning module, and sending out an acousto-optic warning; the alarm information is transmitted to the system host for subsequent analysis and processing, the alarm is sent to the preset mobile phone number of the security personnel in a short message mode, and alarm positioning is provided, so that illegal personnel can be prevented from intruding into the house of the user in time, and the security personnel can be helped to know the accident occurrence place and arrive at the place more quickly.
Further, the step S1 includes:
s101, collecting sound signals by using a microphone array, wherein the microphone array comprises a plurality of microphone units;
s102, carrying out sound preprocessing on the sound signal: removing direct current components and trend terms from sound signals collected by a microphone; filtering out high-frequency clutter from the processed sound signal; finally, power frequency interference and harmonic waves are removed by adopting a spectral subtraction method, then the sound signals are subjected to normalization processing to obtain processed signals s (m), and the acquired sound is processed to obtain clearer sound, so that the accuracy of judging abnormal sound can be improved;
s103, judging whether the sound is abnormal sound or not, and locating the abnormal sound if the sound is judged to be abnormal sound.
Further, the step S103 includes: judging abnormal sound and positioning the abnormal sound:
and (3) judging abnormal sound:
(1) performing frame division processing on the processed signal s (m), calculating the average power of each frame of signal, wherein T is the time of each frame:
(2) performing frame division processing on a noise signal s (a) of a surrounding environment, calculating the average power of each frame signal, wherein T is the time of each frame:
(3) calculating the signal-to-noise ratio of the sound:detecting the signal-to-noise ratio, setting a threshold value, marking the sound signal as abnormal sound if the preset threshold value is exceeded, and judging the abnormal sound more accurately by comparing the power of the noise of each frame of signal and the surrounding environment after the processing;
abnormal sound localization:
(4) dividing a plurality of microphones into a left array and a right array, wherein each array comprises 4 microphone units, establishing coordinates, determining relevant coordinate positions of the microphone units, and receiving signals of a kth microphone as follows:
sk(m)=s(m)*vn(m)+sn(a)
where s (m) is an abnormal sound signal, vn(m) is the unit impulse response, sn(a) A noise signal of the surrounding environment;
(5) calculating the energy of the abnormal sound signals received by the 2 microphone arrays, comparing the energy of the abnormal sound signals received by the two microphone arrays, and taking the side with larger energy as a positioning range;
let the energy of the abnormal sound signal received by the kth microphone be:
Rk=∑sk 2(m)
the energy received by the left microphone array is summed as:
the energy received by the right microphone array is then summed as:
comparison of RLeft side ofAnd RRight sideIf R is large or smallLeft side ofGreater than RRight sideIf the sum of the energy received by the left microphone array is larger than the sum of the energy received by the right microphone array, the positioning range is narrowed to the left area; if R isRight sideGreater than RLeft side ofIf the sum of the energy received by the right microphone array is larger than the sum of the energy received by the left microphone array, the positioning range is narrowed to the left area, the acquisition range of the camera can be narrowed, the positioning is more accurate, and the invalid rotation of the camera and the acquisition of invalid images and videos are reduced;
(6) the space is divided into a small grid by using a space clustering method, and abnormal sound position candidate points are determined, so that the number of the candidate points is effectively reduced, and each grid corresponds to the guiding time delay of a group of microphone arrays; the output power of the microphone array guided to each position candidate point, namely the controllable response power, is calculated according to the phase transformation weighted controllable response power algorithm, the maximum controllable response power is found, the phase transformation weighted controllable response power algorithm is relatively simple to realize, the calculation amount is small, the real-time processing is facilitated, and the positioning processing efficiency is improved;
(7) finding out an abnormal sound position candidate point corresponding to the maximum controllable response power by a table look-up or grid method to realize positioning;
obtaining the candidate point N of the abnormal sound position1Candidate point N2Candidate point N3And for the candidate point N1Candidate point N2Candidate point N3The abnormal sound is processed by framing, the frame length is taken as 20-50ms, each frame signal is multiplied by a smooth window function, and the two ends of the frame are smoothly attenuated to zero; such a frame has enough periods and does not changeThe intensity of side lobes after Fourier transform can be reduced, and a frequency spectrum with higher quality can be obtained; the time difference between frames is usually 10ms, so that there is an overlap between frames, otherwise, since the signal at the frame-to-frame connection is weakened due to windowing, this part of information is lost;
performing Fourier transform on the signal subjected to framing processing on the abnormal sound to obtain a frequency spectrum of each frame, performing FFT (fast Fourier transform) on the frequency spectrum to obtain a frequency domain of the frequency spectrum, drawing a power spectrum in the frequency domain, comparing the amplitudes of the power spectrum, wherein the maximum amplitude is the peak value of the frequency spectrum;
obtaining a candidate point N of the abnormal sound position1Has a spectral peak value of A1Candidate point N2Has a spectral peak value of A2Candidate point N3Has a spectral peak value of A3Comparison A1、A2、A3The maximum value is the final abnormal sound anchor point.
Further, in the step S2;
preprocessing the collected face image, wherein the preprocessing process comprises light compensation, gray level transformation, histogram equalization, normalization, geometric correction, filtering and sharpening of the face image; the face image is optimized, so that external interference factors can be removed, the image quality is improved, and the comparison result is more accurate;
extracting the features of the preprocessed face image, and comparing the extracted feature data of the face image with a feature template in a block chain database;
and setting a threshold, and outputting the result obtained by matching when the similarity exceeds the threshold.
Further, in the step S3;
when the image acquisition module identifies that a resident walks to the balcony, a first ultrasonic module located above the roof of the balcony is started, a first ultrasonic transmitting unit transmits ultrasonic waves to the head of the resident, timing is started at the same time of transmitting time, the head of the user is touched on the way and then the ultrasonic waves return immediately, a first ultrasonic receiving unit stops timing immediately after receiving reflected waves, the acquired data are transmitted to a calculating unit for calculation, and the calculating formula is as follows:
wherein L is the distance from the head of the resident to the first ultrasonic receiving module, namely the distance from the head of the resident to the roof of the balcony, c is the speed of the ultrasonic wave, and t is the time from the emission to the reception of the ultrasonic wave;
the distance from the balcony floor to the upper part of the balcony roof is known to be L, so that the height of the obtained resident is H-L; the accurate height condition of the resident can be obtained through the first ultrasonic wave, and unnecessary alarm information caused by alarm misjudgment is prevented;
setting a threshold value of H, and judging the safety of the resident when H is greater than the set threshold value; when H is smaller than a set threshold value, the resident is judged to be a child, and the resident is in an early warning state;
if the resident is judged to be a child, the second ultrasonic module is started, the second ultrasonic transmitting unit transmits ultrasonic waves to the child, timing is started at the same time of transmitting time, the child is touched on the way and then returns immediately, the second ultrasonic receiving unit stops timing immediately after receiving the reflected waves, the obtained data are transmitted to the calculating unit for calculation, and the calculating formula is as follows:
wherein S is the distance from the child to the second ultrasonic wave receiving module, i.e. the distance from the child to the balcony window, c is the speed of the ultrasonic wave, t1Time from transmission to reception of the ultrasonic wave;
setting a distance threshold value of 1.5 m, and triggering sound and light alarm if the distance L from the child to the balcony window is less than 1.5 m; if the distance from the child to the balcony window is 1.5 m from the threshold value, the alarm is released; the set distance threshold value can effectively prevent the child from being dangerous due to the fact that the child is too close to the balcony window, and greatly improves the safety of home furnishing.
Compared with the prior art, the invention has the following beneficial effects: the method judges the sound firstly, and when the sound is judged to be the abnormal sound, the camera is rotated to collect the image and the video, so that the accuracy and precision of face collection are improved; meanwhile, the camera of the image acquisition unit can be prevented from processing the starting state for a long time, and the camera is started to work only when the sound is judged to be abnormal sound, so that the service life of the camera is effectively prolonged; the place where abnormal sound occurs can be positioned, and security personnel can conveniently drive to expel illegal personnel in time; ultrasonic ranging module can carry out the safety protection effect to the young children at home, when they are close to the comparatively dangerous place of balcony window, reach certain distance within range, can send out the police dispatch newspaper, ensures their safety.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic flow chart of a security system for a smart home based on a blockchain according to the present invention;
FIG. 2 is a block chain-based block diagram of a security system for smart homes according to the present invention;
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-2, the present invention provides the following technical solutions:
the working principle of the invention is as follows:
a wisdom house security protection system based on block chain includes: the sound positioning module is used for judging whether abnormal sounds occur or not and realizing a positioning function on the abnormal sounds; the face recognition module is used for recognizing the face and judging whether the face is a house owner; the alarm condition sensing module is used for monitoring whether dangerous conditions occur in the house; the networking alarm module is used for sending alarm information to residents and security personnel when an alarm condition occurs and providing abnormal position information;
block chain database: the face information of the residents and the staff in the community is stored.
The sound positioning module comprises a microphone array module, a sound acquisition module, a sound preprocessing module and an abnormal sound positioning module; the microphone array module comprises a microphone unit and a preamplifier unit; the microphone unit is used for collecting sound signals and converting the collected sound signals into analog electric signals to be output; the signal acquisition module is connected with the preamplifier unit and is used for converting the analog electric signal into a digital signal; the signal preprocessing module is connected with the signal acquisition module and is used for preprocessing the sound acquired by the signal acquisition module; the abnormal sound positioning module is connected with the signal preprocessing module and used for judging whether the sound collected by the signal collecting module belongs to abnormal sound or not and positioning the abnormal sound.
The face recognition module comprises an image acquisition unit, an image processing unit and an image comparison unit;
the image acquisition unit comprises a rotatable camera and is used for acquiring a human face image; the image processing unit is used for preprocessing the collected face image to obtain an optimized image and extracting a face characteristic vector in the image; the image comparison unit is used for comparing the facial feature vector extracted from the image processing unit with the block chain database;
the warning condition induction module comprises an ultrasonic ranging module;
the ultrasonic ranging module is used for measuring the distance between the child and the balcony window; the ultrasonic ranging module comprises an ultrasonic transmitting unit, an ultrasonic receiving unit and a calculating unit; the ultrasonic transmitting unit is used for transmitting ultrasonic waves to the direction of the child; the ultrasonic receiving unit is used for receiving ultrasonic waves reflected from the direction of the child; the computing unit is used for processing the data obtained by the ultrasonic transmitting module and the ultrasonic receiving module.
The networking alarm module is wirelessly connected with monitoring facilities of security personnel and is connected with a database of a public security system to provide an alarm situation in time.
A smart home security method based on a block chain comprises the following steps:
s1, judging whether an abnormal sound signal appears in the monitoring range through the sound positioning module, and if the abnormal sound signal is judged to be abnormal sound, rapidly controlling the camera module to rotate to the abnormal sound production direction for checking;
s2, the camera module collects videos and images in the abnormal sound production direction, carries out face recognition on the collected images, and if the recognition fails, carries out step S5; if successful, the alarm is released and the step S3 is performed;
s3, further recognizing the human face, if the human face is recognized as a child and moves to a balcony dangerous area, opening an ultrasonic ranging module of a balcony, and if the distance between the child and the balcony exceeds a preset threshold value, starting acousto-optic early warning to remind parents of possible danger and stopping in time;
s4, sending an illegal intrusion warning message to a networking warning module, and sending out an acousto-optic warning; and the alarm information is transmitted to the system host for subsequent analysis and processing, and the alarm is sent to the preset mobile phone number of the security personnel in a short message mode, and alarm positioning is provided.
Step S1 includes:
s101, collecting sound signals by using a microphone array, wherein the microphone array comprises a plurality of microphone units;
s102, carrying out sound preprocessing on the sound signal: removing direct current components and trend terms from sound signals collected by a microphone; filtering out high-frequency clutter from the processed sound signal; finally, removing power frequency interference and harmonic waves by adopting a spectral subtraction method, and then carrying out normalization processing on the sound signal to obtain a processed signal s (m);
s103, judging whether the sound is abnormal sound or not, and locating the abnormal sound if the sound is judged to be abnormal sound.
Step S103 includes: judging abnormal sound and positioning the abnormal sound:
and (3) judging abnormal sound:
(1) performing frame division processing on the processed signal s (m), calculating the average power of each frame of signal, wherein T is the time of each frame:
(2) performing frame division processing on a noise signal s (a) of a surrounding environment, calculating the average power of each frame signal, wherein T is the time of each frame:
(3) calculating the signal-to-noise ratio of the sound:detecting the signal-to-noise ratio, setting a threshold value, and marking the sound signal as abnormal sound if the threshold value is exceeded;
abnormal sound localization:
(4) dividing a plurality of microphones into a left array and a right array, wherein each array comprises 4 microphone units, establishing coordinates, determining relevant coordinate positions of the microphone units, and receiving signals of a kth microphone as follows:
sk(m)=s(m)*vn(m)+sn(a)
where s (m) is an abnormal sound signal, vn(m) is the unit impulse response, sn(a) A noise signal of the surrounding environment;
the 4 microphones in each array are uniformly distributed on a circle with the radius of 3cm, a three-dimensional rectangular coordinate system is created by taking the center of the array as an origin, and the coordinates of the 8 microphones are respectively as follows: a1(0, 9, 3), a2(3, 9, 0), a3(0, 9, -3), a4(-3, 9, 0), a5(0, -9, 3), a6(3, -9, 0), a7(0, -9, -3), a8(-3, -9, 0); due to the number of the microphones and the three-dimensional structure of the array structure, accurate near-field positioning can be realized;
(5) calculating the energy of the abnormal sound signals received by the 2 microphone arrays, comparing the energy of the abnormal sound signals received by the two microphone arrays, and taking the side with larger energy as a positioning range;
let the energy of the abnormal sound signal received by the kth microphone be:
Rk=∑sk 2(m)
the energy received by the left microphone array is summed as:
the energy received by the right microphone array is then summed as:
comparison of RLeft side ofAnd RRight sideIf R is large or smallLeft side ofGreater than RRight sideIf the sum of the energy received by the left microphone array is larger than the sum of the energy received by the right microphone array, the positioning range is narrowed to the left area; if R isRight sideGreater than RLeft side ofIf the sum of the energy received by the right microphone array is larger than the sum of the energy received by the left microphone array, the positioning range is narrowed to the left area;
(6) the space is divided into a small grid by using a space clustering method, and abnormal sound position candidate points are determined, so that the number of the candidate points is effectively reduced, and each grid corresponds to the guiding time delay of a group of microphone arrays; calculating the output power of the microphone array to each position candidate point, namely the controllable response power according to a phase transformation weighted controllable response power algorithm, and finding out the maximum controllable response power;
dividing a space region into a plurality of rectangular units with hierarchical structures, wherein the units with different hierarchies correspond to different resolution grids, mapping all data in a data set into different unit grids, and performing all processing of an algorithm by taking a single unit grid as an object, wherein the processing speed is much higher than the efficiency of taking a group as a processing object; dividing a multidimensional data space into a plurality of rectangular units, and determining clustering by calculating the proportion of all data points in the data points in each unit;
(7) finding out an abnormal sound position candidate point corresponding to the maximum controllable response power by a table look-up or grid method to realize positioning;
obtaining the candidate point N of the abnormal sound position1Candidate point N2Candidate point N3And for the candidate point N1Candidate point N2Candidate point N3The abnormal sound is processed by framing, the frame length is taken as 20-50ms, each frame signal is multiplied by a smooth window function, and the two ends of the frame are smoothly attenuated to zero;
performing Fourier transform on the signal subjected to framing processing on the abnormal sound to obtain a frequency spectrum of each frame, performing FFT (fast Fourier transform) on the frequency spectrum to obtain a frequency domain of the frequency spectrum, drawing a power spectrum in the frequency domain, comparing the amplitudes of the power spectrum, wherein the maximum amplitude is the peak value of the frequency spectrum;
obtaining a candidate point N of the abnormal sound position1Has a spectral peak value of A1Candidate point N2Has a spectral peak value of A2Candidate point N3Has a spectral peak value of A3Comparison A1、A2、A3The maximum value is the final abnormal sound anchor point.
9. The intelligent home security method based on the blockchain as claimed in claim 6, wherein: in the step S2;
preprocessing the collected face image, wherein the preprocessing process comprises light compensation, gray level transformation, histogram equalization, normalization, geometric correction, filtering and sharpening of the face image;
extracting the features of the preprocessed face image, and comparing the extracted feature data of the face image with a feature template in a block chain database;
and setting a threshold, and outputting the result obtained by matching when the similarity exceeds the threshold.
10. The intelligent home security method based on the blockchain as claimed in claim 6, wherein: in the step S3;
when the image acquisition module identifies that a resident walks to the balcony, a first ultrasonic module located above the roof of the balcony is started, a first ultrasonic transmitting unit transmits ultrasonic waves to the head of the resident, timing is started at the same time of transmitting time, the head of the user is touched on the way and then the ultrasonic waves return immediately, a first ultrasonic receiving unit stops timing immediately after receiving reflected waves, the acquired data are transmitted to a calculating unit for calculation, and the calculating formula is as follows:
wherein L is the distance from the head of the resident to the first ultrasonic receiving module, namely the distance from the head of the resident to the roof of the balcony, c is the speed of the ultrasonic wave, and t is the time from the emission to the reception of the ultrasonic wave;
the distance from the balcony floor to the upper part of the balcony roof is known to be L, so that the height of the obtained resident is H-L;
setting a threshold value of H, and judging the safety of the resident when H is greater than the set threshold value; when H is smaller than a set threshold value, the resident is judged to be a child, and the resident is in an early warning state;
if the resident is judged to be a child, the second ultrasonic module is started, the second ultrasonic transmitting unit transmits ultrasonic waves to the child, timing is started at the same time of transmitting time, the child is touched on the way and then returns immediately, the second ultrasonic receiving unit stops timing immediately after receiving the reflected waves, the obtained data are transmitted to the calculating unit for calculation, and the calculating formula is as follows:
wherein S is the distance from the child to the second ultrasonic wave receiving module, i.e. the distance from the child to the balcony window, c is the speed of the ultrasonic wave, t1Time from transmission to reception of the ultrasonic wave;
setting a distance threshold value of 1.5 m, and triggering sound and light alarm if the distance L from the child to the balcony window is less than 1.5 m; and if the distance from the child to the balcony window is less than 1.5 m from the threshold value, the alarm is released.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. The utility model provides an wisdom house security protection system based on block chain which characterized in that includes:
the sound positioning module is used for judging whether abnormal sounds occur or not and realizing a positioning function on the abnormal sounds;
the face recognition module is used for recognizing the face and judging whether the face is a house owner;
the alarm condition sensing module is used for monitoring whether dangerous conditions occur in the house;
the networking alarm module is used for sending alarm information to residents and security personnel when an alarm condition occurs and providing abnormal position information;
block chain database: the face information of the residents and the staff in the community is stored.
2. The wisdom home security system based on blockchain of claim 1, wherein: the sound positioning module comprises a microphone array module, a sound acquisition module, a sound preprocessing module and an abnormal sound positioning module;
the microphone array module comprises a microphone unit and a preamplifier unit; the microphone unit is used for collecting sound signals and converting the collected sound signals into analog electric signals to be output;
the signal acquisition module is connected with the preamplifier unit and is used for converting an analog electric signal into a digital signal;
the signal preprocessing module is connected with the signal acquisition module and is used for preprocessing the sound acquired by the signal acquisition module;
the abnormal sound positioning module is connected with the signal preprocessing module and used for judging whether the sound collected by the signal collecting module belongs to abnormal sound or not and positioning the abnormal sound.
3. The wisdom home security system based on blockchain of claim 1, wherein: the face recognition module comprises an image acquisition unit, an image processing unit and an image comparison unit;
the image acquisition unit comprises a rotatable camera and is used for acquiring a human face image;
the image processing unit is used for preprocessing the collected face image to obtain an optimized image and extracting a face characteristic vector in the image;
and the image comparison unit is used for comparing the facial feature vector extracted from the image processing unit with the block chain database.
4. The wisdom home security system based on blockchain of claim 1, wherein: the alarm condition sensing module comprises a first ultrasonic module, a second ultrasonic module and a calculating unit;
the first ultrasonic module is used for measuring the height of a resident;
the second ultrasonic module is used for measuring the distance between the child and the balcony window;
the first ultrasonic module comprises a first ultrasonic transmitting unit and a first ultrasonic receiving unit;
the first ultrasonic transmitting unit is used for transmitting ultrasonic waves to the head of a resident; the first ultrasonic receiving unit is used for receiving ultrasonic waves reflected from the head direction of the resident;
the second ultrasonic module comprises a second ultrasonic transmitting unit and a second ultrasonic receiving unit;
the second ultrasonic transmitting unit is used for transmitting ultrasonic waves to the direction of the child; the second ultrasonic receiving unit is used for receiving ultrasonic waves reflected from the direction of the child;
the computing unit is used for processing the data obtained by the first ultrasonic module and the second ultrasonic module.
5. The wisdom home security system based on blockchain of claim 1, wherein: the networking alarm module is wirelessly connected with monitoring facilities of security personnel and is connected with a database of a public security system to provide an alarm situation in time.
6. A smart home security method based on a block chain is characterized by comprising the following steps:
s1, judging whether an abnormal sound signal appears in the monitoring range through the sound positioning module, and if the abnormal sound signal is judged to be abnormal sound, rapidly controlling the camera module to rotate to the abnormal sound production direction for checking;
s2, the camera module collects videos and images in the abnormal sound production direction, carries out face recognition on the collected images, and if the recognition fails, carries out step S5; if successful, the alarm is released and the step S3 is performed;
s3, further recognizing the human face, if the human face is recognized as a child and moves to a balcony dangerous area, opening an ultrasonic ranging module of a balcony, and if the distance between the child and the balcony exceeds a preset threshold value, starting acousto-optic early warning to remind parents of possible danger and stopping in time;
s4, sending an illegal intrusion warning message to a networking warning module, and sending out an acousto-optic warning; and the alarm information is transmitted to the system host for subsequent analysis and processing, and the alarm is sent to the preset mobile phone number of the security personnel in a short message mode, and alarm positioning is provided.
7. The intelligent home security method based on the blockchain as claimed in claim 6, wherein: the step S1 includes:
s101, collecting sound signals by using a microphone array, wherein the microphone array comprises a plurality of microphone units;
s102, carrying out sound preprocessing on the sound signal: removing direct current components and trend terms from sound signals collected by a microphone; filtering out high-frequency clutter from the processed sound signal; finally, removing power frequency interference and harmonic waves by adopting a spectral subtraction method, and then carrying out normalization processing on the sound signal to obtain a processed signal s (m);
s103, judging whether the sound is abnormal sound or not, and locating the abnormal sound if the sound is judged to be abnormal sound.
8. The intelligent home security method based on the blockchain as claimed in claim 7, wherein: the step S103 includes: judging abnormal sound and positioning the abnormal sound:
and (3) judging abnormal sound:
(1) performing frame division processing on the processed signal s (m), calculating the average power of each frame of signal, wherein T is the time of each frame:
(2) performing frame division processing on a noise signal s (a) of a surrounding environment, calculating the average power of each frame signal, wherein T is the time of each frame:
(3) calculating the signal-to-noise ratio of the sound:detecting the signal-to-noise ratio, setting a threshold value, and marking the sound signal as abnormal sound if the threshold value is exceeded;
abnormal sound localization:
(4) dividing a plurality of microphones into a left array and a right array, wherein each array comprises 4 microphone units, establishing coordinates, determining relevant coordinate positions of the microphone units, and receiving signals of a kth microphone as follows:
sk(m)=s(m)*vn(m)+sn(a)
where s (m) is an abnormal sound signal, vn(m) is the unit impulse response, sn(a) A noise signal of the surrounding environment;
(5) calculating the energy of the abnormal sound signals received by the 2 microphone arrays, comparing the energy of the abnormal sound signals received by the two microphone arrays, and taking the side with larger energy as a positioning range;
let the energy of the abnormal sound signal received by the kth microphone be:
Rk=∑sk 2(m)
the energy received by the left microphone array is summed as:
the energy received by the right microphone array is then summed as:
comparison of RLeft side ofAnd RRight sideIf R is large or smallLeft side ofGreater than RRight sideIf the sum of the energy received by the left microphone array is larger than the sum of the energy received by the right microphone array, the positioning range is narrowed to the left area; if R isRight sideGreater than RLeft side ofIf the sum of the energy received by the right microphone array is larger than the sum of the energy received by the left microphone array, the positioning range is narrowed to the left area;
(6) the space is divided into a small grid by using a space clustering method, and abnormal sound position candidate points are determined, so that the number of the candidate points is effectively reduced, and each grid corresponds to the guiding time delay of a group of microphone arrays; calculating the output power of the microphone array to each position candidate point, namely the controllable response power according to a phase transformation weighted controllable response power algorithm, and finding out the maximum controllable response power;
(7) finding out an abnormal sound position candidate point corresponding to the maximum controllable response power by a table look-up or grid method to realize positioning;
obtaining the candidate point N of the abnormal sound position1Candidate point N2Candidate point N3And for the candidate point N1Candidate point N2Candidate point N3The abnormal sound is processed by framing, the frame length is taken as 20-50ms, each frame signal is multiplied by a smooth window function, and the two ends of the frame are smoothly attenuated to zero;
performing Fourier transform on the signal subjected to framing processing on the abnormal sound to obtain a frequency spectrum of each frame, performing FFT (fast Fourier transform) on the frequency spectrum to obtain a frequency domain of the frequency spectrum, drawing a power spectrum in the frequency domain, comparing the amplitudes of the power spectrum, wherein the maximum amplitude is the peak value of the frequency spectrum;
obtaining a candidate point N of the abnormal sound position1Spectral peak ofIs A1Candidate point N2Has a spectral peak value of A2Candidate point N3Has a spectral peak value of A3Comparison A1、A2、A3The maximum value is the final abnormal sound anchor point.
9. The intelligent home security method based on the blockchain as claimed in claim 6, wherein: in the step S2;
preprocessing the collected face image, wherein the preprocessing process comprises light compensation, gray level transformation, histogram equalization, normalization, geometric correction, filtering and sharpening of the face image;
extracting the features of the preprocessed face image, and comparing the extracted feature data of the face image with a feature template in a block chain database;
and setting a threshold, and outputting the result obtained by matching when the similarity exceeds the threshold.
10. The intelligent home security method based on the blockchain as claimed in claim 6, wherein: in the step S3;
when the image acquisition module identifies that a resident walks to the balcony, a first ultrasonic module located above the roof of the balcony is started, a first ultrasonic transmitting unit transmits ultrasonic waves to the head of the resident, timing is started at the same time of transmitting time, the head of the user is touched on the way and then the ultrasonic waves return immediately, a first ultrasonic receiving unit stops timing immediately after receiving reflected waves, the acquired data are transmitted to a calculating unit for calculation, and the calculating formula is as follows:
wherein L is the distance from the head of the resident to the first ultrasonic receiving module, namely the distance from the head of the resident to the roof of the balcony, c is the speed of the ultrasonic wave, and t is the time from the emission to the reception of the ultrasonic wave;
the distance from the balcony floor to the upper part of the balcony roof is known to be L, so that the height of the obtained resident is H-L;
setting a threshold value of H, and judging the safety of the resident when H is greater than the set threshold value; when H is smaller than a set threshold value, the resident is judged to be a child, and the resident is in an early warning state;
if the resident is judged to be a child, the second ultrasonic module is started, the second ultrasonic transmitting unit transmits ultrasonic waves to the child, timing is started at the same time of transmitting time, the child is touched on the way and then returns immediately, the second ultrasonic receiving unit stops timing immediately after receiving the reflected waves, the obtained data are transmitted to the calculating unit for calculation, and the calculating formula is as follows:
wherein S is the distance from the child to the second ultrasonic wave receiving module, i.e. the distance from the child to the balcony window, c is the speed of the ultrasonic wave, t1Time from transmission to reception of the ultrasonic wave;
setting a distance threshold value of 1.5 m, and triggering sound and light alarm if the distance L from the child to the balcony window is less than 1.5 m; and if the distance from the child to the balcony window is less than 1.5 m from the threshold value, the alarm is released.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011251820.XA CN112382051B (en) | 2020-11-11 | 2020-11-11 | Wisdom house security protection system based on block chain |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011251820.XA CN112382051B (en) | 2020-11-11 | 2020-11-11 | Wisdom house security protection system based on block chain |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112382051A true CN112382051A (en) | 2021-02-19 |
CN112382051B CN112382051B (en) | 2022-01-14 |
Family
ID=74578661
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011251820.XA Active CN112382051B (en) | 2020-11-11 | 2020-11-11 | Wisdom house security protection system based on block chain |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112382051B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117172989A (en) * | 2023-11-02 | 2023-12-05 | 武汉朱雀闻天科技有限公司 | Intelligent campus management method and system based on big data |
CN117876930A (en) * | 2024-01-11 | 2024-04-12 | 北京北测数字技术有限公司 | Video anomaly recognition processing method and system based on artificial intelligence |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003189139A (en) * | 2001-12-20 | 2003-07-04 | Matsushita Electric Ind Co Ltd | Camera controller by detection of acoustic fluctuation |
CN101771814A (en) * | 2009-12-29 | 2010-07-07 | 天津市亚安科技电子有限公司 | Pan and tilt camera with sound identification and positioning function |
CN201725030U (en) * | 2010-04-28 | 2011-01-26 | 上海理工大学 | Positioning system for home monitoring |
CN204442410U (en) * | 2015-02-13 | 2015-07-01 | 上海赢谊电子设备有限公司 | The intelligent home device that a kind of sound is auxiliary |
CN106408717A (en) * | 2016-10-09 | 2017-02-15 | 歌尔科技有限公司 | Method for monitoring independent outgoing of child and intelligent door system |
CN107040656A (en) * | 2017-03-31 | 2017-08-11 | 上海斐讯数据通信技术有限公司 | A kind of monitoring method |
CN110335437A (en) * | 2019-05-05 | 2019-10-15 | 广东白云学院 | A kind of wisdom house security system based on block chain |
-
2020
- 2020-11-11 CN CN202011251820.XA patent/CN112382051B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003189139A (en) * | 2001-12-20 | 2003-07-04 | Matsushita Electric Ind Co Ltd | Camera controller by detection of acoustic fluctuation |
CN101771814A (en) * | 2009-12-29 | 2010-07-07 | 天津市亚安科技电子有限公司 | Pan and tilt camera with sound identification and positioning function |
CN201725030U (en) * | 2010-04-28 | 2011-01-26 | 上海理工大学 | Positioning system for home monitoring |
CN204442410U (en) * | 2015-02-13 | 2015-07-01 | 上海赢谊电子设备有限公司 | The intelligent home device that a kind of sound is auxiliary |
CN106408717A (en) * | 2016-10-09 | 2017-02-15 | 歌尔科技有限公司 | Method for monitoring independent outgoing of child and intelligent door system |
CN107040656A (en) * | 2017-03-31 | 2017-08-11 | 上海斐讯数据通信技术有限公司 | A kind of monitoring method |
CN110335437A (en) * | 2019-05-05 | 2019-10-15 | 广东白云学院 | A kind of wisdom house security system based on block chain |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117172989A (en) * | 2023-11-02 | 2023-12-05 | 武汉朱雀闻天科技有限公司 | Intelligent campus management method and system based on big data |
CN117172989B (en) * | 2023-11-02 | 2024-02-02 | 武汉朱雀闻天科技有限公司 | Intelligent campus management method and system based on big data |
CN117876930A (en) * | 2024-01-11 | 2024-04-12 | 北京北测数字技术有限公司 | Video anomaly recognition processing method and system based on artificial intelligence |
Also Published As
Publication number | Publication date |
---|---|
CN112382051B (en) | 2022-01-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102737480B (en) | Abnormal voice monitoring system and method based on intelligent video | |
CN103839346B (en) | A kind of intelligent door and window anti-intrusion device and system, intelligent access control system | |
CN112382051B (en) | Wisdom house security protection system based on block chain | |
CN101494049B (en) | Method for extracting audio characteristic parameter of audio monitoring system | |
CN102013147B (en) | High voltage power transmission tower intelligent anti-theft method for supervising and device | |
CN103984315A (en) | Domestic multifunctional intelligent robot | |
CN110149604B (en) | Personnel detection method based on WIFI signal | |
CN106205606A (en) | A kind of dynamic positioning and monitoring method based on speech recognition and system | |
US20210217438A1 (en) | Door knock access control | |
CN107681784B (en) | Steel tower ground wire monitoring system and method based on multisource data fusion | |
CN102254394A (en) | Antitheft monitoring method for poles and towers in power transmission line based on video difference analysis | |
CN112907869B (en) | Intrusion detection system based on multiple sensing technologies | |
CN114594490A (en) | Laser external damage prevention method and device for power line | |
CN116506483B (en) | Intelligent park building security method based on wireless transmission | |
WO2023284764A1 (en) | Method and apparatus for detecting living body in vehicle by means of radar, and terminal device | |
CN111768580A (en) | Indoor anti-theft system and anti-theft method based on edge gateway | |
CN118015808A (en) | Intelligent security monitoring method and system | |
Zhao et al. | Event classification for living environment surveillance using audio sensor networks | |
CN114021097A (en) | Identity recognition method, device and system | |
CN104374885A (en) | Explosive gas dangerous sound resource function detection device | |
CN108806702B (en) | Detection method and device for ultrasonic voice hidden attack | |
CN116630853A (en) | Real-time video personnel tracking method and system for key transportation hub | |
CN206074032U (en) | A kind of body of wall vibration detecting system | |
RU59842U1 (en) | DEVICE FOR SEISMOACOUSTIC DETECTION AND CLASSIFICATION OF MOVING OBJECTS (OPTIONS) | |
CN118072447B (en) | Electric protective door safety monitoring system and method integrating infrared and ultrasonic sensors |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20211222 Address after: 510030 room 1101, No. 410, Dongfeng Middle Road, Yuexiu District, Guangzhou, Guangdong Applicant after: Guangzhou Times Property Management Co.,Ltd. Address before: 213000 No.118 Xuefu Road, Yincun Vocational Education Park, Zhonglou District, Changzhou City, Jiangsu Province Applicant before: Pan Xin |
|
GR01 | Patent grant | ||
GR01 | Patent grant |