TW201901626A - Security system and method capable of automatically and instantly processing environmental monitoring information to determine a level of security - Google Patents

Abstract

The present invention discloses a system. The system includes a sensing module, which is configured to receive a microwave signal from a moving object located in an environment, and acquire at least one optical image containing the moving object; and a processor, which is configured to determine a frequency information associated with the environment according to the microwave signal, determine the profile of the moving object according to the at least one optical image, and determine a level of security according to at least part of the frequency information and the profile of the moving object. Furthermore, the sensing module includes an image sensor or an infrared sensor. The image sensor is associated with one or more camera lenses. The infrared sensor includes an infrared thermographic device.

Description

Safety system and method

The present application relates to a security system, and more particularly to a security system that utilizes microwave signals and optical signals to identify human intrusions.

In recent years, security issues in different places, especially the issue of personnel intrusion, have attracted people's attention. A security system is needed to automatically and automatically process environmental monitoring information and to determine security conditions.

In accordance with an aspect of the present application, a system is provided that includes a sensing module configured to receive a microwave signal from a moving object located in an environment, and to acquire at least one of the moving objects An optical image; a processor configured to determine a frequency information associated with the environment based on the microwave signal, determine an outline of the moving object based on the at least one optical image, and according to at least a portion The frequency information and the contour of the moving object determine a security level.

According to another aspect of the present application, a method is provided, the method comprising receiving a microwave signal from a moving object located in an environment; acquiring at least one optical image containing the moving object; Determining, by a processor, a frequency information associated with the environment; determining an outline of the moving object based on the at least one optical image.

In accordance with yet another aspect of the present application, a computer readable storage medium storing executable instructions for causing a computer device to perform includes receiving a microwave signal from a moving object located in an environment Obtaining at least one optical image including the moving object; determining, according to the microwave signal, a frequency information associated with the environment; determining an outline of the moving object according to the at least one optical image; A security level is determined based on at least a portion of the frequency information and an outline of the moving object.

Some additional features of this application can be illustrated in the following description. Some additional features of the present application will be apparent to those skilled in the art from a review of the following description and the accompanying drawings. The features of the present disclosure can be realized and attained by the practice or use of the various methods, methods and combinations of the various embodiments described below.

100‧‧‧Security system

110‧‧‧ Sensor

120‧‧‧moving objects

120-1‧‧‧ people

120-2‧‧‧ animals

120-3‧‧‧Household items

130‧‧‧Announcer

140‧‧‧Network

150‧‧‧Mobile devices

210‧‧‧Test module

220‧‧‧ processor

230‧‧‧Input and output interface

240‧‧‧ memory

302~308‧‧‧Steps

410‧‧‧Microwave signal acquisition unit

420‧‧‧ Optical signal acquisition unit

430‧‧‧Image signal acquisition unit

440‧‧‧Infrared signal acquisition unit

510‧‧‧Signal Processing Unit

520‧‧‧Safety condition storage unit

530‧‧‧Decision unit

540‧‧‧Command Generation Unit

602~610‧‧‧Steps

702~710‧‧‧Steps

801‧‧‧Time domain waveform

802‧‧‧ peak signal

803‧‧‧ frequency domain waveform

804‧‧‧Time domain signal

805‧‧‧ frequency domain curve

806‧‧‧Time domain signal

807‧‧‧Fixed frequency signal

902~910‧‧‧Steps

952~962‧‧‧Steps

1002~1016‧‧‧Steps

1102~1112‧‧‧Steps

The drawings described herein are provided to provide a further understanding of the present application and constitute a part of this application. The illustrative embodiments of the present application and the description thereof are for explaining the present application and are not intended to limit the present application.

1 is a schematic diagram of an application scenario for a security system in accordance with some embodiments of the present application.

2 is a schematic diagram of a module for a security system in accordance with some embodiments of the present application.

3 is a schematic operational flow diagram of processing acquired ambient environmental signals in accordance with some embodiments of the present application.

4 is a schematic diagram of a detection module in accordance with some embodiments of the present application.

FIG. 5 is a schematic diagram of a processor in accordance with some embodiments of the present application.

6 is a flow chart of an exemplary security monitoring operation in accordance with some embodiments of the present application.

7 is a schematic flow diagram of microwave signal processing in accordance with some embodiments of the present application.

8-A is a timing diagram of a time domain waveform of a moving object microwave signal in accordance with some embodiments of the present application.

8-B is a schematic illustration of frequency domain waveforms of a moving object microwave signal in accordance with some embodiments of the present application.

8-C is a time-domain waveform diagram of a microwave signal of an irregular moving object in accordance with some embodiments of the present application.

8-D is a schematic diagram of frequency domain waveforms of a microwave signal of an irregular moving object in accordance with some embodiments of the present application.

8-E is a timing diagram of a time domain waveform of a regularly moving object microwave signal in accordance with some embodiments of the present application.

8-F is a schematic illustration of frequency domain waveforms of a regularly moving object microwave signal in accordance with some embodiments of the present application.

9-A is a schematic flow diagram of an image based imaging process in accordance with some embodiments of the present application.

9-B is a schematic flow diagram of an infrared based signal imaging process in accordance with some embodiments of the present application.

10 is a schematic flow diagram of a security system determining whether a person has invaded based on microwave signals and image signals, in accordance with some embodiments of the present application.

11 is a schematic flow diagram of a security system initiated intervention in accordance with some embodiments of the present application.

The words "a", "an", "the" and "the" In general, the terms "comprising" and "comprising" are intended to include only the steps and elements that are specifically identified, and the steps and elements do not constitute an exclusive list, and the method or device may also include other steps or elements. The term "based on" is "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment." Relevant definitions of other terms will be given in the description below.

Although the present application makes various references to certain modules in a system in accordance with an embodiment of the present application, any number of different modules can be used and operated in a security system. These modules are merely illustrative, and different modules of the system and method may use different modules.

Flowcharts are used in this application to illustrate the operations performed by the system in accordance with an embodiment of the present application. It should be understood that the preceding or lower operations are not necessarily performed exactly in the order. Instead, the various steps can be processed in reverse or simultaneously. At the same time, you can add other operations to these processes, or remove a step or a few steps from these processes.

1 is a schematic diagram of an application scenario for a security system in accordance with some embodiments of the present application. The security system 100 can communicate with the sensors 110, the alarms 130, the network 140, and the mobile device 150, and the like.

The sensor 110 can collect peripheral environment information. The sensor 110 may be one or more of a microwave sensor, an optical sensor, an ultrasonic sensor, a vibration sensor, a sound sensor, a gas sensor, or the like. Through the sensor 110, the security system 100 can acquire information about the moving object 120 in the surrounding environment, including the person 120-1, the animal 120-2, the fan, the curtain, etc. Household items 120-3. The security system 100 analyzes and processes the acquired information to determine whether there is a human intrusion, and alarms the intruder through the alarm 130. In some embodiments, the sensor 110 can include a microwave sensor, an infrared sensor, an image sensor, a sound sensor, a gas sensor, and the like.

Security system 100 can be connected to network 140. The manner in which the security system 100 is connected to the network 140 can be wired or wireless. In some embodiments, the security system 100 can transmit the collected information or the results of the processing to the network 140 for sharing information or assisting in the determination. In some embodiments, security system 100 obtains information over network 140, such as system upgrades, security condition adjustments, and the like. The network 140 can be a single network or a combination of multiple networks. The network 140 may include, but is not limited to, one or more of a regional network, a wide area network, a public network, a private network, a wireless area network, a virtual network, a metropolitan area network, and a public switched telephone network. The combination. The network 140 can include a variety of network access points, such as wired or wireless access points, base stations, or network switching points, through which the data sources can be connected to the network 140 and sent over the network.

The security system 100 can be connected to the mobile device 150. The security system 100 can provide the collected information or results of the processing to the mobile device 150 and receive user input through the mobile device 150, including control commands, parameter settings, and the like. In some embodiments, mobile device 150 can be a cell phone, a laptop, a tablet, a smart watch, and the like.

In some embodiments, the security system 100 can include a protective housing and an input and output panel. The protective casing can have a certain aesthetic or concealment, and is waterproof, moisture-proof, shock-proof, or anti-collision. The input and output panel can provide an interface for the user to input information to the security system 100 and/or the security system 100 to output information to the user. In some embodiments The input and output interface can be a touch display screen. In some embodiments, the security system 100 can be installed in an entrance to a building, a guardhouse, a living room in a home, a hallway, or a living room.

2 is a schematic diagram of a module for a security system in accordance with some embodiments of the present application. The security system 100 includes a detection module 210, a processor 220, an input and output interface 230, and a memory 240. The connection between modules in the system can be wired or wireless. Any module can be local or remote. The correspondence between modules can be one-to-one or one-to-many. For example, the security system 100 can include a plurality of detection modules 210 and a plurality of processors 220; a processor can correspond to a detection module to process the information it collects. For another example, the security system 100 can include a plurality of detection modules 210 and a processor 220; the detection modules 210 can send information to the processor 220 for processing.

The detection module 210 can acquire the surrounding environment information collected by the sensor 110. The detection module 210 can establish a communication connection with one or more sensors 110 and utilize the sensor 110 to monitor and collect information on objects in the environment. The objects in the environment may be static objects such as walls, doors and windows, furniture, stationary appliances, etc., or dynamic objects such as rotating fans, oscillating clocks, swaying plants, moving animals, people, and the like. The information received by the detection module 210 may include microwave signals, infrared signals, image signals, ultrasonic signals, audio signals, pressure signals, and the like. In some embodiments, the signal may be a signal that is output directly by an unprocessed sensor. In some embodiments, the signal may be a processed signal, such as a corresponding voltage, current signal, or the like. For example, the signal may be a voltage signal generated after processing by a processing element in the sensor. The information acquired by the detection module 210 can be sent to the processor 220 for processing, stored in the memory 240, and directly presented to the user through the input and output interface 230. In some embodiments, the detection module 210 can include one or more processing elements for the received The information is pre-processed and then sent to processor 220 for further processing.

The processor 220 can process signals, generate decision decisions or instructions, and the like. The processor 220 can process and/or logically determine the received signal or information and generate control decision information. The received signal or information may be acquired by the detection module 210 from the surrounding environment through the sensor 110, or input by the input/output interface 230, and the like. The processor 220 may process the signals acquired by the detection module 210 by using one or more methods, and the one or more processing methods may include fitting, interpolation, discrete, analog to digital conversion, Z conversion, Fourier transform, low pass filtering, Contour recognition, feature extraction, image segmentation, image enhancement, image reconstruction, non-uniformity correction, infrared digital image detail enhancement, etc. For example, the processor 220 may extract and recognize human face information, human body contour information, and the like in the collected image signals by means of feature extraction, contour recognition, and the like. The processor 220 can also logically process the information acquired through the input and output interface 230 and generate control or decision information. For example, after receiving the instruction of the calibration infrared sensor input by the user, the processor 220 generates control decision information and sends it to the infrared sensor. The control decision information may include methods and steps of infrared sensor calibration. In some embodiments, processor 220 may process signals acquired by detection module 210 (eg, microwave signals, optical image signals, ultrasonic signals, etc.). The processor 220 may determine whether the processed information satisfies one or more security conditions based on a preset security condition. The processor 220 can also determine the security level based thereon to generate control information corresponding to the current security level.

In some embodiments, processor 220 can passively receive information. In some embodiments, the processor 220 may actively acquire surrounding environment information or request user input according to the processing result or the user instruction. For example, the processor 220 can lock the suspect target based on the calculation and image processing, and generate an adjustment monitoring device or a sensor (such as a camera, etc.). An angle or position command to continue tracking and acquiring the target object signal. For another example, the processor 220 may transmit the acquired signal or the result of the processing to the input/output interface 230 or the mobile device 150, request the user to confirm whether it is a human intrusion, and generate corresponding control decision information.

Processor 220 can be a processing element or device. For example, the processor 220 may include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), and a system chip (system) in a device such as a computer. On a chip, SoC), microcontroller (MCU), etc. As another example, processor 220 can include a device such as a tablet, mobile terminal, or computer. As another example, processor 220 can be a specially designed processing element or device having special functions.

The input and output interface 230 can input information to the security system 100 or output information generated by the security system 100. The information input through the input and output interface 230 may include digits, text, images, video, sound, and the like. For example, the information may include numerical thresholds or ranges in security conditions, face information, iris information, fingerprint information, voice commands, gesture commands, and the like. The input and output interface 230 can obtain information from the user in the form of a user's handwriting operation, a touch screen operation, a mouse operation, a button or an operation on a button, a voice control operation, a gesture operation, a eye operation, and the like. The above input information may be saved to the memory 240 or sent to the processor 220 for processing or the like.

The security system 100 can output the processing result through the input and output interface 230 or send a request for obtaining information to the user. In some embodiments, the output information of the input and output interface 230 may be in the form of one or a combination of light, text, sound, image, vibration, and the like. In some embodiments, the input and output interface 230 can output information through a physical display, such as an LED. Indicator light, LCD display screen, OLED display screen, speaker. In some embodiments, the input and output interface 230 can be a virtual reality technology that outputs information, such as holographic images.

The input and output interface 230 can be or be included in a smart terminal such as a tablet, a mobile phone, a notebook, a smart watch, and the like. In some embodiments, the input and output interface 230 can be a combination of one or more of a touch screen, an LED display light, a speaker, a button, a button, and the like on the panel of the security system 100.

In some embodiments, the input and output interface 230 can establish a connection with the network 140 and input or output information via the network 140. In some embodiments, the input and output interface 230 can be wirelessly coupled to the user mobile device 150. For example, the user can receive information output by the security system 100 via the mobile device 150. For another example, the user can send user commands over the network 140 to implement remote control of the security system 100.

The memory 240 can be used to store information acquired and generated by the security system 100. In some embodiments, the information that the memory 240 can store includes the surrounding environment information acquired by the detection module 210, the processing result generated by the processor 220, and the user input information received by the input/output interface 230. The form in which the memory 240 stores information may be text, digits, sounds, images, and the like. In some embodiments, the memory 240 may include, but is not limited to, various types of storage devices such as solid state hard disks, mechanical hard disks, USB flash memory, SD memory cards, optical disks, and random access memory (random-access). Memory, RAM) and read-only memory (ROM). In some embodiments, the memory 240 may be a storage device inside the system, an external storage device of the system, a network storage device outside the system (such as a memory on a cloud storage server, etc.).

It should be noted that the above description of each module in the security system 100 is only Some specific embodiments should not be considered as the only feasible solution. Obviously, it will be apparent to those skilled in the art that after understanding the basic principles of the various modules, various modifications and changes may be made to the configuration of the security system 110 without departing from this principle. However, these modifications and changes are still within the scope of the above description.

For example, the security system 100 can also include a power module for independently powering the system to avoid the risk of power outages. For example, the security system 100 may further include an anti-interference module for resisting interference devices carried by the intruder, and ensuring that the security system 100, sensors, and alarms work normally. For another example, the detection module 210 can receive a chemical signal, a light signal, a temperature signal, a humidity signal, and the like.

FIG. 3 is a schematic operational flow chart of processing the collected ambient environment signals by some embodiments of the present application. Step 302 can include obtaining peripheral environment information through the sensor 110. The peripheral information acquired by the security system 100 can include one or more characteristics of objects in the environment. These characteristics can be physical or chemical information such as the contour of the object, heat radiation, color, sound, shape characteristics, motion, motion characteristics, and odor. In some embodiments, the security system 100 can acquire microwave signals through the microwave sensor to identify moving objects. In some embodiments, the security system 100 can acquire an object infrared signal through an infrared sensor to determine whether a person or an animal is present in the surrounding environment. In some embodiments, the safety system 100 can obtain the pressure or deformation of the door and window through the pressure sensor to determine whether the door and window are opened by a normal route or the like. In some embodiments, the security system 100 can also acquire image information of the target object through the image sensor for analyzing the contour of the object.

Step 304 can include the security system 100 processing the above information and generating a processing result. For different types of information, the security system 100 can use different methods for processing. These methods may include numerical calculation methods, waveform processing methods, image processing methods, and the like. Methods of numerical calculations may include fitting, normalization, integration, principal component analysis, discretization, and the like. Waveform processing methods may include Fourier transform, wavelet transform, low pass filtering, analog digital conversion, chirp, and the like. Image processing methods may include image frame difference, blur recognition, image denoising, multi-resolution processing, region segmentation, bar graph enhancement, convolution back projection reconstruction, model base coding, and the like.

At step 306, the security system 100 can determine whether one or more security conditions are met based on the processing results described above. The one or more security conditions may include a threshold corresponding to the processing result, a time domain frequency domain characteristic of the microwave signal, an image shape characteristic, a sound, a facial feature, and the like. In some embodiments, the safety condition may be that the aspect ratio is less than 1, the temperature in the infrared thermal imaging is lower than 36 ° C, the moving object in the image, the contour in the image is non-human contour, the facial feature is matched with the user or the sound feature is User matches, etc. The above security conditions may be from user input, preset preset information in the system, and adaptive adjustment by the system according to surrounding environment information.

In some embodiments, the security system 100 can communicate the obtained information or the results of the processing to a user or security authority to assist in determining whether to invade. For example, in some special cases that are critical to the security conditions, the security system 100 can present the currently acquired signals such as sound, image, microwave, infrared, or processed data to the user through the user mobile device 150 or The remote end of the network 140 is presented to the security mechanism for assisting in determining whether to invade.

At step 308, based on the above determination, the security system 100 can determine the current security level. The security level can be one of multiple security modes, such as hibernation, alerting, threats, intrusions, and the like. Sleep mode can be used when the user is at home to reduce or avoid the user at home Interference with free activities. The alert mode may correspond to a security level at which the security system 100 continuously monitors surrounding environmental information and has no anomalies (eg, when no one is at home, or at night). The threat mode may correspond to a security level determined by the security system 100 when it is determined that an intruder may be present. The intrusion mode may correspond to a security level determined by the security system 100 to identify a high risk situation in which a human intrusion exists. The several levels of security described above are for illustrative purposes only and are not intended to limit the scope of the application. Security system 100 may also include other levels of security.

In some embodiments, one security level may correspond to one security condition or a combination of multiple security conditions. A security level can be determined by satisfying one or more of the above security conditions. For example, the security system 100 identifies the moving object by the result of the microwave signal processing, and determines that the temperature of the object is greater than the set threshold by the infrared signal, and can determine that the security level is a threat. For another example, the security system 100 determines a moving object, and the moving object performs regular motion, and then the security level can be determined to be an alert. The correspondence between the security level and the security condition may come from the user setting, the system presets the default form, and the system adaptively adjusts according to the surrounding environment.

It should be noted that the above description of the workflow of the security system 100 is merely a specific embodiment and should not be considered as the only feasible solution. Obviously, those skilled in the art, after understanding the basic principles, may make various modifications and changes in the form and details of the workflow or algorithm of the security system 100 without departing from this principle. However, these modifications and changes are still within the scope of the above description.

In some embodiments, the process of determining whether to meet or violate the above-described security conditions may also be replaced by determining one or more dangerous conditions. When the processing result satisfies a dangerous condition or a combination of multiple dangerous conditions, a safety level can be determined. For example, security system 100 The medium signal processing results satisfy the contour aspect ratio greater than 1 and the infrared thermal imaging temperature is higher than 36 °C. The two safety conditions can determine the safety level as the intrusion. For another example, if the signal processing result in the security system 100 satisfies the dangerous condition that an object is an irregular moving object, the security system 100 determines that the current security level is a threat, and performs comparison of other dangerous conditions until a final security level is determined. .

4 is a block diagram of a detection module in accordance with some embodiments of the present application. The detection module 210 may include a microwave signal acquisition unit 410 and an optical signal acquisition unit 420. The optical signal acquisition unit 420 may further include at least one of the infrared signal acquisition unit 430 and the image signal acquisition unit 440.

The microwave signal acquisition unit 410 can be used to acquire signals of the microwave sensor. The microwave signal acquisition unit 410 can be communicatively coupled to one or more microwave sensors. The microwave signal acquired by the microwave signal acquiring unit 410 may be a microwave signal output by the microwave sensor, or may be a signal generated by a pre-processing. In some embodiments, the microwave signal acquired by the microwave signal acquisition unit 410 may be an analog signal, a digital signal, or the like. In some embodiments, the analog signal can be a voltage waveform.

In some embodiments, the microwave waveform reflected by the stationary object may be a microwave waveform that is smooth or slightly varying over time. In some embodiments, the amplitude and frequency of the microwave signal returned via the moving object reflection may change over time. The relationship of the microwave signal over time can be related to the motion state of the object (eg, direction, velocity, or acceleration, etc.). In some embodiments, the microwave signal acquisition unit 410 may preprocess the acquired microwave signal and then send it to the processor 220 for further signal processing or logic determination.

The image signal acquisition unit 430 can be used to acquire a signal of the image sensor. Figure The image signal acquisition unit 430 can be in communication with one or more image sensors and acquire image signals generated by the one or more image sensors. In some embodiments, the image signal can be an image made using visible light. In some embodiments, the image signal may be an image formed by using electromagnetic waves of other wavelength bands to assist visible light, such as an image formed by an infrared sensor to assist an image sensor, or the like. An image sensor can be associated with one or more lenses. In some embodiments, there may be multiple image sensors that may be associated with multiple lenses. In some embodiments, a plurality of image sensors and a plurality of lenses may be utilized to obtain surrounding environment information including object distances. In some embodiments, an infrared sensor and one or more image sensors and associated lenses may also be utilized to obtain peripheral environmental information. In some embodiments, the image signal acquired by the image signal acquisition unit 430 may be a digital image.

In some embodiments, the image information acquired by the image signal acquisition unit 430 may include surrounding environment information within a certain angle. This angle can be related to the imaging angle of the image sensor. In some embodiments, the imaging angle can be any angle from 0 degrees to 360 degrees. In some embodiments, the imaging angle can be 135 degrees. In some embodiments, the imaging angle can be 180 degrees.

The infrared signal acquisition unit 440 can acquire a signal of the infrared sensor. The infrared signal acquisition unit 440 acquires an infrared signal of the surrounding environment by establishing a communication connection with the infrared sensor. The infrared signal can be related to the thermal radiation of objects in the surrounding environment. In some embodiments, an infrared image of the object can be obtained by correlating the thermal radiation of the object in the environment with the temperature by a calibration method. In some embodiments, the obtained infrared image may be a temperature distribution image of the corresponding object. In some embodiments, the temperature can be used to image the infrared image Higher objects are distinguished from the background environment or objects with lower temperatures. In some embodiments, the infrared signal acquisition unit 440 can preprocess the acquired infrared signals and then send them to the processor 220 for further signal processing or decision making.

The infrared signal received by the infrared signal acquisition unit 440 may be derived from an infrared imager, an infrared thermometer, an infrared radiation meter, an infrared scanner, or the like. The received infrared signal may be short-wave infrared (wavelength of 1 to 2.5 micrometers), medium-wave infrared (wavelength of 3 to 5 micrometers), long-wavelength infrared (wavelength of 8 to 14 micrometers), or infrared signals in other wavelength bands.

5 is a schematic diagram of a processor of some embodiments of the present application. The processor 220 may include a signal processing unit 510, a security condition storage unit 520, a decision decision unit 530, and an instruction generation unit 540.

Signal processing unit 510 can process signals acquired by security system 100. The signal processing unit 510 can receive the signal acquired by the detection module 210. The signal may be one or more of a microwave signal, an image signal, an infrared signal, an audio signal, an ultrasonic signal, a gas signal, and the like. In some embodiments, signal processing unit 510 can also acquire signals through input and output interface 230. For example, when the security system 100 initiates an intervention, it may authenticate by collecting some image signals or other signals of the invading object. The acquired image signals or other signals may include facial images, fingerprint images, retinal images, voiceprint signals, and the like.

The signal processing unit 510 can process the signals and extract valid information in one or more ways. The one or more processing methods may include numerical calculations, waveform processing, image processing, and the like. Numerical calculation methods may include principal component analysis, fitting, repeated operations, discrete, interpolation, and the like. The waveform processing method may include analog digital conversion, wavelet conversion, Fourier transform, low pass filtering, and the like. Image processing methods may include moving target recognition, image segmentation, Image enhancement, image reconstruction, non-uniformity correction, infrared digital image detail enhancement, etc. In some embodiments, signal processing unit 510 can process the microwave signal using the methods described above. The processing result may include information such as whether there is a moving object in the environment, a fixed frequency component information of the moving object, and a frequency domain signal after filtering the fixed frequency. In some embodiments, signal processing unit 510 can process the image signal. The processing result may include information such as a texture feature, a shape feature, and a contour feature of the image. In some embodiments, signal processing unit 510 can process the infrared image. The processing result may include information such as a color feature, a contour feature, and the like of the image.

In some embodiments, signal processing unit 510 can include a microprocessor, a single-chip microcomputer, a tablet, a computer, or a specially designed processing element or device having special functions.

The security condition storage unit 520 can store security condition information. The information can be provided to the decision unit 530 in the processor for determining whether there is a security risk in the surrounding environment, such as a human intrusion. The security condition information stored by the security condition storage unit 520 may be a numerical range or a critical value, a time domain frequency domain characteristic of the microwave signal or the sound signal, a color, a texture, a shape, a contour, and the like of the image. In some embodiments, the safety condition information may include the absence of a moving object, the contour aspect ratio of the object being less than 1, the temperature of the object being lower than 36 ° C, the moving object in the image, the contour of the image being non-human contour, facial features and data Library matching and sound features match the database and more. In some embodiments, the security condition includes a primary security condition and one or more secondary security conditions. In some embodiments, the primary security condition may be related to a human intrusion. For example, the primary safety condition may be that no moving object is detected. Based on the determination of the primary security condition, the security system 100 can initiate one or more functions. In some embodiments, the primary safety condition is In the event of a violation, the security system 100 begins to analyze and determine the acquired multiple signals to determine whether there is a human intrusion or misjudgment; in some embodiments, the secondary security conditions may be related to non-personal intrusion factors that affect the security system 100. Such as regular movement of the fan, the movement of pets at home, swinging curtains, shaking plants, and so on. The one or more secondary safety conditions are met to rule out the influencing factors for the one or more secondary safety conditions.

The security condition storage unit 520 can use one or more storage media that can be read or written, such as but not limited to static random access memory (SRAM), random access memory (random-access memory, RAM), read-only memory (ROM), hard disk, flash memory, and the like. In some embodiments, the security condition storage unit may be a storage local to the security system, an external storage, a storage connection (eg, cloud storage, etc.) via the network 140, and the like.

Decision unit 530 can make a determination of the signal processing result or user input and generate decision information. The decision unit 530 can perform the determination of the security level of the surrounding environment based on the result generated by the signal processing unit 510 to generate corresponding decision information. In some embodiments, the decision unit 530 can read the calculated and processed information from the signal processing unit 510 and compare it with the security condition information stored by the security condition storage unit 520 to determine whether one or more security conditions are met or violated. To determine the current security level. In some embodiments, decision unit 530 can generate further decision decisions based on the current level of security. For example, when the decision unit 530 determines that the current security level is a threat, the decision to track or lock the target may be further made.

Decision unit 530 can also make decisions based on information or instructions entered by the user via input/output interface 230 or mobile device 150. For example, when the user requests image information of a monitored area through the mobile device 150, the decision unit 530 can generate image information. The image information of the monitoring area received by the obtaining unit 430 is transmitted to the decision information of the mobile device 150.

The decision unit 530 can include a programmable logic device (PLD), an application specific integrated circuit (ASIC), a central processing unit (CPU), and a single chip microcomputer. , SCM), system on a chip (SoC), and the like.

The instruction generation unit 540 can generate a control instruction executable by the security system 100 or an external device based on the decision information generated by the decision unit 530. The control command can include operational information and address information. Operational information can indicate the method and function of the operation. The address information can point to the object of the operation. In some embodiments, the instructions generated by the instruction generation unit 540 can be sent to one or more of the sensors 110 and control the corresponding sensor 110 to acquire environmental information. In some embodiments, the control commands sent to the sensor 110 can also control the switches of the sensor 110, adjust the parameters of the sensor 110, adjust the signal acquisition angle of the sensor 110, the orientation, and the like. In some embodiments, the instructions generated by the instruction generating unit 540 can be sent to the user input and output interface 230 for opening the user interface, and reading the user input or outputting some processed information to the user.

6 is a flow chart of an exemplary security monitoring operation in accordance with some embodiments of the present application. Step 602 can include the processor 220 obtaining peripheral environment information from the sensor 110. The signals acquired by the processor 220 may include microwave signals, infrared signals, image signals, audio signals, and the like. The signal acquired by the processor 220 may be an unprocessed signal output by the sensor 110, or a signal generated after pre-processing (such as a voltage or current signal generated after pre-processing, etc.). In some embodiments, the processor 220 may preferentially acquire the microwave signal; after satisfying certain conditions, The processor 220 can acquire signals of other sensors. In some embodiments, the condition may be a microwave signal or the result of its processing is against the primary safety condition.

Step 604 can include the processor 220 processing the acquired signal to generate processing result information. The processor 220 can process the different classes of signals in one or more different ways. In some embodiments, processor 220 processes the microwave signal by one or more methods to obtain a motion state of the target object. The one or more processing methods may include Fourier transform, wavelet transform, Z transform, low pass filtering, analog digital conversion, and the like. The microwave signal processing result generated by the processor 220 may include whether there is a moving object in the environment, fixed frequency component information of the moving object, a frequency domain signal after filtering the fixed frequency, and the like.

In some embodiments, processor 220 may process the image signal by one or more methods to extract image features, identify images. The one or more processing methods include moving object recognition, image enhancement, image reconstruction, image segmentation, geometric processing, arithmetic processing, image restoration, image encoding, and the like. The moving object recognition may include an interframe difference method, a background difference method, an optical flow method, an edge detection method, a hybrid Gaussian model method, and the like. Image enhancement methods may include bar graph enhancement, pseudo color enhancement, grayscale windows, and the like. The image reconstruction method may include an algebra method, an inverse algorithm, a Fourier back projection method, a convolution back projection method, and the like. The image segmentation method may include region-based segmentation and morphological watershed-based segmentation and the like. Through processing, processor 220 can generate a result that includes one or more features of the image described above. The one or more features can include contour shapes, colors, textures, area shapes, spatial relationships, and the like. In some embodiments, the processor 220 may acquire the contour of the moving object using the processing method described above. In some embodiments, the processor 220 can process the user authentication information by using the above processing method. In some embodiments, the verification information is a face image, a fingerprint image, or a retina image or the like.

In some embodiments, the processing of the infrared signal by the processor 220 may employ non-uniformity correction, infrared digital image detail enhancement, or the processing method of the image signal mentioned above, and the like. The non-uniformity correction may include a calibration-based correction method and a scene-based correction method, and the infrared digital image detail enhancement may include a histogram equalization (HE) or an unsharp masking (UM). And an image enhancement method for simulating human visual features. The processing results generated by the processor 220 may include color features of the image, contour information, and the like.

In some embodiments, processor 220 can preferentially process microwave signals; after certain conditions are met, other signals are processed. In some embodiments, the condition may be against the primary security condition.

Step 606 can include the processor 220 comparing the processing result to one or more security conditions to determine whether the security condition is met or violated. In some embodiments, the security condition may include a primary security condition and one or more secondary security conditions. In some embodiments, the primary safety condition can be used to determine if there is a moving object in the surrounding environment. In some embodiments, the acquired microwave signal can be a voltage waveform. When the magnitude of the voltage waveform is greater than a certain threshold, the safety system 100 determines that a moving object exists in the surrounding environment, violating the primary safety condition. In some embodiments, the threshold is 700 mV. In some embodiments, one or more of the above secondary safety conditions may be used to exclude certain factors that affect the determination of the security system 100. These factors may include a rotating fan, a oscillating pendulum, a swaying plant, etc., in some embodiments, the one or more secondary safety conditions may include the presence of a fixed frequency component, an image aspect ratio of less than 1, and audio information. Matching, fingerprint image matching, retinal image matching, etc. For example, in some scenarios, the security system 100 performs a Fourier transform on the microwave signal of a moving object in the environment. The fact that the spectrum contains only one fixed frequency violates the primary safety condition and satisfies a secondary safety condition. For another example, the security system 100 processes the acquired optical image information using an image interframe difference method and matches the extracted moving object contours with the human contours in the database. A matching failure satisfies a secondary security condition. With this secondary safety condition, it is possible to judge and exclude the situation in which the moving object is a human body.

In some embodiments, processor 220 only acquires and processes microwave signals before the primary security condition is violated. In some embodiments, after the primary security condition is violated, processor 220 begins processing other signals and compares them with secondary security conditions to determine if one or more secondary security conditions are met. In some embodiments, the results generated by processor 220 violate the primary security condition to generate command information to initiate one or more sensors 110, which may include an infrared sensor, image sense Detector, sound sensor, etc.

Step 608 can include the processor 220 determining the current security level by the above determination. In some embodiments, one security level may correspond to one or more security conditions. In some embodiments, the primary security condition is violated to determine a level of security. For example, the security system 100 identifies a moving object by microwave signal processing results, violating the primary security condition; and determining that the security level is an intrusion when no other secondary security conditions are met. In some embodiments, a security level may be determined in violation of the primary security condition and satisfying one or more secondary security conditions. In some embodiments, after the primary security condition is violated, the processor 220 may sequentially compare the processing result with a preset security condition, and after completing the comparison with all the security conditions, may determine a security level. In some embodiments, processor 220 may compare the processing results to the specified one or more security conditions to determine a security level.

Step 610 can include the processor 220 generating a one based on the current security level. The corresponding instruction information. The command information can be received and executed by the corresponding hardware. In some embodiments, when the current security level is an intrusion and the security system 100 fails to intervene, the processor 220 can generate command information for the alert. In some embodiments, the command information can be sent to the alarm 130. In some embodiments, when the processor 220 determines that there is an intrusion, the alarm 130 can alert by local or remote form and can take some security measures. In some embodiments, the alarm can be audible or flashed according to the command information, such as providing a high-decibel beep. In some embodiments, the alarm can also alert the security, police, etc. via the network in accordance with the instructions. In some embodiments, the alarm 130 can also take some security measures, such as locking doors and windows (eg, locking doors and windows of the invaded area, etc.), turning on the lighting system, etc., depending on the instructions.

It should be noted that the above description of the security monitoring workflow is only some specific embodiments and should not be regarded as the only feasible solution. Obviously, those skilled in the art, after understanding the basic principles, may make various modifications and changes in the form and details of the security monitoring workflow or algorithm without departing from the principle. However, these modifications and changes are still within the scope of the above description.

In some embodiments, a method of combining a primary security condition with one or more secondary security conditions to determine a security level may be replaced by other methods. These methods can be a combination of one or more dangerous conditions corresponding to a security level. If the signal processing result satisfies one or more dangerous conditions, the security system 100 can confirm a security level. For example, if the contour aspect ratio is greater than 1, the infrared thermal imaging temperature is higher than 36 ° C, or the dangerous condition is met, and the contour of the image matches the human contour, the safety system 100 determines. The security level is intrusion. For another example, if there is a dangerous condition in which the facial features are not matched or the sound features are not matched, the security system 100 determines the security level. For threats, etc.

In some embodiments, one of the first safety conditions may be one of an infrared signal having no object having a temperature greater than 36° C., an image contour having no contour of the human body, and an image aspect ratio having an aspect ratio of less than 1 . . In some embodiments, when the processing results in the security system 100 violate the primary security conditions, the current security level can be set as a threat and the other processing results are compared until the final security level is determined.

7 is a schematic flow diagram of microwave signal processing in accordance with some embodiments of the present application. Step 702 can include the security system 100 acquiring a microwave signal. The microwave signal acquired by the security system 100 can be obtained after being reflected by one or more objects in the surrounding environment. In some embodiments, the objects in the surrounding environment are all static objects, and the waveform of the obtained time domain microwave signal is relatively stable or slightly changed with time, and the frequency does not change. In some embodiments, the surrounding environment includes one or more moving objects, and the amplitude and frequency of the microwave signals occur in relation to the motion characteristics of the moving object. The microwave signal acquired by the security system 100 may be an analog signal or a digital signal obtained through some processing. In some embodiments, the process can be analog to digital conversion.

Step 704 can include performing time domain frequency domain conversion on the acquired microwave signals. The security system 100 can convert the acquired time domain microwave signals into frequency domain signals by some conversion. The conversion may include Fourier transform, wavelet transform, Z transform, and the like. In some embodiments, the security system 100 can preprocess the acquired analog signal and then obtain the frequency domain signal using the conversion method described above. In some embodiments, the pre-processing may be to sample it to discretize it. In some embodiments, the pre-processing may be analogous to digital conversion. In some embodiments, the microwave signal acquired by the security system 100 is a digital signal, which can be directly passed through the Fourier transform. Convert it to a frequency domain signal. Figure 8 includes a detailed illustration of the processing of microwave signals using Fourier transform.

8 is a schematic diagram of spectral analysis of a microwave signal using Fourier transform, in accordance with some embodiments of the present application. The security system 100 acquires microwave signals of the surrounding environment through the microwave sensor 110. In some embodiments, the microwave signal can be a time domain waveform 801, as in Figure 8-A. By performing a Fourier transform on the microwave signal, it can be converted from the time domain waveform 801 to the frequency domain waveform 803, as shown in Figure 8-B. The Fourier transform may be a continuous Fourier transform, a discrete Fourier transform, a short time interval Fourier transform, or a fast Fourier transform. In some embodiments, the frequency domain waveform 803 can be obtained by discretizing the time domain waveform 801 and then performing discrete Fourier transform or fast Fourier transform. The time domain signal 803 spectrum may be expanded to include a peak signal 802. After separating the peak signal 802 in the spectrum, the frequency domain signal 803 becomes a frequency curve 805, as shown in Figure 8-D. The time domain signal corresponding to the frequency domain curve 805 is 804, as shown in Figure 8-C. The peak signal 802 corresponds to a fixed frequency signal 807, as shown in Figure 8-F. The time domain signal corresponding to the fixed frequency signal 807 is 806, as shown in Figure 8-E. The frequency domain signal 805 corresponds to an irregular moving object, such as a person, an animal, a curtain, etc., and the fixed frequency signal 807 corresponds to a regular moving object, such as a fan, a pendulum clock, and the like. In some embodiments, the spectrum analysis of the microwave signal described above can be performed by computer program or software, such as Matlab, or by spectrum analysis components or devices, such as a spectrum analyzer.

Returning to Figure 7, step 706 can include determining if a fixed frequency is present in the frequency domain signal. In some embodiments, if a fixed frequency is present in the frequency domain signal, the corresponding secondary safety condition is met, and the influence of the regular moving object on the security system 100 can be eliminated. Through the frequency domain analysis described above, if there is a fixed frequency in the frequency domain signal, the fixed frequency is filtered out in step 708. The method of filtering out the fixed frequency can be implemented by computer program or software (such as MatLab). Etc.), implemented by physical components or equipment (such as traps, etc.).

If there is no fixed frequency in the microwave signal or the fixed frequency present has been filtered out in step 708, then in step 710 the security system 100 determines if there is still a moving object in the surrounding environment. In some embodiments, the microwave signal filtered by the fixed frequency is compared with the microwave signal emitted by the microwave sensor, and if other frequency information still exists, it can be determined that there is an irregular moving object, such as an intruder or an invading animal. Fluttering curtains, swinging plants, etc. In some embodiments, there are moving objects in the surrounding environment that violate the primary safety conditions. In some embodiments, if the processing result of the microwave signal violates the primary security condition, the security system 100 can begin to compare the processing result with other secondary security conditions.

9-A is a schematic flow diagram of an image based imaging process in accordance with some embodiments of the present application. Step 902 can include the security system 100 acquiring an image signal generated by the image sensor. The image signal may be an image signal formed using visible light, and other light sources may assist an image signal formed by visible light or the like. In some embodiments, an image signal formed using visible light may be provided by one image sensor and one or more associated lenses. In some embodiments, the image signal may also be provided by a plurality of image sensors and a plurality of associated lenses. In some embodiments, the image signal formed by other light sources to assist visible light may be provided by an infrared sensor and one or more image sensors and their associated one or more lenses. The images acquired by the security system 100 may include static objects, moving objects, and the like. In some embodiments, one or more moving objects may be included in the image acquired by the security system 100. At this point, the image signal may be distorted or distorted; the security system 100 may preprocess the image signal using one or more methods. The one or more pre-processing methods may include panoramic distortion correction, distortion correction, pseudo color enhancement, bar graph enhancement, subtraction processing, Fourier back projection, Convolution back projection, etc.

In step 904, the security system 100 can obtain object contour information. The method for obtaining the contour information of the object may include a boundary feature method, a Fourier feature description method, an interframe difference method, a background difference method, a mixed Gaussian model method, an optical flow method, an edge detection method, and the like. The contour of the moving object can be obtained by one or more of an interframe difference method, a background difference method, a mixed Gaussian model method, an optical flow method, an edge detection method, and the like. In some embodiments, the security system 100 can acquire the contour information of the moving object using an interframe difference method. In some embodiments, the interframe difference method may perform differential operations on images of moving objects acquired at different times to obtain contour information of the moving object.

Step 906 can include determining whether the contour information of the object satisfies certain conditions. In some embodiments, the condition may be whether the contour is a shape, the aspect ratio is at or beyond a certain range, and the like. In some embodiments, the above shape or range may be set according to the size of a person, pet, or other animal. In some embodiments, the security system 100 determines whether the contour of the object is a human contour or whether the contour aspect ratio meets the size of the person. In some embodiments, the security system 100 determines if the aspect ratio of the contour of the object is greater than a threshold. For example, the threshold may be a positive number such as 0.5, 0.8, 1, 1.5, or the like.

When the contour of the object does not satisfy the given condition, the flow proceeds to step 908 where the security system 100 determines the animal's invasion. In some embodiments, the security system 100 determines that the animal invasion meets the corresponding secondary safety condition, and the effect of the animal on the security system 100 determination can be ruled out. In some embodiments, the user may decide whether the security system 100 determines whether an animal invasion meets the secondary security condition based on whether there is a pet in the household. For example, if there is no pet in the home, the user can cancel the secondary safety condition; the security system 100 can take the package when the animal is detected Some measures including warnings. In some embodiments, after determining that the animal has invaded, the security system 100 can alert via a buzzer. In some embodiments, the security system 100 can utilize a buzzer, flash, or the like to drive invading animals. In some embodiments, the security system 100 can lock the doors and windows of the invaded area, limiting the invading animals to a range.

If the obtained aspect ratio is less than the threshold, the flow proceeds to step 910 where the security system 100 determines the intrusion of the person and initiates the intervention mode. A detailed description of the intervention initiated by the security system 100 can be found in other portions of this application, as shown in Figure 11 and its description.

9-B is a schematic flow diagram of an infrared based signal imaging process in accordance with some embodiments of the present application. At step 952, the security system 100 can acquire an infrared signal generated by the infrared sensor. The security system 100 can obtain thermal radiation generated by an object through an infrared sensor. In some embodiments, the distribution of radiant energy of the object can be captured by certain elements, such as photosensitive elements, to obtain an infrared signal. This infrared signal corresponds to the heat distribution on the surface of the object. By calibrating the infrared signal, the surface heat distribution of the object can be correlated with temperature. In some embodiments, the infrared signal can be presented in the form of an infrared image. By calibrating the infrared signal, the image color information can be used to reflect the heat distribution of the object. In some embodiments, the color in the infrared image corresponding to the human or animal may be red by temperature calibration, and the color in the corresponding infrared image of the plant, furniture, etc. may be blue.

In some embodiments, the security system 100 pre-processes the acquired infrared signals by one or more methods. The preprocessing method may include an infrared signal processing method such as non-uniformity correction, infrared digital image detail enhancement, or a method used for preprocessing of the image signal described above. The non-uniformity correction may include a calibration-based correction method, a scene-based correction method, and the like. Infrared digital image detail enhancements can include bar graph equalization (HE), unsharp masking Method (UM) and image enhancement methods for simulating human visual features.

At step 954, the security system 100 determines if the infrared image satisfies certain conditions. The condition may be whether an object having a temperature above a certain threshold or range is present in the infrared image. The threshold or range can be set according to the temperature of the human or animal body. For example, the threshold may be set to 36 ° C, or between 35 ° C and 40 ° C, and the like. The threshold can be set by the user, the system preset value, the system adaptive adjustment, and the like. In some embodiments, the threshold is related to temperature calibration. The safety system 100 can adaptively adjust the temperature or critical value of an object in an image by acquiring factors that affect temperature calibration, such as air humidity, ambient temperature, angle of the infrared sensor to the surface of the object, and the like.

If the security system 100 determines that the acquired infrared image does not satisfy the condition, the security system 100 determines that no person or animal exists in the surrounding environment, and the corresponding secondary security condition is satisfied. The corresponding flow returns to step 952, and the security system 100 continues to acquire the temperature of the object in the environment and compares it with the preset conditions. If it is judged that the acquired infrared image satisfies the condition, the security system 100 determines that a person or an animal exists in the surrounding environment and does not satisfy the corresponding secondary safety condition. The corresponding flow proceeds to step 956 where the contour of the object is acquired in the infrared image. In some embodiments, the method for the security system 100 to acquire the contour of the object in the infrared image may be the boundary feature method, the Fourier feature description method, the interframe difference method, the background difference method, the mixed Gaussian model method, and the optical flow method as described above. One or more of image contour feature extraction methods such as edge detection. In some embodiments, the security system 100 can process by extracting color features in the infrared image to obtain an outline of the object in the infrared image. For example, the security system 100 can extract the contour information of a person or an animal by using a color bar graph or the like by using different colors of different colors in the infrared image. Step 958, step 960 and step 962 are respectively associated with Figure 9-A. The processing methods of step 906, step 908, and step 910 are similar, and are not described herein again.

It should be noted that the security system 100 can obtain the surrounding environment information and determine whether there is a human intrusion, and the microwave signal described in FIG. 7 can be compared with the optical signal described in FIG. 9-A or FIG. 9-B. At least one combination is used to determine the level of security. In some embodiments, the level of security can be determined using microwave signals and infrared signals. In some embodiments, the microwave signal can be used as a primary safety condition or a primary method of judgment, and the infrared signal can be used as a secondary safety condition or a method of elimination. For example, it is determined by the microwave signal whether there is a moving object, such as the presence of a moving object, which violates the primary safety condition. Based on the situation in which the primary security condition is violated, the security system 100 can sequentially determine whether the moving object satisfies one or more secondary security conditions by comparing the processing results. Examples of the one or more secondary safety conditions may include that the detected object is a regularly moving object, the infrared image temperature threshold is less than 36 ° C, and the contour aspect ratio in the infrared image is less than one. In some embodiments, all secondary security conditions are not met and the security level is determined to be an intrusion. In some embodiments, the safety level is determined to be a warning if the moving object is a regularly moving object or the object has a temperature threshold of less than 36 °C. In some embodiments, a safety condition that satisfies a contour aspect ratio of less than one determines that the security level is a threat, in which the security system 100 may continue to track and detect the object.

In some embodiments, the primary security condition is violated and the security system 100 can determine that the current security level is a threat. In some embodiments, security system 100 can further determine whether one or more secondary security conditions are met. Based on determining whether the secondary security condition is met, the security system 100 can determine the corresponding security level. In some embodiments, when only the primary security condition is violated and all secondary security conditions are not met, the security system 100 can determine that the current security level is an intrusion. In some embodiments, the security system 100 can initiate dry Pre-program and decide whether to report the alarm based on the intervention result.

In some embodiments the security system 100 will adaptively use or ignore one or more secondary security conditions. For example, when the brightness of the outside is dark, the contour recognition of the object is difficult, and the safety condition of the image signal aspect ratio of less than 1 is excluded.

10 is a schematic flow diagram of a security system determining whether a person has invaded based on microwave signals and image signals, in accordance with some embodiments of the present application. Step 1002 can include the security system 100 acquiring microwave signals and image information of the surrounding environment. The microwave signal may be a signal reflected by an object in the surrounding environment obtained by the security system 100 through the microwave sensor. The image information may be visible or infrared line imaging of the surrounding environment acquired by the image sensor. In some embodiments, the microwave signal can be an analog voltage waveform; the image information can be one or more images containing the surrounding environment.

At step 1004, the security system 100 can determine if there is a moving object. In some embodiments, the acquired microwave signal can be a voltage waveform. When the magnitude of the voltage waveform is greater than a certain threshold, the security system 100 determines that there is a moving object in the surrounding environment. In some embodiments, the threshold is 500 mV, 700 mV, 1000 mV, and the like. If the result of the security system 100 is that there is a moving object in the surrounding environment, the primary security condition is violated. At this point the security system 100 begins comparing the signal processing results to one or more secondary security conditions, and the flow proceeds to step 1006. In some embodiments, the security system 100 can determine all secondary security conditions in a subsequent step to determine the current security level. If the security system 100 determines that there is no moving object, it may return to step 1002, and the security system 100 continues to monitor and acquire the microwave signal and the image information.

At step 1006, a time domain frequency domain conversion is performed on the microwave signal containing one or more moving objects. In some embodiments, the time domain frequency domain conversion is using Fourier transform, Z transform, One or more of methods such as wavelet transform. In some embodiments, the security system 100 may sample and discretely process the voltage waveform described above, and perform discrete Fourier transform, fast Fourier transform, or wavelet transform, etc., to convert the acquired time domain signal into a frequency domain signal. Steps 1008 and 1010 include determining and filtering out fixed frequency component information in the frequency domain signal. The fixed frequency component information corresponds to a regular moving object in the surrounding environment. In some embodiments, there is fixed frequency component information in the frequency domain signal. By analyzing the fixed frequency components, it can be judged whether there is a regular moving object, and thus the influence of the regular moving object on the safety system 100 monitoring and judging personnel invasion can be excluded. In some embodiments, the regularly moving object may include some electrical appliances such as a fan, a pendulum clock, a sweeping robot, and the like.

If the above frequency domain signal does not include fixed component information, or the fixed component information is filtered out, there is still a moving object. Image matching is then performed in step 1012. The security system 100 can utilize one or more image comparisons or processing methods to extract information about the moving objects described above. In some embodiments, the security system 100 acquires the contour information of the moving object by using an interframe difference method, a background difference method, an optical flow method, a mixed Gaussian model method, an edge detection method, or the like. Step 1014 can include determining if the contour information includes a human contour. In some embodiments, the acquired contour shape or parameter is compared with the shape or parameter of the preset contour in the database, and it can be determined whether the moving object is a human body. In some embodiments, the shape or parameters of the preset contours in the database may be set according to different person's body types. In some embodiments, the contour parameter is the aspect ratio of the contour. In some embodiments, if the aspect aspect ratio is less than a certain reference value or reference range, the corresponding secondary safety condition is met, and the possibility of human intrusion is eliminated, the security level may be determined to be an alert, and the flow returns to step 1002. If the aspect aspect ratio is greater than a certain reference value or reference range, then in step 1016, the security system 100 determines that a human intrusion has occurred and initiated Intervention. In some embodiments, the above reference value may be a positive number such as 0.5, 0.8, 1, 1.5, or the like. In some embodiments, the above reference range may be in the range of 0.5-0.8, 0.8-1, 1-1.5, and the like. In some embodiments, the security system 100 can intervene intruders through the manner and flow illustrated in FIG.

11 is a schematic flow diagram of a security system initiated intervention in accordance with some embodiments of the present application. Step 1102 can include the security system 100 obtaining a security level. The security system 100 processes the acquired surrounding environment information and determines the current security level based on the comparison between the processing result and the security conditions. The surrounding environment information may be microwave signals, infrared signals, image signals, and sound signals of the surrounding environment.

Step 1104 can include the security system 100 determining if identity authentication is required. In some embodiments, when the current security level meets certain conditions, the process returns to step 1102, and the security system 100 continues to monitor and obtain environmental information and obtain a security level. In some embodiments, the condition may be that the current security level is one or more of a plurality of security modes, such as dormancy or alert. If the security system 100 determines that authentication is required, then step 1106 is performed. In some embodiments, when the corresponding security level is a threat or an intrusion, the determination requires identity authentication.

Step 1106 can include the security system 100 prompting and requesting the suspect to perform identity authentication when the suspect is required to perform identity authentication. In some embodiments, the security system 100 provides a short time buffer, also referred to as intervention time. During the intervention period, the suspect was asked to be authenticated. The authentication method can be password input, face recognition, iris recognition, fingerprint entry, answering questions, image selection, gesture representation, voiceprint recognition, and the like. In some embodiments, the security system 110 sends the identity authentication prompt information through the input and output interface, which can be used to prompt the content and manner of the identity authentication of the suspect. In some embodiments, the prompt information can include But not limited to voice, text, lights, pictures or digital.

Based on the identity authentication information provided by the suspect, the security system 100 determines in step 1108 whether the authentication has passed. In some embodiments, the security system 100 can match the information entered by the suspect object with the information stored in the database. The information stored in the database may include passwords, fingerprints, facial features, iris features, authentication questions and/or answers, authentication gestures, and the like.

If the authentication is passed, the flow proceeds to step 810 where the security system 100 determines that the current security level is dormant. The dormancy level is suitable for the owner to use at home, which can ensure that the owner is free to move at home, without having to worry about accidentally touching the alarm and affecting normal life. If the authentication fails, the flow proceeds to step 812 where the security system 100 generates an alert message. In some embodiments, the security system 100 can alert via an alarm and take appropriate security measures. In some embodiments, the security system 100 simultaneously turns on the lights of all rooms to alert the intrusion.

The basic concept has been described above, and it is obvious to those skilled in the art that the above disclosure is only an example and does not constitute a limitation of the present application. Various modifications, improvements and improvements may be made by the skilled person in the art without departing from the invention. Such modifications, improvements, and modifications are suggested in the present application, and such modifications, improvements, and modifications are still within the spirit and scope of the exemplary embodiments of the present application.

Also, the present application uses specific words to describe embodiments of the present application. An embodiment, an embodiment, and/or some embodiments mean a feature, structure, or characteristic associated with at least one embodiment of the present application. Therefore, it should be emphasized and noted that “an embodiment” or “an embodiment” or “an alternative embodiment” that is referred to in this specification two or more times in different positions does not necessarily refer to the same embodiment. . Furthermore, some of the features, structures, or characteristics of one or more embodiments of the present application can be combined as appropriate.

Moreover, those skilled in the art will appreciate that aspects of the present application can be illustrated and described by a number of patentable categories or conditions, including any new and useful process, machine, product, or combination of materials, or Any new and useful improvements to them. Accordingly, various aspects of the present application may be performed entirely by hardware, may be performed entirely by software (including firmware, resident software, microcode, etc.), or may be performed by a combination of hardware and software. The above hardware or software may be referred to as "data block", "module", "engine", "unit", "component" or "system". Moreover, aspects of the present application may be embodied in a computer product located in one or more computer readable media, including a computer readable program code.

A computer readable signal medium may include a propagated data signal containing a computer program code, such as on a baseband or as part of a carrier. The propagated signal may have a variety of manifestations, including electromagnetic forms, optical forms, and the like, or a suitable combination. The computer readable signal medium can be any computer readable medium other than a computer readable storage medium that can be communicated, propagated, or transmitted for use by connection to an instruction execution system, apparatus, or device. The program code located on the computer readable signal medium can be propagated over any suitable medium, including radio, cable, fiber optic cable, radio frequency signals, or similar media, or any combination of the above.

The computer program code required for the operation of each part of this application can be written in any one or more programming languages, including object oriented programming languages such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB.NET, Python. Etc., regular stylized programming languages such as C, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages such as Python, Ruby and Groovy, or other programming languages. The program code can be run entirely on the user's computer or as a stand-alone package software. The computer is running, or partially running on the user's computer, running partially on the remote computer, or running entirely on the remote computer or server. In the latter case, the remote computer can be connected to the user's computer via any network, such as a local area network (LAN) or a wide area network (WAN), or connected to an external computer (eg via the Internet), or In a cloud computing environment, or as a service such as Software as a Service (SaaS).

In addition, the order of processing elements and sequences, the use of digits, or the use of other names in the present application are not intended to limit the order of the processes and methods of the present application, unless explicitly stated in the claims. While the above disclosure discusses some embodiments that are presently considered useful by various examples, it should be understood that such details are for illustrative purposes only, and the scope of the appended claims is not limited to the disclosed embodiments. The scope is intended to cover all such modifications and alternatives For example, although the system components described above may be implemented by hardware devices, they may be implemented only by a software solution, such as installing the described system on an existing server or mobile device.

In the same way, it should be noted that in order to simplify the description of the present application to facilitate the understanding of one or more embodiments, in the foregoing description of the embodiments of the present application, various features are sometimes combined into one embodiment. , drawings or descriptions thereof. However, this method of disclosure does not mean that the features of the present application require more features than those mentioned in the scope of the patent application. In fact, the features of the embodiments are less than all of the features of the single embodiments disclosed above.

Numbers describing the number of components, attributes, are used in some embodiments, it being understood that such numbers are used in the examples, and in some examples the modifiers "about", "approximately" or "substantially" are used. Modification. Unless otherwise stated, "about", "approximately" or "substantially" indicates that the number is allowed to vary by ±20%. Accordingly, in some embodiments, the description Numerical parameters used in the book and in the scope of the claims are approximations that may vary depending upon the desired characteristics of the individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and employ a method of general digit retention. Although numerical fields and parameters used to confirm the breadth of its range in some embodiments of the present application are approximations, in certain embodiments, the setting of such values is as accurate as possible within the feasible range.

Each of the patents, patent applications, patent applications, and other materials, such as articles, books, specifications, publications, documents, etc. Except for the application history documents that are inconsistent or conflicting with the content of this application, the documents that have the broadest scope of patent application scope (currently or later attached to this application) are also excluded. It should be noted that, where the use of the descriptions, definitions, and/or terms in the accompanying materials of the present application is inconsistent or conflicting with the content described in the present application, the description, definition, and/or terminology of the present application. The use shall prevail.

Finally, it should be understood that the embodiments described in this application are merely illustrative of the principles of the embodiments of the present application. Other variations are also possible within the scope of the present application. Thus, by way of example, and not limitation,, and FIG Accordingly, the embodiments of the present application are not limited to the embodiments that are specifically described and described herein.

Claims (20)

A system comprising: a sensing module configured to: receive a microwave signal from a moving object located in the environment, and acquire at least one optical image containing the moving object; and a processor configured Determining, according to the microwave signal, a frequency information associated with the environment, determining an outline of the moving object based on the at least one optical image, and based on at least a portion of the frequency information and the moving object The outline determines a level of security. The optical sensor according to the system of claim 1, wherein the optical sensor comprises an image sensor or an infrared sensor. In accordance with the system of claim 2, the image sensor is associated with one or more lenses. According to the system of claim 2, the infrared sensor comprises a red thermal imager. The system of claim 1, wherein the frequency information comprises a fixed frequency associated with the moving object. According to the system of claim 1, the frequency information is obtained by the processor by performing Fourier transform on the microwave signal. In accordance with the system of claim 1, the contour of the moving object is obtained by the processor applying an image processing method to the at least one optical image. According to the system of claim 7, the image processing method is at least one selected from the group consisting of an interframe difference method, a background difference method, an optical flow method, an edge detection method, and a hybrid Gaussian model method. The system of claim 1, wherein the processor is further configured to determine whether the moving object is a human body based on an aspect ratio of a contour of the moving object. The system of claim 1, further comprising an alarm configured to generate an alarm signal when the security level is below a certain threshold. A method comprising: receiving a microwave signal from a moving object located in an environment; acquiring at least one optical image containing the moving object; determining, by the processor, an association associated with the environment based on the microwave signal a frequency information; determining an outline of the moving object according to the at least one optical image; and determining a security level according to at least part of the frequency information and an outline of the moving object. According to the method of claim 11, the optical image is acquired by an image sensor or an infrared sensor. The optical sensor is associated with one or more lenses according to the method of claim 12. The infrared sensor includes an infrared thermal imager according to the method of claim 12. According to the method of claim 11, the frequency information includes the movement A fixed frequency associated with an object. According to the method of claim 11, the frequency is obtained by Fourier transforming the microwave signal. The method of claim 11, wherein the contour of the moving object is passed by the at least one optical image by an interframe difference method, a background difference method, an optical flow method, an edge detection method, and a mixed Gaussian model method. At least one image processing method is obtained. According to the method of claim 11, the aspect ratio of the moving object is calculated to determine whether the moving object is a human body. The method of claim 11, wherein the alarm is issued in an alarm manner when the security level is below a certain threshold. A computer readable storage medium storing executable instructions for causing a computer device to perform, comprising: receiving a microwave signal from a moving object located in an environment; acquiring at least one of the moving objects An optical image; determining, according to the microwave signal, a frequency information associated with the environment; determining an outline of the moving object based on the at least one optical image; and based on at least a portion of the frequency information and the The outline of the moving object determines a level of security.