CN111862524B - Monitoring alarm method and device based on intelligent home system - Google Patents
Monitoring alarm method and device based on intelligent home system Download PDFInfo
- Publication number
- CN111862524B CN111862524B CN202010665212.7A CN202010665212A CN111862524B CN 111862524 B CN111862524 B CN 111862524B CN 202010665212 A CN202010665212 A CN 202010665212A CN 111862524 B CN111862524 B CN 111862524B
- Authority
- CN
- China
- Prior art keywords
- recognition result
- detection
- monitoring
- alarm
- sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B19/00—Alarms responsive to two or more different undesired or abnormal conditions, e.g. burglary and fire, abnormal temperature and abnormal rate of flow
- G08B19/005—Alarms responsive to two or more different undesired or abnormal conditions, e.g. burglary and fire, abnormal temperature and abnormal rate of flow combined burglary and fire alarm systems
Abstract
The embodiment of the application discloses a monitoring alarm method and device based on an intelligent home system. According to the technical scheme, the triggering information of the sensor is received, the camera is driven to correspond to the associated area of the sensor to collect video image data in response to the triggering information, the sound collection device is driven to collect sound data in a corresponding mode, detection and identification are further carried out on the basis of the video image data and the sound data, a corresponding detection and identification result is obtained, the detection and identification result is compared with a preset alarm condition, and when the detection and identification result reaches the alarm condition, corresponding alarm information is output to a user client side and/or an alarm platform of the intelligent home system. By adopting the technical means, the appointed monitoring information can be identified and detected through the video image data and the sound data, and the alarm prompt is carried out corresponding to the information reaching the alarm condition, so that the indoor environment can be monitored and alarmed in a targeted manner, and the monitoring security effect is optimized.
Description
Technical Field
The embodiment of the application relates to the technical field of intelligent home, in particular to a monitoring alarm method and device based on an intelligent home system.
Background
At present, with the enhancement of security awareness of people, more and more families can set security devices (such as a camera, an infrared sensor and the like) at home so as to carry out real-time monitoring and alarming on illegal entry and theft. The camera is arranged indoors, indoor video image information is collected in real time and is output to a user mobile phone or a home display to be displayed in real time, and therefore real-time monitoring of the indoor environment can be achieved.
However, the existing method of monitoring the indoor environment in real time by using the camera can only simply record the video of the corresponding indoor area, and since the user is difficult to check the monitoring video in real time, the warning prompt of the user is short of timeliness when illegal entrance, theft and the like happen, and the evasion effect of illegal entrance and theft is relatively poor. In addition, because the camera is fixedly arranged, the monitoring area is relatively fixed, so that the monitoring of the indoor environment is limited, and the targeted monitoring of the indoor environment is difficult to realize well.
Disclosure of Invention
The embodiment of the application provides a monitoring alarm method and device based on an intelligent home system, which can monitor designated areas such as indoor environment in a targeted manner, identify designated monitoring information in real time, and correspondingly perform alarm prompt, so that the monitoring and security protection effects are better.
In a first aspect, an embodiment of the present application provides a monitoring alarm method based on an intelligent home system, including:
receiving trigger information of a sensor, responding to the trigger information to drive a camera to collect video image data corresponding to an associated area of the sensor, and driving a sound collection device to collect sound data corresponding to the camera;
detecting and identifying based on the video image data and the sound data to obtain a corresponding detection and identification result;
and comparing the detection identification result with a preset alarm condition, and outputting corresponding alarm information to a user client and/or an alarm platform of the intelligent home system when the detection identification result reaches the alarm condition.
Further, the sensor comprises a door and window opening and closing detection sensor arranged at a door and window, and the triggering information is door and window opening detection information;
correspondingly, the detecting and identifying are carried out based on the video image data and the sound data, and a corresponding detecting and identifying result is obtained, and the method comprises the following steps:
inputting the video image data into a preset target detection model and a preset action recognition model, and outputting a corresponding target detection result and an action recognition result;
inputting the voice data into a preset voice recognition model, and outputting a corresponding voiceprint recognition result and a corresponding voice content recognition result;
and summarizing the target detection result, the action recognition result, the voiceprint recognition result and the voice content recognition result to be used as detection recognition results.
Further, comparing the detection identification result with a preset alarm condition includes:
and comparing the target detection result with a preset image database, comparing the voiceprint recognition result with a predicted voiceprint database, and judging whether predefined monitoring contents exist in the action recognition result and the voice content recognition result.
Further, comparing the detection identification result with a preset alarm condition, further comprises:
and if the image database does not match the target detection result, the voiceprint database does not match the voiceprint recognition result, the action recognition result has predefined monitoring content and/or the voice content recognition result has predefined monitoring content, judging that the detection recognition result reaches the alarm condition.
Further, the sensor also comprises a smoke sensor, a leakage sensor and a water sensor;
correspondingly, the detection and identification are carried out based on the video image data and the sound data, and the method comprises the following steps:
detecting and identifying whether specified image features exist based on the video image data, wherein the image features comprise open fire image features, breaker tripping image features or water immersion image features.
Further, output corresponding alarm information to intelligent home systems's user client and/or warning platform, still include:
the method comprises the steps of scanning an indoor environment and/or a specified area around a house through a camera in real time, detecting and identifying whether predefined monitoring behaviors exist, and outputting corresponding alarm information to a user client and/or an alarm platform of the intelligent home system when the predefined monitoring behaviors are detected and identified.
Further, when the detection and identification result reaches the alarm condition, outputting corresponding alarm information to the user client and/or the alarm platform of the smart home system, and further comprising:
and outputting the corresponding video image data and/or the sound data to a user client and/or an alarm platform of the intelligent home system.
In a second aspect, an embodiment of the present application provides a monitoring alarm device based on an intelligent home system, including:
the acquisition module is used for receiving trigger information of the sensor, responding to the trigger information to drive the camera to acquire video image data corresponding to the associated area of the sensor and drive the sound acquisition device to acquire sound data correspondingly;
the identification module is used for carrying out detection and identification on the basis of the video image data and the sound data to obtain a corresponding detection and identification result;
and the alarm module is used for comparing the detection identification result with a preset alarm condition, and outputting corresponding alarm information to a user client and/or an alarm platform of the intelligent home system when the detection identification result reaches the alarm condition.
In a third aspect, an embodiment of the present application provides an electronic device, including:
a memory and one or more processors;
the memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the monitoring and alarming method based on the smart home system according to the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the monitoring and alarming method based on a smart home system according to the first aspect.
According to the embodiment of the application, the triggering information of the sensor is received, the camera is driven to correspond to the associated area of the sensor to collect video image data in response to the triggering information, the sound collection device is driven to correspondingly collect sound data, further, the detection and identification are carried out based on the video image data and the sound data, a corresponding detection and identification result is obtained, the detection and identification result is compared with a preset alarm condition, and when the detection and identification result reaches the alarm condition, corresponding alarm information is output to a user client side and/or an alarm platform of the intelligent home system. By adopting the technical means, the appointed monitoring information can be identified and detected through the video image data and the sound data, and the alarm prompt is carried out corresponding to the information reaching the alarm condition, so that the appointed areas such as the indoor environment and the like can be monitored and alarmed in a targeted manner, and the monitoring security effect is optimized.
Drawings
Fig. 1 is a flowchart of a monitoring alarm method based on an intelligent home system according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating a detection and identification result determination process in the first embodiment of the present application;
fig. 3 is a schematic structural diagram of a monitoring alarm device based on an intelligent home system according to a second embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The monitoring and alarming method of the intelligent home system aims to perform video detection and sound detection of the corresponding area of the indoor environment in a targeted manner through triggering of various sensors of the intelligent home system, and judge whether to alarm or not based on a detection and identification result. Therefore, the monitoring and alarming of the indoor environment are realized, and a better security alarming effect is provided. Compared with the traditional intelligent home system, the intelligent home system is usually operated independently corresponding to various indoor sensors. The camera only monitors and records indoor designated areas, and cannot detect and identify designated monitoring information such as illegal entrance, theft and the like. Obviously, the security effect of the monitoring mode is relatively poor, and the user cannot be prompted in time about illegal entering, theft and other behaviors of the current indoor environment. Therefore, the monitoring alarm method based on the intelligent home system is provided to solve the technical problems that the existing intelligent home system cannot perform security alarm and alarm prompt is not timely.
The first embodiment is as follows:
fig. 1 is a flowchart of a monitoring and alarming method based on an intelligent home system according to an embodiment of the present disclosure, where the monitoring and alarming method based on an intelligent home system provided in this embodiment may be executed by a monitoring and alarming device based on an intelligent home system, the monitoring and alarming device based on an intelligent home system may be implemented in a software and/or hardware manner, and the monitoring and alarming device based on an intelligent home system may be formed by two or more physical entities or may be formed by one physical entity. Generally speaking, the monitoring alarm device based on the smart home system may be a smart home system server, a smart home gateway, or the like.
The following description will be given by taking the monitoring and alarming device based on the smart home system as an example of a main body for executing the monitoring and alarming method based on the smart home system. Referring to fig. 1, the monitoring and alarming method based on the smart home system specifically includes:
s110, receiving trigger information of a sensor, responding to the trigger information, driving a camera to collect video image data corresponding to a relevant area of the sensor, and driving a sound collection device to collect sound data correspondingly.
Specifically, in the embodiment of the application, various sensors are arranged in an indoor environment, and the sensors are in signal connection with the monitoring alarm device based on the intelligent home system so as to upload trigger information to the monitoring alarm device in real time. It should be noted that the trigger information of various sensors is different, and for the door and window opening and closing detection sensor, the sensor uploads the trigger information to the monitoring alarm device when detecting that the door and window is opened; and for the temperature, smoke and gas sensors, when the detection value reaches a set threshold value, uploading triggering information to the monitoring alarm equipment.
Further, in order to realize targeted monitoring and alarming in specified areas such as indoor environments, an association area is set for each sensor when various sensors are arranged in the intelligent home system in the embodiment of the application, the association area can be bound with identification information of the sensors, and the binding relation is stored in the monitoring and alarming device. For example, the area associated with the sensor disposed at the door is the area corresponding to the door position in the room. The related area of the sensor correspondingly arranged at the window is the area corresponding to the position of the window indoors. And for temperature and smoke, their associated zones may be within a set range centered about their location. And subsequently, after the monitoring alarm device receives the trigger information, the monitoring alarm device responds to the trigger information to acquire indoor environment image data and sound data so as to perform video and sound monitoring pertinently according to the trigger information. The monitoring alarm equipment acquires video image data of the associated area corresponding to the sensor by driving the camera. When the monitoring alarm equipment receives the trigger information, the pre-stored binding relationship is inquired by determining the identification information of the sensor sending the trigger information, the association area corresponding to the identification information is determined, and the camera is further driven to acquire video image data towards the association area. On the other hand, after the monitoring alarm equipment receives the trigger information, sound data acquisition is carried out through a sound acquisition device in response to the trigger information. The embodiment of the application does not limit the sound collection device in a fixed mode, the sound collection device and the sensor can be correspondingly arranged for guaranteeing the definition of sound collection, and sound data collection is carried out through the driving of the monitoring alarm device.
And S120, carrying out detection and identification based on the video image data and the sound data to obtain a corresponding detection and identification result.
Furthermore, according to actual monitoring needs, detection and identification are carried out based on the collected video image data and the collected sound data, and different monitoring contents are detected and identified according to different sensors. According to the embodiment of the application, when data are collected according to the trigger information for detection and identification, detection and identification models used for detection and identification of sensors of different types are different, so that detection and identification of different monitoring contents are realized. If the sensor sending the trigger information is a door and window opening and closing detection sensor arranged at a door and window, the trigger information is door and window opening detection information, and the content needing to be monitored is illegal entering and theft; if the sensor sending the trigger information is a temperature sensor or a smoke sensor, the trigger information is temperature or smoke concentration exceeding information, and the content needing to be detected is an indoor fire. In some embodiments, according to the monitoring requirement, a corresponding type sensor can be further arranged, and the corresponding monitoring content is identified according to the sensor trigger information acquisition data. The specific monitoring content is not fixedly limited in the embodiment of the application, and is not described herein in detail.
Referring to fig. 2, when detecting and recognizing data collected according to triggering information of a door sensor or a window sensor, a detection recognition result determination process includes:
s1201, inputting the video image data into a preset target detection model and a preset action recognition model, and outputting a corresponding target detection result and a corresponding action recognition result;
s1202, inputting the voice data into a preset voice recognition model, and outputting a corresponding voiceprint recognition result and a corresponding voice content recognition result;
s1203, summarizing the target detection result, the action recognition result, the voiceprint recognition result and the voice content recognition result to serve as detection recognition results.
In order to detect and identify illegal entry and theft, the embodiment of the application establishes a target detection model and a motion identification model in advance corresponding to video image data and establishes a voice identification model corresponding to sound data, wherein the target detection model is mainly used for identifying and detecting a target in the video image data and acquiring face image data of the target. The target detection model may be a target detection model constructed using a network such as Faster R-CNN, YOLOv3, or the like. In the prior art, there are many specific implementation manners for target detection, and the embodiments of the present application are not limited herein. The motion recognition model mainly recognizes and detects a monitoring motion, and the monitoring motion can be a motion of crossing a window. When the motion recognition model detects and recognizes the monitoring motion, a motion recognition algorithm based on a convolutional neural network can be adopted to detect and recognize the monitoring motion. Specifically, a plurality of joint points of the target are positioned, the motion vector of the target is determined based on the joint point connecting line, and further, the Euclidean distance between the motion vector of the target and a prestored motion standard (motion of crossing a window) is calculated, so that whether the monitoring motion exists in the current video image data is determined according to the Euclidean distance. It should be noted that there are many motion recognition algorithms based on video image data in the prior art, specifically including motion recognition algorithms based on a double-flow neural network, a three-dimensional convolutional neural network, a long-short memory network (LSTM), an antagonistic neural network, and the like, and the embodiment of the present application does not impose any fixed limitation on the specifically used motion recognition algorithms. Therefore, the corresponding target detection result and the corresponding action recognition result can be determined through the target detection model and the action recognition model.
On the other hand, a preset voice recognition model is used for detecting and recognizing corresponding collected voice data, and the voice recognition model is mainly used for carrying out voiceprint recognition and voice content recognition on the voice data. The voiceprint recognition is mainly used for obtaining the voiceprint characteristics of the target, and the voice content recognition is mainly used for recognizing the content of the monitored target speech. Speech recognition is a mature technology, and is not a main improvement point of the embodiments of the present application, and is not described herein again.
Finally, based on the target detection result, the action recognition result, the voiceprint recognition result and the voice content recognition result which are detected and recognized, the result can be summarized as a final detection recognition result. Whether alarm information needs to be output or not can be judged subsequently based on the detection and identification result.
S130, comparing the detection identification result with a preset alarm condition, and outputting corresponding alarm information to a user client and/or an alarm platform of the intelligent home system when the detection identification result reaches the alarm condition.
Further, whether an alarm is given or not is judged by comparing preset alarm conditions based on the detection and identification results. And comparing the target detection result with a preset image database, comparing the voiceprint recognition result with a predicted voiceprint database, and judging whether predefined monitoring contents exist in the action recognition result and the voice content recognition result. Before that, the monitoring and alarming device pre-constructs an image database and a voiceprint database, wherein the image database pre-stores face image data trusted by the user, namely the face image data of the part corresponds to a target allowed to enter the indoor environment by the user. This portion of the target may be the family of the user. It can be understood that when the detection result of the detected and recognized target is matched with the corresponding face data in the image database, it indicates that the currently detected and recognized target is legal, and an alarm is not required. Similarly, the voiceprint database contains voiceprint characteristic information of a target trusted by the user, and the target corresponding to the part of the voiceprint characteristic information is allowed to enter the indoor environment by the user. This portion of the target may be the family of the user. It can be understood that when the voiceprint recognition result in the detected and recognized voice content recognition result is matched with the corresponding voiceprint feature information in the voiceprint database, it indicates that the target currently detected and recognized is legal, and an alarm is not required. And when judging whether the action recognition result and the voice content recognition result have predefined monitoring contents, mainly judging whether predefined monitoring actions such as window crossing exist in the action recognition result, and judging whether the voice content has preset monitoring speaking contents. The speech content of the set monitoring can be customized by a user, the predefined monitoring action can be other monitoring actions according to actual needs, and only corresponding monitoring action recognition models are required to be constructed corresponding to different monitoring actions.
Finally, judging that the detection recognition result reaches the alarm condition by comparing the detection recognition result with a preset alarm condition if the image database does not match the target detection result, the voiceprint database does not match the voiceprint recognition result, the action recognition result has predefined monitoring content and/or the voice content recognition result has predefined monitoring content. It should be noted that, if any one or more of the above identification results are not matched with the corresponding database or predefined monitoring content exists, it is determined that the detection identification result reaches the alarm condition. For example, when the facial image data of the monitored target is identified not to match the image database according to the target detection result, the detection identification result is judged to reach the alarm condition. And when the existence of predefined monitoring contents such as window turning actions and the like is detected according to the action recognition result, judging that the detection recognition result reaches the alarm condition. The alarm triggering mode of the monitoring device can be various, and can be set by user according to actual needs, which is not described herein.
Further, when the detection identification result reaches the alarm condition, outputting corresponding alarm information to a user client and/or an alarm platform of the intelligent home system. By sending alarm information to the user client, the user can be timely reminded that the security risk exists in the current indoor environment, so that the user can go to the processing in time. Similarly, by sending alarm information to the alarm platform, illegal entrance and theft behaviors can be timely alarmed, and a better security effect is achieved.
In some embodiments, the monitoring alarm device sends alarm information and simultaneously outputs the corresponding video image data and/or the corresponding sound data to a user client and/or an alarm platform of the smart home system. By sending the video image data to the user client and/or the alarm platform, the user can conveniently confirm the current monitoring condition, and the condition that the monitoring alarm equipment has misjudgment is avoided. Moreover, the video image alarm mode is adopted, so that the user can more accurately know illegal entrance and theft behaviors, and better monitoring and security effects are realized.
In addition, in one embodiment, a smoke sensor, an electric leakage sensor and a water immersion sensor are arranged at corresponding positions of the indoor environment, so that the monitoring and alarming on fire and circuit faults of the indoor environment are realized. When monitoring and identifying fire and circuit faults, whether specified image characteristics exist is mainly detected and identified based on the video image data when the video image data and the sound data are used for detecting and identifying, wherein the image characteristics comprise open fire image characteristics, breaker tripping image characteristics or water immersion image characteristics.
Illustratively, when the smoke sensor detects that the smoke concentration exceeds a set threshold value, or the electric leakage sensor detects electric leakage of a circuit, trigger information is sent to the monitoring alarm device. And the monitoring alarm equipment acquires video image data of the relevant area of the smoke sensor or the electric leakage sensor through the camera based on the trigger information. Based on the video image data, the image characteristics of the open fire or the image characteristics of the tripping of the circuit breaker are detected and identified. The monitoring alarm equipment establishes an image feature recognition model in advance, the image feature recognition model can be constructed by collecting a feature recognition model based on a convolutional neural network, and the image feature recognition model is obtained by performing model training by taking a large number of open fire images or breaker images as training samples. Subsequently, the collected video image data is input into an image feature recognition model to detect whether open fire image features or breaker tripping image features exist, if the open fire image features exist, the fact that a fire possibly occurs in a current room is indicated, an alarm condition is triggered, and alarm information is sent to a user client and/or an alarm platform. Similarly, if the breaker tripping image characteristics exist, the current indoor circuit fault is indicated, so that an alarm condition is triggered, and alarm information is sent to the user client and/or the alarm platform. By monitoring and alarming indoor fire and circuit faults in real time, the indoor security effect can be further optimized, and indoor safety is guaranteed. Similarly, when the corresponding detection area detects water immersion, whether the area has the water immersion image characteristics or not is identified through detection, and if yes, an alarm condition is triggered. In addition, in some embodiments, a co sensor or other detection device may be additionally provided, and further indoor co poisoning may be detected and identified. It can be understood that after the co sensor is triggered, the video image data is detected and identified to find that image features of a human body which is still for a long time exist, the co poisoning of the human body is considered to possibly exist at the moment, and the alarm condition is triggered to send alarm information to the user client and/or the alarm platform.
In addition, in a real-time example, the monitoring device also scans the indoor environment in real time through the camera video, detects and identifies whether the predefined monitoring behavior exists in the indoor environment, and outputs corresponding alarm information to the user client and/or the alarm platform of the smart home system when detecting and identifying the predefined monitoring behavior. Specifically, the monitoring behavior may be a behavior that the infant is not covered by a quilt when sleeping, or a human body invades the user. The method comprises the steps of acquiring video image data of an infant, determining the image data of the infant, and carrying out detection and identification on the quilt of the image data of the infant. It can be understood that if the image data does not detect the image feature of the "quilt" or the image feature of the "quilt" is not located at the corresponding position, the alarm condition is triggered, and at this time, the corresponding alarm information is output to the user client and/or the alarm platform of the smart home system. And when the behavior of a corresponding person invading the user is detected and identified, action identification or dangerous object identification is carried out through video image data, and when dangerous objects such as a control tool held by a monitoring target are detected or the monitoring target invades other people, the current person invading behavior is judged. At the moment, the alarm information is output to the user client and/or the alarm platform in the same way, and corresponding video image data is sent at the same time. Through the detection and identification of the human body invasion behaviors, the personal safety of users and family can be guaranteed, and a better security protection effect of the monitoring alarm device is realized. It should be noted that, the detection and identification corresponding to the predefined monitoring behavior may refer to the detection and identification manner for the illegal entry behavior, but the specific identification and detection action is changed.
The triggering information of the sensor is received, the camera is driven to correspond to the associated area of the sensor to collect the video image data in response to the triggering information, the sound collection device is driven to correspondingly collect the sound data, the detection and identification are further carried out based on the video image data and the sound data, a corresponding detection and identification result is obtained, the detection and identification result is finally compared with a preset alarm condition, and when the detection and identification result reaches the alarm condition, corresponding alarm information is output to a user client side and/or an alarm platform of the intelligent home system. By adopting the technical means, the appointed monitoring information can be identified and detected through the video image data and the sound data, and the alarm prompt is carried out corresponding to the information reaching the alarm condition, so that the indoor environment can be monitored and alarmed in a targeted manner, and the monitoring security effect is optimized.
Example two:
on the basis of the foregoing embodiment, fig. 3 is a schematic structural diagram of a monitoring alarm device based on an intelligent home system according to a second embodiment of the present application. Referring to fig. 3, the monitoring alarm device based on the smart home system provided in this embodiment specifically includes: the system comprises an acquisition module 21, an identification module 22 and an alarm module 23.
The acquisition module 21 is configured to receive trigger information of a sensor, drive a camera to acquire video image data corresponding to an associated region of the sensor in response to the trigger information, and drive a sound acquisition device to acquire sound data corresponding to the camera;
the identification module 22 is configured to perform detection and identification based on the video image data and the sound data to obtain a corresponding detection and identification result;
the alarm module 23 is configured to compare the detection identification result with a preset alarm condition, and output corresponding alarm information to a user client and/or an alarm platform of the smart home system when the detection identification result meets the alarm condition.
The triggering information of the sensor is received, the camera is driven to correspond to the associated area of the sensor to collect the video image data in response to the triggering information, the sound collection device is driven to correspondingly collect the sound data, the detection and identification are further carried out based on the video image data and the sound data, a corresponding detection and identification result is obtained, the detection and identification result is finally compared with a preset alarm condition, and when the detection and identification result reaches the alarm condition, corresponding alarm information is output to a user client side and/or an alarm platform of the intelligent home system. By adopting the technical means, the appointed monitoring information can be identified and detected through the video image data and the sound data, and the alarm prompt is carried out corresponding to the information reaching the alarm condition, so that the indoor environment can be monitored and alarmed in a targeted manner, and the monitoring security effect is optimized.
The monitoring and alarming device based on the intelligent home system provided by the second embodiment of the application can be used for executing the monitoring and alarming method based on the intelligent home system provided by the first embodiment of the application, and has corresponding functions and beneficial effects.
Example three:
an embodiment of the present application provides an electronic device, and with reference to fig. 4, the electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors in the electronic device may be one or more, and the number of memories in the electronic device may be one or more. The processor, memory, communication module, input device, and output device of the electronic device may be connected by a bus or other means.
The memory 32 is a computer-readable storage medium, and can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the monitoring and alarming method based on the smart home system according to any embodiment of the present application (for example, the acquisition module, the identification module, and the alarm module in the monitoring and alarming device based on the smart home system). The memory can mainly comprise a program storage area and a data storage area, wherein the program storage area can store an operating system and an application program required by at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The communication module 33 is used for data transmission.
The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, that is, the monitoring and alarming method based on the smart home system is realized.
The input device 34 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 35 may include a display device such as a display screen.
The electronic device provided by the embodiment can be used for executing the monitoring and alarming method based on the intelligent home system provided by the embodiment one, and has corresponding functions and beneficial effects.
Example four:
the embodiment of the present application further provides a storage medium containing computer executable instructions, where the computer executable instructions, when executed by a computer processor, are configured to perform a monitoring and alarm method based on an intelligent home system, where the monitoring and alarm method based on the intelligent home system includes: receiving trigger information of a sensor, responding to the trigger information to drive a camera to collect video image data corresponding to an associated area of the sensor, and driving a sound collection device to collect sound data corresponding to the camera; detecting and identifying based on the video image data and the sound data to obtain a corresponding detection and identification result; and comparing the detection identification result with a preset alarm condition, and outputting corresponding alarm information to a user client and/or an alarm platform of the intelligent home system when the detection identification result reaches the alarm condition.
Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network (such as the internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations, e.g., in different computer systems connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.
Certainly, in the storage medium containing the computer-executable instructions provided in the embodiments of the present application, the computer-executable instructions are not limited to the monitoring and alarming method based on the smart home system described above, and may also perform related operations in the monitoring and alarming method based on the smart home system provided in any embodiment of the present application.
The monitoring and alarming device, the storage medium, and the electronic device based on the smart home system provided in the above embodiments may execute the monitoring and alarming method based on the smart home system provided in any embodiment of the present application, and reference may be made to the monitoring and alarming method based on the smart home system provided in any embodiment of the present application without detailed technical details described in the above embodiments.
The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.
Claims (7)
1. A monitoring alarm method based on an intelligent home system is characterized by comprising the following steps:
receiving trigger information of a sensor, wherein the trigger information comprises a temperature sensor, a smoke sensor and a gas sensor, responding to the trigger information, driving a camera to collect video image data corresponding to a relevant area of the sensor, and driving a sound collection device to collect sound data corresponding to the sound collection device;
performing detection and recognition based on the video image data and the sound data to obtain a corresponding detection and recognition result, wherein the detection and recognition result comprises inputting the video image data into a preset target detection model and a preset action recognition model, outputting a corresponding target detection result and a corresponding action recognition result, inputting the sound data into a preset voice recognition model, outputting a corresponding voiceprint recognition result and a voice content recognition result, and summarizing the target detection result, the action recognition result, the voiceprint recognition result and the voice content recognition result to be used as a detection and recognition result;
comparing the detection recognition result with a preset alarm condition, wherein the comparison comprises the steps of comparing the target detection result with a preset image database, comparing the voiceprint recognition result with a predicted voiceprint database, judging whether the action recognition result and the voice content recognition result have predefined monitoring contents, if the image database does not match the target detection result, the voiceprint database does not match the voiceprint recognition result, the action recognition result has the predefined monitoring contents and/or the voice content recognition result has the predefined monitoring contents, judging that the detection recognition result reaches the alarm condition, and outputting the corresponding video image data and/or the voice data to a user client and/or an alarm platform of the intelligent home system.
2. The monitoring and alarming method based on the intelligent home system according to claim 1, wherein the sensor comprises a door and window opening and closing detection sensor arranged at a door and window, and the triggering information is door and window opening detection information.
3. The smart home system-based monitoring and alarming method according to claim 1, wherein the sensors further comprise a smoke sensor, a leakage sensor and a water sensor;
correspondingly, the detection and identification are carried out based on the video image data and the sound data, and the method comprises the following steps:
detecting and identifying whether specified image features exist based on the video image data, wherein the image features comprise open fire image features, breaker tripping image features or water immersion image features.
4. The monitoring and alarming method based on the intelligent home system according to claim 1, wherein outputting corresponding alarming information to a user client and/or an alarming platform of the intelligent home system further comprises:
the method comprises the steps of scanning an indoor environment and/or a specified area around a house through a camera in real time, detecting and identifying whether predefined monitoring behaviors exist, and outputting corresponding alarm information to a user client and/or an alarm platform of the intelligent home system when the predefined monitoring behaviors are detected and identified.
5. The utility model provides a monitoring alarm device based on intelligent home systems which characterized in that includes:
the acquisition module is used for receiving trigger information of a sensor, comprises a temperature sensor, a smoke sensor and a gas sensor, responds to the trigger information, drives a camera to acquire video image data corresponding to a relevant area of the sensor, and drives a sound acquisition device to acquire sound data corresponding to the sound acquisition device;
the recognition module is used for carrying out detection recognition based on the video image data and the sound data to obtain a corresponding detection recognition result, and comprises the steps of inputting the video image data into a preset target detection model and a preset action recognition model, outputting a corresponding target detection result and a corresponding action recognition result, inputting the sound data into a preset voice recognition model, outputting a corresponding voiceprint recognition result and a voice content recognition result, and summarizing the target detection result, the action recognition result, the voiceprint recognition result and the voice content recognition result to be used as detection recognition results;
and the alarm module is used for comparing the detection recognition result with a preset alarm condition, wherein the detection recognition result is compared with a preset image database, the voiceprint recognition result is compared with a predicted voiceprint database, whether predefined monitoring content exists in the action recognition result and the voice content recognition result or not is judged, if the image database does not match the target detection result, the voiceprint database does not match the voiceprint recognition result, predefined monitoring content exists in the action recognition result and/or predefined monitoring content exists in the voice content recognition result, the detection recognition result is judged to reach the alarm condition, and corresponding video image data and/or voice data are output to a user client side and/or an alarm platform of the intelligent home system.
6. An electronic device, comprising:
a memory and one or more processors;
the memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors are enabled to implement the monitoring and alarming method based on the smart home system according to any one of claims 1 to 4.
7. A storage medium containing computer-executable instructions, wherein the computer-executable instructions, when executed by a computer processor, are configured to perform the smart home system-based monitoring alarm method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010665212.7A CN111862524B (en) | 2020-07-10 | 2020-07-10 | Monitoring alarm method and device based on intelligent home system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010665212.7A CN111862524B (en) | 2020-07-10 | 2020-07-10 | Monitoring alarm method and device based on intelligent home system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111862524A CN111862524A (en) | 2020-10-30 |
| CN111862524B true CN111862524B (en) | 2022-08-05 |
Family
ID=72982950
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010665212.7A Active CN111862524B (en) | 2020-07-10 | 2020-07-10 | Monitoring alarm method and device based on intelligent home system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111862524B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114520889A (en) * | 2020-11-16 | 2022-05-20 | 中国联合网络通信集团有限公司 | Household monitoring equipment, system and method |
| CN114842617A (en) * | 2021-02-02 | 2022-08-02 | 深圳慧安康科技有限公司 | Safety early warning method and device based on desk lamp, desk lamp and storage medium |
| CN114220242A (en) * | 2021-12-10 | 2022-03-22 | 珠海格力电器股份有限公司 | Indoor state monitoring method and device, storage medium and equipment |
| CN114488832A (en) * | 2022-01-11 | 2022-05-13 | 濮晨雪 | Intelligent household system and equipment management method |
| CN117312828A (en) * | 2023-09-28 | 2023-12-29 | 光谷技术有限公司 | Public facility monitoring method and system |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103295351A (en) * | 2013-05-17 | 2013-09-11 | 安科智慧城市技术（中国）有限公司 | Safety and protection monitoring method, safety and protection monitoring device and monitoring system |
| US8917186B1 (en) * | 2014-03-04 | 2014-12-23 | State Farm Mutual Automobile Insurance Company | Audio monitoring and sound identification process for remote alarms |
| CN103984315A (en) * | 2014-05-15 | 2014-08-13 | 成都百威讯科技有限责任公司 | Domestic multifunctional intelligent robot |
| CN106157505A (en) * | 2015-03-25 | 2016-11-23 | 中兴通讯股份有限公司 | One is illegally entered the room alarm method and device |
| CN106059868A (en) * | 2016-07-24 | 2016-10-26 | 哈尔滨理工大学 | Home intelligent video monitoring protection system |
| CN108924511A (en) * | 2018-08-07 | 2018-11-30 | 钟祥博谦信息科技有限公司 | A kind of smart home monitoring method and system |
| CN109598885B (en) * | 2018-12-21 | 2021-06-11 | 广东中安金狮科创有限公司 | Monitoring system and alarm method thereof |
| CN111063162A (en) * | 2019-12-05 | 2020-04-24 | 恒大新能源汽车科技(广东)有限公司 | Silent alarm method and device, computer equipment and storage medium |
-
2020
- 2020-07-10 CN CN202010665212.7A patent/CN111862524B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111862524A (en) | 2020-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111862524B (en) | Monitoring alarm method and device based on intelligent home system | |
| US10902707B1 (en) | Video monitoring and alarm verification technology | |
| US20210076010A1 (en) | System and method for gate monitoring during departure or arrival of an autonomous vehicle | |
| US7504942B2 (en) | Local verification systems and methods for security monitoring | |
| US9779614B2 (en) | System and method of alerting CMS and registered users about a potential duress situation using a mobile application | |
| CN205508055U (en) | Door and window security protection system based on thing networking | |
| CN111757069B (en) | Monitoring anti-theft method and device based on intelligent doorbell | |
| CN104504793A (en) | Intelligent door safety control system and method based on video service | |
| US11217076B1 (en) | Camera tampering detection based on audio and video | |
| CA3105060A1 (en) | Object tracking using disparate monitoring systems | |
| CN112991585A (en) | Personnel entering and exiting management method and computer readable storage medium | |
| CN108597164A (en) | A kind of theft preventing method, device, terminal and computer-readable medium | |
| CN113284274A (en) | Trailing identification method and computer readable storage medium | |
| KR101075550B1 (en) | Image sensing agent and security system of USN complex type | |
| CN108898717B (en) | Intelligent security monitoring system | |
| CN108806155B (en) | Security monitoring method based on Internet of things | |
| KR20170121934A (en) | Smart doorbell and home security system | |
| CN111666780A (en) | Intelligent door control security method based on emotion recognition technology | |
| CN115049988A (en) | Edge calculation method and device for power distribution network monitoring and prejudging | |
| CN212229720U (en) | Intelligent access control system based on block chain | |
| CN109799712A (en) | Intelligent household security system based on human-computer interaction | |
| CN110148278A (en) | A kind of intelligent security guard method and system | |
| CN109212979A (en) | A kind of home intelligent security system | |
| CN210776878U (en) | Intelligent household access control system | |
| CN211030021U (en) | Multifunctional door watching robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |