CN106773745A

CN106773745A - A kind of household equipment method for safety monitoring, device, household equipment and system

Info

Publication number: CN106773745A
Application number: CN201510819037.1A
Authority: CN
Inventors: 周文辉
Original assignee: China Mobile Communications Group Co Ltd
Current assignee: China Mobile Communications Group Co Ltd
Priority date: 2015-11-23
Filing date: 2015-11-23
Publication date: 2017-05-31

Abstract

The invention discloses a kind of household equipment method for safety monitoring, methods described includes：Receive security monitoring instruction；The security monitoring instruction is responded, the first information and the second information is gathered；The first information is different from second information；The current mode of operation of the household equipment is determined based on the first information and the second information；The safe condition of the household equipment is determined based on the current mode of operation of the household equipment and default state repository；The household equipment is controlled according to the safe condition and default security strategy that determine.The present invention further simultaneously discloses a kind of household equipment safety monitoring device, household equipment and system.

Description

Home device safety monitoring method and device, home device and system

Technical Field

The invention relates to the technical field of household equipment safety, in particular to a household equipment safety monitoring method, a household equipment safety monitoring device, household equipment and a household equipment safety monitoring system.

Background

With the development of society, people pay more and more attention to safety problems, and the safety problems of household equipment become more and more important.

At present, the safety monitoring of household equipment (such as a gas stove and the like) usually adopts a temperature measurement and control mode of a sensor (such as a temperature sensor, a gas concentration sensor and the like), however, the monitoring mode needs to consider the stability of the sensor and related modules under the conditions of high temperature and high humidity, the realization is complex, the cost is high, and the accuracy cannot be ensured.

Therefore, providing a home device security monitoring scheme that can accurately and reliably determine the security status of the home device and perform corresponding control has become an urgent problem to be solved.

Disclosure of Invention

In view of this, embodiments of the present invention are expected to provide a method, an apparatus, a home device, and a system for monitoring security of a home device, which can accurately determine a security state of the home device and perform corresponding control, and have low cost, good reliability, and strong expansion capability.

In order to achieve the above purpose, the technical solution of the embodiment of the present invention is realized as follows:

the embodiment of the invention provides a home equipment safety monitoring method, which comprises the following steps:

receiving a safety monitoring instruction;

responding to the safety monitoring instruction, and acquiring first information and second information; the first information is different from the second information;

determining the current operating state of the home equipment based on the first information and the second information;

determining the safety state of the household equipment based on the current operation state of the household equipment and a preset state library;

and controlling the household equipment according to the determined safety state and a preset safety strategy.

In the above scheme, the first information is image information, and the second information is audio information;

the determining the current operating state of the home device based on the first information and the second information includes:

carrying out image processing on the image information, and carrying out target detection on an image processing result so as to identify different monitoring objects in the image information;

and carrying out audio characteristic analysis on the audio information, and determining the current operating state of the household equipment based on the audio analysis result and the identified different monitoring objects.

In the foregoing solution, the determining the security state of the home device based on the current operating state of the home device and a preset state library includes:

and matching the current operating state of the household equipment with the operating state in the preset state library, and determining the safety state of the household equipment according to the matching result.

In the above scheme, the determined safety state is a dangerous state; accordingly, the method can be used for solving the problems that,

the controlling the home device according to the determined security state and the preset security policy includes:

and monitoring the duration time of the dangerous state, and controlling the household equipment to stop operating when determining that the duration time of the dangerous state reaches a preset dangerous time threshold.

monitoring the duration time of the dangerous state, and sending a device control request to a user terminal when determining that the duration time of the dangerous state reaches a preset dangerous time threshold;

when a control instruction fed back by the user terminal is determined to be received in the first time, the household equipment is correspondingly controlled according to the control instruction;

and controlling the household equipment to stop operating when the control instruction fed back by the user terminal is determined not to be received within the first time.

In the foregoing solution, after the controlling the home device according to the determined security status and the preset security policy, the method further includes:

sending the state confirmation information of the household equipment to a user terminal; the state confirmation information carries the image information of the current state of the home equipment.

In the foregoing solution, when it is determined that the duration of the dangerous state reaches a preset dangerous time threshold, the method further includes:

and carrying out audio playing on the safety alarm of the household equipment, or sending the alarm information of the household equipment to a user terminal.

The embodiment of the invention also provides a safety monitoring device for the household equipment, which comprises: the device comprises a first communication module, an acquisition module, a determination module, a processing module and a control module; wherein,

the first communication module is used for receiving a safety monitoring instruction;

the acquisition module is used for responding to the safety monitoring instruction and acquiring first information and second information; the first information is different from the second information;

the determining module is used for determining the current operating state of the household equipment based on the first information and the second information;

the processing module is used for determining the safety state of the household equipment based on the current operating state of the household equipment and a preset state library;

and the control module is used for controlling the household equipment according to the determined safety state and a preset safety strategy.

the determining module is specifically configured to perform image processing on the image information and perform target detection on an image processing result to identify different monitoring objects in the image information;

In the above scheme, the processing module is specifically configured to match the current operating state of the home device with the operating state in the preset state library, and determine the security state of the home device according to a matching result.

the control module is specifically configured to monitor duration time of the dangerous state, and control the home device to stop operating when it is determined that the duration time of the dangerous state reaches a preset dangerous time threshold.

the control module is specifically configured to monitor duration time of the dangerous state, and send a device control request to the user terminal when determining that the duration time of the dangerous state reaches a preset dangerous time threshold;

In the above scheme, the first communication module is further configured to send status confirmation information of the home device to the user terminal; the state confirmation information carries the image information of the current state of the home equipment.

In the above scheme, the apparatus further includes an alarm module, configured to play an audio for performing a safety alarm on the home device, or send alarm information of the home device to a user terminal.

An embodiment of the present invention further provides a home device, where the home device includes: the second communication module and the safety control module; wherein,

the second communication module is used for receiving a control instruction;

the safety control module is used for controlling the household equipment according to the control instruction;

the control instruction is sent by a household equipment safety monitoring device according to the determined safety state and a preset safety strategy, wherein the household equipment safety monitoring device receives a safety monitoring instruction, acquires first information and second information, determines the current operating state of the household equipment based on the first information and the second information, determines the safety state of the household equipment based on the current operating state of the household equipment and a preset state library; the first information is different from the second information.

In the above scheme, the second communication module is further configured to send the security monitoring instruction.

The embodiment of the invention also provides a system for monitoring the safety of the household equipment, which comprises: a home device safety monitoring device and a home device; wherein,

the home equipment is used for sending a safety monitoring instruction;

the household equipment safety monitoring device is used for receiving the safety monitoring instruction and acquiring first information and second information according to the safety monitoring instruction; the first information is different from the second information;

sending a control instruction according to the determined safety state and a preset safety strategy;

and the household equipment is used for controlling the household equipment according to the control instruction.

The home equipment safety monitoring method, the device, the home equipment and the system provided by the embodiment of the invention receive a safety monitoring instruction; responding to the safety monitoring instruction, and acquiring first information and second information; the first information is different from the second information; determining the current operating state of the home equipment based on the first information and the second information; determining the safety state of the household equipment based on the current operation state of the household equipment and a preset state library; and controlling the household equipment according to the determined safety state and a preset safety strategy. Therefore, the safety state of the household equipment can be accurately judged and correspondingly controlled, and the household equipment safety control system is low in cost, good in reliability and strong in expansion capability.

Drawings

Fig. 1 is a schematic flow chart of a home device security monitoring method according to an embodiment of the present invention;

fig. 2 is a schematic flow chart of a second home device security monitoring method according to an embodiment of the present invention;

fig. 3 is a schematic flow chart of a security monitoring method for a third home device according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a structure of a safety monitoring apparatus for home devices according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a household device according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a home device security monitoring system according to an embodiment of the present invention.

Detailed Description

In the embodiment of the invention, a safety monitoring instruction is received; responding to the safety monitoring instruction, and acquiring first information and second information; the first information is different from the second information; determining the current operating state of the home equipment based on the first information and the second information; determining the safety state of the household equipment based on the current operation state of the household equipment and a preset state library; and controlling the household equipment according to the determined safety state and a preset safety strategy.

Example one

Fig. 1 is a schematic flow chart of a home device security monitoring method according to an embodiment of the present invention, which is applied to a home device security monitoring apparatus, and as shown in fig. 1, the home device security monitoring method includes:

step 101: receiving a safety monitoring instruction;

here, the security monitoring instruction is used to instruct a home device security monitoring apparatus to start a security monitoring operation on the home device;

based on the embodiment of the invention, in practical application, the safety monitoring instruction may be a safety monitoring instruction sent by the home device, that is, when the home device is started, the safety monitoring device of the home device is synchronously triggered to start the safety monitoring operation on the home device; or a safety monitoring instruction is sent to the user, namely the user manually starts the household equipment safety monitoring device to start the safety monitoring operation on the household equipment.

Based on the embodiment of the invention, in practical application, the household equipment can be a gas stove, the gas stove can comprise a second communication module, and when the gas stove is opened, the safety monitoring instruction can be sent to the household equipment safety monitoring device through the second communication module in a wireless local area network WIFI mode.

Step 102: responding to the safety monitoring instruction, and acquiring first information and second information;

here, the first information is different from the second information.

In an embodiment, the collecting the first information and the second information includes:

periodically acquiring first information and second information; the period can be set according to actual needs, for example, determined according to related factors such as the minimum allowable time of various dangerous states of the household equipment (such as empty burning of a gas stove, empty burning of a cooking utensil, long-time boiling of the cooking utensil, and the like), information processing performance, and the like; the setting of the period can adopt default configuration or manual configuration; such as setting the period to 1-5 minutes.

Based on the embodiment of the present invention, in practical application, the first information may be image information, and specifically may be image information of an environment where the home device is located; the second information may be audio information, and specifically may be sound from an environment where the home device is located; accordingly, if the allowed time lengths of the household device in various dangerous states are T1, T2, T3 and …, respectively, the time required for processing and identifying one frame of image is T1 ', and the time required for processing and identifying one audio sample is T2', the period T < min (T1, T2, T3 and …) and T > < max (T1 'and T2').

Step 103: determining the current operating state of the home equipment based on the first information and the second information;

based on the embodiment of the present invention, in practical application, when the first information is image information and the second information is audio information, the step specifically includes:

In an embodiment, the image processing the image information includes:

and performing basic image processing such as color conversion processing, filtering processing, binarization image conversion processing and the like on the image information.

In an embodiment, the performing target detection on the image processing result to identify different monitoring objects in the image information includes:

identifying different monitoring objects in the image information by carrying out contour detection and machine learning on the image processing result; for example: when the household device is a gas stove, the detection object may be: gas cooktops, flames and their sizes, cooking utensils, smoke, and other various physical objects.

In an embodiment, the performing audio characteristic analysis on the audio information includes:

and analyzing the frequency and the amplitude of the audio signal of the audio information, and determining the frequency and the amplitude of the audio signal corresponding to the audio information.

In one embodiment, the determining the current operating state of the home device based on the audio analysis result and the identified different monitoring objects includes:

matching the determined frequency and amplitude of the audio frequency with preset frequency and amplitude respectively, and determining the current operating state of the household equipment according to the matching result and the identified different monitoring objects;

here, the preset frequency and amplitude can be the frequency and amplitude of boiling of different foods, such as water; if the matching is successful, indicating that the corresponding food is in a boiling state;

the operating state of the home device may be: a gas stove empty burning state, a cooking utensil empty burning state, a cooking food boiling state, a food cooking state and the like;

correspondingly, the determination of the empty burning state of the gas stove can be as follows: determining that the gas cooking range has a flame and no cooking vessel is on the cooking range through the identified different monitoring objects;

the determination of the cooking vessel empty-burning state may be: determining that the gas cooking range has flame through the identified different monitoring objects, and placing a cooking utensil without any food above the gas cooking range;

the determination of the boiling state of the cooked food may be: determining that the gas stove has flame through the identified different monitoring objects, placing a cooking utensil above the gas stove, and determining that the gas stove cooks food through the existence of fog, and then determining that the cooked food is boiled through the matching result of the frequency and the amplitude of the audio frequency, namely the cooked food is in a boiling state at present;

the determination of the food cooking state may be: and determining that the gas cooking range has flame through the identified different monitoring objects, a cooking utensil is placed above the gas cooking range, fog exists, and determining that the cooked food is not boiled, namely the cooked food is currently in a food cooking state through matching results of the frequency and the amplitude of the audio frequency.

Step 104: determining the safety state of the household equipment based on the current operation state of the household equipment and a preset state library;

here, the state library includes various preset dangerous states; such as: a gas stove empty burning state, a cooking utensil empty burning state, a cooking food boiling state and the like.

Based on the embodiment of the invention, in practical application, the steps specifically comprise:

matching the current operating state of the household equipment with the operating state in the preset state library, and determining the safety state of the household equipment according to the matching result;

when the matching is successful, determining that the household equipment is in a dangerous state currently;

and when the matching fails, determining that the home equipment is in a safe state currently.

Step 105: controlling the household equipment according to the determined safety state and a preset safety strategy;

here, when the determined security state is a dangerous state, the controlling the home device according to the determined security state and a preset security policy includes:

monitoring the duration time of the dangerous state, and controlling the household equipment to stop operating when the duration time of the dangerous state reaches a preset dangerous time threshold;

wherein, the dangerous time threshold value can be set according to actual needs; such as 6 minutes;

in one embodiment, the monitoring the duration of the hazardous state comprises:

processing first information and second information acquired in each period to obtain a corresponding operation state, determining that the current operation state is the same as the dangerous state determined last time, recording the current time, and obtaining the time difference between the time when the dangerous state appears last and the time when the dangerous state appears first, wherein the time difference is the duration time of the dangerous state;

in one embodiment, the controlling the home device to stop operating includes:

sending a stop operation instruction to the home device to enable the home device to control the home device to stop the current operation according to the stop operation instruction, namely, the gas stove further comprises a safety control module for self-controlling and self-adjusting, for example, controlling the gas stove/gas valve to be closed and adjusting the gas valve to achieve the adjustment of the gas quantity;

wherein the sending of the stop operation instruction to the home device comprises:

and acquiring the address information of the household equipment, and sending an operation stopping instruction to the household equipment in a WIFI mode according to the address information of the household equipment.

In an embodiment, the communication between the home device security monitoring apparatus and the home device may be performed in a WIFI manner.

Based on the embodiment of the invention, in practical application, the determined safety state is a dangerous state;

controlling the home device according to the determined security state and a preset security policy, comprising:

when determining that the control instruction fed back by the user terminal is not received within the first time, controlling the household equipment to stop operating;

here, the size of the first time may be set according to actual needs;

the equipment control request can comprise the image information of the dangerous state, so that a user can know the current condition of the household equipment, and meanwhile, the user can quickly take corresponding measures under the condition that the user is close to the household equipment, such as immediately closing the gas stove when seeing that the gas stove is empty, seeing that a vessel on the gas stove is empty, immediately adding food into the vessel, and the like;

the control instruction can be a stop operation instruction, an equipment adjusting instruction, a no operation instruction and the like;

the equipment adjusting instruction is used for instructing a household equipment safety monitoring device to control the household equipment to adjust, for example, a gas stove is controlled to adjust a gas valve so as to adjust the gas quantity; the no-operation instruction is used for indicating the household equipment safety monitoring device not to perform any operation, namely, no operation related instruction is required to be sent to the household equipment.

In an embodiment, after the controlling the home device according to the determined security status and the preset security policy, the method further includes:

Based on the embodiment of the present invention, in practical applications, when it is determined that the duration time of the dangerous state reaches a preset dangerous time threshold, the method further includes:

In an embodiment, the playing the audio for the home device security alarm includes:

playing preset voice prompt information, such as: play "dangerous state, please note"; the playing may be a periodic playing; the period can be set according to actual needs;

or, playing preset sound signals, such as: playing a particular piece of music, a harsh sound, etc.

In an embodiment, the alarm information may be sent independently, or may be sent by being carried in the control request; when the warning information is independently transmitted, the warning information may include image information of the dangerous state.

Example two

Fig. 2 is a schematic flow chart of a home device security monitoring method according to an embodiment of the present invention, which is applied to a home device security monitoring apparatus, and as shown in fig. 2, the home device security monitoring method includes:

step 201: receiving a safety monitoring instruction;

in the embodiment of the invention, the household equipment is a gas stove, and the safety monitoring instruction is a safety monitoring instruction sent by the gas stove, namely when the household equipment is started, a safety monitoring device of the household equipment is synchronously triggered to start the safety monitoring operation on the gas stove.

Step 202: responding to the safety monitoring instruction, and acquiring first information and second information;

in the embodiment of the present invention, the first information is image information, specifically image information of an environment where the home device is located; the second information is audio information, specifically, sound from an environment where the home device is located.

The acquiring the first information and the second information comprises: periodically acquiring first information and second information;

the period can be set according to actual needs, for example, according to various dangerous states of the household equipment, such as empty burning of a gas stove, empty burning of a cooking utensil, long-time boiling of the cooking utensil and the like, the allowable minimum time, information processing performance and other relevant factors; the setting of the period can adopt default configuration or manual configuration; such as setting the period to 1-5 minutes; if the allowed time lengths of the household equipment in various dangerous states are T1, T2, T3 and … respectively, the time required for processing and identifying one frame of image is T1 ', and the time required for processing and identifying one audio sample is T2', the period T < ═ min (T1, T2, T3 and …) and T > ═ max (T1 ', T2').

Step 203: determining the current operating state of the home equipment based on the first information and the second information;

in the embodiment of the present invention, the steps specifically include: carrying out image processing on the image information, and carrying out target detection on an image processing result so as to identify different monitoring objects in the image information; performing audio characteristic analysis on the audio information, and determining the current operating state of the household equipment based on the audio analysis result and the identified different monitoring objects;

wherein the image processing the image information comprises:

performing basic image processing such as color conversion processing, filtering processing, binarization image conversion processing and the like on the image information;

performing target detection on the image processing result to identify different monitoring objects in the image information, including:

identifying different monitoring objects in the image information by carrying out contour detection and machine learning on the image processing result; for example: when the household device is a gas stove, the detection object may be: gas kitchen ranges, flames and sizes thereof, cooking utensils, smoke and other various physical objects;

the performing audio characteristic analysis on the audio information includes:

analyzing the frequency and amplitude of the audio signal of the audio information, and determining the frequency and amplitude of the audio signal corresponding to the audio information;

the determining the current operating state of the home device based on the audio analysis result and the identified different monitoring objects comprises:

the operating state of the home device may be: a gas stove empty burning state, a cooking utensil empty burning state, a cooking food boiling state, a food cooking state and the like.

Step 204: judging whether the household equipment is in a dangerous state currently according to the operation state and a preset state library, and if so, executing step 205; otherwise, go to step 202;

in the embodiment of the invention, the state library comprises various preset dangerous states; such as: a gas stove empty burning state, a cooking utensil empty burning state, a cooking food boiling state and the like.

In the embodiment of the present invention, the steps specifically include: matching the current operating state of the household equipment with the operating state in the preset state library, and if the matching is successful, determining that the household equipment is in a dangerous state currently; and if the matching fails, determining that the home equipment is in a safe state currently.

Step 205: monitoring the duration time of the dangerous state, judging whether the duration time of the dangerous state reaches a preset dangerous time threshold value, and if so, executing a step 206; if not, go to step 202;

here, the time-to-risk threshold may be set according to actual needs.

In an embodiment of the present invention, the monitoring the duration of the dangerous state includes:

the method comprises the steps of obtaining a corresponding operation state by processing first information and second information collected in each period, determining that the current operation state is the same as a dangerous state determined last time, recording the current time, and obtaining the time difference between the time when the dangerous state appears last and the time when the dangerous state appears first, wherein the time difference is the duration time of the dangerous state.

Step 206: performing safety alarm and sending a device control request to the user terminal, judging whether a control signaling fed back by the user terminal is received in the first time, and if so, executing step 207; if not, go to step 209;

here, the device control request includes image information of the dangerous state to make a user know a current status of the home device;

the first time can be set according to actual needs;

In the embodiment of the present invention, the performing security alarm includes: playing preset voice prompt information or a preset sound signal; the playing may be a periodic playing; the period can be set according to actual needs; the voice prompt information comprises: "dangerous state, please note"; the sound signals are as follows: a particular piece of music, a harsh sound, etc.

Step 207: and correspondingly controlling the household equipment according to the control instruction.

Step 208: transmitting the state confirmation information of the home device to the user terminal, and executing step 210;

here, the state confirmation information carries image information of the current state of the home device.

Step 209: sending a stop operation instruction to the home device, controlling the home device to stop operating, and executing step 210;

here, when the household appliance receives the stop operation instruction, the household appliance controls itself to stop the current operation, such as closing the gas stove/gas valve, according to the stop operation instruction.

Step 210: and ending the processing flow.

EXAMPLE III

Fig. 3 is a schematic flow chart of a home device security monitoring method according to an embodiment of the present invention; as shown in fig. 3, the home device security monitoring method includes:

step 301: receiving a safety monitoring instruction;

in an embodiment of the present invention, the household appliance is a gas range.

The receiving of the security monitoring instruction is receiving of a security monitoring instruction sent by a user, namely, the user manually starts the security monitoring device of the home device to start the security monitoring operation on the home device.

Step 302: responding to the safety monitoring instruction, and acquiring first information and second information;

Step 303: determining the current operating state of the home equipment based on the first information and the second information;

wherein the image processing the image information comprises:

the performing audio characteristic analysis on the audio information includes:

Step 304: judging whether the household equipment is in a dangerous state currently according to the operation state and a preset state library, and if so, executing a step 305; otherwise, go to step 302;

Step 305: monitoring the duration time of the dangerous state, judging whether the duration time of the dangerous state reaches a preset dangerous time threshold value, and if so, executing step 306; if not, go to step 302;

here, the time-to-risk threshold may be set according to actual needs.

Step 306: carrying out safety alarm and sending an operation stopping instruction to the household equipment to control the household equipment to stop operation;

And when the household equipment receives the stop operation instruction, controlling the household equipment to stop the current operation according to the stop operation instruction, such as controlling the gas stove/gas valve to be closed.

Step 307: and ending the processing flow.

Example four

FIG. 4 is a schematic diagram of a structure of a safety monitoring apparatus for home devices according to an embodiment of the present invention; as shown in fig. 4, the home device security monitoring apparatus according to the embodiment of the present invention includes: a first communication module 41, an acquisition module 42, a determination module 43, a processing module 44 and a control module 45; wherein,

the first communication module 41 is configured to receive a security monitoring instruction;

the acquisition module 42 is configured to respond to the security monitoring instruction and acquire first information and second information; the first information is different from the second information;

the determining module 43 is configured to determine a current operating state of the home device based on the first information and the second information;

the processing module 44 is configured to determine a security state of the home device based on a current operating state of the home device and a preset state library;

the control module 45 is configured to control the home device according to the determined security state and a preset security policy;

In practical applications, the household appliance may be a gas range.

Based on the embodiment of the invention, in practical application, the first information is image information, and the second information is audio information;

the determining module 43 is specifically configured to perform image processing on the image information, and perform target detection on an image processing result to identify different monitoring objects in the image information;

In an embodiment, the determining module 43 is specifically configured to perform basic image processing such as color conversion processing, filtering processing, and binary image conversion processing on the image information.

In an embodiment, the determining module 43 is specifically configured to perform contour detection and machine learning on the image processing result to identify different monitoring objects in the image information.

In an embodiment, the determining module 43 is specifically configured to perform frequency and amplitude analysis on the audio information to determine the frequency and amplitude of the audio signal corresponding to the audio information.

In an embodiment, the determining module 43 is specifically configured to match the determined frequency and amplitude of the audio frequency with a preset frequency and amplitude, and determine the current operating state of the home device according to a matching result and in combination with different identified monitoring objects;

Based on the embodiment of the present invention, in practical applications, the processing module 44 is specifically configured to match the current operating state of the home device with the operating state in the preset state library, and determine the security state of the home device according to a matching result;

here, the state library includes various preset dangerous states; such as: a gas stove empty burning state, a cooking utensil empty burning state, a cooking food boiling state and the like;

correspondingly, the control module 45 is specifically configured to monitor the duration time of the dangerous state, and control the home device to stop operating when determining that the duration time of the dangerous state reaches a preset dangerous time threshold;

wherein, the dangerous time threshold value can be set according to actual needs; such as 6 minutes.

In an embodiment, the control module 45 is specifically configured to process the first information and the second information acquired in each period to obtain a corresponding operation state, determine that the current operation state is the same as the dangerous state determined last time, record the current time, and obtain a time difference between the time when the dangerous state occurs last time and the time when the dangerous state occurs first time, where the time difference is the duration time of the dangerous state.

correspondingly, the control module 45 is specifically configured to monitor the duration time of the dangerous state, and send an equipment control request to the user terminal when determining that the duration time of the dangerous state reaches a preset dangerous time threshold;

here, the size of the first time may be set according to actual needs;

the device control request may include image information of the dangerous state to make a user know a current condition of the home device;

Based on the embodiment of the present invention, in practical application, the first communication module 41 is further configured to send the status confirmation information of the home device to the user terminal; the state confirmation information carries the image information of the current state of the home equipment.

Based on the embodiment of the present invention, in practical application, the apparatus further includes an alarm module 46, configured to play an audio for performing a safety alarm on the home device, or send an alarm message of the home device to the user terminal.

In an embodiment, the alarm module 46 is specifically configured to play a preset voice prompt message, such as: play "dangerous state, please note"; the playing may be a periodic playing; the period can be set according to actual needs;

EXAMPLE five

FIG. 5 is a schematic diagram of a household device according to an embodiment of the present invention; as shown in fig. 5, the home device in the embodiment of the present invention includes: a second communication module 51 and a security control module 52; wherein,

the second communication module 51 is configured to receive a control instruction;

the safety control module 52 is configured to control the home device according to the control instruction;

Based on the embodiment of the present invention, in practical application, the second communication module 51 is further configured to send the security monitoring instruction.

Based on the embodiment of the invention, in practical application, the control instruction can be a stop operation instruction, an equipment adjustment instruction, a no operation instruction and the like;

correspondingly, when the control instruction is a stop operation instruction, the safety control module 52 is specifically configured to control itself to stop the current operation according to the stop operation instruction; when the household device is a gas stove, the safety control module 52 is specifically configured to control the gas stove/gas valve to be closed according to the stop operation instruction;

when the control instruction is an apparatus adjustment instruction, the safety control module 52 is specifically configured to adjust the home apparatus according to the apparatus adjustment instruction, such as: the gas valve is adjusted to achieve the purpose of adjusting the gas quantity.

When the control command is a no-operation command, the safety control module 52 is specifically configured to not perform any operation according to the no-operation command.

It should be noted that, when the household device is a gas stove, the household device includes not only the second communication module 51 and the safety control module 52, but also the parts of the existing gas stove, such as a gas stove head, a gas valve, and a motor.

EXAMPLE six

FIG. 6 is a schematic diagram of a composition structure of a home device security monitoring system according to an embodiment of the present invention; as shown in fig. 6, the home device security monitoring system according to the embodiment of the present invention includes: a home appliance 61 and a home appliance security monitoring device 62; wherein,

the home device security monitoring device 62 is configured to receive a security monitoring instruction, and acquire first information and second information according to the security monitoring instruction; the first information is different from the second information;

determining a current operation state of the home device 61 based on the first information and the second information;

determining the safety state of the home device 61 based on the current operating state of the home device and a preset state library;

the home device 61 is configured to control the home device 61 according to the control instruction.

Based on the embodiment of the present invention, in practical application, the home device 61 is further configured to send a security monitoring instruction, that is, when the home device 61 is started, the home device security monitoring apparatus 62 is synchronously triggered to start a security monitoring operation on the home device.

In one embodiment, the household appliance 61 may be a gas range.

Based on the embodiment of the present invention, in practical applications, the first information is different from the second information, and the first information may be image information and the second information may be audio information.

Based on the embodiment of the present invention, in practical applications, the home device security monitoring apparatus 62 is specifically configured to periodically acquire first information and second information; the period can be set according to actual needs, for example, determined according to related factors such as the minimum allowable time of various dangerous states of the household equipment (such as empty burning of a gas stove, empty burning of a cooking utensil, long-time boiling of the cooking utensil, and the like), information processing performance, and the like; the setting of the period can adopt default configuration or manual configuration; such as setting the period to 1-5 minutes; if the allowed time lengths of the household equipment in various dangerous states are T1, T2, T3 and … respectively, the time required for processing and identifying one frame of image is T1 ', and the time required for processing and identifying one audio sample is T2', the period T < ═ min (T1, T2, T3 and …) and T > ═ max (T1 ', T2').

Based on the embodiment of the present invention, in practical application, the home device security monitoring apparatus 62 is specifically configured to perform image processing on the image information, and perform target detection on an image processing result to identify different monitored objects in the image information;

In an embodiment, the home device security monitoring apparatus 62 is specifically configured to perform basic image processing, such as color conversion processing, filtering processing, and binary image conversion processing, on the image information.

In an embodiment, the home device security monitoring apparatus 62 is specifically configured to perform contour detection and machine learning on the image processing result to identify different monitoring objects in the image information; for example: when the household device is a gas stove, the detection object may be: gas cooktops, flames and their sizes, cooking utensils, smoke, and other various physical objects.

In an embodiment, the home device security monitoring apparatus 62 is specifically configured to perform frequency and amplitude analysis on the audio information to determine the frequency and amplitude of the audio signal corresponding to the audio information.

In an embodiment, the home device security monitoring apparatus 62 is specifically configured to match the determined frequency and amplitude of the audio with a preset frequency and amplitude, respectively, and determine the current operating state of the home device according to a matching result and in combination with different identified monitoring objects;

Based on the embodiment of the invention, in practical application, the state library comprises various preset dangerous states; such as: a gas stove empty burning state, a cooking utensil empty burning state, a cooking food boiling state and the like.

In an embodiment, the home device security monitoring apparatus 62 is specifically configured to match the current operating state of the home device 61 with the operating state in the preset state library, and determine the security state of the home device 61 according to a matching result;

Based on the embodiment of the present invention, in practical application, the home device safety monitoring apparatus 62 is specifically configured to monitor the duration time of the dangerous state, and control the home device 61 to stop operating when determining that the duration time of the dangerous state reaches a preset dangerous time threshold.

Based on the embodiment of the invention, in practical application, the home device safety monitoring system further comprises a user terminal 63; correspondingly, the home device safety monitoring apparatus 62 is specifically configured to monitor the duration time of the dangerous state, and send a device control request to the user terminal 63 when determining that the duration time of the dangerous state reaches a preset dangerous time threshold;

when determining that a control instruction fed back by the user terminal 63 is received within a first time, correspondingly controlling the home device 61 according to the control instruction;

when determining that the control instruction fed back by the user terminal 63 is not received within the first time, controlling the home device 61 to stop operating;

the equipment adjusting instruction is used for instructing a household equipment safety monitoring device to control the household equipment to adjust, such as controlling a gas stove to adjust a gas valve to adjust the gas quantity; the no-operation instruction is used for indicating the household equipment safety monitoring device not to perform any operation, namely, no operation related instruction is required to be sent to the household equipment.

Based on the embodiment of the present invention, in practical application, the home device security monitoring apparatus 62 is further configured to send the status confirmation information of the home device to the user terminal; the state confirmation information carries the image information of the current state of the home equipment.

Based on the embodiment of the present invention, in practical applications, the home device security monitoring apparatus 62 is further configured to perform audio playing for the home device security alarm, or send the alarm information of the home device to the user terminal.

In an embodiment, the home device security monitoring apparatus 62 is specifically configured to play preset voice prompt messages, such as: play "dangerous state, please note"; the playing may be a periodic playing; the period can be set according to actual needs;

Based on the embodiment of the invention, in practical application, the alarm information can be sent independently or carried in the control request; when the warning information is independently transmitted, the warning information may include image information of the dangerous state.

In the embodiment of the present invention, the first communication module 41, the acquisition module 42, the determination module 43, the Processing module 44, the control module 45, the alarm module 46, the second communication module 51, and the safety control module 52 may be implemented by a Central Processing Unit (CPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), or an integrated circuit (ASIC) in a terminal or a server.

Here, it should be noted that: the above description related to the apparatus and system is similar to the above description of the method, and the description of the beneficial effects of the method is omitted for brevity. For technical details not disclosed in the embodiments of the apparatus and system according to the present invention, reference is made to the description of the embodiments of the method according to the present invention.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.

Claims

1. A home device security monitoring method, the method comprising:

receiving a safety monitoring instruction;

2. The method of claim 1, wherein the first information is image information and the second information is audio information;

3. The method according to claim 1 or 2, wherein the determining the security status of the home device based on the current operating status of the home device and a preset status library comprises:

4. The method of claim 1, wherein the determined safety state is a hazardous state;

5. The method of claim 1, wherein the determined safety state is a hazardous state;

6. The method of claim 5, wherein after the controlling the home device according to the determined security status and the preset security policy, the method further comprises:

7. The method of claim 4 or 5, wherein when it is determined that the time for which the dangerous state lasts reaches a preset dangerous time threshold, the method further comprises:

8. A home device security monitoring apparatus, the apparatus comprising: the device comprises a first communication module, an acquisition module, a determination module, a processing module and a control module; wherein,

9. The apparatus of claim 8, wherein the first information is image information and the second information is audio information;

10. The apparatus according to claim 8 or 9, wherein the processing module is specifically configured to match a current operation state of the home device with an operation state in the preset state library, and determine the security state of the home device according to a matching result.

11. The apparatus of claim 8, wherein the determined safety state is a dangerous state;

12. The apparatus of claim 8, wherein the determined safety state is a dangerous state;

13. The apparatus of claim 12, wherein the first communication module is further configured to send a status confirmation message of the home device to the user terminal; the state confirmation information carries the image information of the current state of the home equipment.

14. The apparatus of claim 11 or 12, further comprising an alarm module, configured to perform audio playing for the security alarm of the home device, or send an alarm message of the home device to the user terminal.

15. A home device, characterized in that the home device comprises: the second communication module and the safety control module; wherein,

the second communication module is used for receiving a control instruction;

16. The home device of claim 15, wherein the second communication module is further configured to send the security monitoring instruction.

17. A home device security monitoring system, the system comprising: a home device safety monitoring device and a home device; wherein,

the household equipment safety monitoring device is used for receiving a safety monitoring instruction and acquiring first information and second information according to the safety monitoring instruction; the first information is different from the second information;