CN113888826A

CN113888826A - Monitoring processing method, device and system, computer equipment and storage medium

Info

Publication number: CN113888826A
Application number: CN202111135765.2A
Authority: CN
Inventors: 李春君; 韩洋; 陈科科
Original assignee: Lumi United Technology Co Ltd
Current assignee: Shenzhen Lumi United Technology Co Ltd; Lumi United Technology Co Ltd
Priority date: 2021-09-27
Filing date: 2021-09-27
Publication date: 2022-01-04

Abstract

The embodiment of the application provides a monitoring processing method, a device and a system, computer equipment and a medium, wherein the monitoring processing method comprises the following steps: when motion sensing information uploaded by environment sensing equipment in a target environment is acquired, determining whether the target environment meets monitoring conditions; if the monitoring condition is met, acquiring a monitoring strategy corresponding to the action sensing information; sending a control instruction to mobile monitoring equipment in the target environment according to the monitoring strategy; and the control instruction is used for indicating the mobile monitoring equipment to move to a target monitoring position determined according to the monitoring strategy and carrying out image acquisition, and the acquired image data is used for being pushed to a monitoring terminal for monitoring.

Description

Monitoring processing method, device and system, computer equipment and storage medium

Technical Field

The present application relates to the field of smart home technologies, and in particular, to a monitoring processing method, an apparatus and a system, a computer device, and a computer-readable storage medium.

Background

With the development of social progress and demand, people have higher and higher requirements on safe living environment. The main known method for improving the home security is to configure a dedicated security monitoring device, and the security monitoring device, various alarm detectors, cameras and the like jointly form a home security alarm system for providing intrusion alarm service for a residence.

However, in the home security alarm system, the positions of the cameras, the alarm detectors and other devices for detecting whether safety risk exists are fixed, the monitoring coverage is small, the monitoring form is single, or the cameras need to be arranged at various places in the home to meet the safety monitoring requirement of all-around high requirements, so that the monitoring cost is high, and the monitoring efficiency is low.

Disclosure of Invention

In order to solve the existing technical problems, the application provides a monitoring processing method, a monitoring processing device, a monitoring processing system, a computer device and a computer readable storage medium, which have the advantages of lower cost, more complete coverage and capability of improving monitoring safety performance.

In order to achieve the above purpose, the technical solution of the embodiment of the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a monitoring processing method, which is applied to a monitoring center, and includes:

when motion sensing information uploaded by environment sensing equipment in a target environment is acquired, determining whether the target environment meets monitoring conditions;

if the monitoring condition is met, acquiring a monitoring strategy corresponding to the action sensing information;

sending a control instruction to mobile monitoring equipment in the target environment according to the monitoring strategy; and the control instruction is used for indicating the mobile monitoring equipment to move to a target monitoring position determined according to the monitoring strategy and carrying out image acquisition, and the acquired image data is used for being pushed to a monitoring terminal for monitoring.

In a second aspect, an embodiment of the present application provides a monitoring processing apparatus, including:

the determining module is used for determining whether the target environment meets monitoring conditions or not when motion sensing information uploaded by environment sensing equipment in the target environment is acquired;

the strategy module is used for acquiring a monitoring strategy corresponding to the action sensing information if the monitoring condition is met;

the control module is used for sending a control instruction to the mobile monitoring equipment in the target environment according to the monitoring strategy; and the control instruction is used for indicating the mobile monitoring equipment to move to a target monitoring position determined according to the monitoring strategy and carrying out image acquisition, and the acquired image data is used for being pushed to a monitoring terminal for monitoring.

Optionally, the policy module is further configured to obtain a monitoring configuration parameter, which is sent by the terminal device and is for each environmental sensing device in the target environment; and configuring monitoring conditions corresponding to the action sensing information of each environment sensing device according to the monitoring configuration parameters.

Optionally, the monitoring configuration parameter includes at least one of a preset monitoring period and an event type; the monitoring condition includes at least one of a target monitoring period and a target event type corresponding to the monitoring configuration parameter.

Optionally, the monitoring policy includes a position calibration point calibrated in advance and corresponding to the motion sensing information of the environment sensing device; the control module is further used for determining a target monitoring position corresponding to the mobile monitoring equipment according to the position calibration point corresponding to the monitoring strategy; acquiring current position information of the mobile monitoring equipment, and determining a moving track of the mobile monitoring equipment according to the current position information and the target monitoring position; and sending a control instruction carrying the moving track to the mobile monitoring equipment in the target environment according to the monitoring strategy.

Optionally, the control module is further configured to obtain shooting strategy information corresponding to each position calibration point; the shooting strategy information comprises a shooting mode or a shooting mode and a shooting duration corresponding to the shooting mode; sending a control instruction carrying a target monitoring position and the corresponding shooting strategy information to mobile monitoring equipment in the target environment according to the monitoring strategy; the control instruction is used for controlling the mobile monitoring equipment to move to a target position, acquiring image data according to the corresponding shooting strategy information and pushing the image data to the terminal equipment.

Optionally, the environment sensing device includes at least one of an infrared sensor, a door and window sensor, a vibration sensor, a radar sensor, and a door lock device; the action sensing information comprises at least one of human body movement information detected by an infrared sensor, opening and closing signals detected by a door and window sensor, vibration signals detected by a vibration sensor, object movement information detected by a radar sensor and unlocking information detected by door lock equipment.

Optionally, the control module is further configured to send corresponding warning information to the terminal device according to the monitoring policy, and send a control instruction carrying the target monitoring position to the mobile monitoring device.

Optionally, the control module is further configured to determine, according to the monitoring policy, a plurality of target monitoring locations in the target environment and a priority corresponding to each of the target monitoring locations; sending a control instruction carrying a plurality of target monitoring positions comprising the priorities to mobile monitoring equipment in the target environment; and the control instruction is used for indicating the mobile monitoring equipment to move to each target monitoring position according to the priority and carrying out image acquisition.

In a third aspect, an embodiment of the present application provides a computer device, including a processor, a memory, and a computer program stored on the memory and executable by the processor, where the computer program, when executed by the processor, implements the monitoring processing method according to any embodiment of the present application.

In a fourth aspect, an embodiment of the present application provides a monitoring processing system, including an environment sensing device, a computer device, a mobile monitoring device, and a monitoring terminal, wherein: the environment sensing equipment is used for acquiring action sensing information in a target environment and reporting the action sensing information to the computer equipment; the computer equipment is used for determining whether the target environment meets monitoring conditions or not when the action sensing information uploaded by the environment sensing equipment in the target environment is acquired; if the monitoring condition is met, acquiring a monitoring strategy corresponding to the action sensing information; sending a control instruction to mobile monitoring equipment in the target environment according to the monitoring strategy; the control instruction is used for indicating the mobile monitoring equipment to move to a target monitoring position determined according to the monitoring strategy and carrying out image acquisition, and the acquired image data is used for being pushed to a monitoring terminal for monitoring; the mobile monitoring equipment is used for moving to a target position according to the control instruction to acquire an image and pushing acquired image data to the monitoring terminal; and the monitoring terminal is used for acquiring the image data sent by the mobile monitoring equipment and monitoring the image data.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements a monitoring processing method according to any embodiment of the present application.

According to the monitoring processing method, the monitoring processing device and the monitoring processing system, and the computer equipment, the monitoring processing method determines the monitoring strategy by acquiring the action sensing information uploaded by the environment sensing equipment and controls the mobile monitoring equipment to move to the target monitoring position determined according to the monitoring strategy and perform image acquisition according to the action sensing information, the acquired image data is used for being pushed to the monitoring terminal for monitoring, so that the image data of different positions can be acquired through the mobility of the mobile monitoring equipment, and therefore all-around monitoring can be achieved under the condition that cameras are not installed at all positions, not only is the cost saved, but also the monitoring coverage range is wide, and the monitoring timeliness and the monitoring efficiency can be improved.

The computer-readable storage medium provided in the foregoing embodiment is used to implement the monitoring processing method provided in the embodiment of the present application, and has the same technical effect as the monitoring processing method, and for avoiding repetition, details are not described here again.

Drawings

Fig. 1 is a framework diagram of an internet of things system in an optional application scenario of a monitoring processing method provided in an embodiment of the present application;

FIG. 2 is a flow chart of a monitoring process according to an embodiment of the present application;

FIG. 3 is a flow chart of a monitoring process in an alternative embodiment of the present application;

FIG. 4 is a schematic diagram of a configuration interface in an embodiment of the present application;

fig. 5 is a timing diagram of a monitoring processing method according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a monitoring processing device according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a monitoring center according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a monitoring processing system according to an embodiment of the present application.

Detailed Description

The technical solution of the present application is further described in detail with reference to the drawings and specific embodiments of the specification.

In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the attached drawings, the described embodiments should not be considered as limiting the present application, and all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

In the following description, reference is made to the expression "some embodiments" which describe a subset of all possible embodiments, it being noted that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

In the following description, references to the terms "first, second, and third" are only used to distinguish between similar items and do not denote a particular order, but rather the terms "first, second, and third" are used to indicate that a particular order or sequence of items may be interchanged where appropriate to enable embodiments of the application described herein to be practiced otherwise than as specifically illustrated or described herein.

Please refer to fig. 1, which is a block diagram of an internet of things system in an optional application scenario of the monitoring processing method according to the embodiment of the present application. The internet of things system comprises a monitoring center 51, a terminal device 52, a mobile monitoring device 54, a trigger device 53 and the like. The monitoring center 51 may be a decision system in the smart home system, such as a gateway, a cloud, a central controller, and other devices having a centralized control function. The terminal device 51 may be any intelligent device with communication and storage functions, such as a smart phone, a desktop computer, a notebook computer, a tablet computer, or other intelligent communication devices with network connection functions. The triggering device 53 may include various intelligent home products, such as various sensors, vibration stickers, and door locks, capable of detecting the environmental status information in the home for determining whether a specific risk event occurs. The mobile monitoring device 54 is an intelligent shooting device capable of moving autonomously and taking pictures or videos, such as a mobile robot equipped with a camera.

Optionally, the mobile monitoring device 54 and the triggering device 53 may respectively access a network through a gateway to form an internet of things system, the gateway may be built based on a ZigBee protocol, and the mobile monitoring device 54 and the triggering device 53 may establish network connection with the gateway 53 based on the ZigBee protocol, so as to join in the ZigBee network. The smart home devices such as the mobile monitoring device 54 and the triggering device 53 may be pre-added gateways, for example, the mobile monitoring device 54 and the triggering device 53 may be devices in a suite to which the gateway device belongs when the gateway leaves a factory; or a device subsequently connected to the gateway by user operation.

Optionally, a client capable of managing smart home devices such as the mobile monitoring device 54 and the triggering device 53 is installed in the terminal device 52, where the client may be an application client (e.g., a mobile phone APP) or a web page client, and is not limited herein.

The terminal device 52, the mobile monitoring device 54, the triggering device 53 and other smart home devices may all access to the ethernet through a gateway, and the gateway may access to the smart home system through a wired or wireless communication connection. For example, a user may configure a control policy of the smart home device by using a client on the terminal device 52, and the terminal device 52 may store the acquired configuration information in the monitoring center 51 according to a user operation. Optionally, the terminal device 52 may also establish a network connection with the monitoring center 51 through 2G/3G/4G/5G, WiFi, so as to obtain data sent by the monitoring center 51.

Optionally, the terminal device 52, the network mobility monitoring device 54, and the triggering device 53 may be in the same local area network as the gateway, or may be in the same wide area network as the monitoring center 51. When the terminal device 52 and the gateway are in the same local area network, the terminal device 52 may interact with the gateway, and smart home devices such as a network mobile monitoring device 54 and a triggering device 53 connected to the gateway through a local area network path; and the intelligent home devices such as the gateway, the network mobile monitoring device 54 connected to the gateway, the trigger device 53 and the like can be interacted with the gateway through a wide area network path. When the terminal device 52 and the gateway are not in the same local area network, the terminal device 52 may interact with the gateway, and smart home devices such as the network mobile monitoring device 54 and the triggering device 53 connected to the gateway through a wide area network path.

The user can adopt the terminal equipment 52 to configure automation, and the intelligent home system can realize the control of the intelligent home equipment in the range of the local area network according to the automation configured by the terminal equipment 52. Automation refers to a linkage application built between gateway devices or sub-devices connected to the gateway devices; the automation comprises a trigger condition and an execution action, the equipment for realizing the control of the automation scene comprises trigger equipment and controlled equipment (or execution equipment), the trigger equipment and the controlled equipment are in communication connection through a gateway, and when the trigger equipment meets the trigger condition, the gateway controls the controlled equipment to execute the corresponding execution action. The triggering device can be various environment sensing devices such as a pressure sensor, a temperature sensor, a humidity sensor, a door and window sensor or a smoke sensor. The controlled devices may be various switches, sockets, cameras, etc. In the monitoring processing method provided in the embodiment of the present application, the controlled device mainly refers to a mobile monitoring device 54.

Suppose that a user sets an automatic linkage of security monitoring to control the mobile monitoring device to move to the door and window to acquire a video when a person intrudes into the home from the door and window, and the condition in the automation is that the person enters from the door and window, and the execution action is to acquire the video when the mobile monitoring device moves to the door and window. Based on the application scene, the door and window sensor can be set as the trigger equipment, and the mobile monitoring equipment is set as the controlled equipment. The specific execution principle is as follows: if the automatic execution is carried out locally on the gateway through the local area network path, the door and window sensor senses that the door and the window are opened and the infrared sensor detects that someone enters, the event is reported to the gateway, after the gateway receives the event that someone enters from the gateway when the door and the window are opened, the mobile monitoring equipment corresponding to the execution action is found according to the stored automatic configuration information, and the mobile monitoring equipment is informed to move to the position of the door and the window to start video shooting, so that the automatic linkage of the security monitoring event is realized. Under the wide area network path, automatic execution is carried out at the high in the clouds, then the door and window sensor senses that door and window are opened and infrared sensor detects someone from door and window entering, reports this incident to the gateway, reports this incident after the gateway receives and is the high in the clouds, and the high in the clouds is according to the scene configuration information of storage, finds the portable supervisory equipment who carries out the correspondence of action to inform portable supervisory equipment to move the position of door and window and open the video and shoot, thereby realized the automatic linkage of security protection monitoring incident. The mobile monitoring equipment reports the video to the cloud after acquiring the video, and the cloud is responsible for storage.

Referring to fig. 2, a monitoring processing method provided in an embodiment of the present application may be applied to the monitoring center shown in fig. 1, where the monitoring center is a decision-making system in an intelligent home system, such as any device with a centralized control function, such as a gateway, a cloud, and a central controller in the intelligent home system. The monitoring processing method includes, but is not limited to, S101 and S103, and specifically is as follows:

s101, when motion sensing information uploaded by environment sensing equipment in a target environment is acquired, determining whether the target environment meets monitoring conditions; .

The environment sensing device is a device for monitoring sensing information in a target environment, and specifically may be a trigger device with a sensing detection function, which is capable of detecting motion sensing information generated in the target environment, and may include, for example, various sensors, a vibration sticker, a door lock and other smart home devices, where the sensors may include an infrared sensor, a door and window sensor, a vibration sensor, a radar sensor and the like. The action sensing information uploaded by the environment sensing equipment can be information detected by various sensors, information detected by intelligent household equipment such as a door lock and the like that the intelligent household equipment is in a certain state or executes a certain execution action. The target environment refers to a preset place range to be monitored, such as a home of a user.

In some optional embodiments, the obtaining of the action sensing information uploaded by the environment sensing device in the target environment refers to obtaining specified information detected by the trigger device in the target environment or obtaining execution action information for executing a certain execution action. The triggering device may include various smart home products capable of detecting an environmental state within a home for determining whether a particular risk event has occurred. The trigger device and the execution action information of the trigger device can be used as automatic trigger condition information, and whether a corresponding risk event occurs at present can be judged according to the trigger condition information.

S103, if the monitoring condition is met, acquiring a monitoring strategy corresponding to the action sensing information;

the monitoring strategy refers to a preset mode for monitoring a target monitoring position meeting the monitoring condition, and if the target monitoring position meets the monitoring condition according to the action sensing information uploaded by the environment sensing equipment, the mode for shooting the target monitoring position is started, wherein the shooting mode comprises a photo or a video, a shooting angle or angle range, shooting duration and the like. The target monitoring position can be determined according to the action sensing information, if the action sensing information is abnormal unlocking information detected by the door lock, the target environment can be determined to meet the monitoring condition according to the action sensing information uploaded by the door lock, and the area where the door lock is located can be determined to be the target monitoring position according to the action sensing information uploaded by the door lock.

The monitoring strategy corresponds to the action sensing information, and different monitoring strategies can be set according to different action sensing information so as to ensure that the image data acquired under the corresponding monitoring strategy can represent the current event content of the target monitoring position.

S105, sending a control instruction to the mobile monitoring equipment in the target environment according to the monitoring strategy; and the control instruction is used for indicating the mobile monitoring equipment to move to a target monitoring position determined according to the monitoring strategy and carrying out image acquisition, and the acquired image data is used for being pushed to a monitoring terminal for monitoring.

The mobile monitoring device is a mobile device having an autonomous positioning and navigation function and a camera function, and is capable of constructing a navigation map in a target environment and autonomously moving, and may specifically be a mobile monitoring device, a mobile robot having a camera function, and the like.

The initial position of the mobile monitoring device may be located at a fixed position indoors, and the target monitoring position refers to position information of a desired position to which the mobile monitoring device moves from the initial position, for example, the target monitoring position may be a coordinate value in a coordinate system created by using the initial position as a coordinate origin, an indoor preset reference point position coordinate, or a position coordinate of an indoor preset reference object. And the control instruction is used for controlling the mobile monitoring equipment to move to a target position to acquire image data of the target monitoring position and push the image data to the terminal equipment.

In some optional embodiments, when motion sensing information uploaded by the environment sensing equipment is acquired, whether a risk event exists is determined according to the motion sensing information and an event judgment rule, and if the risk event exists, a control instruction carrying target position information is sent to the mobile monitoring equipment; the control instruction is used for controlling the mobile monitoring equipment to move to a target position to acquire the image data of the risk event and push the image data to the terminal equipment.

The event judgment rule may be a preset and unified rule for judging whether the risky event occurs, or a rule configured by a user in a self-defined manner through the terminal device for judging whether the risky event occurs. The event judgment rule is a rule that is used to judge whether a risk event occurs and needs to start monitoring, and may be determined according to a security risk possibly caused by the occurrence of a corresponding event, for example, an event attempting to illegally enter a room may cause a security risk, which is a risk event. Optionally, the event judgment rule may further correspondingly divide the event into a plurality of risk event levels according to the degree of the security risk possibly caused by the event, for example, an event attempting to illegally enter a room may cause a greater security risk, which is a risk event of the first risk level; events visited by strangers may pose a certain security risk, a risk event of a second risk level. And the monitoring center sends a control instruction carrying target position information to the mobile monitoring equipment under the condition that the risk event is determined to exist according to the action sensing information of the environment sensing equipment and the event judgment rule.

In the above embodiment of the application, when the monitoring center can monitor the risk event according to the action sensing information of the trigger device, the mobile monitoring device is controlled to move to the designated position for patrol, the image data of the risk event possibly occurring at different positions can be collected through the mobility of the mobile monitoring device, so that the omnidirectional monitoring can be realized under the condition of avoiding installing cameras at all positions, the cost is saved, the monitoring coverage range is wide, and the monitoring timeliness and the monitoring efficiency can be improved.

In some embodiments, the method further comprises:

acquiring monitoring configuration parameters which are sent by terminal equipment and aim at each environmental sensing equipment in a target environment;

and configuring monitoring conditions corresponding to the action sensing information of each environment sensing device according to the monitoring configuration parameters.

The monitoring configuration parameters are parameters configured according to the type of the designated motion sensing information detected by each environment sensing device. When the action sensing information detected by different environment sensing devices or a plurality of appointed environment sensing devices respectively detect specific action sensing information, whether preset monitoring conditions are met or not can be correspondingly represented. In an optional example, the monitoring configuration parameter includes a correspondence between the monitoring condition and the motion sensing information detected by each of the environment sensing devices.

The monitoring configuration parameters can be configured by a user in a user-defined mode through terminal equipment, and the terminal equipment obtains the monitoring configuration parameters according to configuration operation of the user aiming at each environment sensing equipment in the target environment and sends the monitoring configuration parameters to the monitoring center.

In some embodiments, the monitoring center determines whether the monitoring condition is satisfied according to the motion sensing information detected by the environment sensing device, which means that the monitoring center determines whether a risk event exists according to the motion sensing information detected by the environment sensing device and a set event determination rule. And if the risk event is determined to exist, the monitoring center sends a control instruction carrying the target monitoring position to the mobile monitoring equipment. Before the monitoring center sends the control instruction carrying the target monitoring position to the mobile monitoring equipment, the method comprises the following steps:

acquiring monitoring configuration parameters sent by terminal equipment, and determining an event judgment rule according to the monitoring configuration parameters; the event judgment rule comprises trigger condition information and an event type corresponding to the trigger condition information.

The terminal equipment can be provided with a client capable of managing the mobile monitoring equipment, the trigger equipment and other intelligent household equipment, the client can provide a security monitoring interface for configuring the security monitoring range, mode and the like by a user, and the user performs configuration operation in the client to set an event judgment rule for identifying the risk event. The security monitoring interface may provide a configuration field for a user to select a trigger device and configure the execution of an action thereon, and a configuration field for identifying the risk event corresponding to the selected trigger device and the execution of the action thereon. If the user can select the vibration sticker a1 to detect vibration and the infrared sensor a2 detects a person through the configuration field provided by the security monitoring interface, the currently occurring event is identified as the illegal entry risk event. The monitoring configuration parameters may be configuration parameters obtained by the terminal device based on configuration operations of the user in a security monitoring interface of the client. The terminal equipment acquires monitoring configuration parameters according to configuration operations of a user and sends the monitoring configuration parameters to the monitoring center, the monitoring center takes the trigger equipment and execution actions thereof as trigger condition information in the event judgment rule according to the monitoring configuration parameters sent by the terminal equipment, and takes a result of an event which is determined to be occurring and has safety risks according to the trigger equipment and the execution actions thereof as an event type in the event judgment rule, so that the event judgment rule is formed.

In the above embodiment, the user may configure the monitoring configuration parameters of each environmental sensing device by using the terminal device to form an individualized security monitoring scheme meeting the self-demand, and the mobility of the mobile monitoring device may be utilized to collect image data of risk events that may occur at different positions, so as to achieve the monitoring purpose, and in terms of a mode of autonomously starting monitoring for risk identification, the user may conveniently configure the rules for identifying the risk events without being limited by the positions and number of cameras fixedly installed in the room, thereby facilitating the formation of a security monitoring scheme with a more comprehensive coverage and meeting the individualized demand.

In some embodiments, the monitoring configuration parameter comprises at least one of a preset monitoring period and an event type; the monitoring condition includes at least one of a target monitoring period and a target event type corresponding to the monitoring configuration parameter.

The preset monitoring time period may refer to an effective time period for starting detection of motion sensing information for different environment sensing devices. For example, the sleep time period from 12 pm to 6 am is set as the preset monitoring time period. The event type may refer to a preset event type, and the user may preset one or more event types that need to start monitoring, and determine whether a currently occurring event is the event type according to the monitoring configuration parameters detected by each environmental sensing device. The monitoring condition is a target monitoring time period or a target event type corresponding to the monitoring configuration parameter, if the monitoring center judges whether the current time belongs to a preset target monitoring time period, if so, the monitoring condition is satisfied; or if the current time belongs to the preset target time type, indicating that the monitoring condition is met.

In an optional example, the step of determining the event judgment rule according to the monitoring configuration parameter includes:

acquiring monitoring configuration parameters of a plurality of security modes which are respectively corresponding to different monitoring time periods and sent by terminal equipment, and determining an event judgment rule according to the monitoring configuration parameters; the event judgment rule comprises trigger condition information and event types corresponding to the trigger condition information detected in different monitoring time periods.

The user sets an event judgment rule for identifying the risk event by self configuration operation of the client of the terminal device, and can set different judgment standards according to the execution action information of the same trigger device in different monitoring time periods to determine whether the risk event exists, wherein the event determined based on the information that the door lock detects that someone unlocks in the time periods of going to sleep in the daytime is usually a safe event without risk, and the event determined based on the information that the door lock detects that someone unlocks in the time periods of going to sleep in the evening is usually regarded as someone entering the room illegally and is the risk event. And setting different judgment standards according to the execution action information of the same trigger equipment in different monitoring time periods to determine whether risk events exist, and correspondingly forming different security modes corresponding to the different monitoring time periods, wherein if the security mode set in the time period aiming at going to work on a daytime is a home guarding mode, the security mode set in the time period aiming at falling asleep at night is a night guarding mode, and the event judgment rules for identifying the risk events in the home guarding mode and the night guarding mode are different. The monitoring center acquires monitoring configuration parameters of a plurality of security modes which are respectively corresponding to different monitoring time periods and are sent by the terminal equipment, takes monitoring time period information, the triggering equipment and execution actions thereof as triggering condition information in the event judgment rule, and takes a result of determining that an event with a safety risk is occurring according to the triggering equipment and the execution actions thereof acquired in the different monitoring time periods as an event type in the event judgment rule, so that the event judgment rule is formed.

In the embodiment, the user can configure different monitoring configuration parameters to meet security monitoring requirements in different time periods, and the security monitoring scheme with more personalized requirements is convenient for the user.

In some embodiments, the monitoring policy includes a pre-calibrated location calibration point corresponding to the motion sensing information of the environmental sensing device; the method further comprises the following steps:

determining a target monitoring position corresponding to the mobile monitoring equipment according to the position calibration point corresponding to the monitoring strategy;

acquiring current position information of the mobile monitoring equipment, and determining a moving track of the mobile monitoring equipment according to the current position information and the target monitoring position;

the sending a control instruction to the mobile monitoring equipment in the target environment according to the monitoring strategy comprises:

and sending a control instruction carrying the moving track to the mobile monitoring equipment in the target environment according to the monitoring strategy.

The terminal equipment can be provided with a client capable of managing the intelligent household equipment such as the mobile monitoring equipment, the environment sensing equipment and the like, the client can provide a map interface for marking the main cruising position in the security monitoring range by a user, and the terminal equipment obtains position calibration point information according to the cruising position set in the map interface by the user and reports the position calibration point information to the monitoring center.

The position calibration point may correspond to motion sensing information of the environment sensing devices, and the monitoring policy includes pre-calibrated motion sensing information corresponding to the motion sensing information of each environment sensing device. The monitoring center determines a monitoring strategy according to the action sensing information of the environment sensing equipment, determines a target monitoring position according to a position calibration point in the monitoring strategy, determines a moving track according to the current position of the mobile monitoring equipment and the target monitoring position, and sends a control instruction carrying the moving track to the mobile monitoring equipment so as to control the mobile monitoring equipment to move to the target monitoring position according to the moving track to acquire image data.

In an optional example, determining a movement trajectory of the mobile monitoring device includes:

and acquiring current position information reported by the mobile monitoring equipment, and determining the walking track of the mobile monitoring equipment according to the current position information and the target monitoring position.

The mobile monitoring device may report its current position according to a preset frequency, or report its current position after receiving a control instruction sent by the monitoring center, so that the monitoring center can calculate the walking track of the mobile monitoring device according to the current position and the target position of the mobile monitoring device before controlling the mobile monitoring device to move to the target position after monitoring the risk event. And the monitoring center sends a control instruction carrying a walking track to the mobile monitoring equipment under the condition that the risk event exists according to the action sensing information of the trigger equipment and the event judgment rule, so that the mobile monitoring equipment can be controlled to rapidly move to a target position according to the optimal walking track to acquire the image data of the risk event. Optionally, the risk event may include a plurality of risk events at the same time in the same time period, the corresponding target position also includes a plurality of risk events, and the walking trajectory may be a walking trajectory including a plurality of target positions.

In the above embodiment, the mobile monitoring device reports its current position to the monitoring center, and when the monitoring center determines that a risk event exists, the mobile monitoring device can quickly calculate the movement track of the mobile monitoring device to the target position, and control the mobile monitoring device to quickly and accurately move to the target position according to the movement track to acquire the image data of the risk event. Compared with the mode that the mobile monitoring equipment receives the target monitoring position of the monitoring center and calculates the moving track by itself, the method can reduce the calculation force requirement on the mobile monitoring equipment and is beneficial to reducing the hardware performance requirement of the mobile monitoring equipment.

In some embodiments, the monitoring center sends a control instruction carrying a target monitoring position to the mobile monitoring device when determining that a risk event exists according to the action sensing information and the event determination rule uploaded by the environment sensing device, wherein the determination of the target monitoring position includes:

and determining the position of the current event based on the position of the environment sensing equipment according to the received action sensing information of the environment sensing equipment so as to obtain the target monitoring position.

The environment sensing device may include a plurality of trigger devices disposed at different indoor locations, so as to detect potential risk events that may occur at different indoor locations. Taking the monitoring of an illegal entry attempt event as an example, the door lock detects the input of decryption information for more than a preset number of times, and the door lock is considered to possibly have a risk event of illegal entry attempt; the vibration paste arranged on the door and the window detects vibration information, and can be regarded as an event that illegal entry attempts possibly exist; when the monitoring center determines that the current risk event exists according to the received decryption information input which is reported by the door lock and detected for more than the preset times, the monitoring center can determine a target monitoring position according to the position of the door lock and control the shooting equipment to move to a position close to the door lock to collect image data during movement; when the monitoring center determines that the current risk event exists according to the received detected vibration information reported by the vibration sticker on the door and window, the target monitoring position can be determined according to the position of the vibration sticker, and the shooting equipment is controlled to move to a position close to the door and window to collect image data when the monitoring center moves.

In the above embodiment, the monitoring center determines the position of the current event according to the position of the environment sensing device to obtain the target monitoring position, so that the mobile monitoring device can be controlled to move to the target position quickly and accurately to acquire the image data of the risk event when the risk event is determined to exist, and the image data of the risk event can be acquired accurately and timely when the risk event occurs.

In other embodiments, the determining of the target monitoring location comprises:

acquiring position calibration point information sent by terminal equipment;

determining a target position calibration point based on the position of the environment sensing equipment and the position calibration point information according to the received action sensing information of the environment sensing equipment;

and obtaining a target monitoring position according to the target position calibration point.

The terminal equipment can be provided with a client capable of managing the intelligent household equipment such as the mobile monitoring equipment, the environment sensing equipment and the like, the client can provide a map interface for marking the main cruising position in the security monitoring range by a user, and the terminal equipment obtains position calibration point information according to the cruising position set in the map interface by the user and reports the position calibration point information to the monitoring center. The environment sensing device may include a plurality of triggering devices located at different locations within the room to enable detection of potential risk events that may occur at different locations within the room. The monitoring center obtains position calibration point information sent by the terminal equipment, determines a position calibration point closest to the environment sensing equipment as a target position calibration point according to the position of the environment sensing equipment and the position calibration point information, and obtains a target monitoring position according to the target position calibration point. For example, the user may use the position on the right side of the door and spaced 0.5 m from the door as the first position calibration point and the position 0.5 m in front of the door and window as the second position calibration point, and taking the monitoring of the event attempting to illegally enter the room as an example, the door lock detects the input of the decryption information for more than the predetermined number of times, and it is considered that there may be a risk event attempting to illegally enter the room; the vibration paste arranged on the door and the window detects vibration information, and can be regarded as an event that illegal entry attempts possibly exist; when the monitoring center determines that the current risk event exists according to the received decryption information input which is reported by the door lock and detected for more than the preset times, the monitoring center can determine a first position calibration point as a target position calibration point according to the position of the door lock and the position calibration point information, determine a target monitoring position according to the position of the first position calibration point, and control the mobile monitoring equipment to move to the first position calibration point to collect image data; when the monitoring center determines that the current risk event exists according to the received detected vibration information reported by the vibration sticker on the door and window, the monitoring center can determine the second position calibration point as the target position calibration point according to the position of the vibration sticker and the position calibration point information, determine the target monitoring position according to the position of the second position calibration point, and control the monitoring equipment to move to the second position calibration point to collect the image data during moving.

In the above embodiment, the user may preset a plurality of position calibration points, and the monitoring center selects the optimal position calibration point according to the position of the environment sensing device to obtain the target monitoring position, so that the mobile monitoring device can be controlled to rapidly and accurately move to the optimal position calibration point to acquire the image data of the risk event when the risk event is determined to exist, and the image data of the risk event can be accurately and timely acquired when the risk event occurs, and the setting of the position calibration point is favorable for ensuring that the mobile monitoring device can acquire clear and complete images.

In some embodiments, the monitoring processing method further includes:

acquiring shooting strategy information corresponding to each position calibration point; the shooting strategy information comprises a shooting mode or a shooting mode and a shooting duration corresponding to the shooting mode;

sending a control instruction carrying a target monitoring position and the corresponding shooting strategy information to mobile monitoring equipment in the target environment according to the monitoring strategy; the control instruction is used for controlling the mobile monitoring equipment to move to a target position, acquiring image data according to the corresponding shooting strategy information and pushing the image data to the terminal equipment.

The monitoring center may acquire the shooting policy information corresponding to each position calibration point, and the user sets the corresponding shooting policy information for each position calibration point correspondingly in the process of setting the position calibration point through the terminal device. The monitoring center sends a control instruction carrying a target monitoring position and the corresponding shooting strategy information to the mobile monitoring equipment under the condition that the current monitoring condition is met; the control instruction is used for controlling the mobile monitoring equipment to move to a target position, acquiring image data of the risk event according to the corresponding shooting strategy information and pushing the image data to the terminal equipment. The user can mark the main cruising position in the security monitoring range through the client installed on the terminal equipment, and the shooting strategies are respectively set for the selected cruising position. And the terminal equipment obtains the position calibration point information and the shooting strategy information corresponding to each position calibration point according to the setting of the cruise position and the shooting strategy corresponding to the cruise position by the user and reports the position calibration point information and the shooting strategy information to the monitoring center. And under the condition that the monitoring center determines that a risk event exists according to the action sensing information of the environment sensing equipment and the event judgment rule, according to the position and the position calibration point information of the triggering equipment, the position calibration point closest to the triggering equipment is determined as a target position calibration point, a target monitoring position is obtained according to the target position calibration point, and the mobile monitoring equipment is controlled to move to the target position calibration point to acquire image data according to a shooting strategy corresponding to the target position calibration point.

For example, the user may take the position on the right side of the door and spaced 0.5 m as the first position calibration point, take the shooting strategy corresponding to the first position calibration point to record the video for three minutes, take the position 0.5 m right in front of the door and window as the second position calibration point, and take the pictures every 30 seconds for ten pictures. Taking the monitoring of an illegal entry attempt event as an example, the door lock detects the input of decryption information for more than a preset number of times, and the door lock is considered to possibly have a risk event of illegal entry attempt; the vibration paste arranged on the door and the window detects vibration information, and can be regarded as an event that illegal entry attempts possibly exist; when the monitoring center determines that the current risk event exists according to the received decryption information input which is reported by the door lock and detected for more than the preset times, the monitoring center can determine a first position calibration point as a target position calibration point according to the position of the door lock and the position calibration point information, determine a target monitoring position according to the position of the first position calibration point, control the mobile monitoring equipment to move to the first position calibration point, record three-minute video according to a shooting strategy corresponding to the first position calibration point and push the three-minute video to the terminal equipment; when the monitoring center determines that the current risk event exists according to the received detected vibration information reported by the vibration sticker on the door and window, the monitoring center can determine a second position calibration point as a target position calibration point according to the position of the vibration sticker and the position calibration point information, determine a target monitoring position according to the position of the second position calibration point, control the mobile control device to move to the second position calibration point, and then shoot ten pictures at intervals of 30 seconds according to a preset shooting strategy corresponding to the second position calibration point and push the pictures to the terminal device.

In the above embodiment, the user may preset a plurality of position calibration points, and may set different shooting strategies for different position calibration points, the monitoring center may select an optimal position calibration point according to the position of the environment sensing device to obtain the target monitoring position, so that when it is determined that a risk event exists, the monitoring center may control the mobile monitoring device to rapidly and accurately move to the optimal position calibration point to acquire image data of the risk event according to the set shooting strategy, and it is ensured that the image data of the risk event may be accurately and timely acquired when the risk event occurs, and the setting of the position calibration point and the corresponding shooting strategy is favorable for ensuring that the mobile monitoring device may acquire clear and complete images.

In some embodiments, the environment sensing device comprises at least one of an infrared sensor, a door and window sensor, a vibration sensor, a radar sensor, and a door lock device; the action sensing information comprises at least one of human body movement information detected by an infrared sensor, opening and closing signals detected by a door and window sensor, vibration signals detected by a vibration sensor, object movement information detected by a radar sensor and unlocking information detected by door lock equipment.

The acquiring of the motion sensing information of the environment sensing device includes at least one of:

the system comprises a sensor, a vibration sticker, a radar sensor, a door lock and a door, wherein the sensor is used for acquiring human body movement information detected by the infrared sensor, acquiring opening and closing signals of the door and window sensor, acquiring vibration signals sensed by the vibration sticker, acquiring object movement information detected by the radar sensor and acquiring unlocking information sent by the door lock.

The environment sensing device can comprise various intelligent household products which can detect the environment state information in the family for judging whether a specific risk event occurs. The environment sensing device may include one or more smart home products of the same or different types, such as a plurality of infrared sensors disposed in different rooms of the room. The monitoring center acquires action sensing information of the environment sensing equipment, can acquire action sensing information of one or more environment sensing equipment, such as human body movement information detected by an infrared sensor, opening and closing signals of a door and window sensor, vibration signals sensed by a vibration sticker, object movement information detected by a radar sensor, unlocking information sent by a door lock, and prejudges the occurrence of events according to the action sensing information of the environment sensing equipment at different positions so as to determine whether risk events exist.

In the above embodiment, the monitoring center may comprehensively determine whether a risk event occurs based on the motion sensing information reported by a plurality of identical or different trigger devices, and provide more optional conditions for a user to form more configurations of personalized security monitoring schemes, so as to expand a monitoring coverage and contribute to improving monitoring safety performance.

In some embodiments, the sending a control instruction to a mobile monitoring device in the target environment according to the monitoring policy includes:

and sending corresponding alarm information to the terminal equipment according to the monitoring strategy, and sending a control instruction carrying a target monitoring position to the mobile monitoring equipment.

And when the monitoring center determines that the monitoring condition is met according to the action sensing information of the environment sensing equipment, determining a monitoring strategy corresponding to the action sensing information of the environment sensing equipment, and timely sending alarm information to the terminal equipment according to the monitoring strategy so that a user can timely know the occurrence condition of the risk event. The monitoring center sends the alarm information corresponding to the current risk event to the terminal device, and the alarm information may be sent before, after or simultaneously with sending the control instruction carrying the target monitoring position to the mobile monitoring device, which is not limited herein. The form of the alarm information may be text, sound or a combination thereof, and the alarm information may include the occurrence time of the risk event and a description of the event description.

In the above embodiment, when monitoring that the monitoring condition is met, the monitoring center respectively sends the alarm information to the terminal device and sends the control instruction carrying the target monitoring position to the mobile monitoring device, so that the user can know the occurrence condition of the risk event in time, and the user can also select whether to receive image data collected and sent by the subsequent mobile monitoring device or select whether to perform manual operation on the mobile terminal according to the preference of the user so as to control the subsequent image collection of the mobile monitoring device.

determining a plurality of target monitoring positions in the target environment and the corresponding priority of each target monitoring position according to the monitoring strategy;

sending a control instruction carrying a plurality of target monitoring positions comprising the priorities to mobile monitoring equipment in the target environment; and the control instruction is used for indicating the mobile monitoring equipment to move to each target monitoring position according to the priority and carrying out image acquisition.

In the target environment, there may be a case where a plurality of positions all satisfy the monitoring condition at the same time, and at this time, a plurality of target monitoring positions correspond to each other. Different target monitoring positions have different priorities, and the monitoring center sends a control instruction carrying a plurality of target monitoring positions including the priorities to the mobile monitoring equipment so as to control the mobile monitoring equipment to move to each target monitoring position according to the priorities and acquire images.

In an optional example, in a case that the monitoring center determines that there are multiple risk events according to the motion sensing information of the environment sensing device and the event determination rule, one of the following steps is performed: and sending a control instruction carrying a target monitoring position to the mobile monitoring equipment, sending a control instruction carrying a plurality of target monitoring positions corresponding to the risk events to the mobile monitoring equipment, and sending a control instruction carrying a plurality of target monitoring positions corresponding to the risk events and a priority policy to the mobile monitoring equipment in sequence according to a set priority policy.

The monitoring center may monitor the situations of multiple risk events at the same time point or in the same time period, and the corresponding positions of the multiple risk events may be different, so that the mobile monitoring device needs to be controlled to sequentially move to the target position to respectively collect the image data of the risk events. Optionally, the monitoring center may determine the sequence of moving the mobile shooting device to each target position according to a set priority policy, and sequentially send the control instruction carrying the target monitoring position to the mobile monitoring device. The priority policy set may be to determine the sequence of moving to the target location according to the risk levels of multiple risk events, or to determine the sequence of moving to the target location according to the principle of proximity, etc. Optionally, the monitoring center may also send a control instruction carrying a plurality of target monitoring positions corresponding to the risk event to the mobile monitoring device, and the mobile shooting device determines the sequence of moving to each target position according to a preset priority policy after receiving the plurality of target monitoring positions. Optionally, the monitoring center may also send a control instruction carrying a plurality of target monitoring positions and priority policies corresponding to the risk event to the mobile monitoring device, and the mobile shooting device determines the sequence of moving to each target position according to the received plurality of target monitoring positions and priority policies.

In the above embodiment, the monitoring center can collect the image data of the corresponding risk event according to the sequence to the mobile monitoring equipment for controlling the condition that a plurality of risk events occur, and can patrol a plurality of indoor different positions only by using a single mobile monitoring equipment, so that the whole process can be carried out without participation of users, and convenience and monitoring coverage range are improved.

In order to provide a more systematic understanding of the monitoring processing method provided in the embodiments of the present application, a specific example is described below.

Different types of sensing equipment can be arranged in the intelligent home system to provide signal input for the intelligent home system, such as: the human body infrared sensor senses a signal of someone, a door and window sensor opening and closing signal, the vibration of the vibration patch, the movement in a millimeter wave radar sensing area and the like. The signals are reported to a monitoring center of the intelligent home system, wherein the monitoring center can be a gateway, a server, a central controller and other devices with centralized control functions, and the monitoring center determines output behaviors according to an automation table in the monitoring center. The automation table may be configured by the user on the terminal device, and an example of automation may be as follows:

referring to fig. 3, the monitoring processing method includes:

s11, configuring the security monitoring scheme by the user through the terminal equipment, and reporting the security monitoring configuration parameters to the monitoring center by the terminal equipment;

s12, the monitoring center forms an event judgment rule according to the security monitoring configuration parameters; the security monitoring configuration parameters are configuration parameters for controlling the actions of the mobile monitoring equipment, and the actions of the mobile monitoring equipment are integrated into the automation function of the intelligent home system, and the automation example can be as follows:

condition 2 may have a similar representation as condition 1, for example, no one in the home may detect no human activity for any sensor device in the home, and the activity includes but is not limited to: no touch switch is touched for a long time, no person is sensed by the sensor, no person is sensed by the sleeping belt, no object movement is sensed by the millimeter wave radar, and the like, so that the condition that no person is at home can be inferred.

Alternatively, only the condition 1 may be included in the above-described automation example. Referring to fig. 4, in an alternative configuration interface diagram of the security monitoring scheme, a user may select, on an automatic configuration interface, that when the configured conditions are satisfied (the configured conditions include that the infrared sensor 1 senses the set motion sensing information and the vibration sticker 1 senses the set motion sensing information in the configured time period), the user may correspondingly determine that the risk event a exists currently, and configure and determine that when the risk event a exists, the user controls the mobile monitoring device to move to a designated point for taking a picture and uploading. An example of event decision rule formation based on the anti-monitoring configuration parameters provided in the example may be as follows:

s13, the monitoring center acquires the action sensing information of the environment sensing equipment; for example, the environment sensing device can be a door and window magnetic sensor, a vibration sticker;

s14, the monitoring center determines the target position under the condition that the risk event exists according to the action sensing information of the environment sensing equipment and the event judgment rule, sends alarm information to the terminal equipment and sends a control instruction carrying the target monitoring position to the mobile monitoring equipment; the actions performed by the mobile monitoring device may be as follows:

moving to a target position, taking a picture at a specified visual angle, and then pushing the picture to the terminal equipment;

moving to a target position, recording a video in a specified view angle range, and then pushing the video to a terminal device;

and moving the target positions to a plurality of target positions in sequence, photographing or recording videos at the corresponding positions, and then pushing the videos to the terminal equipment.

Wherein the step of determining the target position may comprise: after the mobile monitoring equipment is added into the intelligent home system, a map in a security monitoring range is created and sent to the terminal equipment, a user can select a plurality of cruise points in the map, and if the position one meter right in front of a selected window is marked as a cruise point A, the position half meter right in front of a safe is marked as a cruise point B. And the terminal equipment forms position calibration information according to the selection operation of the cruise point selected by the user and reports the position calibration information to the monitoring center. And the monitoring center selects a position calibration point closest to the position of the trigger equipment as a target position calibration point according to the position and the position calibration information of the trigger equipment, and determines a target position according to the target position calibration point. In a specific example, in a client, a user can add mobile monitoring equipment into an intelligent home system, then enter a detail page of the mobile monitoring equipment, and click on a map building, so that the mobile monitoring equipment can walk in the home of the user once, and a map of the home of the user can be gradually built in the walking process; after the construction is completed, the user can click to view the map or edit the map at the client, and then the calibration of the navigation point can be carried out on the map displayed by the client.

For each cruise point, the user can also configure the shooting mode (taking a picture or taking a video), the shooting angle or angle range, and the shooting duration. When there are a plurality of cruise points, the execution order of the plurality of cruise points may also be configured. In the automated configuration, the time period for each automated message to be executed may also be configured to control the time period for the mobile monitoring device to perform the action.

And S15, the mobile monitoring equipment moves to the target position according to the control instruction, and the image data of the risk event is collected. If someone illegally enters the mobile terminal through the window, the monitoring center receives a signal that the vibration sticker senses that the window is opened, namely the mobile monitoring equipment is controlled to go to a cruise point appointed by a user in advance to record a video or take a picture, the mobile monitoring equipment uploads the recorded video or picture to the monitoring center, and the monitoring center pushes the video or picture to the terminal equipment. After the mobile monitoring equipment finishes image data acquisition, the mobile monitoring equipment can return to an initial position, such as a charging pile position. After the mobile monitoring equipment receives a control instruction of a target monitoring position carried by the monitoring center, the mobile monitoring equipment can determine that the motion track moves to the target position by adopting a path planning algorithm.

And S16, the mobile monitoring equipment reports the image data to the monitoring center and/or sends the image data to the terminal equipment.

In the embodiment, when the monitoring center detects a risk event, the monitoring center sends a control instruction to the mobile monitoring equipment to control the mobile monitoring equipment to move to a target position for patrol, the control can be performed without manual intervention during the period, no delay is waited, and the patrol result has higher timeliness; in the whole process from the occurrence of the abnormity to the patrol, the user does not need to participate, so that the convenience is improved; by utilizing the mobility of the mobile monitoring equipment, the patrol of different indoor positions can be completed only by using a single shooting device, and the monitoring coverage range can be improved on the premise of reducing the cost.

Referring to fig. 5, the present application further provides an application scenario, where the application of the monitoring processing method in the application scenario is as follows: the Internet of things system comprises an environment sensing device, an intelligent home system, a terminal device and a mobile monitoring device. A user installs a mobile robot which can be remotely controlled to move and carry out real-time video at home. The mobile robot has a SLAM function, can construct a 2D platform map of the environment and can move to any reachable position specified by a user. The mobile robot and the central control equipment of the intelligent home system communicate through a network (WiFi or ZIGBEE or other wireless networks). The SLAM function is an ability of the robot to construct an indoor map and to perceive its position. The robot starts to move from an unknown position in an unknown environment, self-positioning is carried out according to the position and the map in the moving process, and meanwhile, an incremental map is built on the basis of self-positioning, so that the autonomous positioning and navigation of the robot are realized.

The monitoring processing method comprises the following steps:

s1, the environment sensing equipment senses the action sensing information and reports the action sensing information to the intelligent home system;

s2, the intelligent home system determines that the monitoring condition is met according to the action sensing information, and controls the mobile monitoring equipment to move to the target position;

s3, the mobile monitoring equipment collects image data at the target position;

and S4, the mobile monitoring equipment sends the acquired image data to the terminal equipment.

In the smart home systems, there are different kinds of sensing devices as environment sensing devices, which provide signal input for the smart home systems, such as: the human body infrared sensor senses a signal of someone, a door and window sensor opening and closing signal, the vibration of the vibration patch, the movement in a millimeter wave radar sensing area and the like. In S1, the environment sensing device reports the signal to a decision system (where the decision system may be a gateway, a server, a central control device, or other devices with centralized control functions) in the smart home system, and the decision system determines an output behavior according to an automation table therein. An example of an automation table is as follows:

in S2, the monitoring condition can be determined in various ways, such as: the home has no longer sensed any human activity for a period of time, including but not limited to: the fact that people are sensed by a touch switch, people are sensed by a human body, vibration is sensed by a vibration static sticker, people are not sensed by a sleep band, no moving object is found by the millimeter wave radar, and the like can be inferred that no people exist at home.

At S3, the mobile robot may be programmed with the following actions:

moving to a specified position, taking a picture at a specified visual angle, and then pushing the picture to a user App;

moving to a specified position, recording a video in a specified view angle range, and then pushing the video to an App;

and moving to a plurality of designated points in sequence, taking pictures or recording videos at corresponding positions, and then pushing to an App.

The actions of the mobile robot are integrated into the automation function of the intelligent home, and the following is an automation table in the intelligent home system:

specifically, taking the environment sensing device as a door and window magnetic inductor as an example, a user can install the door and window magnetic inductor on a window, and configure the automation 1 at a mobile phone end or a computer end. Before the mobile robot is brought into the home of a user, the map of the home and the position of the mobile robot are unknown, and after the mobile robot starts working, the map is gradually constructed and the position of the mobile robot is determined through the SLAM technology.

In the client, a user can firstly add the mobile robot into an Internet of things system, then enter a detail page of the mobile robot, and click on the 'map construction', so that the mobile robot can walk in the user's home once, and the map of the user's home can be gradually constructed in the walking process; after the construction is completed, a user clicks 'view map' or 'edit map' on the client, the calibration of the cruising point can be carried out on the map displayed by the client, and the user can select a certain point on the map to be the cruising point A (for example, the position right in front of a window is selected to be calibrated as the cruising point A, and the position right in front of a safe case is selected to be calibrated as the cruising point B).

Then, the user can enter an automation page to carry out the configuration of automation information, and corresponding automation configuration is carried out aiming at different sensors; for example, entering a configuration page of a door and window sensor (the door and window sensor is added into the internet of things system in advance), configuring conditions to be met (for example, when a window is sensed to be opened), configuring actions to be executed by the mobile robot, and selecting one or more cruise points from a plurality of cruise points calibrated in advance.

For each cruise point, the user can also configure the mode of shooting (taking a picture or taking a video), the angle or range of angles taken, and the duration of the shooting. When there are a plurality of cruise points, the execution order of the plurality of cruise points may also be configured.

In the automated configuration, the time period for each automated information execution may also be configured to control the time period for the robot to perform the action.

When someone illegally enters the intelligent home system through the window, the intelligent home system receives a signal that the window is opened, namely the mobile robot is immediately enabled to go to a cruise point which is pre-designated by a user to record a video or take a picture, and then the mobile robot uploads the recorded video or picture to the intelligent home system. The intelligent home system pushes the video or the photo to the user App end.

After the mobile robot records, the mobile robot can automatically return to the charging pile. The charging pile can be used as an initial position of the mobile robot, but is not limited to the charging pile, and can also be at a certain position.

Because the mobile robot supports SLAM, the mobile robot can determine the real-time position of the mobile robot, and can plan a moving path by adopting a path planning algorithm according to the real-time position and the target position and move forward along the moving path. After the recording is completed, the mobile robot may return to the initial position.

The mobile monitoring equipment has the advantages that the mobile monitoring equipment can collect image data at different positions, so that all-around monitoring can be realized under the condition of avoiding installing cameras at all positions, the cost is saved, the monitoring coverage range is wide, and the monitoring safety can be improved.

In another aspect of the embodiment of the present application, please refer to fig. 6, further providing a monitoring processing apparatus, which is applied to a monitoring center, where the monitoring center may be a decision center such as a gateway, a server, a central controller, and the like in an intelligent home system, and the apparatus includes: the determining module 11 is configured to determine whether the target environment meets a monitoring condition when motion sensing information uploaded by an environment sensing device in the target environment is acquired; the strategy module 12 is configured to obtain a monitoring strategy corresponding to the motion sensing information if the monitoring condition is met; the control module 13 is configured to send a control instruction to the mobile monitoring device in the target environment according to the monitoring policy; and the control instruction is used for indicating the mobile monitoring equipment to move to a target monitoring position determined according to the monitoring strategy and carrying out image acquisition, and the acquired image data is used for being pushed to a monitoring terminal for monitoring.

The policy module 12 further includes: acquiring monitoring configuration parameters which are sent by terminal equipment and aim at each environmental sensing equipment in a target environment; and configuring monitoring conditions corresponding to the action sensing information of each environment sensing device according to the monitoring configuration parameters.

The policy module 12 further includes: the monitoring configuration parameters comprise at least one of preset monitoring time period and event type; the monitoring condition includes at least one of a target monitoring period and a target event type corresponding to the monitoring configuration parameter.

The monitoring strategy comprises a position calibration point which is calibrated in advance and corresponds to the action sensing information of the environment sensing equipment; the control module 13 further includes: determining a target monitoring position corresponding to the mobile monitoring equipment according to the position calibration point corresponding to the monitoring strategy; acquiring current position information of the mobile monitoring equipment, and determining a moving track of the mobile monitoring equipment according to the current position information and the target monitoring position; and sending a control instruction carrying the moving track to the mobile monitoring equipment in the target environment according to the monitoring strategy.

The control module 13 further includes: acquiring shooting strategy information corresponding to each position calibration point; the shooting strategy information comprises a shooting mode or a shooting mode and a shooting duration corresponding to the shooting mode; sending a control instruction carrying a target monitoring position and the corresponding shooting strategy information to mobile monitoring equipment in the target environment according to the monitoring strategy; the control instruction is used for controlling the mobile monitoring equipment to move to a target position, acquiring image data according to the corresponding shooting strategy information and pushing the image data to the terminal equipment.

The environment sensing equipment comprises at least one of an infrared sensor, a door and window sensor, a vibration sensor, a radar sensor and door lock equipment; the action sensing information comprises at least one of human body movement information detected by an infrared sensor, opening and closing signals detected by a door and window sensor, vibration signals detected by a vibration sensor, object movement information detected by a radar sensor and unlocking information detected by door lock equipment.

The control module 13 further includes: and sending corresponding alarm information to the terminal equipment according to the monitoring strategy, and sending a control instruction carrying a target monitoring position to the mobile monitoring equipment.

The control module 13 further includes: determining a plurality of target monitoring positions in the target environment and the corresponding priority of each target monitoring position according to the monitoring strategy; sending a control instruction carrying a plurality of target monitoring positions comprising the priorities to mobile monitoring equipment in the target environment; and the control instruction is used for indicating the mobile monitoring equipment to move to each target monitoring position according to the priority and carrying out image acquisition.

It should be noted that: in the process of implementing the monitoring processing method to implement security monitoring, the monitoring processing device provided in the above embodiment is exemplified by only the division of the program modules, and in practical applications, the processing may be distributed to different program modules as needed, that is, the internal structure of the device may be divided into different program modules to complete all or part of the method steps described above. In addition, the monitoring processing apparatus and the monitoring processing method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments and are not described herein again.

In another aspect of the embodiment of the present application, please refer to fig. 7, which further provides a computer device, including a processor 213, a memory 214, and a computer program stored on the memory 214 and executable by the processor 213, wherein when the computer program is executed by the processor 213, the monitoring processing method according to any embodiment of the present application is implemented, and the same technical effect can be achieved, and is not repeated herein. In this embodiment, the computer device refers to any intelligent device that executes the monitoring processing method, such as the monitoring center described in the foregoing embodiments.

In another aspect of the present embodiment, please refer to fig. 8, which further provides a monitoring processing system, including an environment sensing device 53, a monitoring center 51, a mobile monitoring device 54 and a terminal device 52 according to any embodiment of the present application, where the environment sensing device 53 is configured to report motion sensing information; and the mobile monitoring equipment 54 moves to a target position according to the control instruction to acquire image data and pushes the image data to the terminal equipment. Optionally, the environment sensing device 53 includes at least one of: infrared sensor, door and window sensor, vibration subsides, radar sensor, lock. The monitoring center 51 may be the computer device described in the foregoing embodiment, and the environment sensing device 53 is configured to obtain motion sensing information in a target environment and report the motion sensing information to the computer device; the computer equipment is used for determining whether the target environment meets monitoring conditions or not when the action sensing information uploaded by the environment sensing equipment in the target environment is acquired; if the monitoring condition is met, acquiring a monitoring strategy corresponding to the action sensing information; sending a control instruction to mobile monitoring equipment in the target environment according to the monitoring strategy; the control instruction is used for indicating the mobile monitoring equipment to move to a target monitoring position determined according to the monitoring strategy and carrying out image acquisition, and the acquired image data is used for being pushed to a monitoring terminal for monitoring; the mobile monitoring equipment 54 is used for moving to a target position according to the control instruction to acquire an image and pushing acquired image data to the monitoring terminal; the terminal device 52 is configured to obtain image data sent by the mobile monitoring device, and monitor and process the image data.

Optionally, the mobile monitoring device 54 is further configured to move according to the map creation instruction with the current position as the initial position, construct an incremental map according to the self-positioning during the moving process, and send the incremental map to the terminal device. Wherein the create map instruction includes at least one of: the terminal equipment is used for creating a map instruction, a mobile monitoring equipment initial power-on instruction and a map initialization instruction sent by the terminal equipment based on user operation.

Optionally, the terminal device 52 is further configured to determine position-pointing point information based on a selection operation of a user on the map, and report the position-pointing point information to the monitoring center; or, the terminal device 52 is further configured to determine position-pointing information based on a selection operation of the user on the map, obtain corresponding shooting policy information based on the setting of the position-pointing by the user, and report the position-pointing information and the shooting policy information corresponding to each position-pointing to the monitoring center.

The embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the monitoring processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A monitoring processing method is applied to a monitoring center and is characterized by comprising the following steps:

2. The monitoring process of claim 1, wherein the process further comprises:

3. The monitoring processing method of claim 2, wherein the monitoring configuration parameter includes at least one of a preset monitoring period and an event type; the monitoring condition includes at least one of a target monitoring period and a target event type corresponding to the monitoring configuration parameter.

4. The monitoring processing method of claim 1, wherein the monitoring policy includes a pre-calibrated location calibration point corresponding to the motion-sensing information of the environmental sensing device;

the method further comprises the following steps:

5. The monitoring processing method of claim 4, further comprising:

6. The monitoring processing method of claim 1, wherein the environment sensing device comprises at least one of an infrared sensor, a door and window sensor, a vibration sensor, a radar sensor, and a door lock device; the action sensing information comprises at least one of human body movement information detected by an infrared sensor, opening and closing signals detected by a door and window sensor, vibration signals detected by a vibration sensor, object movement information detected by a radar sensor and unlocking information detected by door lock equipment.

7. The monitoring processing method according to any one of claims 1 to 6, wherein the sending a control instruction to a mobile monitoring device in the target environment according to the monitoring policy comprises:

8. The monitoring processing method according to any one of claims 1 to 6, wherein the sending a control instruction to a mobile monitoring device in the target environment according to the monitoring policy comprises:

9. A monitoring processing apparatus, comprising:

10. The utility model provides a control processing system, its characterized in that, control processing system includes environmental sensing equipment, computer equipment, portable supervisory equipment and monitor terminal, wherein:

the environment sensing equipment is used for acquiring action sensing information in a target environment and reporting the action sensing information to the computer equipment;

the computer equipment is used for determining whether the target environment meets monitoring conditions or not when the action sensing information uploaded by the environment sensing equipment in the target environment is acquired; if the monitoring condition is met, acquiring a monitoring strategy corresponding to the action sensing information; sending a control instruction to mobile monitoring equipment in the target environment according to the monitoring strategy; the control instruction is used for indicating the mobile monitoring equipment to move to a target monitoring position determined according to the monitoring strategy and carrying out image acquisition, and the acquired image data is used for being pushed to a monitoring terminal for monitoring

The mobile monitoring equipment is used for moving to a target position according to the control instruction to acquire an image and pushing acquired image data to the monitoring terminal;

and the monitoring terminal is used for acquiring the image data sent by the mobile monitoring equipment and monitoring the image data.

11. A computer device comprising a processor, a memory, and a computer program stored on the memory and executable by the processor, the computer program, when executed by the processor, implementing a monitoring processing method according to any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that a computer program is stored thereon, which, when being executed by a processor, implements the monitoring processing method according to any one of claims 1 to 10.