WO2018076508A1

WO2018076508A1 - Method and apparatus for security monitoring of greenhouse

Info

Publication number: WO2018076508A1
Application number: PCT/CN2016/111094
Authority: WO
Inventors: 董黎晨
Original assignee: 深圳前海弘稼科技有限公司
Priority date: 2016-10-31
Filing date: 2016-12-20
Publication date: 2018-05-03
Also published as: CN106326885A

Abstract

Disclosed in the present invention are a method and apparatus for security monitoring of a greenhouse. The method comprises: monitoring a pre-determined security monitoring area in a greenhouse; outputting a prompt message that requires a moving target to make a verification gesture when monitoring the moving target in the security monitoring area; capturing and recognizing the verification gesture made by the moving target; determining whether the verification gesture matches at least one valid gesture in a preset gesture library; and outputting alarm information if not. By applying the technical solution provided by the embodiments of the present invention, it is not necessary to arrange a dedicated caregiver to continually pay attention to a monitoring video recording, thereby reducing labor cost, ensuring the security of plants growing in a greenhouse without a person caring for the plants and avoiding economic losses of a user brought on by damage to the plants.

Description

Method and device for monitoring safety of planting greenhouse

This application claims priority to Chinese Patent Application No. 201610933529.8, entitled "A Method and Device for Monitoring the Safety of Planting Greenhouses" on October 31, 2016, the entire contents of which are incorporated herein by reference. In the application.

Technical field

The invention relates to the field of monitoring technology, in particular to a method and a device for monitoring the safety of a greenhouse.

Background technique

With the development of science and technology, the development of planting greenhouses is becoming more and more rapid. Planting greenhouses are mostly used for the cultivation of large-scale vegetable plants, which can create economic benefits for users.

For users, the safety of growing greenhouses is crucial. At present, the safety of planting greenhouses is mostly ensured by means of personnel care. This method requires the caregiver to pay attention to the surveillance video at all times, which requires more care of the nursing staff and higher labor costs. Moreover, if the caregiver has something to do temporarily, in the case of unattended care, the growth safety of the plants in the greenhouse will not be guaranteed, and may bring greater economic losses to the user.

Summary of the invention

The object of the present invention is to provide a method and a device for monitoring the safety of planting greenhouses, so as to reduce the labor cost, and ensure the growth safety of the plants in the greenhouse in the case of unattended care, and avoid economic loss to the user due to damage to the plants. .

In order to solve the above technical problem, the present invention provides the following technical solutions:

A method for monitoring the safety of greenhouses, comprising:

Monitoring a predetermined safety monitoring area in the planting greenhouse;

When it is detected that there is a moving target in the security monitoring area, outputting prompt information requesting the moving target to perform a verification gesture;

Capturing and identifying a verification gesture performed by the moving target;

Determining whether the verification gesture matches at least one legal gesture in the preset gesture library;

If no, an alarm message is output.

In a specific embodiment of the present invention, the moving target is required to perform verification at the output After the gesture prompt message, it also includes:

If the verification gesture is not captured within the set duration, the step of outputting the alarm information is performed.

In a specific implementation manner of the present invention, the method further includes:

When it is determined that the verification gesture does not match any of the legal gestures in the gesture library, the step of outputting the prompt information requesting the motion target to perform the verification gesture is repeatedly performed until the number of repetitions reaches a preset number threshold.

In a specific embodiment of the present invention, the monitoring of the predetermined security monitoring area in the planting greenhouse includes:

The predetermined safety monitoring area in the planting greenhouse is monitored during a preset safety monitoring period.

In a specific embodiment of the invention, the security monitoring area is determined by the following steps:

Collecting an image of the area within the field of view;

Transmitting the area image to a user, so that the user selects a monitoring area based on the area image;

The monitoring area selected by the user is determined as the security monitoring area.

In a specific embodiment of the invention, it is determined whether there is a moving target in the security monitoring area by the following steps:

In the process of monitoring the security monitoring area, for each adjacent two frames of images, performing differential operations on the adjacent two frames of images to obtain an absolute difference of pixel values of each corresponding pixel point, if the pixel value is If the ratio of the number of pixels whose absolute difference is greater than the preset threshold to the total number of pixels is greater than the preset ratio threshold, it is determined that there is a moving target in the security monitoring area.

A planting greenhouse safety monitoring device, comprising:

a monitoring module for monitoring a predetermined safety monitoring area in the planting greenhouse;

a prompt information output module, configured to: when the moving target is detected in the security monitoring area, output prompt information requesting the moving target to perform a verification gesture;

a verification gesture recognition module, configured to capture and identify a verification gesture performed by the moving target;

a gesture determining module, configured to determine whether the verification gesture matches at least one legal gesture in the preset gesture library, and if not, trigger an alarm module;

The alarm module is configured to output alarm information.

And a timeout processing module, configured to trigger the alarm module if the verification gesture of the verification gesture is performed by the moving target after the output requires that the verification gesture is not captured within the set duration.

a repeating execution module, configured to repeatedly perform the step of outputting the prompt information requesting the moving target to perform the verification gesture until the verification gesture is not matched with any one of the gestures in the gesture library, until the number of repetitions The preset number of thresholds is reached.

In a specific implementation manner of the present invention, the monitoring module is specifically configured to:

In a specific implementation manner of the present invention, the security monitoring area determining module is further configured to determine the security monitoring area by using the following steps:

Collecting an image of the area within the field of view;

In a specific embodiment of the present invention, the method further includes a moving target determining module, configured to determine whether there is a moving target in the security monitoring area by:

Applying the technical solution provided by the embodiment of the present invention, in the process of monitoring the security monitoring area in the planting greenhouse, if there is a moving target in the security monitoring area, the prompt information for requesting the moving target to perform the verification gesture may be output, and the capturing information may be captured. And identifying the verification gesture performed by the moving target. If the verification gesture does not match any of the legal gestures in the preset gesture library, the motion target may be determined to be an illegal person, and the alarm information may be output. In this way, there is no need to arrange special caregivers to pay attention to the surveillance video, which reduces the labor cost. In the case of unattended care, the growth safety of the plants in the greenhouse is ensured, and the economic loss caused by the damage of the plants is avoided.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a flow chart showing an implementation of a method for monitoring a greenhouse in a greenhouse according to an embodiment of the present invention;

2 is a schematic structural view of a planting greenhouse safety monitoring device according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail below in conjunction with the drawings and embodiments. It is apparent that the described embodiments are only a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

FIG. 1 is a flowchart of an implementation of a method for monitoring a greenhouse in a greenhouse according to an embodiment of the present invention. The method may include the following steps:

S110: Monitoring a predetermined safety monitoring area in the planting greenhouse.

In practical applications, image acquisition devices, such as cameras, can be installed in the security weak links of the greenhouse, such as the gates and junctions. The field of view of the image acquisition device can be directly determined as a security monitoring area, or the security monitoring area can be determined according to the user's settings.

In a specific embodiment of the present invention, the security monitoring area can be determined by the following steps:

Step 1: Collect an image of the area within the field of view;

Step 2: Send the area image to the user, so that the user selects the monitoring area based on the area image;

Step 3: Determine the monitoring area selected by the user as the security monitoring area.

For the convenience of description, the above three steps are combined for explanation.

In the embodiment of the present invention, an area image within the field of view of the field of view can be acquired by the image acquisition device. Send the area image to the user. Based on the image of the area, the user can select the monitoring area according to actual needs and return to the selected monitoring area. The monitoring area selected by the user is determined as the security monitoring area. Specifically, the field of view of the image acquisition device can be adjusted according to the monitoring area selected by the user, and the field of view can be adjusted to an image that can be collected into the security monitoring area.

After the safety monitoring area is determined in advance, the safety monitoring area can be monitored by the image collecting device to monitor whether there is a moving target in the safety monitoring area, and the moving target may be a human or an animal.

Specifically, the predetermined safety monitoring area in the planting greenhouse can be monitored within a preset safety monitoring time period.

In the embodiment of the present invention, the security monitoring time period may be preset, and specifically, may be set by a user or set by default. When entering the preset safety monitoring time period, the image acquisition device is turned on to monitor the safety monitoring area in the planting greenhouse. Turn off the image capture device outside the security monitoring period.

In the embodiment of the present invention, the user refers to the owner or manager of the planting greenhouse.

S120: When there is a moving target in the security monitoring area, output prompt information that requires the moving target to perform a verification gesture.

During the monitoring of the safety monitoring area in the planting greenhouse, it is possible to determine whether there is a moving target in the safety monitoring area.

In a specific embodiment of the present invention, whether there is a moving target in the security monitoring area can be determined by the following steps:

In the process of monitoring the security monitoring area, for each adjacent two frames of images, the adjacent two frames of images are subjected to a difference operation to obtain an absolute difference of pixel values of each corresponding pixel point, if the absolute difference of the pixel values If the ratio of the number of pixels larger than the preset threshold to the total number of pixels is greater than the preset ratio threshold, it is determined that there is a moving target in the security monitoring area.

During the monitoring of the security monitoring area, the images of the security monitoring area may be continuously collected, and the inter-frame difference algorithm may be used to determine whether there is a moving target in the security monitoring area. The interframe difference algorithm is an algorithm for obtaining a moving target contour by performing differential operations on two consecutive frames of a video image sequence. When an abnormal moving target appears in the monitoring scene, there will be obvious differences between the adjacent two frames, and the two frames are subtracted, and the corresponding position of the image, that is, the absolute value of the pixel value difference of the pixel, is determined, and whether it is determined whether Greater than a certain threshold, and then analyze the motion characteristics of the object of the video or image sequence.

For each adjacent two frames of images, the adjacent two frames of images may be subjected to a difference operation to obtain an absolute difference of pixel values of each corresponding pixel. If the ratio of the pixel value of the pixel value to the preset threshold is greater than the preset ratio threshold, it may be determined that there is a moving target in the security monitoring area. Otherwise, it may be determined that there is no moving target in the security monitoring area, and Only for normal plants move.

When determining the security monitoring area, if the size of the determined security monitoring area is reasonable, it is advantageous to increase the speed of performing differential operations on adjacent two frames of images.

When there is a moving target in the monitored security monitoring area, a prompt message requesting the moving target to perform the verification gesture may be output. Specifically, the prompt information may be output by voice, and the prompt information may be outputted by text in a preset display screen in the planting greenhouse.

S130: Capture and identify a verification gesture performed by the moving target.

It can be understood that after outputting the prompt information requesting the verification target of the moving target, if the moving target is a legitimate person, it should be able to execute the corresponding verification gesture according to the prompt information. The verification gesture performed by the moving target can be captured and recognized by the image acquisition device.

S140: Determine whether the verification gesture matches at least one legal gesture in the preset gesture library, and if not, perform the operation of step S150.

In the embodiment of the present invention, a legal gesture may be preset, such as setting a rounding gesture, lifting the two hands up to two gestures, and the like as a legal gesture. Specifically, it can be set by the user or set by default. The preset gesture library can contain one or more legal gestures. The inclusion of multiple legal gestures in the gesture library can improve the matching success rate of the verification gesture and the legal gesture to some extent.

After capturing and recognizing the verification gesture performed by the moving target, the verification gesture may be matched with each legal gesture in the gesture library, and if the verification gesture matches at least one legal gesture, the motion target may be determined to be a legal person, It is a legal act to enter and leave the greenhouse.

If the verification gesture does not match any of the legal gestures in the gesture library, it may be determined that the motion target is not a legal person, and may be an illegal person. In this case, the operation of step S150 may be continued.

S150: Output alarm information.

When the verification gesture does not match any of the legal gestures in the gesture library, it may be determined that the motion target is not a legal person, and the alarm information may be output. Specifically, an audible alarm or a light alarm can be triggered. Alternatively, the warning information may be sent to the preset terminal, where the preset terminal is a terminal that is pre-registered and verified, and the user can receive the warning information through the preset terminal, and timely process the problem. In this way, the user does not need to frequently view the surveillance video, and can also know whether there are illegal personnel in the current greenhouse.

Applying the method provided by the embodiment of the present invention, in the process of monitoring the safety monitoring area in the planting greenhouse, if there is a moving target in the safety monitoring area, the prompt information that the moving target is required to perform the verification gesture may be output, and the The verification gesture performed by the moving target is recognized. If the verification gesture does not match any of the legal gestures in the preset gesture library, the motion target may be determined to be an illegal person, and the alarm information may be output. In this way, there is no need to arrange special caregivers to pay attention to the surveillance video, which reduces the labor cost. In the case of unattended care, the growth safety of the plants in the greenhouse is ensured, and the economic loss caused by the damage of the plants is avoided.

In an embodiment of the present invention, after outputting the prompt information requesting the verification target to perform the verification gesture, the method may further include the following steps:

If no verification gesture is captured within the set duration, the operation of step S150 is performed.

It can be understood that if the moving target is an illegal person, it may not be able to perform the corresponding verification gesture, and if the moving target is an animal, it will not perform the corresponding verification gesture. Therefore, after outputting the prompt message requesting the verification target of the moving target, if no verification gesture is captured within the set duration, the alarm information may be directly output, so that the user can handle the situation in time.

The setting duration can be set and adjusted according to the actual situation, for example, set to 5 seconds.

In an embodiment of the present invention, the following steps may also be included:

When it is determined that the verification gesture does not match any of the legal gestures in the gesture library, the step of outputting the prompt information requesting the motion target to perform the verification gesture is repeatedly performed until the number of repetitions reaches the preset number threshold.

In practical applications, there may be some error in capturing or identifying the verification gesture performed by the moving target. It is possible that the moving target performs the verification gesture as a legal gesture, but because of the recognition error, the verification gesture and the gesture library may be determined. A legal gesture does not match. In this case, the prompt information that requires the moving target to perform the verification gesture may be repeatedly output until the number of repetitions reaches the preset number threshold, and if the captured and recognized verification gesture still does not match any of the legal gestures in the gesture library, Then you can output alarm information. In this way, the accuracy of the verification gesture recognition can be improved.

The preset number threshold can be set and adjusted according to the actual situation, for example, set to 1.

Corresponding to the above method embodiment, the embodiment of the present invention further provides a planting greenhouse safety monitoring device, and a planting greenhouse safety monitoring device described below and a planting greenhouse safety monitoring method described above can be mutually referenced.

Referring to Figure 2, the device includes the following modules:

The monitoring module 210 is configured to monitor a predetermined safety monitoring area in the planting greenhouse;

The prompt information outputting module 220 is configured to output, when the moving target is detected in the security monitoring area, the prompt information that requires the moving target to perform the verification gesture;

a verification gesture recognition module 230, configured to capture and identify a verification gesture performed by the moving target;

The gesture determining module 240 is configured to determine whether the verification gesture matches at least one legal gesture in the preset gesture library, and if not, trigger the alarm module 250;

The alarm module 250 is configured to output alarm information.

When the device provided by the embodiment of the present invention is used to monitor the security monitoring area in the greenhouse, if there is a moving target in the security monitoring area, the prompt information that the moving target is required to perform the verification gesture may be output, and the The verification gesture performed by the moving target is recognized. If the verification gesture does not match any of the legal gestures in the preset gesture library, the motion target may be determined to be an illegal person, and the alarm information may be output. In this way, there is no need to arrange special caregivers to pay attention to the surveillance video, which reduces the labor cost. In the case of unattended care, the growth safety of the plants in the greenhouse is ensured, and the economic loss caused by the damage of the plants is avoided.

The timeout processing module is configured to trigger the alarm module 250 after outputting the prompt information for requesting the motion target to perform the verification gesture, if no verification gesture is captured within the set duration.

The repeating execution module is configured to repeatedly perform the step of outputting the prompt information requesting the motion target to perform the verification gesture when determining that the verification gesture does not match any of the legal gestures in the gesture library, until the number of repetitions reaches a preset number threshold.

In a specific implementation manner of the present invention, the monitoring module 210 is specifically configured to:

The predetermined safety monitoring area in the planting greenhouse is monitored during the preset safety monitoring period.

Collecting an image of the area within the field of view;

Sending the area image to the user, so that the user selects the monitoring area based on the area image;

In a specific embodiment of the present invention, the method further includes a moving target determining module, configured to determine whether there is a moving target in the security monitoring area by the following steps:

The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same or similar parts of the respective embodiments may be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

A person skilled in the art will further appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software or a combination of both, in order to clearly illustrate the hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

The steps of a method or algorithm described in connection with the embodiments disclosed herein can be implemented directly in hardware, a software module executed by a processor, or a combination of both. The software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.

The principles and embodiments of the present invention have been described with reference to specific examples. The description of the above embodiments is only for helping to understand the technical solutions of the present invention and the core ideas thereof. It should be noted that those skilled in the art can make various modifications and changes to the present invention without departing from the spirit and scope of the invention.

Claims

A method for monitoring the safety of a greenhouse, characterized in that it comprises:

Monitoring a predetermined safety monitoring area in the planting greenhouse;

When it is detected that there is a moving target in the security monitoring area, outputting prompt information requesting the moving target to perform a verification gesture;

Capturing and identifying a verification gesture performed by the moving target;

Determining whether the verification gesture matches at least one legal gesture in the preset gesture library;

If no, an alarm message is output.
The method for monitoring the safety of a greenhouse according to claim 1, further comprising: after the outputting the prompt information that the moving target is required to perform the verification gesture, the method further comprising:

If the verification gesture is not captured within the set duration, the step of outputting the alarm information is performed.
The method for monitoring the safety of a greenhouse according to claim 1, further comprising:

When it is determined that the verification gesture does not match any of the legal gestures in the gesture library, the step of outputting the prompt information requesting the motion target to perform the verification gesture is repeatedly performed until the number of repetitions reaches a preset number threshold.
The method for monitoring the safety of a greenhouse according to any one of claims 1 to 3, wherein the monitoring of the predetermined safety monitoring area in the planting greenhouse comprises:

The predetermined safety monitoring area in the planting greenhouse is monitored during a preset safety monitoring period.
The method for monitoring the safety of a greenhouse according to any one of claims 1 to 3, characterized in that the security monitoring area is determined by the following steps:

Collecting an image of the area within the field of view;

Transmitting the area image to a user, so that the user selects a monitoring area based on the area image;

The monitoring area selected by the user is determined as the security monitoring area.
The planting greenhouse safety monitoring method according to any one of claims 1 to 3, characterized in that, by means of the following steps, it is determined whether there is a moving target in the safety monitoring area:

In the process of monitoring the security monitoring area, for each adjacent two frames of images, performing differential operations on the adjacent two frames of images to obtain an absolute difference of pixel values of each corresponding pixel point, if If the ratio of the pixel value of the prime value greater than the preset threshold to the total pixel number is greater than the preset ratio threshold, it is determined that there is a moving target in the security monitoring area.
A planting greenhouse safety monitoring device is characterized in that it comprises:

a monitoring module for monitoring a predetermined safety monitoring area in the planting greenhouse;

a prompt information output module, configured to: when the moving target is detected in the security monitoring area, output prompt information requesting the moving target to perform a verification gesture;

a verification gesture recognition module, configured to capture and identify a verification gesture performed by the moving target;

a gesture determining module, configured to determine whether the verification gesture matches at least one legal gesture in the preset gesture library, and if not, trigger an alarm module;

The alarm module is configured to output alarm information.
The planting shelter safety monitoring device according to claim 7, further comprising:

And a timeout processing module, configured to trigger the alarm module if the verification gesture is not captured within the set duration after the output requesting the motion target to perform the verification gesture of the verification gesture.
The planting shelter safety monitoring device according to claim 7, further comprising:

a repeating execution module, configured to repeatedly perform the step of outputting the prompt information requesting the moving target to perform the verification gesture until the verification gesture is not matched with any one of the gestures in the gesture library, until the number of repetitions The preset number of thresholds is reached.
The planting greenhouse safety monitoring device according to any one of claims 7 to 9, wherein the monitoring module is specifically configured to:

The predetermined safety monitoring area in the planting greenhouse is monitored during a preset safety monitoring period.
The planting greenhouse safety monitoring device according to any one of claims 7 to 9, further comprising a safety monitoring area determining module, configured to determine the safety monitoring area by the following steps:

Collecting an image of the area within the field of view;

Transmitting the area image to a user, so that the user selects a monitoring area based on the area image;

The monitoring area selected by the user is determined as the security monitoring area.
The planting greenhouse safety monitoring device according to any one of claims 7 to 9, further comprising a moving target determining module, configured to determine in the safety monitoring area by the following steps Is there a moving goal:

In the process of monitoring the security monitoring area, for each adjacent two frames of images, performing differential operations on the adjacent two frames of images to obtain an absolute difference of pixel values of each corresponding pixel point, if the pixel value is If the ratio of the number of pixels whose absolute difference is greater than the preset threshold to the total number of pixels is greater than the preset ratio threshold, it is determined that there is a moving target in the security monitoring area.