CN113554837A - Monitoring alarm method and system - Google Patents
Monitoring alarm method and system Download PDFInfo
- Publication number
- CN113554837A CN113554837A CN202110825363.9A CN202110825363A CN113554837A CN 113554837 A CN113554837 A CN 113554837A CN 202110825363 A CN202110825363 A CN 202110825363A CN 113554837 A CN113554837 A CN 113554837A
- Authority
- CN
- China
- Prior art keywords
- monitoring
- image data
- alarm
- human body
- early warning
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 138
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000004044 response Effects 0.000 claims abstract description 14
- 238000012545 processing Methods 0.000 claims description 34
- 230000009471 action Effects 0.000 claims description 16
- 238000004891 communication Methods 0.000 claims description 14
- 238000001931 thermography Methods 0.000 claims description 11
- 230000004297 night vision Effects 0.000 claims description 7
- 230000006399 behavior Effects 0.000 claims description 5
- 238000003860 storage Methods 0.000 claims description 5
- 206010000117 Abnormal behaviour Diseases 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims description 4
- 230000017525 heat dissipation Effects 0.000 claims description 3
- 238000003384 imaging method Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 3
- 238000009826 distribution Methods 0.000 abstract description 3
- 238000012806 monitoring device Methods 0.000 abstract description 2
- 238000004519 manufacturing process Methods 0.000 description 9
- 230000008901 benefit Effects 0.000 description 6
- 241000256626 Pterygota <winged insects> Species 0.000 description 5
- 240000007651 Rubus glaucus Species 0.000 description 5
- 235000011034 Rubus glaucus Nutrition 0.000 description 5
- 235000009122 Rubus idaeus Nutrition 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000003801 milling Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000003062 neural network model Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 239000002912 waste gas Substances 0.000 description 3
- XKRFYHLGVUSROY-UHFFFAOYSA-N Argon Chemical compound [Ar] XKRFYHLGVUSROY-UHFFFAOYSA-N 0.000 description 2
- 229910000831 Steel Inorganic materials 0.000 description 2
- 238000005553 drilling Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000007711 solidification Methods 0.000 description 2
- 230000008023 solidification Effects 0.000 description 2
- 239000010959 steel Substances 0.000 description 2
- 241000196324 Embryophyta Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 229910052786 argon Inorganic materials 0.000 description 1
- 230000001174 ascending effect Effects 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003754 machining Methods 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 239000002994 raw material Substances 0.000 description 1
- 239000011265 semifinished product Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
- 238000003466 welding Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Alarm Systems (AREA)
Abstract
The invention provides a monitoring alarm method and a device; the method comprises the following steps: acquiring image data of a workshop site through a monitoring node; identifying a human body in the image data and capturing a plurality of key nodes of the human body; constructing a limb line based on a plurality of key nodes of the human body, and calculating the intrusion ratio of the limb line in an early warning surface generated based on image data; and controlling the monitoring node to give an alarm and upload related image data to the monitoring center in response to the fact that the intrusion ratio of the limb line in the early warning surface is larger than or equal to a preset threshold value. The beneficial effects of the invention include: the monitoring method and the monitoring device for image recognition and human body posture prediction support auxiliary monitoring by predicting the human body posture under the condition of low image definition, support prediction under an off-line condition, reduce monitoring personnel investment and reduce workshop network distribution cost.
Description
Technical Field
The invention relates to the technical field of monitoring, in particular to a monitoring alarm method and a monitoring alarm system.
Background
With the deepening of the concept of safety production, the production workshops and production lines of enterprises are equipped with operation monitoring, and are equipped with special persons for monitoring and exception handling. However, the existing workshop monitoring method has many problems, and the main problems include:
1) different from the chemical industry and the paper making industry which are oriented to the process manufacturing and can realize clean and dust-free workshops, the workshops which are oriented to the discrete manufacturing industry, particularly the workshops which relate to the steel structure processing, are difficult to realize dust-free. The processing technology of a large-scale equipment manufacturing factory often has the procedures of high-temperature cutting, argon arc welding and the like, so a large amount of waste gas can be generated, the large-scale equipment manufacturing workshop has large size of processed parts, and the raw materials and semi-finished products are stacked temporarily, so that the waste gas is difficult to disperse in a short time, the visibility of the workshop is reduced, in addition, the workshop working clothes mainly have deep colors such as dark blue, gray, black and the like, are not clear from the boundaries of other environmental factors such as equipment, steel and the like, and are more difficult to distinguish and distinguish from a monitoring image.
2) For the early warning of object intrusion, an alarm is generally triggered according to the ratio of the intrusion area to the area of a forbidden area (early warning surface), however, the alarm is often false in this way. For example: a winged insect carries out the flight motion in the scope of pressing close to the camera, because the perspective phenomenon of nearly big far and little, the winged insect area enlarges at double, and the occupation ratio reaches the default, can lead to the mistake to touch the control warning promptly to lead to the fact extra examination work for the control personnel, on the other hand also can waste a large amount of storage spaces because the early warning of wrong report police is saved.
3) After the deployment of the monitoring system is completed, due to the solidification problem of the monitoring system, the upgrading, increase, decrease, migration of the equipment and the introduction of new functional equipment are difficult.
Therefore, there is a need to provide a new monitoring alarm method and/or system to avoid the above problems.
Disclosure of Invention
In order to solve the technical problem, in one aspect of the present invention, a monitoring alarm method is provided, where the method includes acquiring image data of a monitoring site through a monitoring node; identifying a human body in the image data and capturing a plurality of key nodes of the human body; constructing a limb line based on a plurality of key nodes of the human body, and calculating the intrusion ratio of the limb line in an early warning surface generated based on image data; and controlling the monitoring node to give an alarm and upload related image data to a monitoring center in response to the fact that the intrusion ratio of the limb line in the early warning surface is larger than or equal to a preset threshold value.
In one or more embodiments, the controlling the monitoring node to issue an alarm in response to the intrusion ratio of the limb line in the early warning surface being greater than or equal to a preset threshold includes: responding to the fact that the ratio of the length of the limb line invading the early warning surface to the whole length of the limb line is larger than or equal to a first preset threshold value, and controlling the monitoring node to give out an alarm; and the early warning surface is a designated area in an image picture corresponding to the image data.
In one or more embodiments, the controlling the monitoring node to issue an alarm in response to the intrusion ratio of the limb line in the early warning surface being greater than or equal to a preset threshold includes: controlling the monitoring node to give an alarm in response to the fact that the ratio of the number of key nodes invading the early warning surface in the limb line to the number of all key nodes in the limb line is greater than or equal to a second preset threshold value; and the early warning surface is a designated area in an image picture corresponding to the image data.
In one or more embodiments, the monitoring alarm method further comprises: identifying an object in the image data; and classifying the identified objects, performing region division on an image picture corresponding to the image data according to the classification, and generating one or more early warning surfaces based on the division result.
In one or more embodiments, the monitoring alarm method further comprises: identifying human body actions based on a plurality of key nodes of the human body; identifying object behaviors according to one or more human body actions and the region where the human body is located; and controlling the monitoring node to give an alarm and upload related image data to a monitoring center in response to the abnormal behavior of the object.
In one or more embodiments, the image data includes: depth image data and thermal imaging data.
In another aspect of the present invention, a monitoring alarm system is provided, including: the system comprises one or more monitoring nodes, a monitoring server and a monitoring server, wherein each monitoring node at least comprises a camera and a processing module, and the camera is in communication connection with the processing module; a storage module storing an executable computer program for implementing the respective steps of the monitoring alarm method as described above when executed by the processing module; and the monitoring center is used for receiving and displaying the related image data uploaded by one or more monitoring nodes.
In one or more embodiments, the monitoring and alarm system further comprises: the thermal imaging device or the infrared night vision device is in communication connection with the processing module through one of the data interfaces and is used for sending the acquired thermal imaging data or night vision imaging data to the processing module.
In one or more embodiments, the monitoring and alarm system further comprises: and the thermal imager is in communication connection with the processing module through one of the data interfaces and is used for sending the acquired thermal imaging data to the processing module.
In one or more embodiments, the monitoring and alarm system further comprises: and the heat dissipation device is arranged near the base and used for dissipating heat of the processing module in the base.
The beneficial effects of the invention include: 1) the monitoring method and the monitoring device for image recognition and human body posture prediction support auxiliary monitoring by predicting the human body posture under the condition of low image definition, support prediction under an off-line condition, reduce monitoring personnel investment and reduce workshop network distribution cost. 2) The human body posture is quantized and converted into accurate judgment of limbs and the early warning area, and the early warning accuracy is improved. 3) The monitoring design and the device with low cost and high effect support flexible ascending and descending of configuration according to application scenes. 4) The model training aiming at the state is provided, the advantages of one-time training and multi-place deployment can be formed in the same industry, and the machine training cost is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.
FIG. 1 is a flow chart of the operation of a monitoring alarm method of the present invention;
FIG. 2 is a schematic diagram of the monitoring alarm system of the present invention;
FIG. 3 is a flow chart of the operation of a prior art monitoring alarm system;
FIG. 4 is a flow chart of the operation of the monitoring alarm system of the present invention;
fig. 5 is a schematic diagram of physical connection at the monitoring node side of the monitoring alarm system of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
Fig. 1 is a flowchart of a monitoring alarm method according to the present invention. As shown in fig. 1, the working flow of the monitoring alarm method of the present invention includes: s1, acquiring image data of a monitoring site through a monitoring node; step S2, recognizing the human body in the image data, and capturing a plurality of key nodes of the human body; step S3, constructing a limb line based on a plurality of key nodes of the human body, and calculating the intrusion ratio of the limb line in an early warning surface generated based on image data; and step S4, responding to the intrusion ratio of the limb line in the early warning surface being larger than a preset threshold value, controlling the monitoring node to send out an alarm and upload related image data to the monitoring center. The early warning surface is a designated area in an image picture corresponding to the image data.
In the embodiment, the invention provides that the monitoring of a monitoring site is realized by adopting an image analysis algorithm, the key nodes of a human body are identified, a limb line is constructed, and the intrusion proportion of the limb line in the generated early warning surface is calculated to trigger the alarm; compared with the prior art, the method has the advantages that the occurrence of false alarm is greatly reduced by capturing the moving object and triggering the alarm mode according to the area ratio of the object invading the early warning surface; for example, in the alarm of winged insect intrusion mentioned in the background art, since the winged insect cannot be identified as a human body and cannot be further identified to a key node, a false alarm is not triggered. In addition, the invention also identifies key nodes, so that the requirement on the image quality of the image is not high, and the hardware investment in the application of the scheme of the invention is far lower than that of the existing monitoring scheme.
In a further embodiment, in order to further ensure the accuracy of intrusion alarm, the invention also provides a method for calculating the intrusion ratio by calculating the ratio of the length of the limb line intrusion early-warning surface to the overall length of the limb line, and controlling the monitoring node to send out an alarm in response to the condition that the ratio of the length of the limb line intrusion early-warning surface to the overall length of the limb line is greater than or equal to a first preset threshold value; in this embodiment, since the limb line configuration needs to have at least two key nodes, the intrusion alarm based on the limb line can effectively avoid the occurrence of false alarms such as winged insect intrusion.
In a further embodiment, in order to further ensure the accuracy of intrusion alarm, the invention further provides that the intrusion ratio is calculated by the ratio of the number of key nodes of the intrusion early warning surface in the limb line to the number of all key nodes in the limb line, and the monitoring node is controlled to send out an alarm in response to the ratio of the number of key nodes of the intrusion early warning surface in the limb line to the number of all key nodes in the limb line being greater than or equal to a second preset threshold value. In this embodiment, in consideration of the influence of the human posture on the intrusion ratio, for example, when the human body bends over or squats, the key nodes are concentrated, and it is obviously not accurate enough to calculate the intrusion ratio based on the length of the limb line intrusion early warning surface.
In a specific embodiment, the intrusion alarm modes in the two embodiments are combined, and in the monitoring process, the intrusion alarm is triggered when any one condition of the two intrusion alarms is met.
In a further embodiment, the present invention further provides a method for automatically determining an early warning plane, comprising the steps of: identifying an object in the image data; and classifying the identified objects, performing region division on an image picture corresponding to the image data according to the classification, and generating one or more early warning surfaces based on the division result. The early warning surface corresponds to an area where people are forbidden to enter in a monitoring field, and danger may exist in the area.
In a specific embodiment, the forbidden zone may also relate to commercial secrets, and for this purpose, the on-site monitoring method of the present invention further includes performing face recognition on the person in the person monitoring picture, and determining the forbidden zone according to the level difference of the identity of the subject. This implementation can be more intelligent realization to the control on-the-spot to the management work in workshop can effectual supplementary.
In the monitoring and early warning method, the forbidden area can be monitored, and the abnormal behavior of personnel can be monitored, and the specific scheme is as follows:
in a further embodiment, the monitoring alarm method of the present invention further comprises identifying human body actions based on a plurality of key nodes of the human body; identifying object behaviors according to one or more human body actions and the region where the human body is located; and controlling the monitoring node to give an alarm and upload related image data to the monitoring center in response to the abnormal behavior of the object. The above human body actions are basic actions of the human body recognized according to a plurality of key nodes, such as squatting, sitting, standing, walking, bending, lifting the hands and the like. However, considering that the same action may have different meanings in different scenes, the invention determines the working scene based on the recognition and classification of the workshop on-site object in the previous embodiment, and identifies the object behavior by one or more human body actions, for example, taking a numerical control milling machine and a radial drilling machine as examples, the worker also has the action of standing and lowering the head, however, the corresponding specific actions are the plane milling action of the numerical control milling worker in the numerical control milling process and the hole drilling action of the operator in the hole machining process respectively. Also, in both scenarios, abnormal operation of the person will be distinguished. Therefore, the implementation determines the working environment by combining the recognition object, and the monitoring of the object behaviors based on the working environment and the human body actions is more reasonable and effective.
In a further embodiment, the image data of the zone of the invention may be depth of field image data as well as thermographic data for the case of an intrusion into a hazardous area in an intrusion alert. The intrusion alarm based on the thermal imaging data can effectively avoid the situation that the field monitoring cannot be effectively realized in the prior art due to the shielding of waste gas, obstacles and the like, and on the contrary, the field monitoring under the unfavorable working conditions can be effectively realized due to the adoption of the mode of constructing the human body line based on the human body key nodes. And the method also has good effect on night monitoring.
It should be noted that the application scenarios described above are only common application scenarios that can be thought of by the present invention, but do not play any limiting role in the application scenarios of the present invention; any other application scenario that can be inspired by the application scenario proposed by the present invention and can be monitored by the method of the present invention is also within the protection scope of the present invention.
In addition, the above-described analysis processing work on the image data is mainly realized by a neural network model. In an embodiment of the invention, the external device can train the model and optimize the model, and then the optimized neural network model is stored as the tflite file to perform software deployment. Wherein, the trained neural network model has self-learning ability.
On the basis of the monitoring alarm method provided by each embodiment, the invention further provides a monitoring alarm system, which is specifically described as follows:
fig. 2 is a schematic structural diagram of the monitoring alarm system of the present invention. As shown in fig. 2, the monitoring alarm system of the present invention includes: one or more monitoring nodes 100 (only one monitoring node is shown in fig. 2), each monitoring node 100 at least comprises a camera 120 and a processing module 110, and the camera 120 is communicatively connected with the processing module 110; a storage module 200, wherein the storage module 200 stores an executable computer program, and the computer program is used for implementing the corresponding steps of the monitoring alarm method in any one of the above embodiments when being executed by the processing module 110; and the monitoring center 300, wherein the monitoring center 300 is used for receiving and displaying the related image data uploaded from one or more monitoring nodes 100.
In this embodiment, the acquired image data is analyzed on site and off-line, and only the image data related to the alarm is uploaded to the monitoring center, so that the requirement on system network transmission is greatly reduced, and the deployment difficulty of the monitoring alarm system is greatly reduced. In addition, the invention configures a plurality of data interfaces for the monitoring node, so that the hardware equipment composition at the monitoring node side can be flexibly configured, the solidification problem of the monitoring system is solved to a certain extent, and the upgrading, increasing, decreasing, migrating and the introduction of new functional equipment of the hardware equipment can be more simply realized compared with the prior art.
Because the invention has low requirements on the network transmission performance of the system, in an optional embodiment, the monitoring node of the invention can communicate with the monitoring center in a wired communication mode and upload related image data; in a preferred embodiment, the monitoring node of the present invention can communicate with the monitoring center by wireless communication, and upload the related image data. Although wired communication has advantages and disadvantages in relation to wireless communication, the present invention provides more options than the existing plant monitoring schemes that generally have higher requirements for network transmission capabilities and can only use wired communication, so that the communication form can be selected as desired. The following table lists the comparison of the benefit and disadvantage of wired versus wireless.
TABLE 1 comparison of advantages and disadvantages of Wired versus Wireless communication
In a specific embodiment, the monitoring node and the monitoring center adopt a communication limiting mode, if in general conditions, video data can only be uploaded to the monitoring center by the monitoring node, and except for active pulling after identity verification, any process processing image data cannot leave edge equipment, so that the confidentiality of a process flow is ensured.
In another specific embodiment, the related image data uploaded by the monitoring node is image data within a preset time period before and after the occurrence of an alarm.
In the embodiment, because the analysis of the image data is carried out in the monitoring nodes on the site, the invention not only realizes the average distribution of calculation power, but also avoids the danger caused by the loss of the monitoring capability of the whole workshop site once the analysis system fails when the image data is analyzed in a centralized way. The workflow of the solution of the present invention is aligned with the existing solutions as shown in fig. 3 and 4:
fig. 3 is a flowchart illustrating the operation of a conventional monitoring alarm system. In the existing scheme, a field monitoring node generally only has a camera shooting capability, image data processing is performed in a background, and a monitoring center can display the field monitoring condition of a workshop in real time, so that the field monitoring work of the workshop is mainly realized under the condition that monitoring personnel assist in monitoring.
Fig. 4 is a flow chart of the operation of the monitoring alarm system of the present invention. In the scheme of the invention, the processing of the image data is completed in the field, and only the relevant video for triggering the alarm is uploaded to the monitoring center, so that the monitoring personnel only need to pay attention to the video displayed in the monitoring center, thereby greatly reducing the manpower requirement in the monitoring work of the invention.
In an alternative embodiment, in order to ensure continuous monitoring of the important area, the monitoring node can be configured to upload the video data shot by the monitoring node in real time, and not only upload the video data related to the alarm.
In one embodiment, the processing module of the present legal is a raspberry pi 4B IC board and the camera is an HBV-4K 1928V 55 camera.
In a further embodiment, the monitoring alarm system of the present invention further includes a thermal imaging camera, and the thermal imaging camera is in communication connection with the processing module through one of the data interfaces on the base, and is configured to send the acquired thermal imaging data to the processing module.
In a further embodiment, the monitoring alarm system of the present invention further comprises an infrared night vision device, which is communicatively connected to the processing module through one of the plurality of data interfaces on the base and is configured to transmit the acquired night vision imaging data to the processing module.
In the embodiment, aiming at the problems of different enterprise scales and different workshop production environments, the raspberry pi 4B, HBV-4K 1928V 55 cameras used in the embodiment of the invention can be flexibly configured, lifted and adjusted, and the full-automatic selection of hardware equipment is realized. Such as: the environment is clean, the production environment is simple, the Camera can be descended to be RPi Camera V2, and the raspberry group 4B is descended to be 3B +; in a workshop where dark work exists, the Camera can be replaced by an RPi Camera NOIR V2 Camera supporting infrared night vision.
In a further embodiment, the monitoring alarm system of the present invention further includes a heat dissipation device disposed near the base for dissipating heat from the processing module in the base.
In a further embodiment, the monitoring alarm system further comprises a power supply module, and the power supply module is used for supplying power to the whole monitoring alarm system.
In one implementation, the power supply module is used for providing 220V alternating current and 5V/3A direct current.
Fig. 5 is a schematic diagram of physical connection at the monitoring node side of the monitoring alarm system of the present invention. As shown in fig. 5, 100 is a processing module (raspberry pi 4B ic), 120 is a camera, 400 is a power supply module, and 500 is a fan. In this implementation, the memory module 200 is also integrated on a raspberry pi 4B integrated circuit board.
The monitoring alarm method or system of the invention is beneficial to reducing the hardware investment cost, and the following table lists the comparison of the hardware investment required by the existing monitoring systems and the monitoring alarm method or system provided by the invention, and specifically shows that:
TABLE 2 hardware investment comparison of the inventive scheme with the existing scheme
It can be known from the comparison that the monitoring of 2-3 stations is realized, the hardware investment of the invention is far lower than that of the hundred-degree AI scheme, and the investment cost in the aspect of the camera can be effectively reduced because the performance requirement of the camera is not high, so that the hardware investment cost of the scheme of the invention is lower than that of the Dahua scheme.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. A monitoring alarm method, characterized in that the method comprises,
acquiring image data of a monitoring site through a monitoring node;
identifying a human body in the image data and capturing a plurality of key nodes of the human body;
constructing a limb line based on a plurality of key nodes of the human body, and calculating the intrusion ratio of the limb line in an early warning surface generated based on the image data;
and controlling the monitoring node to give an alarm and upload related image data to a monitoring center in response to the fact that the intrusion ratio of the limb line in the early warning surface is larger than or equal to a preset threshold value.
2. The monitoring alarm method of claim 1, wherein the controlling the monitoring node to issue an alarm in response to the intrusion proportion of the limb line in the early warning surface being greater than or equal to a preset threshold value comprises:
responding to the fact that the ratio of the length of the limb line invading the early warning surface to the whole length of the limb line is larger than or equal to a first preset threshold value, and controlling the monitoring node to give out an alarm;
and the early warning surface is a designated area in an image picture corresponding to the image data.
3. The monitoring alarm method of claim 1, wherein the controlling the monitoring node to issue an alarm in response to the intrusion proportion of the limb line in the early warning surface being greater than or equal to a preset threshold value comprises:
controlling the monitoring node to give an alarm in response to the fact that the ratio of the number of key nodes invading the early warning surface in the limb line to the number of all key nodes in the limb line is greater than or equal to a second preset threshold value;
and the early warning surface is a designated area in an image picture corresponding to the image data.
4. A monitoring alarm method according to claim 2 or 3, characterised in that the method further comprises:
identifying an object in the image data;
and classifying the identified objects, performing region division on an image picture corresponding to the image data according to the classification, and generating one or more early warning surfaces based on the division result.
5. The monitoring alarm method of claim 4, further comprising:
identifying human body actions based on a plurality of key nodes of the human body;
identifying object behaviors according to one or more human body actions and the region where the human body is located;
and controlling the monitoring node to give an alarm and upload related image data to a monitoring center in response to the abnormal behavior of the object.
6. The monitoring alarm method of claim 1, wherein the image data comprises: depth image data and thermal imaging data.
7. A monitoring alarm system, comprising:
the system comprises one or more monitoring nodes, a monitoring server and a monitoring server, wherein each monitoring node at least comprises a camera and a processing module, and the camera is in communication connection with the processing module;
a storage module storing an executable computer program for implementing the respective steps of the monitoring alarm method according to any one of claims 1-6 when executed by the processing module;
and the monitoring center is used for receiving and displaying the related image data uploaded by one or more monitoring nodes.
8. The monitoring alarm system according to claim 7, wherein the processing module is disposed in a base, the base fixedly supporting the camera and being provided with a plurality of data interfaces, the plurality of data interfaces being respectively connected with the processing module, the camera being communicatively connected with the processing module through one of the plurality of data interfaces and being configured to transmit the acquired image data to the processing module.
9. The monitoring alarm system of claim 8, further comprising: the thermal imaging device or the infrared night vision device is in communication connection with the processing module through one of the data interfaces and is used for sending the acquired thermal imaging data or night vision imaging data to the processing module.
10. The monitoring alarm system of claim 8, further comprising: and the heat dissipation device is arranged near the base and used for dissipating heat of the processing module in the base.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110825363.9A CN113554837B (en) | 2021-07-21 | 2021-07-21 | Monitoring alarm method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110825363.9A CN113554837B (en) | 2021-07-21 | 2021-07-21 | Monitoring alarm method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113554837A true CN113554837A (en) | 2021-10-26 |
| CN113554837B CN113554837B (en) | 2023-08-15 |
Family
ID=78103858
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110825363.9A Active CN113554837B (en) | 2021-07-21 | 2021-07-21 | Monitoring alarm method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113554837B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI832391B (en) * | 2022-08-23 | 2024-02-11 | 矽格股份有限公司 | Behavior monitoring device and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117023A (en) * | 2015-09-25 | 2015-12-02 | 京东方科技集团股份有限公司 | Automatic adjustment display system and adjusting method and device thereof |
| CN109034124A (en) * | 2018-08-30 | 2018-12-18 | 成都考拉悠然科技有限公司 | A kind of intelligent control method and system |
| CN110675433A (en) * | 2019-10-31 | 2020-01-10 | 北京达佳互联信息技术有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN111597879A (en) * | 2020-04-03 | 2020-08-28 | 成都云盯科技有限公司 | Gesture detection method, device and system based on monitoring video |
| CN112926541A (en) * | 2021-04-09 | 2021-06-08 | 济南博观智能科技有限公司 | Sleeping post detection method and device and related equipment |
| CN112949439A (en) * | 2021-02-19 | 2021-06-11 | 中国石油天然气集团有限公司 | Method and system for monitoring invasion of personnel in key area of oil tank truck |
| US20210201074A1 (en) * | 2011-03-29 | 2021-07-01 | Thermal Matrix USA, Inc. | Method and system for detecting concealed objects using handheld thermal imager |
-
2021
- 2021-07-21 CN CN202110825363.9A patent/CN113554837B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20210201074A1 (en) * | 2011-03-29 | 2021-07-01 | Thermal Matrix USA, Inc. | Method and system for detecting concealed objects using handheld thermal imager |
| CN105117023A (en) * | 2015-09-25 | 2015-12-02 | 京东方科技集团股份有限公司 | Automatic adjustment display system and adjusting method and device thereof |
| CN109034124A (en) * | 2018-08-30 | 2018-12-18 | 成都考拉悠然科技有限公司 | A kind of intelligent control method and system |
| CN110675433A (en) * | 2019-10-31 | 2020-01-10 | 北京达佳互联信息技术有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN111597879A (en) * | 2020-04-03 | 2020-08-28 | 成都云盯科技有限公司 | Gesture detection method, device and system based on monitoring video |
| CN112949439A (en) * | 2021-02-19 | 2021-06-11 | 中国石油天然气集团有限公司 | Method and system for monitoring invasion of personnel in key area of oil tank truck |
| CN112926541A (en) * | 2021-04-09 | 2021-06-08 | 济南博观智能科技有限公司 | Sleeping post detection method and device and related equipment |
Non-Patent Citations (1)
| Title |
|---|
| 刘成 等: "基于图像处理的嵌入式自动报警系统" * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI832391B (en) * | 2022-08-23 | 2024-02-11 | 矽格股份有限公司 | Behavior monitoring device and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113554837B (en) | 2023-08-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110795989A (en) | Intelligent safety monitoring system for electric power operation and monitoring method thereof | |
| JP2019530084A (en) | Factory equipment monitoring system and method using active black box | |
| KR101339928B1 (en) | Integrated wireless ship management system based on local information of worker | |
| CN105308657A (en) | Security and/or monitoring devices and systems | |
| JPWO2015037542A1 (en) | Notification system | |
| KR102096175B1 (en) | Ceiling rail type IoT based surveillance robot device | |
| JP2009003940A (en) | Security device, security system, security camera, security system operating method, security monitoring method and program | |
| JP7119532B2 (en) | Productivity Improvement Support System and Productivity Improvement Support Program | |
| CN107404635B (en) | Alarm information monitoring method and system | |
| CN211509189U (en) | Electric power operation field supervision equipment and system | |
| CN113554837A (en) | Monitoring alarm method and system | |
| CN206975532U (en) | warehouse monitoring system based on wireless GSM | |
| EP3140790A1 (en) | Issue tracking and resolution system | |
| KR102219809B1 (en) | Safety Work Management System by Image Analysis | |
| JP2017097702A (en) | Monitor system and monitor control device of the same | |
| KR20200079001A (en) | Control system and method using integrated environmental monitoring | |
| CN113506416A (en) | Engineering abnormity early warning method and system based on intelligent visual analysis | |
| JP2020086482A (en) | Safety measure system and safety measure method | |
| CN108388873A (en) | A kind of supervisory systems of machine vision, method and client computer, storage medium | |
| TWI732392B (en) | Factory management system and control system | |
| CN112200995A (en) | Low-power consumption field security system based on hybrid architecture | |
| CN112015134A (en) | Storage cabinet personal safety protection safety system and safety control method thereof | |
| JP2018142169A (en) | Worker state grasping device, worker state grasping system, and worker state grasping method | |
| CN213457742U (en) | Welding operation monitoring system | |
| JP2013192202A (en) | Work image monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230717 Address after: 250101 Inspur science and Technology Park, 1036 Inspur Road, hi tech Zone, Jinan City, Shandong Province Applicant after: Inspur Genersoft Co.,Ltd. Address before: 250100 Room 102, 1st floor, R & D building, 2877 Kehang Road, Suncun Town, high tech Zone, Jinan City, Shandong Province Applicant before: SHANDONG INSPUR GENESOFT INFORMATION TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |