CN110245630B - Monitoring data processing method and device and readable storage medium - Google Patents
Monitoring data processing method and device and readable storage medium Download PDFInfo
- Publication number
- CN110245630B CN110245630B CN201910534159.4A CN201910534159A CN110245630B CN 110245630 B CN110245630 B CN 110245630B CN 201910534159 A CN201910534159 A CN 201910534159A CN 110245630 B CN110245630 B CN 110245630B
- Authority
- CN
- China
- Prior art keywords
- illegal
- personnel
- action
- data
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 123
- 238000003672 processing method Methods 0.000 title claims abstract description 30
- 230000006399 behavior Effects 0.000 claims abstract description 84
- 238000012545 processing Methods 0.000 claims abstract description 38
- 230000002265 prevention Effects 0.000 claims abstract description 24
- 230000000007 visual effect Effects 0.000 claims description 5
- 108091026890 Coding region Proteins 0.000 claims description 4
- 238000012163 sequencing technique Methods 0.000 claims description 4
- 230000001815 facial effect Effects 0.000 claims description 3
- 238000000034 method Methods 0.000 description 20
- 230000000875 corresponding effect Effects 0.000 description 13
- 238000004458 analytical method Methods 0.000 description 11
- 238000004364 calculation method Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000009825 accumulation Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19608—Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19613—Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Artificial Intelligence (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention discloses a monitoring data processing method, which comprises the following steps: collecting monitoring image video data, and identifying face image data in the monitoring image video data; carrying out similarity comparison on the recognized face image data and face image data in a face database of a prestored illegal action person, calculating to obtain a similarity matching value, if the similarity matching value is greater than a preset threshold value, sending out a prevention alarm, and marking the recognized face image data as target face data; and acquiring tracking video images of the target face data, judging whether illegal behaviors exist in the acquired tracking video images, and starting an alarm if the illegal behaviors exist. The invention also discloses a monitoring data processing device and a readable storage medium. The invention can reduce the manpower quantity and improve the working efficiency; meanwhile, misjudgment or negligence of security personnel is reduced, so that illegal behaviors are effectively prevented.
Description
Technical Field
The present invention relates to the field of monitoring data processing technologies, and in particular, to a monitoring data processing method and apparatus, and a readable storage medium.
Background
Articles or public property are often stolen in residential districts, markets, stations and other places, and citizens often lack the awareness of protecting their property, so that the theft events are frequent.
At present, for the illegal behaviors of the thieves, the prevention means is mainly manual monitoring, such as security personnel watching and identifying in real time and continuously patrolling and checking; or the security personnel continuously check the situation through the camera monitoring picture. The methods are based on human monitoring and analysis, a large amount of manpower is required to be invested, and the working efficiency is low. Meanwhile, for the identification of common thieves, training and accumulation are required for a certain time based on the judgment of people, and once the people leave the job, the risk of theft is increased in a short time; but also may not be effective in preventing illegal activities due to carelessness of personnel.
Disclosure of Invention
The invention mainly aims to provide a monitoring data processing method, a monitoring data processing device and a readable storage medium, aiming at reducing the manpower quantity and improving the working efficiency; meanwhile, misjudgment or negligence of security personnel is reduced, so that illegal behaviors are effectively prevented.
In order to achieve the above object, the present invention provides a monitoring data processing method, including the steps of:
collecting monitoring image video data, and identifying face image data in the monitoring image video data;
carrying out similarity comparison on the recognized face image data and face image data in a face database of a prestored illegal action person, calculating to obtain a similarity matching value, if the similarity matching value is greater than a preset threshold value, sending out a prevention alarm, and marking the recognized face image data as target face data;
and acquiring tracking video images of the target face data, judging whether illegal behaviors exist in the acquired tracking video images, and starting an alarm if the illegal behaviors exist.
In an embodiment, the pre-stored face database of the illegal action person comprises crime position information and crime time information of the illegal action person; the monitoring data processing method comprises the following steps:
collecting monitoring image video data, and identifying face image data in the monitoring image video data, wherein the identified face image data comprises collecting position information and collecting time information;
and comparing the similarity of the acquisition position information with the prisoner case position information, and/or comparing the similarity of the acquisition time information with the prisoner case time information, calculating to obtain a similarity matching value, and if the similarity matching value is greater than a preset threshold value, sending out a prevention alarm.
In an embodiment, the acquiring monitoring image video data and recognizing facial image data in the monitoring image video data, where the step of recognizing facial image data includes acquiring location information and acquiring time information further includes:
acquiring the occurrence frequency of the face image data corresponding to the acquisition position information and/or the acquisition time information;
coding and sequencing the recognized face image data according to the appearance frequency of the face image data;
and comparing the similarity of the recognized face image data according to a coding sequence, calculating to obtain a similarity matching value, and sending out a prevention alarm if the similarity matching value is greater than a preset threshold value.
In an embodiment, the step of acquiring a tracking video image of the target face data, and determining whether an illegal action exists in the acquired tracking video image, and if an illegal action exists, the step of starting an alarm includes:
obtaining crime position information and crime time information corresponding to target face data from a pre-stored face database of the illegal action personnel;
tracking video image acquisition is carried out on target face data according to the crime position information and/or crime time information, and personnel behavior actions are identified and analyzed in the acquired tracking video image;
and judging whether the behavior action of the personnel is illegal or not, and starting an alarm if the behavior action of the personnel is illegal.
In an embodiment, the step of determining whether the behavior of the person is illegal, and if so, the step of starting an alarm includes:
and when the action of the personnel is judged to be illegal, sending an action taking signal to the field security personnel to prompt the security personnel to take action.
In one embodiment, the step of sending an action taking signal to the on-site security personnel to prompt the security personnel to take action when it is determined that the personnel action is illegal comprises the following steps:
when the action of the personnel is judged to be illegal, an alarm in the monitoring room is started, and an action taking signal is sent to the field security personnel through the communicator so as to prompt the security personnel to take action; or,
when the action of the personnel is judged to be illegal, the on-site audible and visual alarm is started, and an action signal is sent to on-site security personnel to prompt the security personnel to take action.
In an embodiment, the determining whether the behavior of the person is illegal, and if so, after the step of starting an alarm, further includes:
and inputting the target face data into a pre-stored face database of the illegal action personnel to update the face database of the illegal action personnel.
In an embodiment, the step of acquiring monitoring image video data and identifying face image data in the monitoring image video data further includes:
acquiring face data of illegal behavior personnel, wherein the face data of the illegal behavior personnel comprises crime committing time information and crime committing position information;
and the face data of the illegal action personnel is arranged to obtain a face database of the illegal action personnel, and the face database of the illegal action personnel is stored.
To achieve the above object, the present invention further provides a monitoring data processing apparatus including a processor, a memory, and a monitoring data processing program stored on the memory and operable on the processor, the monitoring data processing program implementing the steps of the method as described above when executed by the processor.
To achieve the above object, the present invention further provides a readable storage medium storing a monitoring data processing program, which when executed by the processor, implements the steps of the creation method of the privilege space as described above.
The monitoring data processing device firstly adopts a face recognition technology to recognize collected monitoring image video data to obtain face image data, then carries out similarity comparison on the face image data obtained by recognition and a face image in a face database of a prestored illegal action person to obtain a similarity matching value through calculation, and if the similarity matching value is larger than a preset threshold value, marks the face image data as target face data and sends out a prevention alarm to remind security personnel to enhance the prevention consciousness; and then, acquiring tracking video images of the target face data, judging whether illegal behaviors exist in the acquired tracking video images, and immediately starting an alarm to prompt security personnel to take action if the illegal behaviors exist. Because the monitoring data processing device completes monitoring analysis based on the server system, compared with the existing mode based on manual monitoring analysis, the monitoring data processing device can effectively reduce the working strength of security personnel, reduce the manpower quantity and improve the working efficiency. Meanwhile, misjudgment or negligence of security personnel can be effectively avoided, and illegal behaviors can be more effectively prevented.
Drawings
Fig. 1 is a schematic diagram of a hardware configuration of a monitoring data processing apparatus according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a monitoring data processing method based on a monitoring data processing apparatus according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a monitoring data processing method according to a second embodiment of the present invention;
FIG. 4 is a flowchart illustrating a monitoring data processing method according to a third embodiment of the present invention;
FIG. 5 is a detailed flowchart of step S30 in a fourth embodiment of the monitoring data processing method according to the present invention;
fig. 6 is a flowchart illustrating a monitoring data processing method according to a fifth embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: collecting monitoring image video data, identifying face image data in the monitoring image video data, comparing the identified face image data with the face image data in a face database of a prestored illegal behavior person to obtain a similarity matching value through calculation, and if the similarity matching value is greater than a preset threshold value, sending out a prevention alarm and marking the identified face image data as target face data; and acquiring tracking video images of the target face data, judging whether illegal behaviors exist in the acquired tracking video images, and starting an alarm if the illegal behaviors exist.
The monitoring data processing method comprises the steps of firstly adopting a face recognition technology to recognize collected monitoring image video data to obtain face image data, then carrying out similarity comparison on the face image data obtained through recognition and face images in a face database of prestored illegal behavior personnel, calculating to obtain a similarity matching value, marking the face image data as target face data if the similarity matching value is larger than a preset threshold value, and sending out a prevention alarm to remind security personnel to enhance the prevention consciousness; and then, acquiring tracking video images of the target face data, judging whether illegal behaviors exist in the acquired tracking video images, and immediately starting an alarm to prompt security personnel to take action if the illegal behaviors exist. Because the invention is based on the server system to complete the monitoring analysis, compared with the existing mode based on artificial monitoring analysis, the invention can effectively reduce the working strength of security personnel, reduce the manpower quantity and improve the working efficiency. Meanwhile, misjudgment or negligence of security personnel can be effectively avoided, and illegal behaviors can be more effectively prevented.
As an implementation, the monitoring data processing apparatus may be as shown in fig. 1.
The embodiment of the invention relates to a monitoring data processing device, which comprises: a processor 101, e.g. a CPU, a memory 102, a communication bus 103. Wherein a communication bus 103 is used to enable the connection communication between these organizations.
The memory 102 may be a high-speed RAM memory or a non-volatile memory (e.g., a disk memory). As shown in fig. 1, a monitoring data processing program that monitors a data processing apparatus may be included in a memory 102 as a computer-readable storage medium; and the processor 101 may be configured to call the monitoring data processing program of the monitoring data processing apparatus stored in the memory 102, and perform the following operations:
collecting monitoring image video data, and identifying face image data in the monitoring image video data;
carrying out similarity comparison on the recognized face image data and face image data in a face database of a prestored illegal action person, calculating to obtain a similarity matching value, if the similarity matching value is greater than a preset threshold value, sending out a prevention alarm, and marking the recognized face image data as target face data;
and acquiring tracking video images of the target face data, judging whether illegal behaviors exist in the acquired tracking video images, and starting an alarm if the illegal behaviors exist.
In one embodiment, the processor 101 may be configured to call a program stored in the memory 102 and perform the following operations:
the prestored face database of the illegal action personnel comprises crime position information and crime time information of the illegal action personnel; the monitoring data processing method comprises the following steps:
collecting monitoring image video data, and identifying face image data in the monitoring image video data, wherein the identified face image data comprises collecting position information and collecting time information;
and comparing the similarity of the acquisition position information with the prisoner case position information, and/or comparing the similarity of the acquisition time information with the prisoner case time information, calculating to obtain a similarity matching value, and if the similarity matching value is greater than a preset threshold value, sending out a prevention alarm.
In one embodiment, the processor 101 may be configured to call a program stored in the memory 102 and perform the following operations:
the method comprises the following steps of collecting monitoring image video data, identifying face image data in the monitoring image video data, and acquiring position information and acquisition time information of the identified face image data, wherein the steps of:
acquiring the occurrence frequency of the face image data corresponding to the acquisition position information and/or the acquisition time information;
coding and sequencing the recognized face image data according to the appearance frequency of the face image data;
and comparing the similarity of the recognized face image data according to a coding sequence, calculating to obtain a similarity matching value, and sending out a prevention alarm if the similarity matching value is greater than a preset threshold value.
In one embodiment, the processor 101 may be configured to call a program stored in the memory 102 and perform the following operations:
the tracking video image acquisition of the target face data is carried out, whether illegal behaviors exist in the acquired tracking video image or not is judged, and if the illegal behaviors exist, the step of starting alarm comprises the following steps:
acquiring crime position information and crime time information corresponding to target face data from a face database of a prestored illegal action person;
tracking video image acquisition is carried out on target face data according to the crime position information and/or crime time information, and personnel behavior actions are identified and analyzed in the acquired tracking video images;
and judging whether the behavior action of the personnel is illegal or not, and starting an alarm if the behavior action of the personnel is illegal.
In one embodiment, the processor 101 may be configured to call a program stored in the memory 102 and perform the following operations:
the step of judging whether the behavior action of the person is illegal or not, and if the behavior action of the person is illegal, starting the alarm comprises the following steps:
and when the action of the personnel is judged to be illegal, sending an action taking signal to the field security personnel to prompt the security personnel to take action.
In one embodiment, the processor 101 may be configured to call a program stored in the memory 102 and perform the following operations:
when the action of the personnel is judged to be illegal, an action taking signal is sent to the on-site security personnel to prompt the security personnel to take action, and the steps comprise:
when the behavior action of the personnel is judged to be illegal, an alarm in the monitoring room is started, and a behavior taking signal is sent to the on-site security personnel through the communicator to prompt the security personnel to take action; or,
when the action of the personnel is judged to be illegal, the on-site audible and visual alarm is started, and an action signal is sent to on-site security personnel to prompt the security personnel to take action.
In one embodiment, the processor 101 may be configured to call a program stored in the memory 102 and perform the following operations:
and judging whether the behavior and the action of the personnel are illegal, if not, starting the alarm, and then further comprising the following steps:
and inputting the target face data into a pre-stored face database of the illegal action personnel to update the face database of the illegal action personnel.
In one embodiment, the processor 101 may be configured to call a program stored in the memory 102 and perform the following operations:
the step of collecting the monitoring image video data and identifying the face image data in the monitoring image video data further comprises the following steps:
acquiring face data of illegal behavior personnel, wherein the face data of the illegal behavior personnel comprises crime committing time information and crime committing position information;
and the face data of the illegal action personnel is arranged to obtain a face database of the illegal action personnel, and the face database of the illegal action personnel is stored.
According to the scheme, the monitoring data processing device firstly identifies the collected monitoring image video data by adopting a face identification technology to obtain face image data, then compares the identified face image data with the face images in the face database of the prestored illegal behavior personnel in similarity, calculates to obtain a similarity matching value, marks the face image data as target face data if the similarity matching value is larger than a preset threshold value, and sends out a prevention alarm to remind the working personnel to enhance the precaution consciousness. And then, acquiring tracking video images of the target face data, judging whether illegal behaviors exist in the acquired tracking video images, and immediately starting an alarm to prompt security personnel to take action if the illegal behaviors exist. Because the monitoring data processing device completes monitoring analysis based on the server system, compared with the existing mode based on manual monitoring analysis, the monitoring data processing device can effectively reduce the working strength of security personnel, reduce the manpower quantity and improve the working efficiency. Meanwhile, misjudgment or negligence of security personnel can be effectively avoided, and illegal behaviors are more effectively prevented.
Based on the hardware architecture of the monitoring data processing device, the embodiment of the monitoring data processing method of the monitoring data processing device is provided.
With reference to fig. 2, fig. 2 shows a first embodiment of the method of the invention, comprising the steps of:
and S10, collecting monitoring image data and identifying the face image data in the monitoring image data.
The execution main body of the invention is a monitoring data processing device which comprises a background data processing server and a plurality of cameras electrically connected with the background data processing server. The monitoring image data may include picture data, video data, or image video data. The system comprises a background data processing server, a human face recognition unit and a human face recognition unit, wherein the camera is arranged at each position of a public place, the camera can shoot and collect image data in continuous time periods and transmit the image data to the background data processing server, the server receives the collected monitoring image video data, the recognition unit can recognize the monitoring image video data by using a human face recognition technology, and the human face image data are obtained through recognition. When the human face is identified, if the distance between a person in a shot video image and the camera is far, the person image picture in the video image is small and is not easy to identify, and the video image can be magnified in a zooming manner at the moment so as to clearly and quickly identify the human face image data. The identified face image data comprises face part feature information, appearing position information, appearing time information, appearing frequency in the same position area in preset time and the like.
And step S20, carrying out similarity comparison on the recognized face image data and face image data in a face database of a prestored illegal action person, calculating to obtain a similarity matching value, sending out a prevention alarm if the similarity matching value is greater than a preset threshold value, and marking the recognized face image data as target face data.
The face database of the illegal action personnel can be used for inputting the face image data of the illegal action personnel into the database in advance through the registration unit of the background data processing server, wherein the face image data of the illegal action personnel comprises face part feature information, crime position information and crime time information. Comparing the face image data obtained by face recognition with the face image data of the illegal behavior personnel in the database by one-to-one similarity, calculating to obtain a similarity matching value, and judging the size of the similarity matching value and a preset threshold, wherein the similarity matching value can be the ratio of the two or the relative error of the two, the preset threshold is set according to different calculation modes, and it can be understood that when the similarity matching value is the ratio of the two, the preset threshold can be more than 90%, such as 91% or 99%; when the similarity match value is a relative error between the two, the preset threshold may be less than 1%, such as 0.01%, 0.1%. And the user inputs the preset threshold value after setting in advance and prestores the preset threshold value into the background server. The comparison process can be that face image data which is consistent with crime position information of illegal action personnel is found out firstly, and then whether the face part feature information of the face image data and the crime position feature information of the illegal action personnel are matched in similarity or not is further judged; or the face image data which is consistent with the crime time information of the illegal action personnel is found out firstly, and then whether the face part characteristics of the face image data and the crime time information of the illegal action personnel are matched in similarity or not is further judged, so that the comparison process can be simplified, the comparison time is saved, and the target face data can be screened out more quickly. If the similarity matching value after comparison is larger than a preset threshold value, the recognized face image data is judged as target face data, the target face data is marked, a prevention alarm is immediately sent out, and when the security personnel receive the preset alarm, the personnel corresponding to the marked target face data are subjected to key monitoring observation. Therefore, only one security worker is required to watch and monitor before the data processing device is monitored, and the workload of the security worker can be effectively reduced.
And step S30, acquiring tracking video images of the target face data, judging whether illegal behaviors exist in the acquired tracking video images, and starting an alarm if the illegal behaviors exist.
The method comprises the steps that a collecting unit in a monitoring data processing device collects tracking video images of target face data, a camera is switched continuously to shoot a path video image of a target person, the shot path video image is sent to the collecting unit, then the collecting unit sends the path video image to an analyzing unit, the analyzing unit receives the video image and conducts behavior analysis on the video image, and the behavior analysis mainly refers to limb actions of the person. And if the fact that the body action of the person in the video image has illegal behaviors is analyzed, an alarm is immediately started to prompt security personnel to take action.
It should be noted that if an illegal case such as theft often occurs in a certain area, the area can be marked as a target area, a camera is switched to the area at different time and different angles to capture video images, the frequency of the target for distinguishing face image data is identified and counted, the face image data of the illegal acting person is compared according to the frequency of the face image data, only when the identified face image data is matched with the face image data of the illegal acting person, tracking video image acquisition is performed, and whether the illegal case exists is further judged; otherwise, the tracking image acquisition is not continued. It will be appreciated that the person who frequently enters the target area may be a resident or a worker in the area, for whom tracking and follow-up operations are not to be continued. Therefore, the expense of the background server can be greatly saved, and the workload of security personnel is greatly reduced.
In the technical scheme provided by this embodiment, the monitoring data processing device firstly identifies the collected monitoring image video data by adopting a face identification technology to obtain face image data, then compares the identified face image data with a face image in a face database of a prestored illegal action person to obtain a similarity matching value through calculation, and if the similarity matching value is greater than a preset threshold value, marks the face data as target face data and sends out a prevention alarm to remind security personnel to enhance the prevention consciousness. And then, tracking video image acquisition is carried out on the target face data, whether illegal behaviors exist in the acquired video images is judged, and if the illegal behaviors exist, an alarm is immediately started to prompt security personnel to take action. Because the monitoring data processing device completes monitoring analysis based on the server system, compared with the existing mode based on manual monitoring analysis, the monitoring data processing device can effectively reduce the working strength of security personnel, reduce the manpower quantity and improve the working efficiency. Meanwhile, misjudgment or negligence of security personnel can be effectively avoided, and illegal behaviors are more effectively prevented.
Referring to fig. 3, fig. 3 is a second embodiment of the monitoring data processing method based on the monitoring data processing apparatus according to the present invention, and based on the first embodiment, the pre-stored face database of the illegal action person includes crime position information and crime time information of the illegal action person; the monitoring data processing method comprises the following steps:
s11, collecting monitoring image video data, and identifying face image data in the monitoring image video data, wherein the identified face image data comprises collection position information and collection time information;
and S21, comparing the similarity of the collected position information with the prisoner case position information, and/or comparing the similarity of the collected time information with the prisoner case time information, calculating to obtain a similarity matching value, and if the similarity matching value is greater than a preset threshold value, sending out a prevention alarm.
As an embodiment, step S10 includes step S11, acquiring acquisition position information and acquisition time information in the recognized face image data. Specifically, the acquisition position information is determined according to the position of a camera which shoots the face image during acquisition, and the acquisition time information is determined according to the shooting time during acquisition.
As an embodiment, the step S20 includes a step S21 of comparing the collected position information and the collected time information with the crime position information and the crime time information, which may be comparing the collected position information with the crime position information of the illegal action person, or comparing the collected time information with the crime time information of the illegal action person, or comparing the collected position information and the collected time information with the crime position information and the crime time information of the illegal action person in sequence, and calculating a similar matching value. The similarity matching value may be a ratio of the two or a relative error of the two, and the preset threshold is set according to different calculation manners, and it can be understood that, when the ratio of the two is calculated, the preset threshold may be greater than 90%, such as 91% or 99%; when calculating the relative error between the two, the preset threshold may be less than 1%, such as 0.01%, 0.1%. And when the similarity matching value of at least one of the collected position information or the collected time information is greater than a preset threshold value, a prevention alarm is sent out to remind security personnel to enhance prevention consciousness.
Referring to fig. 4, fig. 4 is a third embodiment of the monitoring data processing method based on the monitoring data processing apparatus according to the present invention, and based on the second embodiment, after step S11, the method further includes:
s12, acquiring the occurrence frequency of the face image data corresponding to the acquisition position information and/or the acquisition time information;
s13, coding and sequencing the recognized face image data according to the appearance frequency of the face image data;
and S22, sequentially carrying out similarity comparison on the recognized face image data according to a coding sequence, calculating to obtain a similarity matching value, and sending out a prevention alarm if the similarity matching value is greater than a preset threshold value.
As an embodiment, step S12 includes obtaining an appearance frequency of face image data corresponding to the acquisition position information, or obtaining an appearance frequency of face image data corresponding to the acquisition time information, or obtaining an appearance frequency of face image data corresponding to both the acquisition position information and the acquisition time information.
And then coding and sorting are carried out according to the occurrence frequency of the obtained face image data, then the similarity of the face part characteristic information in the corresponding face image data and the face part characteristic information of the illegal behavior personnel is compared in sequence according to the coding and sorting, a similarity matching value is obtained through calculation, and if the similarity matching value is larger than a preset threshold value, the target face data is recorded. The method is adopted to screen and obtain the target face data, and is quick and accurate.
Referring to fig. 5, fig. 5 is a fourth embodiment of the monitoring data processing method based on the monitoring data processing apparatus according to the present invention, and based on the first to third embodiments, step S30 includes:
step S31, acquiring crime position information and crime time information corresponding to target face data from a prestored face database of the illegal action personnel;
step S32, tracking video image acquisition is carried out on the target face data according to the crime position information and/or crime time information, and personnel behavior actions are identified and analyzed in the acquired tracking video image;
and step S33, judging whether the personnel behavior action is illegal or not, and starting an alarm if the personnel behavior action is illegal.
In the embodiment, after the target face data is determined, the crime position information and crime time information corresponding to the target face data are obtained according to the face image database of the illegal action personnel, then tracking video image acquisition is carried out through the camera positioned at the crime position according to the crime position information and the crime time information, action actions of personnel in the video image corresponding to the crime time information are observed at the same time, whether the action actions are illegal or not is judged according to the action actions of the personnel, and if the action is illegal, an alarm is started immediately to prompt the security personnel nearby to stop the illegal action. Therefore, whether the personnel behaviors are illegal or not can be judged quickly and accurately, and the illegal behaviors can be effectively prevented. In addition, when the person behavior is judged to be illegal, an action taking signal can be sent to the security personnel, specifically, the security personnel can be notified of the illegal behavior place and the person condition in a telephone or short message mode, and the security personnel can arrive at the site immediately after receiving the notification to stop the illegal behavior.
Step S33 includes: and when the action of the personnel is judged to be illegal, sending an action taking signal to the field security personnel to prompt the security personnel to take action.
As an embodiment of step S33, when it is determined that the personnel action is illegal, an alarm in the monitoring room is activated, and a signal of taking action is sent to the security personnel on site through the communicator, so as to prompt the security personnel to take action. Here indoor alarm and communicator are with monitoring data processing apparatus electric connection, when judging that personnel's action exists illegally, start the alarm in the control room, and the communicator can be with taking action signal transmission to on-the-spot security personnel. Or when the security protection personnel in the monitoring room receives the sound of the alarm, the security protection personnel on site are informed of the place of the illegal behavior in a wireless communication mode, and the security protection personnel nearby can immediately arrive at the site after hearing the sound to prevent the illegal behavior.
As another embodiment of the step S33, when the person behavior action is judged to be illegal, a field audible and visual alarm is started, and an action taking signal is sent to field security personnel to prompt the security personnel to take action. When the behavior of the person is judged to be illegal, a site sound alarm is started, and the security personnel nearby hear the sound alarm and then immediately arrive at the site to stop the illegal behavior. Or when the behavior action of the personnel is judged to be illegal, the site light alarm is started, and the security personnel nearby can immediately arrive at the site to stop the illegal behavior after seeing the light alarm. If the illegal action occurs in an indoor area, a field audible and visual alarm can be started, and the entrance guard or other outgoing passages are temporarily controlled to be locked so as to prevent the person from escaping from the field after hearing the alarm sound, so that the operation can well realize automatic security and protection.
In addition, if the illegal behavior is analyzed and the alarm is started, the security personnel are not at the position of the security personnel, and the video image can be called as the crime evidence of the illegal behavior personnel afterwards, so that the public security bureau can obtain evidence conveniently.
Further, step S33 is followed by: and inputting the target face data into a pre-stored face database of the illegal action personnel to update the face database of the illegal action personnel. Therefore, the comprehensiveness of the face data of the illegal action personnel can be ensured.
Referring to fig. 6, fig. 6 is a fifth embodiment of the monitoring data processing method based on the monitoring data processing apparatus of the present invention, and based on the first embodiment to the fourth embodiment, the method further includes before step S10:
step S01, obtaining face data of illegal action personnel, wherein the face data of the illegal action personnel comprises crime committing time information and crime committee position information;
and S02, the face data of the illegal behavior personnel is sorted to obtain a face database of the illegal behavior personnel, and the face database of the illegal behavior personnel is stored.
The face image data in the face database of the illegal action person can be obtained from a public security system, and can also be the illegal action person identified by the monitoring data processing device. The face image data comprises face part feature data, crime making time information and crime making position information of the illegal action personnel, the face part feature data, the crime making time information and the crime making position information are correlated, and the information is recorded into a face database of the illegal action personnel through a registration unit of the background server for subsequent similarity comparison and use.
In order to achieve the above object, the present invention further provides a monitoring data processing apparatus, which includes a processor, a memory, and a monitoring data processing program stored on the memory and operable on the processor, and when executed by the processor, the monitoring data processing program implements the steps of the monitoring data processing method according to the above embodiment.
To achieve the above object, the present invention further provides a readable storage medium storing a monitoring data processing program, which when executed by the processor, implements the steps of the monitoring data processing method according to the above embodiment.
The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages and disadvantages of the embodiments.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of other like elements in a process, method, article, or system comprising the element.
Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method of the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better implementation. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a computer-readable storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above, and includes several instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (8)
1. A monitoring data processing method is characterized by comprising the following steps:
collecting monitoring image video data, and identifying face image data in the monitoring image video data;
carrying out similarity comparison on the recognized face image data and face image data in a face database of a prestored illegal action person, calculating to obtain a similarity matching value, if the similarity matching value is greater than a preset threshold value, sending out a prevention alarm, and marking the recognized face image data as target face data;
acquiring tracking video images of the target face data, judging whether illegal behaviors exist in the acquired tracking video images, and starting an alarm if the illegal behaviors exist;
the step of issuing a precautionary alarm includes: collecting monitoring image video data, and identifying face image data in the monitoring image video data, wherein the identified face image data comprises collecting position information and collecting time information; acquiring the occurrence frequency of the face image data corresponding to the acquisition position information and/or the acquisition time information; coding and sequencing the identified face image data according to the occurrence frequency of the face image data; and comparing the similarity of the recognized face image data according to a coding sequence, calculating to obtain a similarity matching value, and sending out a prevention alarm if the similarity matching value is greater than a preset threshold value.
2. The monitoring data processing method according to claim 1, wherein the step of collecting the tracking video image of the target face data and judging whether there is an illegal action in the collected tracking video image, and if there is an illegal action, the step of starting an alarm comprises:
obtaining crime position information and crime time information corresponding to target face data from a pre-stored face database of the illegal action personnel;
tracking video image acquisition is carried out on target face data according to the crime position information and/or crime time information, and personnel behavior actions are identified and analyzed in the acquired tracking video images;
and judging whether the behavior action of the personnel is illegal or not, and starting an alarm if the behavior action of the personnel is illegal.
3. The monitoring data processing method according to claim 2, wherein the step of judging whether the behavior action of the person is illegal, and if so, the step of starting an alarm comprises the steps of:
when the action of the personnel is judged to be illegal, an action taking signal is sent to the field security personnel ， To prompt security personnel to take action.
4. The monitoring data processing method according to claim 3, wherein when it is determined that the human behavior action is illegal, an action taking signal is sent to a field security personnel ， The steps of prompting security personnel to take action include:
when the behavior action of the personnel is judged to be illegal, an alarm in the monitoring room is started, and a behavior taking signal is sent to the on-site security personnel through the communicator to prompt the security personnel to take action; or,
when the action of the personnel is judged to be illegal, a field audible and visual alarm is started, and an action signal is sent to field security personnel to prompt the security personnel to take action.
5. The monitoring data processing method according to claim 2, wherein the step of determining whether the behavior of the person is illegal, and if so, the step of starting an alarm further comprises:
and inputting the target face data into a pre-stored face database of the illegal action personnel to update the face database of the illegal action personnel.
6. The monitored data processing method according to claim 1, wherein said step of acquiring video data of a monitored image and identifying facial image data in said video data of a monitored image further comprises:
acquiring face data of illegal behavior personnel, wherein the face data of the illegal behavior personnel comprises crime committing time information and crime committing position information;
and the face data of the illegal action personnel is collated to obtain a face database of the illegal action personnel, and the face database of the illegal action personnel is stored.
7. A monitoring data processing apparatus, characterized in that the monitoring data processing apparatus comprises a processor, a memory and a monitoring data processing program stored on the memory and executable on the processor, which monitoring data processing program, when executed by the processor, implements the steps of the monitoring data processing method according to any one of claims 1-6.
8. A readable storage medium, characterized in that the readable storage medium stores a monitoring data processing program which, when executed by a processor, implements the steps of the monitoring data processing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910534159.4A CN110245630B (en) | 2019-06-18 | 2019-06-18 | Monitoring data processing method and device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910534159.4A CN110245630B (en) | 2019-06-18 | 2019-06-18 | Monitoring data processing method and device and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110245630A CN110245630A (en) | 2019-09-17 |
| CN110245630B true CN110245630B (en) | 2023-02-17 |
Family
ID=67888245
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910534159.4A Active CN110245630B (en) | 2019-06-18 | 2019-06-18 | Monitoring data processing method and device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110245630B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110781750A (en) * | 2019-09-25 | 2020-02-11 | 万翼科技有限公司 | Dangerous person monitoring processing method and device, computer equipment and storage medium |
| CN112825553A (en) * | 2019-11-21 | 2021-05-21 | 北京声智科技有限公司 | Monitoring system, method, device, equipment and medium |
| CN111325139B (en) * | 2020-02-18 | 2023-08-04 | 浙江大华技术股份有限公司 | Lip language identification method and device |
| CN111414517B (en) * | 2020-03-26 | 2023-05-19 | 成都市喜爱科技有限公司 | Video face analysis method, device and server |
| CN111738053B (en) * | 2020-04-15 | 2022-04-01 | 上海摩象网络科技有限公司 | Tracking object determination method and device and handheld camera |
| CN111652074B (en) * | 2020-05-09 | 2022-11-08 | 山东浪潮科学研究院有限公司 | Face recognition method, device, equipment and medium |
| CN111767816A (en) * | 2020-06-22 | 2020-10-13 | 苏州交驰人工智能研究院有限公司 | Abnormity prompting method, device, equipment and storage medium |
| CN111753756A (en) * | 2020-06-28 | 2020-10-09 | 浙江大华技术股份有限公司 | Object identification-based deployment alarm method and device and storage medium |
| CN112016526B (en) * | 2020-10-16 | 2021-02-09 | 金税信息技术服务股份有限公司 | Behavior monitoring and analyzing system, method, device and equipment for site activity object |
| CN112911142B (en) * | 2021-01-15 | 2022-02-25 | 珠海格力电器股份有限公司 | Image processing method, image processing apparatus, non-volatile storage medium, and processor |
| CN113194281B (en) * | 2021-01-27 | 2024-04-26 | 广东建邦计算机软件股份有限公司 | Video parsing method, device, computer equipment and storage medium |
| CN112906660A (en) * | 2021-03-31 | 2021-06-04 | 浙江大华技术股份有限公司 | Security check early warning method and device, storage medium and electronic equipment |
| CN114038029B (en) * | 2021-10-08 | 2024-10-15 | 浙江大华技术股份有限公司 | Method, device, equipment and medium for identifying offensive athlete |
| CN117115755B (en) * | 2023-10-23 | 2024-01-23 | 科曼智能科技有限公司 | Power operation site violation monitoring alarm recognition system based on image recognition |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101401426A (en) * | 2006-03-15 | 2009-04-01 | 欧姆龙株式会社 | Tracking device, tracking method, tracking device control program, and computer-readable recording medium |
| CN103246869A (en) * | 2013-04-19 | 2013-08-14 | 福建亿榕信息技术有限公司 | Crime monitoring method based on face recognition technology and behavior and sound recognition |
| JP2013235329A (en) * | 2012-05-07 | 2013-11-21 | Taiwan Colour & Imaging Technology Corp | Face identification monitoring/management method |
| CN108874911A (en) * | 2018-05-28 | 2018-11-23 | 广西师范学院 | Suspect's position predicting method based on regional environment Yu crime dramas data |
| CN109145714A (en) * | 2018-07-02 | 2019-01-04 | 深圳云感物联网科技有限公司 | A kind of identification of facial image carries out tracking and early warning method to emphasis control personnel |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA3060189C (en) * | 2011-05-12 | 2021-09-21 | Solink Corporation | Video analytics system |
| CN104318217A (en) * | 2014-10-28 | 2015-01-28 | 吴建忠 | Face recognition information analysis method and system based on distributed cloud computing |
| CN108038422B (en) * | 2017-11-21 | 2021-12-21 | 平安科技（深圳）有限公司 | Camera device, face recognition method and computer-readable storage medium |
| CN109543513A (en) * | 2018-10-11 | 2019-03-29 | 平安科技（深圳）有限公司 | Method, apparatus, equipment and the storage medium that intelligent monitoring is handled in real time |
-
2019
- 2019-06-18 CN CN201910534159.4A patent/CN110245630B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101401426A (en) * | 2006-03-15 | 2009-04-01 | 欧姆龙株式会社 | Tracking device, tracking method, tracking device control program, and computer-readable recording medium |
| JP2013235329A (en) * | 2012-05-07 | 2013-11-21 | Taiwan Colour & Imaging Technology Corp | Face identification monitoring/management method |
| CN103246869A (en) * | 2013-04-19 | 2013-08-14 | 福建亿榕信息技术有限公司 | Crime monitoring method based on face recognition technology and behavior and sound recognition |
| CN108874911A (en) * | 2018-05-28 | 2018-11-23 | 广西师范学院 | Suspect's position predicting method based on regional environment Yu crime dramas data |
| CN109145714A (en) * | 2018-07-02 | 2019-01-04 | 深圳云感物联网科技有限公司 | A kind of identification of facial image carries out tracking and early warning method to emphasis control personnel |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110245630A (en) | 2019-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110245630B (en) | Monitoring data processing method and device and readable storage medium | |
| CN110491004B (en) | Resident community personnel safety management system and method | |
| CN109166261B (en) | Image processing method, device and equipment based on image recognition and storage medium | |
| CN211293956U (en) | AI-based identification and alarm system for abnormal agent on construction site | |
| US10949657B2 (en) | Person's behavior monitoring device and person's behavior monitoring system | |
| CN109002786B (en) | Face detection method, face detection equipment and computer-readable storage medium | |
| CN109214779A (en) | Construction site information managing and control system | |
| CN108540752B (en) | Method, device and system for identifying target object in video monitoring | |
| KR20110130033A (en) | Active image monitoring system using motion pattern database, and method thereof | |
| CN111860152A (en) | Method, system, equipment and computer equipment for detecting personnel state | |
| US10419728B2 (en) | Monitoring system having personal information protection function and method thereof | |
| CN110246292B (en) | Household video monitoring method, device and storage medium | |
| CN111985428A (en) | Security detection method and device, electronic equipment and storage medium | |
| CN114937237A (en) | Construction site safety monitoring method and system based on AI intelligent identification | |
| CN112818758A (en) | Monitoring method, system and device for electric power construction site and storage medium | |
| CN111539338A (en) | Pedestrian mask wearing control method, device, equipment and computer storage medium | |
| CN110544362A (en) | Construction site anomaly identification method and device based on block chain | |
| CN110543866A (en) | Safety management system and method for capital construction engineering constructors | |
| CN110796776A (en) | Intelligent access control system and control method thereof | |
| CN113343913A (en) | Target determination method, target determination device, storage medium and computer equipment | |
| CN110751125A (en) | Wearing detection method and device | |
| CN111629184A (en) | Video monitoring alarm system and method capable of identifying personnel in monitoring area | |
| CN115457449A (en) | Early warning system based on AI video analysis and monitoring security protection | |
| CN113971782A (en) | Comprehensive monitoring information management method and system | |
| KR20200059643A (en) | ATM security system based on image analyses and the method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |