CN112104837A - Intelligent behavior analysis system applied to school places - Google Patents
Intelligent behavior analysis system applied to school places Download PDFInfo
- Publication number
- CN112104837A CN112104837A CN201910529438.1A CN201910529438A CN112104837A CN 112104837 A CN112104837 A CN 112104837A CN 201910529438 A CN201910529438 A CN 201910529438A CN 112104837 A CN112104837 A CN 112104837A
- Authority
- CN
- China
- Prior art keywords
- module
- human
- school
- monitoring
- actions
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/22—Status alarms responsive to presence or absence of persons
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Signal Processing (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses an intelligent behavior analysis system applied to school places, which comprises a collection end, an NVR (network video recorder), a server end and an output end, wherein the collection end is communicated with a local area network; the acquisition end comprises a monitoring camera, an infrared sensor, a smoke sensor and a temperature sensor which are arranged in each area of a school place; the output end comprises a monitoring screen, a remote client and an alarm sound which are arranged in a monitoring room; the system mainly analyzes school places in real time through monitoring video streams, and based on a human body skeleton structure, various abnormal behaviors defined according to motion tracks are immediately judged and screen popping alarms are sent as long as actions of people and rules of other people in a scene change, and a worker does not need to observe a plurality of monitoring pictures in a monitoring room at any time.
Description
Technical Field
The invention relates to a monitoring system for identifying special behaviors and objects, in particular to an intelligent behavior analysis system applied to school places.
Background
In the school site, a video monitoring system is installed to monitor the site, so that the daily monitoring of the school is facilitated, the safety of students in the school is guaranteed, the students can be timely handled when special events occur, the things which occur to school staff in the school site are recorded, objective and powerful evidence is provided for the checking and verification of events in the future, in the practical application of the monitoring system, the real-time monitoring of the school site, the prevention of the special events and the timely handling of emergency alarms are required to be realized, a plurality of monitoring pictures are required to be constantly observed by workers in a monitoring room, the spirit of the observers is greatly consumed, the attention of the observers is easily lost, if an emergency occurs, the workers are difficult to find in the plurality of monitoring pictures, the events cannot be timely handled, the situation is upgraded, the normal order in the school is influenced, and bad influence is brought to the students, and even affect the safety of the student at school.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention provides an intelligent behavior analysis system applied to school sites.
The technical scheme adopted by the invention for solving the technical problems is as follows:
an intelligent behavior analysis system applied to school places is characterized by comprising an acquisition end, a server end and an output end, wherein the acquisition end, the server end and the output end are communicated with a local area network;
the acquisition end comprises a monitoring camera, an infrared sensor, a smoke sensor and a temperature sensor which are arranged in each area of a school place;
the output end comprises a monitoring screen arranged in a monitoring room, remote client ends arranged at all posts for receiving alarm information and alarm sound boxes arranged at all places of a school;
the server side includes:
an information processing module: the system comprises a human figure distinguishing module, a human face recognition module and an object recognition module, wherein the human figure distinguishing module is used for distinguishing human figures from human faces;
a figure judging module: the image capturing module is used for judging and sketching figure image data in a captured image and sending the judged data to the object identification module and the skeleton construction module;
an object identification module: the system comprises a snapshot module, a human figure judging module, an alarm processing module and a human body recognition module, wherein the snapshot module is used for capturing a snapshot image or human figure image data sent by the human figure judging module, recognizing a specific article and a wearing article of a human body, generating alarm information and sending the alarm information to the alarm processing module; a framework construction module: the human body skeleton data generating module is used for processing the human figure image, generating human body skeleton data and sending the human body skeleton data to the behavior analysis module; a behavior analysis module: a behavior action database is stored and used for arranging the received human body skeleton data according to time sequence, identifying the behavior action of the human body skeleton, comparing the behavior action database with the behavior action database, generating alarm information and sending the alarm information to an alarm processing module, and meanwhile sending the captured image to the face recognition module for face recognition; an alarm processing module: and the alarm information is used for receiving and processing the alarm information of character behaviors, face recognition and object recognition, and the generated alarm content and video pictures are sent to the output end.
The behavior actions comprise limb actions, skeleton actions, time actions and people number actions;
the limb actions include: asking for help, putting on a shelf and falling down;
the skeletal actions include: breaking in and climbing;
the time action includes: off duty, sleeping, off duty, loitering, staying;
the number of people actions includes: and (5) gathering people.
The installation position of the acquisition end comprises a public area, a perimeter area and a duty station.
The server side further comprises a streaming media server, and the video streams collected by the monitoring cameras are all sent to the streaming media server and are uniformly sent to the information processing module by the streaming media server.
The invention has the beneficial effects that: the system comprises a collection end, a server end and an output end which are communicated with a local area network, wherein the server end comprises an information processing module, a person distinguishing module, a skeleton building module, an object recognition module, a face recognition module, a behavior analysis module and an alarm processing module, the system mainly analyzes school places in real time through monitoring video streams, and based on a human body skeleton structure, various abnormal behaviors defined according to motion tracks are immediately judged and screen popping alarms are sent out as long as actions of persons and rules of other persons in a scene change, and a worker does not need to observe a plurality of monitoring pictures in a monitoring room constantly.
Drawings
The invention is further illustrated with reference to the following figures and examples.
FIG. 1 is a system block diagram of the present invention.
Detailed Description
Referring to fig. 1, an intelligent behavior analysis system applied to school places comprises a collection end, an NVR video recorder, a server end and an output end, wherein the collection end is communicated with a local area network; the acquisition end comprises a monitoring camera, an infrared sensor, a smoke sensor and a temperature sensor which are arranged in each area of a school place; the output end comprises a monitoring screen arranged in a monitoring room, remote client ends arranged at all posts and used for receiving alarm information, and alarm sound boxes arranged at all places of a school, when the system detects abnormality, the abnormal video picture can be immediately displayed on the monitoring screen in a popup mode, and other remote client ends can synchronously receive the alarm information; the NVR video recorder is placed in a monitoring room and controls and manages the monitoring camera, and pictures collected by the monitoring camera on one hand transmit a main code stream to the NVR video recorder for storage through a local area network and on the other hand transmit a sub code stream to the server side for behavior analysis; the monitoring camera is a 500-ten-thousand-pixel infrared integrated zooming intelligent AI behavior acquisition speed dome (the model is DX-XJ40Q5-I), the server side is a 4U rack type high-performance GPU server, analysis of 16 paths, 32 paths, 64 paths or customized multi-path video streams is supported, and the monitoring camera has a storage function.
The server side includes:
an information processing module: the system comprises a human figure distinguishing module, a human face recognition module and an object recognition module, wherein the human figure distinguishing module is used for distinguishing human figures from human faces;
a figure judging module: the image capturing module is used for judging and sketching figure image data in a captured image and sending the judged data to the object identification module and the skeleton construction module;
an object identification module: the system comprises a snapshot module, a human figure judging module, an alarm processing module and a human body recognition module, wherein the snapshot module is used for capturing a snapshot image or human figure image data sent by the human figure judging module, recognizing a specific article and a wearing article of a human body, generating alarm information and sending the alarm information to the alarm processing module; a face recognition module: the face recognition module is used for carrying out face recognition on the captured image, generating alarm information and sending the alarm information to the alarm processing module, and the face information of students and school workers is stored in the alarm processing module;
a framework construction module: the human body skeleton data generating module is used for processing the human figure image, generating human body skeleton data and sending the human body skeleton data to the behavior analysis module; a behavior analysis module: a behavior action database is stored and used for arranging the received human body skeleton data according to time sequence, identifying the behavior action of the human body skeleton, comparing the behavior action database with the behavior action database, generating alarm information and sending the alarm information to an alarm processing module, and meanwhile sending the captured image to the face recognition module for face recognition; an alarm processing module: the alarm information is used for receiving and processing the alarm information of character behaviors, face recognition and object recognition, and the generated alarm content and video pictures are sent to the output end; the system mainly analyzes school places in real time through monitoring video streams, based on a human body skeleton structure, according to various abnormal behaviors defined by motion tracks, as long as actions of people and rules of other people in a scene change, the abnormal behaviors are immediately judged and screen popping alarms are sent out, and workers do not need to observe a plurality of monitoring pictures in a monitoring room at any time.
The module software and hardware combination technology of the information processing module, the person distinguishing module, the face recognition module, the object recognition module, the skeleton construction module, the behavior analysis module and the alarm processing module is the prior art, the information processing module of video monitoring and sensing information processing is described in the patent document of "a campus wireless video monitoring system" with the publication number of "CN 105791772A", the object recognition module of matching, recognizing and recording the object of the monitoring image shot by the camera shooting device is described in the patent document of "video monitoring method, system and camera shooting monitoring system" with the publication number of "CN 104902229A", the device of constructing the human skeleton recognition behavior by the photographic image is described in the patent document of "human skeleton behavior recognition method and device based on deep reinforcement learning" with the publication number of "CN 108304795A", and the server can be used as a function integration platform in the actual use, the system can be connected with various control devices with data providing capability, such as relays and access control devices, received data are uniformly identified and processed by the information processing module, and subordinate hardware devices installed in school places are uniformly monitored and managed, so that all module devices of the whole system can operate efficiently and cooperatively.
The behavior actions comprise limb actions, skeleton actions, time actions and people number actions;
the limb actions include: asking for help, putting on a shelf, falling down, and waving hands by holding the camera to define as asking for help; two or more people alternately pinch, twist, push the soil and the like to define a big fighting frame; when the head, the buttocks and the feet of the person are positioned on the same plane and are parallel to the ground, the person falls;
the skeletal actions include: breaking in and climbing; the scene picture with limited intrusion is defined as intrusion when a person is detected; climbing is defined when both feet leave the bottom surface and climb upwards;
the time action includes: off duty, sleeping, off duty, loitering, staying; the person on duty leaves the duty position for more than the specified time and is defined as leaving the duty; defining the person on duty as sleeping duty when the person on duty sleeps for more than a specified time; if no person is on duty for a long time, the duty-off position is defined as the off-duty position; walking back and forth in a specific area, and wandering is defined as how long the person walks; the retention of people occurs in a specific area, and the retention is defined as the retention time when the retention time exceeds the specific area; the number of people actions includes: gathering people; the number of the people gathering in the picture exceeds the number set by the system, and the people gathering is defined as the crowd.
The installation position of the acquisition end comprises a public area, a perimeter area and a duty post, different areas correspond to different behavior actions, different behavior actions can be customized according to different areas, and detection of different areas on different behavior actions is achieved.
The server side further comprises a streaming media server, the video streams collected by the monitoring cameras are all sent to the streaming media server, and the streaming media server sends the video streams to the NVR video recorder and the information processing module in a unified mode, so that the complexity of the system architecture is avoided.
The above embodiments do not limit the scope of the present invention, and those skilled in the art can make equivalent modifications and variations without departing from the overall concept of the present invention.
Claims (4)
1. An intelligent behavior analysis system applied to school places is characterized by comprising an acquisition end, a server end and an output end, wherein the acquisition end, the server end and the output end are communicated with a local area network;
the acquisition end comprises a monitoring camera, an infrared sensor, a smoke sensor and a temperature sensor which are arranged in each area of a school place;
the output end comprises a monitoring screen arranged in a monitoring room, remote client ends arranged at all posts for receiving alarm information and alarm sound boxes arranged at all places of a school;
the server side includes:
an information processing module: the system comprises a human figure distinguishing module, a human face recognition module and an object recognition module, wherein the human figure distinguishing module is used for distinguishing human figures from human faces;
a figure judging module: the image capturing module is used for judging and sketching figure image data in a captured image and sending the judged data to the object identification module and the skeleton construction module;
an object identification module: the system comprises a snapshot module, a human figure judging module, an alarm processing module and a human body recognition module, wherein the snapshot module is used for capturing a snapshot image or human figure image data sent by the human figure judging module, recognizing a specific article and a wearing article of a human body, generating alarm information and sending the alarm information to the alarm processing module;
a framework construction module: the human body skeleton data generating module is used for processing the human figure image, generating human body skeleton data and sending the human body skeleton data to the behavior analysis module;
a behavior analysis module: a behavior action database is stored and used for arranging the received human body skeleton data according to time sequence, identifying the behavior action of the human body skeleton, comparing the behavior action database with the behavior action database, generating alarm information and sending the alarm information to an alarm processing module, and meanwhile sending the captured image to the face recognition module for face recognition;
an alarm processing module: and the alarm information is used for receiving and processing the alarm information of character behaviors, face recognition and object recognition, and the generated alarm content and video pictures are sent to the output end.
2. The intelligent behavior analysis system applied to school property according to claim 1, wherein said behavior actions include limb actions, bone actions, time actions, and people number actions;
the limb actions include: asking for help, putting on a shelf and falling down;
the skeletal actions include: breaking in and climbing;
the time action includes: off duty, sleeping, off duty, loitering, staying;
the number of people actions includes: and (5) gathering people.
3. The intelligent behavior analysis system applied to school property as claimed in claim 1, wherein the installation location of said collection end comprises public area, perimeter area and duty station.
4. The intelligent behavior analysis system applied to school sites as claimed in claim 1, wherein the server further comprises a streaming media server, and the video streams collected by the monitoring cameras are all sent to the streaming media server and are sent to the information processing module by the streaming media server in a unified manner.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910529438.1A CN112104837A (en) | 2019-06-18 | 2019-06-18 | Intelligent behavior analysis system applied to school places |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910529438.1A CN112104837A (en) | 2019-06-18 | 2019-06-18 | Intelligent behavior analysis system applied to school places |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112104837A true CN112104837A (en) | 2020-12-18 |
Family
ID=73749236
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910529438.1A Pending CN112104837A (en) | 2019-06-18 | 2019-06-18 | Intelligent behavior analysis system applied to school places |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112104837A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114821957A (en) * | 2022-05-13 | 2022-07-29 | 湖南工商大学 | AI video analysis system and method |
| CN116563797A (en) * | 2023-07-10 | 2023-08-08 | 安徽网谷智能技术有限公司 | Monitoring management system for intelligent campus |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101093603A (en) * | 2007-07-03 | 2007-12-26 | 北京智安邦科技有限公司 | Module set of intellective video monitoring device, system and monitoring method |
| CN103297751A (en) * | 2013-04-23 | 2013-09-11 | 四川天翼网络服务有限公司 | Wisdom skynet video behavior analyzing system |
| KR20170136251A (en) * | 2016-06-01 | 2017-12-11 | 박병한 | Emegency call from smart-phone through blootuth interconnection at any shopping center s and sports stadium and and etc... |
| CN109413369A (en) * | 2017-08-17 | 2019-03-01 | 孟思宏 | A kind of monitor video intellectual analysis early warning platform |
| CN109448291A (en) * | 2018-11-22 | 2019-03-08 | 广东点讯智能科技有限公司 | A kind of behavior video monitoring system applied to construction site |
-
2019
- 2019-06-18 CN CN201910529438.1A patent/CN112104837A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101093603A (en) * | 2007-07-03 | 2007-12-26 | 北京智安邦科技有限公司 | Module set of intellective video monitoring device, system and monitoring method |
| CN103297751A (en) * | 2013-04-23 | 2013-09-11 | 四川天翼网络服务有限公司 | Wisdom skynet video behavior analyzing system |
| KR20170136251A (en) * | 2016-06-01 | 2017-12-11 | 박병한 | Emegency call from smart-phone through blootuth interconnection at any shopping center s and sports stadium and and etc... |
| CN109413369A (en) * | 2017-08-17 | 2019-03-01 | 孟思宏 | A kind of monitor video intellectual analysis early warning platform |
| CN109448291A (en) * | 2018-11-22 | 2019-03-08 | 广东点讯智能科技有限公司 | A kind of behavior video monitoring system applied to construction site |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114821957A (en) * | 2022-05-13 | 2022-07-29 | 湖南工商大学 | AI video analysis system and method |
| CN116563797A (en) * | 2023-07-10 | 2023-08-08 | 安徽网谷智能技术有限公司 | Monitoring management system for intelligent campus |
| CN116563797B (en) * | 2023-07-10 | 2023-10-27 | 安徽网谷智能技术有限公司 | Monitoring management system for intelligent campus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10812761B2 (en) | Complex hardware-based system for video surveillance tracking | |
| US11037300B2 (en) | Monitoring system | |
| CN100504942C (en) | Module set of intelligent video monitoring device, system and monitoring method | |
| CN109448291A (en) | A kind of behavior video monitoring system applied to construction site | |
| US20090122144A1 (en) | Method for detecting events at a secured location | |
| CN201893807U (en) | Campus management system | |
| CN107730681A (en) | A kind of Campus Security ensures intelligent supervision early warning system | |
| CN108206935A (en) | A kind of personnel amount statistical monitoring analysis system | |
| CN210469390U (en) | Wisdom campus security protection system | |
| CN112102585A (en) | Intelligent behavior analysis system applied to old age support place | |
| CN109840962A (en) | Recognition of face movable attendance checking system and method | |
| CN110674761A (en) | Regional behavior early warning method and system | |
| CN112104837A (en) | Intelligent behavior analysis system applied to school places | |
| CN114358980A (en) | Intelligent community property management system and method based on Internet of things | |
| CN112101078A (en) | Intelligent behavior analysis system applied to prison site | |
| CN112788287A (en) | Campus intelligent security monitoring system based on Internet of things | |
| CN207571805U (en) | A kind of Campus Security ensures intelligent supervision early warning system | |
| JP2006244140A (en) | Human behavior detecting and optimum responding system | |
| KR20130047131A (en) | Method and system for surveilling contents of surveillance using mobile terminal | |
| Mane et al. | Raspberry-Pi based security system on IoT platform | |
| CN113012003A (en) | Campus security comprehensive management and service method, system and equipment | |
| JP2004128615A (en) | Person monitoring system | |
| CN217932732U (en) | Information acquisition device for tracing mentally disabled people | |
| KR101269576B1 (en) | The crime prevention terminal using RFID communication and crime prevention system therewith | |
| RU47546U1 (en) | DEVICE OF AUTOMATED CONTROL OF THE ENVIRONMENT IN THE AUDIENCE HALLS |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201218 |