CN105516659A - Intelligent safe-guard system and method based on face emotion recognition - Google Patents
Intelligent safe-guard system and method based on face emotion recognition Download PDFInfo
- Publication number
- CN105516659A CN105516659A CN201510885826.5A CN201510885826A CN105516659A CN 105516659 A CN105516659 A CN 105516659A CN 201510885826 A CN201510885826 A CN 201510885826A CN 105516659 A CN105516659 A CN 105516659A
- Authority
- CN
- China
- Prior art keywords
- emotion recognition
- face
- emotion
- security
- condition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000008909 emotion recognition Effects 0.000 title claims abstract description 152
- 238000000034 method Methods 0.000 title claims abstract description 28
- HDDSHPAODJUKPD-UHFFFAOYSA-N fenbendazole Chemical compound C1=C2NC(NC(=O)OC)=NC2=CC=C1SC1=CC=CC=C1 HDDSHPAODJUKPD-UHFFFAOYSA-N 0.000 title abstract 3
- 238000012544 monitoring process Methods 0.000 claims abstract description 77
- 230000008451 emotion Effects 0.000 claims abstract description 57
- 238000012806 monitoring device Methods 0.000 claims abstract description 8
- 230000000007 visual effect Effects 0.000 claims description 25
- 238000004891 communication Methods 0.000 claims description 13
- 230000001815 facial effect Effects 0.000 claims description 11
- 238000012216 screening Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 2
- 230000002411 adverse Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Alarm Systems (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
The invention discloses an intelligent safe-guard system and method based on face emotion recognition. The system comprises a first emotion recognition subsystem, a first active push device and a human body track route monitoring device, wherein the first emotion recognition subsystem is used for extracting feature information of faces of passengers in each elevator, and carrying out an emotion analysis on the extracted face feature information; when any one face emotion recognition device obtains an emotion recognition result indicating a hurry-scurry emotion, the first active push device is used for actively pushing real time monitoring pictures of a monitoring camera, located in the same elevator with the face emotion recognition device, to a large screen of a background monitoring center; when the passage walks out of the elevator and enters any one floor, the human body track route monitoring device is used for actively pushing real time monitoring pictures of a monitoring camera in the floor. The intelligent safe-guard system and method based on face emotion recognition achieves the aim of finding out suspicious people in advance before security incidents in a community, so as to greatly improving the security factor of the community.
Description
Technical Field
The invention relates to the technical field of security, in particular to an intelligent security system and method based on face emotion recognition.
Background
Currently, in order to improve the safety environment inside a cell, a monitoring system, such as a closed circuit television monitoring system, is installed in the cell. However, these existing cell monitoring systems are passive monitoring systems, and usually take corresponding countermeasures after a security accident such as burglary occurs, but it is likely that the security accident is late, and the system will have adverse effects on the physical, property and psychology of the victim.
In summary, it can be seen how to find suspicious people in advance before a cell security accident occurs, so as to prevent the suspicious people from getting into the foreground, which is a problem to be solved at present.
Disclosure of Invention
In view of this, the present invention provides an intelligent security system and method based on face emotion recognition, which achieve the purpose of finding suspicious people in advance before a cell security accident occurs, thereby greatly improving the security coefficient of a cell. The specific scheme is as follows:
an intelligent security system based on face emotion recognition, comprising:
the first emotion recognition subsystem is used for extracting the feature information of the face of the passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
the first active pushing device is in communication connection with the first emotion recognition subsystem, and when an emotion recognition result obtained by any one face emotion recognition device shows a scared emotion, a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device is actively pushed to a large screen of a background monitoring center;
and the human body track route monitoring device is used for positioning the human body of the passenger generating the panicked emotion in real time when the emotion recognition result obtained by any one face emotion recognition device represents the panicked emotion so as to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to the large screen after the passenger leaves the elevator and enters any floor.
Preferably, the intelligent security system further comprises:
the security personnel positioning subsystem is used for acquiring the position information of all security personnel in the cell in real time;
and the alarm information sending device is used for being connected with the security personnel positioning subsystem and the first emotion recognition subsystem, calculating the distance between the current position of each security personnel and the position of the face emotion recognition device when the emotion recognition result obtained by any face emotion recognition device arranged in the elevator shows a scary emotion, screening N security personnel based on a screening principle that the closer the distance is, the higher the priority is, wherein N is a positive integer, and sending corresponding alarm information to the handheld mobile terminal of the N security personnel.
Preferably, the intelligent security system further comprises:
the second emotion recognition subsystem is used for extracting feature information of the face outside the door and performing emotion analysis on the extracted face feature information through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
and the second active pushing device is in communication connection with the second emotion recognition subsystem, and actively pushes the real-time monitoring picture of the monitoring camera positioned on the gate of the resident to the handheld mobile terminal of the corresponding resident when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panicked emotion.
Preferably, the handheld mobile terminal of the corresponding household is provided with:
the security condition manual judgment unit is used for providing a condition manual selection interface for the resident, and acquiring the security condition selected by the user according to the actual condition after watching the real-time monitoring picture pushed by the second active pushing device through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
and the monitoring picture closing unit is used for closing the real-time monitoring picture on the current handheld mobile terminal when the security condition acquired by the security condition manual judgment unit is a security condition.
Preferably, any household gate is further provided with:
and the audible and visual alarm is used for sending a corresponding audible and visual alarm signal when the security condition acquired by the security condition manual judgment unit corresponding to the resident door is a dangerous condition.
Preferably, any household gate is further provided with:
and the warning communication device is used for generating corresponding warning prompt information when the audible and visual alarm corresponding to the resident door sends an audible and visual alarm signal, and sending the warning prompt information to handheld mobile terminals of the residents of M households around the resident door, wherein M is a positive integer.
The invention also discloses an intelligent security method based on face emotion recognition, which comprises the following steps:
extracting feature information of the face of a passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, actively pushing a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device to a large screen of a background monitoring center;
and when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, carrying out real-time human body positioning on the passenger generating the scary emotion to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to the large screen after the passenger leaves the elevator and enters any floor.
Preferably, the intelligent security method further includes:
acquiring position information of all security personnel in a cell in real time;
when the emotion recognition result obtained by any one face emotion recognition device arranged in the elevator shows a scary emotion, the distance between the current position of each security worker and the position of the face emotion recognition device is calculated, N security workers are screened out based on a screening principle that the closer the distance is, the higher the priority is, N is a positive integer, and corresponding alarm information is sent to the handheld mobile terminal of the N security workers.
Preferably, the intelligent security method further includes:
extracting feature information of the face outside the door and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panic emotion, the real-time monitoring picture of the monitoring camera on the gate of the resident is actively pushed to the handheld mobile terminal of the corresponding resident.
Preferably, the intelligent security method further includes:
providing a condition manual selection interface for a resident, and acquiring a security condition selected according to an actual condition after a user watches a real-time monitoring picture on a handheld mobile terminal of the user through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
when the acquired security protection condition is a safety condition, closing a real-time monitoring picture on the current handheld mobile terminal;
when the acquired security protection condition is a dangerous condition, a corresponding control signal is sent out so as to control an audible and visual alarm on a gate of a corresponding resident to send out a corresponding audible and visual alarm signal;
when the audible and visual alarm on the gate of any resident sends out audible and visual alarm signals, corresponding warning prompt information is generated and sent to handheld mobile terminals of the residents of M households around, wherein M is a positive integer.
In the invention, the intelligent security system comprises: the first emotion recognition subsystem is used for extracting the feature information of the face of the passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result; the first active pushing device is in communication connection with the first emotion recognition subsystem, and when an emotion recognition result obtained by any one face emotion recognition device shows a scared emotion, a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device is actively pushed to a large screen of a background monitoring center; and the human body tracking route monitoring device is used for positioning the human body of the passenger generating the panicked emotion in real time when the emotion recognition result obtained by any one face emotion recognition device represents the panicked emotion so as to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to a large screen after the passenger leaves the elevator and enters any floor. Therefore, the invention analyzes the face emotion of passengers in the elevator through the face emotion recognition device arranged in each elevator in the community, and pushes the real-time monitoring picture in the corresponding elevator to the large screen of the background monitoring center after the situation that any passenger has a panic is found, so that once a worker in the background monitoring center finds that the large screen actively jumps out of the real-time monitoring picture of one elevator, the worker knows that suspicious personnel try to work in the community, and can remind related security personnel to pay close attention to the suspicious personnel in time, thereby avoiding the occurrence of safety accidents.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic structural diagram of an intelligent security system based on face emotion recognition according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a specific intelligent security system based on face emotion recognition according to an embodiment of the present invention;
fig. 3 is a flowchart of an intelligent security method based on facial emotion recognition, disclosed by an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses an intelligent security system based on face emotion recognition, which is shown in figure 1 and comprises:
the first emotion recognition subsystem 11 is used for extracting feature information of the face of a passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
the first active pushing device 12 is used for being in communication connection with the first emotion recognition subsystem 11, and actively pushing a real-time monitoring picture of a monitoring camera which is located in the same elevator with any face emotion recognition device to a large screen of a background monitoring center when an emotion recognition result obtained by the face emotion recognition device shows a scary emotion;
and the human body track route monitoring device 13 is used for positioning the human body of the passenger with the panicked emotion in real time to determine the specific position of the passenger in the elevator when the emotion recognition result obtained by any one face emotion recognition device shows the panicked emotion, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to a large screen after the passenger leaves the elevator and enters any floor.
It can be understood that the facial emotion recognition device comprises a corresponding face acquisition camera, a facial feature extractor, a feature comparison analyzer, an analysis data transmission line and the like. In addition, when the human body trace route monitoring device 13 locates the human body of a passenger who has a panic, it is preferable to extract the dressing characteristic information of the passenger and locate the passenger in real time based on the extracted dressing characteristic information.
In the embodiment of the invention, the intelligent security system comprises: the first emotion recognition subsystem is used for extracting the feature information of the face of the passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result; the first active pushing device is in communication connection with the first emotion recognition subsystem, and when an emotion recognition result obtained by any one face emotion recognition device shows a scared emotion, a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device is actively pushed to a large screen of a background monitoring center; and the human body tracking route monitoring device is used for positioning the human body of the passenger generating the panicked emotion in real time when the emotion recognition result obtained by any one face emotion recognition device represents the panicked emotion so as to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to a large screen after the passenger leaves the elevator and enters any floor.
Therefore, the embodiment of the invention analyzes the face emotion of the passengers in the elevator through the face emotion recognition device arranged in each elevator in the community, and when a panic emotion appears in any passenger, the real-time monitoring picture in the corresponding elevator is pushed to the large screen of the background monitoring center, so that once a worker in the background monitoring center finds that the real-time monitoring picture of one elevator actively jumps out of the large screen, the worker knows that suspicious people try to work in the community, and can remind related security personnel to pay close attention to the suspicious people in time, thereby avoiding the occurrence of safety accidents.
The embodiment of the invention discloses a specific intelligent security system based on face emotion recognition, and compared with the previous embodiment, the embodiment further explains and optimizes the technical scheme. Specifically, the method comprises the following steps:
referring to fig. 2, in order to timely notify nearby security personnel of starting an emergency countermeasure when a suspicious person is found, in this embodiment, the intelligent security system may further include a security personnel positioning subsystem 14 and an alarm information sending device 15; wherein,
the security personnel positioning subsystem 14 is used for acquiring the position information of all security personnel in the cell in real time;
and the alarm information sending device 15 is used for being connected with the security personnel positioning subsystem 14 and the first emotion recognition subsystem 11, calculating the distance between the current position of each security personnel and the position of the face emotion recognition device when the emotion recognition result obtained by any face emotion recognition device arranged in the elevator shows a scary emotion, screening out N security personnel based on a screening principle that the closer the distance is, the higher the priority is, wherein N is a positive integer, and sending corresponding alarm information to the handheld mobile terminal of the N security personnel.
In order to further improve the security environment of the cell and reduce burglary incidents, in this embodiment, the intelligent security system may further include a second emotion recognition subsystem and a second active push device; wherein,
the second emotion recognition subsystem is used for extracting feature information of the face outside the door and performing emotion analysis on the extracted face feature information through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
and the second active pushing device is in communication connection with the second emotion recognition subsystem, and actively pushes the real-time monitoring picture of the monitoring camera positioned on the gate of the resident to the handheld mobile terminal of the corresponding resident when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panicked emotion. Certainly, when an alarm occurs, the real-time monitoring picture of the monitoring camera on the gate of the resident can be pushed to the large monitoring screen of the background monitoring center through the second active pushing device.
In the embodiment, a manual security condition judging unit and a monitoring picture closing unit are arranged on the handheld mobile terminal of the corresponding resident; wherein,
the security condition manual judgment unit is used for providing a condition manual selection interface for the resident, and acquiring the security condition selected by the user according to the actual condition after the user watches the real-time monitoring picture pushed by the second active pushing device through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
and the monitoring picture closing unit is used for closing the real-time monitoring picture on the current handheld mobile terminal when the security condition acquired by the security condition manual judgment unit is the security condition.
Furthermore, an audible and visual alarm and a warning communication device can be arranged on any resident gate; wherein,
and the audible and visual alarm is used for sending a corresponding audible and visual alarm signal when the security condition acquired by the security condition manual judgment unit corresponding to the resident door is a dangerous condition.
And the warning communication device is used for generating corresponding warning prompt information when the audible and visual alarm corresponding to the resident door sends an audible and visual alarm signal, and sending the warning prompt information to handheld mobile terminals of the residents of M households around the resident door, wherein M is a positive integer.
It can be understood that the warning communication device comprises a corresponding memory and a wireless data transceiver, wherein the memory stores the contact information of the householder of the M households in advance, and when a warning situation occurs, the wireless data transceiver sends the corresponding warning prompt information to the handheld mobile terminal corresponding to the prestored contact information according to the contact information prestored in the memory, so as to prompt the surrounding households to improve the warning in time.
The embodiment of the invention also discloses an intelligent security method based on face emotion recognition, which is shown in figure 3 and comprises the following steps:
step S31: extracting feature information of the face of a passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
step S32: when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, actively pushing a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device to a large screen of a background monitoring center;
step S33: when the emotion recognition result obtained by any face emotion recognition device shows a scary emotion, the passengers who generate the scary emotion are positioned in real time to determine the specific positions of the passengers in the elevator, and after the passengers walk out of the elevator and enter any floor, real-time monitoring pictures of the monitoring cameras of the floor are actively pushed to a large screen.
Further, in order to timely notify security personnel nearby to start an emergency countermeasure when finding suspicious people, the method in this embodiment may further include: acquiring position information of all security personnel in a cell in real time; when the emotion recognition result obtained by any one face emotion recognition device arranged in the elevator shows a scary emotion, the distance between the current position of each security worker and the position of the face emotion recognition device is calculated, N security workers are screened out based on a screening principle that the closer the distance is, the higher the priority is, N is a positive integer, and corresponding alarm information is sent to the handheld mobile terminal of the N security workers.
In order to further improve the security environment of the cell and reduce the incidence of burglary events, in this embodiment, the intelligent security method may further include: extracting feature information of the face outside the door and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result; when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panic emotion, the real-time monitoring picture of the monitoring camera on the gate of the resident is actively pushed to the handheld mobile terminal of the corresponding resident.
Further, the method in this embodiment may further include: providing a situation manual selection interface for a resident, and acquiring a security condition selected according to an actual situation after a user watches a real-time monitoring picture on a handheld mobile terminal through the situation manual selection interface; wherein the security condition is a safety condition or a dangerous condition; when the acquired security protection condition is a safety condition, closing a real-time monitoring picture on the current handheld mobile terminal; when the acquired security protection condition is a dangerous condition, a corresponding control signal is sent out so as to control an audible and visual alarm on a gate of a corresponding resident to send out a corresponding audible and visual alarm signal; when the audible and visual alarm on the gate of any resident sends out audible and visual alarm signals, corresponding warning prompt information is generated and sent to handheld mobile terminals of the residents of M households around, wherein M is a positive integer.
Therefore, the embodiment of the invention analyzes the face emotion of the passengers in the elevator through the face emotion recognition device arranged in each elevator in the community, and when a panic emotion appears in any passenger, the real-time monitoring picture in the corresponding elevator is pushed to the large screen of the background monitoring center, so that once a worker in the background monitoring center finds that the real-time monitoring picture of one elevator actively jumps out of the large screen, the worker knows that suspicious people try to work in the community, and can remind related security personnel to pay close attention to the suspicious people in time, thereby avoiding the occurrence of safety accidents.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The intelligent security system and the method based on face emotion recognition provided by the invention are described in detail, specific examples are applied in the description to explain the principle and the implementation mode of the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. The utility model provides an intelligent security system based on face emotion recognition which characterized in that includes:
the first emotion recognition subsystem is used for extracting the feature information of the face of the passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
the first active pushing device is in communication connection with the first emotion recognition subsystem, and when an emotion recognition result obtained by any one face emotion recognition device shows a scared emotion, a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device is actively pushed to a large screen of a background monitoring center;
and the human body track route monitoring device is used for positioning the human body of the passenger generating the panicked emotion in real time when the emotion recognition result obtained by any one face emotion recognition device represents the panicked emotion so as to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to the large screen after the passenger leaves the elevator and enters any floor.
2. The intelligent security system based on facial emotion recognition of claim 1, further comprising:
the security personnel positioning subsystem is used for acquiring the position information of all security personnel in the cell in real time;
and the alarm information sending device is used for being connected with the security personnel positioning subsystem and the first emotion recognition subsystem, calculating the distance between the current position of each security personnel and the position of the face emotion recognition device when the emotion recognition result obtained by any face emotion recognition device arranged in the elevator shows a scary emotion, screening N security personnel based on a screening principle that the closer the distance is, the higher the priority is, wherein N is a positive integer, and sending corresponding alarm information to the handheld mobile terminal of the N security personnel.
3. The intelligent security system based on facial emotion recognition according to claim 1 or 2, further comprising:
the second emotion recognition subsystem is used for extracting feature information of the face outside the door and performing emotion analysis on the extracted face feature information through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
and the second active pushing device is in communication connection with the second emotion recognition subsystem, and actively pushes the real-time monitoring picture of the monitoring camera positioned on the gate of the resident to the handheld mobile terminal of the corresponding resident when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panicked emotion.
4. The intelligent security system based on facial emotion recognition of claim 3, wherein the handheld mobile terminal of the corresponding resident is provided with:
the security condition manual judgment unit is used for providing a condition manual selection interface for the resident, and acquiring the security condition selected by the user according to the actual condition after watching the real-time monitoring picture pushed by the second active pushing device through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
and the monitoring picture closing unit is used for closing the real-time monitoring picture on the current handheld mobile terminal when the security condition acquired by the security condition manual judgment unit is a security condition.
5. The intelligent security system based on facial emotion recognition of claim 4, wherein any household gate is further provided with:
and the audible and visual alarm is used for sending a corresponding audible and visual alarm signal when the security condition acquired by the security condition manual judgment unit corresponding to the resident door is a dangerous condition.
6. The intelligent security system based on facial emotion recognition of claim 5, wherein any household gate is further provided with:
and the warning communication device is used for generating corresponding warning prompt information when the audible and visual alarm corresponding to the resident door sends an audible and visual alarm signal, and sending the warning prompt information to handheld mobile terminals of the residents of M households around the resident door, wherein M is a positive integer.
7. An intelligent security method based on face emotion recognition is characterized by comprising the following steps:
extracting feature information of the face of a passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, actively pushing a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device to a large screen of a background monitoring center;
and when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, carrying out real-time human body positioning on the passenger generating the scary emotion to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to the large screen after the passenger leaves the elevator and enters any floor.
8. The intelligent security method based on facial emotion recognition, as recited in claim 7, further comprising:
acquiring position information of all security personnel in a cell in real time;
when the emotion recognition result obtained by any one face emotion recognition device arranged in the elevator shows a scary emotion, the distance between the current position of each security worker and the position of the face emotion recognition device is calculated, N security workers are screened out based on a screening principle that the closer the distance is, the higher the priority is, N is a positive integer, and corresponding alarm information is sent to the handheld mobile terminal of the N security workers.
9. The intelligent security method based on facial emotion recognition according to claim 7 or 8, further comprising:
extracting feature information of the face outside the door and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panic emotion, the real-time monitoring picture of the monitoring camera on the gate of the resident is actively pushed to the handheld mobile terminal of the corresponding resident.
10. The intelligent security method based on facial emotion recognition of claim 9, further comprising:
providing a condition manual selection interface for a resident, and acquiring a security condition selected according to an actual condition after a user watches a real-time monitoring picture on a handheld mobile terminal of the user through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
when the acquired security protection condition is a safety condition, closing a real-time monitoring picture on the current handheld mobile terminal;
when the acquired security protection condition is a dangerous condition, a corresponding control signal is sent out so as to control an audible and visual alarm on a gate of a corresponding resident to send out a corresponding audible and visual alarm signal;
when the audible and visual alarm on the gate of any resident sends out audible and visual alarm signals, corresponding warning prompt information is generated and sent to handheld mobile terminals of the residents of M households around, wherein M is a positive integer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510885826.5A CN105516659B (en) | 2015-12-04 | 2015-12-04 | A kind of intelligent safety and defence system and method based on face's Emotion identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510885826.5A CN105516659B (en) | 2015-12-04 | 2015-12-04 | A kind of intelligent safety and defence system and method based on face's Emotion identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105516659A true CN105516659A (en) | 2016-04-20 |
| CN105516659B CN105516659B (en) | 2018-10-23 |
Family
ID=55724254
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510885826.5A Expired - Fee Related CN105516659B (en) | 2015-12-04 | 2015-12-04 | A kind of intelligent safety and defence system and method based on face's Emotion identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105516659B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106384414A (en) * | 2016-10-26 | 2017-02-08 | 厦门施米德智能科技有限公司 | Intelligent door system and operation method thereof |
| CN106652293A (en) * | 2016-12-30 | 2017-05-10 | 安徽杰瑞信息科技有限公司 | Intelligent district online safety and protection monitoring system |
| CN108830761A (en) * | 2018-06-27 | 2018-11-16 | 山东众云教育科技有限公司 | A kind of campus security management method based on recognition of face |
| CN109766474A (en) * | 2018-12-18 | 2019-05-17 | 深圳壹账通智能科技有限公司 | Inquest signal auditing method, device, computer equipment and storage medium |
| CN109981928A (en) * | 2017-12-27 | 2019-07-05 | 杭州百航信息技术有限公司 | A kind of intelligence air control video and audio recording system and its working principle |
| CN110689654A (en) * | 2019-09-17 | 2020-01-14 | 厦门朗畅信息技术有限公司 | Apartment security system |
| CN111582001A (en) * | 2019-02-18 | 2020-08-25 | 北京入思技术有限公司 | Method and system for identifying suspicious people based on emotion perception |
| CN112700571A (en) * | 2020-12-11 | 2021-04-23 | 广脉科技股份有限公司 | Intelligent community personnel management system |
| US20210196169A1 (en) * | 2017-11-03 | 2021-07-01 | Sensormatic Electronics, LLC | Methods and System for Monitoring and Assessing Employee Moods |
| CN114092991A (en) * | 2021-08-25 | 2022-02-25 | 新疆云腾创新智能科技有限公司 | Artificial intelligence expression discernment integrative lamp of collecting evidence |
| CN114842521A (en) * | 2021-11-30 | 2022-08-02 | 浙江久冠信息技术服务有限公司 | Intelligent analysis early warning system for emotion recognition of personnel |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090027493A1 (en) * | 2007-07-24 | 2009-01-29 | Ahron Amar | Method and device for security in public places |
| CN101542549A (en) * | 2007-03-06 | 2009-09-23 | 株式会社东芝 | Suspicious behavior detection system and method |
| CN101609588A (en) * | 2008-06-16 | 2009-12-23 | 云南正卓信息技术有限公司 | Full-automatic anti-intrusion intelligent video monitoring alarm system for unattended villa |
| CN102894980A (en) * | 2011-07-28 | 2013-01-30 | 刘永强 | Security inspection device capable of recognizing criminals |
| CN203165162U (en) * | 2013-03-15 | 2013-08-28 | 华北电力大学（保定） | Community antitheft monitoring system based on Internet of Things |
| JP2013171476A (en) * | 2012-02-22 | 2013-09-02 | Nec Corp | Portable back camera system for face recognition crime prevention and crime prevention determination method used for the same |
| CN203504688U (en) * | 2013-10-16 | 2014-03-26 | 中南大学 | Identification system for suspicious act in parking lot |
| CN104484966A (en) * | 2014-12-17 | 2015-04-01 | 天津翔宇润达科技有限公司 | Intelligent alarm system |
| CN104581045A (en) * | 2014-12-05 | 2015-04-29 | 安徽华盛科技控股股份有限公司 | CIT (computer and information technology) intelligent security control system and method |
| CN105069425A (en) * | 2015-07-31 | 2015-11-18 | 小米科技有限责任公司 | Video abnormity information prompting method and apparatus |
-
2015
- 2015-12-04 CN CN201510885826.5A patent/CN105516659B/en not_active Expired - Fee Related
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101542549A (en) * | 2007-03-06 | 2009-09-23 | 株式会社东芝 | Suspicious behavior detection system and method |
| US20090027493A1 (en) * | 2007-07-24 | 2009-01-29 | Ahron Amar | Method and device for security in public places |
| CN101609588A (en) * | 2008-06-16 | 2009-12-23 | 云南正卓信息技术有限公司 | Full-automatic anti-intrusion intelligent video monitoring alarm system for unattended villa |
| CN102894980A (en) * | 2011-07-28 | 2013-01-30 | 刘永强 | Security inspection device capable of recognizing criminals |
| JP2013171476A (en) * | 2012-02-22 | 2013-09-02 | Nec Corp | Portable back camera system for face recognition crime prevention and crime prevention determination method used for the same |
| CN203165162U (en) * | 2013-03-15 | 2013-08-28 | 华北电力大学（保定） | Community antitheft monitoring system based on Internet of Things |
| CN203504688U (en) * | 2013-10-16 | 2014-03-26 | 中南大学 | Identification system for suspicious act in parking lot |
| CN104581045A (en) * | 2014-12-05 | 2015-04-29 | 安徽华盛科技控股股份有限公司 | CIT (computer and information technology) intelligent security control system and method |
| CN104484966A (en) * | 2014-12-17 | 2015-04-01 | 天津翔宇润达科技有限公司 | Intelligent alarm system |
| CN105069425A (en) * | 2015-07-31 | 2015-11-18 | 小米科技有限责任公司 | Video abnormity information prompting method and apparatus |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106384414A (en) * | 2016-10-26 | 2017-02-08 | 厦门施米德智能科技有限公司 | Intelligent door system and operation method thereof |
| CN106384414B (en) * | 2016-10-26 | 2018-07-20 | 厦门施米德智能科技有限公司 | A kind of intelligence door system and its working method |
| CN106652293A (en) * | 2016-12-30 | 2017-05-10 | 安徽杰瑞信息科技有限公司 | Intelligent district online safety and protection monitoring system |
| US20210196169A1 (en) * | 2017-11-03 | 2021-07-01 | Sensormatic Electronics, LLC | Methods and System for Monitoring and Assessing Employee Moods |
| CN109981928A (en) * | 2017-12-27 | 2019-07-05 | 杭州百航信息技术有限公司 | A kind of intelligence air control video and audio recording system and its working principle |
| CN108830761A (en) * | 2018-06-27 | 2018-11-16 | 山东众云教育科技有限公司 | A kind of campus security management method based on recognition of face |
| CN109766474A (en) * | 2018-12-18 | 2019-05-17 | 深圳壹账通智能科技有限公司 | Inquest signal auditing method, device, computer equipment and storage medium |
| CN111582001A (en) * | 2019-02-18 | 2020-08-25 | 北京入思技术有限公司 | Method and system for identifying suspicious people based on emotion perception |
| CN110689654A (en) * | 2019-09-17 | 2020-01-14 | 厦门朗畅信息技术有限公司 | Apartment security system |
| CN112700571A (en) * | 2020-12-11 | 2021-04-23 | 广脉科技股份有限公司 | Intelligent community personnel management system |
| CN114092991A (en) * | 2021-08-25 | 2022-02-25 | 新疆云腾创新智能科技有限公司 | Artificial intelligence expression discernment integrative lamp of collecting evidence |
| CN114842521A (en) * | 2021-11-30 | 2022-08-02 | 浙江久冠信息技术服务有限公司 | Intelligent analysis early warning system for emotion recognition of personnel |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105516659B (en) | 2018-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105516659B (en) | A kind of intelligent safety and defence system and method based on face's Emotion identification | |
| CN205230242U (en) | Intelligent residential district security protection system | |
| CN105741467B (en) | A kind of security monitoring robot and robot security's monitoring method | |
| CN109064698B (en) | Resident security early warning method and resident security early warning system | |
| CN109815818B (en) | Target person tracking method, system and related device | |
| CN106934787B (en) | Intelligent access control method, system, server and equipment | |
| AU2019295856B2 (en) | Object tracking using disparate monitoring systems | |
| CN108038808A (en) | A kind of monitoring method, device, terminal device and storage medium | |
| CN111800617A (en) | Intelligent security system based on Internet of things | |
| KR20220058297A (en) | Integrated security system for apartment complexes based on artificial intelligence image analysis | |
| CN105354901A (en) | Fingerprint identification-based children loss prevention method and device | |
| CN112211496B (en) | Monitoring method and system based on intelligent door lock and intelligent door lock | |
| CN115273369A (en) | Intelligent household security monitoring device and monitoring method thereof | |
| KR20150033402A (en) | Apparatus and Method for Unmanned Safety Guard Based on Video Recognition | |
| CN104933779A (en) | Cloud-intelligent access control management method and system | |
| CN105155995A (en) | Safety door system and using method thereof | |
| CN208314959U (en) | A kind of intelligent safety and defence system | |
| CN114745218A (en) | Control method, device and equipment for intelligent household equipment | |
| KR20180066688A (en) | Digital Social Shield System using Deep Active Semi-Supervised Learning | |
| CN105469472B (en) | intelligent access control method and system | |
| KR101280353B1 (en) | Event notification system of condition using mobile device | |
| CN103793961A (en) | Safety identification method capable of comparing identity in real time | |
| CN110443931B (en) | Hospital access control system and control method | |
| CN205405842U (en) | Intelligence alarm system based on cloud platform | |
| CN116311714A (en) | Method and system for preventing false alarm of intelligent door lock |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20181023 Termination date: 20191204 |