CN105516659A - Intelligent safe-guard system and method based on face emotion recognition - Google Patents

Intelligent safe-guard system and method based on face emotion recognition Download PDF

Info

Publication number
CN105516659A
CN105516659A CN201510885826.5A CN201510885826A CN105516659A CN 105516659 A CN105516659 A CN 105516659A CN 201510885826 A CN201510885826 A CN 201510885826A CN 105516659 A CN105516659 A CN 105516659A
Authority
CN
China
Prior art keywords
emotion recognition
face
emotion
security
condition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510885826.5A
Other languages
Chinese (zh)
Other versions
CN105516659B (en
Inventor
姚琛
许群峰
赵月学
史勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Casin Contract Energy Management Co Ltd
Original Assignee
Chongqing Casin Contract Energy Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Casin Contract Energy Management Co Ltd filed Critical Chongqing Casin Contract Energy Management Co Ltd
Priority to CN201510885826.5A priority Critical patent/CN105516659B/en
Publication of CN105516659A publication Critical patent/CN105516659A/en
Application granted granted Critical
Publication of CN105516659B publication Critical patent/CN105516659B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Alarm Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses an intelligent safe-guard system and method based on face emotion recognition. The system comprises a first emotion recognition subsystem, a first active push device and a human body track route monitoring device, wherein the first emotion recognition subsystem is used for extracting feature information of faces of passengers in each elevator, and carrying out an emotion analysis on the extracted face feature information; when any one face emotion recognition device obtains an emotion recognition result indicating a hurry-scurry emotion, the first active push device is used for actively pushing real time monitoring pictures of a monitoring camera, located in the same elevator with the face emotion recognition device, to a large screen of a background monitoring center; when the passage walks out of the elevator and enters any one floor, the human body track route monitoring device is used for actively pushing real time monitoring pictures of a monitoring camera in the floor. The intelligent safe-guard system and method based on face emotion recognition achieves the aim of finding out suspicious people in advance before security incidents in a community, so as to greatly improving the security factor of the community.

Description

Intelligent security system and method based on face emotion recognition
Technical Field
The invention relates to the technical field of security, in particular to an intelligent security system and method based on face emotion recognition.
Background
Currently, in order to improve the safety environment inside a cell, a monitoring system, such as a closed circuit television monitoring system, is installed in the cell. However, these existing cell monitoring systems are passive monitoring systems, and usually take corresponding countermeasures after a security accident such as burglary occurs, but it is likely that the security accident is late, and the system will have adverse effects on the physical, property and psychology of the victim.
In summary, it can be seen how to find suspicious people in advance before a cell security accident occurs, so as to prevent the suspicious people from getting into the foreground, which is a problem to be solved at present.
Disclosure of Invention
In view of this, the present invention provides an intelligent security system and method based on face emotion recognition, which achieve the purpose of finding suspicious people in advance before a cell security accident occurs, thereby greatly improving the security coefficient of a cell. The specific scheme is as follows:
an intelligent security system based on face emotion recognition, comprising:
the first emotion recognition subsystem is used for extracting the feature information of the face of the passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
the first active pushing device is in communication connection with the first emotion recognition subsystem, and when an emotion recognition result obtained by any one face emotion recognition device shows a scared emotion, a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device is actively pushed to a large screen of a background monitoring center;
and the human body track route monitoring device is used for positioning the human body of the passenger generating the panicked emotion in real time when the emotion recognition result obtained by any one face emotion recognition device represents the panicked emotion so as to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to the large screen after the passenger leaves the elevator and enters any floor.
Preferably, the intelligent security system further comprises:
the security personnel positioning subsystem is used for acquiring the position information of all security personnel in the cell in real time;
and the alarm information sending device is used for being connected with the security personnel positioning subsystem and the first emotion recognition subsystem, calculating the distance between the current position of each security personnel and the position of the face emotion recognition device when the emotion recognition result obtained by any face emotion recognition device arranged in the elevator shows a scary emotion, screening N security personnel based on a screening principle that the closer the distance is, the higher the priority is, wherein N is a positive integer, and sending corresponding alarm information to the handheld mobile terminal of the N security personnel.
Preferably, the intelligent security system further comprises:
the second emotion recognition subsystem is used for extracting feature information of the face outside the door and performing emotion analysis on the extracted face feature information through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
and the second active pushing device is in communication connection with the second emotion recognition subsystem, and actively pushes the real-time monitoring picture of the monitoring camera positioned on the gate of the resident to the handheld mobile terminal of the corresponding resident when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panicked emotion.
Preferably, the handheld mobile terminal of the corresponding household is provided with:
the security condition manual judgment unit is used for providing a condition manual selection interface for the resident, and acquiring the security condition selected by the user according to the actual condition after watching the real-time monitoring picture pushed by the second active pushing device through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
and the monitoring picture closing unit is used for closing the real-time monitoring picture on the current handheld mobile terminal when the security condition acquired by the security condition manual judgment unit is a security condition.
Preferably, any household gate is further provided with:
and the audible and visual alarm is used for sending a corresponding audible and visual alarm signal when the security condition acquired by the security condition manual judgment unit corresponding to the resident door is a dangerous condition.
Preferably, any household gate is further provided with:
and the warning communication device is used for generating corresponding warning prompt information when the audible and visual alarm corresponding to the resident door sends an audible and visual alarm signal, and sending the warning prompt information to handheld mobile terminals of the residents of M households around the resident door, wherein M is a positive integer.
The invention also discloses an intelligent security method based on face emotion recognition, which comprises the following steps:
extracting feature information of the face of a passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, actively pushing a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device to a large screen of a background monitoring center;
and when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, carrying out real-time human body positioning on the passenger generating the scary emotion to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to the large screen after the passenger leaves the elevator and enters any floor.
Preferably, the intelligent security method further includes:
acquiring position information of all security personnel in a cell in real time;
when the emotion recognition result obtained by any one face emotion recognition device arranged in the elevator shows a scary emotion, the distance between the current position of each security worker and the position of the face emotion recognition device is calculated, N security workers are screened out based on a screening principle that the closer the distance is, the higher the priority is, N is a positive integer, and corresponding alarm information is sent to the handheld mobile terminal of the N security workers.
Preferably, the intelligent security method further includes:
extracting feature information of the face outside the door and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panic emotion, the real-time monitoring picture of the monitoring camera on the gate of the resident is actively pushed to the handheld mobile terminal of the corresponding resident.
Preferably, the intelligent security method further includes:
providing a condition manual selection interface for a resident, and acquiring a security condition selected according to an actual condition after a user watches a real-time monitoring picture on a handheld mobile terminal of the user through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
when the acquired security protection condition is a safety condition, closing a real-time monitoring picture on the current handheld mobile terminal;
when the acquired security protection condition is a dangerous condition, a corresponding control signal is sent out so as to control an audible and visual alarm on a gate of a corresponding resident to send out a corresponding audible and visual alarm signal;
when the audible and visual alarm on the gate of any resident sends out audible and visual alarm signals, corresponding warning prompt information is generated and sent to handheld mobile terminals of the residents of M households around, wherein M is a positive integer.
In the invention, the intelligent security system comprises: the first emotion recognition subsystem is used for extracting the feature information of the face of the passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result; the first active pushing device is in communication connection with the first emotion recognition subsystem, and when an emotion recognition result obtained by any one face emotion recognition device shows a scared emotion, a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device is actively pushed to a large screen of a background monitoring center; and the human body tracking route monitoring device is used for positioning the human body of the passenger generating the panicked emotion in real time when the emotion recognition result obtained by any one face emotion recognition device represents the panicked emotion so as to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to a large screen after the passenger leaves the elevator and enters any floor. Therefore, the invention analyzes the face emotion of passengers in the elevator through the face emotion recognition device arranged in each elevator in the community, and pushes the real-time monitoring picture in the corresponding elevator to the large screen of the background monitoring center after the situation that any passenger has a panic is found, so that once a worker in the background monitoring center finds that the large screen actively jumps out of the real-time monitoring picture of one elevator, the worker knows that suspicious personnel try to work in the community, and can remind related security personnel to pay close attention to the suspicious personnel in time, thereby avoiding the occurrence of safety accidents.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic structural diagram of an intelligent security system based on face emotion recognition according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a specific intelligent security system based on face emotion recognition according to an embodiment of the present invention;
fig. 3 is a flowchart of an intelligent security method based on facial emotion recognition, disclosed by an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses an intelligent security system based on face emotion recognition, which is shown in figure 1 and comprises:
the first emotion recognition subsystem 11 is used for extracting feature information of the face of a passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
the first active pushing device 12 is used for being in communication connection with the first emotion recognition subsystem 11, and actively pushing a real-time monitoring picture of a monitoring camera which is located in the same elevator with any face emotion recognition device to a large screen of a background monitoring center when an emotion recognition result obtained by the face emotion recognition device shows a scary emotion;
and the human body track route monitoring device 13 is used for positioning the human body of the passenger with the panicked emotion in real time to determine the specific position of the passenger in the elevator when the emotion recognition result obtained by any one face emotion recognition device shows the panicked emotion, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to a large screen after the passenger leaves the elevator and enters any floor.
It can be understood that the facial emotion recognition device comprises a corresponding face acquisition camera, a facial feature extractor, a feature comparison analyzer, an analysis data transmission line and the like. In addition, when the human body trace route monitoring device 13 locates the human body of a passenger who has a panic, it is preferable to extract the dressing characteristic information of the passenger and locate the passenger in real time based on the extracted dressing characteristic information.
In the embodiment of the invention, the intelligent security system comprises: the first emotion recognition subsystem is used for extracting the feature information of the face of the passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result; the first active pushing device is in communication connection with the first emotion recognition subsystem, and when an emotion recognition result obtained by any one face emotion recognition device shows a scared emotion, a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device is actively pushed to a large screen of a background monitoring center; and the human body tracking route monitoring device is used for positioning the human body of the passenger generating the panicked emotion in real time when the emotion recognition result obtained by any one face emotion recognition device represents the panicked emotion so as to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to a large screen after the passenger leaves the elevator and enters any floor.
Therefore, the embodiment of the invention analyzes the face emotion of the passengers in the elevator through the face emotion recognition device arranged in each elevator in the community, and when a panic emotion appears in any passenger, the real-time monitoring picture in the corresponding elevator is pushed to the large screen of the background monitoring center, so that once a worker in the background monitoring center finds that the real-time monitoring picture of one elevator actively jumps out of the large screen, the worker knows that suspicious people try to work in the community, and can remind related security personnel to pay close attention to the suspicious people in time, thereby avoiding the occurrence of safety accidents.
The embodiment of the invention discloses a specific intelligent security system based on face emotion recognition, and compared with the previous embodiment, the embodiment further explains and optimizes the technical scheme. Specifically, the method comprises the following steps:
referring to fig. 2, in order to timely notify nearby security personnel of starting an emergency countermeasure when a suspicious person is found, in this embodiment, the intelligent security system may further include a security personnel positioning subsystem 14 and an alarm information sending device 15; wherein,
the security personnel positioning subsystem 14 is used for acquiring the position information of all security personnel in the cell in real time;
and the alarm information sending device 15 is used for being connected with the security personnel positioning subsystem 14 and the first emotion recognition subsystem 11, calculating the distance between the current position of each security personnel and the position of the face emotion recognition device when the emotion recognition result obtained by any face emotion recognition device arranged in the elevator shows a scary emotion, screening out N security personnel based on a screening principle that the closer the distance is, the higher the priority is, wherein N is a positive integer, and sending corresponding alarm information to the handheld mobile terminal of the N security personnel.
In order to further improve the security environment of the cell and reduce burglary incidents, in this embodiment, the intelligent security system may further include a second emotion recognition subsystem and a second active push device; wherein,
the second emotion recognition subsystem is used for extracting feature information of the face outside the door and performing emotion analysis on the extracted face feature information through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
and the second active pushing device is in communication connection with the second emotion recognition subsystem, and actively pushes the real-time monitoring picture of the monitoring camera positioned on the gate of the resident to the handheld mobile terminal of the corresponding resident when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panicked emotion. Certainly, when an alarm occurs, the real-time monitoring picture of the monitoring camera on the gate of the resident can be pushed to the large monitoring screen of the background monitoring center through the second active pushing device.
In the embodiment, a manual security condition judging unit and a monitoring picture closing unit are arranged on the handheld mobile terminal of the corresponding resident; wherein,
the security condition manual judgment unit is used for providing a condition manual selection interface for the resident, and acquiring the security condition selected by the user according to the actual condition after the user watches the real-time monitoring picture pushed by the second active pushing device through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
and the monitoring picture closing unit is used for closing the real-time monitoring picture on the current handheld mobile terminal when the security condition acquired by the security condition manual judgment unit is the security condition.
Furthermore, an audible and visual alarm and a warning communication device can be arranged on any resident gate; wherein,
and the audible and visual alarm is used for sending a corresponding audible and visual alarm signal when the security condition acquired by the security condition manual judgment unit corresponding to the resident door is a dangerous condition.
And the warning communication device is used for generating corresponding warning prompt information when the audible and visual alarm corresponding to the resident door sends an audible and visual alarm signal, and sending the warning prompt information to handheld mobile terminals of the residents of M households around the resident door, wherein M is a positive integer.
It can be understood that the warning communication device comprises a corresponding memory and a wireless data transceiver, wherein the memory stores the contact information of the householder of the M households in advance, and when a warning situation occurs, the wireless data transceiver sends the corresponding warning prompt information to the handheld mobile terminal corresponding to the prestored contact information according to the contact information prestored in the memory, so as to prompt the surrounding households to improve the warning in time.
The embodiment of the invention also discloses an intelligent security method based on face emotion recognition, which is shown in figure 3 and comprises the following steps:
step S31: extracting feature information of the face of a passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
step S32: when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, actively pushing a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device to a large screen of a background monitoring center;
step S33: when the emotion recognition result obtained by any face emotion recognition device shows a scary emotion, the passengers who generate the scary emotion are positioned in real time to determine the specific positions of the passengers in the elevator, and after the passengers walk out of the elevator and enter any floor, real-time monitoring pictures of the monitoring cameras of the floor are actively pushed to a large screen.
Further, in order to timely notify security personnel nearby to start an emergency countermeasure when finding suspicious people, the method in this embodiment may further include: acquiring position information of all security personnel in a cell in real time; when the emotion recognition result obtained by any one face emotion recognition device arranged in the elevator shows a scary emotion, the distance between the current position of each security worker and the position of the face emotion recognition device is calculated, N security workers are screened out based on a screening principle that the closer the distance is, the higher the priority is, N is a positive integer, and corresponding alarm information is sent to the handheld mobile terminal of the N security workers.
In order to further improve the security environment of the cell and reduce the incidence of burglary events, in this embodiment, the intelligent security method may further include: extracting feature information of the face outside the door and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result; when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panic emotion, the real-time monitoring picture of the monitoring camera on the gate of the resident is actively pushed to the handheld mobile terminal of the corresponding resident.
Further, the method in this embodiment may further include: providing a situation manual selection interface for a resident, and acquiring a security condition selected according to an actual situation after a user watches a real-time monitoring picture on a handheld mobile terminal through the situation manual selection interface; wherein the security condition is a safety condition or a dangerous condition; when the acquired security protection condition is a safety condition, closing a real-time monitoring picture on the current handheld mobile terminal; when the acquired security protection condition is a dangerous condition, a corresponding control signal is sent out so as to control an audible and visual alarm on a gate of a corresponding resident to send out a corresponding audible and visual alarm signal; when the audible and visual alarm on the gate of any resident sends out audible and visual alarm signals, corresponding warning prompt information is generated and sent to handheld mobile terminals of the residents of M households around, wherein M is a positive integer.
Therefore, the embodiment of the invention analyzes the face emotion of the passengers in the elevator through the face emotion recognition device arranged in each elevator in the community, and when a panic emotion appears in any passenger, the real-time monitoring picture in the corresponding elevator is pushed to the large screen of the background monitoring center, so that once a worker in the background monitoring center finds that the real-time monitoring picture of one elevator actively jumps out of the large screen, the worker knows that suspicious people try to work in the community, and can remind related security personnel to pay close attention to the suspicious people in time, thereby avoiding the occurrence of safety accidents.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The intelligent security system and the method based on face emotion recognition provided by the invention are described in detail, specific examples are applied in the description to explain the principle and the implementation mode of the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. The utility model provides an intelligent security system based on face emotion recognition which characterized in that includes:
the first emotion recognition subsystem is used for extracting the feature information of the face of the passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
the first active pushing device is in communication connection with the first emotion recognition subsystem, and when an emotion recognition result obtained by any one face emotion recognition device shows a scared emotion, a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device is actively pushed to a large screen of a background monitoring center;
and the human body track route monitoring device is used for positioning the human body of the passenger generating the panicked emotion in real time when the emotion recognition result obtained by any one face emotion recognition device represents the panicked emotion so as to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to the large screen after the passenger leaves the elevator and enters any floor.
2. The intelligent security system based on facial emotion recognition of claim 1, further comprising:
the security personnel positioning subsystem is used for acquiring the position information of all security personnel in the cell in real time;
and the alarm information sending device is used for being connected with the security personnel positioning subsystem and the first emotion recognition subsystem, calculating the distance between the current position of each security personnel and the position of the face emotion recognition device when the emotion recognition result obtained by any face emotion recognition device arranged in the elevator shows a scary emotion, screening N security personnel based on a screening principle that the closer the distance is, the higher the priority is, wherein N is a positive integer, and sending corresponding alarm information to the handheld mobile terminal of the N security personnel.
3. The intelligent security system based on facial emotion recognition according to claim 1 or 2, further comprising:
the second emotion recognition subsystem is used for extracting feature information of the face outside the door and performing emotion analysis on the extracted face feature information through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
and the second active pushing device is in communication connection with the second emotion recognition subsystem, and actively pushes the real-time monitoring picture of the monitoring camera positioned on the gate of the resident to the handheld mobile terminal of the corresponding resident when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panicked emotion.
4. The intelligent security system based on facial emotion recognition of claim 3, wherein the handheld mobile terminal of the corresponding resident is provided with:
the security condition manual judgment unit is used for providing a condition manual selection interface for the resident, and acquiring the security condition selected by the user according to the actual condition after watching the real-time monitoring picture pushed by the second active pushing device through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
and the monitoring picture closing unit is used for closing the real-time monitoring picture on the current handheld mobile terminal when the security condition acquired by the security condition manual judgment unit is a security condition.
5. The intelligent security system based on facial emotion recognition of claim 4, wherein any household gate is further provided with:
and the audible and visual alarm is used for sending a corresponding audible and visual alarm signal when the security condition acquired by the security condition manual judgment unit corresponding to the resident door is a dangerous condition.
6. The intelligent security system based on facial emotion recognition of claim 5, wherein any household gate is further provided with:
and the warning communication device is used for generating corresponding warning prompt information when the audible and visual alarm corresponding to the resident door sends an audible and visual alarm signal, and sending the warning prompt information to handheld mobile terminals of the residents of M households around the resident door, wherein M is a positive integer.
7. An intelligent security method based on face emotion recognition is characterized by comprising the following steps:
extracting feature information of the face of a passenger in each elevator and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged in the elevator to obtain a corresponding emotion recognition result;
when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, actively pushing a real-time monitoring picture of a monitoring camera which is positioned in the same elevator with the face emotion recognition device to a large screen of a background monitoring center;
and when the emotion recognition result obtained by any one face emotion recognition device shows a scary emotion, carrying out real-time human body positioning on the passenger generating the scary emotion to determine the specific position of the passenger in the elevator, and actively pushing the real-time monitoring picture of the monitoring camera of the floor to the large screen after the passenger leaves the elevator and enters any floor.
8. The intelligent security method based on facial emotion recognition, as recited in claim 7, further comprising:
acquiring position information of all security personnel in a cell in real time;
when the emotion recognition result obtained by any one face emotion recognition device arranged in the elevator shows a scary emotion, the distance between the current position of each security worker and the position of the face emotion recognition device is calculated, N security workers are screened out based on a screening principle that the closer the distance is, the higher the priority is, N is a positive integer, and corresponding alarm information is sent to the handheld mobile terminal of the N security workers.
9. The intelligent security method based on facial emotion recognition according to claim 7 or 8, further comprising:
extracting feature information of the face outside the door and performing emotion analysis on the extracted feature information of the face through a face emotion recognition device arranged on the gate of each resident to obtain a corresponding emotion recognition result;
when the emotion recognition result obtained by the face emotion recognition device on the gate of any resident shows a panic emotion, the real-time monitoring picture of the monitoring camera on the gate of the resident is actively pushed to the handheld mobile terminal of the corresponding resident.
10. The intelligent security method based on facial emotion recognition of claim 9, further comprising:
providing a condition manual selection interface for a resident, and acquiring a security condition selected according to an actual condition after a user watches a real-time monitoring picture on a handheld mobile terminal of the user through the condition manual selection interface; wherein the security condition is a safety condition or a dangerous condition;
when the acquired security protection condition is a safety condition, closing a real-time monitoring picture on the current handheld mobile terminal;
when the acquired security protection condition is a dangerous condition, a corresponding control signal is sent out so as to control an audible and visual alarm on a gate of a corresponding resident to send out a corresponding audible and visual alarm signal;
when the audible and visual alarm on the gate of any resident sends out audible and visual alarm signals, corresponding warning prompt information is generated and sent to handheld mobile terminals of the residents of M households around, wherein M is a positive integer.
CN201510885826.5A 2015-12-04 2015-12-04 A kind of intelligent safety and defence system and method based on face's Emotion identification Expired - Fee Related CN105516659B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510885826.5A CN105516659B (en) 2015-12-04 2015-12-04 A kind of intelligent safety and defence system and method based on face's Emotion identification

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510885826.5A CN105516659B (en) 2015-12-04 2015-12-04 A kind of intelligent safety and defence system and method based on face's Emotion identification

Publications (2)

Publication Number Publication Date
CN105516659A true CN105516659A (en) 2016-04-20
CN105516659B CN105516659B (en) 2018-10-23

Family

ID=55724254

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510885826.5A Expired - Fee Related CN105516659B (en) 2015-12-04 2015-12-04 A kind of intelligent safety and defence system and method based on face's Emotion identification

Country Status (1)

Country Link
CN (1) CN105516659B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106384414A (en) * 2016-10-26 2017-02-08 厦门施米德智能科技有限公司 Intelligent door system and operation method thereof
CN106652293A (en) * 2016-12-30 2017-05-10 安徽杰瑞信息科技有限公司 Intelligent district online safety and protection monitoring system
CN108830761A (en) * 2018-06-27 2018-11-16 山东众云教育科技有限公司 A kind of campus security management method based on recognition of face
CN109766474A (en) * 2018-12-18 2019-05-17 深圳壹账通智能科技有限公司 Inquest signal auditing method, device, computer equipment and storage medium
CN109981928A (en) * 2017-12-27 2019-07-05 杭州百航信息技术有限公司 A kind of intelligence air control video and audio recording system and its working principle
CN110689654A (en) * 2019-09-17 2020-01-14 厦门朗畅信息技术有限公司 Apartment security system
CN111582001A (en) * 2019-02-18 2020-08-25 北京入思技术有限公司 Method and system for identifying suspicious people based on emotion perception
CN112700571A (en) * 2020-12-11 2021-04-23 广脉科技股份有限公司 Intelligent community personnel management system
US20210196169A1 (en) * 2017-11-03 2021-07-01 Sensormatic Electronics, LLC Methods and System for Monitoring and Assessing Employee Moods
CN114092991A (en) * 2021-08-25 2022-02-25 新疆云腾创新智能科技有限公司 Artificial intelligence expression discernment integrative lamp of collecting evidence
CN114842521A (en) * 2021-11-30 2022-08-02 浙江久冠信息技术服务有限公司 Intelligent analysis early warning system for emotion recognition of personnel

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090027493A1 (en) * 2007-07-24 2009-01-29 Ahron Amar Method and device for security in public places
CN101542549A (en) * 2007-03-06 2009-09-23 株式会社东芝 Suspicious behavior detection system and method
CN101609588A (en) * 2008-06-16 2009-12-23 云南正卓信息技术有限公司 Full-automatic anti-intrusion intelligent video monitoring alarm system for unattended villa
CN102894980A (en) * 2011-07-28 2013-01-30 刘永强 Security inspection device capable of recognizing criminals
CN203165162U (en) * 2013-03-15 2013-08-28 华北电力大学(保定) Community antitheft monitoring system based on Internet of Things
JP2013171476A (en) * 2012-02-22 2013-09-02 Nec Corp Portable back camera system for face recognition crime prevention and crime prevention determination method used for the same
CN203504688U (en) * 2013-10-16 2014-03-26 中南大学 Identification system for suspicious act in parking lot
CN104484966A (en) * 2014-12-17 2015-04-01 天津翔宇润达科技有限公司 Intelligent alarm system
CN104581045A (en) * 2014-12-05 2015-04-29 安徽华盛科技控股股份有限公司 CIT (computer and information technology) intelligent security control system and method
CN105069425A (en) * 2015-07-31 2015-11-18 小米科技有限责任公司 Video abnormity information prompting method and apparatus

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101542549A (en) * 2007-03-06 2009-09-23 株式会社东芝 Suspicious behavior detection system and method
US20090027493A1 (en) * 2007-07-24 2009-01-29 Ahron Amar Method and device for security in public places
CN101609588A (en) * 2008-06-16 2009-12-23 云南正卓信息技术有限公司 Full-automatic anti-intrusion intelligent video monitoring alarm system for unattended villa
CN102894980A (en) * 2011-07-28 2013-01-30 刘永强 Security inspection device capable of recognizing criminals
JP2013171476A (en) * 2012-02-22 2013-09-02 Nec Corp Portable back camera system for face recognition crime prevention and crime prevention determination method used for the same
CN203165162U (en) * 2013-03-15 2013-08-28 华北电力大学(保定) Community antitheft monitoring system based on Internet of Things
CN203504688U (en) * 2013-10-16 2014-03-26 中南大学 Identification system for suspicious act in parking lot
CN104581045A (en) * 2014-12-05 2015-04-29 安徽华盛科技控股股份有限公司 CIT (computer and information technology) intelligent security control system and method
CN104484966A (en) * 2014-12-17 2015-04-01 天津翔宇润达科技有限公司 Intelligent alarm system
CN105069425A (en) * 2015-07-31 2015-11-18 小米科技有限责任公司 Video abnormity information prompting method and apparatus

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106384414A (en) * 2016-10-26 2017-02-08 厦门施米德智能科技有限公司 Intelligent door system and operation method thereof
CN106384414B (en) * 2016-10-26 2018-07-20 厦门施米德智能科技有限公司 A kind of intelligence door system and its working method
CN106652293A (en) * 2016-12-30 2017-05-10 安徽杰瑞信息科技有限公司 Intelligent district online safety and protection monitoring system
US20210196169A1 (en) * 2017-11-03 2021-07-01 Sensormatic Electronics, LLC Methods and System for Monitoring and Assessing Employee Moods
CN109981928A (en) * 2017-12-27 2019-07-05 杭州百航信息技术有限公司 A kind of intelligence air control video and audio recording system and its working principle
CN108830761A (en) * 2018-06-27 2018-11-16 山东众云教育科技有限公司 A kind of campus security management method based on recognition of face
CN109766474A (en) * 2018-12-18 2019-05-17 深圳壹账通智能科技有限公司 Inquest signal auditing method, device, computer equipment and storage medium
CN111582001A (en) * 2019-02-18 2020-08-25 北京入思技术有限公司 Method and system for identifying suspicious people based on emotion perception
CN110689654A (en) * 2019-09-17 2020-01-14 厦门朗畅信息技术有限公司 Apartment security system
CN112700571A (en) * 2020-12-11 2021-04-23 广脉科技股份有限公司 Intelligent community personnel management system
CN114092991A (en) * 2021-08-25 2022-02-25 新疆云腾创新智能科技有限公司 Artificial intelligence expression discernment integrative lamp of collecting evidence
CN114842521A (en) * 2021-11-30 2022-08-02 浙江久冠信息技术服务有限公司 Intelligent analysis early warning system for emotion recognition of personnel

Also Published As

Publication number Publication date
CN105516659B (en) 2018-10-23

Similar Documents

Publication Publication Date Title
CN105516659B (en) A kind of intelligent safety and defence system and method based on face's Emotion identification
CN205230242U (en) Intelligent residential district security protection system
CN105741467B (en) A kind of security monitoring robot and robot security's monitoring method
CN109064698B (en) Resident security early warning method and resident security early warning system
CN109815818B (en) Target person tracking method, system and related device
CN106934787B (en) Intelligent access control method, system, server and equipment
AU2019295856B2 (en) Object tracking using disparate monitoring systems
CN108038808A (en) A kind of monitoring method, device, terminal device and storage medium
CN111800617A (en) Intelligent security system based on Internet of things
KR20220058297A (en) Integrated security system for apartment complexes based on artificial intelligence image analysis
CN105354901A (en) Fingerprint identification-based children loss prevention method and device
CN112211496B (en) Monitoring method and system based on intelligent door lock and intelligent door lock
CN115273369A (en) Intelligent household security monitoring device and monitoring method thereof
KR20150033402A (en) Apparatus and Method for Unmanned Safety Guard Based on Video Recognition
CN104933779A (en) Cloud-intelligent access control management method and system
CN105155995A (en) Safety door system and using method thereof
CN208314959U (en) A kind of intelligent safety and defence system
CN114745218A (en) Control method, device and equipment for intelligent household equipment
KR20180066688A (en) Digital Social Shield System using Deep Active Semi-Supervised Learning
CN105469472B (en) intelligent access control method and system
KR101280353B1 (en) Event notification system of condition using mobile device
CN103793961A (en) Safety identification method capable of comparing identity in real time
CN110443931B (en) Hospital access control system and control method
CN205405842U (en) Intelligence alarm system based on cloud platform
CN116311714A (en) Method and system for preventing false alarm of intelligent door lock

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20181023

Termination date: 20191204