CN116477433A - Intelligent elevator security system, elevator, readable storage medium and electronic equipment - Google Patents

Abstract

The disclosure provides an intelligent elevator security system and an elevator, and relates to the technical field of elevator security. The system comprises: a status sensor module, an image sensor configured to detect the presence of a passenger in the elevator by image recognition, recognize a set passenger behavior, and recognize a predetermined object; the device comprises an electric power storage module, a voice module, a ventilation module, a communication module and a central control module. Through state sensor and image sensor cooperation, can be when abnormal conditions takes place, confirm the condition in the elevator better, through the mutual cooperation of voice module, electric power storage module, communication module, the module of taking a breath etc. better carries out suitable handling to dangerous condition, has increased the security.

Description

Intelligent elevator security system, elevator, readable storage medium and electronic equipment

Technical Field

The disclosure relates to the technical field of elevator safety, in particular to an intelligent elevator security system, an elevator, a computer readable storage medium and electronic equipment.

Background

In the current age, along with the trend of urban arrangement, more and more people live in high-rise buildings, the frequency of using the elevator is also higher, and the safety problem of the elevator is receiving more and more attention.

The existing elevator safety technology about uncontrolled falling is mature, 3 steel wire ropes are used for simultaneously dragging the elevator car, each steel wire rope can independently bear the weight of the whole elevator car, and a series of protection devices such as speed limiting and the like are added, so that the probability of uncontrolled falling of the elevator is greatly reduced. Even so, there is a certain risk probability; in addition, there are many unsafe factors hidden in the elevator, such as bad behavior, malignant behavior, sudden power failure of the elevator, etc., and for these situations, the current elevator cannot cope well.

It should be noted that the information disclosed in the above background section is only for enhancing understanding of the background of the present disclosure and thus may include information that does not constitute prior art known to those of ordinary skill in the art.

Disclosure of Invention

The aim of the disclosure is to provide an intelligent elevator security system and an elevator, which at least overcome the problem that the elevator security protection is not in place due to the limitation of the related technology to a certain extent.

Other features and advantages of the present disclosure will be apparent from the following detailed description, or may be learned in part by the practice of the disclosure.

According to one aspect of the present disclosure, there is provided an intelligent elevator security system comprising:

a status sensor module configured to detect an elevator status;

an image sensor configured to detect whether a passenger exists in the elevator by image recognition, recognize a set passenger behavior, and recognize a predetermined object;

the power storage module is configured to store electric energy when the elevator normally operates and temporarily supply power to the elevator system when the elevator fails;

the voice module is configured to send a safety prompt or warning voice to passengers in different scenes in an acoustic mode;

a ventilation module configured to open a ventilation passage to ventilate the inside of the car based on the switch instruction;

the communication module is configured to communicate with the property security system, the police system and the vision networking system, and when the elevator security system detects dangerous conditions, the dangerous conditions are reported to the property security system and the police system, or passenger information is reported to the vision networking system to assist the security system and the police system in processing the conditions;

the central control module is configured to drive the communication module, the state sensor module, the image sensor, the voice module and the ventilation module to process different conditions based on data obtained by the state sensor module and the image sensor.

In one embodiment, the status sensor module includes: a speed sensor configured to detect whether the elevator is in stall drop according to a set speed threshold;

when the speed sensor detects that the speed of the elevator exceeds a set threshold value, reporting the elevator to a central control module, and automatically pressing all floor keys by a central control module control system, and guiding passengers to take emergency protection through a voice module; and the property security system and the police system are reported through the communication module.

In one embodiment, the status sensor module includes:

a collision detection sensor configured to detect whether an abnormal collision exists in the elevator car;

when the collision detection sensor detects abnormal collision in the elevator car, the image sensor is used for identifying and setting passenger behaviors, the identified passenger behaviors are reported to the central control module, and the central control module drives the voice module to send intelligent voice reminding to passengers in the elevator car.

In one embodiment, an event risk level is determined when the image sensor detects the presence of a set passenger behavior and a set object within the elevator; for a common dangerous event, intelligent voice reminding is sent to passengers in the lift car through a voice module according to the recognized scene; for serious dangerous events, the central control module is reported, the central control module performs whistle alarm through the voice module, meanwhile, the original video image information is saved through the evidence collection of the image sensor, the property security system and the police system are reported through the communication module, corresponding evidence collection information is transmitted, meanwhile, the image information and the real-time position information of passengers are transmitted to the vision networking system through the communication module, and related personnel are tracked in real time through the vision networking system.

In one embodiment, when the elevator fails abnormally, the electricity storage module temporarily supplies power to the intelligent elevator security system, whether passengers exist in the elevator or not is detected through identification of the image sensor, if the passengers exist in the elevator, the property security system and the local police service system are reported through the communication module, after waiting for a set time threshold, if the alarm is not released, the ventilation module is triggered to ventilate the elevator car, and the property security system and the local police service system are reported through the communication module again.

In one embodiment, the image sensor is a camera and the image recognition capability is obtained by a number of specific image datasets and training a deep learning neural network.

In one embodiment, the voice module is a speaker arranged to acoustically give safety prompts or warning voices to passengers in different scenarios.

According to another aspect of the present disclosure, there is provided an elevator having an intelligent security system, the elevator including the intelligent elevator security system described above.

According to still another aspect of the present disclosure, there is provided an electronic apparatus including:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the following steps via execution of the executable instructions:

and receiving an abnormal event reported by the state sensor. The abnormal event comprises an abnormal falling or collision of the elevator;

informing the image sensor to identify whether passengers exist in the car;

if the passengers are identified to exist, informing the passengers to make safety protection through the voice module;

reporting the property security system and the local police service system through the communication module;

after waiting for the set time threshold, if the alarm is not released, triggering the ventilation module to ventilate the inside of the car.

According to yet another aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program, characterized in that the computer program, when executed by a processor, realizes the following method steps:

and receiving an abnormal event reported by the state sensor. The abnormal event comprises an abnormal falling or collision of the elevator;

informing the image sensor to identify whether passengers exist in the car;

if the passengers are identified to exist, informing the passengers to make safety protection through the voice module;

reporting the property security system and the local police service system through the communication module;

after waiting for the set time threshold, if the alarm is not released, triggering the ventilation module to ventilate the inside of the car.

Through state sensor and image sensor cooperation, can be when abnormal conditions takes place, confirm the condition in the elevator better, through the mutual cooperation of voice module, electric power storage module, communication module, the module of taking a breath etc. better carries out suitable handling to dangerous condition, has increased the security.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. It will be apparent to those of ordinary skill in the art that the drawings in the following description are merely examples of the disclosure and that other drawings may be derived from them without undue effort.

Fig. 1 is a schematic diagram of a security system structure of an intelligent elevator in an embodiment of the present disclosure;

fig. 2 shows a flowchart of a method for implementing security protection of an intelligent elevator in an embodiment of the disclosure;

fig. 3 illustrates a flowchart of another intelligent elevator security implementation method in an embodiment of the present disclosure;

fig. 4 illustrates a flowchart of yet another intelligent elevator security implementation method in an embodiment of the present disclosure;

fig. 5 illustrates a flowchart of yet another intelligent elevator security implementation method in an embodiment of the present disclosure; and

fig. 6 shows a block diagram of a computer device in an embodiment of the disclosure.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software or in one or more hardware modules or integrated circuits or in different networks and/or processor devices and/or microcontroller devices.

The solution provided by the present application [ overview of the technical solution ]. For ease of understanding, several terms referred to in this application are first explained below.

Artificial intelligence (Artificial Intelligence, AI) is the theory, method, technique and application system that uses a digital computer or a machine controlled by a digital computer to simulate, extend and extend human intelligence, sense the environment, acquire knowledge and use the knowledge to obtain optimal results. In other words, artificial intelligence is an integrated technology of computer science that attempts to understand the essence of intelligence and to produce a new intelligent machine that can react in a similar way to human intelligence. Artificial intelligence, i.e. research on design principles and implementation methods of various intelligent machines, enables the machines to have functions of sensing, reasoning and decision.

The artificial intelligence technology is a comprehensive subject, and relates to the technology with wide fields, namely the technology with a hardware level and the technology with a software level. Artificial intelligence infrastructure technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a voice processing technology, a natural language processing technology, machine learning/deep learning and other directions.

Computer Vision (CV) is a science of studying how to "look" a machine, and more specifically, to replace human eyes with a camera and a Computer to perform machine Vision such as recognition, tracking and measurement on a target, and further perform graphic processing to make the Computer process into an image more suitable for human eyes to observe or transmit to an instrument to detect. As a scientific discipline, computer vision research-related theory and technology has attempted to build artificial intelligence systems that can acquire information from images or multidimensional data. Computer vision techniques typically include image processing, image recognition, image semantic understanding, image retrieval, OCR (Optical Character Recognition ), video processing, video semantic understanding, video content/behavior recognition, three-dimensional object reconstruction, 3D (three-dimensional) techniques, virtual reality, augmented reality, synchronous positioning, and map construction, and the like, as well as common biometric recognition techniques such as face recognition, fingerprint recognition, and the like.

Key technologies for Speech technology (Speech Technology) are automatic Speech recognition technology (Automatic Speech Recognition, ASR) and Speech synthesis technology (Text To Speech, TTS) and voiceprint recognition technology. The method can enable the computer to listen, watch, say and feel, is the development direction of human-computer interaction in the future, and voice becomes one of the best human-computer interaction modes in the future.

Machine Learning (ML) is a multi-domain interdisciplinary, involving multiple disciplines such as probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory, etc. It is specially studied how a computer simulates or implements learning behavior of a human to acquire new knowledge or skills, and reorganizes existing knowledge structures to continuously improve own performance. Machine learning is the core of artificial intelligence, a fundamental approach to letting computers have intelligence, which is applied throughout various areas of artificial intelligence. Machine learning and deep learning typically include techniques such as artificial neural networks, confidence networks, reinforcement learning, transfer learning, induction learning, teaching learning, and the like.

With research and advancement of artificial intelligence technology, research and application of artificial intelligence technology is being developed in various fields, such as common smart home, smart wearable devices, virtual assistants, smart speakers, smart marketing, unmanned, automatic driving, unmanned aerial vehicles, robots, smart medical treatment, smart customer service, etc., and it is believed that with the development of technology, artificial intelligence technology will be applied in more fields and with increasing importance value.

The scheme provided by the embodiment of the application relates to intelligent elevator security and protection technology, and is specifically described through the following embodiments:

fig. 1 shows a schematic diagram of a security system structure of an intelligent elevator in an embodiment of the disclosure. In this embodiment, the intelligent elevator security system 10 includes a status sensor module 106, an image sensor 107, a voice module 101, a communication module 102, a ventilation module 103, a central control module 104, and an electrical storage module 105. The status sensor module 106 is used to detect the status of the elevator. The status sensor module 106 includes a speed sensor 1061 and a collision detection sensor 1062. The speed sensor 1061 is configured to detect elevator stall droop from a set speed threshold; the image sensor 107 is configured as a camera configured to detect the presence of passengers within the elevator by image recognition, recognize specific passenger behaviors such as a handicapped person, bad limb contact, smoke, etc., and recognize specific objects such as a regulated cutter, dangerous appliances, electric vehicles, rechargeable batteries, etc., the camera image recognition capability can be obtained through a large number of specific image data sets and training a deep learning neural network; the collision detection sensor 1062 detects whether there is an abnormal collision within the elevator car, such as a passenger jumping, an intentional heavy hit against a car sidewall, or the like. The voice module 101 is configured as a loudspeaker and acoustically sounds a safety prompt or warning to the passengers in different scenarios, for example "do not jump in the car-! 'or' do not smoke in the car-! ". The communication module 102 can communicate with the property security system and the local police system, so that when the current elevator security system detects a dangerous situation, the dangerous situation can be reported to the property security system and the police system. The ventilation module 103 is configured to open a ventilation channel to ventilate the elevator when receiving the command of the central control module 104; the central control module 104 includes a memory, a processor, and an intelligent recognition program, and is configured to drive the status sensor module 106, the image sensor 107, the voice module 101, the communication module 102, and the ventilation module 103 to handle different situations based on the data of the status sensor module 106 and the image sensor 107. The electricity storage module 105 is configured to store electrical energy during daily operation of the elevator, and to temporarily power the system during a power outage of the elevator, wherein the electrical energy is stored in a manner that converts mechanical energy of the daily operation of the elevator into electrical energy without additional consumption of energy.

The communication module may be a wireless network or a wired network, and may use standard communication techniques and/or protocols. The network is typically the Internet, but may be any network including, but not limited to, a local area network (Local Area Network, LAN), metropolitan area network (Metropolitan Area Network, MAN), wide area network (Wide Area Network, WAN), mobile, wired or wireless network, private network, or any combination of virtual private networks. In some embodiments, data exchanged over a network is represented using techniques and/or formats including HyperText Mark-up Language (HTML), extensible markup Language (Extensible MarkupLanguage, XML), and the like. All or some of the links may also be encrypted using conventional encryption techniques such as secure sockets layer (Secure Socket Layer, SSL), transport layer security (Transport Layer Security, TLS), virtual private network (Virtual Private Network, VPN), internet protocol security (Internet ProtocolSecurity, IPsec), etc. In other embodiments, custom and/or dedicated data communication techniques may also be used in place of or in addition to the data communication techniques described above.

In the above embodiment, through the cooperation of the state sensor and the image sensor, the situation in the elevator can be better determined when the abnormal situation occurs, and through the mutual cooperation of the voice module, the electricity storage module, the communication module, the ventilation module and the like, the dangerous situation can be better treated appropriately, and the safety is increased.

Hereinafter, each step of the intelligent elevator security implementing method in the present exemplary embodiment will be described in more detail with reference to the accompanying drawings and examples.

Fig. 2 shows a flowchart of an intelligent elevator security implementation method in an embodiment of the present disclosure.

The implementation method of the intelligent elevator security system is further described below in connection with specific use scenarios.

As described in fig. 2, S202, when the elevator stalls down, the speed sensor detects that the elevator speed exceeds a set threshold, e.g. reaches 5m/S.

S204, reporting abnormal elevator speed conditions of the central control module through the communication module.

And S206, the central control module immediately detects whether passengers exist in the elevator through the image sensor.

S208, if the passengers are identified, all floor buttons are automatically pressed, and the passengers are guided to take emergency protection through the voice module, such as voice broadcasting that the passengers are not in a panic state, the back and the arms are close to the wall as far as possible, the knee bending is kept, the passengers are reminded to get back to the corner as far as possible, the back and the arms are close to the wall, the knee bending is kept, and the like.

S210, immediately reporting the elevator fault condition of the property security system and the local police service system and the personnel information condition in the elevator car, such as trapped people and images, through the communication module.

In the above embodiment, when the speed sensor detects that the speed of the elevator is abnormal, the central control module is immediately reported, and the central control module detects whether passengers exist in the elevator through the image sensor, when the passengers exist, all floor keys are automatically pressed, and the passengers are guided to take emergency protection through voice, so that the maximum possible rescue and protection of the passengers are achieved.

Fig. 3 illustrates a flowchart of another intelligent elevator security implementation method in an embodiment of the present disclosure.

As shown in fig. 3, S302, the elevator experiences a power interruption.

S304, when the elevator fails abnormally, the electricity storage module starts temporary power supply for the intelligent elevator security system.

S306, the image sensor detects whether passengers exist in the elevator through image recognition.

And S308, if the passengers are identified, immediately reporting the property security system and the local police service system through the communication module.

S310, after waiting for a set time threshold, for example, 20 minutes, if the alarm is not released at the moment and is not rescued, triggering the ventilation module to ventilate the elevator car, and reporting the fault condition of the property security system and the local police system and the personnel information condition in the elevator car, such as trapped people and images, through the communication module.

In the above embodiment, under the condition of abnormal power failure, the power storage module starts temporary power supply to the elevator system, and whether passengers exist in the elevator or not is detected through the image sensor, and after the preset time, the passengers in the elevator are ventilated through the ventilation module, so that the safety coefficient for rescuing the passengers in the elevator is improved.

Fig. 4 illustrates a flowchart of yet another intelligent elevator security implementation method in an embodiment of the present disclosure.

As shown in fig. 4, the image sensor detects in real time whether there is dangerous passenger behavior or dangerous goods in the elevator S402.

And S404, classifying the risk level into a common risk level and a serious risk level according to a preset standard. If it is a serious risk level, S406 is continued, otherwise S414 is continued.

S406, reporting the occurrence of serious danger level event of the central control module for serious danger, such as mechanical injury.

S408, the central control module immediately performs whistle alarm through the voice module, and the image sensor acquires evidence and stores original video image information.

S410, reporting the property security system and the local police system through the communication module and transmitting corresponding evidence obtaining information.

S412, the image information and the real-time position information of the related personnel are transmitted to the visual networking system through the communication module, and the related personnel are tracked in real time through the visual networking system, so that the security system and police system personnel can conveniently know the real-time movement direction of the related personnel, and the related personnel can be controlled in time.

S414, for the common danger, the intelligent voice prompt is immediately sent to the passengers in the lift car through the voice module according to the recognized scene, for example, the smoking behavior is detected, the passengers are reminded of' do not smoke in the lift-! ".

In the embodiment, dangerous passenger behaviors and dangerous articles in the elevator can be detected through the image sensor, corresponding disposal measures are provided, and safer intelligent elevator security is realized.

The following provides a specific implementation of identifying dangerous passenger behavior or dangerous goods based on deep learning. The basic idea is to convert the video and the classification labels in the data set into images (video frames) and the corresponding classification labels, and then train, learn and test the images by adopting a CNN network to convert the video classification problem into the graph classification problem.

(1) For each video, including training video and test video, capturing video frames with a certain FPS, storing the video frames as a training set and a test set, and taking the classification performance of the images as the classification performance of the corresponding video;

(2) Selecting a CNN network architecture and initial weight, and performing migration learning to a certain data set;

(3) Retraining the CNN network part layer by using a training video set to obtain a trained CNN model;

(4) And after training, loading the model to check and verify all video frames in the test video set to obtain the accuracy.

In one embodiment, video and images are obtained through an image sensor, a model for identifying dangerous passenger behaviors or dangerous objects based on deep learning is formed by combining a 2D convolution sub-network and a 3D convolution sub-network through feature stitching, the input of the model is RGB image frames, the model is provided by the image sensor, and the 2D convolution sub-network adopts a part of GhostNet as a backbone bone to improve reasoning speed. The 2D convolution sub-network performs primary extraction of a spatial feature map on pictures in the video stream through the GhostNet, performs spatial transformation on the spatial feature map obtained by primary extraction to obtain other feature maps, and then obtains all the feature maps extracted by the 2D convolution sub-network; the 2D convolution sub-network is formed by splicing four Ghost-Bottleneck blocks, wherein the Ghost-Bottleneck blocks are formed by stacking two Ghost modules and one depth separable convolution module, the Ghost modules are divided into main convolution operation and simple conversion operation, a feature map is generated by the main convolution first, then the feature map generated by the main convolution is transformed by using the simple conversion operation, the operation amount is reduced while the features are enhanced, and finally the two feature maps are spliced together and input to the next Ghost module. The attention mechanism of SE modules (Squeeze-and-specification) was added to the 4 th Ghost Bottleneck block. The output of the 2D convolution sub-network is, for example, 40×28×28, and the feature images are stacked in frame order, for example, 16×40×28×28, and input into the 3D sub-network, and the 3D convolution sub-network adopts a 3D-shuffleetv 2 structure. The convolution sub-network is composed of 6 3D convolution modules, wherein each 3D convolution module is calculated from 1 x 1, 3 x 3 and 1 x 1 convolutions respectively, and finally merging the two components together to a next 3D convolution module, and finally classifying abnormal and normal behaviors by using a full connection layer.

Aiming at the defects of the prior art, the intelligent elevator security system and the elevator overcome the defects of the prior system. For different elevator fault conditions such as abnormal collision, stall falling, power failure and the like, intelligent coping and guiding of passengers can be performed; for personal safety conditions such as abnormal behaviors of mechanical injury, bad limb contact and the like, dangerous goods and the like, the intelligent safety device can intelligently solve the problems by means of an image recognition technology and an optical networking technology, well ensures the personal safety of passengers, and greatly improves the use satisfaction of users.

Fig. 5 illustrates a flowchart of yet another intelligent elevator security implementation method in an embodiment of the present disclosure.

As shown in fig. 5, S502, the central control module receives an abnormal event reported by the status sensor. The abnormal event includes an abnormal drop of the elevator or a collision with the elevator.

S504, the central control module notifies the image sensor to recognize whether a passenger exists in the car.

S506, if the passenger is identified to exist, the central control module informs the passenger of making safety protection through the voice module.

And S508, if the passengers are identified, reporting the property security system and the local police service system through the communication module.

And S510, after waiting for the set time threshold, triggering the ventilation module to ventilate the inside of the car if the alarm is not released.

It is noted that the above-described figures are only schematic illustrations of processes involved in a method according to an exemplary embodiment of the invention, and are not intended to be limiting. It will be readily appreciated that the processes shown in the above figures do not indicate or limit the temporal order of these processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, for example, among a plurality of modules.

Those skilled in the art will appreciate that the various aspects of the invention may be implemented as a system, method, or program product. Accordingly, aspects of the invention may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects may be referred to herein as a "circuit," module "or" system.

An electronic device 800 according to such an embodiment of the invention is described below with reference to fig. 6. The electronic device 800 shown in fig. 6 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.

As shown in fig. 6, the electronic device 800 is embodied in the form of a general purpose computing device. Components of electronic device 800 may include, but are not limited to: the at least one processing unit 810, the at least one memory unit 820, and a bus 830 connecting the various system components, including the memory unit 820 and the processing unit 810.

Wherein the storage unit stores program code that is executable by the processing unit 810 such that the processing unit 810 performs steps according to various exemplary embodiments of the present invention described in the above section of the "exemplary method" of the present specification.

The storage unit 820 may include readable media in the form of volatile storage units, such as Random Access Memory (RAM) 8201 and/or cache memory 8202, and may further include Read Only Memory (ROM) 8203.

Storage unit 820 may also include a program/utility 8204 having a set (at least one) of program modules 8205, such program modules 8205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.

Bus 830 may be one or more of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

The electronic device 800 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 600, and/or any device (e.g., router, modem, etc.) that enables the electronic device 800 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 650. Also, electronic device 800 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through network adapter 860. As shown, network adapter 860 communicates with other modules of electronic device 800 over bus 830. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 600, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.

From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a U-disk, a mobile hard disk, etc.) or on a network, including several instructions to cause a computing device (may be a personal computer, a server, a terminal device, or a network device, etc.) to perform the method according to the embodiments of the present disclosure.

In an exemplary embodiment of the present disclosure, a computer-readable storage medium having stored thereon a program product capable of implementing the method described above in the present specification is also provided. In some possible embodiments, the various aspects of the invention may also be implemented in the form of a program product comprising program code for causing a terminal device to carry out the steps according to the various exemplary embodiments of the invention as described in the "exemplary methods" section of this specification, when said program product is run on the terminal device.

A program product for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read-only memory (CD-ROM) and comprise program code and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit in accordance with embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied.

Furthermore, although the steps of the methods in the present disclosure are depicted in a particular order in the drawings, this does not require or imply that the steps must be performed in that particular order or that all illustrated steps be performed in order to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform, etc.

From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a U-disk, a mobile hard disk, etc.) or on a network, including several instructions to cause a computing device (may be a personal computer, a server, a mobile terminal, or a network device, etc.) to perform the method according to the embodiments of the present disclosure.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims (10)

1. An intelligent elevator security system, comprising:

a status sensor module configured to detect an elevator status;

an image sensor configured to detect whether a passenger exists in the elevator by image recognition, recognize a set passenger behavior, and recognize a predetermined object;

the power storage module is configured to store electric energy when the elevator normally operates and temporarily supply power to the elevator system when the elevator fails;

the voice module is configured to send a safety prompt or warning voice to passengers in different scenes in an acoustic mode;

a ventilation module configured to open a ventilation passage to ventilate the inside of the car based on the switch instruction;

the communication module is configured to communicate with the property security system, the police system and the vision networking system, and when the elevator security system detects dangerous conditions, the dangerous conditions are reported to the property security system and the police system, or passenger information is reported to the vision networking system to assist the security system and the police system in processing the conditions;

the central control module is configured to drive the communication module, the state sensor module, the image sensor, the voice module and the ventilation module to process different conditions based on data obtained by the state sensor module and the image sensor.

2. The intelligent elevator security system of claim 1, wherein the status sensor module comprises:

a speed sensor configured to detect whether the elevator is in stall drop according to a set speed threshold;

when the speed sensor detects that the speed of the elevator exceeds a set threshold value, reporting the elevator to a central control module, and automatically pressing all floor keys by a central control module control system, and guiding passengers to take emergency protection through a voice module; and the property security system and the police system are reported through the communication module.

3. The intelligent elevator security system of claim 1, wherein the status sensor module comprises:

a collision detection sensor configured to detect whether an abnormal collision exists in the elevator car;

when the collision detection sensor detects abnormal collision in the elevator car, the image sensor is used for identifying and setting passenger behaviors, the identified passenger behaviors are reported to the central control module, and the central control module drives the voice module to send intelligent voice reminding to passengers in the elevator car.

4. The intelligent elevator security system of any of claims 1-3, wherein an event hazard level is determined when the image sensor detects the presence of a set passenger behavior and a set object within an elevator; for a common dangerous event, intelligent voice reminding is sent to passengers in the lift car through a voice module according to the recognized scene; for serious dangerous events, the central control module is reported, the central control module performs whistle alarm through the voice module, meanwhile, the original video image information is saved through the evidence collection of the image sensor, the property security system and the police system are reported through the communication module, corresponding evidence collection information is transmitted, meanwhile, the image information and the real-time position information of passengers are transmitted to the vision networking system through the communication module, and related personnel are tracked in real time through the vision networking system.

5. The intelligent elevator security system of claim 1, wherein when an elevator fails abnormally, the electricity storage module temporarily supplies power to the intelligent elevator security system, whether passengers exist in the elevator is detected through identification of an image sensor, if passengers exist in the elevator, the property security system and the local police service system are reported through the communication module, after waiting for a set time threshold, if the alarm is not released, the ventilation module is triggered to ventilate the elevator car, and the property security system and the local police service system are reported through the communication module again.

6. The intelligent elevator security system of claim 1, wherein the image sensor is a camera, and the image recognition capability is obtained by a plurality of specific image datasets and training a deep learning neural network.

7. A smart elevator security system as claimed in any one of claims 1 to 3, wherein the voice module is a speaker arranged to acoustically give security prompts or warning sounds to passengers in different scenarios.

8. An elevator with an intelligent security system, the elevator comprising an intelligent elevator security system according to any of the preceding claims 1 to 7.

9. An electronic device, comprising:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the following steps via execution of the executable instructions:

and receiving an abnormal event reported by the state sensor. The abnormal event comprises an abnormal falling or collision of the elevator;

informing the image sensor to identify whether passengers exist in the car;

if the passengers are identified to exist, informing the passengers to make safety protection through the voice module;

reporting the property security system and the local police service system through the communication module;

after waiting for the set time threshold, if the alarm is not released, triggering the ventilation module to ventilate the inside of the car.

10. A computer readable storage medium having stored thereon a computer program, characterized in that the computer program when executed by a processor realizes the following method steps:

and receiving an abnormal event reported by the state sensor. The abnormal event comprises an abnormal falling or collision of the elevator;

informing the image sensor to identify whether passengers exist in the car;

if the passengers are identified to exist, informing the passengers to make safety protection through the voice module;

reporting the property security system and the local police service system through the communication module;

after waiting for the set time threshold, if the alarm is not released, triggering the ventilation module to ventilate the inside of the car.