CN114735559A - Elevator monitoring system and method based on image recognition - Google Patents
Elevator monitoring system and method based on image recognition Download PDFInfo
- Publication number
- CN114735559A CN114735559A CN202210411488.1A CN202210411488A CN114735559A CN 114735559 A CN114735559 A CN 114735559A CN 202210411488 A CN202210411488 A CN 202210411488A CN 114735559 A CN114735559 A CN 114735559A
- Authority
- CN
- China
- Prior art keywords
- elevator
- door
- time
- monitoring
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 102
- 238000000034 method Methods 0.000 title claims abstract description 24
- 230000008859 change Effects 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 8
- 230000004888 barrier function Effects 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000012806 monitoring device Methods 0.000 description 12
- 230000002159 abnormal effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 239000012535 impurity Substances 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000009194 climbing Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000630 rising effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B5/00—Applications of checking, fault-correcting, or safety devices in elevators
- B66B5/0006—Monitoring devices or performance analysers
- B66B5/0012—Devices monitoring the users of the elevator system
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B13/00—Doors, gates, or other apparatus controlling access to, or exit from, cages or lift well landings
- B66B13/24—Safety devices in passenger lifts, not otherwise provided for, for preventing trapping of passengers
- B66B13/26—Safety devices in passenger lifts, not otherwise provided for, for preventing trapping of passengers between closing doors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B5/00—Applications of checking, fault-correcting, or safety devices in elevators
- B66B5/0006—Monitoring devices or performance analysers
- B66B5/0018—Devices monitoring the operating condition of the elevator system
- B66B5/0031—Devices monitoring the operating condition of the elevator system for safety reasons
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B5/00—Applications of checking, fault-correcting, or safety devices in elevators
- B66B5/02—Applications of checking, fault-correcting, or safety devices in elevators responsive to abnormal operating conditions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B50/00—Energy efficient technologies in elevators, escalators and moving walkways, e.g. energy saving or recuperation technologies
Abstract
The invention is suitable for the technical field of video processing, and particularly relates to an elevator monitoring system and method based on image recognition, wherein the method comprises the following steps: acquiring a real-time elevator monitoring video; identifying an elevator button area in a real-time elevator monitoring video, and determining the floor where the current elevator is located; carrying out object identification on an elevator door area, judging whether an obstacle influencing the closing of the elevator exists or not, and if the elevator door area is blocked, judging that the elevator door area is free of the obstacle; judging whether an object moves along a door gap in an elevator door area or not; if the object moves along the door gap, an alarm is given and an emergency stop instruction is given to the elevator; if the obstacle is detected, a prompt voice is sent out, and an instruction of forbidding closing is sent out to the elevator. According to the invention, through monitoring the elevator door area, whether an obstacle exists when the door is closed can be judged, and then, after the door is closed, the object at the door gap can be monitored, so that the elevator door is prevented from clamping the object to operate, and the safety of a user is protected to the greatest extent.
Description
Technical Field
The invention belongs to the technical field of video processing, and particularly relates to an elevator monitoring system and method based on image recognition.
Background
The monitoring system is also called as a closed circuit television monitoring system, and a typical monitoring system mainly comprises five parts, namely front-end audio and video acquisition equipment, audio and video transmission equipment and rear-end storage, control and display equipment, wherein the rear-end equipment can be further divided into central control equipment and sub-control equipment. The front-end and back-end devices have various configurations, and the connection between them (also called transmission system) can be realized by various means such as coaxial cable, twisted pair, optical fiber, microwave, wireless, etc.
In current building, all be equipped with the elevator basically, in order to guarantee the safety of elevator, all dispose the monitoring device in the elevator correspondingly, in the background, can look over the condition in the elevator through monitoring device, convenient and safe in utilization.
However, the monitoring device in the elevator at present only plays a role of recording, and is unable to recognize an emergency occurring in the elevator, so that when an accident occurs in the elevator, danger is easily caused.
Disclosure of Invention
An object of the embodiment of the present invention is to provide an elevator monitoring method based on image recognition, which aims to solve the problems proposed in the third part of the background art.
The embodiment of the invention is realized in such a way that an elevator monitoring method based on image recognition comprises the following steps:
acquiring a real-time elevator monitoring video, wherein a monitoring range contained in the real-time elevator monitoring video at least covers an elevator door and an elevator button area;
identifying an elevator button area in a real-time elevator monitoring video, determining the floor where the current elevator is located, and calculating the current floor according to the operation time of the elevator when the elevator button area is shielded;
carrying out object identification on an elevator door area, judging whether an obstacle influencing the closing of the elevator exists or not, and if the elevator door area is blocked, judging that the elevator door area is free of the obstacle;
after the elevator door is closed, continuously monitoring the elevator door area, and judging whether an object moves along the door gap in the elevator door area;
if the object moves along the door gap, an alarm is given and an emergency stop instruction is given to the elevator;
and if an obstacle influencing the door closing of the elevator is detected, sending out a prompt voice and sending out a command of forbidding closing to the elevator.
Preferably, the step of calculating the current floor by the elevator operation time specifically includes:
inquiring the floor of the last stop of the elevator, and calling the closing time of the elevator door when the elevator continuously operates on the floor, wherein the closing time is defined as the starting time;
determining the opening time of an elevator door when the elevator reaches the current floor through a real-time elevator monitoring video, and defining the opening time as the stop time;
and calculating the running time according to the starting time and the stopping time, calculating the number of floors moved by the elevator in the running according to historical data, and determining the floor where the elevator is currently located.
Preferably, the step of identifying the object in the elevator door area and determining whether an obstacle affecting the closing of the elevator door exists specifically includes:
extracting a picture of an elevator door region from a real-time elevator monitoring video, and carrying out gray level processing on the picture;
performing line treatment on the image after the gray level treatment, identifying elevator doors in the image after the line treatment, and judging whether lines among the elevator doors are continuous or not;
if the line between the elevator doors is not continuous, then an obstruction is deemed to be present.
Preferably, after the elevator door is closed, the elevator door area is continuously monitored, and whether an object moves along the door gap exists in the elevator door area is judged, specifically including:
identifying the position of the elevator door in real time, and analyzing the video of the elevator door area in real time after the elevator door is closed;
extracting pictures of a video in the elevator door area, comparing two adjacent pictures, and comparing the change of the door seam position between the two pictures;
when the door gap position is detected to be shielded and the shielded position gradually rises, the object is judged to move along the door gap.
Preferably, in the step of giving an alarm and giving an emergency stop instruction to the elevator, the content of the alarm includes text and voice prompt.
Preferably, the obstruction is removed to permit closing of the elevator doors.
It is another object of an embodiment of the present invention to provide an elevator monitoring system based on image recognition, the system including:
the data acquisition module is used for acquiring a real-time elevator monitoring video, and the monitoring range contained in the real-time elevator monitoring video at least covers an elevator door and an elevator button area;
the elevator positioning module is used for identifying an elevator button area in a real-time elevator monitoring video, determining the floor where the current elevator is located, and calculating the current floor according to the operation time of the elevator when the elevator button area is shielded;
the obstacle detection module is used for identifying objects in the elevator door area, judging whether an obstacle influencing the closing of the elevator exists or not, and if the elevator door area is blocked, judging that the elevator door area is free of the obstacle;
the operation monitoring module is used for continuously monitoring the elevator door area after the elevator door is closed and judging whether an object moves along the door gap in the elevator door area;
if the object moves along the door gap, an alarm is given and an emergency stop instruction is given to the elevator;
and if an obstacle influencing the door closing of the elevator is detected, sending out a prompt voice and sending out a command of forbidding closing to the elevator.
Preferably, the elevator positioning module comprises:
the floor inquiry unit is used for inquiring the floor at which the elevator stops at the last time, calling the closing time of the elevator door when the elevator continuously operates at the floor, and defining the closing time as starting time;
the stop timing unit is used for determining the opening time of the elevator door when the elevator arrives at the current floor through the real-time elevator monitoring video, and the time is defined as the stop time;
and the time calculation unit is used for calculating the operation time according to the starting time and the stopping time, calculating the number of floors moved by the elevator in the operation according to historical data, and determining the floor where the elevator is currently located.
Preferably, the obstacle detection module includes:
the image processing unit is used for extracting a picture of an elevator door region from a real-time elevator monitoring video and carrying out gray level processing on the picture;
and the barrier identification unit is used for carrying out line processing on the image after the gray processing, identifying the elevator doors in the image after the line processing, judging whether lines among the elevator doors are continuous or not, and if the lines among the elevator doors are discontinuous, determining that the barrier exists.
Preferably, the operation monitoring module includes:
the door closing identification unit is used for identifying the position of the elevator door in real time and analyzing the video of the elevator door area in real time after the elevator door is determined to be closed;
the picture comparison unit is used for extracting pictures of the video of the elevator door area, comparing two adjacent pictures and comparing the change of the door gap position between the two pictures;
and the real-time monitoring unit is used for judging that the object moves along the door gap when the door gap position is detected to be shielded and the shielded position gradually rises.
According to the elevator monitoring method based on image recognition, provided by the embodiment of the invention, whether an obstacle exists when the door is closed can be judged by monitoring the elevator door area, and then, after the door is closed, the elevator door can be prevented from clamping the object to operate by monitoring the object at the door gap, so that the safety of a user is protected to the greatest extent.
Drawings
Fig. 1 is a flowchart of an elevator monitoring method based on image recognition according to an embodiment of the present invention;
fig. 2 is a flowchart of the steps provided by the embodiment of the present invention to calculate the current floor by the elevator operation time;
fig. 3 is a flowchart of the steps of performing object identification on an elevator door area and determining whether an obstacle affecting the closing of the elevator door exists according to the embodiment of the present invention;
fig. 4 is a flowchart of the steps of continuously monitoring the elevator door area after the elevator door is closed and determining whether an object moves along the door gap in the elevator door area according to the embodiment of the present invention;
fig. 5 is an architecture diagram of an elevator monitoring system based on image recognition according to an embodiment of the present invention;
fig. 6 is an architecture diagram of an elevator positioning module according to an embodiment of the present invention;
fig. 7 is an architecture diagram of an obstacle detection module according to an embodiment of the present invention;
fig. 8 is an architecture diagram of an operation monitoring module according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms unless otherwise specified. These terms are only used to distinguish one element from another. For example, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script, without departing from the scope of the present application.
In current building, all be equipped with the elevator basically, in order to guarantee the safety of elevator, all dispose monitoring device in the elevator correspondingly, in the background, can look over the condition in the elevator through monitoring device, it is convenient and safe to use. However, the monitoring device in the elevator at present only plays a role of recording, and is unable to recognize an emergency occurring in the elevator, so that when an accident occurs in the elevator, danger is easily caused.
According to the invention, through monitoring the elevator door area, whether an obstacle exists when the door is closed can be judged, and then, after the door is closed, the object at the door gap can be monitored, so that the elevator door is prevented from clamping the object to operate, and the safety of a user is protected to the greatest extent.
As shown in fig. 1, a flowchart of an elevator monitoring method based on image recognition is provided in an embodiment of the present invention, where the method includes:
s100, obtaining a real-time elevator monitoring video, wherein a monitoring range contained in the real-time elevator monitoring video at least covers an elevator door and an elevator button area.
In the step, a real-time elevator monitoring video is obtained, the number of passengers in a monitoring range is counted, the total number of passengers is determined, when the total number of passengers is identified, the number of the passengers entering the elevator is identified in a face mode, the number of the passengers entering the elevator is determined according to the number of the passengers in the face mode, the load of the elevator is analyzed in real time, the number of the passengers is determined according to the change of the load of the elevator, and therefore the number of the passengers in each time is determined; the elevator is characterized in that each elevator is provided with a monitoring device, the monitoring device is used for shooting conditions in the elevator, the installation position of the monitoring device is far away from the elevator door and shoots the elevator door, so that the face of a person can be conveniently identified, in the elevator, impurities are located at the position of the elevator door in two common abnormal conditions, and the elevator door can still be closed due to the fact that the size of obstacles such as the impurities is small and the obstacles are not easily identified by the elevator, so that the obstacles are squeezed, and danger is easily caused.
S200, identifying an elevator button area in the real-time elevator monitoring video, determining the floor where the current elevator is located, and calculating the current floor according to the operation time of the elevator when the elevator button area is shielded.
In this step, discerning the elevator button region in the real-time elevator monitoring video, utilize image recognition's means, discernment elevator presses the pilot lamp that the key region shined, thereby judge the position that the current elevator stopped, this is because for backstage managers, it is very important to know the position of elevator, in case take place abnormal conditions, can arrive corresponding place rapidly according to the position of elevator, can shorten rescue time, create the condition for rescue, but in the elevator operation process, the key region of elevator often can be sheltered from, consequently there is the condition that can't discern easily, then at this moment, then can calculate according to the functioning speed of elevator and the operating time of elevator, in order to confirm the position of elevator.
S300, identifying objects in the elevator door area, judging whether an obstacle influencing the closing of the elevator exists or not, and if the elevator door area is shielded, judging that the elevator door area is free of the obstacle.
In the step, object identification is carried out on the elevator door area, namely, whether sundries and the like exist at the position of the elevator door is judged by utilizing an image identification technology, and when an obstacle exists, the elevator door is not allowed to be closed, so that the elevator is protected, the obstacle is also protected, the danger is avoided, and if no obstacle exists, the elevator can be normally closed; when the obstruction is removed, the elevator doors are permitted to close.
S400, after the elevator door is closed, the elevator door area is continuously monitored, and whether an object moves along the door gap in the elevator door area is judged.
In the step, after the elevator door is closed, the elevator door area is continuously monitored, the position of the door gap is monitored, whether an object moves along the door gap is judged, because the sundries are clamped, the sundries are pulled up by a traction rope along with the rising of the elevator and climb along the position of the door gap, and the object at the position of the door gap is monitored, when the object moves, the object is considered to be abnormal, even if a person in the background is informed, and the elevator stops running; in the step of giving the alarm and giving the emergency stop instruction to the elevator, the alarm content comprises words and voice prompts.
As shown in fig. 2, as a preferred embodiment of the present invention, the step of calculating the current floor by the elevator operation time specifically includes:
s201, inquiring the floor where the elevator stops last time, and calling the time of closing the elevator door when the elevator continuously operates on the floor, wherein the time is defined as starting time.
In this step, the floor at which the elevator stops last time is inquired, and when the elevator stops each time, the position at which the elevator stops at present needs to be determined, specifically, the position can be determined in an image recognition mode, and certainly, the position can also be directly obtained from the control equipment of the elevator.
S202, determining the opening time of the elevator door when the elevator arrives at the current floor through the real-time elevator monitoring video, and defining the opening time as the stop time.
In the step, the opening time of the elevator door when the elevator reaches the current floor is determined through the real-time elevator monitoring video, namely when the elevator reaches the floor of the stop, the opening time of the elevator door is determined according to the opening time of the elevator door in the monitoring video, and the opening time is defined as the stop time.
And S203, calculating the running time according to the starting time and the stopping time, calculating the number of floors moved by the elevator in the running according to historical data, and determining the floor where the elevator is currently located.
In this step, the difference between the starting time and the stopping time is calculated, that is, the time of the current elevator operation, since the speed of the elevator operation is known, it can be calculated according to the historical operation time, and for example, in the historical data, the time required for climbing two floors is 10 seconds, and the time for climbing even three floors is 15 seconds, so that the floor moved this time is calculated according to the current operation time, and since the starting floor is known, the floor at which the elevator stops this time can be determined.
As shown in fig. 3, as a preferred embodiment of the present invention, the step of performing object identification on the elevator door area and determining whether there is an obstacle affecting the closing of the elevator door specifically includes:
s301, extracting a picture of an elevator door area from the real-time elevator monitoring video, and carrying out gray level processing on the picture.
In the step, the picture of the elevator door region is extracted from the real-time elevator monitoring video, namely the video of the elevator door region in the real-time elevator monitoring video is independently intercepted and converted into the picture of one frame, and then all the pictures are subjected to gray level processing to reduce the data processing amount.
And S302, performing line processing on the image after the gray processing, identifying elevator doors in the image after the line processing, judging whether lines among the elevator doors are continuous or not, and if the lines among the elevator doors are discontinuous, determining that an obstacle exists.
In the step, the image after the gray processing is processed into lines, the image is converted into an image mainly comprising the lines, and the elevator door is composed of the lines, and the edge of the bottom of the elevator is also composed of the lines, so that whether the obstacle exists can be judged according to the continuity of the lines.
As shown in fig. 4, as a preferred embodiment of the present invention, the step of continuously monitoring the elevator door area after the elevator door is closed and determining whether an object moves along the door gap exists in the elevator door area specifically includes:
s401, identifying the position of the elevator door in real time, and analyzing the video of the elevator door area in real time after the elevator door is closed.
S402, extracting pictures of the video in the elevator door area, comparing two adjacent pictures, and comparing the change of the door seam position between the two pictures.
In the step, whether the elevator door is in a closed state or not is judged through image recognition, when the elevator door is closed, picture extraction is carried out on the video in the elevator door area, and then whether an object rises along a door gap or not is analyzed.
And S403, when the door gap position is detected to be blocked and the blocked position gradually rises, determining that the object moves along the door gap.
In this step, when the object is detected to rise along the door gap, it is indicated that the object is stuck between the elevator doors, braking needs to be performed in time, and related personnel are notified to check and process the object.
As shown in fig. 5, an elevator monitoring system based on image recognition is provided for an embodiment of the present invention, the system includes:
the data acquisition module 100 is configured to acquire a real-time elevator monitoring video, where a monitoring range included in the real-time elevator monitoring video at least covers an elevator door and an elevator button area.
In the system, a data acquisition module 100 acquires a real-time elevator monitoring video, counts the number of people taking the elevator in a monitoring range, determines the total number of people taking the elevator, performs face identification on people entering the elevator during identification, determines the number of people entering the elevator according to the number of the people on the face, analyzes the load of the elevator in real time, determines the number of people reducing according to the change of the load of the elevator, and thereby determines the number of people taking the elevator each time; the elevator is characterized in that each elevator is provided with a monitoring device, the monitoring device is used for shooting conditions in the elevator, the installation position of the monitoring device is far away from the elevator door and shoots the elevator door, so that the face of a person can be conveniently identified, in the elevator, impurities are located at the position of the elevator door in two common abnormal conditions, and the elevator door can still be closed due to the fact that the size of obstacles such as the impurities is small and the obstacles are not easily identified by the elevator, so that the obstacles are squeezed, and danger is easily caused.
And the elevator positioning module 200 is used for identifying an elevator button area in the real-time elevator monitoring video, determining the floor where the current elevator is located, and calculating the current floor through the elevator operation time when the elevator button area is shielded.
In this system, elevator orientation module 200 discerns the elevator button region in the real-time elevator monitoring video, utilize image recognition's means, the pilot lamp that the discernment elevator pressed the key region and lighted, thereby judge the position that current elevator stopped, this is because to backstage managers, it is very important to know the position of elevator, in case take place abnormal conditions, can arrive corresponding place rapidly according to the position of elevator, can shorten the rescue time, create the condition for rescue, but at elevator operation in-process, the key region of elevator can be sheltered from often, consequently, there is the condition of unable discernment easily, then can calculate according to the functioning speed of elevator and the operating time of elevator, with the position of confirming the elevator.
The obstacle detection module 300 is configured to perform object identification on an elevator door area, determine whether an obstacle affecting the closing of the elevator door exists, and determine that the elevator door area is an obstacle-free obstacle if the elevator door area is blocked.
In the system, the obstacle detection module 300 performs object identification on the elevator door area, namely, the image identification technology is utilized to judge whether sundries and the like exist at the position of the elevator door, when an obstacle exists, the elevator door is not allowed to be closed, the elevator is protected, the obstacle is also protected, danger is avoided, and if no obstacle exists, normal closing can be performed; when the obstruction is removed, the elevator doors are permitted to close.
And the operation monitoring module 400 is used for continuously monitoring the elevator door area after the elevator door is closed, and judging whether an object moves along the door gap in the elevator door area.
In the system, the operation monitoring module 400 continuously monitors the elevator door area after the elevator door is closed, and judges whether an object moves along the door gap by monitoring the position of the door gap, because the object is clamped, the object is pulled up by the traction rope along with the rising of the elevator and climbs along the position of the door gap, and the object at the position of the door gap is monitored, when the object moves, the object is considered to be abnormal, and even if a person in the background is informed, the elevator stops operating; in the step of giving the alarm and giving the emergency stop instruction to the elevator, the alarm content comprises words and voice prompts.
As shown in fig. 6, as a preferred embodiment of the present invention, the elevator positioning module 200 includes:
and the floor inquiring unit 201 is used for inquiring the floor at which the elevator stops last time, and calling the closing time of the elevator door when the elevator continues to operate on the floor, and the closing time is defined as the starting time.
In this module, the floor querying unit 201 queries the floor at which the elevator stops last time, and when the elevator stops each time, the current position at which the elevator stops needs to be determined, specifically, the current position can be determined by adopting an image recognition mode, and certainly, the current position can also be directly obtained from the control device of the elevator.
And a stop timing unit 202, configured to determine, through the real-time elevator monitoring video, a time when the elevator door is opened when the elevator arrives at the current floor, which is defined as a stop time.
In this module, the stop timing unit 202 determines the time of opening the elevator door when the elevator reaches the current floor through the real-time elevator monitoring video, that is, when the elevator reaches the floor at which the elevator stops, the time of opening the elevator door is determined according to the opening time of the elevator door in the monitoring video, and the time of opening the elevator door is determined and defined as the stop time.
And the time calculation unit 203 is used for calculating the running time according to the starting time and the stopping time, calculating the number of floors moved by the elevator in the running according to historical data, and determining the floor where the elevator is currently located.
In this module, the time calculating unit 203 calculates the difference between the starting time and the stopping time, that is, the time of the current elevator operation, and since the speed of the elevator operation is known, it can be calculated according to the historical operation time, of course, the time required for climbing two floors is 10 seconds, and the time of afraid of three floors is 15 seconds, so that the floor of the current movement is calculated according to the current operation time, and since the starting floor is known, the floor of the current stop can be determined.
As shown in fig. 7, as a preferred embodiment of the present invention, the obstacle detection module 300 includes:
the image processing unit 301 is configured to extract a picture of an elevator door region from the real-time elevator monitoring video, and perform gray processing on the picture.
In this module, the image processing unit 301 extracts a picture of the elevator door region from the real-time elevator monitoring video, that is, the video of the elevator door region in the real-time elevator monitoring video is separately captured and converted into a frame-by-frame picture, and then the gray level processing is performed on all the pictures to reduce the data processing amount.
And an obstacle identifying unit 302, configured to perform line processing on the image after the gray processing, identify elevator doors in the image after the line processing, and determine whether lines between the elevator doors are continuous, where if the lines between the elevator doors are discontinuous, it is determined that an obstacle exists.
In this module, the obstacle recognition unit 302 performs line processing on the image after the gray processing, and the image is converted into an image mainly composed of lines, and since the elevator door is composed of lines and the edge of the elevator bottom is also composed of lines, it is possible to determine whether an obstacle exists according to the continuity of the lines.
As shown in fig. 8, as a preferred embodiment of the present invention, the operation monitoring module 400 includes:
the door closing recognition unit 401 is configured to recognize the position of the elevator door in real time, and analyze the video of the elevator door area in real time after determining that the elevator door is closed.
In this module, the door closing recognition unit 401 determines whether the elevator door is in a closed state through image recognition, starts to extract a picture of a video in the elevator door area when the elevator door is closed, and then analyzes whether an object exists in the video and rises along a door gap.
And the picture comparison unit 402 is used for extracting pictures of the video in the elevator door area, comparing two adjacent pictures and comparing the change of the door seam position between the two pictures.
And the real-time monitoring unit 403 is configured to determine that an object moves along the door gap when the door gap is detected to be blocked and the blocked position gradually rises.
In the module, when the object is detected to rise along the door gap, namely the object is indicated to be clamped between the elevator doors, the braking is required to be carried out in time, and related personnel are informed to carry out checking and processing.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of steps in various embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternatingly with other steps or at least a portion of sub-steps or stages of other steps.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (10)
1. An elevator monitoring method based on image recognition is characterized by comprising the following steps:
acquiring a real-time elevator monitoring video, wherein a monitoring range contained in the real-time elevator monitoring video at least covers an elevator door and an elevator button area;
identifying an elevator button area in a real-time elevator monitoring video, determining the floor where the current elevator is located, and calculating the current floor according to the operation time of the elevator when the elevator button area is shielded;
carrying out object identification on an elevator door area, judging whether an obstacle influencing the closing of the elevator door exists or not, and if the elevator door area is shielded, judging that no obstacle exists;
after the elevator door is closed, continuously monitoring the elevator door area, and judging whether an object moves along the door gap in the elevator door area;
if the object moves along the door gap, an alarm is given and an emergency stop instruction is given to the elevator;
and if an obstacle influencing the door closing of the elevator is detected, sending out a prompt voice and sending out a command of forbidding closing to the elevator.
2. The image recognition-based elevator monitoring method according to claim 1, wherein the step of calculating the current floor by the elevator operation time specifically comprises:
inquiring the floor of the last stop of the elevator, and calling the closing time of the elevator door when the elevator continuously operates on the floor, wherein the closing time is defined as the starting time;
determining the opening time of an elevator door when the elevator arrives at the current floor through a real-time elevator monitoring video, and defining the opening time as the stop time;
and calculating the running time according to the starting time and the stopping time, calculating the number of floors moved by the elevator in the running according to historical data, and determining the floor where the elevator is currently located.
3. The image recognition-based elevator monitoring method according to claim 1, wherein the step of performing object recognition on the elevator door area and determining whether an obstacle affecting the closing of the elevator door exists specifically comprises:
extracting a picture of an elevator door region from a real-time elevator monitoring video, and carrying out gray level processing on the picture;
and (3) carrying out line treatment on the image after the gray level treatment, identifying elevator doors in the image after the line treatment, judging whether lines between the elevator doors are continuous or not, and if the lines between the elevator doors are discontinuous, determining that an obstacle exists.
4. The image recognition-based elevator monitoring method according to claim 1, wherein the step of continuously monitoring the elevator door area after the elevator door is closed and judging whether the elevator door area has an object moving along the door gap specifically comprises:
identifying the position of the elevator door in real time, and analyzing the video of the elevator door area in real time after the elevator door is closed;
extracting pictures of the video of the elevator door area, comparing two adjacent pictures, and comparing the change of the door gap position between the two pictures;
when the door gap position is detected to be shielded and the shielded position gradually rises, the object is judged to move along the door gap.
5. The elevator monitoring method based on image recognition according to claim 1, wherein in the step of giving the alarm and giving the emergency stop instruction to the elevator, the alarm content comprises text and voice prompts.
6. The image recognition-based elevator monitoring method according to claim 1, wherein the step of obtaining real-time elevator monitoring video is followed by counting the number of people in the elevator.
7. An elevator monitoring system based on image recognition, the system comprising:
the data acquisition module is used for acquiring a real-time elevator monitoring video, and the monitoring range contained in the real-time elevator monitoring video at least covers an elevator door and an elevator button area;
the elevator positioning module is used for identifying an elevator button area in a real-time elevator monitoring video, determining the floor where the current elevator is located, and calculating the current floor according to the operation time of the elevator when the elevator button area is shielded;
the obstacle detection module is used for identifying objects in the elevator door area, judging whether an obstacle influencing the closing of the elevator exists or not, and if the elevator door area is blocked, judging that the elevator door area is free of the obstacle;
the operation monitoring module is used for continuously monitoring the elevator door area after the elevator door is closed and judging whether an object moves along the door gap in the elevator door area;
if the object moves along the door gap, an alarm is given and an emergency stop instruction is given to the elevator;
and if an obstacle influencing the door closing of the elevator is detected, sending out a prompt voice and sending out a command of forbidding closing to the elevator.
8. The image recognition-based elevator monitoring system of claim 7, wherein the elevator location module comprises:
the floor inquiry unit is used for inquiring the floor at which the elevator stops at the last time, calling the closing time of the elevator door when the elevator continuously operates at the floor, and defining the closing time as starting time;
the stop timing unit is used for determining the opening time of the elevator door when the elevator arrives at the current floor through the real-time elevator monitoring video, and the time is defined as the stop time;
and the time calculation unit is used for calculating the running time according to the starting time and the stopping time, calculating the number of floors moved by the elevator in the running according to historical data, and determining the floor where the elevator is currently located.
9. The image recognition based elevator monitoring system of claim 7, wherein the obstruction detection module comprises:
the image processing unit is used for extracting a picture of an elevator door region from a real-time elevator monitoring video and carrying out gray level processing on the picture;
and the barrier identification unit is used for carrying out line processing on the image after the gray processing, identifying the elevator doors in the image after the line processing, judging whether lines among the elevator doors are continuous or not, and if the lines among the elevator doors are discontinuous, determining that the barrier exists.
10. The image recognition based elevator monitoring system of claim 7 wherein the operation monitoring module comprises:
the door closing identification unit is used for identifying the position of the elevator door in real time and analyzing the video of the elevator door area in real time after the elevator door is determined to be closed;
the picture comparison unit is used for extracting pictures of the video of the elevator door area, comparing two adjacent pictures and comparing the change of the door gap position between the two pictures;
and the real-time monitoring unit is used for judging that the object moves along the door gap when the door gap position is detected to be shielded and the shielded position gradually rises.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210411488.1A CN114735559B (en) | 2022-04-19 | 2022-04-19 | Elevator monitoring system and method based on image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210411488.1A CN114735559B (en) | 2022-04-19 | 2022-04-19 | Elevator monitoring system and method based on image recognition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114735559A true CN114735559A (en) | 2022-07-12 |
| CN114735559B CN114735559B (en) | 2023-10-31 |
Family
ID=82280910
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210411488.1A Active CN114735559B (en) | 2022-04-19 | 2022-04-19 | Elevator monitoring system and method based on image recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114735559B (en) |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1179585A (en) * | 1997-09-09 | 1999-03-23 | Hitachi Ltd | Elevator car position detecting device |
| DE10017333A1 (en) * | 2000-04-07 | 2001-10-18 | Pilz Gmbh & Co | Protective device for safeguarding a dangerous area and method for checking its functional safety has an image capture unit with an image sensor containing multiple light-sensitive image points. |
| US20030168288A1 (en) * | 2002-03-11 | 2003-09-11 | Romeo Deplazes | Door state monitoring by means of three-dimensional sensor |
| JP2009051615A (en) * | 2007-08-27 | 2009-03-12 | Mitsubishi Electric Building Techno Service Co Ltd | Elevator device |
| US20090108987A1 (en) * | 2006-05-31 | 2009-04-30 | Mitsubishi Electric Corporation | Sliding door apparatus and elevator |
| JP2009113932A (en) * | 2007-11-07 | 2009-05-28 | Mitsubishi Electric Corp | Entrance/exit device of elevator |
| JP2011093702A (en) * | 2009-11-02 | 2011-05-12 | Toshiba Elevator Co Ltd | Object caught-in detecting system of elevator |
| JP2012176837A (en) * | 2011-02-28 | 2012-09-13 | Hitachi Ltd | Elevator |
| JP6081555B1 (en) * | 2015-11-11 | 2017-02-15 | 東芝エレベータ株式会社 | Elevator control device that can carry pets |
| CN106966278A (en) * | 2016-01-13 | 2017-07-21 | 东芝电梯株式会社 | The seating detecting system of elevator |
| CN206367970U (en) * | 2017-01-04 | 2017-08-01 | 樱花电梯（中山）有限公司 | A kind of elevator anti-pinch device |
| KR101929838B1 (en) * | 2017-07-14 | 2018-12-17 | 전남대학교산학협력단 | A safety elevator equipped with a device for sensing the insertion of a pet's neck collar |
| CN110002305A (en) * | 2018-12-25 | 2019-07-12 | 浙江新再灵科技股份有限公司 | A kind of elevator door suture detection method and system based on computer vision technique |
| CN110745675A (en) * | 2019-10-17 | 2020-02-04 | 宁波微科光电股份有限公司 | Elevator protection method based on TOF camera |
| CN112850396A (en) * | 2019-11-28 | 2021-05-28 | 宁波微科光电股份有限公司 | Elevator foreign matter detection method and system, computer storage medium and elevator |
| CN113291944A (en) * | 2021-05-21 | 2021-08-24 | 南京喜诗图家具有限公司 | Pet safety protection equipment is used to elevator |
| CN114022767A (en) * | 2021-11-04 | 2022-02-08 | 上海擎朗智能科技有限公司 | Elevator floor positioning method and device, terminal equipment and storage medium |
-
2022
- 2022-04-19 CN CN202210411488.1A patent/CN114735559B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1179585A (en) * | 1997-09-09 | 1999-03-23 | Hitachi Ltd | Elevator car position detecting device |
| DE10017333A1 (en) * | 2000-04-07 | 2001-10-18 | Pilz Gmbh & Co | Protective device for safeguarding a dangerous area and method for checking its functional safety has an image capture unit with an image sensor containing multiple light-sensitive image points. |
| US20030168288A1 (en) * | 2002-03-11 | 2003-09-11 | Romeo Deplazes | Door state monitoring by means of three-dimensional sensor |
| US20090108987A1 (en) * | 2006-05-31 | 2009-04-30 | Mitsubishi Electric Corporation | Sliding door apparatus and elevator |
| JP2009051615A (en) * | 2007-08-27 | 2009-03-12 | Mitsubishi Electric Building Techno Service Co Ltd | Elevator device |
| JP2009113932A (en) * | 2007-11-07 | 2009-05-28 | Mitsubishi Electric Corp | Entrance/exit device of elevator |
| JP2011093702A (en) * | 2009-11-02 | 2011-05-12 | Toshiba Elevator Co Ltd | Object caught-in detecting system of elevator |
| JP2012176837A (en) * | 2011-02-28 | 2012-09-13 | Hitachi Ltd | Elevator |
| JP6081555B1 (en) * | 2015-11-11 | 2017-02-15 | 東芝エレベータ株式会社 | Elevator control device that can carry pets |
| CN106966278A (en) * | 2016-01-13 | 2017-07-21 | 东芝电梯株式会社 | The seating detecting system of elevator |
| CN206367970U (en) * | 2017-01-04 | 2017-08-01 | 樱花电梯（中山）有限公司 | A kind of elevator anti-pinch device |
| KR101929838B1 (en) * | 2017-07-14 | 2018-12-17 | 전남대학교산학협력단 | A safety elevator equipped with a device for sensing the insertion of a pet's neck collar |
| CN110002305A (en) * | 2018-12-25 | 2019-07-12 | 浙江新再灵科技股份有限公司 | A kind of elevator door suture detection method and system based on computer vision technique |
| CN110745675A (en) * | 2019-10-17 | 2020-02-04 | 宁波微科光电股份有限公司 | Elevator protection method based on TOF camera |
| CN112850396A (en) * | 2019-11-28 | 2021-05-28 | 宁波微科光电股份有限公司 | Elevator foreign matter detection method and system, computer storage medium and elevator |
| CN113291944A (en) * | 2021-05-21 | 2021-08-24 | 南京喜诗图家具有限公司 | Pet safety protection equipment is used to elevator |
| CN114022767A (en) * | 2021-11-04 | 2022-02-08 | 上海擎朗智能科技有限公司 | Elevator floor positioning method and device, terminal equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114735559B (en) | 2023-10-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11760605B2 (en) | Elevator door monitoring system, elevator system and elevator door monitoring method | |
| CN109657608B (en) | Trailing analysis method based on face recognition technology | |
| US20190100412A1 (en) | Elevator door control system for detection of obstacle trapping | |
| CN108928700B (en) | Hospital elevator safety three-dimensional monitoring cloud platform, system and method thereof, and elevator system | |
| KR100797932B1 (en) | A safe management system of subway door | |
| CN109019225B (en) | Detection method and system for early warning of door closing risk of abnormally blocked elevator | |
| CN110830765A (en) | Gate control method, system, gate, computer device and storage medium | |
| CN110930569B (en) | Security check control method and system | |
| CN110189449B (en) | Gate control method, device and system | |
| CN110675582A (en) | Automatic alarm method and device | |
| CN113239758A (en) | Elevator monitoring method and system based on face matching and electric vehicle matching | |
| CN112357707A (en) | Elevator detection method and device, robot and storage medium | |
| CN114999141A (en) | Battery car parking management method, device, equipment, system and readable storage medium | |
| CN114735559A (en) | Elevator monitoring system and method based on image recognition | |
| CN111776905B (en) | Battery car elevator entering warning method and system combining re-identification | |
| CN110443931B (en) | Hospital access control system and control method | |
| CN114701934B (en) | Security control method, device and system for elevator, cloud platform and storage medium | |
| CN109779445B (en) | Fire door control method and device, computer equipment and storage medium | |
| CN108230498A (en) | A kind of Household security system for identifying courier | |
| CN113450489B (en) | Power communication equipment maintenance and repair remote authorization management method and equipment and computer storage medium | |
| CN111946384B (en) | Air door control method, device, equipment and system | |
| JP5682325B2 (en) | Security system | |
| CN111252640B (en) | Recognition and supervision method for preventing smoking in elevator | |
| CN113530397A (en) | Electric door opening distance detection method and system for voice control electric door | |
| CN110867006A (en) | Pedestrian passageway gate machine, control method thereof and pedestrian passageway gate machine system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |