CN112184737A - Children take alone elevator detection and alarm system based on image analysis - Google Patents
Children take alone elevator detection and alarm system based on image analysis Download PDFInfo
- Publication number
- CN112184737A CN112184737A CN202011079120.7A CN202011079120A CN112184737A CN 112184737 A CN112184737 A CN 112184737A CN 202011079120 A CN202011079120 A CN 202011079120A CN 112184737 A CN112184737 A CN 112184737A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- elevator
- warning
- children
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000010191 image analysis Methods 0.000 title claims abstract description 17
- 238000001514 detection method Methods 0.000 title claims abstract description 15
- 238000007405 data analysis Methods 0.000 claims description 41
- 238000004458 analytical method Methods 0.000 claims description 4
- 238000000034 method Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 4
- 238000012790 confirmation Methods 0.000 claims description 3
- 238000013480 data collection Methods 0.000 claims description 3
- 238000013500 data storage Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 238000004806 packaging method and process Methods 0.000 claims description 2
- 239000000284 extract Substances 0.000 abstract 1
- 208000027418 Wounds and injury Diseases 0.000 description 4
- 230000006378 damage Effects 0.000 description 4
- 208000014674 injury Diseases 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/53—Recognition of crowd images, e.g. recognition of crowd congestion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/182—Level alarms, e.g. alarms responsive to variables exceeding a threshold
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B7/00—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
- G08B7/06—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B50/00—Energy efficient technologies in elevators, escalators and moving walkways, e.g. energy saving or recuperation technologies
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Geometry (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Indicating And Signalling Devices For Elevators (AREA)
Abstract
The invention discloses a children independent elevator detection and alarm system based on image analysis, which reads the distance data of people entering an elevator by taking a multi-view camera as an information acquisition port, extracts a portrait area in a picture when the elevator is started by an RGB (red, green and blue) camera, guides the area back to the shot picture, reads the partial characteristics of the portrait in the shot picture, scans the portrait by a TOF (time of flight) camera to establish a three-dimensional model of the people, combines the portrait with partial characteristic data of the portrait to establish a real three-dimensional portrait model so as to judge whether children enter the elevator or not, compares all real three-dimensional model data entering the elevator with pre-stored information in a database so as to judge whether the children entering the elevator enter the elevator independently or not, and then gives an alarm, reminds and dissuages the children when the children take the elevator independently, Remind and persuade, avoid children to take the elevator alone and lead to the emergence of accident.
Description
Technical Field
The invention relates to the technical field of elevator safety systems, in particular to a children's independent elevator detection and alarm system based on image analysis.
Background
In the modern society, the elevator becomes an indispensable tool in people's life, and while the elevator brings various conveniences to modern people's life, accidents such as elevator sliding, elevator failure, elevator outage and the like and frequent tragedies bring injuries to countless families, especially children who take the elevator alone, because the children are small and the elevator is easy to jump in the elevator and to push the buttons in disorder due to the small children and the skin adjustment, the accident rate of the elevator is greatly increased, and because the mind is immature, the elevator can not effectively ask for help when the elevator is in failure, and is easy to make dangerous actions in the elevator to cause self injury or even death, therefore, the children taking the elevator, especially the children taking the elevator alone, have quite high safety hazards, therefore, in order to prevent accidents caused by the fact that children take the elevator independently, the invention provides a detection device and a detection system of a detection and alarm system for children taking the elevator independently based on image analysis.
Disclosure of Invention
The invention aims to provide a detection and alarm system for a child to take an elevator alone based on image analysis, which solves the problems that the accident rate of the elevator is greatly increased because the child taking the elevator alone, especially the child taking the elevator alone, is small and easy to jump and press buttons in the elevator due to the fact that the child is small and the child is not well-conditioned, the child cannot ask for help effectively when the elevator fails, and the child is easy to make dangerous actions in the elevator to cause self injury or even death.
In order to achieve the purpose, the invention provides the following technical scheme: a children's independent elevator detection system based on image analysis comprises a data acquisition module, a data analysis module, a data transceiver module, a remote port module and a warning module, wherein the data acquisition module is unidirectionally connected with the data analysis module;
the data acquisition module comprises: the elevator monitoring system comprises an image acquisition module and a person acquisition module, wherein the image acquisition module is used for acquiring personnel images entering an elevator, the person acquisition module is used for acquiring personnel conditions entering the elevator, and the data acquisition module is used for acquiring personnel images entering the elevator through the image acquisition module, acquiring personnel conditions entering the elevator through the person acquisition module, packaging and transmitting acquired data to a data analysis module;
the data analysis module is used for receiving the data information transmitted by the data acquisition module, analyzing the information to obtain the condition of people entering the elevator, judging whether children take the elevator or not, comparing the information with the database to obtain whether the children taking the elevator take the elevator alone or not, and transmitting the result to the data transceiver module, wherein the database stores unmanned RGB image information and resident personnel information after the elevator is started;
the data receiving and sending module is used for transmitting the result analyzed by the data analysis module and the data acquired by the data acquisition module to the remote port module, transmitting different information to the warning module according to the result, receiving a control signal transmitted by the remote port module, and controlling the warning module through the control signal;
the remote port module is used for receiving the data result analyzed by the data analysis module and the image data acquired by the data acquisition module, transmitting a control signal to the data transceiver module, and simultaneously pushing warning information and propaganda safety education videos into the elevator through the remote port module;
the warning module is used for sending warning information;
the children's elevator detection system of singly taking on based on image analysis specifically as follows:
(1) the system comprises an image acquisition module, a person acquisition module, a data analysis module, a data storage module and a data processing module, wherein the image acquisition module is used for acquiring images of persons entering an elevator, the person acquisition module is used for acquiring conditions of the persons entering the elevator, and the acquired data are packaged and transmitted to the data analysis module;
(2) the data analysis module is used for receiving the data information transmitted by the data acquisition module and analyzing the information to obtain the condition of personnel entering the elevator, judging whether children take the elevator or not, comparing the information with the database to obtain whether the children taking the elevator take the elevator or not, and transmitting the result to the data transceiver module;
(3) the data receiving and sending module is used for transmitting the analysis result of the data analysis module and the data collected by the data collection module to the remote port module, and transmitting different information to the warning module according to the result;
(4) the warning module carries out warning broadcasting according to the information transmitted by the data receiving and transmitting module;
(5) the remote port module receives the data result analyzed by the data analysis module and the image data acquired by the data acquisition module, an operator sends an instruction to the data transceiver module through the remote port module, and the data transceiver module is controlled to transmit a control signal to the warning module through the instruction.
Further, the image acquisition module is for shooing the camera module, people collection module is including location camera module, RGB camera module and TOF camera module, location camera module is made for binocular range finding camera, and shoots camera module, location camera module, RGB camera module and TOF camera module all fixed mounting in the elevator, shoot the central point that camera module is located between the binocular range finding camera of location camera module and put, and equal high installation, data acquisition module specifically is as follows:
(1) when the elevator door is opened, the shooting camera module and the positioning camera module are started;
(2) the shooting camera module is started to shoot people entering the elevator, and the image data is marked as data P;
(3) the positioning camera module is started to shoot people entering the elevator, the distance between the people entering the elevator and the camera and the height of the people are measured according to the binocular camera principle, the distance data are marked as data D, and the height of the people is marked as data Hr;
(4) when data lower than the warning line value exists in Hr, starting a TOF camera module and starting an RGB camera module; .
(5) The TOF camera module is started to photograph people entering the elevator to obtain depth image data, and the depth image data is marked as data T;
(6) the RGB camera module analyzes and decodes the data P, converts the data P into an RGB image and marks the RGB image as data R;
(7) data P, D, T and R are imported into the data analysis module.
Further, the warning line numerical value can be provided with a plurality of, and a plurality of warning line numerical values divide into first warning line numerical value, second warning line numerical value, third warning line numerical value and nth warning line numerical value from low to high in proper order.
Further, the data analysis module specifically includes:
1) receive data P, D, T and R;
2) comparing the data R with the RGB image data stored in the database when no elevator is in person, finding out different RGB image areas in the two data, marking the RGB image areas as Hn, and taking n as 0-infinity;
I) the first distinct RGB image area is labeled H1;
II) a second distinct RGB image area labeled H2;
III) the nth different RGB image area is marked as Hn;
3) extracting data Hn, substituting the Hn data into data P and T, and marking corresponding areas in P and T respectively;
4) extracting a marked region in the data P, identifying the extracted region by a computer, and extracting an identified portrait which is marked as rn, wherein n is 1-infinity;
I) marking the extracted first portrait as r 1;
II) recording the extracted second portrait as r 2;
III) marking the n-th extracted portrait as rn;
5) calculating the height Hpn of the portrait rn in the data P, wherein n is 1- ∞;
6) bring Hpn into
In the method, the actual height Hzn of the portrait is calculated, n is 1-infinity, f is the focal length of a camera in a shooting camera module, Hpn is the height of the portrait rn in data P, Hzn is the actual height of Hpn corresponding to the portrait, and D is the distance between a person entering the elevator and the shooting camera module;
7) extracting Hzn the figures rn and Hzn the figures rn of which the numerical values are less than the warning line numerical value and are respectively marked as Qxn and Qdn, and the values of n in Qxn and Qdn are the same as the values of n in rn corresponding to Qxn and Qdn;
8) substituting regions corresponding to Qxn and Qdn into T data;
9) extracting depth data of regions corresponding to Qxn and Qdn from the T data, and respectively recording the depth data as Sxn and Sdn, wherein the value of n in the Sxn and Sdn is the same as the value of n in rn corresponding to Qxn and Qdn;
10) combining the portrait data of rn corresponding to Sxn and Qxn to obtain real physiognomic three-dimensional data Zrn with the height lower than the numerical value of a warning line, wherein the value of n in Zrn is the same as the numerical value of n in rn corresponding to Qxn;
11) combining the portrait data of rn corresponding to Sdn and Qdn to obtain true-appearance three-dimensional data Zdn of the person with the height higher than the warning line value, wherein the value of n in Zdn is the same as the value of n in rn corresponding to Qdn;
12) detecting whether the personnel corresponding to Zrn and Zdn belong to children or not by comparing the big data of the human body limb shape of the computer, marking the children as RTn and the adults as CNn, wherein the values of n in the RTn and the CNn are the same as the values of n in Zrn and Zdn;
13) respectively retrieving data corresponding to the RTn and personnel data corresponding to the CNn in a database, respectively comparing the data corresponding to the RTn with the personnel data corresponding to the CNn, observing whether a relation exists, and further judging whether children enter the elevator independently;
14) and transmitting the result to the data transceiver module.
Further, the determination manner in step 12) is specifically as follows:
1) when the corresponding data are not retrieved from the database by the RTn and no CNn data exist, the rn children are judged to enter the elevator independently;
2) when the corresponding data is not retrieved from the database by the data RTn and the data does not have a relationship with the corresponding data retrieved from the database by the CNn, judging that rn children enter the elevator independently;
3) when the corresponding data are not retrieved from the database by the data RTn and the data are in a relation with the corresponding data retrieved from the database by the CNn, judging that rn children do not enter the elevator independently;
4) and when the data RTn does not retrieve corresponding data from the database and the data CNn does not retrieve corresponding data from the database, judging rn unknown personnel to enter the elevator.
Further, the data transceiver module specifically comprises the following steps:
1) when the data transceiver module receives that the child does not enter the elevator independently, the data P and the conclusion that the child does not enter the elevator independently are transmitted to the remote client module;
2) when the data receiving and sending module receives that an unknown person enters the elevator, the data P, the RTn and the CNn of the unknown person are transmitted to the remote client module, a confirmation instruction is sent to an elevator manager through an alarm module in the warning module, and the elevator manager manually turns on and off an alarm after confirming with the elevator person through the remote client module;
3) when the data transceiver module receives the result that the child enters the elevator independently, the data P, Zrn and the conclusion that the child enters the elevator independently are transmitted to the remote client module, and meanwhile, an alarm instruction is transmitted to the alarm module.
The utility model provides a children take advantage of elevator alarm system alone based on image analysis, alarm system includes alarm module and on-the-spot warning module, alarm module and on-the-spot warning module all with warning module one-way connection:
the alarm module is used for giving an alarm to an elevator manager;
the on-site warning module comprises a language broadcast warning module and a flashing light warning module, the language broadcast warning module is used for voice broadcast to remind children who enter the elevator alone of not entering the elevator alone and keeping away from the elevator, and the flashing light warning module is used for flashing warning light to remind children who enter the elevator alone of keeping away from the elevator.
Further, the alarm system is as follows:
1) the alarm system receives the warning instruction;
2) the alarm module rapidly gives an alarm to an elevator manager, and the elevator manager can directly call the children through the remote client module;
3) meanwhile, the voice broadcast warning module reminds children who enter the elevator independently not to enter the elevator independently and to be far away from the elevator through voice broadcast;
4) meanwhile, the flashing light warning module flashes the warning light back and forth;
5) the elevator manager can manually and independently close and open the language broadcast warning module and the flashing light warning module in the warning system through the remote client module.
Compared with the prior art, the invention has the beneficial effects that: the invention takes a multi-camera as an information acquisition port, utilizes a positioning camera to read distance data of people entering an elevator, leads the data into a system, utilizes an RGB camera to extract a portrait area in a photo shot when the elevator is started, leads the area back to the photo shot by a shooting camera module, further reads a portrait in the photo shot by the shooting camera module and partial characteristics of the portrait, scans the people entering the elevator when the elevator is started through a TOF camera so as to establish a three-dimensional model of the people, then combines the established three-dimensional model and partial characteristic data of the portrait in the photo shot by the shooting camera module to establish a real three-dimensional portrait model with the same size as a real object, judges whether children enter the elevator or not through the real three-dimensional portrait model, and then compares all real three-dimensional model data entering the elevator with pre-stored information in a database, the elevator alarm system can effectively prevent children from taking the elevator independently and give an alarm to elevator workers in time when the children take the elevator independently, and can simultaneously give an alarm, remind and dissuade the children ready to enter the elevator so as to prevent the children from taking the elevator independently and further avoiding self injury and even death events; supporting drawing a plurality of warning lines; the method has the advantages that based on the human body limb form big data analysis technology, whether children are in the walking state or not is assisted and identified through the form and the posture of the walking person, and the system misinformation caused by height problems of special groups is avoided; uploading an alarm picture and a linkage alarm video of a central monitoring room in real time, and when a child takes the elevator alone, reading floor elevator information on a picture by a system based on image analysis, and informing security personnel to arrive at the site in time; warning information is pushed in a targeted mode, and safety education videos are publicized.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a block diagram of the system of the present invention;
FIG. 2 is a schematic diagram of the detection of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the present invention provides a technical solution: a children's elevator detecting system of singly taking on based on image analysis, includes data acquisition module, data analysis module, data transceiver module, long-range port module and warning module, data acquisition module and data analysis module one-way connection, data analysis module and data transceiver module one-way connection, data transceiver module and long-range port module both way junction, data transceiver module and warning module one-way connection.
The data acquisition module comprises: the elevator monitoring system comprises an image acquisition module and a person acquisition module, wherein the image acquisition module is used for acquiring personnel images entering an elevator, the person acquisition module is used for acquiring personnel conditions entering the elevator, the data acquisition module is used for acquiring personnel images entering the elevator through the image acquisition module and personnel conditions entering the elevator through the person acquisition module, and the acquired data are packaged and transmitted to the data analysis module.
The data analysis module is used for receiving the data information transmitted by the data acquisition module, analyzing the information to obtain the condition of people entering the elevator, judging whether children take the elevator or not, comparing the data to obtain the result, judging whether the children taking the elevator take the elevator or not, transmitting the result to the data receiving and transmitting module, and storing unmanned RGB image information and resident personnel information after the elevator is started in the database.
The data receiving and sending module is used for transmitting the analysis result of the data analysis module and the data acquired by the data acquisition module to the remote port module, transmitting different information to the warning module according to the result, receiving the control signal transmitted by the remote port module, and controlling the warning module through the control signal.
The remote port module is used for receiving data results analyzed by the data analysis module and image data acquired by the data acquisition module, transmitting control signals to the data receiving and transmitting module, and meanwhile, warning information and propaganda safety education videos can be pushed into the elevator through the remote port module.
The warning module is used for sending warning information.
The children's elevator detection system of singly taking on based on image analysis specifically as follows:
(1) the system comprises an image acquisition module, a person acquisition module, a data analysis module, a data storage module and a data processing module, wherein the image acquisition module is used for acquiring images of persons entering an elevator, the person acquisition module is used for acquiring conditions of the persons entering the elevator, and the acquired data are packaged and transmitted to the data analysis module;
(2) the data analysis module is used for receiving the data information transmitted by the data acquisition module and analyzing the information to obtain the condition of personnel entering the elevator, judging whether children take the elevator or not, comparing the information with the database to obtain whether the children taking the elevator take the elevator or not, and transmitting the result to the data transceiver module;
(3) the data receiving and sending module is used for transmitting the analysis result of the data analysis module and the data collected by the data collection module to the remote port module, and transmitting different information to the warning module according to the result;
(4) the warning module carries out warning broadcasting according to the information transmitted by the data receiving and transmitting module;
(5) the remote port module receives the data result analyzed by the data analysis module and the image data acquired by the data acquisition module, an operator sends an instruction to the data transceiver module through the remote port module, and the data transceiver module is controlled to transmit a control signal to the warning module through the instruction.
The image acquisition module is for shooing the camera module, personage's collection module is including location camera module, RGB camera module and TOF camera module, location camera module is made for binocular range finding camera, and shoots camera module, location camera module, RGB camera module and TOF camera module all fixed mounting in the elevator, shoot the central point that camera module is located between the binocular range finding camera of location camera module and put, and equal high installation, data acquisition module specifically as follows:
(1) when the elevator door is opened, the shooting camera module and the positioning camera module are started;
(2) the shooting camera module is started to shoot people entering the elevator, and the image data is marked as data P;
(3) the positioning camera module is started to shoot people entering the elevator, the distance between the people entering the elevator and the camera and the height of the people are measured according to the binocular camera principle, the distance data are marked as data D, and the height of the people is marked as data Hr;
(4) when data lower than the warning line value exists in Hr, starting a TOF camera module and starting an RGB camera module; .
(5) The TOF camera module is started to photograph people entering the elevator to obtain depth image data, and the depth image data is marked as data T;
(6) the RGB camera module analyzes and decodes the data P, converts the data P into an RGB image and marks the RGB image as data R;
(7) data P, D, T and R are imported into the data analysis module.
The warning line numerical value can be provided with a plurality ofly, and a plurality of warning line numerical values divide into first warning line numerical value, second warning line numerical value, third warning line numerical value and nth warning line numerical value from low to high in proper order.
The data analysis module specifically comprises the following modules:
1) receive data P, D, T and R;
2) comparing the data R with the RGB image data stored in the database when no elevator is in person, finding out different RGB image areas in the two data, marking the RGB image areas as Hn, and taking n as 0-infinity;
I) the first distinct RGB image area is labeled H1;
II) a second distinct RGB image area labeled H2;
III) the nth different RGB image area is marked as Hn;
3) extracting data Hn, substituting the Hn data into data P and T, and marking corresponding areas in P and T respectively;
4) extracting a marked region in the data P, identifying the extracted region by a computer, and extracting an identified portrait which is marked as rn, wherein n is 1-infinity;
I) marking the extracted first portrait as r 1;
II) recording the extracted second portrait as r 2;
III) marking the n-th extracted portrait as rn;
5) calculating the height Hpn of the portrait rn in the data P, wherein n is 1- ∞;
6) bring Hpn into
In the method, the actual height Hzn of the portrait is calculated, n is 1-infinity, f is the focal length of a camera in a shooting camera module, Hpn is the height of the portrait rn in data P, Hzn is the actual height of Hpn corresponding to the portrait, and D is the distance between a person entering the elevator and the shooting camera module;
7) extracting Hzn the figures rn and Hzn the figures rn of which the numerical values are less than the warning line numerical value and are respectively marked as Qxn and Qdn, and the values of n in Qxn and Qdn are the same as the values of n in rn corresponding to Qxn and Qdn;
8) substituting regions corresponding to Qxn and Qdn into T data;
9) extracting depth data of regions corresponding to Qxn and Qdn from the T data, and respectively recording the depth data as Sxn and Sdn, wherein the value of n in the Sxn and Sdn is the same as the value of n in rn corresponding to Qxn and Qdn;
10) combining the portrait data of rn corresponding to Sxn and Qxn to obtain real physiognomic three-dimensional data Zrn with the height lower than the numerical value of a warning line, wherein the value of n in Zrn is the same as the numerical value of n in rn corresponding to Qxn;
11) combining the portrait data of rn corresponding to Sdn and Qdn to obtain true-appearance three-dimensional data Zdn of the person with the height higher than the warning line value, wherein the value of n in Zdn is the same as the value of n in rn corresponding to Qdn;
12) detecting whether the personnel corresponding to Zrn and Zdn belong to children or not by comparing the big data of the human body limb shape of the computer, marking the children as RTn and the adults as CNn, wherein the values of n in the RTn and the CNn are the same as the values of n in Zrn and Zdn;
13) respectively retrieving data corresponding to the RTn and personnel data corresponding to the CNn in a database, respectively comparing the data corresponding to the RTn with the personnel data corresponding to the CNn, observing whether a relation exists, and further judging whether children enter the elevator independently;
14) and transmitting the result to the data transceiver module.
The judgment mode in the step 12) is as follows:
1) when the corresponding data are not retrieved from the database by the RTn and no CNn data exist, the rn children are judged to enter the elevator independently;
2) when the corresponding data is not retrieved from the database by the data RTn and the data does not have a relationship with the corresponding data retrieved from the database by the CNn, judging that rn children enter the elevator independently;
3) when the corresponding data are not retrieved from the database by the data RTn and the data are in a relation with the corresponding data retrieved from the database by the CNn, judging that rn children do not enter the elevator independently;
4) and when the data RTn does not retrieve corresponding data from the database and the data CNn does not retrieve corresponding data from the database, judging rn unknown personnel to enter the elevator.
The data transceiver module comprises the following specific steps:
1) when the data transceiver module receives that the child does not enter the elevator independently, the data P and the conclusion that the child does not enter the elevator independently are transmitted to the remote client module;
2) when the data receiving and sending module receives that an unknown person enters the elevator, the data P, the RTn and the CNn of the unknown person are transmitted to the remote client module, a confirmation instruction is sent to an elevator manager through an alarm module in the warning module, and the elevator manager manually turns on and off an alarm after confirming with the elevator person through the remote client module;
3) when the data transceiver module receives the result that the child enters the elevator independently, the data P, Zrn and the conclusion that the child enters the elevator independently are transmitted to the remote client module, and meanwhile, an alarm instruction is transmitted to the alarm module.
The utility model provides a children take advantage of elevator alarm system alone based on image analysis which characterized in that: alarm system includes alarm module and on-the-spot warning module, alarm module and on-the-spot warning module all with warning module one-way connection:
the alarm module is used for giving an alarm to an elevator manager;
the on-site warning module comprises a language broadcast warning module and a flashing light warning module, the language broadcast warning module is used for voice broadcast to remind children who enter the elevator alone of not entering the elevator alone and keeping away from the elevator, and the flashing light warning module is used for flashing warning light to remind children who enter the elevator alone of keeping away from the elevator.
The alarm system is characterized in that:
1) the alarm system receives the warning instruction;
2) the alarm module rapidly gives an alarm to an elevator manager, and the elevator manager can directly call the children through the remote client module;
3) meanwhile, the voice broadcast warning module reminds children who enter the elevator independently not to enter the elevator independently and to be far away from the elevator through voice broadcast;
4) meanwhile, the flashing light warning module flashes the warning light back and forth;
5) the elevator manager can manually and independently close and open the language broadcast warning module and the flashing light warning module in the warning system through the remote client module.
In the description herein, references to the description of "one embodiment," "an example," "a specific example" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (8)
1. A children's independent elevator detection system based on image analysis is characterized by comprising a data acquisition module, a data analysis module, a data transceiver module, a remote port module and a warning module, wherein the data acquisition module is unidirectionally connected with the data analysis module;
the data acquisition module comprises: the elevator monitoring system comprises an image acquisition module and a person acquisition module, wherein the image acquisition module is used for acquiring personnel images entering an elevator, the person acquisition module is used for acquiring personnel conditions entering the elevator, and the data acquisition module is used for acquiring personnel images entering the elevator through the image acquisition module, acquiring personnel conditions entering the elevator through the person acquisition module, packaging and transmitting acquired data to a data analysis module;
the data analysis module is used for receiving the data information transmitted by the data acquisition module, analyzing the information to obtain the condition of people entering the elevator, judging whether children take the elevator or not, comparing the information with the database to obtain whether the children taking the elevator take the elevator alone or not, and transmitting the result to the data transceiver module, wherein the database stores unmanned RGB image information and resident personnel information after the elevator is started;
the data receiving and sending module is used for transmitting the result analyzed by the data analysis module and the data acquired by the data acquisition module to the remote port module, transmitting different information to the warning module according to the result, receiving a control signal transmitted by the remote port module, and controlling the warning module through the control signal;
the remote port module is used for receiving the data result analyzed by the data analysis module and the image data acquired by the data acquisition module, transmitting a control signal to the data transceiver module, and simultaneously pushing warning information and propaganda safety education videos into the elevator through the remote port module;
the warning module is used for sending warning information;
the children's elevator detection system of singly taking on based on image analysis specifically as follows:
(1) the system comprises an image acquisition module, a person acquisition module, a data analysis module, a data storage module and a data processing module, wherein the image acquisition module is used for acquiring images of persons entering an elevator, the person acquisition module is used for acquiring conditions of the persons entering the elevator, and the acquired data are packaged and transmitted to the data analysis module;
(2) the data analysis module is used for receiving the data information transmitted by the data acquisition module and analyzing the information to obtain the condition of personnel entering the elevator, judging whether children take the elevator or not, comparing the information with the database to obtain whether the children taking the elevator take the elevator or not, and transmitting the result to the data transceiver module;
(3) the data receiving and sending module is used for transmitting the analysis result of the data analysis module and the data collected by the data collection module to the remote port module, and transmitting different information to the warning module according to the result;
(4) the warning module carries out warning broadcasting according to the information transmitted by the data receiving and transmitting module;
(5) the remote port module receives the data result analyzed by the data analysis module and the image data acquired by the data acquisition module, an operator sends an instruction to the data transceiver module through the remote port module, and the data transceiver module is controlled to transmit a control signal to the warning module through the instruction.
2. The system for detecting the children's independent elevator based on the image analysis of claim 1, wherein the image acquisition module is a shooting camera module, the person acquisition module comprises a positioning camera module, an RGB camera module and a TOF camera module, the positioning camera module is made of a binocular ranging camera, the shooting camera module, the positioning camera module, the RGB camera module and the TOF camera module are all fixedly installed in the elevator, the shooting camera module is located at the center position between the binocular ranging cameras of the positioning camera module and installed at the same height, and the data acquisition module comprises the following components:
(1) when the elevator door is opened, the shooting camera module and the positioning camera module are started;
(2) the shooting camera module is started to shoot people entering the elevator, and the image data is marked as data P;
(3) the positioning camera module is started to shoot people entering the elevator, the distance between the people entering the elevator and the camera and the height of the people are measured according to the binocular camera principle, the distance data are marked as data D, and the height of the people is marked as data Hr;
(4) when data lower than the warning line value exists in Hr, starting a TOF camera module and starting an RGB camera module; .
(5) The TOF camera module is started to photograph people entering the elevator to obtain depth image data, and the depth image data is marked as data T;
(6) the RGB camera module analyzes and decodes the data P, converts the data P into an RGB image and marks the RGB image as data R;
(7) data P, D, T and R are imported into the data analysis module.
3. The system for detecting the children's independent elevator based on the image analysis as claimed in claim 2, wherein: the warning line numerical value can be provided with a plurality ofly, and a plurality of warning line numerical values divide into first warning line numerical value, second warning line numerical value, third warning line numerical value and nth warning line numerical value from low to high in proper order.
4. The system of claim 1, wherein the system comprises: the data analysis module is as follows:
1) receive data P, D, T and R;
2) comparing the data R with the RGB image data stored in the database when no elevator is in person, finding out different RGB image areas in the two data, marking the RGB image areas as Hn, and taking n as 0-infinity;
I) the first distinct RGB image area is labeled H1;
II) a second distinct RGB image area labeled H2;
III) the nth different RGB image area is marked as Hn;
3) extracting data Hn, substituting the Hn data into data P and T, and marking corresponding areas in P and T respectively;
4) extracting a marked region in the data P, identifying the extracted region by a computer, and extracting an identified portrait which is marked as rn, wherein n is 1-infinity;
I) marking the extracted first portrait as r 1;
II) recording the extracted second portrait as r 2;
III) marking the n-th extracted portrait as rn;
5) calculating the height Hpn of the portrait rn in the data P, wherein n is 1- ∞;
6) bring Hpn into
In the method, the actual height Hzn of the portrait is calculated, n is 1-infinity, f is the focal length of a camera in a shooting camera module, Hpn is the height of the portrait rn in data P, Hzn is the actual height of Hpn corresponding to the portrait, and D is the distance between a person entering the elevator and the shooting camera module;
7) extracting Hzn the figures rn and Hzn the figures rn of which the numerical values are less than the warning line numerical value and are respectively marked as Qxn and Qdn, and the values of n in Qxn and Qdn are the same as the values of n in rn corresponding to Qxn and Qdn;
8) substituting regions corresponding to Qxn and Qdn into T data;
9) extracting depth data of regions corresponding to Qxn and Qdn from the T data, and respectively recording the depth data as Sxn and Sdn, wherein the value of n in the Sxn and Sdn is the same as the value of n in rn corresponding to Qxn and Qdn;
10) combining the portrait data of rn corresponding to Sxn and Qxn to obtain real physiognomic three-dimensional data Zrn with the height lower than the numerical value of a warning line, wherein the value of n in Zrn is the same as the numerical value of n in rn corresponding to Qxn;
11) combining the portrait data of rn corresponding to Sdn and Qdn to obtain true-appearance three-dimensional data Zdn of the person with the height higher than the warning line value, wherein the value of n in Zdn is the same as the value of n in rn corresponding to Qdn;
12) detecting whether the personnel corresponding to Zrn and Zdn belong to children or not by comparing the big data of the human body limb shape of the computer, marking the children as RTn and the adults as CNn, wherein the values of n in the RTn and the CNn are the same as the values of n in Zrn and Zdn;
13) respectively retrieving data corresponding to the RTn and personnel data corresponding to the CNn in a database, respectively comparing the data corresponding to the RTn with the personnel data corresponding to the CNn, observing whether a relation exists, and further judging whether children enter the elevator independently;
14) and transmitting the result to the data transceiver module.
5. The system of claim 4, wherein the system comprises: the judgment mode in the step 12) is as follows:
1) when the corresponding data are not retrieved from the database by the RTn and no CNn data exist, the rn children are judged to enter the elevator independently;
2) when the corresponding data is not retrieved from the database by the data RTn and the data does not have a relationship with the corresponding data retrieved from the database by the CNn, judging that rn children enter the elevator independently;
3) when the corresponding data are not retrieved from the database by the data RTn and the data are in a relation with the corresponding data retrieved from the database by the CNn, judging that rn children do not enter the elevator independently;
4) and when the data RTn does not retrieve corresponding data from the database and the data CNn does not retrieve corresponding data from the database, judging rn unknown personnel to enter the elevator.
6. The system of claim 4, wherein the system comprises: the data transceiver module specifically comprises:
1) when the data transceiver module receives that the child does not enter the elevator independently, the data P and the conclusion that the child does not enter the elevator independently are transmitted to the remote client module;
2) when the data receiving and sending module receives that an unknown person enters the elevator, the data P, the RTn and the CNn of the unknown person are transmitted to the remote client module, a confirmation instruction is sent to an elevator manager through an alarm module in the warning module, and the elevator manager manually turns on and off an alarm after confirming with the elevator person through the remote client module;
3) when the data transceiver module receives the result that the child enters the elevator independently, the data P, Zrn and the conclusion that the child enters the elevator independently are transmitted to the remote client module, and meanwhile, an alarm instruction is transmitted to the alarm module.
7. An alarm system using a detection system according to any one of claims 1 to 6, wherein: alarm system includes alarm module and on-the-spot warning module, alarm module and on-the-spot warning module all with warning module one-way connection:
the alarm module is used for giving an alarm to an elevator manager;
the on-site warning module comprises a language broadcast warning module and a flashing light warning module, the language broadcast warning module is used for voice broadcast to remind children who enter the elevator alone of not entering the elevator alone and keeping away from the elevator, and the flashing light warning module is used for flashing warning light to remind children who enter the elevator alone of keeping away from the elevator.
8. The warning system of claim 7, wherein: the alarm system specifically comprises the following components:
1) the alarm system receives the warning instruction;
2) the alarm module rapidly gives an alarm to an elevator manager, and the elevator manager can directly call the children through the remote client module;
3) meanwhile, the voice broadcast warning module reminds children who enter the elevator independently not to enter the elevator independently and to be far away from the elevator through voice broadcast;
4) meanwhile, the flashing light warning module flashes the warning light back and forth;
5) the elevator manager can manually and independently close and open the language broadcast warning module and the flashing light warning module in the warning system through the remote client module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011079120.7A CN112184737B (en) | 2020-10-10 | 2020-10-10 | Image analysis-based child independent elevator detection and alarm system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011079120.7A CN112184737B (en) | 2020-10-10 | 2020-10-10 | Image analysis-based child independent elevator detection and alarm system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112184737A true CN112184737A (en) | 2021-01-05 |
| CN112184737B CN112184737B (en) | 2024-06-14 |
Family
ID=73948659
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011079120.7A Active CN112184737B (en) | 2020-10-10 | 2020-10-10 | Image analysis-based child independent elevator detection and alarm system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112184737B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106315324A (en) * | 2015-06-16 | 2017-01-11 | 奥的斯电梯公司 | Elevator system capable of monitoring child's use and control method for same |
| CN107673152A (en) * | 2017-09-11 | 2018-02-09 | 浙江新再灵科技股份有限公司 | The alarm method that children individually take in cage type elevator |
| CN108876990A (en) * | 2018-05-31 | 2018-11-23 | 深圳市零度智控科技有限公司 | Intelligent door lock and its control method, device and readable storage medium storing program for executing |
| CN109110590A (en) * | 2018-08-21 | 2019-01-01 | 深圳市赛亿科技开发有限公司 | Elevator uses control method and device, electronic equipment, storage medium |
| CN109484935A (en) * | 2017-09-13 | 2019-03-19 | 杭州海康威视数字技术股份有限公司 | A kind of lift car monitoring method, apparatus and system |
| CN109516334A (en) * | 2018-11-21 | 2019-03-26 | 日立楼宇技术（广州）有限公司 | A kind of boarding guard method, device, system, equipment and storage medium |
-
2020
- 2020-10-10 CN CN202011079120.7A patent/CN112184737B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106315324A (en) * | 2015-06-16 | 2017-01-11 | 奥的斯电梯公司 | Elevator system capable of monitoring child's use and control method for same |
| CN107673152A (en) * | 2017-09-11 | 2018-02-09 | 浙江新再灵科技股份有限公司 | The alarm method that children individually take in cage type elevator |
| CN109484935A (en) * | 2017-09-13 | 2019-03-19 | 杭州海康威视数字技术股份有限公司 | A kind of lift car monitoring method, apparatus and system |
| CN108876990A (en) * | 2018-05-31 | 2018-11-23 | 深圳市零度智控科技有限公司 | Intelligent door lock and its control method, device and readable storage medium storing program for executing |
| CN109110590A (en) * | 2018-08-21 | 2019-01-01 | 深圳市赛亿科技开发有限公司 | Elevator uses control method and device, electronic equipment, storage medium |
| CN109516334A (en) * | 2018-11-21 | 2019-03-26 | 日立楼宇技术（广州）有限公司 | A kind of boarding guard method, device, system, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112184737B (en) | 2024-06-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3115326B1 (en) | Elevator system capable of monitoring children use and control method thereof | |
| US20030142853A1 (en) | Security identification system | |
| WO2002048971A3 (en) | Apparatus and methods for resolution of entry/exit conflicts for security monitoring systems | |
| CN107038776A (en) | A kind of gate control system and access control method | |
| CN103295297A (en) | Kindergarten safety management system based on face recognition | |
| JP3924171B2 (en) | Monitoring device for identifying monitoring objects | |
| CN110276265A (en) | Pedestrian monitoring method and device based on intelligent three-dimensional solid monitoring device | |
| CN108388838A (en) | Unmanned plane population surveillance system and monitoring method over the ground | |
| CN111429681A (en) | Comprehensive perimeter security system with infrared thermal image verification and method | |
| CN109359712A (en) | Electric operating information dynamic collection monitoring device and its application method | |
| CN106713815A (en) | Building intercom system | |
| CN108012075A (en) | The integrated control method and system of a kind of monitoring device and lighting apparatus | |
| CN114358609A (en) | Scenic spot tourism safety management system and method | |
| CN112184737A (en) | Children take alone elevator detection and alarm system based on image analysis | |
| CN212966489U (en) | Elevator early warning system on electric motor car based on intelligent analysis technique | |
| CN106960484A (en) | Identification access system and method based on distance activation | |
| CN104867205A (en) | Secure identification monitoring system | |
| CN106791569A (en) | The building conversational system of time can be forecast to reach | |
| CN115909580A (en) | Intelligent office method and system based on Internet of things | |
| CN214670663U (en) | Biological characteristic detection equipment | |
| CN215298410U (en) | Invasion identification system | |
| CN113503972B (en) | Local dynamic target temperature measurement system based on low-pixel infrared camera | |
| KR101615243B1 (en) | Video surveillance apparatus for intelligent security and video surveillance method thereof | |
| CN115223088A (en) | Security check person-bag matching system and security check person-bag matching method | |
| CN208969695U (en) | Electric operating information dynamic collection monitoring device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |