CN114408717A - Escalator control method, escalator control device, computer equipment and storage medium - Google Patents
Escalator control method, escalator control device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN114408717A CN114408717A CN202111537780.XA CN202111537780A CN114408717A CN 114408717 A CN114408717 A CN 114408717A CN 202111537780 A CN202111537780 A CN 202111537780A CN 114408717 A CN114408717 A CN 114408717A
- Authority
- CN
- China
- Prior art keywords
- escalator
- image
- passenger
- pushing
- monitoring equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B29/00—Safety devices of escalators or moving walkways
- B66B29/005—Applications of security monitors
Landscapes
- Escalators And Moving Walkways (AREA)
Abstract
The present application relates to an escalator control method, apparatus, computer device, storage medium and computer program product. The method comprises the following steps: acquiring a first image of a monitored object acquired by fixed monitoring equipment; inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result; the state of the monitored object is preliminarily judged through the fixed monitoring equipment, so that the movable monitoring equipment is controlled to move to the position near the monitored object, and more comprehensive information is acquired; acquiring a second image acquired by the movable monitoring equipment; inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result; and according to the effective state recognition result, a control command is pushed to the escalator controller, so that the accuracy of escalator safety problem detection is improved, and the escalator operation is accurately controlled.
Description
Technical Field
The present application relates to the field of intelligent control technologies, and in particular, to a method, an apparatus, a computer device, a storage medium, and a computer program product for controlling an escalator.
Background
The escalator or the moving sidewalk is widely applied to public places such as markets, hotels, hospitals, airports, stations, subways and the like, and becomes an indispensable component of modern buildings. The safety problem of escalators or moving walkways is highly appreciated by society.
In order to reduce the safety accidents of escalators and moving walkways, most commercial facilities are equipped with monitoring systems for monitoring the operation of escalators or moving walkways. However, the existing escalator monitoring system cannot accurately identify the problems existing in the operation and cannot accurately control the escalator.
Disclosure of Invention
In view of the above, it is necessary to provide an escalator control method, an escalator control device, a computer-readable storage medium, and a computer program product, which can improve the escalator accident monitoring accuracy.
In a first aspect, the present application provides an escalator control method. The method comprises the following steps:
acquiring a first image of a monitoring object acquired by fixed monitoring equipment, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component of the escalator;
inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object;
acquiring a second image acquired by the movable monitoring equipment;
inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and pushing a control command to the escalator controller according to the effective state identification result.
In one embodiment, the monitored object is a passenger on an escalator or an object on the escalator; the effective state recognition result is a passenger or object abnormal recognition result, and the pushing of the control command to the escalator controller according to the effective state recognition result comprises at least one of the following conditions: pushing a ladder stopping instruction to an escalator controller according to the falling state identification result of the passenger; according to the passenger crowding state recognition result, a speed regulation instruction is pushed to the escalator controller; according to the identification result that the head, hands and body of the passenger exceed the handrail area of the escalator, a speed regulating command is pushed to the escalator controller; pushing a speed regulating command to the escalator controller according to the identification result of the articles staying in the escalator; pushing a speed regulating command to the escalator controller according to the passenger converse running state identification result; pushing a speed regulating command to an escalator controller according to the identification result of taking the escalator by special objects such as a baby carriage, a wheelchair and the like; and pushing voice reminding information to the escalator controller according to the identification result of the state of the passenger with inconvenient actions.
In one embodiment, the pushing voice reminding information to the escalator controller according to the passenger mobility difficulty state recognition result comprises: acquiring noise information acquired by movable monitoring equipment; and adjusting the volume of the voice reminding information according to the noise information, and pushing the voice reminding information with the adjusted volume to the escalator controller.
In one embodiment, the monitored object is a passenger on an escalator; the first image is input into a preset escalator safety monitoring model for identification, and after an initial state identification result is obtained, the method further comprises the following steps: when the initial state recognition result represents that the monitored object is an escalator manager, receiving a voice control instruction of the escalator manager; and pushing the voice control command to the escalator controller.
In one embodiment, before inputting the second image into the preset escalator safety monitoring model for identification and obtaining the effective state identification result, the method further includes: when the second image is detected to be a shielding image, determining the moving direction according to the position of the movable monitoring equipment, and controlling the movable monitoring equipment to move; and returning to obtain a second image acquired by the movable monitoring equipment.
In one embodiment, the monitored object is a component part of an escalator; according to effective state recognition result, the propelling movement control command to the staircase controller includes: and determining the equipment fault type according to the running state of the component parts, and pushing equipment fault reminding information to the escalator controller.
In a second aspect, the present application further provides an escalator control device. The device includes:
the first acquisition module is used for acquiring a first image of a monitoring object acquired by fixed monitoring equipment, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component of the escalator;
the first identification module is used for inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
the mobile control module is used for positioning the position of the monitoring object and sending a mobile instruction to the movable monitoring equipment according to the position of the monitoring object when the initial target state recognition result is abnormal, wherein the mobile instruction is used for controlling the movable monitoring equipment to move to the position of the monitoring object;
the second acquisition module is used for acquiring a second image acquired by the movable monitoring equipment;
the second identification module is used for inputting a second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and the pushing module is used for pushing the control command to the escalator controller according to the effective state recognition result.
In a third aspect, the present application also provides a computer device. The computer device comprises a memory storing a computer program and a processor implementing the following steps when executing the computer program:
acquiring a first image of a monitoring object acquired by fixed monitoring equipment, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component of the escalator;
inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object;
acquiring a second image acquired by the movable monitoring equipment;
inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and pushing a control command to the escalator controller according to the effective state identification result.
In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:
acquiring a first image of a monitoring object acquired by fixed monitoring equipment, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component of the escalator;
inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object;
acquiring a second image acquired by the movable monitoring equipment;
inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and pushing a control command to the escalator controller according to the effective state identification result.
In a fifth aspect, the present application further provides a computer program product. The computer program product comprising a computer program which when executed by a processor performs the steps of:
acquiring a first image of a monitoring object acquired by fixed monitoring equipment, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component of the escalator;
inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object;
acquiring a second image acquired by the movable monitoring equipment;
inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and pushing a control command to the escalator controller according to the effective state identification result.
According to the escalator control method, the escalator control device, the computer equipment, the storage medium and the computer program product, the first image of the monitored object acquired by the fixed monitoring equipment is acquired, and the monitored object comprises a passenger on the escalator or an object on the escalator or a component part of the escalator; inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result; when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object; acquiring a second image acquired by the movable monitoring equipment; inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result; and pushing a control command to the escalator controller according to the effective state identification result. In the whole process, the state of a monitored object (a passenger on the escalator or an object on the escalator or a component part of the escalator) is preliminarily judged through the fixed monitoring equipment, so that the movable monitoring equipment is controlled to move to the position near the monitored object, more comprehensive information is acquired, the accuracy rate of escalator safety problem detection is improved, and the escalator operation is accurately controlled.
Drawings
FIG. 1 is an environmental diagram of an embodiment of an escalator control method;
FIG. 2 is a schematic flow diagram of an escalator control method according to one embodiment;
fig. 3 is a schematic flow chart illustrating a process of sending a voice prompt message to an escalator controller according to a passenger mobility state recognition result in one embodiment;
fig. 4 is a block diagram of the structure of an escalator control device in one embodiment;
FIG. 5 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The escalator control method provided by the embodiment of the application can be applied to the application environment shown in figure 1. Wherein, the fixed monitoring device 102, the movable monitoring device 104 and the escalator controller 106 can all communicate with the terminal 108 through the network. The mobile monitoring device may also be integrated on the terminal 108 as a mobile intelligent monitoring device. The terminal can remotely receive the image of the monitored object and carry out remote state analysis, processing and management on the monitored object. Specifically, the terminal 108 acquires a first image of a monitoring object acquired by the fixed monitoring equipment 102, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component part of the escalator; inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result; when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment 104 according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment 104 to move to the position of the monitored object; acquiring a second image acquired by the movable monitoring equipment 104; inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result; and pushing a control command to the escalator controller 106 according to the effective state recognition result, and then controlling the escalator by the escalator controller according to the control command. The terminal 108 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and internet of things devices, and the internet of things devices may be smart speakers, smart televisions, smart air conditioners, smart car-mounted devices, and the like.
The escalator control method can be applied to escalators or moving sidewalks, fixed monitoring equipment and movable monitoring equipment are remotely transmitted to a terminal in real time through a wired or wireless network, the terminal can be a computer of an escalator equipment manufacturer or a computer of a monitoring center, an escalator safety monitoring model is established on the terminal, a model is established for operation of escalator equipment and passengers taking the escalator, real-time monitoring of the escalator and the passengers is achieved, intelligent escalator safety operation monitoring is achieved, analysis and diagnosis can be conducted remotely according to data of the real-time monitoring model, remote diagnosis of relevant problems is achieved, manual intervention is reduced, and passenger experience is improved. The embodiment of the application takes the example that the escalator monitoring method is applied to an escalator, and the realization of the self-service sidewalk monitoring method is similar.
In one embodiment, as shown in fig. 2, an escalator control method is provided, which is illustrated by way of example as applied to the terminal 108 in fig. 1, and includes the following steps:
The monitored object comprises a passenger on the escalator or an object on the escalator or a component part of the escalator.
Specifically, the terminal 108 acquires a first image of a passenger on an escalator or an object on an escalator or a component part of an escalator collected by a stationary monitoring device.
And 204, inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result.
Specifically, the terminal 108 inputs a first image into a preset escalator safety monitoring model, extracts the characteristics of the first image, determines the type of the first image according to the characteristics of the first image, and performs state recognition on the first image according to a recognition model corresponding to the type of the first image to obtain the passenger safety state on the escalator or the running state of the components of the escalator. The first image type comprises the states of passengers on the escalator, the running states of components of the escalator, a face image and the like. The preset escalator safety monitoring model can comprise an escalator passenger state identification model, an escalator component operation state identification model, a face identification model and the like. The preset escalator safety monitoring model can be realized through a convolutional neural network, a deep learning algorithm and a machine learning algorithm, and the embodiment of the application is not limited herein.
And step 206, when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object.
Specifically, when a passenger on the escalator is in an abnormal state or the running state of a component of the escalator is abnormal, the terminal positions the position of the monitored object according to the first image information, determines the moving direction and the moving distance according to the position of the monitored object and the position of the movable monitoring equipment, and pushes the moving direction and the moving distance to the movable monitoring equipment so that the movable monitoring equipment moves to the position of the monitored object.
For example, when the abnormal part is identified through the image collected by the fixed monitoring equipment, the image is sent to the movable monitoring equipment, so that the movable monitoring equipment moves to the position near the part to be identified at a closer distance and at multiple angles and by multiple sensors, and the clear image, rich information such as temperature and sound are provided for identification.
And step 208, acquiring a second image acquired by the movable monitoring equipment.
Specifically, the terminal 108 acquires a second image corresponding to monitoring collected by the movable monitoring device.
And step 210, inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result.
Specifically, the second image is input into an identification model corresponding to the safety state of passengers on the escalator or the running state of the components of the escalator, and further state identification is carried out to obtain an effective state identification result. The passenger state on the escalator can comprise a passenger falling state, a passenger crowding state, passenger inconvenience and the like, and the running state of the components of the escalator comprises abnormity such as component missing, damage and the like. The escalator comprises components such as a floor plate, a skirt plate, a step, a railing, a handrail and the like outside the escalator, and a main machine, a chain wheel, a fan and the like inside the escalator, and is used for monitoring whether the external components and the internal components of the escalator are lost or not and whether the escalator runs normally or not so as to realize the monitoring of escalator equipment. The operation state of the passenger or the object on the escalator can be state information such as the shape, the operation track, the speed, the temperature and the sound of the passenger or the object, the information such as the shape, the operation track, the speed, the temperature and the sound of the passenger or the object can be collected by the movable monitoring equipment, various information can be identified by the preset escalator safety monitoring model, and then the effective identification state of the monitored object can be identified more accurately according to various information.
And step 212, pushing a control command to the escalator controller according to the effective state identification result.
Specifically, the terminal 108 determines the control strategy of the corresponding state in the control strategy database according to the effective state identification result, and pushes the control command of the control strategy of the corresponding state to the escalator controller, so that the escalator controller controls the escalator according to the control command. The control strategy database learns the control strategies corresponding to different states according to the historical operating states of the escalator and the behaviors of passengers, records the control strategies corresponding to different states of passengers on the escalator and different operating states of the components of the escalator, can determine the corresponding control strategies according to different states, and realizes intelligent analysis and remote diagnosis.
In the escalator control method, a first image of a monitored object acquired by fixed monitoring equipment is acquired, wherein the monitored object comprises a passenger on an escalator or an object on the escalator or a component part of the escalator; inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result; when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object; acquiring a second image acquired by the movable monitoring equipment; inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result; and pushing a control command to the escalator controller according to the effective state identification result. In the whole process, the state of the monitored object is preliminarily judged through the fixed monitoring equipment, then the movable monitoring equipment is controlled to move to the position near the monitored object, more comprehensive information is collected, the accuracy rate of escalator safety problem detection is improved, and then the escalator operation is accurately controlled.
In an alternative embodiment, the monitoring object is a passenger on an escalator or an object on an escalator; the effective state recognition result is a passenger or object abnormal recognition result, and the pushing of the control command to the escalator controller according to the effective state recognition result comprises at least one of the following conditions: pushing a ladder stopping instruction to an escalator controller according to the falling state identification result of the passenger; according to the passenger crowding state recognition result, a speed regulation instruction is pushed to the escalator controller; according to the identification result that the head, hands and body of the passenger exceed the handrail area of the escalator, a speed regulating command is pushed to the escalator controller; pushing a speed regulating command to the escalator controller according to the identification result of the articles staying in the escalator; pushing a speed regulating command to the escalator controller according to the passenger converse running state identification result; pushing a speed regulating command to an escalator controller according to the identification result of taking the escalator by special objects such as a baby carriage, a wheelchair and the like; and pushing voice reminding information to the escalator controller according to the identification result of the state of the passenger with inconvenient actions.
Specifically, when the terminal 108 detects that the monitored object is a passenger on the escalator, the state type of the passenger or the object is determined, the abnormal state of the passenger is further accurately determined according to the identification model, and when the passenger falls down, a ladder stopping instruction is generated and pushed to the escalator controller; when the situation that passengers on the escalator are crowded is identified, namely the number of the passengers on the escalator exceeds a preset passenger number threshold value, a speed reduction instruction is generated and is pushed to the escalator controller, and meanwhile, crowded voice reminding information can be pushed to the escalator controller; when the head, the hands and the body of a passenger are identified to exceed the handrail belt area of the escalator, a speed regulating command is pushed to the escalator controller; when the situation that articles are left in the escalator is detected, a speed regulating command is pushed to the escalator controller; when the passenger is detected to move reversely, a speed regulating command is pushed to the escalator controller; pushing a speed regulating command to an escalator controller according to the identification result of taking the escalator by special objects such as a baby carriage, a wheelchair and the like; when the passenger is identified to be inconvenient to move, the voice guide information is pushed to the escalator controller.
For example, when the terminal is integrated with the movable monitoring device to form an AI control device, and there is a baby carriage, a wheelchair or a person with slow movement at the front, the AI intelligent recognition module can move to the foremost end of a floor plate of an escalator in advance to perform voice interaction, and remind a passenger to take a straight ladder at other positions by voice, or guide the passenger to take the escalator by voice, control the escalator to stop or slowly move to the passenger to enter and then slowly accelerate the passenger to an exit.
In an alternative embodiment, as shown in fig. 3, the pushing voice reminding information to the escalator controller according to the passenger mobility difficulty state recognition result comprises:
In particular, the movable monitoring device includes at least one of a TOF sensor, a microwave sensor, an infrared sensor, and a noise sensor. Noise information around the monitored object can be collected by a noise sensor configured on the movable monitoring device.
And step 304, adjusting the volume of the voice reminding information according to the noise information, and pushing the voice reminding information with the adjusted volume to the escalator controller.
Specifically, the movable monitoring equipment can move on the outer side of a handrail belt on an escalator, an escalator skirt plate or a cover plate in an escalator floor plate area, and can be provided with devices such as TOF sensors, microwave sensors, infrared sensors, noise sensors and the like to identify information such as the outline, the running track and speed, the temperature, the sound and the like of passengers or components. When the terminal identifies that the passenger is inconvenient to move, noise information around the passenger, which is acquired by the movable monitoring equipment, is acquired, the volume of the voice reminding information is adjusted according to the height of the noise volume, and then the voice reminding information after the volume is adjusted is pushed to the escalator controller, so that the user can take the escalator according to the voice prompt.
In the embodiment, the fixed monitoring equipment identifies that the passenger has abnormal behaviors, and the movable AI intelligent identification equipment or the movable monitoring equipment can be used for carrying out auxiliary identification through another angle, so that the accuracy and the identification efficiency are improved, and the escalator control efficiency and the escalator control accuracy are further improved.
In an alternative embodiment, the monitored object is a passenger on an escalator; the first image is input into a preset escalator safety monitoring model for identification, and after an initial state identification result is obtained, the method further comprises the following steps: when the initial state recognition result represents that the monitored object is an escalator manager, receiving a voice control instruction of the escalator manager; and pushing the voice control command to the escalator controller.
Specifically, the preset escalator safety monitoring model comprises a face recognition model, when the terminal determines that a monitored object is of a face image type according to a first image, a clearer face image is collected through a movable monitoring device, then the monitored object is recognized according to the face recognition model, and when the monitored object is recognized as an escalator manager, voice escalator opening or escalator stopping is achieved when no passenger is on the escalator.
In an optional embodiment, before inputting the second image into the preset escalator safety monitoring model for identification and obtaining an effective state identification result, the method further includes: when the second image is detected to be a shielding image, determining the moving direction according to the position of the movable monitoring equipment, and controlling the movable monitoring equipment to move; and returning to obtain a second image acquired by the movable monitoring equipment.
Specifically, when the terminal 108 detects that the second image acquired by the movable monitoring equipment is a blocking image, the moving direction is determined according to the position of the movable monitoring equipment, the movable monitoring equipment is controlled to move, then the second image acquired by the movable monitoring equipment is acquired again, and when the second image is not the blocking image, the second image is input into a preset escalator safety monitoring model for identification to obtain an effective state identification result; and pushing a control command to the escalator controller according to the effective state identification result. And when the second image is the shielding image, continuously determining the moving direction according to the position of the movable monitoring equipment, controlling the movable monitoring equipment to move, and then re-acquiring the second image acquired by the movable monitoring equipment. In addition, when the terminal 108 detects that the first image collected by the fixed monitoring device is a blocking image, a moving instruction is sent to the movable monitoring device, so that the movable monitoring device can accurately identify the abnormal behavior of the passenger and the running state of the device.
When the terminal is integrated with the movable monitoring equipment, an AI control device is formed, the AI control device can automatically hide when the camera is shielded, the escalator is monitored from other positions in real time, the escalator is stopped at the first time when a dangerous condition occurs, a manager is assisted by voice or network to manage the escalator such as starting and stopping, and passengers are assisted by voice interaction to take the escalator. The AI control device may be a machine device capable of autonomously riding on an escalator, assisting a handicapped person in riding on the escalator, carrying an article of a designated size and weight, assisting another camera in performing close-range image recognition, guiding a passenger to a destination, and the like.
In an alternative embodiment, the monitored object is a component part of an escalator; according to effective state recognition result, the propelling movement control command to the staircase controller includes: and determining the equipment fault type according to the running state of the component parts, and pushing equipment fault reminding information to the escalator controller.
Specifically, when the monitored object is a component of the escalator, the terminal can determine the fault type of the component of the escalator according to the collected first image and the collected second image, and further generate an escalator control instruction and equipment fault reminding information and push the escalator control instruction and the equipment fault reminding information to the escalator controller, or push the equipment fault reminding information to an escalator manager, so that the escalator manager can know the escalator fault information at the first time and carry out operation and maintenance.
It should be understood that, although the steps in the flowcharts related to the embodiments as described above are sequentially displayed as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a part of the steps in the flowcharts related to the embodiments described above may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the execution order of the steps or stages is not necessarily sequential, but may be rotated or alternated with other steps or at least a part of the steps or stages in other steps.
Based on the same inventive concept, the embodiment of the application also provides an escalator control device for realizing the escalator control method. The solution to the problem provided by the device is similar to the solution described in the above method, so the specific limitations in one or more embodiments of the escalator control device provided below can be referred to the limitations in the above escalator control method, and are not described herein again.
In one embodiment, as shown in fig. 4, there is provided an escalator control device comprising: a first obtaining module 402, a first identifying module 404, a movement control module 406, a second obtaining module 408, a second identifying module 410, and a pushing module 412, wherein:
the first acquiring module 402 is configured to acquire a first image of a monitoring object acquired by a fixed monitoring device, where the monitoring object includes a passenger on an escalator or an object on an escalator or a component of an escalator.
And the first identification module 404 is configured to input the first image into a preset escalator safety monitoring model for identification, so as to obtain an initial state identification result.
And the movement control module 406 is configured to, when the initial target state identification result represents an abnormal state, locate the position of the monitored object, and send a movement instruction to the movable monitoring device according to the position of the monitored object, where the movement instruction is used to control the movable monitoring device to move to the position of the monitored object.
And a second obtaining module 408, configured to obtain a second image collected by the mobile monitoring device.
And the second identification module 410 is configured to input a second image into the preset escalator safety monitoring model for identification, so as to obtain an effective state identification result.
And the pushing module 412 is used for pushing the control command to the escalator controller according to the effective state identification result.
In an alternative embodiment, the monitoring object is a passenger on an escalator or an object on an escalator; the effective state identification result is an abnormal passenger or object identification result, and the pushing module 412 is further configured to push a ladder stopping instruction to the ladder controller according to the falling state identification result of the passenger; or, according to the passenger crowding state recognition result, pushing a speed regulation instruction to the escalator controller; or, according to the identification result that the head, the hands and the body of the passenger exceed the handrail area of the escalator, a speed regulating command is pushed to the escalator controller; or pushing a speed regulating instruction to the escalator controller according to the identification result of the article staying in the escalator; or, according to the passenger converse running state recognition result, pushing a speed regulation instruction to the escalator controller; or pushing a speed regulating command to an escalator controller according to the identification result of the special objects such as a baby carriage, a wheelchair and the like when the user takes the escalator; or pushing voice reminding information to the escalator controller according to the passenger mobility inconvenience state recognition result.
In an optional embodiment, the pushing module 412 is further configured to obtain noise information collected by the mobile monitoring device; and adjusting the volume of the voice reminding information according to the noise information, and pushing the voice reminding information with the adjusted volume to the escalator controller.
In an alternative embodiment, the monitored object is a passenger on an escalator; the first identification module 404 is further configured to receive a voice control instruction of an escalator supervisor when the initial state identification result represents that the monitored object is the escalator supervisor; and pushing the voice control command to the escalator controller.
In an optional embodiment, the movement control module 406 is further configured to determine a movement direction according to the position of the movable monitoring device when the second image is detected to be the occlusion image, and control the movable monitoring device to move; and returning to the second acquisition module 408 to acquire the second image acquired by the movable monitoring equipment again.
In an alternative embodiment, the monitored object is a component part of an escalator; the pushing module 412 is further configured to determine a device fault type according to the operation state of the component, and push the device fault reminding information to the escalator controller.
The modules in the escalator control device can be realized by software, hardware and a combination thereof in whole or in part. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 5. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement an escalator control method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program:
acquiring a first image of a monitoring object acquired by fixed monitoring equipment, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component of the escalator;
inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object;
acquiring a second image acquired by the movable monitoring equipment;
inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and pushing a control command to the escalator controller according to the effective state identification result.
In one embodiment, the processor, when executing the computer program, further performs the steps of: the monitored object is a passenger on the escalator; the effective state recognition result is a passenger abnormal recognition result, and the step of pushing the control command to the escalator controller according to the effective state recognition result comprises at least one of the following conditions: pushing a ladder stopping instruction to an escalator controller according to the falling state identification result of the passenger; according to the passenger crowding state recognition result, a speed regulation instruction is pushed to the escalator controller; and pushing voice reminding information to the escalator controller according to the identification result of the state of the passenger with inconvenient actions.
In one embodiment, the processor, when executing the computer program, further performs the steps of: according to passenger's inconvenient state recognition result of moving, propelling movement pronunciation warning message includes to the staircase controller: acquiring noise information acquired by movable monitoring equipment; and adjusting the volume of the voice reminding information according to the noise information, and pushing the voice reminding information with the adjusted volume to the escalator controller.
In one embodiment, the processor, when executing the computer program, further performs the steps of: the monitored object is a passenger on the escalator; the first image is input into a preset escalator safety monitoring model for identification, and after an initial state identification result is obtained, the method further comprises the following steps: when the initial state recognition result represents that the monitored object is an escalator manager, receiving a voice control instruction of the escalator manager; and pushing the voice control command to the escalator controller.
In one embodiment, the processor, when executing the computer program, further performs the steps of: inputting a second image into a preset escalator safety monitoring model for identification, and before obtaining an effective state identification result, further comprising: when the second image is detected to be a shielding image, determining the moving direction according to the position of the movable monitoring equipment, and controlling the movable monitoring equipment to move; and returning to obtain a second image acquired by the movable monitoring equipment.
In one embodiment, the processor, when executing the computer program, further performs the steps of: the monitored object is a component part of the escalator; according to effective state recognition result, the propelling movement control command to the staircase controller includes: and determining the equipment fault type according to the running state of the component parts, and pushing equipment fault reminding information to the escalator controller.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring a first image of a monitoring object acquired by fixed monitoring equipment, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component of the escalator;
inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object;
acquiring a second image acquired by the movable monitoring equipment;
inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and pushing a control command to the escalator controller according to the effective state identification result.
In one embodiment, the computer program when executed by the processor further performs the steps of: the monitored object is a passenger on the escalator or an object on the escalator; the effective state recognition result is a passenger or object abnormal recognition result, and the pushing of the control command to the escalator controller according to the effective state recognition result comprises at least one of the following conditions: pushing a ladder stopping instruction to an escalator controller according to the falling state identification result of the passenger; according to the passenger crowding state recognition result, a speed regulation instruction is pushed to the escalator controller; according to the identification result that the head, hands and body of the passenger exceed the handrail area of the escalator, a speed regulating command is pushed to the escalator controller; pushing a speed regulating command to the escalator controller according to the identification result of the articles staying in the escalator; pushing a speed regulating command to the escalator controller according to the passenger converse running state identification result; pushing a speed regulating command to an escalator controller according to the identification result of taking the escalator by special objects such as a baby carriage, a wheelchair and the like; and pushing voice reminding information to the escalator controller according to the identification result of the state of the passenger with inconvenient actions.
In one embodiment, the computer program when executed by the processor further performs the steps of: according to passenger's inconvenient state recognition result of moving, propelling movement pronunciation warning message includes to the staircase controller: acquiring noise information acquired by movable monitoring equipment; and adjusting the volume of the voice reminding information according to the noise information, and pushing the voice reminding information with the adjusted volume to the escalator controller.
In one embodiment, the computer program when executed by the processor further performs the steps of: the monitored object is a passenger on the escalator; the first image is input into a preset escalator safety monitoring model for identification, and after an initial state identification result is obtained, the method further comprises the following steps: when the initial state recognition result represents that the monitored object is an escalator manager, receiving a voice control instruction of the escalator manager; and pushing the voice control command to the escalator controller.
In one embodiment, the computer program when executed by the processor further performs the steps of: inputting a second image into a preset escalator safety monitoring model for identification, and before obtaining an effective state identification result, further comprising: when the second image is detected to be a shielding image, determining the moving direction according to the position of the movable monitoring equipment, and controlling the movable monitoring equipment to move; and returning to obtain a second image acquired by the movable monitoring equipment.
In one embodiment, the computer program when executed by the processor further performs the steps of: the monitored object is a component part of the escalator; according to effective state recognition result, the propelling movement control command to the staircase controller includes: and determining the equipment fault type according to the running state of the component parts, and pushing equipment fault reminding information to the escalator controller.
In one embodiment, a computer program product is provided, comprising a computer program which, when executed by a processor, performs the steps of:
acquiring a first image of a monitoring object acquired by fixed monitoring equipment, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component of the escalator;
inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to the movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object;
acquiring a second image acquired by the movable monitoring equipment;
inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and pushing a control command to the escalator controller according to the effective state identification result.
In one embodiment, the computer program when executed by the processor further performs the steps of: the monitored object is a passenger on the escalator or an object on the escalator; the effective state recognition result is a passenger or object abnormal recognition result, and the pushing of the control command to the escalator controller according to the effective state recognition result comprises at least one of the following conditions: pushing a ladder stopping instruction to an escalator controller according to the falling state identification result of the passenger; according to the passenger crowding state recognition result, a speed regulation instruction is pushed to the escalator controller; according to the identification result that the head, hands and body of the passenger exceed the handrail area of the escalator, a speed regulating command is pushed to the escalator controller; pushing a speed regulating command to the escalator controller according to the identification result of the articles staying in the escalator; pushing a speed regulating command to the escalator controller according to the passenger converse running state identification result; pushing a speed regulating command to an escalator controller according to the identification result of taking the escalator by special objects such as a baby carriage, a wheelchair and the like; and pushing voice reminding information to the escalator controller according to the identification result of the state of the passenger with inconvenient actions.
In one embodiment, the computer program when executed by the processor further performs the steps of: according to passenger's inconvenient state recognition result of moving, propelling movement pronunciation warning message includes to the staircase controller: acquiring noise information acquired by movable monitoring equipment; and adjusting the volume of the voice reminding information according to the noise information, and pushing the voice reminding information with the adjusted volume to the escalator controller.
In one embodiment, the computer program when executed by the processor further performs the steps of: the monitored object is a passenger on the escalator; the first image is input into a preset escalator safety monitoring model for identification, and after an initial state identification result is obtained, the method further comprises the following steps: when the initial state recognition result represents that the monitored object is an escalator manager, receiving a voice control instruction of the escalator manager; and pushing the voice control command to the escalator controller.
In one embodiment, the computer program when executed by the processor further performs the steps of: inputting a second image into a preset escalator safety monitoring model for identification, and before obtaining an effective state identification result, further comprising: when the second image is detected to be a shielding image, determining the moving direction according to the position of the movable monitoring equipment, and controlling the movable monitoring equipment to move; and returning to obtain a second image acquired by the movable monitoring equipment.
In one embodiment, the computer program when executed by the processor further performs the steps of: the monitored object is a component part of the escalator; according to effective state recognition result, the propelling movement control command to the staircase controller includes: and determining the equipment fault type according to the running state of the component parts, and pushing equipment fault reminding information to the escalator controller.
It should be noted that, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, presented data, etc.) referred to in the present application are information and data authorized by the user or sufficiently authorized by each party.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high-density embedded nonvolatile Memory, resistive Random Access Memory (ReRAM), Magnetic Random Access Memory (MRAM), Ferroelectric Random Access Memory (FRAM), Phase Change Memory (PCM), graphene Memory, and the like. Volatile Memory can include Random Access Memory (RAM), external cache Memory, and the like. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others. The databases referred to in various embodiments provided herein may include at least one of relational and non-relational databases. The non-relational database may include, but is not limited to, a block chain based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, quantum computing based data processing logic devices, etc., without limitation.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.
Claims (10)
1. An escalator control method, characterized in that the method comprises:
acquiring a first image of a monitoring object acquired by fixed monitoring equipment, wherein the monitoring object comprises a passenger on an escalator or an object on the escalator or a component of the escalator;
inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
when the initial target state recognition result is abnormal, positioning the position of the monitored object, and sending a moving instruction to movable monitoring equipment according to the position of the monitored object, wherein the moving instruction is used for controlling the movable monitoring equipment to move to the position of the monitored object;
acquiring a second image acquired by the movable monitoring equipment;
inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and pushing a control command to the escalator controller according to the effective state identification result.
2. The method of claim 1, wherein the monitored object is a passenger on an escalator or an object on an escalator;
the effective state recognition result is a passenger or object abnormal recognition result, and the pushing of the control command to the escalator controller according to the effective state recognition result comprises at least one of the following conditions:
pushing a ladder stopping instruction to an escalator controller according to the falling state identification result of the passenger;
according to the passenger crowding state recognition result, a speed regulation instruction is pushed to the escalator controller;
according to the identification result that the head, hands and body of the passenger exceed the handrail area of the escalator, a speed regulating command is pushed to the escalator controller;
pushing a speed regulating command to the escalator controller according to the identification result of the articles staying in the escalator;
pushing a speed regulating command to the escalator controller according to the passenger converse running state identification result;
pushing a speed regulating command to an escalator controller according to the identification result of taking the escalator by special objects such as a baby carriage, a wheelchair and the like;
and pushing voice reminding information to the escalator controller according to the identification result of the state of the passenger with inconvenient actions.
3. The method of claim 2, wherein the pushing voice reminding information to the escalator controller according to the passenger mobility difficulty state recognition result comprises:
acquiring noise information acquired by movable monitoring equipment;
and adjusting the volume of the voice reminding information according to the noise information, and pushing the voice reminding information with the adjusted volume to the escalator controller.
4. The method of claim 1, wherein the monitored object is a passenger on an escalator;
the step of inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result further comprises the following steps:
when the initial state recognition result represents that the monitored object is an escalator manager, receiving a voice control instruction of the escalator manager;
and pushing the voice control command to an escalator controller.
5. The method according to claim 1, wherein before inputting the second image into the preset escalator safety monitoring model for identification and obtaining the effective state identification result, the method further comprises:
when the second image is detected to be a blocking image, determining the moving direction according to the position of the movable monitoring equipment, and controlling the movable monitoring equipment to move;
and returning to obtain the second image acquired by the movable monitoring equipment.
6. The method of claim 1, wherein the monitored object is a component part of an escalator;
the step of pushing a control command to the escalator controller according to the effective state recognition result comprises:
and determining the equipment fault type according to the running state of the component parts, and pushing equipment fault reminding information to the escalator controller.
7. An escalator control device, characterized in that the device comprises:
the monitoring system comprises a first acquisition module, a second acquisition module and a monitoring module, wherein the first acquisition module is used for acquiring a first image of a monitored object acquired by fixed monitoring equipment, and the monitored object comprises a passenger on an escalator or an object on the escalator or a component part of the escalator;
the first identification module is used for inputting the first image into a preset escalator safety monitoring model for identification to obtain an initial state identification result;
the mobile control module is used for positioning the position of the monitored object and sending a mobile instruction to the mobile monitoring equipment according to the position of the monitored object when the initial target state identification result is abnormal, wherein the mobile instruction is used for controlling the mobile monitoring equipment to move to the position of the monitored object;
the second acquisition module is used for acquiring a second image acquired by the movable monitoring equipment;
the second identification module is used for inputting the second image into a preset escalator safety monitoring model for identification to obtain an effective state identification result;
and the pushing module is used for pushing a control command to the escalator controller according to the effective state identification result.
8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any of claims 1 to 6.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.
10. A computer program product comprising a computer program, characterized in that the computer program realizes the steps of the method of any one of claims 1 to 6 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111537780.XA CN114408717A (en) | 2021-12-15 | 2021-12-15 | Escalator control method, escalator control device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111537780.XA CN114408717A (en) | 2021-12-15 | 2021-12-15 | Escalator control method, escalator control device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114408717A true CN114408717A (en) | 2022-04-29 |
Family
ID=81267992
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111537780.XA Pending CN114408717A (en) | 2021-12-15 | 2021-12-15 | Escalator control method, escalator control device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114408717A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114998828A (en) * | 2022-05-18 | 2022-09-02 | 慧之安信息技术股份有限公司 | Offshore platform personnel stair climbing management method based on Internet of things platform |
-
2021
- 2021-12-15 CN CN202111537780.XA patent/CN114408717A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114998828A (en) * | 2022-05-18 | 2022-09-02 | 慧之安信息技术股份有限公司 | Offshore platform personnel stair climbing management method based on Internet of things platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220121197A1 (en) | Safety of autonomous vehicles by remote support request | |
| US11256266B2 (en) | Method of controlling cart robot in movement restricted area and cart robot for implementing the same | |
| US11383663B2 (en) | Vehicle control method, vehicle control system, vehicle control device, passenger watching-over method, passenger watching-over system, and passenger watching-over device | |
| US10762775B2 (en) | Vehicle terminal device and control method thereof | |
| KR100999084B1 (en) | Video aided system for elevator control | |
| EP2300949B1 (en) | Video-based system and method of elevator door detection | |
| CN105270944B (en) | The touch-screen type destination log-on operation disk and its user's decision method of elevator | |
| JP2013131100A (en) | Number of persons prediction method, number of persons prediction device, movable robot, and program | |
| JP6945630B2 (en) | Vehicle management system | |
| CN114408717A (en) | Escalator control method, escalator control device, computer equipment and storage medium | |
| EP3920141B1 (en) | Boarding permission determination device and boarding permission determination method | |
| WO2016110023A1 (en) | Method and device for controlling use of mobile terminal during movement | |
| JP2018150757A (en) | Parking management system, self-propelled parking prevention device, and management server | |
| GB2479495A (en) | Video aided system for elevator control. | |
| JP2012180190A (en) | Space measurement system and measuring method, and elevator control system | |
| CN110738843B (en) | Information processing method and information processing apparatus | |
| US11971721B2 (en) | Autonomous mobile robot control system, control method thereof, a non-transitory computer readable medium storing control program thereof, and autonomous mobile robot control device | |
| CN114057051B (en) | Reminding method and system for elevator calling in car | |
| CN114714361A (en) | Robot control method, robot control device, robot, storage medium, and program product | |
| US20220070415A1 (en) | Access control system | |
| US20220324676A1 (en) | Multi-Input Call Panel for an Elevator System | |
| CN115434602A (en) | Vehicle door opening control method, device, equipment and storage medium | |
| CN114495074A (en) | Control method and device of vehicle, electronic equipment and storage medium | |
| CN111847168A (en) | Height limit control method, device and equipment for construction elevator and storage medium | |
| KR102448710B1 (en) | Method and system for deep learning-based parking management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |