CN115818537B - Monitoring system, method and device for forklift running safety - Google Patents

Monitoring system, method and device for forklift running safety Download PDF

Info

Publication number
CN115818537B
CN115818537B CN202310182101.4A CN202310182101A CN115818537B CN 115818537 B CN115818537 B CN 115818537B CN 202310182101 A CN202310182101 A CN 202310182101A CN 115818537 B CN115818537 B CN 115818537B
Authority
CN
China
Prior art keywords
forklift
real
target area
image
driver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310182101.4A
Other languages
Chinese (zh)
Other versions
CN115818537A (en
Inventor
熊丽
张启亮
赵峰
郭辉
管士飞
顾金楼
高迁波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
XCMG Hanyun Technologies Co Ltd
Original Assignee
XCMG Hanyun Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by XCMG Hanyun Technologies Co Ltd filed Critical XCMG Hanyun Technologies Co Ltd
Priority to CN202310182101.4A priority Critical patent/CN115818537B/en
Publication of CN115818537A publication Critical patent/CN115818537A/en
Application granted granted Critical
Publication of CN115818537B publication Critical patent/CN115818537B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Forklifts And Lifting Vehicles (AREA)
  • Traffic Control Systems (AREA)

Abstract

The application provides a monitoring system, a method and a device for forklift running safety, wherein the system comprises: the monitoring assembly is arranged on the forklift and the background server; the monitoring component comprises an image acquisition module, a pressure detection module, a driving data acquisition module and a control module; the pressure detection module is used for detecting a real-time pressure value born by the forklift seat, and the driving data acquisition module is used for acquiring the real-time position and the real-time speed of the forklift; the control module is used for controlling the image acquisition module to acquire a target area image based on the real-time position of the forklift and the change condition of the real-time pressure value born by the forklift seat, determining whether the current driver is a witness or not based on the target area image, and sending alarm information to the background server under the condition that the current driver is the witness; the background server is used for sending an emergency control instruction to the forklift of which the driver is a witness based on the alarm information, the real-time position and the real-time speed of the forklift, and the occurrence rate of safety accidents of the forklift can be reduced.

Description

Monitoring system, method and device for forklift running safety
Technical Field
The application relates to the technical field of vehicle control, in particular to a monitoring system, method and device for forklift running safety.
Background
At present, the forklift is increasingly commonly applied in the logistics industry, and safety accidents occur more frequently, wherein the main factor causing the safety accidents of the forklift is that no witness performs forklift driving. The prior art is to manage and control the driver without a witness to drive the vehicle, and usually, the identity of the driver is checked in a manual mode before the vehicle is used, but the checking efficiency in the mode is low, and a great deal of manpower and time cost are required to be consumed. Meanwhile, the replacement of a driver in the forklift working process cannot be checked in time, and safety accidents cannot be avoided.
Disclosure of Invention
The application provides a monitoring system, method and device for forklift running safety, which are used for realizing automatic monitoring of forklift running safety, improving checking efficiency of driver identity and carrying out emergency treatment on a driving forklift without license, and further reducing the occurrence rate of forklift safety accidents.
The application provides a monitored control system of fork truck safety of traveling, monitored control system is used for going the safety control to a plurality of fork trucks in the target workplace, monitored control system includes:
the monitoring components are arranged on each forklift in the target workplace, and the background server is in communication connection with each monitoring component;
The monitoring assembly comprises an image acquisition module, a pressure detection module, a driving data acquisition module and a control module which is in communication connection with the image acquisition module, the pressure detection module and the driving data acquisition module;
the pressure detection module is used for detecting a real-time pressure value born by a forklift seat and feeding back the real-time pressure value to the control module, the driving data acquisition module is used for acquiring the real-time position and the real-time speed of the forklift and feeding back the real-time position and the real-time speed to the control module, and the control module is used for forwarding the real-time position and the real-time speed of the forklift to the background server;
the control module is also used for controlling the image acquisition module to acquire a target area image based on the real-time position of the forklift and the change condition of the real-time pressure value born by the forklift seat, determining whether the current driver is a witness or not based on the target area image, and sending alarm information to a background server under the condition that the current driver is the witness;
the background server is used for sending an emergency control instruction to a first target forklift of which the driver is a witness based on the alarm information, the real-time position and the real-time speed of each forklift so as to instruct a control module of the first target forklift to carry out emergency control on the first target forklift.
According to the monitoring system for forklift running safety, the control module is further used for adjusting the shooting angle of the image acquisition module under the condition that the characteristic information in the image of the target area is not full, and sending an assistance identification request to the background server under the condition that the shooting angle adjustment times reach a preset threshold value and the corresponding characteristic information in the image of the target area is still not full.
According to the monitoring system for the forklift running safety, the background server is further used for determining the corresponding second target forklift based on the assistance identification request, determining the third target forklift for assistance identification based on the real-time position of each forklift, sending assistance shooting instructions to the third target forklift to instruct the control module of the third target forklift to control the corresponding image acquisition module to acquire the target area supplementary shooting image and feeding back the image to the second target forklift.
The application also provides a monitoring method of the forklift running safety, which is applied to a control module of any monitoring component in the monitoring system of the forklift running safety, and comprises the following steps:
controlling an image acquisition module to acquire a target area image based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift;
Determining whether the current driver is a witness or not based on the target area image, sending alarm information to a background server under the condition that the current driver is the witness, and carrying out emergency control on a corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, and the real-time position and the real-time speed of each forklift.
According to the monitoring method for the running safety of the forklift provided by the application, the image acquisition module is controlled to acquire the image of the target area based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat, and the method specifically comprises the following steps:
determining whether a driver is replaced in a forklift cab based on the change condition of the real-time pressure value born by the forklift seat of the corresponding forklift;
under the condition that a driver is replaced, determining whether the current time period and the current position of the corresponding forklift meet preset driver replacement conditions, and if not, starting an image acquisition module to acquire an image of a target area.
According to the monitoring method for the running safety of the forklift provided by the application, the determining whether the current time period and the current position of the corresponding forklift meet the preset driver replacement condition or not specifically comprises the following steps:
Judging that the preset driver replacement condition is met under the condition that the current time period is a shift-switching time period and the current position of the corresponding forklift is a rest area; otherwise, judging that the preset driver replacement condition is not met.
According to the monitoring method for forklift running safety provided by the application, the method for determining whether the current driver is a witness or not based on the target area image specifically comprises the following steps:
judging whether the characteristic information in the target area image is complete or not, and adjusting the shooting angle of the image acquisition module under the condition that the characteristic information in the target area image is not complete;
under the condition that the shooting angle adjustment times reach a preset threshold value and the characteristic information in the corresponding target area image is still incomplete, sending an auxiliary identification request to the background server, and receiving a target area supplementary shooting image fed back by a forklift for auxiliary identification; the forklift for assisting in recognition is determined by the background server based on the assisting recognition request and the real-time position of each forklift, and the target area complement image is acquired by the forklift for assisting in recognition based on the assisting shooting instruction sent by the background server and controlled by the corresponding image acquisition module;
And determining whether the current driver is a no-license person or not based on the target area image and the target area complement image.
According to the monitoring method for the running safety of the forklift provided by the application, the emergency control instruction fed back by the background server is used for carrying out emergency control on the corresponding forklift, and the method specifically comprises the following steps:
determining a corresponding emergency running route and an emergency running speed based on the emergency control instruction;
and controlling the corresponding forklift to travel to a rest area based on the emergency travel route and the emergency travel speed.
According to the monitoring method for the forklift running safety, before the alarm information is sent to the background server, the method further comprises the following steps: and controlling the corresponding forklift to enter a locking mode, and correspondingly, after sending alarm information to a background server, the method further comprises the following steps:
and updating a preset driver database based on the driver updating instruction fed back by the background server, and releasing the locking mode.
The application also provides a monitoring device of fork truck safety of traveling, the device is applied to the control module of any monitoring module in the aforementioned monitoring system of fork truck safety of traveling, the device includes:
The image acquisition control unit is used for controlling the image acquisition module to acquire the image of the target area based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift;
the emergency control unit is used for determining whether the current driver is a witness or not based on the target area image, sending alarm information to a background server under the condition that the current driver is the witness, and carrying out emergency control on the corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, and the real-time position and the real-time speed of each forklift.
The present application also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of a method of monitoring the running safety of a forklift as described in any one of the above.
The application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of a method for monitoring the running safety of a forklift as described in any one of the above.
The application provides a monitoring system, a method and a device for forklift running safety, wherein the monitoring system is used for monitoring the running safety of a plurality of forklifts in a target workplace, and the monitoring system comprises: the monitoring components are arranged on each forklift in the target workplace, and the background server is in communication connection with each monitoring component; the monitoring assembly comprises an image acquisition module, a pressure detection module, a driving data acquisition module and a control module which is in communication connection with the image acquisition module, the pressure detection module and the driving data acquisition module; the pressure detection module is used for detecting a real-time pressure value born by a forklift seat and feeding back the real-time pressure value to the control module, the driving data acquisition module is used for acquiring the real-time position and the real-time speed of the forklift and feeding back the real-time position and the real-time speed to the control module, and the control module is used for forwarding the real-time position and the real-time speed of the forklift to the background server; the control module is also used for controlling the image acquisition module to acquire a target area image based on the real-time position of the forklift and the change condition of the real-time pressure value born by the forklift seat, determining whether the current driver is a witness or not based on the target area image, and sending alarm information to a background server under the condition that the current driver is the witness; the background server is used for sending an emergency control instruction to a first target forklift of which the driver is a no-license person based on the alarm information, the real-time position and the real-time speed of each forklift to instruct a control module of the first target forklift to carry out emergency control on the first target forklift, so that automatic monitoring of forklift running safety can be realized, timeliness and accuracy of no-license person detection are guaranteed under the condition that the energy consumption of the image acquisition module is reduced to the maximum extent, verification efficiency of driver identity is improved, emergency treatment is carried out on the no-license driving forklift, and further the occurrence rate of forklift safety accidents is reduced.
Drawings
For a clearer description of the present application or of the prior art, the drawings that are used in the description of the embodiments or of the prior art will be briefly described, it being apparent that the drawings in the description below are some embodiments of the present application, and that other drawings may be obtained from these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a monitoring system for forklift running safety provided by the application;
fig. 2 is a flow chart of a method for monitoring the running safety of a forklift provided by the application;
FIG. 3 is a schematic diagram of a control flow for capturing an image of a target area provided herein;
FIG. 4 is a schematic illustration of a determination flow of a witness provided herein;
fig. 5 is a schematic structural diagram of a monitoring device for forklift running safety provided by the application;
fig. 6 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the present application more apparent, the technical solutions in the present application will be clearly and completely described below with reference to the drawings in the present application, and it is apparent that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
Fig. 1 is a schematic structural diagram of a monitoring system for safety of forklift travel provided in the present application, where the monitoring system is used for monitoring safety of forklift travel in a target workplace, and the monitoring system includes:
the monitoring components are arranged on each forklift in the target workplace, and the background server is in communication connection with each monitoring component;
the monitoring assembly comprises an image acquisition module, a pressure detection module, a driving data acquisition module and a control module which is in communication connection with the image acquisition module, the pressure detection module and the driving data acquisition module;
the pressure detection module is used for detecting a real-time pressure value born by a forklift seat and feeding back the real-time pressure value to the control module, the driving data acquisition module is used for acquiring the real-time position and the real-time speed of the forklift and feeding back the real-time position and the real-time speed to the control module, and the control module is used for forwarding the real-time position and the real-time speed of the forklift to the background server;
the control module is also used for controlling the image acquisition module to acquire a target area image based on the real-time position of the forklift and the change condition of the real-time pressure value born by the forklift seat, determining whether the current driver is a witness or not based on the target area image, and sending alarm information to a background server under the condition that the current driver is the witness;
The background server is used for sending an emergency control instruction to a first target forklift of which the driver is a witness based on the alarm information, the real-time position and the real-time speed of each forklift so as to instruct a control module of the first target forklift to carry out emergency control on the first target forklift.
Specifically, the target workplace may be a port, a station, an airport, a goods yard, a factory workshop, a warehouse, a circulation center, a distribution center, etc., which is not particularly limited in the embodiment of the present application. The background server can be arranged in a central control room of the target workplace so that workers can check the working condition of each forklift in time and operate the background server. The image acquisition module can be arranged at the junction of the forklift roof and the front windshield so as to acquire images without influencing the visual field of a driver, and of course, the image acquisition module can also be arranged at other suitable positions, and the embodiment of the application is not particularly limited. The pressure detection module is arranged below the cushion of the forklift seat so as to acquire a real-time pressure value born by the forklift seat. The driving data acquisition module can comprise a positioning sub-module and a speed detection sub-module so as to acquire the real-time position and the real-time speed of the forklift.
It is noted that, because the target workplace needs to carry out the carrying work continuously, the forklift of the target workplace usually works continuously for 24 hours, and based on this, the forklift driver usually works in a three-shift form, and each type of target workplace sets a suitable shift-over period for the forklift driver to shift over. Based on the foregoing, in the prior art, in order to control a driver without a witness to drive a vehicle, the identity of the driver is usually checked manually before the vehicle is used, but the checking efficiency is low, and a great deal of manpower and time cost are required to be consumed. Meanwhile, the replacement of a driver in the forklift working process cannot be checked in time, and safety accidents cannot be avoided. To solve the problem, the embodiment of the application detects a real-time pressure value born by a forklift seat through the pressure detection module, determines whether a driver is replaced or not based on the change condition of the real-time pressure value, and acquires a target area image through the image acquisition module under the condition that the driver is replaced so as to determine whether the current driver is a no-license person based on the target area image. It can be appreciated that the target area is a cab area of the forklift, based on which the face information of the driver can be quickly collected for subsequent witness confirmation. It can be further understood that the real-time pressure values born by the forklift seat under the condition of drivers and no drivers can be obviously different, meanwhile, the pressure values born by the forklift seat can be different for different drivers due to different weights of the drivers, and based on the difference, whether the drivers are replaced or not can be determined according to the change condition of the real-time pressure values. According to the method and the device, researches show that hidden danger that no witness drives the forklift is likely to exist only under the condition that a driver is replaced, therefore, the image acquisition module is started to acquire the image of the target area only under the condition that the driver is replaced, and based on the fact, timeliness and accuracy of detection of no witness can be guaranteed under the condition that energy consumption of the image acquisition module is reduced to the maximum extent.
According to the method and the device, the face information of the licensed forklift driver in the target workplace is collected in advance, the preset driver database is formed and stored in the background server, and the background server sends the preset driver database to the control module of the monitoring assembly of each forklift. Based on the above, the control module of the monitoring component of each forklift can match the face information in the target area image with the face information in the preset driver database to determine whether the current driver is a no-license person.
Under the condition that the current driver is a no-license person, the control module can send alarm information to the background server, and the background server is used for sending an emergency control instruction to a first target forklift of which the driver is the no-license person based on the alarm information, the real-time position and the real-time speed of each forklift so as to instruct the control module of the first target forklift to carry out emergency control on the first target forklift, and based on the emergency control instruction, the possible safety accidents caused by the fact that the no-license person continues to drive the forklift can be avoided.
The control module is further used for adjusting the shooting angle of the image acquisition module under the condition that the characteristic information in the target area image is not full, and sending an assistance identification request to the background server under the condition that the shooting angle adjustment times reach a preset threshold value and the characteristic information in the corresponding target area image is still not full. The feature information includes all features of the face, i.e., eyes, nose, mouth, and cheeks, for accurate identity matching. It can be appreciated that, in the case that the driver sits and drives the forklift normally, the image of the target area collected by the image collection module can include all the characteristic information. However, the driver without the license may avoid identity verification by avoiding shooting, so that the target area image may have insufficient characteristic information. Aiming at the problem, the embodiment of the application ensures that the complete target area image of the characteristic information is acquired by adjusting the shooting angle of the image acquisition module so as to carry out identity matching. Meanwhile, in consideration of ensuring identity verification efficiency, when the number of times of adjustment of the shooting angle reaches a preset threshold and feature information in a corresponding target area image is still incomplete (for example, a driver without a license keeps avoiding shooting), the control module in the embodiment of the application can send an assistance identification request to the background server.
After receiving the assistance recognition request, the background server is further configured to determine a corresponding second target forklift (i.e. a forklift that needs assistance recognition) based on the assistance recognition request, determine a third target forklift for assistance recognition based on a real-time position of each forklift, and send an assistance shooting instruction to the third target forklift to instruct a control module of the third target forklift to control a corresponding image acquisition module to acquire a target area complement image and feed back the target area complement image to the second target forklift. It will be appreciated that, in order to ensure the handling efficiency, the target workplace typically includes a plurality of parallel forklift travel routes, based on which, the target area image (i.e. the target area complement image) of the second target forklift may be acquired by the forklift on the parallel travel route of the travel route where the second target forklift is located and fed back to the second target forklift for the second target forklift to acquire complete feature information based on the target area image and the target area complement image. The third target forklift is preferably a forklift located at the same position as the second target forklift on a parallel driving route of the driving route where the second target forklift is located, and based on this, it can be ensured that the target area supplementary shot image includes as much feature information as possible.
The system provided by the embodiment of the application comprises: the monitoring components are arranged on each forklift in the target workplace, and the background server is in communication connection with each monitoring component; the monitoring assembly comprises an image acquisition module, a pressure detection module, a driving data acquisition module and a control module which is in communication connection with the image acquisition module, the pressure detection module and the driving data acquisition module; the pressure detection module is used for detecting a real-time pressure value born by a forklift seat and feeding back the real-time pressure value to the control module, the driving data acquisition module is used for acquiring the real-time position and the real-time speed of the forklift and feeding back the real-time position and the real-time speed to the control module, and the control module is used for forwarding the real-time position and the real-time speed of the forklift to the background server; the control module is also used for controlling the image acquisition module to acquire a target area image based on the real-time position of the forklift and the change condition of the real-time pressure value born by the forklift seat, determining whether the current driver is a witness or not based on the target area image, and sending alarm information to a background server under the condition that the current driver is the witness; the background server is used for sending an emergency control instruction to a first target forklift of which the driver is a no-license person based on the alarm information, the real-time position and the real-time speed of each forklift to instruct a control module of the first target forklift to carry out emergency control on the first target forklift, so that automatic monitoring of forklift running safety can be realized, timeliness and accuracy of no-license person detection are guaranteed under the condition that the energy consumption of the image acquisition module is reduced to the maximum extent, verification efficiency of driver identity is improved, emergency treatment is carried out on the no-license driving forklift, and further the occurrence rate of forklift safety accidents is reduced.
Fig. 2 is a flow chart of a method for monitoring forklift running safety, which is applied to a control module of any monitoring component in the forklift running safety monitoring system according to the foregoing embodiment, as shown in fig. 2, and includes:
step 101, controlling an image acquisition module to acquire an image of a target area based on the real-time position of a corresponding forklift and the change condition of a real-time pressure value born by a forklift seat; the target area is a cab area corresponding to the forklift.
Step 102, determining whether the current driver is a witness or not based on the target area image, sending alarm information to a background server under the condition that the current driver is the witness, and carrying out emergency control on a corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, and the real-time position and the real-time speed of each forklift.
Specifically, fig. 3 is a schematic diagram of a control flow for acquiring an image of a target area, as shown in fig. 3, where the image acquisition module is controlled to acquire the image of the target area based on a real-time position of a corresponding forklift and a change condition of a real-time pressure value borne by a forklift seat, and specifically includes:
Step 201, determining whether a driver is replaced in a forklift cab based on the change condition of a real-time pressure value born by a forklift seat of a corresponding forklift;
step 202, under the condition that a driver is replaced, determining whether the current time period and the current position of the corresponding forklift meet preset driver replacement conditions, and if not, starting an image acquisition module to acquire an image of a target area.
The determining whether the current time period and the current position of the corresponding forklift meet the preset driver replacement condition specifically comprises the following steps:
judging that the preset driver replacement condition is met under the condition that the current time period is a shift-switching time period and the current position of the corresponding forklift is a rest area; otherwise, judging that the preset driver replacement condition is not met.
Based on the foregoing embodiment, the real-time pressure values borne by the forklift seat under the condition of having a driver and no driver will have obvious differences, meanwhile, the pressure values borne by the forklift seat will also have differences for different drivers due to different weights of the drivers, and based on this, the embodiment of the application can determine, through experiments in advance, the first pressure value interval corresponding to the condition of having no driver and the second pressure interval corresponding to the condition of having the driver seated, and based on this, whether the driver is replaced in the forklift cab can be determined based on the change condition of the real-time pressure values borne by the forklift seat corresponding to the forklift. It can be understood that when the change condition of the real-time pressure value born by the forklift seat shows that the state corresponding to the seat is changed to be the state of having the driver, no driver and having the driver, and the pressure values corresponding to the states of having the driver in front and back two times are the same, the driver is indicated to be not replaced. However, if the pressure values corresponding to the driver states are different in the front and rear two times, the driver replacement is indicated. Based on the foregoing embodiments, it is also known that a normal shift may be attributed to a driver change. It can be appreciated that only the licensed driver can learn the shift time point and shift place, so that the normal shift cannot be at risk of driving the forklift by the unlicensed driver. Based on the above, in order to accurately judge whether the current driver replacement belongs to normal shift, the image acquisition module is prevented from being started by mistake. According to the method and the device for determining the position of the forklift in the image acquisition mode, under the condition that a driver is replaced, whether the current time period and the current position of the forklift meet the preset driver replacement condition or not is further determined, and if not, the image acquisition module is started to acquire the image of the target area. It can also be understood that the preset driver replacement condition is judged to be satisfied only when the current time period is the shift-to-shift time period and the current position of the corresponding forklift is the rest area (i.e., the designated shift-to-shift place); otherwise, judging that the preset driver replacement condition is not met. Based on the mode, timeliness and accuracy of detection of no-witness can be guaranteed under the condition that energy consumption of the image acquisition module is reduced to the maximum extent.
Further, fig. 4 is a schematic diagram of a determination flow of the witness provided in the present application, and as shown in fig. 4, the determining whether the current driver is the witness based on the target area image specifically includes:
step 301, judging whether the feature information in the target area image is complete, and adjusting the shooting angle of the image acquisition module under the condition that the feature information in the target area image is not complete;
step 302, sending an auxiliary identification request to the background server and receiving a target area supplementary shooting image fed back by a forklift for auxiliary identification under the condition that the shooting angle adjustment times reach a preset threshold value and the characteristic information in the corresponding target area image is still incomplete; the forklift for assisting in recognition is determined by the background server based on the assisting recognition request and the real-time position of each forklift, and the target area complement image is acquired by the forklift for assisting in recognition based on the assisting shooting instruction sent by the background server and controlled by the corresponding image acquisition module;
step 303, determining whether the current driver is a no-license person based on the target area image and the target area complement image.
The preset threshold may be adjusted according to actual needs, which is not specifically limited in the embodiment of the present application. It can be understood that the target area image is the target area image acquired by the image acquisition module of the corresponding forklift truck, and because the shooting angle is adjusted for a plurality of times, the target area image is a plurality of images, and correspondingly, the target area supplementary shooting image can also be a plurality of images, so that the comprehensiveness of the characteristic information can be ensured to the greatest extent, and the accuracy of the identity check of the current driver is further ensured. The principles and effects of steps 301-303 are described in detail in the foregoing embodiments, and are not repeated here.
Further, the emergency control instruction based on the feedback of the background server performs emergency control on the corresponding forklift, and specifically includes:
determining a corresponding emergency running route and an emergency running speed based on the emergency control instruction;
and controlling the corresponding forklift to travel to a rest area based on the emergency travel route and the emergency travel speed.
Based on the foregoing, it can be understood that, when the current period is the shift period and the current position of the corresponding forklift is the rest area, it is determined that the preset driver replacement condition is satisfied, and based on this, when the alarm information is sent to the background server, it is indicated that the current period is not the shift period and/or the current position of the corresponding forklift is not the rest area. Therefore, emergency control needs to be performed on the corresponding forklift to avoid affecting the work of other forklifts and also avoid safety accidents. Based on the above, the background server of the embodiment of the application can determine the emergency running route and the emergency running speed of the corresponding forklift according to the real-time position and the real-time speed of each forklift, generate an emergency control instruction, and further determine the corresponding emergency running route and emergency running speed based on the emergency control instruction, and control the corresponding forklift to run to the rest area based on the emergency running route and the emergency running speed.
It is further understood that before sending the alarm information to the background server, the method further comprises: and controlling the corresponding forklift to enter a locking mode. In the locking mode, the corresponding forklift is kept in a static state so as to avoid potential safety hazards caused by continued driving of the forklift by no-license personnel.
It is worth noting that, since the preset driver database is sent by the background server to the control module of the monitoring assembly of each forklift. Therefore, in the actual application process, the situation that the current driver is misjudged as a witness due to the fact that the preset driver database information in the control module is not updated timely may exist. Based on this, after sending the alarm information to the background server, the method further comprises:
and updating a preset driver database based on the driver updating instruction fed back by the background server, and releasing the locking mode.
Specifically, the alarm information includes related information for checking the identity of the driver by the control module, where the related information includes, but is not limited to, the target area image, the target area complement image, and intermediate information generated in the identity checking process, based on which, after receiving the alarm information, the background server may perform secondary identity checking on the current driver based on the stored preset driver database, the target area image, the target area complement image, and the intermediate information generated in the identity checking process, and if the secondary checking result is that the current driver is a person with a certificate, a driver update instruction is fed back to the control module corresponding to the forklift to update the preset driver database in the control module, and the locking mode is released so that the current driver can work normally.
According to the method provided by the embodiment of the application, the image acquisition module is controlled to acquire the image of the target area based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift; determining whether the current driver is a witness or not based on the target area image, sending alarm information to a background server under the condition that the current driver is the witness, and carrying out emergency control on a corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, the real-time position and the real-time speed of each forklift, so that automatic monitoring of forklift running safety can be realized, timeliness and accuracy of no-license personnel detection are guaranteed under the condition of reducing the energy consumption of the image acquisition module to the maximum extent, checking efficiency of driver identity is improved, emergency treatment is carried out on no-license forklift, and further the occurrence rate of forklift safety accidents is reduced.
The following describes the monitoring device for forklift running safety provided by the application, and the monitoring device for forklift running safety described below and the monitoring method for forklift running safety described above can be referred to correspondingly.
Based on any of the above embodiments, fig. 5 is a schematic structural diagram of a monitoring device for forklift running safety, where the device is applied to a control module of any one of monitoring components in the monitoring system for forklift running safety according to the foregoing embodiment, as shown in fig. 5, and the device includes:
the image acquisition control unit 401 is used for controlling the image acquisition module to acquire the image of the target area based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift;
the emergency control unit 402 is configured to determine whether the current driver is a no-license person based on the target area image, send alarm information to a background server if the current driver is a no-license person, and perform emergency control on a corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, and the real-time position and the real-time speed of each forklift.
According to the device provided by the embodiment of the application, the image acquisition control unit 401 controls the image acquisition module to acquire the image of the target area based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift; the emergency control unit 402 determines whether the current driver is a witness or not based on the target area image, sends alarm information to a background server under the condition that the current driver is the witness, and performs emergency control on a corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, the real-time position and the real-time speed of each forklift, so that automatic monitoring of forklift running safety can be realized, timeliness and accuracy of no-license personnel detection are guaranteed under the condition of reducing the energy consumption of the image acquisition module to the maximum extent, checking efficiency of driver identity is improved, emergency treatment is carried out on no-license forklift, and further the occurrence rate of forklift safety accidents is reduced.
Based on the above embodiment, the image acquisition module is controlled to acquire an image of a target area based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value borne by the forklift seat, and specifically includes:
determining whether a driver is replaced in a forklift cab based on the change condition of the real-time pressure value born by the forklift seat of the corresponding forklift;
under the condition that a driver is replaced, determining whether the current time period and the current position of the corresponding forklift meet preset driver replacement conditions, and if not, starting an image acquisition module to acquire an image of a target area.
Based on any one of the foregoing embodiments, the determining whether the current period and the current position of the corresponding forklift meet the preset driver replacement condition specifically includes:
judging that the preset driver replacement condition is met under the condition that the current time period is a shift-switching time period and the current position of the corresponding forklift is a rest area; otherwise, judging that the preset driver replacement condition is not met.
Based on any of the foregoing embodiments, the determining whether the current driver is a no-license person based on the target area image specifically includes:
judging whether the characteristic information in the target area image is complete or not, and adjusting the shooting angle of the image acquisition module under the condition that the characteristic information in the target area image is not complete;
Under the condition that the shooting angle adjustment times reach a preset threshold value and the characteristic information in the corresponding target area image is still incomplete, sending an auxiliary identification request to the background server, and receiving a target area supplementary shooting image fed back by a forklift for auxiliary identification; the forklift for assisting in recognition is determined by the background server based on the assisting recognition request and the real-time position of each forklift, and the target area complement image is acquired by the forklift for assisting in recognition based on the assisting shooting instruction sent by the background server and controlled by the corresponding image acquisition module;
and determining whether the current driver is a no-license person or not based on the target area image and the target area complement image.
Based on any one of the foregoing embodiments, the emergency control instruction based on the feedback of the background server performs emergency control on the corresponding forklift, and specifically includes:
determining a corresponding emergency running route and an emergency running speed based on the emergency control instruction;
and controlling the corresponding forklift to travel to a rest area based on the emergency travel route and the emergency travel speed.
Based on any of the above embodiments, before sending the alarm information to the background server, the emergency control unit 402 is further configured to control the corresponding forklift to enter the locking mode, and correspondingly, after sending the alarm information to the background server, the emergency control unit 402 is further configured to update the preset driver database based on the driver update instruction fed back by the background server, and release the locking mode.
Fig. 6 illustrates a physical schematic diagram of an electronic device, as shown in fig. 6, which may include: the device comprises a processor 501, a communication interface 502, a memory 503 and a communication bus 504, wherein the processor 501, the communication interface 502 and the memory 503 are in communication with each other through the communication bus 504. The processor 501 may call logic instructions in the memory 503 to execute the method for monitoring the running safety of the forklift provided by the above methods, where the method includes: controlling an image acquisition module to acquire a target area image based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift; determining whether the current driver is a witness or not based on the target area image, sending alarm information to a background server under the condition that the current driver is the witness, and carrying out emergency control on a corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, and the real-time position and the real-time speed of each forklift.
Further, the logic instructions in the memory 503 described above may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a stand alone product. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In another aspect, the present application further provides a computer program product, where the computer program product includes a computer program, where the computer program may be stored on a non-transitory computer readable storage medium, where the computer program, when executed by a processor, is capable of executing a method for monitoring the running safety of a forklift provided by the above methods, where the method includes: controlling an image acquisition module to acquire a target area image based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift; determining whether the current driver is a witness or not based on the target area image, sending alarm information to a background server under the condition that the current driver is the witness, and carrying out emergency control on a corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, and the real-time position and the real-time speed of each forklift.
In still another aspect, the present application further provides a non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor, is implemented to perform a method for monitoring the running safety of a forklift provided by the above methods, the method comprising: controlling an image acquisition module to acquire a target area image based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift; determining whether the current driver is a witness or not based on the target area image, sending alarm information to a background server under the condition that the current driver is the witness, and carrying out emergency control on a corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, and the real-time position and the real-time speed of each forklift.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting thereof; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the corresponding technical solutions.

Claims (4)

1. The method is applied to a control module of any monitoring component in a monitoring system of forklift running safety, wherein the monitoring system of forklift running safety is used for monitoring running safety of a plurality of forklifts in a target workplace, and the monitoring system comprises:
the monitoring components are arranged on each forklift in the target workplace, and the background server is in communication connection with each monitoring component; the monitoring assembly comprises an image acquisition module, a pressure detection module, a driving data acquisition module and a control module which is in communication connection with the image acquisition module, the pressure detection module and the driving data acquisition module; the pressure detection module is used for detecting a real-time pressure value born by the forklift seat and feeding back to the control module, and the driving data acquisition module is used for acquiring the real-time position and the real-time speed of the forklift and feeding back to the control module;
The method comprises the following steps:
controlling an image acquisition module to acquire a target area image based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift;
determining whether the current driver is a witness or not based on the target area image, sending alarm information to a background server under the condition that the current driver is the witness, and carrying out emergency control on a corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, and the real-time position and real-time speed of each forklift;
the image acquisition module is controlled to acquire the image of the target area based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat, and specifically comprises the following steps:
determining whether a driver is replaced in a forklift cab based on the change condition of the real-time pressure value born by the forklift seat of the corresponding forklift;
under the condition that a driver is replaced, determining whether the current time period and the current position of the corresponding forklift meet preset driver replacement conditions, and if not, starting an image acquisition module to acquire an image of a target area;
The determining whether the current time period and the current position of the corresponding forklift meet the preset driver replacement condition specifically comprises the following steps:
judging that the preset driver replacement condition is met under the condition that the current time period is a shift-switching time period and the current position of the corresponding forklift is a rest area; otherwise, judging that the preset driver replacement condition is not met;
the determining whether the current driver is a witness based on the target area image specifically comprises:
judging whether the characteristic information in the target area image is complete or not, and adjusting the shooting angle of the image acquisition module under the condition that the characteristic information in the target area image is not complete;
under the condition that the shooting angle adjustment times reach a preset threshold value and the characteristic information in the corresponding target area image is still incomplete, sending an auxiliary identification request to the background server, and receiving a target area supplementary shooting image fed back by a forklift for auxiliary identification; the forklift for assisting in recognition is determined by the background server based on the assisting recognition request and the real-time position of each forklift, and the target area complement image is acquired by the forklift for assisting in recognition based on the assisting shooting instruction sent by the background server and controlled by the corresponding image acquisition module;
And determining whether the current driver is a no-license person or not based on the target area image and the target area complement image.
2. The method for monitoring the running safety of the forklift according to claim 1, wherein the emergency control command based on the feedback of the background server performs emergency control on the corresponding forklift, and specifically comprises:
determining a corresponding emergency running route and an emergency running speed based on the emergency control instruction;
and controlling the corresponding forklift to travel to a rest area based on the emergency travel route and the emergency travel speed.
3. The method for monitoring the running safety of a forklift according to claim 1, wherein before sending the alarm information to the background server, the method further comprises: and controlling the corresponding forklift to enter a locking mode, and correspondingly, after sending alarm information to a background server, the method further comprises the following steps:
and updating a preset driver database based on the driver updating instruction fed back by the background server, and releasing the locking mode.
4. The utility model provides a monitoring device of fork truck safety of traveling, its characterized in that, the device is applied to the control module of any control module in a fork truck safety of traveling monitored control system, fork truck safety of traveling monitored control system is used for going safety control to a plurality of fork trucks in the target workplace, monitored control system includes:
The monitoring components are arranged on each forklift in the target workplace, and the background server is in communication connection with each monitoring component; the monitoring assembly comprises an image acquisition module, a pressure detection module, a driving data acquisition module and a control module which is in communication connection with the image acquisition module, the pressure detection module and the driving data acquisition module; the pressure detection module is used for detecting a real-time pressure value born by the forklift seat and feeding back to the control module, and the driving data acquisition module is used for acquiring the real-time position and the real-time speed of the forklift and feeding back to the control module;
the device comprises:
the image acquisition control unit is used for controlling the image acquisition module to acquire the image of the target area based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat; the target area is a cab area corresponding to the forklift;
the emergency control unit is used for determining whether the current driver is a witness or not based on the target area image, sending alarm information to a background server under the condition that the current driver is the witness, and carrying out emergency control on the corresponding forklift based on an emergency control instruction fed back by the background server; the emergency control instruction is generated by the background server based on the alarm information, and the real-time position and real-time speed of each forklift;
The image acquisition module is controlled to acquire the image of the target area based on the real-time position of the corresponding forklift and the change condition of the real-time pressure value born by the forklift seat, and specifically comprises the following steps:
determining whether a driver is replaced in a forklift cab based on the change condition of the real-time pressure value born by the forklift seat of the corresponding forklift;
under the condition that a driver is replaced, determining whether the current time period and the current position of the corresponding forklift meet preset driver replacement conditions, and if not, starting an image acquisition module to acquire an image of a target area;
the determining whether the current time period and the current position of the corresponding forklift meet the preset driver replacement condition specifically comprises the following steps:
judging that the preset driver replacement condition is met under the condition that the current time period is a shift-switching time period and the current position of the corresponding forklift is a rest area; otherwise, judging that the preset driver replacement condition is not met;
the determining whether the current driver is a witness based on the target area image specifically comprises:
judging whether the characteristic information in the target area image is complete or not, and adjusting the shooting angle of the image acquisition module under the condition that the characteristic information in the target area image is not complete;
Under the condition that the shooting angle adjustment times reach a preset threshold value and the characteristic information in the corresponding target area image is still incomplete, sending an auxiliary identification request to the background server, and receiving a target area supplementary shooting image fed back by a forklift for auxiliary identification; the forklift for assisting in recognition is determined by the background server based on the assisting recognition request and the real-time position of each forklift, and the target area complement image is acquired by the forklift for assisting in recognition based on the assisting shooting instruction sent by the background server and controlled by the corresponding image acquisition module;
and determining whether the current driver is a no-license person or not based on the target area image and the target area complement image.
CN202310182101.4A 2023-03-01 2023-03-01 Monitoring system, method and device for forklift running safety Active CN115818537B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310182101.4A CN115818537B (en) 2023-03-01 2023-03-01 Monitoring system, method and device for forklift running safety

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310182101.4A CN115818537B (en) 2023-03-01 2023-03-01 Monitoring system, method and device for forklift running safety

Publications (2)

Publication Number Publication Date
CN115818537A CN115818537A (en) 2023-03-21
CN115818537B true CN115818537B (en) 2023-05-05

Family

ID=85522262

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310182101.4A Active CN115818537B (en) 2023-03-01 2023-03-01 Monitoring system, method and device for forklift running safety

Country Status (1)

Country Link
CN (1) CN115818537B (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108162975A (en) * 2017-12-11 2018-06-15 厦门蓝斯通信股份有限公司 A kind of driver identity identification and monitoring and managing method and system
CN115225676A (en) * 2018-05-25 2022-10-21 西安艾润物联网技术服务有限责任公司 Driver identity online monitoring method and device and storage medium
CN112329526A (en) * 2020-09-29 2021-02-05 爱动超越人工智能科技(北京)有限责任公司 Real-time driving behavior analysis and early warning system and method based on AI vision
CN113077607A (en) * 2021-04-02 2021-07-06 中慧能源(杭州)有限公司 Forklift safety control equipment and system
CN113506436A (en) * 2021-05-19 2021-10-15 海南师范大学 System and method for monitoring and detecting whether driver plays mobile phone in vehicle

Also Published As

Publication number Publication date
CN115818537A (en) 2023-03-21

Similar Documents

Publication Publication Date Title
CN107640159A (en) A kind of automatic Pilot man-machine interactive system and method
CN108773433A (en) A kind of butt junction location calibration method and AGV trolleies based on AGV trolleies
JP2019533604A (en) Method and apparatus for assisting a driver when the vehicle's highly automatic driving mode is stopped
CN105172842B (en) A kind of train is driven to calibration method, equipment and system by station track
CN111284502B (en) Method and system for detecting pose of tractor group
US20200079391A1 (en) Method and system for assisting a driver in the event of a road departure
CN110807615A (en) Transportation management system and method thereof
CN111582167B (en) Container crane driver operation safety identification method, system and computing equipment
CN109189567B (en) Time delay calculation method, device, equipment and computer readable storage medium
CN115818537B (en) Monitoring system, method and device for forklift running safety
CN114253256B (en) Dump truck control method and device and dump truck
CN109050524A (en) A kind of braking of omnidirectional vehicle and accelerate control method and control system
KR20220024768A (en) Damage detection device and method
CN105217477A (en) Crane hoisting multiplying power automatic recognition control method and control system
CN114387802B (en) Remote take-over system and method for unmanned mining truck of surface mine
CN116279428A (en) Method and system for automatic parking and obstacle avoidance
CN112660171B (en) Safety protection system and method
EP4033035A1 (en) A system and method therein for remote operation of a working machine comprising a tool
CN110812762B (en) Control method of intelligent fire truck
JPH04199304A (en) Production management system
US11235692B2 (en) Working unit, a working equipment, and a method in relation to a working unit
JP7399670B2 (en) A warehousing management system for a mechanical parking device, its warehousing management method, a warehousing management program, a mechanical parking device
EP3922528A1 (en) Safety system for a vehicle combination
CN113085893A (en) Vehicle control method and device based on image recognition
CN114495542B (en) Driving assistance method, driving assistance device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant