CN110428589B - Monitoring method, device, equipment and storage medium - Google Patents
Monitoring method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN110428589B CN110428589B CN201910691383.4A CN201910691383A CN110428589B CN 110428589 B CN110428589 B CN 110428589B CN 201910691383 A CN201910691383 A CN 201910691383A CN 110428589 B CN110428589 B CN 110428589B
- Authority
- CN
- China
- Prior art keywords
- getting
- time
- boarding
- action
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/22—Status alarms responsive to presence or absence of persons
Landscapes
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
- Emergency Alarm Devices (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the invention relates to the technical field of monitoring, in particular to a monitoring method, a monitoring device, monitoring equipment and a storage medium. A method of monitoring, comprising: acquiring a current image frame of a boarding point; determining time information related to the getting-on action in the image frame; and judging whether getting-on is illegal according to the time information related to the action. The method comprises the steps of determining that the image frame has action time information of getting-on action; and determining whether getting-on is illegal according to the action time information. The machine replaces manual monitoring, and the monitoring effect is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of intelligent monitoring, in particular to a monitoring method, a monitoring device, monitoring equipment and a storage medium.
Background
The monkey car is colliery upper and lower well operation personnel's transport means, the monkey car comprises parts such as hanging seat, cableway, motor, the operation personnel is at the colliery mouth, the shaft bottom is taken a bus in district and is hung the monkey car hanging point and pick up the monkey car hanging seat after, hang the monkey car hanging seat on the monkey car cableway, the cableway is held tightly to the rope clip on the hanging seat, personnel straddle on the hanging seat, motor drive cableway drives the reciprocal operation of monkey car hanging seat, play reciprocal transport personnel's effect. At present, a coal mine is specially provided with one person in a monkey vehicle riding area to supervise whether a worker going into and out of a well takes the monkey vehicle according to a specified distance, but the supervisors have the phenomenon of long-time off duty and off duty, and the supervision has the defects of being not objective, not timely, poor in effect and high in cost.
Disclosure of Invention
The embodiment of the invention aims to provide a monitoring method, a monitoring device, monitoring equipment and a storage medium, which are used for solving the problem of poor monitoring effect caused by manual monitoring in the prior art.
In order to achieve the above object, the embodiments of the present invention mainly provide the following technical solutions:
in a first aspect, an embodiment of the present invention provides a monitoring method, including: acquiring a current image frame of a boarding point;
determining time information related to the getting-on action in the image frame;
and judging whether the boarding is illegal according to the time information related to the boarding action, and outputting an alarm instruction if the boarding is illegal.
Further, the action-related time information includes:
a starting time point of getting on and a finishing time point of getting on;
determining whether the violation occurs according to the time information related to the boarding action, wherein the determining comprises the following steps:
calculating the time consumed by getting on the bus by subtracting the starting time point from the finishing time point;
and if the time consumed by getting on the vehicle is greater than a preset second threshold value, determining that the action of getting on the vehicle is illegal.
Further, judging whether the violation occurs according to the time information related to the boarding action comprises the following steps:
determining a starting time point of getting on a vehicle in a current image frame;
calculating the time difference between the starting time point and the pre-stored boarding completion time point of the previous vehicle;
and if the time difference is smaller than a predetermined third threshold value, determining the action violation of the boarding.
Further, determining a starting time point of the getting-on, comprising:
determining the action of hanging the chair rod from the current image frame;
acquiring real-time width and height values of a marking frame of the chair lifting rod;
calculating to obtain a real-time width-height ratio according to the real-time width and height values of the marking frame;
calculating the absolute value of the difference value of the real-time width-height ratio and the standard value of the preset width-height ratio;
if the absolute value of the difference reaches a predetermined first threshold;
the point in time at which the predetermined first threshold value is reached is recorded as the starting point in time for the boarding.
Further, determining a completion time point of the getting-on, includes:
determining the action of taking the chair lifting rod from the current image frame;
acquiring a vertical coordinate of a central point of a marker frame of the hanging chair rod; and the ordinate of the center point of the marking frame of the person;
calculating the difference value of the vertical coordinate of the center point of the marking frame of the hanging chair rod and the vertical coordinate of the center point of the marking frame of the person;
if the difference value reaches a predetermined fourth threshold value, recording a time point of reaching the predetermined fourth threshold value as a completion time point of the getting-on.
Further, after determining that the boarding action is violation according to the time information related to the boarding action, the method includes: prompting to sit down one vehicle.
Further, if it is determined that there is a seat rail and no person in the current image frame of the boarding point, and there is no seat rail in the next plurality of image frames, it is determined that an empty car is sent out; sending an electric signal to the getting-on indicator lamp so as to enable the indicator lamp to be in a state of allowing getting-on.
In a second aspect, an embodiment of the present invention further provides a monitoring device, including:
the acquisition module is used for acquiring the current image frame of the boarding point; the determining module is used for determining time information related to the getting-on action in the image frame;
and the judging module is used for judging whether the boarding is illegal according to the time information related to the boarding action, and outputting an alarm instruction if the boarding is illegal.
Further, the time information related to the getting-on action comprises:
a starting time point of getting on and a finishing time point of getting on;
the judging module is also used for calculating the time consumed by getting on the bus by subtracting the starting time point from the finishing time point;
and if the time consumed by getting on the vehicle is greater than a preset second threshold value, determining that the action of getting on the vehicle is illegal.
Furthermore, the judging module is also used for determining the starting time point of getting on the bus in the current image frame;
calculating the time difference between the starting time point and the pre-stored boarding completion time point of the previous vehicle;
and if the time difference is smaller than a predetermined third threshold value, determining the action violation of the boarding.
Furthermore, the judgment module is also used for acquiring the real-time width and height values of the marking frame of the chair lifting rod;
calculating to obtain a real-time width-height ratio according to the real-time width and height values of the marking frame;
calculating the absolute value of the difference value of the real-time width-height ratio and the standard value of the preset width-height ratio;
if the absolute value of the difference reaches a predetermined first threshold;
the point in time at which the predetermined first threshold value is reached is recorded as the starting point in time for the boarding.
Further, the judging module is also used for determining the action of taking the hanging chair from the current image frame;
acquiring a vertical coordinate of a central point of a marker frame of the hanging chair rod; and the ordinate of the central point of the marking frame of the steel wire rope;
acquiring a vertical coordinate of a central point of a marker frame of the hanging chair rod; and the ordinate of the center point of the marking frame of the person;
calculating the difference value of the vertical coordinate of the center point of the marking frame of the hanging chair rod and the vertical coordinate of the center point of the marking frame of the person;
if the difference value reaches a predetermined fourth threshold value, recording a time point of reaching the predetermined fourth threshold value as a completion time point of the getting-on.
Further, the device also comprises a prompting module used for prompting the user to sit down a trolley.
Further, the system also comprises an indication control module, and if the current image frame of the boarding point is determined to have a chair lift and no person, and the next image frames have no chair lift, the system is determined to be sent out in an empty vehicle; sending an electric signal to the getting-on indicator lamp so as to enable the indicator lamp to be in a state of allowing getting-on.
In a third aspect, an embodiment of the present invention further provides a monitoring device, including: at least one processor and at least one memory;
the memory is to store one or more program instructions;
the processor is configured to execute one or more program instructions to perform any of the methods described above.
In a fourth aspect, the present invention also provides a computer-readable storage medium containing one or more program instructions for executing the method described in any one of the above.
The technical scheme provided by the embodiment of the invention at least has the following advantages: determining the getting-on action and related time information in the image frame; whether getting-on violations or not is determined according to the time information related to the action, the monitoring effect is improved, and the labor cost is reduced.
Drawings
Fig. 1 is a schematic view of a hanging chair of a monkey vehicle according to an embodiment of the present invention;
FIG. 2 is a flow chart of a monitoring method according to an embodiment of the present invention;
fig. 3 is a schematic distribution diagram of the mark frame at the boarding completion time according to the embodiment of the present invention;
FIG. 4 is a flowchart of a complete monitoring method provided by the embodiment of the present invention;
fig. 5 is a schematic structural diagram of a monitoring device according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a monitoring device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention is provided for illustrative purposes, and other advantages and effects of the present invention will become apparent to those skilled in the art from the present disclosure.
In the following description, for purposes of explanation and not limitation, specific details are set forth such as particular system structures, interfaces, techniques, etc. in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In the mining field, workers often use the monkey vehicle to realize when going up and down the well, so that the physical strength of the workers is saved, and the time consumed when going to work is shortened. A steel wire rope which moves back and forth is arranged in a mine, a monkey vehicle falls on the steel wire rope, and a worker rides on the monkey vehicle, which is shown in a structural schematic diagram of a hanging chair shown in an attached figure 1 and comprises a hook 101 used for being hung on the steel wire rope; a seat 102; a person sits on it; a chair stem 103.
In the prior art, a worker needs to take out the hanging chair from a warehouse and then walk to a fixed boarding point to carry out the action of hanging the monkey vehicle, wherein the action is to fix a hanging chair rod on a steel wire rope; then get on the vehicle and sit on the hanging chair. And the operation specification requires that the swing amplitude cannot be too large in the getting-on action process, so that danger is not brought. The time of getting on the bus also has requirements, and the bus can be got on only after waiting for a preset time in order to keep a certain distance after the previous bus is moved and avoid the phenomenon of getting on the bus after being bound; and the time of getting on the bus cannot be too long, because when getting on the bus, the people hold the hanging seat to hang the moving steel wire rope, if the time is too long, the people can fall off the getting on platform, and danger is caused. In the prior art, professional monitoring personnel are adopted to monitor that workers get on the vehicle at a vehicle getting-on point so as to ensure the safety of the workers, and if illegal actions exist, an alarm is given in time to stop the operation of the steel wire rope, so that greater danger is avoided. However, the monitoring personnel have the phenomena of long-time off duty and off duty, and the defects of non-objective and non-timely monitoring, poor effect and high cost exist.
Based on this, the present application proposes a monitoring method, referring to a monitoring method flow shown in fig. 2, the method includes:
step S201, acquiring a current image frame of a boarding point;
adopting a camera near a fixed boarding point to acquire image information of the boarding point; getting on the monkey car must be carried out at a specified getting on point; comprises a monkey hanging action and a monkey loading action; a worker holds the hanging chair, hangs the hanging chair on the steel wire and fixes the hanging chair; then go up to sit on the hanging seat, and get on the bus after sitting stably.
Step S202, determining time information related to getting-on actions in the image frames;
the method comprises the steps of recognizing getting-on actions from images by adopting a convolutional neural network, wherein the convolutional neural network comprises an input layer, a convolutional layer, a pooling layer, a full-link layer and an output layer. The input layer is used for inputting images, the convolutional layer is used for converting the images into feature maps, the pooling layer is used for pooling the feature maps so as to reduce the number of features in the feature maps, the fully-connected layer is used for mapping the feature maps processed by the convolutional layer and the pooling layer into one-dimensional feature vectors, and the output layer is used for outputting a first probability value according to the one-dimensional feature vectors output by the fully-connected layer. The output layer of the convolutional neural network may be implemented by a classifier, which may be a Softmax classifier, for implementing a binary classification task. With respect to the binary tasks, including, for example: whether the object in the picture is a monkey vehicle or not; whether the picture is a person or not; whether the picture has the steel wire rope or not. Can be implemented using a convolutional neural network. When the neural network is trained by adopting the samples, the more the number of the samples is, the higher the accuracy of the neural network identification is. And the action of hanging the hand-held hanging chair on the steel wire rope can be recognized. Firstly, the getting-on action is recognized from the image, and then the relevant time information of the getting-on action is determined.
And step S203, determining whether the boarding operation is illegal according to the time information of the boarding operation, and outputting an alarm instruction if the boarding operation is illegal.
It should be emphasized that the vehicle in the present application includes a monkey vehicle, and may also be another type of vehicle, and the present application is not particularly limited, and the method described above in the present application may be applied to monitoring in any scene where a target object needs to be monitored.
According to the method, whether the boarding violation is determined or not is intelligently completed through the images, the supervision effect is improved, the labor cost is reduced, and the monitoring intelligence degree in mining construction is improved.
In determining whether a boarding violation is occurring, two main aspects are that the time consuming boarding cannot be too long, since a person holding the chair on the boarding base may be dangerous if the movement of the trailer cannot be completed for a long time. On the other hand, after the last hanging chair is sent out, the current hanging chair cannot start immediately, but the current hanging chair is separated by a certain time to avoid bunching.
For the first aspect, the time information related to the action includes: a starting time point of getting on and a finishing time point of getting on; when whether the violation occurs is determined according to the time information, calculating the time consumed by getting on the bus by subtracting the starting time point from the finishing time point; and if the time consumed by getting on the vehicle is greater than a preset second threshold value, determining that the action of getting on the vehicle is illegal.
Wherein, for determining the starting time point of getting on the bus, the following steps are taken:
determining the action of hanging the chair rod from the image frame;
when a person hangs the hanging chair rod, the hanging chair has a specific action posture, and the two hands hold the hanging chair rod of the hanging chair to hang; recognizing the action of hanging the chair rod by adopting a convolutional neural network trained in advance;
acquiring real-time width and height values of a marking frame of the chair lifting rod;
calculating to obtain a real-time width-height ratio according to the real-time width and height values of the marking frame;
calculating the absolute value of the difference value of the real-time width-height ratio and the standard value of the preset width-height ratio;
the real-time width-height ratio is that the width-height ratio of the mark frame changes in real time because of shaking generated after a person sits on the hanging chair.
If the absolute value of the difference reaches a predetermined first threshold;
the point in time at which the predetermined first threshold value is reached is recorded as the starting point in time for the boarding.
In order to determine a specific boarding time point, the time point of the maximum inclination is used as the boarding time point, when the inclination is maximum, the difference value between the width-height ratio of the marking frame and the width-height ratio standard value at the preset balance position is also maximum, and when the calculated difference value reaches a preset threshold value, the time point is recorded as the boarding starting time point.
For how to determine the completion time point of getting on the bus, the method comprises:
determining a sitting sling chair action from the current image frame;
acquiring a vertical coordinate of a central point of a marker frame of the hanging chair rod; and the ordinate of the center point of the marking frame of the person;
calculating the difference value of the vertical coordinate of the center point of the marking frame of the hanging chair rod and the vertical coordinate of the center point of the marking frame of the person;
if the difference value reaches a predetermined fourth threshold value, recording a time point of reaching the predetermined fourth threshold value as a completion time point of the getting-on.
Referring to fig. 3, a schematic distribution diagram of the mark boxes at the boarding completion time is shown; wherein 31 is a human mark frame; 32 is a marking frame of the chair lifting rod; 33 is a marking frame of a steel wire rope; for simplicity of representation, figures are not drawn; when the final boarding is finished, a person sits on the hanging chair, the hanging chair is perpendicular to the steel wire rope, the person takes hold of the hanging chair rod with two hands, and two feet are placed on the pedal rods.
Sequentially identifying a plurality of image frames according to a target tracking algorithm, and shortening the character marking frame from high when the character is identified to start to get on the vehicle from the handheld crane rod; and determining the time point of the getting-on completion in the following manner:
acquiring a vertical coordinate of a central point of a marker frame of the hanging chair rod; and the ordinate of the center point of the marking frame of the person;
calculating the difference value of the vertical coordinate of the center point of the marking frame of the hanging chair rod and the vertical coordinate of the center point of the marking frame of the person;
if the difference value reaches a predetermined fourth threshold value, recording a time point of reaching the predetermined fourth threshold value as a completion time point of the getting-on.
The second threshold is half the length of the entire chair lift.
The following introduces that whether the vehicles adjacent to each other before and after the vehicle can not be too close to each other is judged to be illegal, and the boarding completion time of the previous vehicle needs to be stored in the method; calculating the getting-on completion time of the current vehicle; the following steps are taken:
determining a starting time point of getting on a vehicle in a current image frame;
calculating the time difference between the starting time point and the pre-stored boarding completion time point of the previous monkey vehicle;
and if the time difference is smaller than a predetermined third threshold value, determining the action violation of the boarding. Can send out a prompt to prompt the person getting on the bus not to get on the bus any more.
In one embodiment, the method further comprises: if the current image frame is determined to have the hanging seat column and no person, and the next image frames have no hanging seat column, determining that the vehicle is sent out in an empty state; sending an electric signal to the getting-on indicator lamp so as to enable the indicator lamp to be in a state of allowing getting-on.
The getting-on indicator light has two states of a red light and a green light; the state allowing getting on is a green light state; the state that the vehicle is not allowed to get on is a red light state; when the indicator light receives the control electric signal, the switching of the traffic light state can be realized.
Under normal conditions, after a previous person takes a car, the indicator light is in a red light state and is changed into a green light after a period of time; then the next person gets on the vehicle again; so if it is determined that the previous vehicle was an empty vehicle, the person did not successfully sit on the vehicle; the indicator light shortens the waiting time; even without waiting; the indicator light can be controlled to be in a green light state, and the fact that a person who does not sit on the seat hangs another hanging seat to sit on the next vehicle is indicated. Thereby avoiding the condition that the front and back intervals are too large and the stress on the steel wire rope is unbalanced because the vehicle is missed.
An overall monkey vehicle monitoring method is introduced below, and a complete monkey vehicle monitoring method shown in fig. 4 is shown in a schematic flow chart; the method comprises the steps of monitoring a riding point area of the monkey vehicle in real time through a camera, analyzing the monitored video in real time through a trained model in a system, and collecting one frame of image every N frames, wherein N is a positive integer larger than one. Identifying each picture shot by each camera, wherein the identification steps are as follows:
step S401, whether a worker hangs a monkey vehicle or not is identified by using a target detection algorithm at the beginning, if yes, step S402 is executed, and if not, an indicator light is changed into green;
step S402, recognizing the chair lifting rod in the picture by using a target detection algorithm; judging whether the chair lifting rod is inclined or not; judging whether the hanging chair rod is inclined or not according to the length-width ratio of the marking frame of the hanging chair rod, if so, executing the step S403, otherwise, turning the indicating lamp to green;
step S403, recording time t 1;
step S404, judging that the difference value of the vertical coordinates of the center points of the marking frame of the chair lifting rod and the marking frame of the person is equal to a preset fourth threshold value or falls within the range of the threshold value;
wherein the fourth threshold is half the length of the chair lift; it is noted that, in order to improve the accuracy, the following steps may be performed before the above steps: the vertical coordinate of the center point of the marking frame of the person is analyzed and judged through a plurality of image frames, and the process of changing from high to low is carried out, and the process can indicate that the person is in the process of sitting. A threshold range may be set, for example, a margin of a difference may be left or right floating around a predetermined fourth threshold to form a threshold range, and if the difference between the ordinate of the center point of the marking frame of the wheelchair lever and the ordinate of the center point of the marking frame of the person falls within the threshold range, it is determined that the boarding operation is completed.
If yes, executing step S405, otherwise, executing step S406;
step S405, recording time t 2;
step S407, calculating time t 3-t 2-t 1;
step S408, judging whether T3 is greater than a system alarm threshold T1;
if yes, returning to the step S401; if not, executing step S409;
step S409, identifying whether the action of hanging the monkey vehicle exists next time;
if yes, go to step S410; if not, returning to the step S405;
step S410, the system transmits alarm information to an audible and visual alarm, the audible and visual alarm sends out an alarm signal, and an LED screen prompts that the monkey vehicle is forbidden to sit;
step S406, recording time t 4;
step S411, judging that the difference value of the vertical coordinates of the center points of the marking frame of the chair lifting rod and the marking frame of the person in the next frame is equal to a preset fourth threshold value;
if yes, go to step S405; if not, go to step S412;
step S412, recording the time t 5;
step S414, calculating time t 6-t 5-t 4;
step S414, judging whether T6 is larger than a system alarm threshold T2; if yes, the method indicates that the monkey vehicle is not seated in the specified time, step S415 is executed, and if no, the method returns to step S411;
step S415, recording time t 7;
step S416, alarming and prompting;
the system transmits alarm information to the audible and visual alarm, the audible and visual alarm sends an alarm signal, and the LED screen prompts a monkey vehicle to sit down;
step S417, recording time t 8;
step S418, calculating time t 9-t 8-t 7;
step S419, judging whether T9 is greater than a system alarm threshold T3; if the monkey vehicle is not taken by the person, the monkey vehicle is judged to leave for a certain time, whether action of hanging the monkey vehicle exists or not can be continuously judged, and the step S401 is returned;
if not, go to step S420;
step S420, judging whether the next frame has a monkey vehicle hanging action; if yes, go to step S421; if not, returning to the step S417;
step S421, alarming and prompting; the audible and visual alarm sends out an alarm signal, and the LED screen prompts that the monkey vehicle is forbidden to sit.
In a second aspect, the present application further provides a monitoring device, referring to a schematic structural diagram of the monitoring device shown in fig. 5, the monitoring device includes:
an obtaining module 51, configured to obtain a current image frame of a boarding point;
a determining module 52, configured to determine time information related to the getting-on action in the image frame;
and the judging module 53 is configured to judge whether the boarding is violated according to the time information of the boarding action, and if the boarding is violated, output an alarm instruction.
Further, the determining module 53 is further configured to calculate a time consumed for getting on the vehicle by subtracting the starting time point from the finishing time point; and if the time consumed by getting on the vehicle is greater than a preset second threshold value, determining that the action of getting on the vehicle is illegal.
Further, the judging module 53 is further configured to determine a starting time point of getting on the vehicle in the current image frame;
calculating the time difference between the starting time point and the pre-stored boarding completion time point of the previous vehicle;
and if the time difference is smaller than a predetermined third threshold value, determining the action violation of the boarding.
Further, the determining module 53 is further configured to obtain a real-time width and height value of the marking frame of the chair lifting rod;
calculating to obtain a real-time width-height ratio according to the real-time width and height values of the marking frame;
calculating the absolute value of the difference value of the real-time width-height ratio and the standard value of the preset width-height ratio;
if the absolute value of the difference reaches a predetermined first threshold;
the point in time at which the predetermined first threshold value is reached is recorded as the starting point in time for the boarding.
Further, the judging module 53 is also used for,
determining a sitting sling chair action from the current image frame;
acquiring a vertical coordinate of a central point of a marker frame of the hanging chair rod; and the ordinate of the center point of the marking frame of the person;
calculating the difference value of the vertical coordinate of the center point of the marking frame of the hanging chair rod and the vertical coordinate of the center point of the marking frame of the person;
if the difference value reaches a predetermined fourth threshold value, recording a time point of reaching the predetermined fourth threshold value as a completion time point of the getting-on.
Further, the device also comprises a prompting module used for prompting the user to sit down a trolley.
Further, the system comprises an indication control module, a display module and a display module, wherein the indication control module is used for determining that the vehicle is sent out in an empty state if the current image frame of the boarding point is determined to have a seat rail and no person, and the next plurality of image frames have no seat rail; sending an electric signal to the getting-on indicator lamp so as to enable the indicator lamp to be in a state of allowing getting-on.
According to a third aspect of an embodiment of the present invention, there is provided a monitoring device for a train of mine cars, as illustrated in figure 6, comprising: at least one processor 61 and at least one memory 62; the memory 61 is used for storing one or more program instructions;
the processor 62 is configured to execute one or more program instructions to perform any of the methods described above.
According to a fourth aspect of embodiments of the present invention, a computer-readable storage medium having one or more program instructions embodied therein for being executed by a method according to any one of the preceding claims.
In an embodiment of the invention, the processor may be an integrated circuit chip having signal processing capability. The Processor may be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The processor reads the information in the storage medium and completes the steps of the method in combination with the hardware.
The storage medium may be a memory, for example, which may be volatile memory or nonvolatile memory, or which may include both volatile and nonvolatile memory.
The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory.
The volatile Memory may be a Random Access Memory (RAM) which serves as an external cache. By way of example, and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), SLDRAM (SLDRAM), and Direct Rambus RAM (DRRAM).
The storage media described in connection with the embodiments of the invention are intended to comprise, without being limited to, these and any other suitable types of memory.
Those skilled in the art will appreciate that the functionality described in the present invention may be implemented in a combination of hardware and software in one or more of the examples described above. When software is applied, the corresponding functionality may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
The above-mentioned embodiments, objects, technical solutions and advantages of the present invention are further described in detail, it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present invention should be included in the scope of the present invention.
Claims (9)
1. A method of monitoring, comprising:
acquiring a current image frame of a boarding point; determining time information related to boarding actions in the image frames;
judging whether the boarding is illegal according to the time information related to the boarding action, and outputting an alarm instruction if the boarding is illegal;
the time information related to the getting-on action comprises a starting time point of getting-on;
determining a starting time point of the getting-on, comprising:
determining the action of hanging the chair rod from the current image frame;
acquiring real-time width and height values of a marking frame of the chair lifting rod;
calculating to obtain a real-time width-height ratio according to the real-time width and height values of the marking frame;
calculating the absolute value of the difference value of the real-time width-height ratio and the standard value of the preset width-height ratio;
if the absolute value of the difference value reaches a predetermined first threshold value, the time point of reaching the predetermined first threshold value is recorded as the starting time point of getting on the vehicle.
2. The method of claim 1, wherein the boarding action-related time information further comprises:
a completion time point of boarding;
determining whether the violation occurs according to the time information related to the boarding action, wherein the determining comprises the following steps:
calculating the time consumed by getting on the bus by subtracting the starting time point from the finishing time point;
and if the time consumed by getting on the vehicle is greater than a preset second threshold value, determining that the action of getting on the vehicle is illegal.
3. The method of claim 1,
judging whether the violation occurs according to the time information related to the boarding action, wherein the judging step comprises the following steps:
determining a starting time point of getting on a vehicle in a current image frame;
calculating the time difference between the starting time point and the pre-stored boarding completion time point of the previous vehicle;
and if the time difference is smaller than a predetermined third threshold value, determining the action violation of the boarding.
4. The method of claim 2, wherein determining the completion time point for pick-up comprises:
determining a sitting sling chair action from the current image frame;
acquiring a vertical coordinate of a central point of a marker frame of the hanging chair rod; and the ordinate of the center point of the marking frame of the person;
calculating the difference value of the vertical coordinate of the center point of the marking frame of the hanging chair rod and the vertical coordinate of the center point of the marking frame of the person;
if the difference value reaches a predetermined fourth threshold value, recording a time point of reaching the predetermined fourth threshold value as a completion time point of the getting-on.
5. The method of claim 1, wherein determining that the getting-on action is a violation based on the time information related to the action comprises: prompting to sit down one vehicle.
6. The method of claim 2, further comprising: if the current image frame of the boarding point is determined to have a chair lift and no person, and the next plurality of image frames have no chair lift, determining that the vehicle is sent out in an empty state; sending an electric signal to the getting-on indicator lamp so as to enable the indicator lamp to be in a state of allowing getting-on.
7. A monitoring device, comprising:
the acquisition module is used for acquiring the current image frame of the boarding point;
the determining module is used for determining time information related to the getting-on action in the image frame;
the time information related to the getting-on action comprises a starting time point of getting-on;
determining a starting time point of the getting-on, comprising:
determining the action of hanging the chair rod from the current image frame;
acquiring real-time width and height values of a marking frame of the chair lifting rod;
calculating to obtain a real-time width-height ratio according to the real-time width and height values of the marking frame;
calculating the absolute value of the difference value of the real-time width-height ratio and the standard value of the preset width-height ratio;
if the absolute value of the difference value reaches a preset first threshold value, recording the time point reaching the preset first threshold value as the starting time point of getting on the bus;
and the judging module is used for judging whether the boarding is illegal according to the time information related to the boarding action.
8. A monitoring device, comprising: at least one processor and at least one memory;
the memory is to store one or more program instructions;
the processor, configured to execute one or more program instructions to perform the method of any of claims 1-6.
9. A computer-readable storage medium having one or more program instructions embodied therein for being executed to perform the method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910691383.4A CN110428589B (en) | 2019-07-29 | 2019-07-29 | Monitoring method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910691383.4A CN110428589B (en) | 2019-07-29 | 2019-07-29 | Monitoring method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110428589A CN110428589A (en) | 2019-11-08 |
| CN110428589B true CN110428589B (en) | 2020-08-21 |
Family
ID=68411279
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910691383.4A Active CN110428589B (en) | 2019-07-29 | 2019-07-29 | Monitoring method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110428589B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112101351B (en) * | 2020-09-07 | 2024-04-19 | 凌云光技术股份有限公司 | Text line rotation correction method and device based on projection |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012007618A8 (en) * | 2010-07-13 | 2012-06-28 | Scio Soft, S.L. | Passive safety system and personal equipment on vessels for man-overboard situations |
| CN203032675U (en) * | 2013-01-21 | 2013-07-03 | 霍州煤电集团吕梁山煤电有限公司方山木瓜煤矿 | Mining monkey vehicle detection and control system |
| CN203976283U (en) * | 2014-07-11 | 2014-12-03 | 常州科研试制中心有限公司 | The comprehensive electric-control system of mining rope traction transportation device |
| CN205247172U (en) * | 2015-12-19 | 2016-05-18 | 大同卓立机化有限责任公司 | Full automatic control device of mining monkey car |
| CN105652290A (en) * | 2016-03-27 | 2016-06-08 | 厦门精图信息技术有限公司 | Riding information shared system based on Beidou navigation and communication network |
| CN107274702A (en) * | 2016-04-06 | 2017-10-20 | 中兴通讯股份有限公司 | A kind of intelligent traffic management system and its method of work |
| CN107481487A (en) * | 2017-08-28 | 2017-12-15 | 郑海英 | A kind of method of real-time reminding waiting time |
| CN206901607U (en) * | 2017-05-23 | 2018-01-19 | 四川达竹煤电(集团)有限责任公司渡市选煤发电厂 | Transporting coal cableway set a distance hair bucket control device |
| WO2018061044A2 (en) * | 2016-09-30 | 2018-04-05 | Maritano Meiranesio Luca | System of orientable cabins for passengers |
| EP2949615B1 (en) * | 2014-05-27 | 2018-07-11 | Uniforest, D.o.o. | Cable winch with automatically controlled regulation of speed of unwinding of a haulage cable |
| CN207758776U (en) * | 2017-12-12 | 2018-08-24 | 临沂矿业集团有限责任公司 | A kind of Aerial Conveyance for Human in Coal Mine multiplies human world distance control apparatus |
| CN109204587A (en) * | 2018-10-27 | 2019-01-15 | 华强方特（芜湖）文化科技有限公司 | A kind of amusement park Sightseeing Bus |
| CN208673125U (en) * | 2018-09-07 | 2019-03-29 | 成都赛零信息技术开发有限公司 | Cableway-type monitoring system |
| CN109558776A (en) * | 2017-09-27 | 2019-04-02 | 重庆凯泽科技股份有限公司 | The method and device detected in violation of rules and regulations by bus for station |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108024155A (en) * | 2017-12-15 | 2018-05-11 | 北京小度互娱科技有限公司 | The video broadcasting method and device of adaptive video the ratio of width to height |
| CN109686048B (en) * | 2019-01-02 | 2022-03-18 | 平安科技（深圳）有限公司 | Early warning method and device for line crossing of train platform, computer equipment and storage medium |
| CN110040470B (en) * | 2019-05-21 | 2021-04-13 | 精英数智科技股份有限公司 | Monitoring method for identifying belt deviation through artificial intelligence video |
-
2019
- 2019-07-29 CN CN201910691383.4A patent/CN110428589B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012007618A8 (en) * | 2010-07-13 | 2012-06-28 | Scio Soft, S.L. | Passive safety system and personal equipment on vessels for man-overboard situations |
| CN203032675U (en) * | 2013-01-21 | 2013-07-03 | 霍州煤电集团吕梁山煤电有限公司方山木瓜煤矿 | Mining monkey vehicle detection and control system |
| EP2949615B1 (en) * | 2014-05-27 | 2018-07-11 | Uniforest, D.o.o. | Cable winch with automatically controlled regulation of speed of unwinding of a haulage cable |
| CN203976283U (en) * | 2014-07-11 | 2014-12-03 | 常州科研试制中心有限公司 | The comprehensive electric-control system of mining rope traction transportation device |
| CN205247172U (en) * | 2015-12-19 | 2016-05-18 | 大同卓立机化有限责任公司 | Full automatic control device of mining monkey car |
| CN105652290A (en) * | 2016-03-27 | 2016-06-08 | 厦门精图信息技术有限公司 | Riding information shared system based on Beidou navigation and communication network |
| CN107274702A (en) * | 2016-04-06 | 2017-10-20 | 中兴通讯股份有限公司 | A kind of intelligent traffic management system and its method of work |
| WO2018061044A2 (en) * | 2016-09-30 | 2018-04-05 | Maritano Meiranesio Luca | System of orientable cabins for passengers |
| CN206901607U (en) * | 2017-05-23 | 2018-01-19 | 四川达竹煤电(集团)有限责任公司渡市选煤发电厂 | Transporting coal cableway set a distance hair bucket control device |
| CN107481487A (en) * | 2017-08-28 | 2017-12-15 | 郑海英 | A kind of method of real-time reminding waiting time |
| CN109558776A (en) * | 2017-09-27 | 2019-04-02 | 重庆凯泽科技股份有限公司 | The method and device detected in violation of rules and regulations by bus for station |
| CN207758776U (en) * | 2017-12-12 | 2018-08-24 | 临沂矿业集团有限责任公司 | A kind of Aerial Conveyance for Human in Coal Mine multiplies human world distance control apparatus |
| CN208673125U (en) * | 2018-09-07 | 2019-03-29 | 成都赛零信息技术开发有限公司 | Cableway-type monitoring system |
| CN109204587A (en) * | 2018-10-27 | 2019-01-15 | 华强方特（芜湖）文化科技有限公司 | A kind of amusement park Sightseeing Bus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110428589A (en) | 2019-11-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112528721B (en) | Bridge crane integrated card safety positioning method and system | |
| CN110733983B (en) | Tower crane safety control system and control method thereof | |
| JP7289581B2 (en) | Crane information processing device | |
| CN106504580A (en) | A kind of method for detecting parking stalls and device | |
| JP7386681B2 (en) | Scrap grade determination system, scrap grade determination method, estimation device, learning device, learned model generation method, and program | |
| CN103858156A (en) | Vehicle vicinity monitoring device | |
| CN110428589B (en) | Monitoring method, device, equipment and storage medium | |
| CN107368786B (en) | Machine vision-based passenger passing handrail detection method | |
| CN110532902B (en) | Molten iron slagging-off detection method based on lightweight convolutional neural network | |
| CN112010187B (en) | Monitoring method and device based on tower crane | |
| CN117474321B (en) | BIM model-based construction site risk intelligent identification method and system | |
| JP2020516233A (en) | Interpretation system for cattle riding behavior | |
| CN107292222B (en) | Vehicle violation detection method and device | |
| CN113361953A (en) | Customs port cargo pipe on-site robot inspection method and system | |
| CN113401745B (en) | Elevator control method based on elevator crowding degree | |
| JP6435571B2 (en) | Container weight measuring system and container weight measuring method | |
| CN106096554A (en) | Decision method and system are blocked in a kind of parking stall | |
| JP2017019351A (en) | Fallen person detection device, fallen person detection system, fallen person detection method, and fallen person detection program | |
| CN112232271B (en) | Laser-based people stream detection method and device | |
| CN114560396A (en) | Sensing Internet of things equipment and method for intelligent tower crane picking and placing motion detection | |
| JP2022066951A (en) | Program, information processing method and information processing system | |
| CN111709360A (en) | Safety rope wearing identification method and system | |
| CN115215177B (en) | Intelligent elevator lifting identification system and method | |
| CN112906566B (en) | Depth of field judging method for offending and staying of descending person in operation scene of suspension arm vehicle | |
| CN103442218B (en) | A kind of multi-mode Activity recognition and the preprocessing method of video signal of description |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |