CN110428589A - Monitoring method, device, equipment and storage medium - Google Patents

Monitoring method, device, equipment and storage medium Download PDF

Info

Publication number
CN110428589A
CN110428589A CN201910691383.4A CN201910691383A CN110428589A CN 110428589 A CN110428589 A CN 110428589A CN 201910691383 A CN201910691383 A CN 201910691383A CN 110428589 A CN110428589 A CN 110428589A
Authority
CN
China
Prior art keywords
bus
chair lift
violation
point
regulations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910691383.4A
Other languages
Chinese (zh)
Other versions
CN110428589B (en
Inventor
侯宇辉
蒙泽敏
刘广金
赵雅娟
翟展民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jingying Digital Technology Co Ltd
Original Assignee
Jingying Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jingying Digital Technology Co Ltd filed Critical Jingying Digital Technology Co Ltd
Priority to CN201910691383.4A priority Critical patent/CN110428589B/en
Publication of CN110428589A publication Critical patent/CN110428589A/en
Application granted granted Critical
Publication of CN110428589B publication Critical patent/CN110428589B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/22Status alarms responsive to presence or absence of persons

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Emergency Alarm Devices (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)

Abstract

The present embodiments relate to monitoring technical fields, and in particular to a kind of monitoring method, device, equipment and storage medium.A kind of monitoring method, comprising: obtain the current picture frame got on the bus a little;It determines to get on the bus in described image frame and acts relevant temporal information;Whether in violation of rules and regulations to be got on the bus according to the relevant temporal information judgement of the movement.The above method passes through the actuation time information for determining and having movement of getting on the bus in described image frame;Determine whether in violation of rules and regulations to get on the bus according to the actuation time information.It is monitored with machine instead of manpower, improves the effect of monitoring.

Description

Monitoring method, device, equipment and storage medium
Technical field
The embodiment of the present invention relates to intelligent monitoring technology field, and in particular to a kind of monitoring method, device, equipment and storage are situated between Matter.
Background technique
Monkey car is the means of transport of well operations personnel above and below coal mine, and monkey car is made of components such as chair lift, cableway, motors, is made Industry personnel hang over monkey car chair lift on monkey car cableway after coal mine well port, shaft bottom load zones monkey car hitch point win monkey car chair lift, Rope-grippers in chair lift holds cableway tightly, and personnel ride in chair lift, and motor driven cableway drives monkey car chair lift reciprocating operation, plays The effect of reciprocal conveying people.At present coal mine monkey car load zones specially set a people be responsible for supervising up and down well operations personnel whether by Provide that spacing takes monkey car, but supervisor leaves post phenomenon there are abandon their respective regions for long periods of time, that supervision exists is not objective, not in time, effect Poor, the at high cost disadvantage of fruit.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of monitoring method, device, equipment and storage medium, existing to solve There is technology using the problem for supervising effect difference caused by artificial monitoring.
To achieve the above object, the embodiment of the present invention mainly provides the following technical solutions:
In a first aspect, the embodiment of the invention provides a kind of monitoring methods, comprising: obtain the current image got on the bus a little Frame;
It determines to get on the bus in described image frame and acts relevant temporal information;
It acts the judgement of relevant temporal information according to described get on the bus and whether in violation of rules and regulations to get on the bus, export alarm command if in violation of rules and regulations.
Further, the relevant temporal information of the movement includes:
The start time point got on the bus and the deadline point got on the bus;
According to it is described get on the bus act relevant temporal information determine whether in violation of rules and regulations, comprising:
It calculates the deadline point and subtracts the start time point and obtain the consumed time of getting on the bus;
If the consumed time of getting on the bus is greater than scheduled threshold value, it is determined that the movement got on the bus is in violation of rules and regulations.
Further, according to it is described get on the bus act relevant temporal information judge whether in violation of rules and regulations, comprising:
Determine the start time point got on the bus in current image frame;
Calculate the time difference of the deadline point of getting on the bus of the start time point and a pre-stored upper vehicle;
If the time difference is less than predetermined threshold, it is determined that the movement got on the bus is in violation of rules and regulations.
Further, it is determined that the start time point got on the bus, comprising:
The movement for hanging chair lift bar is determined from the current picture frame;
Obtain the real-time width and height value of the indicia framing of the chair lift bar;
Real-time aspect ratio value is calculated according to the real-time width and height value of the indicia framing;
Calculate the absolute value of the difference of the standard value of the real-time aspect ratio value and scheduled aspect ratio value;
If the absolute value of the difference has reached scheduled threshold value;
Then record reaches the time point of the predetermined threshold for the start time point got on the bus.
Further, it is determined that the deadline point got on the bus, comprising:
The movement for taking chair lift bar is determined from the current picture frame;
Obtain the ordinate of the central point of chair lift pole brand frame;And the ordinate of the central point of the indicia framing of people;
Calculate the ordinate of the central point of the ordinate of the central point of the chair lift pole brand frame and the indicia framing of people Difference;
If the difference has reached scheduled second threshold, the time point that record reaches the predetermined second threshold is The deadline point got on the bus.
It further, is packet after violation according to the movement for acting and getting on the bus described in relevant temporal information determination of getting on the bus It includes: prompting a coastiong of sitting down.
Further, if it is determined that have chair lift column and nobody in the current picture frame got on the bus a little, and next Multiple images frame in there is no chair lift column, it is determined that be empty wagons issue;To getting on the bus, indicator light issues electric signal, so that the instruction Lamp is in the state for allowing to get on the bus.
Second aspect, the embodiment of the present invention also provide a kind of monitoring device, comprising:
Module is obtained, for obtaining the current picture frame got on the bus a little;Determining module, for determining in described image frame Vehicle acts relevant temporal information;
In violation of rules and regulations whether judgment module act the judgement of relevant temporal information and get on the bus, if in violation of rules and regulations for getting on the bus according to Export alarm command.
Further, described get on the bus acts relevant temporal information and includes:
The start time point got on the bus and the deadline point got on the bus;
The judgment module is also used to, and is calculated the deadline point and is subtracted the start time point and got on the bus and is consumed Time;
If the consumed time of getting on the bus is greater than scheduled threshold value, it is determined that the movement got on the bus is in violation of rules and regulations.
Further, judgment module is also used to, and determines the start time point got on the bus in current image frame;
Calculate the time difference of the deadline point of getting on the bus of the start time point and a pre-stored upper vehicle;
If the time difference is less than predetermined threshold, it is determined that the movement got on the bus is in violation of rules and regulations.
Further, judgment module is also used to, and obtains the real-time width and height value of the indicia framing of chair lift bar;
Real-time aspect ratio value is calculated according to the real-time width and height value of the indicia framing;
Calculate the absolute value of the difference of the standard value of the real-time aspect ratio value and scheduled aspect ratio value;
If the absolute value of the difference has reached scheduled threshold value;
Then record reaches the time point of the predetermined threshold for the start time point got on the bus.
Further, judgment module is also used to, and the movement for taking chair lift is determined from the current picture frame;
Obtain the ordinate of the central point of chair lift pole brand frame;And the ordinate of the central point of the indicia framing of wirerope;
Obtain the ordinate of the central point of chair lift pole brand frame;And the ordinate of the central point of the indicia framing of people;
Calculate the ordinate of the central point of the ordinate of the central point of the chair lift pole brand frame and the indicia framing of people Difference;
If the difference has reached scheduled second threshold, the time point that record reaches the predetermined second threshold is The deadline point got on the bus.
It further, further include cue module, for prompting a coastiong of sitting down.
It further, further include instruction control module, if it is determined that have chair lift column simultaneously in the current picture frame got on the bus a little And nobody, and there is no chair lift column in next multiple images frame, it is determined that it is that empty wagons issues;To getting on the bus, indicator light is issued Electric signal, so that the indicator light is in the state for allowing to get on the bus.
The third aspect, the embodiment of the present invention also provide a kind of monitoring device, comprising: at least one processor and at least one Memory;
The memory is for storing one or more program instructions;
The processor, for running one or more program instructions, to execute method described in any of the above embodiments.
Fourth aspect, the embodiment of the present invention also provide a kind of computer readable storage medium, the computer storage medium In comprising one or more program instructions, one or more of program instructions are for being performed side described in any of the above embodiments Method.
Technical solution provided in an embodiment of the present invention at least has the advantages that the movement got on the bus in determining described image frame And relevant temporal information;It is determined and whether in violation of rules and regulations to be got on the bus according to the relevant temporal information of movement, improve the effect of monitoring, dropped Low human cost.
Detailed description of the invention
Fig. 1 is a kind of chair lift schematic diagram of monkey car provided in an embodiment of the present invention;
Fig. 2 is monitoring method flow chart provided in an embodiment of the present invention;
Fig. 3 is that provided in an embodiment of the present invention get on the bus completes the distribution schematic diagram of the indicia framing at moment;
Fig. 4 is complete monitoring method flow chart provided in an embodiment of the present invention;
Fig. 5 is monitoring device structural schematic diagram provided in an embodiment of the present invention;
Fig. 6 is monitoring device structural schematic diagram provided in an embodiment of the present invention.
Specific embodiment
Embodiments of the present invention are illustrated by particular specific embodiment below, those skilled in the art can be by this explanation Content disclosed by book is understood other advantages and efficacy of the present invention easily.
In being described below, for illustration and not for limitation, propose such as specific system structure, interface, technology it The detail of class, to understand thoroughly the present invention.However, it will be clear to one skilled in the art that there is no these specific The present invention also may be implemented in the other embodiments of details.In other situations, omit to well-known system, circuit and The detailed description of method, in case unnecessary details interferes description of the invention.
It in mining industry field, is realized when going into the well on worker commonly using monkey car, saves the physical strength of worker, shortened up and down Consumed time when class.The wirerope of back and forth movement is provided in mine, monkey car is fallen on wirerope, and worker rides over monkey Che Shang, the structural schematic diagram of chair lift referring to figure 1, including hook 101, for hanging on a steel cord;Seat 102;People It sits on;Chair lift bar 103.
In the prior art, worker needs first to take out chair lift from warehouse, then go to it is fixed get on the bus a little, will be into Row hangs the movement of monkey car, which is that chair lift bar is fixed to above wirerope;Then it gets on the bus, is sitting in chair lift.And it operates Code requirement, in the action process got on the bus, amplitude of fluctuation can not be excessive, no to bring danger.The time got on the bus also requires, After a upper vehicle is walked, in order to maintain a certain distance, avoids flocking together and get on the bus, just it needs to wait the predetermined time that can get on the bus later;And And the time got on the bus can not be too long, and because being suspended to the wirerope of movement in human hand held chair lift when getting on the bus, if overlong time, Boarding platform can be fallen, cause danger.It in the prior art, is all that worker is monitored using the monitoring personnel of profession in a progress of getting on the bus It gets on the bus, to guarantee the safety of worker, if there is the movement of violation, then and alarm, stopping wirerope operation avoid generating bigger Danger.But supervisor is there are abandon their respective regions for long periods of time, phenomenon of leaving post, that supervision exists is not objective, not in time, effect is poor, cost High disadvantage.
Based on this, present applicant proposes a kind of methods of monitoring should referring to a kind of attached monitoring method process shown in Fig. 2 Method includes:
Step S201 obtains the current picture frame got on the bus a little;
It is got on the bus near a little using video camera in fixed, acquires the image information got on the bus a little;Upper monkey car must be defined It gets on the bus and to carry out;Including hanging monkey car movement and the movement of upper monkey car;Worker holds chair lift, and chair lift is hung on steel wire, after fixed;Again It is sitting in chair lift up, after occupying stably, completion of getting on the bus.
Step S202 determines that getting on the bus in described image frame acts relevant temporal information;
Wherein, the movement for identifying and getting on the bus from image is realized using convolutional neural networks, convolutional neural networks include Input layer, convolutional layer, pond layer, full articulamentum and output layer.Wherein, input layer is used for input picture, and convolutional layer will be for that will scheme As being converted into characteristic pattern, pond layer is used to carry out pond processing to characteristic pattern, complete to connect to reduce the feature quantity in characteristic pattern Layer for will by convolutional layer and pond layer, treated that characteristic pattern is mapped as one-dimensional characteristic vector, output layer connects entirely for basis The one-dimensional characteristic vector of layer output is connect, the first probability value is exported.The output layer of convolutional neural networks can be realized by classifier, be divided Class device can be Softmax classifier, for realizing two classification tasks.About two classification tasks, including such as: the object in picture Body is monkey car;Picture whether someone;Whether there is wirerope in picture.It may be by convolutional neural networks to be realized. When being trained using sample to neural network, the quantity of sample is more, and the accuracy rate of neural network recognization is higher. And it may recognize that human hand held chair lift hangs over the movement of wirerope.Firstly, first identifying the movement got on the bus from image, so It determines to get on the bus again afterwards the relevant temporal information of movement.
Step S203, according to the temporal information of the movement of getting on the bus determine get on the bus whether in violation of rules and regulations, if in violation of rules and regulations if export report Alert instruction.
It is emphasized that the vehicle in the application includes monkey car, it is also possible to other kinds of vehicle, the application is not done Specific limitation, as long as needing with the method that in the scene being monitored to target object, the application can be applied above-mentioned To be monitored.
The above method, be by image, intelligently complete get on the bus whether the judgement of violation, improve the effect of supervision, Human cost is reduced, the intelligence degree of the monitoring in mining construction is improved.
It gets on the bus whether in violation in judgement, mainly has two aspects, be on the one hand that the elapsed time got on the bus can not be too long, because It is human hand held chair lift station on boarding platform if the movement of trailer can not be completed for a long time, danger may be generated.It is another Aspect is after a upper chair lift issues, and current chair lift can not set out right away, but at regular intervals, in order to avoid It flocks together.
It is divided to two kinds of embodiments to introduce respectively below, in a first aspect, the relevant temporal information of the movement includes: The start time point of vehicle and the deadline got on the bus point;When determining whether violation according to the temporal information, the completion is calculated Time point subtracts the start time point and obtains the consumed time of getting on the bus;If the consumed time of getting on the bus is greater than predetermined Threshold value, it is determined that the movement got on the bus is in violation of rules and regulations.
Wherein, for the start time point got on the bus described in determination, following step is taken:
The movement for hanging chair lift bar is determined from described image frame;
Wherein, when people hangs chair lift bar, there is specific movement posture, that hangs on two hand steered chair lift bars of chair lift is dynamic Make;The movement for hanging chair lift bar is identified using preparatory trained convolutional neural networks;
Obtain the real-time width and height value of the indicia framing of the chair lift bar;
Real-time aspect ratio value is calculated according to the real-time width and height value of the indicia framing;
Calculate the absolute value of the difference of the standard value of the real-time aspect ratio value and scheduled aspect ratio value;
Above-mentioned real-time aspect ratio value is shaking to be generated, so the ratio of width to height of indicia framing after taking chair lift due to people Value also can real-time change.
If the absolute value of the difference has reached scheduled threshold value;
Then record reaches the time point of the predetermined threshold for the start time point got on the bus.
People get on the bus after moment, be originally equilbrium position chair lift will necessarily run-off the straight, in order to determine one tool At the time point of body got on the bus, the time point that the application uses maximum inclination is used as the time point got on the bus, and when gradient maximum, marks The difference of the ratio of width to height and aspect ratio standard value when scheduled equilbrium position for remembering frame also reaches maximum, when calculated difference reaches When to scheduled threshold value, then the time point is recorded, the time point as beginning of getting on the bus.
For the deadline point for how determining to get on the bus, method includes:
The movement for taking chair lift is determined from the current picture frame;
Obtain the ordinate of the central point of chair lift pole brand frame;And the ordinate of the central point of the indicia framing of people;
Calculate the ordinate of the central point of the ordinate of the central point of the chair lift pole brand frame and the indicia framing of people Difference;
If the difference has reached scheduled second threshold, the time point that record reaches the predetermined second threshold is The deadline point got on the bus.
The distribution schematic diagram of the indicia framing at moment is completed referring to attached shown in Fig. 3 get on the bus;Wherein, 31 be people indicia framing; 32 be the indicia framing of chair lift bar;33 be the indicia framing of wirerope;It is indicated to simplify, personage is depicted without;When finally having got on the bus Cheng Shi, people are sitting in chair lift, and chair lift holds chair lift bar perpendicular to wirerope, passenger both hands, and both feet are placed on foot-driven lever.
According to target tracking algorithm, successively identify multiple images frame, when recognize personage get on the bus from hand-held crane bar it is dynamic Work starts, and personage's indicia framing becomes short by height;And the time point for end of getting on the bus is determined in the following ways:
Obtain the ordinate of the central point of chair lift pole brand frame;And the ordinate of the central point of the indicia framing of people;
Calculate the ordinate of the central point of the ordinate of the central point of the chair lift pole brand frame and the indicia framing of people Difference;
If the difference has reached scheduled second threshold, the time point that record reaches the predetermined second threshold is The deadline point got on the bus.
The second threshold is the half of the length of entire chair lift.
The adjacent vehicle in front and back is described below can not be apart from too closely for principle to determine whether in violation of rules and regulations, need to deposit in this method Store up getting on the bus the deadline for a vehicle;Calculate getting on the bus the deadline for current vehicle;Take following steps:
Determine the start time point got on the bus in current image frame;
Calculate the time difference of the deadline point of getting on the bus of the start time point and a pre-stored upper monkey car;
If the time difference is less than predetermined threshold, it is determined that the movement got on the bus is in violation of rules and regulations.Prompting can be issued, is prompted The personnel of getting on the bus not get on the bus again.
In one embodiment, method further include: if it is determined that have chair lift column and nobody in current picture frame, There is no chair lift column in next multiple images frame, it is determined that be that empty wagons issues;To getting on the bus, indicator light issues electric signal, so that institute It states indicator light and is in the state for allowing to get on the bus.
Wherein, indicator light of getting on the bus has red light and green light two states;The state for allowing to get on the bus is green light phase;Do not allow The state of vehicle is red light phase;When indicator light receives control electric signal, the switching of the traffic light status may be implemented.
In normal situation, after a upper people sets out by bus, indicator light is to become after red light phase continues for some time Green light;Then the next man gets on the bus again;So people does not take vehicle successfully if it is determined that a upper vehicle is that empty wagons issues; Then indicator light will then shorten the time of waiting;Even without waiting;Can control indicator light is green light phase, and instruction is not sat Another chair lift is hung in Shang Shangyiliang vehicle forces to sit down a vehicle.To avoid because miss get on the bus and caused by time interval mistake Greatly, the force unbalance on wirerope.
A kind of whole monkey car monitoring method is described below, participates in a kind of attached complete monkey car monitoring method shown in Fig. 4 Flow diagram;Camera real-time monitoring monkey car ride site region utilizes trained mould in system to the video monitored Type is analyzed in real time, and every N frame to one frame of Image Acquisition, N is the positive integer greater than one.Each camera is taken every Picture is identified that identification step is as follows:
Whether step S401 has staff to hang the dynamic of monkey car when beginning using in algorithm of target detection identification picture Make, if so, S402 is thened follow the steps, if it is not, indicator light becomes green;
Step S402 utilizes the chair lift bar in algorithm of target detection identification picture;And judge whether chair lift bar tilts;It can With according to the Aspect Ratio of chair lift pole brand frame, judge the chair lift bar whether run-off the straight, if so, then follow the steps S403, Otherwise indicator light is green;
Step S403 records time t1;
It is preparatory to judge that the difference of the ordinate of the central point of the indicia framing of chair lift bar and the indicia framing of people is equal to by step S404 The second threshold of setting is fallen in threshold range;
Wherein, second threshold is the half of the length of chair lift;It is worth noting that, in order to improve accuracy, above-mentioned steps Before, it can also follow the steps below: analyze and determine the ordinate warp of the central point of the indicia framing of people by multiple images frame The process being lower from height is gone through, this process can show that people is in the process taken a seat.One threshold value model can also be set It encloses, such as centered on scheduled second threshold, the nargin of one difference of left and right floating forms a threshold range, if hung The difference of the ordinate of the central point of the indicia framing of the indicia framing and people of chair bar is fallen in threshold range, it is determined that is got on the bus and has been acted At.
If so, thening follow the steps S405, otherwise, step S406 is executed;
Step S405 records time t2;
Step S407 calculates time t3=t2-t1;
Step S408, judges whether t3 is greater than system alarm threshold value T1;
If it is, return step S401;If not, thening follow the steps S409;
Step S409 is identified whether to have next time and hangs monkey car movement;
If so, thening follow the steps S410;If it is not, then return step S405;
Warning message is transferred to combined aural and visual alarm by step S410, system, and combined aural and visual alarm issues alarm signal, and LED screen prompt is forbidden sitting monkey car;
Step S406 records time t4;
Step S411 judges the difference of the ordinate of the central point of the indicia framing of the indicia framing and people of chair lift bar in next frame Equal to preset second threshold;
If so, thening follow the steps S405;If not, thening follow the steps S412;
Step S412 records time t5;
Step S414 calculates time t6=t5-t4;
Step S414, judges whether t6 is greater than system alarm threshold value T2;If it is, explanation is not taken at the appointed time Monkey car thens follow the steps S415, if it is not, then return step S411;
Step S415 records time t7;
Step S416 alarms and prompts;
Wherein, warning message is transferred to combined aural and visual alarm by system, and combined aural and visual alarm issues alarm signal, and LED screen Prompt monkey car of sitting down;
Step S417 records time t8;
Step S418 calculates time t9=t8-t7;
Step S419, judges whether t9 is greater than system alarm threshold value T3;If so, the unmanned monkey car taken of explanation has been left Certain time can continue to determine whether to hang monkey car movement, then return step S401;
If not, thening follow the steps S420;
Step S420 judges whether next frame has and hangs monkey car movement;If it is thening follow the steps S421;If it is not, then returning Return step S417;
Step S421 alarms and prompts;Combined aural and visual alarm issues alarm signal, and LED screen prompt is forbidden sitting monkey car.
Second aspect, the application also proposed a kind of monitoring device, referring to attached monitoring device structural representation shown in fig. 5 Figure, the device include:
Module 51 is obtained, for obtaining the current picture frame got on the bus a little;
Determining module 52, for determining that getting on the bus in described image frame acts relevant temporal information;
Judgment module 53, in violation of rules and regulations whether the temporal information judgement for movement of getting on the bus according to get on the bus, defeated if in violation of rules and regulations Alarm command out.
Further, the judgment module 53 is also used to, and is calculated the deadline point and is subtracted the start time point and obtains To the consumed time of getting on the bus;If it is described get on the bus consumed by the time be greater than scheduled threshold value, it is determined that it is described get on the bus it is dynamic Make in violation of rules and regulations.
Further, judgment module 53 is also used to, and determines the start time point got on the bus in current image frame;
Calculate the time difference of the deadline point of getting on the bus of the start time point and a pre-stored upper vehicle;
If the time difference is less than predetermined threshold, it is determined that the movement got on the bus is in violation of rules and regulations.
Further, judgment module 53 is also used to, and obtains the real-time width and height value of the indicia framing of chair lift bar;
Real-time aspect ratio value is calculated according to the real-time width and height value of the indicia framing;
Calculate the absolute value of the difference of the standard value of the real-time aspect ratio value and scheduled aspect ratio value;
If the absolute value of the difference has reached scheduled threshold value;
Then record reaches the time point of the predetermined threshold for the start time point got on the bus.
Further, judgment module 53 is also used to,
The movement for taking chair lift is determined from the current picture frame;
Obtain the ordinate of the central point of chair lift pole brand frame;And the ordinate of the central point of the indicia framing of people;
Calculate the ordinate of the central point of the ordinate of the central point of the chair lift pole brand frame and the indicia framing of people Difference;
If the difference has reached scheduled second threshold, the time point that record reaches the predetermined second threshold is The deadline point got on the bus.
It further, further include cue module, for prompting a coastiong of sitting down.
It further, further include instruction control module, for if it is determined that having chair lift in the current picture frame got on the bus a little Column and nobody, and there is no chair lift column in next multiple images frame, it is determined that it is that empty wagons issues;To indicator light of getting on the bus Electric signal is issued, so that the indicator light is in the state for allowing to get on the bus.
According to a third aspect of the embodiments of the present invention, the application also proposed a kind of monitoring device of mine car queue, referring to The monitoring device structural schematic diagram of attached mine car queue shown in fig. 6, comprising: at least one processor 61 and at least one processor 62;The memory 61 is for storing one or more program instructions;
The processor 62, for running one or more program instructions, to execute method described in any of the above embodiments.
According to a fourth aspect of the embodiments of the present invention, a kind of computer readable storage medium, the computer storage medium In comprising one or more program instructions, one or more of program instructions are for being performed side as described in any one of the above embodiments Method.
In embodiments of the present invention, processor can be a kind of IC chip, the processing capacity with signal.Processing Device can be general processor, digital signal processor (Digital Signal Processor, abbreviation DSP), dedicated integrated Circuit (Application Specific work ntegrated Circuit, abbreviation ASIC), field programmable gate array (FieldProgrammable Gate Array, abbreviation FPGA) either other programmable logic device, discrete gate or crystal Pipe logical device, discrete hardware components.
It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.General procedure Device can be microprocessor or the processor is also possible to any conventional processor etc..In conjunction with disclosed in the embodiment of the present invention Method the step of can be embodied directly in hardware decoding processor and execute completion, or with hardware in decoding processor and soft Part block combiner executes completion.Software module can be located at random access memory, and flash memory, read-only memory may be programmed read-only storage In the storage medium of this fields such as device or electrically erasable programmable memory, register maturation.Processor reads storage medium In information, in conjunction with its hardware complete the above method the step of.
Storage medium can be memory, such as can be volatile memory or nonvolatile memory, or may include Both volatile and non-volatile memories.
Wherein, nonvolatile memory can be read-only memory (Read-Only Memory, abbreviation ROM), may be programmed Read-only memory (Programmable ROM, abbreviation PROM), Erasable Programmable Read Only Memory EPROM (Erasable PROM, letter Claim EPROM), electrically erasable programmable read-only memory (Electrically EPROM, abbreviation EEPROM) or flash memory.
Volatile memory can be random access memory (Random Access Memory, abbreviation RAM), be used as External Cache.By exemplary but be not restricted explanation, the RAM of many forms is available, such as static random-access is deposited Reservoir (Static RAM, abbreviation SRAM), dynamic random access memory (Dynamic RAM, abbreviation DRAM), synchronous dynamic with Machine accesses memory (Synchronous DRAM, abbreviation SDRAM), double data speed synchronous dynamic RAM (Double Data RateSDRAM, abbreviation DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, abbreviation ESDRAM), synchronized links dynamic random access memory (Synchlink DRAM, abbreviation SLDRAM) and directly Rambus random access memory (DirectRambus RAM, abbreviation DRRAM).
The storage medium of description of the embodiment of the present invention is intended to include but is not limited to depositing for these and any other suitable type Reservoir.
Those skilled in the art are it will be appreciated that in said one or multiple examples, function described in the invention It can be realized with hardware with combination of software.When application software, corresponding function can be stored in computer-readable medium In or as on computer-readable medium one or more instructions or code transmitted.Computer-readable medium includes meter Calculation machine storage medium and communication media, wherein communication media includes convenient for transmitting computer journey from a place to another place Any medium of sequence.Storage medium can be any usable medium that general or specialized computer can access.
Above-described specific embodiment has carried out further the purpose of the present invention, technical scheme and beneficial effects It is described in detail, it should be understood that being not intended to limit the present invention the foregoing is merely a specific embodiment of the invention Protection scope, all any modification, equivalent substitution, improvement and etc. on the basis of technical solution of the present invention, done should all Including within protection scope of the present invention.

Claims (10)

1. a kind of monitoring method characterized by comprising
Obtain the current picture frame got on the bus a little;Determine that getting on the bus in described image frame acts relevant temporal information;
It acts the judgement of relevant temporal information according to described get on the bus and whether in violation of rules and regulations to get on the bus, export alarm command if in violation of rules and regulations.
2. the method as described in claim 1, which is characterized in that described get on the bus acts relevant temporal information and include:
The start time point got on the bus and the deadline point got on the bus;
According to it is described get on the bus act relevant temporal information determine whether in violation of rules and regulations, comprising:
It calculates the deadline point and subtracts the start time point and obtain the consumed time of getting on the bus;
If the consumed time of getting on the bus is greater than scheduled threshold value, it is determined that the movement got on the bus is in violation of rules and regulations.
3. the method as described in claim 1, which is characterized in that
According to it is described get on the bus act relevant temporal information judge whether in violation of rules and regulations, comprising:
Determine the start time point got on the bus in current image frame;
Calculate the time difference of the deadline point of getting on the bus of the start time point and a pre-stored upper vehicle;
If the time difference is less than predetermined threshold, it is determined that the movement got on the bus is in violation of rules and regulations.
4. method according to claim 2, which is characterized in that the start time point got on the bus described in determining, comprising:
The movement for hanging chair lift bar is determined from the current picture frame;
Obtain the real-time width and height value of the indicia framing of the chair lift bar;
Real-time aspect ratio value is calculated according to the real-time width and height value of the indicia framing;
Calculate the absolute value of the difference of the standard value of the real-time aspect ratio value and scheduled aspect ratio value;
If the absolute value of the difference has reached scheduled threshold value, it is described that record, which reaches the time point of the predetermined threshold, The start time point got on the bus.
5. method according to claim 2, which is characterized in that the deadline point got on the bus described in determining, comprising:
The movement for taking chair lift is determined from the current picture frame;
Obtain the ordinate of the central point of chair lift pole brand frame;And the ordinate of the central point of the indicia framing of people;
Calculate the difference of the ordinate of the central point of the ordinate of the central point of the chair lift pole brand frame and the indicia framing of people;
If the difference has reached scheduled second threshold, it is described that record, which reaches the time point of the predetermined second threshold, The deadline point got on the bus.
6. the method as described in claim 1, which is characterized in that get on the bus according to the relevant temporal information determination of the movement Movement be violation after, comprising: prompt is sat down a coastiong.
7. method according to claim 2, which is characterized in that further include: if it is determined that in the current picture frame got on the bus a little There are chair lift column and nobody, and there is no chair lift column in next multiple images frame, it is determined that is that empty wagons issues;To getting on the bus Indicator light issues electric signal, so that the indicator light is in the state for allowing to get on the bus.
8. a kind of monitoring device characterized by comprising
Module is obtained, for obtaining the current picture frame got on the bus a little;
Determining module acts relevant temporal information for determining to get on the bus in described image frame;
Judgment module acts whether in violation of rules and regulations relevant temporal information judgement gets on the bus for getting on the bus according to.
9. a kind of monitoring device characterized by comprising at least one processor and at least one processor;
The memory is for storing one or more program instructions;
The processor, for running one or more program instructions, to execute such as the described in any item sides of claim 1-7 Method.
10. a kind of computer readable storage medium, which is characterized in that include one or more journeys in the computer storage medium Sequence instruction, one or more of program instructions are for being performed the method according to claim 1 to 7.
CN201910691383.4A 2019-07-29 2019-07-29 Monitoring method, device, equipment and storage medium Active CN110428589B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910691383.4A CN110428589B (en) 2019-07-29 2019-07-29 Monitoring method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910691383.4A CN110428589B (en) 2019-07-29 2019-07-29 Monitoring method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110428589A true CN110428589A (en) 2019-11-08
CN110428589B CN110428589B (en) 2020-08-21

Family

ID=68411279

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910691383.4A Active CN110428589B (en) 2019-07-29 2019-07-29 Monitoring method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110428589B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112101351A (en) * 2020-09-07 2020-12-18 凌云光技术股份有限公司 Projection-based text line rotation correction method and device

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012007618A8 (en) * 2010-07-13 2012-06-28 Scio Soft, S.L. Passive safety system and personal equipment on vessels for man-overboard situations
CN203032675U (en) * 2013-01-21 2013-07-03 霍州煤电集团吕梁山煤电有限公司方山木瓜煤矿 Mining monkey vehicle detection and control system
CN203976283U (en) * 2014-07-11 2014-12-03 常州科研试制中心有限公司 The comprehensive electric-control system of mining rope traction transportation device
CN205247172U (en) * 2015-12-19 2016-05-18 大同卓立机化有限责任公司 Full automatic control device of mining monkey car
CN105652290A (en) * 2016-03-27 2016-06-08 厦门精图信息技术有限公司 Riding information shared system based on Beidou navigation and communication network
CN107274702A (en) * 2016-04-06 2017-10-20 中兴通讯股份有限公司 A kind of intelligent traffic management system and its method of work
CN107481487A (en) * 2017-08-28 2017-12-15 郑海英 A kind of method of real-time reminding waiting time
CN206901607U (en) * 2017-05-23 2018-01-19 四川达竹煤电(集团)有限责任公司渡市选煤发电厂 Transporting coal cableway set a distance hair bucket control device
WO2018061044A2 (en) * 2016-09-30 2018-04-05 Maritano Meiranesio Luca System of orientable cabins for passengers
CN108024155A (en) * 2017-12-15 2018-05-11 北京小度互娱科技有限公司 The video broadcasting method and device of adaptive video the ratio of width to height
EP2949615B1 (en) * 2014-05-27 2018-07-11 Uniforest, D.o.o. Cable winch with automatically controlled regulation of speed of unwinding of a haulage cable
CN207758776U (en) * 2017-12-12 2018-08-24 临沂矿业集团有限责任公司 A kind of Aerial Conveyance for Human in Coal Mine multiplies human world distance control apparatus
CN109204587A (en) * 2018-10-27 2019-01-15 华强方特(芜湖)文化科技有限公司 A kind of amusement park Sightseeing Bus
CN208673125U (en) * 2018-09-07 2019-03-29 成都赛零信息技术开发有限公司 Cableway-type monitoring system
CN109558776A (en) * 2017-09-27 2019-04-02 重庆凯泽科技股份有限公司 The method and device detected in violation of rules and regulations by bus for station
CN109686048A (en) * 2019-01-02 2019-04-26 平安科技(深圳)有限公司 Station platform gets over method for early warning, device, computer equipment and the storage medium of line
CN110040470A (en) * 2019-05-21 2019-07-23 精英数智科技股份有限公司 A kind of monitoring method of artificial intelligence video identification belt deviation

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012007618A8 (en) * 2010-07-13 2012-06-28 Scio Soft, S.L. Passive safety system and personal equipment on vessels for man-overboard situations
CN203032675U (en) * 2013-01-21 2013-07-03 霍州煤电集团吕梁山煤电有限公司方山木瓜煤矿 Mining monkey vehicle detection and control system
EP2949615B1 (en) * 2014-05-27 2018-07-11 Uniforest, D.o.o. Cable winch with automatically controlled regulation of speed of unwinding of a haulage cable
CN203976283U (en) * 2014-07-11 2014-12-03 常州科研试制中心有限公司 The comprehensive electric-control system of mining rope traction transportation device
CN205247172U (en) * 2015-12-19 2016-05-18 大同卓立机化有限责任公司 Full automatic control device of mining monkey car
CN105652290A (en) * 2016-03-27 2016-06-08 厦门精图信息技术有限公司 Riding information shared system based on Beidou navigation and communication network
CN107274702A (en) * 2016-04-06 2017-10-20 中兴通讯股份有限公司 A kind of intelligent traffic management system and its method of work
WO2018061044A2 (en) * 2016-09-30 2018-04-05 Maritano Meiranesio Luca System of orientable cabins for passengers
CN206901607U (en) * 2017-05-23 2018-01-19 四川达竹煤电(集团)有限责任公司渡市选煤发电厂 Transporting coal cableway set a distance hair bucket control device
CN107481487A (en) * 2017-08-28 2017-12-15 郑海英 A kind of method of real-time reminding waiting time
CN109558776A (en) * 2017-09-27 2019-04-02 重庆凯泽科技股份有限公司 The method and device detected in violation of rules and regulations by bus for station
CN207758776U (en) * 2017-12-12 2018-08-24 临沂矿业集团有限责任公司 A kind of Aerial Conveyance for Human in Coal Mine multiplies human world distance control apparatus
CN108024155A (en) * 2017-12-15 2018-05-11 北京小度互娱科技有限公司 The video broadcasting method and device of adaptive video the ratio of width to height
CN208673125U (en) * 2018-09-07 2019-03-29 成都赛零信息技术开发有限公司 Cableway-type monitoring system
CN109204587A (en) * 2018-10-27 2019-01-15 华强方特(芜湖)文化科技有限公司 A kind of amusement park Sightseeing Bus
CN109686048A (en) * 2019-01-02 2019-04-26 平安科技(深圳)有限公司 Station platform gets over method for early warning, device, computer equipment and the storage medium of line
CN110040470A (en) * 2019-05-21 2019-07-23 精英数智科技股份有限公司 A kind of monitoring method of artificial intelligence video identification belt deviation

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王锦: ""监控视频中异常事件检测方法研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112101351A (en) * 2020-09-07 2020-12-18 凌云光技术股份有限公司 Projection-based text line rotation correction method and device
CN112101351B (en) * 2020-09-07 2024-04-19 凌云光技术股份有限公司 Text line rotation correction method and device based on projection

Also Published As

Publication number Publication date
CN110428589B (en) 2020-08-21

Similar Documents

Publication Publication Date Title
US20190197325A1 (en) Method for monitoring an interior state of an autonomous vehicle
CN104809887B (en) A kind of retrograde detection method of vehicle on expressway and autoalarm
CN105427613B (en) The means of proof and its system that a kind of rule-breaking vehicle is jumped a queue
CN105229698B (en) For monitoring and controlling the method and apparatus for carrying out the method for bulking system
CN107416629B (en) The control method and system of elevator safety operation
CN105118305B (en) Motor pool outlet vehicle management platform
CN107729870A (en) The method and apparatus of in-car safety monitoring based on computer vision
CN108289203B (en) Video monitoring system for rail transit
CN107316462A (en) A kind of flow statistical method and device
CN106682783A (en) Method and device for predicting waiting time of taxis in storage yard
CN109311425A (en) A kind of alarming method by monitoring of vehicle blind zone, device, equipment and storage medium
CN108502552B (en) Automatic storage yard of container terminal
CN106408958A (en) Control apparatus and method of crossing signal lamps
CN109447338A (en) Intelligent logistics cloud management system based on big data
CN108363953A (en) A kind of method and binocular monitoring device of pedestrian detection
CN108171134A (en) A kind of operational motion discrimination method and device
CN106127723A (en) Peripheral space characteristics information extraction method
CN106340205A (en) Traffic monitoring method and traffic monitoring apparatus
CN110321823A (en) Zebra stripes based on deep learning give precedence to the illegal secondary detection method of pedestrian
CN110428589A (en) Monitoring method, device, equipment and storage medium
CN110221551A (en) The method, apparatus and system of banister control
CN110263623A (en) Train climbs monitoring method, device, terminal and storage medium
CN111877817A (en) Multilayer parking system based on machine vision planning path
CN106448251A (en) Recognition method and terminal device
CN109345644A (en) A kind of vehicle appearance monitoring method and system and server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant