CN103324158A - Engineering machinery onboard video monitoring system with face detection function - Google Patents
Engineering machinery onboard video monitoring system with face detection function Download PDFInfo
- Publication number
- CN103324158A CN103324158A CN201310176951XA CN201310176951A CN103324158A CN 103324158 A CN103324158 A CN 103324158A CN 201310176951X A CN201310176951X A CN 201310176951XA CN 201310176951 A CN201310176951 A CN 201310176951A CN 103324158 A CN103324158 A CN 103324158A
- Authority
- CN
- China
- Prior art keywords
- data
- video
- face detection
- people
- master controller
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses an engineering machinery onboard video monitoring system with a face detection function. The system can carry out video monitoring on a working environment, judging personnel appearing in the working environment and actively sending out an early warning signal to improves safety of field operation. The system specifically comprises a main controller, a data collection module, a face detection module and a man-machine interaction module. The main controller is used for judging running conditions of a machine through onboard data analysis. The data collection module comprises a video monitoring device and a condition monitoring device, wherein the video monitoring device collects working environment information through a camera placed at a viewing angle dead zone of a driver, and the condition monitoring device is used for collecting working condition data in a power system, a hydraulic system and an electronic control system through sensors. The face detection module carries out face detection processing on collected video data, identifying the personnel appearing in the working environment, marking positions of faces, and sending the early warning signal. The man-machine interaction module integrates and displays the onboard data and the video data through an LCD display, and providing signal instructions of personnel early warning information, failure information and working modes.
Description
Technical field
The present invention relates to engineering machinery airborne monitoring field, relate in particular to a kind of engineering machinery airborne video monitoring system with the detection of people's face.
Background technology
The aircraft monitor and control system of engineering machinery is responsible for work mechanism is carried out status monitoring and function control, by the data that collect being analyzed and being diagnosed, can find potential faults early, improves the security of operation.In real work, when equipment revolution or vehicle forward-reverse, still need the timely observation of driver whether personnel to be arranged in its working range, and driver's field range is limited, can not grasp vehicle periphery information effectively, security incident takes place easily.
Existing method just increases by a cover video monitoring system, settles camera in position, blind area, visual angle, and working environment is monitored in real time, has solved the safety issue that causes because of the blind area, visual angle.But this method still needs driver oneself to go the environment of observation video information, initiatively whether has personal security hidden danger in the early warning working environment.
Summary of the invention
In view of this, the present invention proposes a kind of engineering machinery video monitoring system that detects with people's face, the video that collects is carried out people's face detect and handle, with the solution problem of personal security hidden danger in the early warning working environment initiatively.
The present invention solves the technical scheme that its technical matters adopts: a kind of engineering machinery video monitoring system that detects with people's face, and this system specifically comprises: master controller, by to on-board data analysis and judgement machine operation conditions; Data acquisition module, comprise video monitoring apparatus and state monitoring device, the former is by being placed on the camera collection working environment information of blind area, driver visual angle, and the latter gathers airborne floor data on power system, hydraulic system and the electric-control system by sensor; People's face detection module by carrying out people's face and detect to handle collecting video data, is identified and labelling human face position personnel's appearance wherein, sends early warning signal; Human-computer interaction module by the integrated demonstration on-board data of LCD display and video data, and provides the signal of personnel's early warning, failure message and mode of operation to indicate.
Wherein in people's face detection module, according to the characteristics of engineering machinery working environment, use the method for detecting human face based on the colour of skin, reduce illumination for the influence of the colour of skin, realized that the portrait that not influenced by human face posture in the regulation zone judges.
Simultaneously in order to improve man-machine interaction, being convenient to human pilot in time learns dangerous situation and makes correct reaction, native system will be integrated and show the airborne floor data obtain and the video data that obtains from the front end camera from front end hydraulic pressure, power and electric-control system, simultaneously to on-board data with video data is analyzed and initiatively early warning.
When the engineering machinery operate as normal, airborne floor data such as pressure, temperature, oil level etc. obtain by the CAN bus, by the analysis to on-board data, determine mode of operation and the device fault information of machine, and show in man-machine interface.The ambient video data are obtained by the camera that is installed in position, blind area, visual angle such as dead astern, in the time of in personnel appear at working range, detect personnel and show personnel's early warning signal in man-machine interface by people's face detection module.
Compared with prior art, the present invention has following advantage:
1. on the basis of video monitoring working environment information, whether have personnel occur, and send initiatively early warning signal, the security that has improved site work to the driver if detecting in the active analysis perform region by people's face.
2. video monitoring is shown with airborne monitoring display to be integrated into a personal-machine interface system, made things convenient for driver's information to obtain.
Description of drawings
Fig. 1 is general structure synoptic diagram of the present invention.
Fig. 2 is that people's face of the present invention detects schematic diagram.
Fig. 3 is active early warning schematic diagram of the present invention.
Among the figure: 1. data acquisition module, 2. people's face detection module, 3. human-computer interaction module, 4. master controller, 11. video data acquiring unit, 12. on-board data collecting units, 111. cameras, 112. video capture processors, 121. sensors, 122.CAN controller.
Embodiment
Principle of the present invention is: on existing supervisory system basis to on-board data, increase the security monitoring to working environment.Detect processing by the vision signal that collects being carried out people's face, whether there is personal security hidden danger in the judgment task environment, and improve whole airborne early-warning system based on this, realize the comprehensive early warning to airborne operating mode and working environment, the security that has improved actual job.
At the engineering machinery environment characteristics, set up the colour of skin of people's face and extract standard, according to the people's face detection algorithm based on the colour of skin, realized that the people's face that not influenced by human face posture judges.
Describe this example in detail below in conjunction with accompanying drawing, it is more obvious that purpose of the present invention and effect will become.
As shown in Figure 1, in this example, described airborne video monitoring system comprises data acquisition module 1, people's face detection module 2, human-computer interaction module 3 and master controller 4.
Wherein data acquisition module 1 comprises video data acquiring unit 11 and on-board data collecting unit 12, video data acquiring unit 11 is made up of camera 111 and video capture processor 112, camera 111 is selected 3 CCD cameras, be placed in both sides and the rear of pilothouse respectively, the signal output part of camera 111 links to each other with the signal input part of video capture processor 112, video capture processor imports master controller 4 into after the analog video signal that collects is converted into digital signal; On-board data collecting unit 12 is made up of sensor 121 and CAN controller 122, sensor 121 is placed in hydraulic system, power system and the electric-control system and gathers on-board data, sensor output signal is converted into the CAN data after sampling by A/D conversion or timer, and import CAN controller 122 into, the CAN controller obtains after the each several part data, and data are encapsulated and import master controller 4 into.
People's face detection module 2 obtains the video data that imported into by video capture processor 112 from master controller 4, by the working environment vision signal being carried out after people's face detects testing result is returned master controller 4.Master controller 4 imports it into human-computer interaction module 3 after the video information that recipient's face detection module 2 returns; As shown in Figure 3, after the on-board data that reception CAN controller 122 imports into, it is carried out mode of operation and Analysis on Fault Diagnosis, thereby judge the airborne operation conditions of excavator, and import on-board data and analysis result into human-computer interaction module 3 in the lump.The demonstration carrier of human-computer interaction module 3 is the LCD liquid crystal display, integrates to show airborne information and video information.
In the operation process, camera 111 is taken the work on the spot environment at fuselage both sides and driver rear, the video data of taking imports master controller 4 into by video capture processor 112, master controller 4 imports it into and carries out people's face detection processing (people's face detects principle as shown in Figure 2) in people's face detection module 2, at last the processed video data is presented on the liquid crystal display of human-computer interaction module 3.Sensor 122 is gathered airborne floor data, be packaged into the CAN data by CAN controller 122 and import master controller 4 into, master controller 4 carries out judgement and the fault diagnosis of mode of operation to it, and analysis result and on-board data together are presented on the liquid crystal display of human-computer interaction module.The driver can set and adjust monitoring parameter by human-computer interaction module simultaneously, to guarantee monitoring effect.
During operate as normal, human-computer interaction module is integrated and is shown airborne information and video information, when in detecting the perform region, personnel occurring, can increase video display area automatically, mark people's face position and follow sound, icon alerting signal, on original early warning basis to airborne work information, increased the early warning to environmental information, improved the security of engineering machinery site work.
This routine described main control chip adopts the imx35 of Freescale, and video capture processor adopts adv7180, and for convenience of obtaining of information, 7 cun liquid crystal touch screen is adopted in the demonstration of native system information and order input.
Above-described embodiment is used for the present invention that explains, rather than limits the invention, and in the protection domain of spirit of the present invention and claim, any modification and change to the present invention makes all fall into protection scope of the present invention.
Claims (1)
1. engineering machinery airborne video monitoring system that detects with people's face, comprise data acquisition module, people's face detection module, human-computer interaction module and master controller, it is characterized in that: data acquisition module comprises video data acquiring unit and on-board data collecting unit, the video data acquiring unit is made up of camera and video capture processor, camera is selected three CCD cameras for use, be placed in both sides and the rear of pilothouse respectively, signal at output end of camera links to each other with the signal input part of video capture processor, video capture processor imports master controller into after the analog video signal that collects is converted into digital signal; The on-board data collecting unit is made up of sensor and CAN controller, sensor is placed in hydraulic system, power system and the electric-control system and gathers on-board data, sensor output signal is converted into the CAN data after sampling by A/D conversion or timer, and import the CAN controller into, the CAN controller obtains after the each several part data, and data are encapsulated and import master controller into; People's face detection module obtains the video data that imported into by video capture processor from master controller, by the working environment vision signal being carried out after people's face detects testing result is returned master controller; Master controller imports it into human-computer interaction module after the video information that recipient's face detection module returns; After the on-board data that reception CAN controller imports into, it is carried out the analysis of mode of operation and fault diagnosis, thereby judge the airborne operation conditions of excavator, and import on-board data and analysis result into human-computer interaction module simultaneously; The demonstration carrier of human-computer interaction module is the LCD liquid crystal display, integrates to show airborne information and video information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310176951XA CN103324158A (en) | 2013-05-14 | 2013-05-14 | Engineering machinery onboard video monitoring system with face detection function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310176951XA CN103324158A (en) | 2013-05-14 | 2013-05-14 | Engineering machinery onboard video monitoring system with face detection function |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103324158A true CN103324158A (en) | 2013-09-25 |
Family
ID=49192965
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310176951XA Pending CN103324158A (en) | 2013-05-14 | 2013-05-14 | Engineering machinery onboard video monitoring system with face detection function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103324158A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109711275A (en) * | 2018-12-05 | 2019-05-03 | 湖北凯瑞知行智能装备有限公司 | A kind of power plant's operation process security risk acquisition identification system and method |
| CN110458090A (en) * | 2019-08-08 | 2019-11-15 | 成都睿云物联科技有限公司 | Working state of excavator detection method, device, equipment and storage medium |
| CN110687806A (en) * | 2019-09-30 | 2020-01-14 | 万翼科技有限公司 | Equipment control method and related device |
| CN112585323A (en) * | 2018-10-15 | 2021-03-30 | 日立建机株式会社 | Hydraulic excavator |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20090000677U (en) * | 2007-07-19 | 2009-01-22 | (주) 이오스링크 | Image controll apparatus with environmental monitoring means |
| CN101547344A (en) * | 2009-04-24 | 2009-09-30 | 清华大学深圳研究生院 | Video monitoring device and tracking and recording method based on linkage camera |
| CN101655907A (en) * | 2009-08-28 | 2010-02-24 | 大连鑫奇辉科技有限公司 | Trainman driving state monitoring intelligent alarm system |
| CN202334770U (en) * | 2011-12-04 | 2012-07-11 | 长安大学 | Full-view monitoring system for engineering machine |
| CN202904884U (en) * | 2012-12-04 | 2013-04-24 | 成都威路特软件科技有限公司 | High-definition video comprehensive detection system |
-
2013
- 2013-05-14 CN CN201310176951XA patent/CN103324158A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20090000677U (en) * | 2007-07-19 | 2009-01-22 | (주) 이오스링크 | Image controll apparatus with environmental monitoring means |
| CN101547344A (en) * | 2009-04-24 | 2009-09-30 | 清华大学深圳研究生院 | Video monitoring device and tracking and recording method based on linkage camera |
| CN101655907A (en) * | 2009-08-28 | 2010-02-24 | 大连鑫奇辉科技有限公司 | Trainman driving state monitoring intelligent alarm system |
| CN202334770U (en) * | 2011-12-04 | 2012-07-11 | 长安大学 | Full-view monitoring system for engineering machine |
| CN202904884U (en) * | 2012-12-04 | 2013-04-24 | 成都威路特软件科技有限公司 | High-definition video comprehensive detection system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112585323A (en) * | 2018-10-15 | 2021-03-30 | 日立建机株式会社 | Hydraulic excavator |
| CN109711275A (en) * | 2018-12-05 | 2019-05-03 | 湖北凯瑞知行智能装备有限公司 | A kind of power plant's operation process security risk acquisition identification system and method |
| CN110458090A (en) * | 2019-08-08 | 2019-11-15 | 成都睿云物联科技有限公司 | Working state of excavator detection method, device, equipment and storage medium |
| CN110687806A (en) * | 2019-09-30 | 2020-01-14 | 万翼科技有限公司 | Equipment control method and related device |
| CN110687806B (en) * | 2019-09-30 | 2023-04-07 | 万翼科技有限公司 | Equipment control method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101614013B1 (en) | Shovel, monitoring device therefor, and shovel output device | |
| CN103324158A (en) | Engineering machinery onboard video monitoring system with face detection function | |
| CN109142904A (en) | A kind of extra-high voltage direct-current transmission converter valve fault monitoring method and device | |
| CN110660199A (en) | Ship monitoring alarm system | |
| CN101849865A (en) | Artificial limb state intelligent monitoring and displaying device | |
| CN203440859U (en) | Intelligent fault diagnosis and monitor system of underground carry-scraper | |
| CN204259266U (en) | A kind of digitlization is used for the high voltage source of movable high-frequency X-ray machine | |
| CN110136852A (en) | A kind of one loop of nuclear power station water pressure test overpressure protection system | |
| CN103422525A (en) | Fault intelligent diagnosing and monitoring system for underground scraper | |
| CN109084997A (en) | A kind of the new-energy automobile fault detection means and detection method of automation | |
| CN203855261U (en) | Real-time monitoring system for elevator running | |
| CN203705878U (en) | Engineering machinery airborne video monitoring system with human face detection | |
| CN107884363B (en) | Laser mine gas telemetry method based on machine vision technology | |
| CN201842575U (en) | Tractor detection or diagnosis system | |
| CN105291838A (en) | Automobile gas combination instrument and control method thereof | |
| CN202066672U (en) | Measuring and controlling system for pressure alternation test of air-air charge air cooler | |
| CN212872720U (en) | Industrial field device fault detection device | |
| CN102877968A (en) | Remote control system for generator set | |
| CN204364750U (en) | A kind of automatic collection monitoring system of fire pump operation conditions | |
| CN210221296U (en) | On-spot management and control early warning device of transformer substation | |
| CN202190543U (en) | Intelligent detection alarming device for combine harvester | |
| CN208537169U (en) | A kind of rolling bearing remote monitoring and diagnosis device | |
| CN206111342U (en) | Marine diesel fuel generating set monitored control system | |
| CN201851161U (en) | Intelligent coal mine gas drainage detecting and monitoring cabinet | |
| CN204859425U (en) | Supplementary car membrane camera that passes through of laser |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130925 |