CN108989745A - A kind of unmanned plane automatic tour inspection system and method - Google Patents

A kind of unmanned plane automatic tour inspection system and method Download PDF

Info

Publication number
CN108989745A
CN108989745A CN201810700905.8A CN201810700905A CN108989745A CN 108989745 A CN108989745 A CN 108989745A CN 201810700905 A CN201810700905 A CN 201810700905A CN 108989745 A CN108989745 A CN 108989745A
Authority
CN
China
Prior art keywords
unmanned plane
photo
embeded processor
controller
shooting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810700905.8A
Other languages
Chinese (zh)
Inventor
侯亮
杨陆见
施永鑫
张凤阁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changchun Strawberry Technology Co Ltd
Original Assignee
Changchun Strawberry Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changchun Strawberry Technology Co Ltd filed Critical Changchun Strawberry Technology Co Ltd
Priority to CN201810700905.8A priority Critical patent/CN108989745A/en
Publication of CN108989745A publication Critical patent/CN108989745A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control

Abstract

A kind of unmanned plane automatic tour inspection system and method are related to air vehicle technique field, solve the problems, such as that existing unmanned plane automatic detecting manpower relies on big, eye recognition fatiguability and accuracy is unstable.The system includes: unmanned plane, the embeded processor and controller that are arranged on unmanned plane, unmanned plane is for shooting photo and the photo of shooting being sent to embeded processor and controller, embeded processor obtains calculated result using the weight model calculating photo being loaded into thereon, judges whether calculated result reaches setting value and obtain judging result, according to judging result transmission alarm signal to controller, and controller controls unmanned plane during flying shooting and sends photo, starts embeded processor, the alarm signal that reception embeded processor is sent.The present invention makes inspection reduce manpower dependence and judges more accurately by embeded processor.Corresponding method for inspecting is easy to operate and accuracy of judgement is stablized, and saves manpower, while judging unmanned plane photo quick.

Description

A kind of unmanned plane automatic tour inspection system and method
Technical field
The present invention relates to air vehicle technique fields, and in particular to a kind of unmanned plane automatic tour inspection system and method.
Background technique
Industrial unmanned plane is in photovoltaic plant inspection, electric inspection process, the inspection of oil gas refinery, base station patrol checking, forest protection, mining The fields such as engineering management, highway quick response gradually begin to use, and are in be gradually increasing trend.
When existing unmanned plane carries out inspection, the flight that professional operates unmanned plane is generally required, controls holder side To the moment observes the picture of passback to judge abnormal conditions.There are manpowers to rely on big, eye recognition fatiguability, accuracy shakiness The problems such as determining.
Summary of the invention
In order to solve, existing unmanned plane automatic detecting manpower relies on big, eye recognition fatiguability and accuracy is unstable asks Topic, the present invention provide a kind of unmanned plane automatic tour inspection system and method.
Used technical solution is as follows in order to solve the technical problem by the present invention:
A kind of unmanned plane automatic tour inspection system, including unmanned plane, controller and the embedded processing being arranged on unmanned plane Device, the unmanned plane are described embedded for shooting photo and the photo of shooting being sent to embeded processor and controller Processor is used to receive the photo of unmanned plane transmission, photo is calculated using the weight model that is loaded into thereon obtain calculated result, Judge calculated result whether reach setting value obtain judging result, according to judging result send alarm signal to controller, it is described Controller for control unmanned plane during flying, control unmanned plane shooting, control unmanned plane send photo, starting embeded processor, Receive the alarm signal and receive the photo that unmanned plane is sent that embeded processor is sent.
A kind of method for inspecting based on unmanned plane automatic tour inspection system, which comprises the steps of:
S1, embeded processor are loaded into weight model;
S2, controller control unmanned plane during flying to target area;
S3, controller start embeded processor;
S4, controller control unmanned plane shooting;
The photo of shooting is sent to embeded processor by S5, unmanned plane, and embeded processor receives what unmanned plane was sent Photo;
S6, embeded processor calculate the received photo of institute using weight model and obtain calculated result, and judge to calculate knot Whether fruit reaches setting value, if it is, embeded processor sends alarm signal to controller, carries out S7, otherwise return S4 or Controller control unmanned plane flies away from the target area;
S7, controller receive alarm signal and control unmanned plane in target area orbit and shooting, and unmanned plane will be clapped The photo taken the photograph is sent to controller, and controller receives the photo that unmanned plane is sent.
The beneficial effects of the present invention are:
1, a kind of unmanned plane automatic tour inspection system passes through the embedded processing that can be loaded into weight model and calculate judgement Device makes inspection reduce manpower and relies on, and without human eye real-time judge, embeded processor judges more accuracy.
2, embeded processor and unmanned plane are controlled by controller, realizes the intelligent operation of this system, reduce manpower It operates and improves efficiency.
3, a kind of method for inspecting of unmanned plane automatic tour inspection system is easy to operate and accuracy of judgement is stablized, and saves manpower Labour, while unmanned plane photo is judged quick.
Detailed description of the invention
Fig. 1 is the acquisition weight model flow chart based on a kind of unmanned plane automatic tour inspection system and method.
Fig. 2 is the acquisition unmanned plane real-time monitoring flow chart based on a kind of unmanned plane automatic tour inspection system and method.
Specific embodiment
The present invention is described in further details with reference to the accompanying drawings and examples.
A kind of unmanned plane automatic tour inspection system, including controller, unmanned plane and embeded processor.Unmanned plane has shooting Function is provided with embeded processor on unmanned plane, and the camera of unmanned plane connects embeded processor, the shooting of unmanned plane camera Photo be sent to embeded processor and/or controller (photo of shooting can be sent embeded processor by unmanned function, Controller can be sent to).Embeded processor is used to receive the photo of unmanned plane transmission, and embeded processor can be loaded into weight mould Type, embeded processor are used to be calculated received photo using the weight model of loading and obtain calculated result, judge calculated result Whether reach setting value to obtain judging result, send alarm signal according to judging result to controller.Embeded processor according to Weight model processing photo can identify object or scene in real time, and processing includes calculating and judging.Controller signals connect unmanned plane And embeded processor, controller are used to start embeded processor, receive alarm signal, reception that embeded processor is sent The photo that photo, control unmanned plane during flying, the shooting of control unmanned plane and the reception unmanned plane that unmanned plane is sent are sent.Embedded place The embedded mould group TX series of NVIDIA can be used in reason device.
A kind of unmanned plane automatic tour inspection system further includes the airplane parking area for parking unmanned plane.Airplane parking area can connect control Device, controller control the cover folding of airplane parking area, the motor operating of airplane parking area and switch of charging unit etc..On airplane parking area Equipped with the charging unit to charge for unmanned plane and for the more changing device of unmanned plane replacement battery.Airplane parking area can be used to stop automatically Machine level ground, autostop level ground have for unmanned plane automatic charging and move certainly the function of unmanned plane battery.
A kind of unmanned plane automatic tour inspection system passes through the embeded processor that can be loaded into weight model and calculate judgement, Make inspection reduce manpower to rely on, without human eye real-time judge, embeded processor judges more accuracy.It is controlled by controller Embeded processor and unmanned plane realize the intelligent operation of this system, reduce manual operation and improve efficiency.
Based on a kind of method for inspecting of unmanned plane automatic tour inspection system, including obtain weight model and unmanned plane real-time monitoring Two big steps.Unmanned plane real-time monitoring is based on known weight model, and the embeded processor of UAV flight can carry out depth The automated reasoning for spending neural network can identify the object and scene on ground by being loaded into trained weight model in real time.It should Method is easy to operate and accuracy of judgement is stablized, and saves manual labor, while judging unmanned plane photo quick.
One, obtain weight model process as shown in Figure 1, are as follows:
It determines the type of data set, for example to detect or monitor the water pollution in river, risk of forest fire, oil field leakage, exhaust gas Discharge of wastewater, disaster search and rescue, pest and disease damage early warning etc., present embodiment is for detecting a certain region and whether have pest and disease damage.
Staff's manual control unmanned plane or other flight instruments with shooting function are gone to pest and disease damage region, Pest and disease damage region is reference zone.
S0.1 obtains pictures: control flight instruments carry out under multi-angle, more times, more weather conditions water pollution region Shooting, shooting obtain pictures.
S0.2 mark strengthens pictures and obtains data set: it is after flight instruments shooting that the picture of shooting is locally downloading, than It such as downloads on computer, staff is manually labeled and strengthens to the region of water pollution in picture, after marking and strengthening Obtain data set.The specific object of such as red spider, bollworm, longicorn, the maize leaves with red stain or scene are marked, is strengthened Using the methods of such as image translation, rotation, mirror image, transformation, brightness change, plus noise.
S0.3 obtains validation data set: data set a part is extracted, as validation data set, data set remaining Part is used as training dataset, such as in data set 20% data as validation data set.
S0.4 obtains weight model by training: computer carries out depth mind to training dataset using high-performance server Training through network, obtains weight model.Such as with the MobileNet model or Darknet under TensorFlow frame Yolo model under frame is trained work, the server that this area video card can be used to accelerate for training, or uses cloud service.
S0.5 verifies weight model: after training, the weight model obtained with validation data set detection verifying, if full If foot requirement (it is required that can reach a certain degree for convergent), then this weight model is qualified, can be applicable to actual scene In;If being unsatisfactory for requiring, such as not converged or over-fitting, then there are two types of methods, and one is the ginsengs of percentage regulation neural network It counts (such as adjustment learning rate learning rate and batch size batches of sizes), the deep neural network pair after adjusting parameter Training dataset is trained work and obtains weight model, i.e., executes S0.4 with the deep neural network after adjusting parameter, then hold Row S0.5.Another kind is that flight instruments shoot more pictures again and add in pictures, executes S0.2 with the pictures after supplementing It to S0.5, i.e., is labeled and strengthens as " pictures " in S0.2 using the pictures after supplementing, such as first progress S0.1 When shoot 1000 pictures as pictures, be unsatisfactory for requiring after S0.5 verifying, 200 pictures can be shot again, by 200 Picture and 1000 pictures are put together, this 1200 picture is the pictures after supplement, carry out S0.2 with 1200 pictures. The weight model met the requirements that S0.5 is obtained is applied in unmanned plane real-time monitoring, is pest and disease damage obtained in present embodiment Weight model.
Two, unmanned plane real-time monitoring process as shown in Fig. 2, are as follows:
Unmanned plane is standby on airplane parking area.It needs to ensure that unmanned plane electricity is sufficient before the taking off of unmanned plane real-time monitoring.
S1: it is loaded into weight model (i.e. the weight model met the requirements obtained in S0.5) on embeded processor, such as It is loaded into the weight model of pest and disease damage." the embeded processor loading weight model " of corresponding diagram 2.
S2: controller sends instruction control unmanned plane and takes off, flight to target area --- and it is to be measured whether to have pest and disease damage Region." unmanned plane during flying to target area " of corresponding diagram 2.
S3: controller starts embeded processor." the starting embeded processor " of corresponding diagram 2.
S4: unmanned plane arrives at target area, and controller transmission shooting instruction controls unmanned plane to unmanned plane and starts to shoot, Unmanned plane receives and starts the photo in photographic subjects region." the unmanned plane shooting " of corresponding diagram 2.
S5: the photo of shooting is sent to embeded processor by unmanned plane, and embeded processor receives what unmanned plane was sent Photo." the embeded processor reception photo " of corresponding diagram 2.
S6: the weight model that embeded processor is loaded by it calculates received photo, obtains calculated result, according to meter It calculates result to judge whether to reach setting value again, according to whether reaching known to setting value whether there is pest and disease damage.Corresponding diagram 2 it is " embedding Enter formula processor and calculate judgement ".
If calculated result reaches setting value, i.e. judgement finds that specific object or scene are such as found to have the jade of red stain Meter Ye, then embeded processor sends alarm signal to controller rapidly, carries out S7.
If calculated result does not reach setting value, returns to S4 (such as Fig. 2) or controller control unmanned plane flies away from the target (this kind of situation is not embodied in Fig. 2) in region.
S7: controller receive alarm signal and control unmanned plane the target area orbit with from multi-angled shooting mesh Object or target scene are marked, and photo is returned into controller in real time, controller receives the photo that unmanned plane is sent.Corresponding diagram 2 " unmanned plane spiral shooting ".
S8: unmanned plane waits controller to send and instructs in next step.Such as controller control unmanned plane makes a return voyage or flies under One target area controls unmanned plane and flies away from the target area, terminates the detection of the target area.
Such as occur the maize leaves with red stain in a certain photograph frame, then passing through embeded processor weight model Calculated result is calculated, judges further according to calculated result, judging result is to reach setting value, and embeded processor sends alarm Signal is to controller, if it is judged that without specific object or scene, then continuing to shine not reach setting value The processes such as piece, calculating and judgement or the detection for terminating the region.If it is judged that can be to pass through not reach setting value The regular hour is set, the still not sent alarm signal of embeded processor, controller do not receive alarm signal after a certain period of time, Then terminate the detection in the region;The number for the photo that can be received and judge for setting embeded processor, embeded processor The case where judging result is reaches setting value is still not present when receiving and processing the photo for reaching and setting number or controller does not have still Alarm signal is received, then terminates the detection in the region;It may be staff's real-time control.
The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.

Claims (8)

1. a kind of unmanned plane automatic tour inspection system, including unmanned plane, which is characterized in that further include controller and setting in unmanned plane On embeded processor, the unmanned plane is for shooting photo and the photo of shooting is sent to embeded processor and control Device, the embeded processor are used to receive the photo of unmanned plane transmission, calculate photo using the weight model being loaded into thereon It obtains calculated result, judge whether calculated result reaches setting value and obtain judging result, send alarm signal according to judging result To controller, the controller is for controlling unmanned plane during flying, the shooting of control unmanned plane, control unmanned plane transmission photo, starting Embeded processor receives alarm signal and receive the photo that unmanned plane is sent that embeded processor is sent.
2. a kind of unmanned plane automatic tour inspection system as described in claim 1, which is characterized in that further include for parking unmanned plane Airplane parking area.
3. a kind of unmanned plane automatic tour inspection system as claimed in claim 2, which is characterized in that the airplane parking area is equipped with and is used for The charging unit of unmanned plane charging and the more changing device that battery is replaced for unmanned plane.
4. based on a kind of method for inspecting of unmanned plane automatic tour inspection system described in any one of claims 1 to 3, feature It is, includes the following steps:
S1, embeded processor are loaded into weight model;
S2, controller control unmanned plane during flying to target area;
S3, controller start embeded processor;
S4, controller control unmanned plane shooting;
The photo of shooting is sent to embeded processor by S5, unmanned plane, and embeded processor receives the photo that unmanned plane is sent;
S6, embeded processor calculate the received photo of institute using weight model and obtain calculated result, and judge that calculated result is It is no to reach setting value, if it is, embeded processor sends alarm signal to controller, S7 is carried out, S4 or control are otherwise returned Device control unmanned plane flies away from the target area;
S7, controller receive alarm signal and simultaneously control unmanned plane in target area orbit and shooting, and unmanned plane is by shooting Photo is sent to controller, and controller receives the photo that unmanned plane is sent.
5. a kind of method for inspecting of unmanned plane automatic tour inspection system as claimed in claim 4, which is characterized in that after progress S7 Further include the steps that controller control unmanned plane flies away from the target area.
6. a kind of method for inspecting of unmanned plane automatic tour inspection system as claimed in claim 5, which is characterized in that after progress S7 The step of specially controller control unmanned plane make a return voyage or fly to next target area, terminate the detection of the target area.
7. a kind of method for inspecting of unmanned plane automatic tour inspection system as claimed in claim 4, which is characterized in that carry out the S1 Before further include following steps:
Pictures under S0.1, acquisition reference zone multi-angle, more times, more weather conditions;
S0.2, artificial mark pictures and reinforcing pictures, obtain data set;
S0.3, a part of data set is extracted as validation data set;
S0.4, the training for carrying out deep neural network to the data set of rest part obtain weight model;
S0.5, whether met the requirements using validation data set verifying weight model, if it is, carrying out S1, otherwise, carry out S0.6;
The parameter of S0.6, percentage regulation neural network execute S0.4 to S0.5 with the deep neural network after adjusting parameter,
Or obtain the picture of reference zone again and add in pictures, S0.2 to S0.5 is executed with the pictures after supplementing.
8. a kind of method for inspecting of unmanned plane automatic tour inspection system as claimed in claim 7, which is characterized in that described in S0.1 Picture and pictures, which are shot by flight instruments, to be obtained.
CN201810700905.8A 2018-06-29 2018-06-29 A kind of unmanned plane automatic tour inspection system and method Pending CN108989745A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810700905.8A CN108989745A (en) 2018-06-29 2018-06-29 A kind of unmanned plane automatic tour inspection system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810700905.8A CN108989745A (en) 2018-06-29 2018-06-29 A kind of unmanned plane automatic tour inspection system and method

Publications (1)

Publication Number Publication Date
CN108989745A true CN108989745A (en) 2018-12-11

Family

ID=64539631

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810700905.8A Pending CN108989745A (en) 2018-06-29 2018-06-29 A kind of unmanned plane automatic tour inspection system and method

Country Status (1)

Country Link
CN (1) CN108989745A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112395905A (en) * 2019-08-12 2021-02-23 北京林业大学 Forest pest and disease real-time detection method, system and model establishment method

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104881865A (en) * 2015-04-29 2015-09-02 北京林业大学 Forest disease and pest monitoring and early warning method and system based on unmanned plane image analysis
CN105528575A (en) * 2015-11-18 2016-04-27 首都师范大学 Sky detection algorithm based on context inference
CN105701513A (en) * 2016-01-14 2016-06-22 深圳市未来媒体技术研究院 Method of rapidly extracting area of interest of palm print
CN106778659A (en) * 2016-12-28 2017-05-31 深圳市捷顺科技实业股份有限公司 A kind of licence plate recognition method and device
CN107346434A (en) * 2017-05-03 2017-11-14 上海大学 A kind of plant pest detection method based on multiple features and SVMs
CN107346413A (en) * 2017-05-16 2017-11-14 北京建筑大学 Traffic sign recognition method and system in a kind of streetscape image
CN107563356A (en) * 2017-09-29 2018-01-09 西安因诺航空科技有限公司 A kind of unmanned plane inspection pipeline target analysis management method and system
CN107621626A (en) * 2017-10-09 2018-01-23 中国矿业大学(北京) Radar signal Railway Roadbed detection method based on depth convolutional neural networks
CN107885229A (en) * 2017-12-15 2018-04-06 上海达实联欣科技发展有限公司 A kind of unmanned plane and its electric power line inspection method of achievable power line automatic detecting

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104881865A (en) * 2015-04-29 2015-09-02 北京林业大学 Forest disease and pest monitoring and early warning method and system based on unmanned plane image analysis
CN105528575A (en) * 2015-11-18 2016-04-27 首都师范大学 Sky detection algorithm based on context inference
CN105701513A (en) * 2016-01-14 2016-06-22 深圳市未来媒体技术研究院 Method of rapidly extracting area of interest of palm print
CN106778659A (en) * 2016-12-28 2017-05-31 深圳市捷顺科技实业股份有限公司 A kind of licence plate recognition method and device
CN107346434A (en) * 2017-05-03 2017-11-14 上海大学 A kind of plant pest detection method based on multiple features and SVMs
CN107346413A (en) * 2017-05-16 2017-11-14 北京建筑大学 Traffic sign recognition method and system in a kind of streetscape image
CN107563356A (en) * 2017-09-29 2018-01-09 西安因诺航空科技有限公司 A kind of unmanned plane inspection pipeline target analysis management method and system
CN107621626A (en) * 2017-10-09 2018-01-23 中国矿业大学(北京) Radar signal Railway Roadbed detection method based on depth convolutional neural networks
CN107885229A (en) * 2017-12-15 2018-04-06 上海达实联欣科技发展有限公司 A kind of unmanned plane and its electric power line inspection method of achievable power line automatic detecting

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
姜新猛: "基于TensorFlow的卷积神经网络的应用研究", 《中国优秀硕士学位论文全文数据库信息科技辑》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112395905A (en) * 2019-08-12 2021-02-23 北京林业大学 Forest pest and disease real-time detection method, system and model establishment method

Similar Documents

Publication Publication Date Title
US11745876B2 (en) Method for adaptive mission execution on an unmanned aerial vehicle
US20190023418A1 (en) Device and method for managing drone
CN106054903B (en) A kind of adaptive landing method of multi-rotor unmanned aerial vehicle and system
CN105511495B (en) Power circuit UAV Intelligent inspection control method and system
CN106443387B (en) A kind of method, apparatus and system controlling crusing robot Partial Discharge Detection
CN109502039A (en) A kind of vehicle-mounted unmanned aerial vehicle stops cabinet equipment, automatic replacement battery methods and system
CN106231191A (en) Full-automatic aerial panoramic view data acquisition system, method and control terminal
CN108537912A (en) A kind of power patrol unmanned machine based on intelligent image identification
CN108510750A (en) A method of the unmanned plane inspection parking offense based on neural network model
CN109630905A (en) A kind of full intelligent inspection system of oil-gas pipeline based on unmanned aerial vehicle remote sensing and deep learning
CN106292126B (en) A kind of intelligence aerial survey flight exposal control method, unmanned aerial vehicle (UAV) control method and terminal
KR20160116531A (en) Drone control system and method for drone control
CN112326686A (en) Unmanned aerial vehicle intelligent cruise pavement disease detection method, unmanned aerial vehicle and detection system
CN105812746A (en) Target detection method and system
CN112506214B (en) Operation flow of unmanned aerial vehicle autonomous fan inspection system
CN109164827B (en) Data acquisition system based on unmanned aerial vehicle
CN106910031A (en) A kind of take-away delivery system based on unmanned plane
CN106094872A (en) A kind of sewage based on unmanned plane secretly arranges mouthful detection method and system
CN105962908A (en) Flying body temperature detector control method and device
CN108989745A (en) A kind of unmanned plane automatic tour inspection system and method
CN112947519A (en) Unmanned aerial vehicle inspection method and device and edge calculation module
CN206629757U (en) Aquatic products cultivates unmanned plane automatically
CN108275275A (en) Unmanned plane throwing mechanism, unmanned plane and the delivering method based on unmanned plane
WO2022247597A1 (en) Papi flight inspection method and system based on unmanned aerial vehicle
CN108765841A (en) A kind of forest fire protection inspection system and visiting method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181211

RJ01 Rejection of invention patent application after publication