CN116363412A - Method and system for constructing classification model of flying bird and unmanned aerial vehicle based on centroid movement characteristics - Google Patents

Method and system for constructing classification model of flying bird and unmanned aerial vehicle based on centroid movement characteristics Download PDF

Info

Publication number
CN116363412A
CN116363412A CN202310121385.6A CN202310121385A CN116363412A CN 116363412 A CN116363412 A CN 116363412A CN 202310121385 A CN202310121385 A CN 202310121385A CN 116363412 A CN116363412 A CN 116363412A
Authority
CN
China
Prior art keywords
trajectory
classification model
classifier
unmanned aerial
flying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310121385.6A
Other languages
Chinese (zh)
Inventor
张弢
韩艺斐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Psychology of CAS
Original Assignee
Institute of Psychology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Psychology of CAS filed Critical Institute of Psychology of CAS
Priority to CN202310121385.6A priority Critical patent/CN116363412A/en
Publication of CN116363412A publication Critical patent/CN116363412A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • G06V20/47Detecting features for summarising video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a method and a system for constructing a classification model of a flying bird and an unmanned aerial vehicle based on centroid movement characteristics, and video data of flying of the flying bird and the unmanned aerial vehicle are shot; preprocessing video data, and then cutting the preprocessed video data into a plurality of tracks with fixed duration to form a video data set; marking a centroid movement track by adopting a computer vision algorithm, and performing wavelet denoising pretreatment; calculating the speed and acceleration value motion characteristics of the track fragments in the centroid motion track, and extracting the maximum fluctuation amplitude of the track fragments in different frequency intervals; respectively establishing a speed classifier, an acceleration classifier and a track fluctuation classifier aiming at the speed, acceleration and track fluctuation characteristics of the flying bird and the unmanned aerial vehicle by adopting machine learning; weighting and integrating the prediction results of the three classifiers, obtaining the optimal weight in a five-fold cross validation mode, and establishing a classification model of the flying bird and the unmanned aerial vehicle; the classification model of the flying bird and the unmanned aerial vehicle provided by the invention has the advantages of high speed and high accuracy, does not need manual judgment, and liberates labor cost.

Description

一种基于质心运动特征的飞鸟和无人机分类模型构建方法及 系统A method for constructing a classification model of flying birds and UAVs based on the motion characteristics of the center of mass and its system

技术领域technical field

本发明涉及目标分类技术领域,具体涉及一种基于质心运动特征的飞鸟和无人机分类模型构建方法及系统,建立实时目标分类器。The invention relates to the technical field of object classification, in particular to a method and system for constructing a classification model of flying birds and drones based on the motion characteristics of the center of mass, and establishes a real-time object classifier.

背景技术Background technique

飞鸟和无人机都是典型的“低小慢”飞行器,即飞行高度低于1000米,飞行速度慢于200公里/小时,雷达反射面积小于2平方米的航空器具。它们是威胁低空空域安全的主要因素。飞鸟撞上飞机会损坏航空器结构,严重会机毁人亡。鸟击事故是飞机运营的主要事故征候因素。此外,随着无人机技术的发展,无人机也逐渐成为一种新型威胁。由于它体积小、易携带和易操作等特点,它很容易被用于违规地面测绘和干扰民航正常飞行等违法活动中。对于飞鸟和无人机的不同威胁,需要采取不同措施,而采取恰当措施的前提是正确识别和分类飞行目标。在距离较远时,飞鸟和无人机体积小,外形特征相似,因此准确区分二者较为困难。Flying birds and UAVs are typical "low, small and slow" aircraft, that is, aerial vehicles with a flying altitude of less than 1,000 meters, a flying speed of less than 200 km/h, and a radar reflection area of less than 2 square meters. They are the main factors threatening the safety of low-altitude airspace. Flying birds will damage the structure of the aircraft when they collide with the aircraft, and it will seriously cause the aircraft to crash and kill people. Bird strike accidents are a major incident factor in aircraft operations. In addition, with the development of drone technology, drones are gradually becoming a new type of threat. Due to its small size, easy to carry and easy to operate, it is easy to be used in illegal activities such as illegal ground surveying and interference with normal civil aviation flights. Different threats to birds and UAVs require different measures, and the prerequisite for taking appropriate measures is to correctly identify and classify flying objects. When the distance is long, birds and UAVs are small in size and have similar appearance characteristics, so it is difficult to distinguish them accurately.

从2017年开始,由欧盟“地平线2020”计划资助的安全海岸线(SafeShore)项目启动了飞鸟、无人机探测挑战赛,这项比赛每隔两年举办一次,至今已经举办了三次。在这项比赛中,大部分算法主要是基于静态图像信息,即基于飞鸟和无人机的外形特征差异,建立卷积神经网络模型。但这些算法识别远距离小目标的效果较差,在目标图像尺寸小于32像素时,假阳性率和漏报率都比较高。Since 2017, the SafeShore project funded by the European Union's "Horizon 2020" program has launched a bird and drone detection challenge. This competition is held every two years and has been held three times so far. In this competition, most of the algorithms are mainly based on static image information, that is, based on the differences in the appearance characteristics of flying birds and drones, to establish a convolutional neural network model. However, these algorithms are less effective in identifying long-distance small targets. When the target image size is less than 32 pixels, the false positive rate and false negative rate are relatively high.

一些研究者提出基于飞行目标的运动信息做分类。相比于图像信息,运动信息的优点是:对距离的鲁棒性高,不受物体形变、环境亮度和背景干扰物的影响。Srigrarom等计算每段轨迹的5个运动特征,包括速度均值、加速度均值、转弯角度、周期性和曲率半径,并用主成分分析法降维,根据前两个主要特征建立支持向量机,准确率大于80%,但这种算法的缺点:它是基于运动信息的统计指标建立的,而统计量只能反映部分信息,易受到轨迹片段长度的影响,不能用于实时分类任务。Some researchers propose to classify objects based on their motion information. Compared with image information, the advantage of motion information is that it is highly robust to distance and is not affected by object deformation, ambient brightness, and background distractors. Srigrarom et al. calculated five motion features of each trajectory, including average velocity, average acceleration, turning angle, periodicity, and radius of curvature, and used principal component analysis to reduce dimensionality. A support vector machine was established based on the first two main features, and the accuracy rate was greater than 80%, but the disadvantage of this algorithm is that it is established based on the statistical indicators of motion information, and the statistics can only reflect part of the information, which is easily affected by the length of the trajectory segment and cannot be used for real-time classification tasks.

发明内容Contents of the invention

为解决上述所存在的技术问题,本发明提供了一种基于质心运动特征的飞鸟和无人机分类模型构建方法及系统,其基于飞鸟和无人机的质心运动特征差异,并借鉴人类视觉系统分类运动目标时采用的策略,建立实时飞行目标分类器。In order to solve the above-mentioned existing technical problems, the present invention provides a method and system for constructing a classification model of flying birds and UAVs based on the motion characteristics of the center of mass. The strategy adopted when classifying moving targets, establishes a real-time flying target classifier.

本发明采用如下技术方案:The present invention adopts following technical scheme:

一方面,本发明提供了一种基于质心运动特征的飞鸟和无人机分类模型构建方法,其特征在于,其构建方法包括如下步骤:On the one hand, the present invention provides a kind of method for building a classification model of flying birds and unmanned aerial vehicles based on the motion characteristics of the center of mass, which is characterized in that the building method includes the following steps:

步骤1,拍摄飞鸟飞行,同时操控无人机模拟飞鸟的运动轨迹飞行,分别得到飞鸟和无人机飞行的视频资料;Step 1, shoot the flying birds, and at the same time control the UAV to simulate the flight trajectory of the flying birds, and obtain the video data of the flying birds and the UAV flight respectively;

步骤2,对视频资料进行预处理,并剪切为若干段固定时长的轨迹,形成视频数据集;Step 2, preprocessing the video data and cutting it into a number of tracks with a fixed duration to form a video data set;

步骤3,采用计算机视觉算法标注出视频数据集中每一帧飞行目标的质心位置,形成质心运动轨迹,并做小波去噪预处理;Step 3, use computer vision algorithm to mark the position of the center of mass of the flying target in each frame of the video data set, form the trajectory of the center of mass, and perform wavelet denoising preprocessing;

步骤4,将每段轨迹无重叠地划分为若干段固定时长的轨迹片段,计算轨迹片段的速度、加速度和轨迹波动运动特征,得到所有速度数值和加速度数值,并提取轨迹片段在不同频率区间的最大波动幅度;Step 4. Divide each trajectory segment into several fixed-duration trajectory segments without overlap, calculate the velocity, acceleration and trajectory fluctuation motion characteristics of the trajectory segment, obtain all velocity values and acceleration values, and extract the trajectory segment in different frequency intervals. Maximum volatility;

步骤5,采用机器学习针对飞鸟和无人机的速度、加速度和轨迹波动特征分别建立速度分类器、加速度分类器和轨迹波动分类器;Step 5, using machine learning to establish speed classifiers, acceleration classifiers and trajectory fluctuation classifiers for the speed, acceleration and trajectory fluctuation characteristics of birds and drones;

步骤6,利用加权整合方法将步骤5中所得三种分类器的预测结果加权整合,采用交叉验证法得到最佳权重,建立运动轨迹分类模型,并对测试集中的飞鸟和/或无人机视频数据集进行识别。Step 6, use the weighted integration method to weight the prediction results of the three classifiers obtained in step 5, use the cross-validation method to obtain the optimal weight, establish a motion trajectory classification model, and test the birds and/or UAV videos in the test set The data set is identified.

进一步地,所述方法还包括步骤7,运动轨迹分类模型对轨迹中的轨迹片段进行计算,得到轨迹片段的类别概率;采用基于人类大脑的工作记忆机制和决策机制的稳定性评估模块对轨迹片段的类别概率进行稳定性评估后输出分类结果。Further, the method also includes step 7, the motion trajectory classification model calculates the trajectory fragments in the trajectory to obtain the category probability of the trajectory fragments; adopts the stability evaluation module based on the working memory mechanism and decision-making mechanism of the human brain to analyze the trajectory fragments The classification results are output after the stability evaluation of the category probability.

进一步地,所述步骤7中,将轨迹片段中的运动特征输入步骤6构建好的运动轨迹分类模型中进行计算,得到轨迹片段的类别概率;运动轨迹分类模型持续向稳定性评估模块输入类别概率信息;当输入的同一类别概率,在连续10个中存在至少7个的类别概率大于0.8,并且速度分类器、加速度分类器及轨迹波动分类器的类别判断一致时,输出分类结果。Further, in the step 7, the motion features in the trajectory segment are input into the motion trajectory classification model built in step 6 for calculation to obtain the category probability of the trajectory segment; the motion trajectory classification model continues to input the category probability to the stability assessment module Information; when there are at least 7 class probabilities greater than 0.8 among 10 consecutive input probabilities of the same class, and the class judgments of the speed classifier, acceleration classifier and trajectory fluctuation classifier are consistent, the classification result is output.

优选地,构建好的运动轨迹分类模型对包含24帧时长200ms的轨迹片段进行类别概率计算。Preferably, the constructed motion trajectory classification model performs category probability calculation on trajectory segments containing 24 frames with a duration of 200 ms.

优选地,所述步骤2中,在对原始视频资料进行预处理时,除去原始视频资料中飞鸟和无人机起飞、降落和悬停时的运动特征,形成每段至少2秒钟的轨迹。Preferably, in step 2, when the original video data is preprocessed, the motion features of flying birds and drones in the original video data during take-off, landing and hovering are removed to form trajectories of at least 2 seconds each.

优选地,所述步骤3中,采用ECO目标跟踪算法对采集到的鸽子视频数据集中的每一帧飞行目标的质心位置做出标注,采用DIMP目标跟踪算法对采集到的黄玉鸟、珍珠鸟及无人机视频数据集中的每一帧飞行目标的质心位置做出标注。Preferably, in the step 3, the ECO target tracking algorithm is used to mark the centroid position of each frame of the flying target in the collected pigeon video data set, and the DIMP target tracking algorithm is used to collect the topaz bird, pearl bird and The position of the center of mass of each frame of the flying target in the UAV video dataset is marked.

优选地,所述步骤4中将每段轨迹无重叠地划分为若干段时长为200ms的轨迹片段,计算轨迹片段中的轨迹波动运动特征的方法是:对步骤3中的质心运动轨迹做移动均值平滑处理后获得平滑轨迹;用质心运动轨迹的水平坐标和垂直坐标分别减去平滑轨迹的水平坐标和垂直坐标,得到水平和竖直方向的轨迹波动;采用快速傅里叶变换对轨迹波动做频谱分析,分别得到在频率区间0~10Hz,10~20Hz和20~30Hz内的最大波动幅度。Preferably, in the step 4, each segment of the track is divided into several track segments with a duration of 200 ms without overlapping, and the method for calculating the trajectory fluctuation motion characteristics in the track segment is: do a moving average on the centroid motion track in step 3 After smoothing, the smooth trajectory is obtained; the horizontal and vertical coordinates of the smooth trajectory are subtracted from the horizontal and vertical coordinates of the centroid motion trajectory, respectively, to obtain the trajectory fluctuations in the horizontal and vertical directions; the spectrum of the trajectory fluctuations is obtained by fast Fourier transform Analysis, respectively, in the frequency range 0 ~ 10Hz, 10 ~ 20Hz and 20 ~ 30Hz in the maximum fluctuation range.

优选地,所述步骤5中采用朴素贝叶斯算法分别建立速度分类器和加速度分类器,采用支持向量机算法建立轨迹波动分类器。Preferably, in the step 5, a velocity classifier and an acceleration classifier are respectively established using a naive Bayesian algorithm, and a trajectory fluctuation classifier is established using a support vector machine algorithm.

另一方面,本发明还提供了一种基于质心运动特征的飞鸟和无人机分类模型系统,所述系统包括:摄像机,用于拍摄飞鸟和无人机飞行的视频资料;On the other hand, the present invention also provides a kind of bird and unmanned aerial vehicle classification model system based on the motion characteristic of center of mass, and described system comprises: camera, is used for taking the video data of flying bird and unmanned aerial vehicle;

预处理模块,用于对视频资料进行预处理,并剪切为若干段固定时长的轨迹,形成视频数据集;The preprocessing module is used to preprocess the video data and cut it into several fixed-time tracks to form a video data set;

视觉算法标注模块,用于对预处理后的飞鸟和无人机轨迹中的每一帧飞行目标质心位置进行标注,形成飞行目标的质心运动轨迹;The visual algorithm labeling module is used to label the position of the center of mass of the flight target in each frame of the preprocessed bird and UAV trajectory to form the center of mass movement track of the flight target;

小波去噪模块,用于对质心运动轨迹进行小波去噪预处理,去除质心运动轨迹中的高频噪声和标注错误;The wavelet denoising module is used to perform wavelet denoising preprocessing on the centroid trajectory to remove high-frequency noise and labeling errors in the centroid trajectory;

数据处理模块,其将每段轨迹无重叠地划分为若干段固定时长的轨迹片段,计算每段轨迹中轨迹片段的速度、加速度和轨迹波动运动特征,得到所有速度数值和加速度数值,并提取轨迹片段在不同频率区间的最大波动幅度;A data processing module, which divides each trajectory into several fixed duration trajectory segments without overlap, calculates the velocity, acceleration and trajectory fluctuation motion characteristics of the trajectory segments in each trajectory, obtains all velocity values and acceleration values, and extracts the trajectory The maximum fluctuation amplitude of the segment in different frequency intervals;

分类器构建模块,提取所述数据处理模块中的速度数值、加速度数值及轨迹波动幅值,采用机器学习分别构建速度分类器、加速度分类器和轨迹波动分类器;The classifier construction module extracts the velocity value, the acceleration value and the trajectory fluctuation amplitude in the data processing module, and adopts machine learning to construct a velocity classifier, an acceleration classifier and a trajectory fluctuation classifier respectively;

分类模型构建模块,利用加权整合方法将所得到的速度分类器、加速度分类器和轨迹波动分类器的预测结果加权整合,采用交叉验证法得到最佳权重,获得运动轨迹分类模型。The classification model construction module uses the weighted integration method to integrate the obtained prediction results of the speed classifier, acceleration classifier and trajectory fluctuation classifier, and uses the cross-validation method to obtain the optimal weight to obtain the motion trajectory classification model.

进一步地,所述系统还包括稳定度评估模块,所述运动轨迹分类模型对每段轨迹中的轨迹片段进行类别概率计算,经所述稳定度评估模块进行概率评估后,输出分类结果。Further, the system also includes a stability evaluation module, the motion trajectory classification model calculates the category probability of the trajectory segments in each trajectory, and outputs the classification result after the probability evaluation is performed by the stability evaluation module.

本发明技术方案具有如下优点:The technical solution of the present invention has the following advantages:

A.本发明所提供的飞鸟和无人机分类模型,其速度快,准确率高。本发明依据视觉系统,基于短时程轨迹片段建立运动轨迹分类模型,可以实现自动化和实时判断运动目标的类别,无需人工判断,解放人力成本;所建立的运动轨迹分类模型对飞鸟和无人机的运动轨迹分类准确率高,达到90%以上,且框架简单,可以迁移到其他基于运动特征分类目标的任务上。A. The flying bird and unmanned aerial vehicle classification model provided by the present invention, its speed is fast, and accuracy rate is high. Based on the vision system, the present invention establishes a motion trajectory classification model based on short-term trajectory segments, which can realize automatic and real-time judgment of the category of moving objects, without manual judgment, and liberates labor costs; The classification accuracy of motion trajectory is high, reaching more than 90%, and the framework is simple, which can be transferred to other tasks of classifying objects based on motion features.

B.本发明训练所需的样本量较少。现有飞行目标的图像特征受到目标类别、观察视角、变形和遮挡等因素的影响,种类繁多,根据图像特征建立分类器需要大量样本的训练。而运动特征受限于飞行动力学,飞鸟和无人机的运动特征存在本质差异,且这种差异不受飞鸟类别和无人机型号的影响,因此,本发明采用小样本训练就可以得到稳定的结果,可适用于对不同类型飞鸟和无人机的识别。B. The amount of samples required for the training of the present invention is relatively small. The image features of existing flying targets are affected by factors such as target category, viewing angle, deformation and occlusion, and there are many types. Establishing a classifier based on image features requires a large number of samples for training. However, the motion characteristics are limited by flight dynamics. There are essential differences in the motion characteristics of flying birds and drones, and this difference is not affected by the type of flying birds and the model of the drone. Therefore, the present invention can obtain Stable results, applicable to the identification of different types of birds and drones.

附图说明Description of drawings

为了更清楚地说明本发明具体实施方式,下面将对具体实施方式中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施方式,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the specific implementation of the present invention more clearly, the accompanying drawings used in the specific implementation will be briefly introduced below. Obviously, the accompanying drawings in the following description are some implementations of the present invention, which are common to those skilled in the art. As far as the skilled person is concerned, other drawings can also be obtained based on these drawings on the premise of not paying creative work.

图1为本发明所提供的运动轨迹分类模型构建方法流程图I;Fig. 1 is the flow chart I of the construction method of motion trajectory classification model provided by the present invention;

图2为本发明所提供的运动轨迹分类模型构建方法流程图II;Fig. 2 is flow chart II of the construction method of motion trajectory classification model provided by the present invention;

图3为本发明所提供的运动轨迹分类模型应用流程图;Fig. 3 is the application flow diagram of motion trajectory classification model provided by the present invention;

图4为本发明所提供的飞行轨迹示例图;Fig. 4 is an example diagram of the flight trajectory provided by the present invention;

图5为本发明所提供的飞鸟和无人机分类器流程图;Fig. 5 is the flow chart of bird and unmanned aerial vehicle classifier provided by the present invention;

图6为本发明所提供的运动轨迹分类模型构建系统组成图;Fig. 6 is a composition diagram of the construction system of the motion track classification model provided by the present invention;

图7是本发明提供的飞鸟测试轨迹分类示例-珍珠鸟;Fig. 7 is the flying bird test track classification example-pearl bird provided by the present invention;

图8是本发明提供的无人机测试轨迹分类示例-Tello。Fig. 8 is an example of UAV test track classification provided by the present invention - Tello.

具体实施方式Detailed ways

下面将结合附图对本发明的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts fall within the protection scope of the present invention.

如图1、图3和图5所示,本发明提供了一种基于质心运动特征的飞鸟和无人机分类模型构建方法,所采用的方法如下:As shown in Fig. 1, Fig. 3 and Fig. 5, the present invention provides a kind of flying bird and UAV classification model construction method based on centroid motion feature, and the method adopted is as follows:

【S01】采用摄像机拍摄飞鸟飞行,同时操控无人机模拟飞鸟的运动轨迹飞行,分别得到飞鸟和无人机飞行的视频资料。【S01】The camera is used to shoot the flying birds, and at the same time, the UAV is controlled to simulate the flight trajectory of the flying birds, and the video data of the flying birds and the UAV flight are respectively obtained.

为了提高模型的适用范围,本发明分别选取了3种体型的飞鸟和无人机,飞鸟从小到大依次是珍珠鸟、黄玉鸟和鸽子;无人机从小到大依次是特洛(Tello),大疆御Pro(MavicPro)和大疆精灵4(Phantom4)。在室内采集3类飞鸟的飞行视频资料,视频时长最短为2秒钟,然后选择无风晴朗的一天,在户外的空旷停车场,请经验丰富的飞手操控3类无人机模拟飞鸟的运动轨迹飞行,得到无人机的飞行视频资料。In order to improve the scope of application of the model, the present invention selects 3 types of flying birds and unmanned aerial vehicles respectively. The flying birds are pearl birds, topaz birds and pigeons from small to large; the unmanned aerial vehicles are Tello (Tello) from small to large. DJI Royal Pro (MavicPro) and DJI Phantom 4 (Phantom4). Collect flight video data of 3 types of flying birds indoors. The shortest video duration is 2 seconds. Then choose a calm and sunny day. In an open parking lot outdoors, please experienced pilots control 3 types of drones to simulate the movement of flying birds. Trajectory flight, get the flight video data of the UAV.

【S02】将所拍摄到的原始视频资料进行预处理,并剪切为若干段固定时长的轨迹,所有轨迹形成视频数据集。[S02] Preprocess the captured raw video data and cut it into several fixed-length trajectories, and all trajectories form a video data set.

这里的预处理包括了用视频软件将所有拍摄到的视频资料剪辑为2秒钟,并在预处理时,去除飞鸟和无人机的典型运动特征,如起飞、降落和悬停等,比如每类飞行物体包含30段、每段2秒钟的飞行视频数据组成视频数据集,对于飞行视频数据集的时长及段数这里不作具体限定。The preprocessing here includes using video software to cut all the captured video materials into 2 seconds, and during preprocessing, remove the typical movement characteristics of flying birds and drones, such as take-off, landing and hovering, etc., such as every The flight-like object consists of 30 segments of flight video data of 2 seconds each to form a video data set. There is no specific limitation on the duration and number of segments of the flight video data set.

【S03】采用计算机视觉算法标注出视频数据集中每一帧飞行目标的质心位置,形成质心运动轨迹,并做小波去噪预处理。[S03] Use computer vision algorithm to mark the position of the center of mass of the flying target in each frame of the video data set, form the trajectory of the center of mass, and perform wavelet denoising preprocessing.

采用计算机视觉算法(包括ECO和DIMP)标注出视频数据集中每一帧飞行目标的质心位置,具体方法是:在飞行目标周围画一个边界框,将边界框的中心定义为质心,如图4所示。视频中每一帧质心目标的位置构成了质心的运动轨迹。在全部标注完成后,人工检测视频标注的准确度。其中采用ECO目标跟踪算法在标注鸽子时的准确率较高,采用DIMP目标跟踪算法在标注其他5类飞行目标(黄玉鸟、珍珠鸟、Tello、Mavic Pro和Phantom4)时的准确率较高。Computer vision algorithms (including ECO and DIMP) are used to mark the centroid position of each frame of the flying target in the video data set. The specific method is: draw a bounding box around the flying target, and define the center of the bounding box as the centroid, as shown in Figure 4 Show. The position of the centroid object in each frame of the video constitutes the motion trajectory of the centroid. After all annotations are completed, the accuracy of video annotations is manually checked. Among them, the ECO target tracking algorithm has a higher accuracy rate when marking pigeons, and the DIMP target tracking algorithm has a higher accuracy rate when marking other five types of flying targets (Topaz Bird, Pearl Bird, Tello, Mavic Pro and Phantom4).

然后对标注后形成的质心运动轨迹做小波去噪预处理,去除轨迹中的高频噪声和可能的标注错误。Then wavelet denoising preprocessing is performed on the center of mass trajectory formed after labeling to remove high-frequency noise and possible labeling errors in the trajectory.

本发明中所用无人机均为四旋翼无人机,螺旋翼的高频转动会造成轨迹中的高频波动,此外抖动(随机噪声)和标注错误也会造成轨迹中的异常波动。为了去除这些噪声,获得相对准确的质心位置,需要对原始轨迹数据进行预处理,本发明中采用小波去噪的方法对原始信号进行降噪处理。小波去噪方法,在去除高频噪声的同时能保留信号特征。The UAVs used in the present invention are all four-rotor UAVs. The high-frequency rotation of the helical wings will cause high-frequency fluctuations in the trajectory. In addition, jitter (random noise) and labeling errors will also cause abnormal fluctuations in the trajectory. In order to remove these noises and obtain a relatively accurate centroid position, it is necessary to preprocess the original trajectory data. In the present invention, the wavelet denoising method is used to denoise the original signal. The wavelet denoising method can preserve signal features while removing high-frequency noise.

【S04】本发明将视频数据集按4:1的比例分为训练集和测试集。将训练集中2秒钟的轨迹无重叠的切分为短时程(200ms)轨迹片段。计算轨迹片段的3个运动特征,包括速度、加速度和轨迹波动运动特征,得到所有速度数值和加速度数值,并提取每段轨迹在不同频率区间的最大波动幅度。[S04] The present invention divides the video data set into a training set and a test set in a ratio of 4:1. The 2-second trajectories in the training set are segmented without overlap into short-term (200ms) trajectories. Calculate the three motion characteristics of the trajectory segment, including velocity, acceleration and trajectory fluctuation motion characteristics, obtain all velocity values and acceleration values, and extract the maximum fluctuation range of each trajectory in different frequency intervals.

这里的轨迹波动是指原始质心运动轨迹与平滑轨迹相比的上下波动。平滑轨迹是指对原始质心运动轨迹做移动均值平滑后获得的轨迹,平滑窗均为15。轨迹波动的计算方法分别用原始的质心运动轨迹的水平和垂直坐标减去平滑轨迹的水平和垂直坐标,得到水平和竖直方向的波动;然后用快速傅里叶变换对轨迹波动做频谱分析,取3个频率区间内的最大波动幅度,包括0-10Hz,10-20Hz和20-30Hz。The trajectory fluctuation here refers to the up and down fluctuation of the original centroid motion trajectory compared with the smooth trajectory. The smooth trajectory refers to the trajectory obtained by smoothing the moving average of the original centroid trajectory, and the smoothing window is 15. The calculation method of trajectory fluctuation subtracts the horizontal and vertical coordinates of the smooth trajectory from the horizontal and vertical coordinates of the original centroid trajectory respectively to obtain the fluctuations in the horizontal and vertical directions; Take the maximum fluctuation range in 3 frequency intervals, including 0-10Hz, 10-20Hz and 20-30Hz.

【S05】采用机器学习针对飞鸟和无人机的速度、加速度和轨迹波动特征分别建立速度分类器、加速度分类器和轨迹波动分类器。本发明优选采用机器学习中的朴素贝叶斯算法,根据【S04】中得到的所有速度和加速度及它们的对应类别,分别建立速度分类器和加速度分类器,采用机器学习中的支持向量机算法,根据【S04】中提取的轨迹波动幅度,建立轨迹波动分类器。[S05] Use machine learning to establish speed classifiers, acceleration classifiers, and trajectory fluctuation classifiers for the speed, acceleration, and trajectory fluctuation characteristics of birds and UAVs. The present invention preferably adopts the naive Bayesian algorithm in machine learning, and according to all velocities and accelerations obtained in [S04] and their corresponding categories, respectively establishes a speed classifier and an acceleration classifier, and adopts a support vector machine algorithm in machine learning , according to the trajectory fluctuation amplitude extracted in [S04], a trajectory fluctuation classifier is established.

【S06】根据步骤【S05】中所得的三种分类器,对任一200ms轨迹片段,速度分类器计算轨迹片段中每个速度值的类别概率,这些类别概率的均值为轨迹片段的速度类别概率;加速度分类器计算轨迹片段中每个加速度值的类别概率,这些类别概率的均值为加速度类别概率;轨迹波动分类器根据波幅特征,计算波动类别概率。利用加权整合方法将三种分类器的预测结果加权整合,采用交叉验证法得到最佳权重,建立运动轨迹分类模型,即建立了最终的目标分类器,并对测试集中的飞鸟和/或无人机视频数据集进行识别。[S06] According to the three classifiers obtained in step [S05], for any 200ms trajectory segment, the velocity classifier calculates the category probability of each velocity value in the trajectory segment, and the mean of these category probabilities is the velocity category probability of the trajectory segment ; The acceleration classifier calculates the category probability of each acceleration value in the trajectory segment, and the average of these category probabilities is the acceleration category probability; the trajectory fluctuation classifier calculates the volatility category probability according to the amplitude characteristics. The prediction results of the three classifiers are weighted and integrated using the weighted integration method, and the optimal weight is obtained by the cross-validation method. Machine video dataset for recognition.

本发明优选采用了五折交叉验证的方法计算最佳权重,具体方法是:将训练集平均分为5个子集,轮流将其中4个子集用于训练,另外1个子集用于验证。这个过程重复5次,每次都会计算出一个正确率,将5个正确率的平均值作为对权重对应正确率的估计,最优权重是正确率最高时对应的权重。The present invention preferably adopts a five-fold cross-validation method to calculate the optimal weight. The specific method is: divide the training set into 5 subsets on average, use 4 subsets for training in turn, and use the other subset for verification. This process is repeated 5 times, each time a correct rate is calculated, and the average of the five correct rates is used as an estimate of the correct rate corresponding to the weight. The optimal weight is the weight corresponding to the highest correct rate.

为了将所建立的运动轨迹分类模型应用于实时分类任务中,如图2所示,本发明在步骤【S07】中还模拟人的工作机制,构建了一个机器观察者,用它分类测试集中的轨迹。如图5中的机器观察者包括两个模块,第一个模块为所构建的运动轨迹分类模型(即飞鸟-无人机分类器),其模拟大脑中的特征检测网络,不断提取轨迹片段的运动特征,并给它们分配不同的权重。本发明中的运动轨迹分类模型计算固定时长的轨迹片段(200ms,共24帧)的类别概率,在测试集中应用时,是以实时输入轨迹数据的方式测试。当输入的轨迹长度小于200毫秒时,不分类;当输入轨迹长度达到200毫秒后,对这200毫秒的轨迹片段做判断,输出类别概率;每新输入一帧数据,就获取最新的200毫秒轨迹片段,输出新的类别概率。在实际分类任务中,仅仅计算出类别概率是不够的,还需要工作记忆和决策机制的帮助。因此,本发明模拟人脑的工作原理,还构建第二个模块,即稳定性评估模块。运动轨迹分类模型持续向稳定性评估模块输入更新的概率信息,当输入的同一类别概率,在连续10个中,其中至少7个大于0.8,并且此时三个分类器的类别判断一致,视为稳定、可靠的判断,输出最终的分类结果;如果三个分类器的类别判断不一致,则不输出分类结果。如果运动轨迹分类模型在轨迹终点都没有做出判断,即没有达到稳定,将正确率记为0.5,将反应时记为其他做出判断的轨迹的平均反应时。In order to apply the established motion trajectory classification model to real-time classification tasks, as shown in Figure 2, the present invention also simulates the human working mechanism in step [S07], constructs a machine observer, and uses it to classify the objects in the test set track. The machine observer as shown in Figure 5 includes two modules. The first module is the constructed motion trajectory classification model (i.e. bird-drone classifier), which simulates the feature detection network in the brain and continuously extracts the trajectory fragments. motion features and assign them different weights. The motion trajectory classification model in the present invention calculates the category probability of trajectory segments (200 ms, 24 frames in total) with a fixed duration, and is tested by inputting trajectory data in real time when applied in the test set. When the input trajectory length is less than 200 milliseconds, no classification is made; when the input trajectory length reaches 200 milliseconds, the 200 millisecond trajectory segment is judged and the category probability is output; every time a new frame of data is input, the latest 200 millisecond trajectory is obtained fragment, outputting new class probabilities. In actual classification tasks, it is not enough to just calculate the class probability, but also requires the help of working memory and decision-making mechanism. Therefore, the present invention simulates the working principle of the human brain, and also constructs a second module, that is, a stability evaluation module. The trajectory classification model continues to input updated probability information to the stability assessment module. When the input probability of the same category is among 10 consecutive ones, at least 7 of them are greater than 0.8, and the category judgments of the three classifiers are consistent at this time, it is regarded as Stable and reliable judgment, output the final classification result; if the category judgments of the three classifiers are inconsistent, the classification result will not be output. If the trajectory classification model does not make a judgment at the end of the trajectory, that is, it does not reach stability, the correct rate is recorded as 0.5, and the reaction time is recorded as the average response time of other trajectories that make judgments.

将测试集中的轨迹数据输入至【S06】中所建立的运动轨迹分类模型中,获得每段轨迹的预测类别;比较预测类别和真实类别的一致性,获得运动轨迹分类模型的分类准确率。Input the trajectory data in the test set into the motion trajectory classification model established in [S06] to obtain the predicted category of each trajectory; compare the consistency between the predicted category and the real category to obtain the classification accuracy of the trajectory classification model.

另一方面,如图6所示,本发明还提供了一种基于质心运动特征的飞鸟和无人机分类模型系统,包括摄像机及内置于计算机中的预处理模块、视觉算法标注模块、小波去噪模块、数据处理模块、分类器构建模块和分类模型构建模块。其中的摄像机用于拍摄飞鸟和无人机飞行的视频资料;预处理模块用于对视频资料进行预处理,并剪切为若干段固定时长的轨迹,形成含有若干个连续轨迹片段的视频数据集;视觉算法标注模块用于对预处理后的飞鸟和无人机轨迹片段中的每一帧飞行目标质心位置进行标注,形成飞行目标的质心运动轨迹;小波去噪模块用于质心运动轨迹进行小波去噪预处理,去除质心运动轨迹中的高频噪声和标注错误;数据处理模块将每段轨迹无重叠地划分为若干段固定时长的轨迹片段,计算每段轨迹中轨迹片段的速度、加速度和轨迹波动运动特征,得到所有速度数值和加速度数值,并提取轨迹片段在不同频率区间的最大波动幅度;分类器构建模块提取数据处理模块中的速度数值、加速度数值及轨迹波动幅值,采用机器学习分别构建速度分类器、加速度分类器和轨迹波动分类器;分类模型构建模块利用加权整合方法将所得到的速度分类器、加速度分类器和轨迹波动分类器的预测结果加权整合,采用交叉验证法得到最佳权重,获得运动轨迹分类模型。On the other hand, as shown in Figure 6, the present invention also provides a bird and drone classification model system based on the motion characteristics of the center of mass, including a camera and a preprocessing module built in a computer, a visual algorithm labeling module, a wavelet Noise blocks, data processing blocks, classifier building blocks, and classification model building blocks. The camera is used to shoot the video data of flying birds and drones; the preprocessing module is used to preprocess the video data and cut it into several fixed-length trajectories to form a video data set containing several continuous trajectory segments ;The visual algorithm labeling module is used to mark the position of the center of mass of each frame of the flying target in the preprocessed bird and UAV track fragments to form the center of mass movement track of the flying target; the wavelet denoising module is used to perform wavelet analysis on the center of mass movement track Denoising preprocessing, removing high-frequency noise and labeling errors in the center of mass motion trajectory; the data processing module divides each trajectory into several fixed-length trajectory segments without overlap, and calculates the velocity, acceleration and Trajectory fluctuation motion characteristics, obtain all velocity values and acceleration values, and extract the maximum fluctuation amplitude of trajectory segments in different frequency intervals; the classifier building module extracts the velocity values, acceleration values and trajectory fluctuation amplitudes in the data processing module, and uses machine learning Construct the velocity classifier, acceleration classifier and trajectory fluctuation classifier respectively; the classification model building module uses the weighted integration method to weight the prediction results of the obtained velocity classifier, acceleration classifier and trajectory fluctuation classifier, and uses the cross-validation method to obtain Optimal weights to obtain a motion trajectory classification model.

为了提高分类准确性,在系统中还设置了稳定度评估模块,运动轨迹分类模型对每段轨迹中的轨迹片段进行类别概率计算,经稳定度评估模块进行概率评估后,输出分类结果。In order to improve the classification accuracy, a stability evaluation module is also set up in the system. The motion trajectory classification model calculates the category probability of the trajectory fragments in each trajectory. After the probability evaluation is performed by the stability evaluation module, the classification result is output.

如图7和图8所示,本发明构建的分类模型示意图。根据飞鸟和无人机的速度和加速度概率分布差异,以及轨迹波动差异区分二者。由图中可以看出:相比于无人机,飞鸟的速度和加速度分布范围较大,轨迹波动也更大。As shown in Fig. 7 and Fig. 8, the classification model constructed by the present invention is a schematic diagram. According to the difference in speed and acceleration probability distribution of flying bird and UAV, as well as the difference in trajectory fluctuation, the two are distinguished. It can be seen from the figure that compared with drones, flying birds have a larger distribution range of speed and acceleration, and larger trajectory fluctuations.

图7和图8中的第一行左侧是原始质心运动轨迹,而第一行右侧是分类器概率判断实时输出结果,其中的白色竖线表示结果输出时刻(平均反应时为380.79ms),分类结果输出在反应框中。第二行是提取的轨迹特征,分别为速度、加速度和水平、竖直方向的轨迹波动。速度和加速度下方是基于训练集中的轨迹数据,获取到的飞鸟和无人机速度、加速度概率分布模板。飞鸟的速度和加速度分布在飞鸟的概率模板内,飞鸟的轨迹波动较大,如图7所示;无人机的速度和加速度分布在无人机的概率模板内,无人机的轨迹波动较小,如图8所示。The left side of the first line in Figure 7 and Figure 8 is the original centroid trajectory, and the right side of the first line is the real-time output result of the classifier probability judgment, where the white vertical line indicates the output moment of the result (the average response time is 380.79ms) , the classification results are output in the response box. The second row is the extracted trajectory features, which are velocity, acceleration, and trajectory fluctuations in the horizontal and vertical directions. Below the speed and acceleration is the probability distribution template of the speed and acceleration of the bird and drone obtained based on the trajectory data in the training set. The speed and acceleration of flying birds are distributed in the probability template of flying birds, and the trajectory of flying birds fluctuates greatly, as shown in Figure 7; the speed and acceleration of UAVs are distributed in the probability template of UAVs, and the trajectory of UAVs fluctuates relatively small, as shown in Figure 8.

对测试集中的30段轨迹进行测试后,其正确率达到100%。After testing 30 segments of trajectories in the test set, the correct rate reaches 100%.

本发明训练所需的样本量较少,只需采集飞行轨迹中的部分轨迹,无需对所有飞行轨迹进行计算,本发明采用小样本训练就可以得到稳定的输出结果,可以适用于对不同类型飞鸟和无人机的准确识别。The amount of samples required for the training of the present invention is small, only part of the flight trajectory needs to be collected, and there is no need to calculate all the flight trajectories. The present invention can obtain stable output results by using small sample training, and can be applied to different types of birds and accurate identification of drones.

显然,上述实施例仅仅是为清楚地说明所作的举例,而并非对实施方式的限定。对于所属领域的普通技术人员来说,在上述说明的基础上还可以做出其它不同形式的变化或变动。这里无需也无法对所有的实施方式予以穷举。而由此所引伸出的显而易见的变化或变动仍处于本发明的保护范围之中。Apparently, the above-mentioned embodiments are only examples for clear description, rather than limiting the implementation. For those of ordinary skill in the art, other changes or changes in different forms can be made on the basis of the above description. It is not necessary and impossible to exhaustively list all the implementation manners here. However, the obvious changes or changes derived therefrom still fall within the scope of protection of the present invention.

Claims (10)

1.一种基于质心运动特征的飞鸟和无人机分类模型构建方法,其特征在于,其构建方法包括如下步骤:1. a kind of flying bird and unmanned aerial vehicle classification model building method based on centroid motion feature, it is characterized in that, its building method comprises the steps: 步骤1,拍摄飞鸟飞行,同时操控无人机模拟飞鸟的运动轨迹飞行,分别得到飞鸟和无人机飞行的视频资料;Step 1, shoot the flying birds, and at the same time control the UAV to simulate the flight trajectory of the flying birds, and obtain the video data of the flying birds and the UAV flight respectively; 步骤2,对视频资料进行预处理,并剪切为若干段固定时长的轨迹,形成视频数据集;Step 2, preprocessing the video data and cutting it into a number of tracks with a fixed duration to form a video data set; 步骤3,采用计算机视觉算法标注出视频数据集中每一帧飞行目标的质心位置,形成质心运动轨迹,并做小波去噪预处理;Step 3, use computer vision algorithm to mark the position of the center of mass of the flying target in each frame of the video data set, form the trajectory of the center of mass, and perform wavelet denoising preprocessing; 步骤4,将每段轨迹无重叠地划分为若干段固定时长的轨迹片段,计算轨迹片段的速度、加速度和轨迹波动运动特征,得到所有速度数值和加速度数值,并提取轨迹片段在不同频率区间的最大波动幅度;Step 4. Divide each trajectory segment into several fixed-duration trajectory segments without overlap, calculate the velocity, acceleration and trajectory fluctuation motion characteristics of the trajectory segment, obtain all velocity values and acceleration values, and extract the trajectory segment in different frequency intervals. Maximum volatility; 步骤5,采用机器学习针对飞鸟和无人机的速度、加速度和轨迹波动特征分别建立速度分类器、加速度分类器和轨迹波动分类器;Step 5, using machine learning to establish speed classifiers, acceleration classifiers and trajectory fluctuation classifiers for the speed, acceleration and trajectory fluctuation characteristics of birds and drones; 步骤6,利用加权整合方法将步骤5中所得三种分类器的预测结果加权整合,采用交叉验证法得到最佳权重,建立运动轨迹分类模型,并对测试集中的飞鸟和/或无人机视频数据集进行识别。Step 6, use the weighted integration method to weight the prediction results of the three classifiers obtained in step 5, use the cross-validation method to obtain the optimal weight, establish a motion trajectory classification model, and test the birds and/or UAV videos in the test set The data set is identified. 2.根据权利要求1所述的基于质心运动特征的飞鸟和无人机分类模型构建方法,其特征在于,所述方法还包括步骤7,运动轨迹分类模型对轨迹中的轨迹片段进行计算,得到轨迹片段的类别概率;采用基于人类大脑的工作记忆机制和决策机制的稳定性评估模块对轨迹片段的类别概率进行稳定性评估后输出分类结果。2. the flying bird and the unmanned aerial vehicle classification model construction method based on the center of mass motion feature according to claim 1, it is characterized in that, described method also comprises step 7, and motion track classification model calculates the track segment in track, obtains The category probability of the trajectory segment; the stability assessment module based on the working memory mechanism and decision-making mechanism of the human brain is used to evaluate the stability of the category probability of the trajectory segment and output the classification result. 3.根据权利要求2所述的基于质心运动特征的飞鸟和无人机分类模型构建方法,其特征在于,所述步骤7中,将轨迹片段中的运动特征输入步骤6构建好的运动轨迹分类模型中进行计算,得到轨迹片段的类别概率;运动轨迹分类模型持续向稳定性评估模块输入类别概率信息;当输入的同一类别概率,在连续10个中存在至少7个的类别概率大于0.8,并且速度分类器、加速度分类器及轨迹波动分类器的类别判断一致时,输出分类结果。3. the flying bird and the unmanned aerial vehicle classification model building method based on the center of mass motion feature according to claim 2, it is characterized in that, in described step 7, the motion track classification that the motion feature input step 6 builds in the trajectory segment Calculate in the model to obtain the category probability of the trajectory segment; the motion trajectory classification model continues to input the category probability information to the stability assessment module; when the same category probability is input, there are at least 7 category probabilities greater than 0.8 in 10 consecutive ones, and When the classification judgments of the speed classifier, acceleration classifier and trajectory fluctuation classifier are consistent, the classification result is output. 4.根据权利要求3所述的基于质心运动特征的飞鸟和无人机分类模型构建方法,其特征在于,构建好的运动轨迹分类模型对包含24帧时长200ms的轨迹片段进行类别概率计算。4. The method for constructing a bird and unmanned aerial vehicle classification model based on the motion characteristics of the center of mass according to claim 3, wherein the constructed motion trajectory classification model carries out category probability calculations for trajectory segments comprising 24 frames with a duration of 200ms. 5.根据权利要求1所述的基于质心运动特征的飞鸟和无人机分类模型构建方法,其特征在于,所述步骤2中,在对原始视频资料进行预处理时,除去原始视频资料中飞鸟和无人机起飞、降落和悬停时的运动特征,形成每段至少2秒钟的轨迹。5. the method for building a flying bird and unmanned aerial vehicle classification model based on the motion characteristics of the center of mass according to claim 1, characterized in that, in the step 2, when the original video data is preprocessed, remove the flying bird in the original video data And the movement characteristics of the drone when it takes off, lands and hovers, forming a trajectory of at least 2 seconds each. 6.根据权利要求1所述的基于质心运动特征的飞鸟和无人机分类模型构建方法,其特征在于,所述步骤3中,采用ECO目标跟踪算法对采集到的鸽子视频数据集中的每一帧飞行目标的质心位置做出标注,采用DIMP目标跟踪算法对采集到的黄玉鸟、珍珠鸟及无人机视频数据集中的每一帧飞行目标的质心位置做出标注。6. the flying bird and the unmanned aerial vehicle classification model building method based on the center of mass motion feature according to claim 1, it is characterized in that, in described step 3, adopt ECO target tracking algorithm to collect each pigeon video data set The position of the center of mass of the frame flying target is marked, and the DIMP target tracking algorithm is used to mark the position of the center of mass of each frame of the flying target in the collected topaz bird, pearl bird and UAV video data sets. 7.根据权利要求1所述的基于质心运动特征的飞鸟和无人机分类模型构建方法,其特征在于,所述步骤4中将每段轨迹无重叠地划分为若干段时长为200ms的轨迹片段,计算轨迹片段中的轨迹波动运动特征的方法是:对步骤3中的质心运动轨迹做移动均值平滑处理后获得平滑轨迹;用质心运动轨迹的水平坐标和垂直坐标分别减去平滑轨迹的水平坐标和垂直坐标,得到水平和竖直方向的轨迹波动;采用快速傅里叶变换对轨迹波动做频谱分析,分别得到在频率区间0~10Hz,10~20Hz和20~30Hz内的最大波动幅度。7. the method for building a flying bird and unmanned aerial vehicle classification model based on the motion characteristics of the center of mass according to claim 1, wherein, in the step 4, each section of the trajectory is divided into several sections of trajectory segments that are 200ms long without overlapping , the method of calculating the trajectory fluctuation motion characteristics in the trajectory segment is: to obtain the smooth trajectory after performing moving mean smoothing on the centroid trajectory in step 3; subtract the horizontal coordinate of the smooth trajectory from the horizontal and vertical coordinates of the centroid trajectory and vertical coordinates to obtain the trajectory fluctuations in the horizontal and vertical directions; use the fast Fourier transform to analyze the frequency spectrum of the trajectory fluctuations, and obtain the maximum fluctuation amplitudes in the frequency intervals of 0-10Hz, 10-20Hz and 20-30Hz respectively. 8.根据权利要求1所述的基于质心运动特征的飞鸟和无人机分类模型构建方法,其特征在于,所述步骤5中采用朴素贝叶斯算法分别建立速度分类器和加速度分类器,采用支持向量机算法建立轨迹波动分类器。8. the flying bird and the unmanned aerial vehicle classification model construction method based on the center of mass motion feature according to claim 1, it is characterized in that, in the described step 5, adopt naive Bayesian algorithm to set up speed classifier and acceleration classifier respectively, adopt Support vector machine algorithm is used to establish trajectory fluctuation classifier. 9.一种基于质心运动特征的飞鸟和无人机分类模型系统,其特征在于,所述系统包括:摄像机,用于拍摄飞鸟和无人机飞行的视频资料;9. A bird and unmanned aerial vehicle classification model system based on the motion characteristics of the center of mass, is characterized in that, said system comprises: video camera, is used to take the video data of flying bird and unmanned aerial vehicle; 预处理模块,用于对视频资料进行预处理,并剪切为若干段固定时长的轨迹,形成视频数据集;The preprocessing module is used to preprocess the video data and cut it into several fixed-time tracks to form a video data set; 视觉算法标注模块,用于对预处理后的飞鸟和无人机轨迹中的每一帧飞行目标质心位置进行标注,形成飞行目标的质心运动轨迹;The visual algorithm labeling module is used to label the position of the center of mass of the flight target in each frame of the preprocessed bird and UAV trajectory to form the center of mass movement track of the flight target; 小波去噪模块,用于对质心运动轨迹进行小波去噪预处理,去除质心运动轨迹中的高频噪声和标注错误;The wavelet denoising module is used to perform wavelet denoising preprocessing on the centroid trajectory to remove high-frequency noise and labeling errors in the centroid trajectory; 数据处理模块,其将每段轨迹无重叠地划分为若干段固定时长的轨迹片段,计算每段轨迹中轨迹片段的速度、加速度和轨迹波动运动特征,得到所有速度数值和加速度数值,并提取轨迹片段在不同频率区间的最大波动幅度;A data processing module, which divides each trajectory into several fixed duration trajectory segments without overlap, calculates the velocity, acceleration and trajectory fluctuation motion characteristics of the trajectory segments in each trajectory, obtains all velocity values and acceleration values, and extracts the trajectory The maximum fluctuation amplitude of the segment in different frequency intervals; 分类器构建模块,提取所述数据处理模块中的速度数值、加速度数值及轨迹波动幅值,采用机器学习分别构建速度分类器、加速度分类器和轨迹波动分类器;The classifier construction module extracts the velocity value, the acceleration value and the trajectory fluctuation amplitude in the data processing module, and adopts machine learning to construct a velocity classifier, an acceleration classifier and a trajectory fluctuation classifier respectively; 分类模型构建模块,利用加权整合方法将所得到的速度分类器、加速度分类器和轨迹波动分类器的预测结果加权整合,采用交叉验证法得到最佳权重,获得运动轨迹分类模型。The classification model construction module uses the weighted integration method to integrate the obtained prediction results of the speed classifier, acceleration classifier and trajectory fluctuation classifier, and uses the cross-validation method to obtain the optimal weight to obtain the motion trajectory classification model. 10.根据权利要求9所述的基于质心运动特征的飞鸟和无人机分类模型系统,其特征在于,所述系统还包括稳定度评估模块,所述运动轨迹分类模型对每段轨迹中的轨迹片段进行类别概率计算,经所述稳定度评估模块进行概率评估后,输出分类结果。10. the flying bird and unmanned aerial vehicle classification model system based on center of mass motion feature according to claim 9, it is characterized in that, described system also comprises stability evaluation module, and described trajectory classification model is to the trajectory in every section trajectory The category probability is calculated for the segment, and the classification result is output after the probability assessment is performed by the stability assessment module.
CN202310121385.6A 2023-02-03 2023-02-03 Method and system for constructing classification model of flying bird and unmanned aerial vehicle based on centroid movement characteristics Pending CN116363412A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310121385.6A CN116363412A (en) 2023-02-03 2023-02-03 Method and system for constructing classification model of flying bird and unmanned aerial vehicle based on centroid movement characteristics

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310121385.6A CN116363412A (en) 2023-02-03 2023-02-03 Method and system for constructing classification model of flying bird and unmanned aerial vehicle based on centroid movement characteristics

Publications (1)

Publication Number Publication Date
CN116363412A true CN116363412A (en) 2023-06-30

Family

ID=86912413

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310121385.6A Pending CN116363412A (en) 2023-02-03 2023-02-03 Method and system for constructing classification model of flying bird and unmanned aerial vehicle based on centroid movement characteristics

Country Status (1)

Country Link
CN (1) CN116363412A (en)

Similar Documents

Publication Publication Date Title
US11751560B2 (en) Imaging array for bird or bat detection and identification
Zaugg et al. Automatic identification of bird targets with radar via patterns produced by wing flapping
CN109409225B (en) UAV classification method and device based on time-frequency feature fusion of radar multipath signals
CN110018453B (en) Intelligent model identification method based on aircraft track characteristics
CN108037770A (en) Unmanned plane power transmission line polling system and method based on artificial intelligence
US20070024494A1 (en) Classification system for radar and sonar applications
CN103559508B (en) A kind of based on continuous Adaboost video vehicle detection method
CN115064009B (en) A method for classifying conflict risk levels between drones and manned aircraft in terminal areas
CN113014866A (en) Airport low-altitude bird activity monitoring and risk alarming system
CN110503647A (en) Wheat plant real-time counting method based on deep learning image segmentation
CN114139373A (en) Multi-sensor automatic cooperative management method for unmanned aerial vehicle reverse braking
CN106886745A (en) A kind of unmanned plane reconnaissance method based on the generation of real-time online map
CN114299106A (en) High-altitude parabolic early warning system and method based on visual sensing and track prediction
CN115311580A (en) Unmanned aerial vehicle threat determination method based on image recognition and related equipment
CN116363412A (en) Method and system for constructing classification model of flying bird and unmanned aerial vehicle based on centroid movement characteristics
Zheng et al. Modeling and detection of low-altitude flight conflict network based on SVM
Qi et al. Detection and tracking of a moving target for UAV based on machine vision
CN115294598A (en) Intelligent bird identification method based on radar and photoelectric multi-mode information fusion decision
CN119942853B (en) Automatic detection and intelligent bird-repelling device and method for airport birds
Mokrova et al. Monitoring of the Earth’s surface in conditions of low visibility
CN119374493B (en) Unmanned aerial vehicle bullet drop point acquisition system and method for experimental identification
CN111178165B (en) Automatic extraction method for air-to-ground target information based on small sample training video
CN117590863B (en) Unmanned aerial vehicle cloud edge end cooperative control system of 5G security rescue net allies oneself with
CN116630897B (en) Airport bird repellent intelligent auxiliary control system based on image recognition
MUNIR VISION-BASED MULTI-SCALE UAV DETECTION

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination