CN116861300A - Automatic auxiliary labeling method and device for complex maneuvering data set of military machine type - Google Patents
Automatic auxiliary labeling method and device for complex maneuvering data set of military machine type Download PDFInfo
- Publication number
- CN116861300A CN116861300A CN202311116892.7A CN202311116892A CN116861300A CN 116861300 A CN116861300 A CN 116861300A CN 202311116892 A CN202311116892 A CN 202311116892A CN 116861300 A CN116861300 A CN 116861300A
- Authority
- CN
- China
- Prior art keywords
- sequence
- maneuver
- flight parameter
- data
- flight
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000002372 labelling Methods 0.000 title claims abstract description 41
- 238000000034 method Methods 0.000 claims abstract description 34
- 238000007781 pre-processing Methods 0.000 claims abstract description 23
- 238000012800 visualization Methods 0.000 claims abstract description 20
- 239000011159 matrix material Substances 0.000 claims abstract description 15
- 230000009471 action Effects 0.000 claims description 81
- 238000012549 training Methods 0.000 claims description 15
- 230000001133 acceleration Effects 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 7
- 239000013598 vector Substances 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 5
- 230000009189 diving Effects 0.000 claims description 4
- 230000001186 cumulative effect Effects 0.000 claims description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 6
- 239000012634 fragment Substances 0.000 description 5
- 238000013135 deep learning Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010921 in-depth analysis Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000001303 quality assessment method Methods 0.000 description 1
- 238000013441 quality evaluation Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 238000005303 weighing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T90/00—Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application relates to an automatic auxiliary labeling method and device for a complex maneuvering data set of a military machine type. The method comprises the following steps: collecting historical flight parameter sequence data and selecting a standard maneuver sample sequence; preprocessing historical flight parameter sequence and target maneuver template sequence data; using a Matrix Profile data structure, and using a target maneuvering template sequence to preliminarily match in a historical flight parameter sequence and extracting a to-be-identified flight parameter subsequence; pre-classifying the identification subsequence; performing similarity matching on the flight parameter subsequence to be identified and the target maneuver template sequence by adopting a multidimensional dynamic time planning method, and finishing the fine classification of maneuver; and carrying out three-dimensional visualization on the flight parameter subsequence, and manually rechecking the automatically marked maneuver categories to obtain a maneuver data set with the tag. The method can remarkably improve the labeling efficiency and accuracy of the complex maneuvering data set, and is suitable for various military models.
Description
Technical Field
The application belongs to the technical field of intelligent flight data processing, and particularly relates to an automatic auxiliary labeling method and device for a military model complex maneuver data set.
Background
Scientific evaluation of flight training quality is of great importance for analyzing pilot maneuvering habits and improving pilot flight driving technologies and ensuring flight safety. Maneuver identification is a key step in flight training quality assessment, and a large amount of assessment content is based on the acquisition of a specific category of action sequences. The flight parameter data recorded and stored by the airborne flight parameter system in the form of multi-dimensional time sequence data provides objective and scientific basis for motor action recognition.
Currently, the maneuver identification method based on the flight parameter data mainly comprises a method based on pattern matching, a method based on an expert system and an intelligent method based on deep learning. Conventional pattern matching based methods require manual adjustment of the threshold. The expert system-based method requires the establishment of a manual rule knowledge base according to prior knowledge of domain experts. These two types of methods are to be further improved for complex maneuver recognition accuracy with high similarity. In recent years, artificial intelligence has been rapidly developed and advanced, and deep learning-based methods have shown remarkable performance in the field of motor action recognition. However, deep learning based methods require a large number of labeled maneuver sample data sets for model training. In addition, the flying parameter data recorded by the multimode onboard sensor such as a gyroscope or an accelerometer contains tens to hundreds of parameters, which is far more difficult to understand than the data of the other modal sensor such as a camera. The traditional maneuver data set labeling method is to observe and analyze flight data manually, identify maneuver fragments in the flight data and label the maneuver fragments. However, this manual labeling method has the following problems: (1) The workload is large, and a large amount of time and manpower resources are consumed for manually marking a large amount of flight data; (2) The subjectivity is strong, and subjective differences can exist in the identification and labeling of different personnel on the maneuver, so that the results are inconsistent; (3) The accuracy is low, the extraction and the category labeling of the maneuvering sequence fragments require professional staff, the labeling accuracy is influenced by factors such as individual ability, experience, fatigue and the like, and the labeling error can exist. Therefore, there is a need for a method and apparatus that automatically assists in labeling maneuvers in flight data to improve labeling efficiency and accuracy.
Disclosure of Invention
The technical problem to be solved by the application is to provide an automatic auxiliary labeling technical scheme for a military machine type complex maneuver data set aiming at the defects of the prior art, so as to solve the technical problems of low labeling precision and low efficiency of target maneuver types under massive flight parameter data.
In order to achieve the aim of the application, the application adopts the following technical scheme:
s1, acquiring historical flight parameter sequence data of pilot flight training, and selecting a standard maneuver sample sequence as a target maneuver template;
s2, preprocessing the collected historical flight parameter sequence data and the selected target maneuver template sequence;
s3, based on a Matrix Profile data structure, using a target maneuvering template sequence to preliminarily match in a historical flight parameter sequence subjected to data preprocessing and extracting a flight parameter subsequence to be identified;
s4, pre-classifying the subsequence to be identified extracted in the S3 through obvious features, namely pre-matching the maneuver categories;
s5, performing similarity matching on the to-be-identified flight parameter subsequence and the target maneuver template sequence in the pre-classified maneuver sequence by adopting an MDTW algorithm, and completing fine classification of maneuver;
and S6, carrying out three-dimensional visualization on the sub-sequences of the flight parameters subjected to the fine classification, and carrying out manual accurate rechecking on the automatically marked maneuver class labels to obtain a final marked maneuver data set.
Preferably, in S1, historical flight parameter sequence data of flight training of the pilot is collected, and a standard maneuver sample sequence is selected as a target maneuver template; the method specifically comprises the following steps:
s1-1, acquiring historical flight parameter sequence data of pilot flight training, and decoding the historical flight parameter data into table data which can be directly read by a computer;
s1-2, determining the type of the target maneuver to be marked according to the flight training outline and the actual demand, and selecting a flight parameter subsequence meeting maneuver operation specification requirements in the flight training manual as a standard target maneuver template sequence.
Preferably, in S2, data preprocessing is carried out on the collected historical flight parameter sequence and the selected target maneuver template sequence; the method specifically comprises the following steps:
s2-1, acquiring parameters of pitch angle, inclination angle, air pressure height, X-axis angular velocity, Y-axis angular velocity, Z-axis angular velocity, horizontal acceleration and vertical acceleration which can judge different action types, filling missing values in a historical flight parameter sequence and a target maneuvering template sequence, and carrying out standardized preprocessing on each dimension in original data.
The data normalization processing formula is as follows:wherein (1)>Representing the mean value of each dimension of the flight data, < >>Representing the standard deviation of each dimension of data in the flight data. Each dimension of data after pretreatmentThe average value was 0 and the standard deviation was 1.
Preferably, in the step S3, based on a Matrix Profile data structure, a target maneuvering template sequence is used for preliminary matching in a historical flight parameter sequence subjected to data preprocessing, and a to-be-identified flight parameter subsequence is extracted; the method specifically comprises the following steps: given a time series of data-preprocessed historical flight parametersTarget maneuver template sequence for querying +.>. Use of the target maneuver template sequence +.>Sliding window of length from historical flight parameter time series subjected to data preprocessing +.>Starting to slide, calculating the sub-sequence within the window and the target maneuver template sequence each time +.>Is of a length ofIs less than a threshold value +.>The value of (2) is at the position from +.>Is matched with and extracted from the sub-sequence of the flight parameters to be identified。
Wherein, the liquid crystal display device comprises a liquid crystal display device,representing the number of parameters>Representing the length of the time series of historical flight parameters, +.>Representing the length of the target maneuver template sequence, typically +.>Far less than->。
Preferably, in S4, the sub-sequence to be identified extracted in S3 is subjected to pre-classification processing, that is, pre-matching of maneuver categories is performed; the method specifically comprises the following steps:
s4-1, the obvious characteristics are height and pitch angle, and the pre-classified categories comprise a bucket like a jin, a jump like a dive, a lift turn like a sharp turn, a roll like a roll and a spiral like four categories;
s4-2, pre-matching of the maneuvering action category is specifically as follows: first, a threshold value is setAnd threshold->，/>Taking the average of the maximum height and minimum height differences in each standard target maneuver template sequence, +.>Taking the average value of the difference values of the maximum pitch angle and the minimum pitch angle in each standard target maneuvering template sequence, and then, according to the average value of the absolute value of the first-order difference of the heights of the subsequences to be identified, judging whether the average value is larger than a threshold value>Is divided into lifting actions, which are smaller than a threshold +.>Is classified into a non-lifting type of motion. In the lifting action, according to the average value of the absolute value of the first-order difference of the pitch angle of the subsequence to be identified, the average value is larger than a threshold value +.>The sequence of (1) is divided into a bucket-like body and a diving jump-like body, which is smaller than a threshold value +.>The sequence of (1) is divided into lifting turns; in the non-lifting type action, according to the average value of the absolute value of the first-order difference of the pitch angle of the subsequence to be identified, the average value is larger than a threshold value +.>Is divided into classes of convolutions, the mean value is smaller than the threshold value +.>Is divided into a sharp turn-like and a roll-like sequence;
preferably, in the maneuver identification stage in S5, similarity matching is carried out on the flight parameter subsequence to be identified and the target maneuver template sequence by utilizing an MDTW algorithm, so as to finish the fine classification of maneuver; the method specifically comprises the following steps:
s5-1, performing similarity matching on the to-be-identified flight parameter subsequence obtained after the pre-classification in the step S4 and the existing target maneuver template sequences, and obtaining a similarity value sequence by respectively calculating MDTW distances between the to-be-identified flight parameter subsequence and the C target maneuver template sequences，/>A value less than a threshold valueThe action to be recognized is determined as +.>A corresponding standard action category. Wherein the method comprises the steps ofAnd setting according to the MDTW distance value of the actual maneuvering sequence and the corresponding target maneuvering template sequence.
S5-2, calculating similarity values of the two action sequences by adopting the MDTW distance calculating principle. Assume that action sequence 1 isAction sequence 2 is->MDTW path matrix is +.>，/>Representing the dimension of the action sequence, +.>And->Indicates the length of action sequence 1 and action sequence 2, respectively,/->Weights representing the respective dimensions;
the action sequences 1 and 2 are defined as: wherein (1)>Is the +.1 of action sequence>Dimension features at%>The value of the individual points,/->Is the +.2 of action sequence>Dimension features at%>The value of each point.
The MDTW path matrix is defined as: ,/>wherein->Is +.1 of action sequence>Dimension features at%>The value of the individual points,/->Is +.2 for action sequence>Dimension features at%>The value of each point. />Representation->Weight of dimensionHeavy (I) of>Representing action sequence 1->Value vector of all dimension characteristics of each point and action sequence 2 +.>Frame weighted matching distance of value vectors of all dimension characteristics of each point;
s5-3, multidimensional dynamic time planning distance of action sequence 1 and action sequence 2Defined as the accumulated distance of the optimal regular path +.>And the regular path meets three constraint conditions of boundary, continuity and monotonicity, and the formula is defined as follows:
wherein the boundary condition is that the start point of the regular path must be +.>The termination point must be +.>The method comprises the steps of carrying out a first treatment on the surface of the The continuity condition is that the regular path should be continuous, i.e. jump from one point to the next, either right, up or up right; the monotonicity condition is that the direction of movement of the regular path should be monotonic, i.e. not move in the opposite direction. Constructing an optimal regular path according to the three constraint conditions, and calculating the accumulated distance of the optimal regular path to obtain +.>。
Preferably, S6, carrying out three-dimensional visualization on the sub-sequences of the flight parameters subjected to fine classification, and rechecking the automatically marked maneuver class labels to obtain a final marked maneuver data set; the method specifically comprises the following steps:
s6-1, carrying out three-dimensional visualization on flight attitude by using pitch angle, roll angle and yaw angle information on the flight parameter subsequence automatically and finely classified by the MDTW algorithm, carrying out three-dimensional visualization on flight track by using altitude, longitude and latitude information on the flight parameter subsequence automatically and finely classified by the MDTW algorithm, rechecking the automatically marked maneuver type label according to the three-dimensional visualization result of the flight attitude and track, storing the flight parameter subsequence and the corresponding label type when the classification result of the MDTW algorithm is consistent with the manual classification result, taking the manual classification result as the type label when the classification result of the MDTW algorithm is inconsistent with the manual classification result, and storing the corresponding flight parameter subsequence, thus obtaining the maneuver data set with the label.
The application also provides an auxiliary labeling device for the complex maneuvering data set of the military machine type.
Specifically, a military machine type complex maneuver data set auxiliary labeling device comprises:
the data acquisition module is used for acquiring the flight parameter sequence data;
the preprocessing module is used for carrying out data preprocessing on the flight parameter sequence data to generate preprocessed flight parameter sequence data;
the pre-matching module is used for carrying out preliminary matching on the target action template and the historical flight parameter sequence to obtain a flight parameter subsequence to be identified
And the maneuver classifying module is used for carrying out similarity matching calculation on the to-be-identified flight parameter subsequence and the target maneuver template sequence to obtain a fine classification result of maneuver.
And the maneuvering motion three-dimensional visualization module is used for carrying out three-dimensional visualization on the flight gesture and the track of the maneuvering motion sequence subjected to fine classification, and further carrying out manual accurate rechecking on the maneuvering type automatically marked.
The technical scheme provided by the application has at least the following beneficial effects:
1. according to the application, the Matrix Profile data structure is utilized, and the maneuvering action templates are used for automatically matching and extracting the target maneuvering action subsequences in the massive flight parameter data, so that the positioning of the time period where the target maneuvering action is positioned in the massive historical flight parameters and the extraction efficiency of the subsequence fragments are greatly improved, and the workload of labeling personnel is reduced.
2. According to the application, after the sub-sequences of the flight parameters to be identified are pre-classified, the MDTW algorithm is adopted to calculate the similarity between the multi-dimensional and unequal-length maneuvering action sequences, so that the precise automatic identification of maneuvering types of the sub-sequences of the flight parameters to be identified is realized, the calculation amount of the MDTW is reduced, and the identification precision and efficiency are improved.
3. The automatic auxiliary labeling method for the motor actions of the military machine model is a universal method, can obviously improve the labeling efficiency of a complex motor action data set, is suitable for various different military machine models, and has wide engineering application prospects.
In summary, the automatic auxiliary labeling method and device for the maneuver data set provided by the application realize automatic auxiliary labeling of maneuver fragments in the flight data by combining the Matrix Profile data structure and the MDTW algorithm, have the advantages of automation, accuracy, high efficiency and universality, and can be widely applied to flight action analysis and quality evaluation in the military aviation field.
Drawings
FIG. 1 is a general flow chart of a method for automatically assisting in labeling a complex maneuver data set for a military machine in accordance with one embodiment of the present application.
FIG. 2 is a flow chart of a maneuver pre-classification process according to an embodiment of the present application.
Fig. 3 is a schematic diagram of an MDTW trace-regular path according to an embodiment of the present application.
FIG. 4 is a flowchart of an embodiment of the application for automatically assisted labeling of a maneuver data set.
Fig. 5 is a schematic structural diagram of an automatic auxiliary labeling device for a complex maneuver data set of a military machine according to an embodiment of the present application.
Detailed Description
Examples
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be clearly and completely described below with reference to specific embodiments of the present application and corresponding drawings. It will be apparent that the described embodiments are only some, but not all, embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
As shown in fig. 1, the embodiment of the application provides an automatic auxiliary labeling method for a complex maneuvering data set of a military machine type, which comprises the following steps:
s1, collecting historical flight parameter sequence data of pilot flight training, and selecting a standard maneuver sample sequence as a target maneuver template.
During the flight of a military model, the onboard multisensor monitors a series of parameters related to the flight state. These flight state related parameters include pitch angle, roll angle, heading angle, angle of attack and sideslip angle, altitude, speed of flight, angular velocity, acceleration, etc. Thus, during annotation of maneuvers, different maneuvers may be described by in-depth analysis of the maneuver's flight parameter variation characteristics. It should be emphasized that these specific index parameters do not limit the scope of the present application. In addition, all the maneuvering data in the complete flight time period from the start of the military model to the end of the flight can be acquired, and the flight parameter sequence data of a part of the complete flight time period of the military model can be selectively acquired. It should be clear that the time period for acquiring the flight parameter sequence data does not limit the protection scope of the present application.
Further, a standard flight parameter subsequence is selected as a target maneuver template according to the operation specification of the target maneuver in the flight training manual. It should be emphasized that in a preferred embodiment of the present application, the obtained historical flight parameter sequence and standard maneuver sample sequence data include flight state related parameters such as pitch angle, roll angle, heading angle, angle of attack and sideslip angle, altitude, speed of flight, angular velocity, acceleration, etc. Furthermore, the number of target maneuver templates is equal to the number of labeling categories of maneuvers, which is not limiting to the scope of the present application.
S2, preprocessing data of the collected historical flight parameter sequence and the selected target maneuver template sequence.
Redundant information exists in the flight state parameters included in the acquired original historical flight parameter sequence and the target maneuver template sequence, and when maneuver judgment is carried out, the calculation efficiency is improved in order to reduce the data dimension, and the key parameters with the maneuver distinction degree are selected.
Further, in a preferred embodiment provided by the application, pitch angle, inclination angle, barometric altitude, X-axis angular velocity, Y-axis angular velocity, Z-axis angular velocity, horizontal acceleration and vertical acceleration parameters which can be determined for different motion categories are taken, missing values in a historical flight parameter sequence and a target maneuver template sequence are filled, and then standardized preprocessing is performed on each dimension in the original data.
The data normalization processing formula is as follows:
wherein, the liquid crystal display device comprises a liquid crystal display device,representing the mean value of each dimension of the flight data, < >>Representing the standard deviation of each dimension of data in the flight data. The average value of each dimension of data after pretreatment is 0, and the standard deviation is 1.
And S3, based on a Matrix Profile data structure, using a target maneuvering template sequence to preliminarily match in a historical flight parameter sequence subjected to data preprocessing, and extracting a flight parameter subsequence to be identified.
Given passing dataPre-processed historical flight parameter time seriesTarget maneuver template sequence for querying +.>. Using a target maneuver template sequenceSliding window of length from historical flight parameter time series subjected to data preprocessing +.>Starting to slide, calculating the sub-sequence within the window and the target maneuver template sequence each time +.>Is a distance of ∈length of generation ∈>Is less than a threshold value +.>The value of (2) is at the position from +.>The sub-sequence of the flight parameter to be identified which is matched and extracted in the step (a)>。
Wherein, the liquid crystal display device comprises a liquid crystal display device,representing the number of parameters>Representing the length of the time series of historical flight parameters, +.>Representing a target maneuver modelThe length of the plate sequence, generally->Far less than->Threshold->Is set manually.
S4, pre-classifying the subsequence to be identified extracted in the S3 through obvious features, namely pre-matching the maneuver categories.
The pre-classified categories comprise four categories of a weighing bucket, a diving jump, a lifting turn, a sharp turn, a rolling turn and a spiral turn. It will be appreciated that the pre-categorized categories described herein are not obviously limiting to the specific scope of the present application.
Further, as shown in fig. 2, in a preferred embodiment provided by the present application, the maneuver pre-matching is specifically: first, a threshold is determinedAnd threshold->. Then, according to the average value of the absolute value of the first-order difference of the height of the subsequence to be identified, the average value is larger than a threshold value +.>Is divided into lifting-type actions, less than the threshold value +.>The sequence is divided into non-lifting actions. In the lifting action, according to the average value of the absolute value of the first-order difference of the pitch angle of the subsequence to be identified, the average value is larger than a threshold value +.>The sequence of (1) is divided into a bucket-like body and a diving jump-like body, which is smaller than a threshold value +.>The sequence of (1) is divided into lifting turns; similarly, in the non-lifting type action, according to the average value of the absolute value of the first-order difference of the pitch angle of the sub-sequence to be identified, the average value is larger than a threshold valueIs divided into classes of convolutions, the mean value is smaller than the threshold value +.>Is divided into a sharp turn-like and a roll-like sequence. And removing maneuver templates which obviously do not accord with the sub-sequence category to be identified through maneuver pre-matching, so that the number of matched maneuver templates is reduced, the calculated amount is simplified, and the working efficiency is improved.
And S5, in a maneuver identification stage, similarity matching is carried out on the flight parameter subsequence to be identified and the target maneuver template sequence by using a multidimensional dynamic time planning method, so that the maneuver is finely classified.
Specifically, the maneuver identification stage is to perform similarity matching on the to-be-identified flight parameter subsequence obtained after S4 pre-classification and the existing target maneuver template sequences, and obtain a similarity value sequence by respectively calculating multidimensional dynamic time planning distances between the to-be-identified flight parameter subsequence and the C target maneuver template sequences,A value less than threshold->The action to be recognized is determined as +.>A corresponding standard action category. Wherein->Given empirically by man.
And the calculation of the similarity values of the two action sequences adopts the calculation principle of multidimensional dynamic time planning distance. Assume that action sequence 1 isAction sequence 2 is->MDTW path matrix is +.>。/>Representing the dimension of the action sequence, +.>And->Indicates the length of action sequence 1 and action sequence 2, respectively,/->Representing the weights of the respective dimensions.
The action sequences 1 and 2 are defined as:
wherein (1)>Is the +.1 of action sequence>Dimension features at%>The value of the individual points,/->Is the +.2 of action sequence>Dimension features at%>The value of each point.
The MDTW path matrix is defined as: ，/>wherein->Is +.1 of action sequence>Dimension features at%>The value of the individual points,/->Is +.2 for action sequence>Dimension features at%>The value of the individual points,/->Representation->Weight of dimension->Representing action sequence 1->Value vector of all dimension characteristics of each point and action sequence 2 +.>Frame weighted matching distance of value vectors of all dimension characteristics of each point;
s5-3, multidimensional dynamic time planning distance of action sequence 1 and action sequence 2Defined as the optimal regular path cumulative distance +.>And the regular path meets three constraint conditions of boundary, continuity and monotonicity, and the formula is defined as follows:
wherein the boundary condition is that the start point of the regular path must be +.>The termination point must be +.>The method comprises the steps of carrying out a first treatment on the surface of the The continuity condition is that the regular path should be continuous, i.e. jump from one point to the next, either right, up or up right; the monotonicity condition is that the direction of movement of the regular path should be monotonic, i.e. not move in the opposite direction. Constructing an optimal regular path according to the three constraint conditions, and calculating the accumulated distance of the optimal regular path to obtain +.>。
And S6, carrying out three-dimensional visualization on the sub-sequences of the flight parameters subjected to the fine classification, and carrying out manual accurate rechecking on the automatically marked maneuver class labels to obtain a final marked maneuver data set.
Specifically, the three-dimensional visualization of the flight attitude and the track is carried out on the flight parameter subsequence automatically and finely classified by the multidimensional dynamic time planning method, and the manual accurate rechecking is carried out on the automatically marked maneuver type label. When the classification result of the multi-dimensional dynamic time planning method is consistent with the manual classification result, the flight parameter subsequence and the corresponding label category are stored, and when the classification result of the multi-dimensional dynamic time planning method is inconsistent with the manual classification result, the manual classification result is used as a category label, and the corresponding flight parameter subsequence is stored, so that the labeled maneuvering action data set is obtained. In summary, in a preferred embodiment of the present application, a detailed implementation flowchart of automatic auxiliary labeling of a maneuver data set is shown in fig. 4.
Referring to fig. 5, an automatic auxiliary labeling device 100 for a complex maneuver data set of a military machine according to an embodiment of the present application includes:
a data acquisition module 11, configured to acquire flight parameter sequence data;
the preprocessing module 12 is configured to perform data preprocessing on the flight parameter sequence data to generate preprocessed flight parameter sequence data;
a pre-matching module 13 for performing preliminary matching on the target action template and the historical flight parameter sequence to obtain a sub-sequence of flight parameters to be identified
And the maneuver classification module 14 is configured to perform similarity matching calculation on the sub-sequence of the flight parameter to be identified and the target maneuver template sequence, so as to obtain a fine classification result of maneuver.
The maneuver three-dimensional visualization module 15 is used for performing three-dimensional visualization of the flight gesture and the track on the maneuver sequences subjected to the fine classification, and further performing manual accurate review on the maneuver types automatically marked.
The application provides an automatic auxiliary labeling method for a complex maneuver data set of a military machine type by referring to the thought of multi-dimensional time subsequence matching query, and aims to automatically detect and label a target maneuver from historical flight data. Firstly, adopting a Matrix Profile data structure, and preliminarily matching and extracting a target maneuver subsequence in mass data by using a maneuver template; secondly, determining the maneuver type of the segmented maneuver sub-sequence by adopting a multidimensional dynamic time planning (MultidimensionalDynamic Time Warping, MDTW) method; and finally, carrying out three-dimensional visualization on the flight gesture and the track on the maneuvering action sequence so as to manually and accurately recheck the maneuvering type automatically marked. The automatic auxiliary labeling method can remarkably improve the labeling efficiency of the complex maneuvering action data set, is suitable for various military machine types, and has wide engineering application prospect.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and variations of the present application will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. which come within the spirit and principles of the application are to be included in the scope of the claims of the present application.
Claims (8)
1. The automatic auxiliary labeling method for the complex maneuvering data set of the military machine type is characterized by comprising the following steps of:
s1, acquiring historical flight parameter sequence data of pilot flight training, and selecting a standard maneuver sample sequence as a target maneuver template;
s2, preprocessing the collected historical flight parameter sequence data and the selected target maneuver template sequence;
s3, based on a Matrix Profile data structure, using a target maneuvering template sequence to preliminarily match in a historical flight parameter sequence subjected to data preprocessing and extracting a flight parameter subsequence to be identified;
s4, pre-classifying the subsequence to be identified extracted in the S3 through obvious features, namely pre-matching the maneuver categories;
s5, performing similarity matching on the to-be-identified flight parameter subsequence and the target maneuver template sequence in the pre-classified maneuver sequence by adopting an MDTW algorithm, and completing fine classification of maneuver;
and S6, carrying out three-dimensional visualization on the sub-sequences of the flight parameters subjected to the fine classification, and rechecking the automatically marked maneuver class labels to obtain a final marked maneuver data set.
2. The method for automatically assisting in labeling a complex maneuver data set for a military machine according to claim 1, wherein in step S1, historical flight parameter sequence data of pilot flight training is collected, and a standard maneuver sample sequence is selected as a target maneuver template, specifically comprising:
s1-1, acquiring historical flight parameter sequence data of pilot flight training, and decoding the historical flight parameter data into table data which can be directly read by a computer;
s1-2, determining the type of the target maneuver to be marked according to the flight training outline and the actual demand, and selecting a flight parameter subsequence meeting maneuver operation specification requirements in the flight training manual as a standard target maneuver template sequence.
3. The method for automatically assisting in labeling a complex maneuver data set for a military machine according to claim 1, wherein in step S2, the collected historical flight parameter sequence and the selected target maneuver template sequence are subjected to data preprocessing, and specifically comprises:
and filling missing values in the historical flight parameter sequence and the target maneuver template sequence by taking parameters of pitch angle, inclination angle, barometric altitude, X-axis angular velocity, Y-axis angular velocity, Z-axis angular velocity, horizontal acceleration and vertical acceleration which can be judged in different action types, and carrying out standardized preprocessing on each dimension in the original data.
4. The automatic auxiliary labeling method for the complex maneuver data set of the military machine type according to claim 1, wherein in step S3, the target maneuver template sequence is used for preliminary matching and extracting the sub-sequence of the flight parameters to be identified in the historical flight parameter sequence subjected to the data preprocessing based on the Matrix Profile data structure, and specifically comprises the following steps:
given historical flight parameters subjected to data preprocessingTime seriesTarget maneuver template sequence for querying +.>Use of the target maneuver template sequence +.>Sliding window of length from historical flight parameter time series subjected to data preprocessing +.>Starting to slide, calculating the sub-sequence within the window and the target maneuver template sequence each time +.>Is a distance of ∈length of generation ∈>Is less than a threshold value +.>The value of (2) is at the position from +.>The sub-sequence of the flight parameter to be identified which is matched and extracted in the step (a)>Wherein, the->Representing the number of parameters>Representing the length of the time series of historical flight parameters, +.>Representing the length of the target maneuver template sequence, typically +.>Far less than->。
5. The automatic auxiliary labeling method for the complex maneuver data set of the military machine type according to claim 1, wherein in step S4, the sub-sequence to be identified extracted in step S3 is subjected to pre-classification processing, that is, pre-matching of maneuver types is performed, and specifically comprises:
s4-1, the obvious characteristics are height and pitch angle, and the pre-classified categories comprise a bucket like a jin, a jump like a dive, a lift turn like a sharp turn, a roll like a roll and a spiral like four categories;
s4-2, pre-matching of the maneuvering action category is specifically as follows: first, a threshold value is setAnd threshold->，/>Taking the average of the maximum height and minimum height differences in each standard target maneuver template sequence, +.>Taking the average value of the difference values of the maximum pitch angle and the minimum pitch angle in each standard target maneuvering template sequence, and then, according to the average value of the absolute value of the first-order difference of the heights of the subsequences to be identified, judging whether the average value is larger than a threshold value>Is divided into lifting actions, which are smaller than a threshold +.>The sequence of the sub-sequence pitch angle is divided into non-lifting type actions, and in the lifting type actions, the average value is larger than a threshold value according to the average value of the first-order difference absolute values of the pitch angles of the sub-sequences to be identified>The sequence of (1) is divided into a bucket-like body and a diving jump-like body, which is smaller than a threshold value +.>The sequence of (1) is divided into lifting turns; in the non-lifting type action, according to the average value of the absolute value of the first-order difference of the pitch angle of the subsequence to be identified, the average value is larger than a threshold valueIs divided into classes of convolutions, the mean value is smaller than the threshold value +.>Is divided into a sharp turn-like and a roll-like sequence.
6. The automatic auxiliary labeling method for complex maneuver data sets of military machine type according to claim 1, wherein in step S5, similarity matching is performed between the sub-sequence of the flight parameter to be identified and the target maneuver template sequence by using an MDTW algorithm, so as to complete fine classification of maneuver, and specifically comprises:
s5-1, performing similarity matching on the flight parameter subsequence to be identified obtained after S4 pre-classification and the existing target maneuver template sequences, and obtaining a similarity value sequence by respectively calculating MDTW distances between the flight parameter subsequence to be identified and the C target maneuver template sequences,/>A value less than a threshold valueThe action to be recognized is determined as +.>A corresponding standard action category in whichSetting according to the MDTW distance value of the actual maneuvering sequence and the corresponding target maneuvering template sequence;
s5-2, calculating similarity values of two action sequences by adopting the MDTW distance calculating principle, and assuming the action sequence 1 isAction sequence 2 is->MDTW path matrix is +.>,/>Representing the dimension of the action sequence, +.>And->Indicates the length of action sequence 1 and action sequence 2, respectively,/->The action sequence 1 and the action sequence 2 are defined as: /> Wherein (1)>Is the +.1 of action sequence>Dimension features at%>The value of the individual points,/->Is the +.2 of action sequence>Dimension features at%>The value of each point; the MDTW path matrix is defined as: /> ，Wherein->Is +.1 of action sequence>Dimension features at%>The value of the individual points is taken out,is +.2 for action sequence>Dimension features at%>The value of each point; />Representation->Weight of dimension->Representing action sequence 1->Value vector of all dimension characteristics of each point and action sequence 2 +.>Frame weighted matching distance of value vectors of all dimension characteristics of each point;
s5-3, multidimensional dynamic time planning distance of action sequence 1 and action sequence 2Defined as the optimal regular path cumulative distance +.>And the regular path meets three constraint conditions of boundary, continuity and monotonicity, and the formula is defined as follows: />Wherein the boundary condition is that the start point of the regular path must be +.>The termination point must be +.>The method comprises the steps of carrying out a first treatment on the surface of the The continuity condition is that the regular path should be continuous, i.e. jump from one point to the next, either right, up or up right; the monotonicity condition is that the moving direction of the regular path should be monotonic, namely the regular path does not move reversely, an optimal regular path is constructed according to the three constraint conditions, and the accumulated distance of the optimal regular path is calculated to obtain +.>。
7. The automatic auxiliary labeling method for the complex maneuver data set of the military machine type according to claim 1, wherein in step S6, the sub-sequence of the flight parameters subjected to the fine classification is subjected to three-dimensional visualization, and the maneuver class labels subjected to the automatic labeling are manually and precisely reviewed to obtain the final labeled maneuver data set, and the method specifically comprises the following steps: and carrying out three-dimensional visualization on flight attitude by using pitch angle, roll angle and yaw angle information on the flight parameter subsequence automatically and finely classified by using an MDTW algorithm, carrying out three-dimensional visualization on flight track by using altitude, longitude and latitude information on the flight parameter subsequence automatically and finely classified by using the MDTW algorithm, rechecking the automatically marked maneuver type tag according to the three-dimensional visualization result of the flight attitude and track, storing the flight parameter subsequence and the corresponding tag type when the classification result of the MDTW algorithm is consistent with the manual classification result, and taking the manual classification result as the type tag when the classification result of the MDTW algorithm is inconsistent with the manual classification result, and storing the corresponding flight parameter subsequence, thus obtaining the maneuver action data set with the tag.
8. Auxiliary labeling device of complicated maneuver data set of military machine type, its characterized in that includes:
the data acquisition module is used for acquiring the flight parameter sequence data;
the preprocessing module is used for carrying out data preprocessing on the flight parameter sequence data to generate preprocessed flight parameter sequence data;
the pre-matching module is used for carrying out preliminary matching on the target action template and the historical flight parameter sequence to obtain a to-be-identified flight parameter subsequence;
the maneuver classifying module is used for carrying out similarity matching calculation on the to-be-identified flight parameter subsequence and the target maneuver template sequence to obtain a fine classification result of maneuver;
and the maneuvering motion three-dimensional visualization module is used for carrying out three-dimensional visualization on the flight gesture and the track of the maneuvering motion sequence subjected to fine classification, and further carrying out manual accurate rechecking on the maneuvering type automatically marked.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311116892.7A CN116861300B (en) | 2023-09-01 | 2023-09-01 | Automatic auxiliary labeling method and device for complex maneuvering data set of military machine type |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311116892.7A CN116861300B (en) | 2023-09-01 | 2023-09-01 | Automatic auxiliary labeling method and device for complex maneuvering data set of military machine type |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116861300A true CN116861300A (en) | 2023-10-10 |
| CN116861300B CN116861300B (en) | 2024-01-09 |
Family
ID=88221860
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311116892.7A Active CN116861300B (en) | 2023-09-01 | 2023-09-01 | Automatic auxiliary labeling method and device for complex maneuvering data set of military machine type |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116861300B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106092093A (en) * | 2016-05-26 | 2016-11-09 | 浙江工业大学 | A kind of indoor orientation method based on earth magnetism fingerprint matching algorithm |
| CN109241077A (en) * | 2018-08-30 | 2019-01-18 | 东北大学 | Production target variation tendency visual query system and method based on similitude |
| CN111390921A (en) * | 2020-03-16 | 2020-07-10 | 华东师范大学 | Library uses multi-functional robot |
| WO2022068142A1 (en) * | 2020-09-30 | 2022-04-07 | 华人运通(上海)云计算科技有限公司 | Road surface terrain recognition method and apparatus based on suspension vibration signal, and storage medium |
| CN114299422A (en) * | 2021-12-20 | 2022-04-08 | 中国人民解放军海军航空大学 | Flight quality self-adaptive evaluation method |
| CN115169403A (en) * | 2022-07-11 | 2022-10-11 | 中联重科股份有限公司 | Method and device for identifying operation mode of mechanical equipment |
| CN115561575A (en) * | 2022-09-09 | 2023-01-03 | 国网上海市电力公司 | Method for distinguishing electrical abnormal state of offshore wind farm based on multi-dimensional matrix profile |
| CN116010889A (en) * | 2022-12-30 | 2023-04-25 | 中国人民解放军海军航空大学 | Intelligent recognition method for abnormal flight state of aviation aircraft |
-
2023
- 2023-09-01 CN CN202311116892.7A patent/CN116861300B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106092093A (en) * | 2016-05-26 | 2016-11-09 | 浙江工业大学 | A kind of indoor orientation method based on earth magnetism fingerprint matching algorithm |
| CN109241077A (en) * | 2018-08-30 | 2019-01-18 | 东北大学 | Production target variation tendency visual query system and method based on similitude |
| CN111390921A (en) * | 2020-03-16 | 2020-07-10 | 华东师范大学 | Library uses multi-functional robot |
| WO2022068142A1 (en) * | 2020-09-30 | 2022-04-07 | 华人运通(上海)云计算科技有限公司 | Road surface terrain recognition method and apparatus based on suspension vibration signal, and storage medium |
| CN114299422A (en) * | 2021-12-20 | 2022-04-08 | 中国人民解放军海军航空大学 | Flight quality self-adaptive evaluation method |
| CN115169403A (en) * | 2022-07-11 | 2022-10-11 | 中联重科股份有限公司 | Method and device for identifying operation mode of mechanical equipment |
| CN115561575A (en) * | 2022-09-09 | 2023-01-03 | 国网上海市电力公司 | Method for distinguishing electrical abnormal state of offshore wind farm based on multi-dimensional matrix profile |
| CN116010889A (en) * | 2022-12-30 | 2023-04-25 | 中国人民解放军海军航空大学 | Intelligent recognition method for abnormal flight state of aviation aircraft |
Non-Patent Citations (6)
| Title |
|---|
| SARA ALAEE等: "Time series motifs discovery under DTW allows more robust discovery of conserved structure", DATA MINING AND KNOWLEDGE DISCOVERY, vol. 35, pages 863, XP037438431, DOI: 10.1007/s10618-021-00740-0 * |
| 周超等: "基于多元时间序列融合的飞行动作识别方法", 空军工程大学学报(自然科学版), vol. 18, no. 4, pages 2 * |
| 朱晓晓;: "快速时间序列模体发现算法", 国外电子测量技术, no. 09, pages 31 - 35 * |
| 李超等: "军用机型复杂飞行动作提取与识别的方法研究", 航空兵器, vol. 30, no. 1, pages 2 * |
| 李鸿利等: "基于MDTW的飞行动作识别算法", 计算机工程与应用, vol. 51, no. 9, pages 2 * |
| 魏池璇等: "时间序列可变尺度的时频特征求解及其分类", 软件学报, vol. 33, no. 12, pages 4411 - 4428 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116861300B (en) | 2024-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11557029B2 (en) | Method for detecting and recognizing surface defects of automated fiber placement composite based on image converted from point cloud | |
| CN111062282B (en) | Substation pointer instrument identification method based on improved YOLOV3 model | |
| US10929649B2 (en) | Multi-pose face feature point detection method based on cascade regression | |
| CN110070074B (en) | Method for constructing pedestrian detection model | |
| CN108090499B (en) | Data active labeling method and system based on maximum information triple screening network | |
| CN110798805B (en) | Data processing method and device based on GPS track and storage medium | |
| CN103745238B (en) | Pantograph identification method based on AdaBoost and active shape model | |
| CN111368762A (en) | Robot gesture recognition method based on improved K-means clustering algorithm | |
| CN110675469A (en) | Image description method for detecting spatial relationship between targets in construction scene | |
| CN115019294A (en) | Pointer instrument reading identification method and system | |
| CN110490166A (en) | High iron catenary pipe cap automatic testing method based on depth learning technology | |
| Chen et al. | Research and implementation of robot path planning based on computer image recognition technology | |
| CN117288094B (en) | Real-time positioning system of heading machine based on laser sensor | |
| CN114359604A (en) | Formation recognition model construction method based on multi-aircraft trajectory data | |
| CN109753922A (en) | Anthropomorphic robot expression recognition method based on dense convolutional neural networks | |
| CN116861300B (en) | Automatic auxiliary labeling method and device for complex maneuvering data set of military machine type | |
| CN111272764B (en) | Non-contact image identification mobile management and control system and method for large intelligent temporary platform | |
| CN113313213B (en) | Data set processing method for accelerating training of target detection algorithm | |
| Tunca et al. | Determining the pointer positions of aircraft analog indicators using deep learning | |
| CN114662594A (en) | Target feature recognition analysis system | |
| Guo et al. | A Hybrid clustering method for bridge structure health monitoring | |
| Zhao et al. | Research and implementation on key technologies of assembly assistance system based on augmented reality | |
| CN114298183B (en) | Intelligent recognition method for flight actions | |
| CN110298287A (en) | A kind of power equipment automatic identifying method based on deep learning | |
| CN113554072B (en) | Flight action dividing method, computer readable storage medium and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |