CN115099607A - Test data fusion and evaluation management system - Google Patents
Test data fusion and evaluation management system Download PDFInfo
- Publication number
- CN115099607A CN115099607A CN202210706512.4A CN202210706512A CN115099607A CN 115099607 A CN115099607 A CN 115099607A CN 202210706512 A CN202210706512 A CN 202210706512A CN 115099607 A CN115099607 A CN 115099607A
- Authority
- CN
- China
- Prior art keywords
- data
- test
- evaluation
- module
- fusion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06313—Resource planning in a project environment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/904—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Abstract
The application relates to a test data fusion and evaluation management system, which comprises: and the test data management module is used for receiving, storing and retrieving management of multi-source test data. And the test data fusion module is in communication connection with the test data management module and is used for fusing and processing the equivalent device data of the control system, simulating the telemetering data and the test console data and outputting the flight missile path data and the system working state data. And the test result evaluation module is in communication connection with the test data management module and is used for performing post comprehensive test effect evaluation according to the post data provided by the test data management module and performing real-time online test effect evaluation according to external real-time data. And the scene display and visualization module is in communication connection with the test data management module and is used for performing data visualization display according to the data provided by the test data management module and external real-time data. The test data management efficiency is greatly improved.
Description
Technical Field
The invention belongs to the technical field of data processing, and relates to a test data fusion and evaluation management system.
Background
In the process of developing a world information simulation test, each simulation node needs to perform data transmission and interaction according to a specific test flow, and in order to judge the consistency of the world simulation information and the effectiveness of information transmission, a unified data storage and processing center is needed to finish unified summarization, storage and comparative analysis of data of each simulation node in the simulation test and evaluate a test result. However, in the process of implementing the present invention, the inventor finds that the conventional data system only provides conventional data acquisition management or single-mode data fusion processing, and does not provide business support of multi-node channel real-time monitoring, data unification and data real-time processing and post-processing, and cannot meet the one-stop whole-process service requirement of collection, storage, processing, comparison, fusion and analysis of simulation information of each device in the whole process of the world information simulation test, and has the technical problem of low test data management efficiency.
Disclosure of Invention
Aiming at the problems in the traditional method, the invention provides a test data fusion and evaluation management system which can greatly improve the management efficiency of test data.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
provided is a test data fusion and evaluation management system, comprising:
the test data management module is used for receiving, storing and retrieving management of multi-source test data;
the test data fusion module is in communication connection with the test data management module and is used for fusing and processing the data of the equivalent device of the control system, simulating the telemetering data and the data of the test console and outputting the flight missile way data and the system working state data;
the test result evaluation module is in communication connection with the test data management module and is used for carrying out post comprehensive test effect evaluation according to the post data provided by the test data management module and carrying out real-time online test effect evaluation according to external real-time data;
and the scene display and visualization module is in communication connection with the test data management module and is used for performing data visualization display according to the data provided by the test data management module and external real-time data.
In one embodiment, the test data management module comprises:
the channel management submodule is used for performing non-lost point receiving on multi-source test data by providing visual management and monitoring the working state of each communication channel;
the interactive instruction response submodule is used for inputting and analyzing an instruction of the human-computer interactive interface into a data management instruction; the data management instruction comprises data query requirements and retrieval keywords;
the data management instruction response submodule is used for analyzing the data management instruction into a data query or data insertion statement;
the data operation service sub-module is used for generating a database query or data insertion statement, submitting an SQL script to a database server and receiving execution result feedback;
the external data interface service submodule is used for respectively accessing the control system equivalent device data, the simulation telemetering data, the test console data and the test data and providing a data acquisition and management integrated interface;
and the man-machine interaction interface service submodule is used for providing a test data management man-machine interaction interface.
In one embodiment, the test data fusion module comprises:
the external interface service submodule is used for accessing the test data and the multi-source information and providing a data acquisition and management integrated interface; the multi-source information comprises control system equivalent device data, simulation telemetering data and test console data;
the data preprocessing submodule is used for carrying out coordinate conversion and data alignment processing on the test data and the multi-source information;
the fusion algorithm library submodule is used for providing the calling of a multi-sensor data fusion algorithm and a target tracking algorithm and responding the addition, modification and deletion of the algorithm;
the fusion result output submodule is used for submitting the fusion result to the test data management module for result data storage and outputting the fusion result to the human-computer interaction interface; the fusion result comprises flight missile path data and system working state data;
and the man-machine interaction interface submodule is used for displaying the decision-making auxiliary information according to the fusion structure.
In one embodiment, the process of invoking a multi-sensor data fusion algorithm and a target tracking algorithm to perform fusion tracking on the preprocessed multi-source information includes:
based on the multi-source information, generating an initial set by adopting a Monte Carlo method;
calculating a prediction set and a prediction state mean value by using the initial set;
calculating a Kalman gain matrix of the ensemble Kalman filtering according to the prediction ensemble and the prediction state mean value;
calculating an analysis set, an analysis state mean value and an analysis state error covariance of the set Kalman filtering according to the Kalman gain matrix;
determining whether tracking is finished;
and if so, outputting the filtered target state, otherwise, returning to the step of calculating the prediction set and the mean value of the prediction state by utilizing the initial set.
In one embodiment, the test result evaluation module comprises:
the index management submodule is used for executing index system construction and index parameter configuration processing;
the evaluation submodule is used for executing single-item capability evaluation, target threat rating and comprehensive capability evaluation according to the data provided by the test data management module and the called index parameters to generate an evaluation result;
the sensitivity analysis submodule is used for analyzing the influence degree of the single index on the target according to the called index and the evaluation result to generate an analysis result;
the evaluation result display submodule is used for performing information display, decision auxiliary information feedback, result data storage and evaluation report generation according to the evaluation result and the analysis result; the information display comprises evaluation scene display, dynamic result change display and evaluation result comparison display.
In one embodiment, the index normalization processing method adopted by the index management sub-module comprises a linear type processing method, a curve type normalization processing method and a broken line type normalization processing method.
In one embodiment, the index management sub-module adopts an index synthesis method including weighted synthesis, ideal point, grey correlation degree or fuzzy synthesis judgment.
In one embodiment, the sensitivity analysis sub-module performs the sensitivity analysis by numerical differentiation.
In one embodiment, the information is displayed in a manner including a spreadsheet display and/or a graphical display.
In one embodiment, the scene display and visualization module comprises:
the data interface service sub-module is used for analyzing the data access instruction in the process of post playback and submitting a query request to the test data management module;
the data classification display submodule is used for graphically displaying the test data and the system working state;
the two-dimensional scene display submodule is used for displaying the target track on a two-dimensional map, updating the target track in real time and responding to the translation and zooming operations of the map;
and the evaluation result display submodule is used for displaying the evaluation result output by the test result evaluation module in a chart form on line.
One of the above technical solutions has the following advantages and beneficial effects:
according to the test data fusion and evaluation management system, through the adoption of the system design of the test data management module, the test data fusion module, the test result evaluation module and the scene display and visualization module, the test data management module provides the functions of receiving, storing and managing multi-source data; the test data fusion module provides flight missile path data and system working state data by processing the equivalent device data of the control system, the simulation telemetering data and the test console data, and provides auxiliary information for flight control decision; the test result evaluation module provides a data analysis and test effect evaluation function, the scene display and visualization module provides a data visualization display function in the modes of curves, charts, bar charts and the like, and dynamic updating and system working state display are supported, so that the one-stop whole-process service requirement of collection, storage, processing, comparison, fusion and analysis of simulation information of all devices in the whole process of the world information simulation test is met, and the purpose of greatly improving the test data management efficiency is achieved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments or the conventional technologies of the present application, the drawings used in the descriptions of the embodiments or the conventional technologies will be briefly introduced below, it is obvious that the drawings in the following descriptions are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of a test data fusion and evaluation management system according to an embodiment;
FIG. 2 is a block diagram of an embodiment of a test data management module;
FIG. 3 is a schematic diagram of an interface design of a test data management module in one embodiment;
FIG. 4 is a schematic diagram of the configuration of the test data fusion module in one embodiment;
FIG. 5 is a schematic diagram of an interface design of a test data fusion module in one embodiment;
FIG. 6 is a schematic flow diagram of an embodiment of an ensemble Kalman filtering based target tracking algorithm;
FIG. 7 is a schematic illustration of a data fusion process in one embodiment;
FIG. 8 is a schematic diagram of the test result evaluation module in one embodiment;
FIG. 9 is a schematic diagram of the interface design of the test result evaluation module in one embodiment;
FIG. 10 is a diagram illustrating the structure of a scene display and visualization module according to an embodiment;
FIG. 11 is a diagram illustrating a design of an interface for a scene display and visualization module, according to an embodiment;
FIG. 12 is a block diagram illustrating an exemplary embodiment of a test data fusion and evaluation management system.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad application.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.
It should be appreciated that reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments.
One skilled in the art will appreciate that the embodiments described herein can be combined with other embodiments. The term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items and includes such combinations.
In research work, the test data fusion processing and evaluation management system can be deployed based on data fusion and processing equipment (such as a high-performance server) and used as a data center of a task monitoring simulation test, and is used for realizing interconnection and intercommunication with other simulation equipment in a simulation verification platform based on a high-performance network switch and completing functions of simulation information collection, storage, processing, comparison, fusion, analysis and the like of each equipment in the whole process of the simulation test, so that the consistency of information transmission and the effectiveness of the test in a task monitoring closed-loop simulation mode are evaluated.
The following detailed description of the embodiments of the invention will be made with reference to the accompanying drawings.
Referring to fig. 1, in one embodiment, a test data fusion and evaluation management system 100 is provided in the present application, and includes a test data management module 12, a test data fusion module 14, a test result evaluation module 16, and a scene display and visualization module 18. The test data management module 12 is used for receiving, storing and retrieving management of multi-source test data. The test data fusion module 14 is in communication connection with the test data management module 12, and is used for fusing and processing the data of the equivalent device of the control system, simulating the telemetering data and the data of the test console, and outputting the flight missile path data and the system working state data. The test result evaluation module 16 is in communication connection with the test data management module 12, and is configured to perform post-test comprehensive effect evaluation according to the post data provided by the test data management module 12, and perform real-time online test effect evaluation according to external real-time data. The scene display and visualization module 18 is in communication connection with the test data management module 12, and is configured to perform data visualization display according to the data provided by the test data management module 12 and the external real-time data.
It will be appreciated that the major external sources of information in a mission monitoring simulation experiment may include control system equivalents, telemetry data sources, and test consoles. The communication connection between the modules may be a wired communication connection or a wireless communication connection as long as the required data transmission function can be realized. The test data management module 12 is configured to provide a required data management function, and according to the reception and storage of test data, the test data management module can perform unified management on each information source data and wireless channels, and can query a database according to the requirements of a user, so as to facilitate searching and retrieving test information in time, and maintain the database, for example, having management functions of editing, updating, adding, deleting data entries, and the like. The test data may include test generation data associated with the task in the task monitoring simulation test.
The test data fusion module 14 is configured to provide a required data fusion function, fuse and correlate related test data (for example, control system equivalent device data, analog telemetry data, and test console data), provide prompts such as task change and safety control implementation based on a fusion result, and provide decision support for a command center simulation node.
The test result evaluation module 16 is used for providing a required test result evaluation function, and performing test result evaluation under a specific combat mission background and an environmental condition based on data fusion and processing results and in combination with a full simulation system operation flow. The scene display and visualization module 18 is used to provide a multi-dimensional scene display function, and can display and display the experimental information flow, the flight trajectory change, the target point damage, and the like in a highly dynamic manner, and at the same time, can provide a display interface of detailed experimental data, and can display the experimental data in multiple manners (such as, but not limited to, in different areas, in a manner of report, curve, graph, and bar graph, and the like).
In the test data fusion and evaluation management system 100, the test data management module 12 provides the receiving, storing and managing functions of multi-source data by adopting the system design of the test data management module 12, the test data fusion module 14, the test result evaluation module 16 and the scene display and visualization module 18; the test data fusion module 14 provides flight missile way data and system working state data by processing the data of the equivalent device of the control system, the simulation telemetering data and the data of the test console, and provides auxiliary information for flight control decision; the test result evaluation module 16 provides a data analysis and test effect evaluation function, the scene display and visualization module 18 provides a data visualization display function in the form of curves, charts, bar charts and the like, and supports dynamic update and system working state display, so that the one-stop whole-process service requirement of collection, storage, processing, comparison, fusion and analysis of simulation information of each device in the whole process of a world information simulation test is met, and the purpose of greatly improving the test data management efficiency is achieved.
In one embodiment, as shown in fig. 2, the test data management module 12 includes a channel management sub-module 121, an interactive command response sub-module 122, a data management command response sub-module 123, a data manipulation service sub-module 124, an external data interface service sub-module 125, and a man-machine interaction interface service sub-module 126. The channel management submodule 121 is configured to perform non-missing point reception of multi-source test data by providing visual management for each communication channel and monitoring the operating state of each communication channel. The interactive instruction response submodule 122 is configured to parse an instruction input of the human-computer interaction interface into a data management instruction. The data management command comprises a data query requirement and a retrieval keyword. The data management instruction response sub-module 123 is configured to parse the data management instruction into a data query or a data insertion statement. The data operation service sub-module 124 is configured to generate a database query or a data insertion statement, submit an SQL script to the database server, and receive an execution result feedback. The external data interface service submodule 125 is used for accessing the control system equivalent device data, the simulation telemetering data, the test console data and the test data respectively, and providing a data acquisition and management integrated interface. The human-computer interaction interface service sub-module 126 is used for providing a test data management human-computer interaction interface.
It can be understood that the test data management module 12 mainly includes a channel management sub-module 121, an interactive instruction response sub-module 122, a data management instruction response sub-module 123, a data operation service sub-module 124, an external data interface service sub-module 125, and a man-machine interaction interface service sub-module 126 according to different functions. The channel management submodule 121 provides a communication channel visualization management function, monitors the working state of each channel, and ensures that the multi-source information is received without losing points.
The interactive instruction response sub-module 122 is responsible for responding to the input of the human-computer interactive interface instruction, resolving the input of the human-computer interactive interface instruction into a data query requirement and a retrieval keyword, and transmitting a data management instruction to a next module. The data management instruction response submodule 123 is responsible for responding to the data management instruction, parsing the data management instruction into a data query statement or a data insertion statement, and submitting the data query statement or the data insertion statement to the data operation service submodule 124. The data operation service sub-module 124 is mainly responsible for generating a database query statement or an insertion statement, submitting an SQL script to a database server configured by the task, and receiving an execution result feedback.
The external data interface service sub-module 125 provides input of control system equivalent device test data, test console data, telemetry data and other test data, provides a multi-source information receiving function, and provides a data acquisition and management integrated interface. The man-machine interface service sub-module 126 provides a man-machine interface for test data management, for example, as shown in fig. 3, which is a schematic interface relationship diagram of the test data management module 12. Through each submodule, each required data management function is sufficiently supported, and the function realization structure is simple and efficient.
In one embodiment, as shown in fig. 4, the test data fusion module 14 includes an external interface service sub-module 141, a data preprocessing sub-module 142, a fusion algorithm library sub-module 143, a fusion result output sub-module 144, and a human-machine interface sub-module 145. The external interface service submodule 141 is configured to access test data and multi-source information, and provide an integrated interface for data acquisition and management. The multi-source information includes control system equivalent device data, analog telemetry data and test console data. The data preprocessing submodule 142 is configured to perform coordinate transformation and data alignment processing on the test data and the multi-source information. The fusion algorithm library submodule 143 is configured to provide invocation of a multi-sensor data fusion algorithm and a target tracking algorithm, and to respond to addition, modification, and deletion of algorithms. The fusion result output submodule 144 is configured to submit the fusion result to the test data management module 12 for result data storage, and output the fusion result to the human-computer interaction interface; the fusion result comprises flight missile path data and system working state data. The human-computer interaction interface sub-module 145 is used for displaying the decision-making auxiliary information according to the fusion structure.
It can be understood that the test data fusion module 14 mainly includes an external interface service sub-module 141, a data preprocessing sub-module 142, a fusion algorithm library sub-module 143, a fusion result output sub-module 144, and a human-computer interaction interface sub-module 145 according to different functions. The test data fusion module 14 provides flight ballistic data and system operating state data by processing control system equivalent device data, test console data and analog telemetry data and using a state estimator such as Kalman filtering, and provides auxiliary information for flight control decisions.
Specifically, the external interface service sub-module 141 provides the functions of inputting test data of the simulation system and receiving multi-source information, and provides an integrated interface for data acquisition and management. The data preprocessing sub-module 142 performs preprocessing operations such as coordinate transformation and data alignment on the raw information of the data (for example, estimating a local target track based on the data measured by each sensor in the task monitoring simulation test). The fusion algorithm library submodule 143 provides for the invocation of various multi-sensor data fusion algorithms and target tracking algorithms, and supports operations such as addition, modification, deletion, and the like of algorithms. The fusion result output sub-module 144 submits the result data to the test data management module 12 for result data storage management according to the fusion result, and can output the result data to the human-computer interaction interface sub-module 145. The human-machine interface sub-module 145 provides a human-machine interface for presenting the user decision assistance information (e.g., flight trajectory data and system operating status data in the aforementioned fusion results).
Fig. 5 is a schematic diagram of the interface relationship of the test data fusion module 14. Through the sub-modules, the required data fusion processing functions are sufficiently supported, and the interface complexity is not high.
In an embodiment, a processing procedure of invoking a multi-sensor data fusion algorithm and a target tracking algorithm to perform fusion tracking on the preprocessed multi-source information, as shown in fig. 6, includes the following processing flows:
based on the multi-source information, generating an initial set by adopting a Monte Carlo method;
calculating a prediction set and a prediction state mean value by using the initial set;
calculating a Kalman gain matrix of the ensemble Kalman filtering according to the prediction ensemble and the prediction state mean value;
calculating an analysis set, an analysis state mean value and an analysis state error covariance of the set Kalman filtering according to the Kalman gain matrix;
determining whether tracking is finished;
and if so, outputting the filtered target state, otherwise, returning to the step of calculating the prediction set and the mean value of the prediction state by utilizing the initial set.
It can be understood that in the data fusion function, a distributed fusion method is to be adopted. Specifically, each sensor in the task monitoring simulation test has an independent tracking filter, local target tracks are estimated based on measured data and are sent to a fusion center, the fusion center performs space alignment and time calibration on the local target tracks, then performs track association, and selects a proper fusion algorithm to perform track fusion. The data fusion process is shown in fig. 7.
Preferably, the fusion algorithm mainly adopts a nonlinear target tracking algorithm comprehensively utilizing an ensemble Kalman filtering technology and a particle filtering technology, an initial ensemble is generated by a blocking idea, and covariance weighted fusion is performed among blocks. The method is characterized in that an ensemble Kalman filtering algorithm and a particle filtering algorithm are effectively combined together, two independent sets are adopted, firstly, one independent set is used for carrying out ensemble Kalman filtering, and then, an analysis set of the ensemble Kalman filtering and the other independent set are used for forming reference distribution of the particle filtering, so that the particle filtering mode is carried out. The algorithm has the advantages of integrating a Kalman filtering algorithm and a particle filtering algorithm, can process the problem that the observation noise of the sensor is non-Gaussian, reduces the measurement error of the sensor, improves the tracking performance of the system, meets the real-time tracking requirement, and has the specific processing flow as shown in FIG. 6.
In one embodiment, as shown in fig. 8, the test result evaluation module 16 includes an index management sub-module 161, an evaluation sub-module 162, a sensitivity analysis sub-module 163, and an evaluation result presentation sub-module 164. The index management sub-module 161 is configured to perform index system construction and index parameter configuration processing. The evaluation submodule 162 is configured to perform single capability evaluation, target threat rating, and comprehensive capability evaluation according to the data provided by the test data management module 12 and the called index parameter, and generate an evaluation result. The sensitivity analysis submodule 163 is configured to perform analysis on the degree of influence of the single index on the target according to the called index and the evaluation result, and generate an analysis result. The evaluation result display submodule 164 is configured to perform information display, decision auxiliary information feedback, result data storage and evaluation report generation according to the evaluation result and the analysis result; the information display comprises evaluation scene display, dynamic result change display and evaluation result comparison display.
It can be understood that the test result evaluation module 16 can be developed and implemented based on a generalized combat effectiveness evaluation toolkit, and can provide functions of self-defining effectiveness indexes, index system editing, index normalization and empowerment aggregation methods, sensitivity analysis and the like. And aiming at different simulation tests, respectively and dynamically establishing an evaluation index system, and counting based on test results to obtain corresponding evaluation index values. The test result evaluation can be divided into real-time online evaluation and post comprehensive evaluation according to different data acquisition modes. The real-time online evaluation supports dynamic index editing and management, online data acquisition and analysis warehousing, online evaluation resolving, evaluation result display and decision information feedback. The post comprehensive evaluation supports single task evaluation and multi-task evaluation result comparison, and single capability evaluation and comprehensive capability evaluation are provided.
Specifically, the index management sub-module 161 may include two parts, one is an index architecture building for configuring a corresponding index architecture. And the index parameter processing is used for selecting different normalization processing methods for index processing according to different index characteristics. The evaluation submodule 162 may be divided into three large blocks: the method comprises the following steps of single capability evaluation, target threat rating and comprehensive capability evaluation, wherein the single capability evaluation refers to the evaluation of a capability index layer, and is the comprehensive evaluation on the basis of a performance index layer; the target threat rating means rating according to the target threat degree; the comprehensive capability is that after weights of different targets are distributed, comprehensive evaluation is carried out to obtain an evaluation result of the whole task.
The sensitivity analysis sub-module 163 is used for analyzing the degree of influence of the single index on the target after the comprehensive evaluation is completed. The evaluation result display submodule 164 implements functions of information display such as evaluation scene display, dynamic result change, evaluation result comparison, and the like. Fig. 9 is a schematic diagram of the interface relationship of the test result evaluation module 16. Wherein the external interface is operable to: the evaluation data can be loaded through the test data management module 12; the data service request module is used for storing the evaluation process data and the result; after the evaluation is finished, forming a word evaluation report by the evaluation result through a report generation interface by a user; and with respect to the internal interface: the main interface of the index management submodule 161 includes configuration, display, parameter input and parameter processing of evaluation indexes, and stores the index architecture through the test data management module 12; the main interface of the evaluation submodule 162 has a selection evaluation item, an evaluation method and evaluation calculation, and the result is stored through the test data management module 12; the sensitivity analysis sub-module 163 loads the comprehensive evaluation result, selects important indexes therein to perform sensitivity analysis and display, and can store the important indexes through the test data management module 12; the evaluation result display sub-module 164 may view the evaluation result by selecting a task, select a multitask evaluation result for comparison display, and generate a word report document.
Through the sub-modules, the efficient implementation of the required test result evaluation function is sufficiently supported.
In one embodiment, the index management sub-module employs index normalization processing methods including a linear type processing method, a curved type normalization processing method, and a broken line type normalization processing method.
Specifically, regarding the index processing, different normalization processing methods can be selected according to different index characteristics. The linear processing method comprises the following steps: when the data characteristics of the indexes are simple, the linear normalization processing method is convenient to process, and the processing result is relatively accurate. However, for complex indexes, the data characteristics of each index are not considered, and the influence of the index value on the evaluation value is processed in equal proportion, so that the evaluation result is greatly different from the real situation.
Compared with a linear normalization processing method, the curve normalization processing method better considers the data characteristics of the indexes and processes the indexes more finely. It also presents two major problems: firstly, the selection of the normalization processing formula is very difficult, and secondly, the precision of the evaluation value can not be ensured on the premise that the parameters in the processing model can not be accurately determined. In addition, in view of the disadvantages of the two processing methods, the present embodiment may also adopt a broken-line normalization processing method, i.e. segmentation of the straight-line processing method or linear approximation of the curved-line processing method. Thus, the required index processing function can be realized more efficiently.
In one embodiment, the index management sub-module adopts an index integration method comprising weighted integration, ideal point, grey correlation degree or fuzzy integration judgment.
Specifically, the conventional methods commonly used in the index synthesis method include weighted synthesis, ideal points, grey correlation degree and fuzzy synthesis evaluation. The fuzzy comprehensive evaluation can well solve the problems of uncertainty and ambiguity of qualitative evaluation index limits, so that semi-qualitative and semi-quantitative problems are converted into quantitative problems to be analyzed, and the fuzzy comprehensive evaluation can be used as an optimal scheme.
In one embodiment, the sensitivity analysis sub-module performs the sensitivity analysis by numerical differentiation. Specifically, sensitivity analysis can be performed through numerical differentiation, different index data are perturbed, and the degree of influence of the sensitivity analysis on the evaluation result is efficiently analyzed.
In one embodiment, the manner of information presentation includes a spreadsheet presentation and/or a graphical display. Optionally, the evaluation result may be, but not limited to, presented in a data table, a graph display, or the like, and result files in the formats of JPG, Word, or the like may be derived. And the other is to feed the evaluation result as decision auxiliary information back to the equivalent control system, and the evaluation result can be transmitted through a TCP/IP protocol.
In one embodiment, as shown in fig. 10, the scene display and visualization module 18 includes a data interface service sub-module 181, a data classification display sub-module 182, a two-dimensional scene display sub-module 183, and an evaluation result display sub-module 184. The data interface service sub-module 181 is configured to parse the data access instruction during the post playback process and to submit a query request to the test data management module 12. The data classification display sub-module 182 is used for graphically displaying the test data and the system working state. The two-dimensional scene display sub-module 183 is configured to display the target trajectory on the two-dimensional map, perform real-time update, and respond to map translation and zoom operations. The evaluation result display sub-module 184 is configured to display the evaluation result output by the test result evaluation module 16 in a graph form on line.
Specifically, the data interface service sub-module 181 parses the data access instruction in the post playback process, and submits a query request to the test data management module 12. The assessment results display sub-module 184 may be coupled to the test results assessment module 16 to display the online assessment results in a graphical format. The two-dimensional scene display submodule 183 displays a target trajectory on a two-dimensional map, supports real-time updating, and supports common operations such as map translation and scaling. The data classification display sub-module 182 can represent the test data and the system working state in the form of a column chart, a curve and a chart, and supports selection of the concerned parameter comparison, observation range selection and display theme replacement.
Fig. 11 is a schematic diagram illustrating the interface relationship between the scene display and the visualization module 18. The required scene display and data visualization functions can be efficiently supported through the sub-modules.
In one embodiment, in practical applications, as shown in fig. 12, the performance of the above-mentioned experimental data fusion and evaluation management system 100 can support: multi-source data non-lost point receiving; analyzing and judging the upper and lower limits of the real-time data; the real-time test data acquisition frequency is 200 frames/second, and the data volume is 10K/second; the real-time test data can be displayed in different areas in the modes of curves, graphs, histograms and the like; the data display can carry out visual editing and maintenance on the publishing and browsing interface under the condition of not modifying the program; the real-time data refreshing time is less than 0.2 second; the data display mode and the data display type are configurable; the database has the functions of inquiring, updating, modifying, deleting, importing and exporting data and the like; the historical test data realizes the functions of single test playback and multiple test contrast display.
The interface design of the system is simple and clear, the operation is smooth, and the system accords with the general Windows software interface design specification. And a complete fault reporting and processing mechanism is provided. The average failure-free time is more than 5000 hours, and the average failure recovery time is less than 1 hour. The system network preferably adopts 1000M Ethernet, data are exchanged through a core switch, and the core switch is physically isolated from other networks to ensure information security.
The modules in the test data fusion and evaluation management system 100 may be implemented in whole or in part by software, hardware, or a combination thereof. The modules may be embedded in a high-performance server device in a hardware form or independent from a specific data processing function, or may be stored in a memory of the device in a software form, so that a processor may invoke and execute operations corresponding to the modules.
Each module of the test data fusion and evaluation management system 100 can be constructed by using an existing programming language in the computer field and using an existing programming method, so as to realize the corresponding function of each module. The system can run on a server and a computer terminal, such as SAS hot-plug hard disks with more than 2.0GHz main frequency, more than 16GB memory and more than 200GB memory, a server supporting an RAID mode, or a computer terminal of an operating system with more than 2.0 main frequency, more than 4G memory and more than Window XP.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for those skilled in the art, various changes and modifications can be made without departing from the spirit of the present application, and all of them fall within the scope of the present application. Therefore, the protection scope of the present patent should be subject to the appended claims.
Claims (10)
1. A test data fusion and evaluation management system is characterized by comprising:
the test data management module is used for receiving, storing and retrieving management of multi-source test data;
the test data fusion module is in communication connection with the test data management module and is used for fusing and processing the data of the equivalent device of the control system, simulating the telemetering data and the data of the test console and outputting the flight missile way data and the system working state data;
the test result evaluation module is in communication connection with the test data management module, and is used for performing post comprehensive test effect evaluation according to the post data provided by the test data management module and performing real-time online test effect evaluation according to external real-time data;
and the scene display and visualization module is in communication connection with the test data management module and is used for performing data visualization display according to the data provided by the test data management module and external real-time data.
2. The experimental data fusion and evaluation management system of claim 1, wherein the experimental data management module comprises:
the channel management submodule is used for performing non-lost point receiving on multi-source test data by providing visual management of each communication channel and monitoring the working state of each communication channel;
the interactive instruction response submodule is used for inputting and analyzing an instruction of the human-computer interactive interface into a data management instruction; the data management instruction comprises a data query requirement and a retrieval keyword;
the data management instruction response submodule is used for analyzing the data management instruction into a data query or data insertion statement;
the data operation service sub-module is used for generating the database query or data insertion statement, submitting an SQL script to a database server and receiving the feedback of the execution result;
the external data interface service submodule is used for respectively accessing the control system equivalent device data, the simulation telemetering data, the test console data and the test data and providing a data acquisition and management integrated interface;
and the man-machine interaction interface service submodule is used for providing a test data management man-machine interaction interface.
3. The experimental data fusion and evaluation management system of claim 1, wherein the experimental data fusion module comprises:
the external interface service submodule is used for accessing the test data and the multi-source information and providing a data acquisition and management integrated interface; the multi-source information includes the control system equivalent device data, the analog telemetry data, and the test console data;
the data preprocessing submodule is used for carrying out coordinate conversion and data alignment processing on the test data and the multi-source information;
the fusion algorithm library submodule is used for providing the calling of a multi-sensor data fusion algorithm and a target tracking algorithm and responding the addition, modification and deletion of the algorithm;
the fusion result output submodule is used for submitting the fusion result to the test data management module for result data storage and outputting the fusion result to a human-computer interaction interface; the fusion result comprises the flight missile path data and the system working state data;
and the man-machine interaction interface submodule is used for displaying the decision auxiliary information according to the fusion structure.
4. The test data fusion and evaluation management system of claim 3, wherein the process of invoking the multi-sensor data fusion algorithm and the target tracking algorithm to perform fusion tracking on the preprocessed multi-source information comprises:
generating an initial set by adopting a Monte Carlo method based on the multi-source information;
calculating a prediction set and a prediction state mean value by using the initial set;
calculating a Kalman gain matrix of the ensemble Kalman filtering according to the prediction ensemble and the prediction state mean value;
calculating an analysis set, an analysis state mean value and an analysis state error covariance of the set Kalman filtering according to the Kalman gain matrix;
determining whether tracking is finished;
and if so, outputting the filtered target state, otherwise, returning to the step of calculating the prediction set and the mean value of the prediction state by utilizing the initial set.
5. The test data fusion and evaluation management system of claim 1, wherein the test result evaluation module comprises:
the index management submodule is used for executing index system construction and index parameter configuration processing;
the evaluation submodule is used for executing single-item capability evaluation, target threat rating and comprehensive capability evaluation according to the data provided by the test data management module and the called index parameters to generate an evaluation result;
the sensitivity analysis submodule is used for analyzing the influence degree of the single index on the target according to the called index and the evaluation result to generate an analysis result;
the evaluation result display submodule is used for carrying out information display, decision auxiliary information feedback, result data storage and evaluation report generation according to the evaluation result and the analysis result; the information display comprises evaluation scene display, dynamic result change display and evaluation result comparison display.
6. The test data fusion and evaluation management system of claim 5, wherein the index management sub-module employs index normalization processing methods including a linear type processing method, a curved type normalization processing method, and a broken line type normalization processing method.
7. The test data fusion and evaluation management system according to claim 5, wherein the index integration method adopted by the index management sub-module includes weighted integration, ideal point, grey correlation degree or fuzzy comprehensive evaluation.
8. The test data fusion and evaluation management system of claim 5, wherein the sensitivity analysis sub-module performs sensitivity analysis by numerical differentiation.
9. The experimental data fusion and evaluation management system of claim 5, wherein the information presentation comprises a spreadsheet presentation and/or a graphical presentation.
10. The experimental data fusion and evaluation management system of claim 1, wherein the scene display and visualization module comprises:
the data interface service sub-module is used for analyzing the data access instruction in the process of post playback and submitting a query request to the test data management module;
the data classification display submodule is used for graphically displaying the test data and the system working state;
the two-dimensional scene display submodule is used for displaying the target track on a two-dimensional map, updating the target track in real time and responding to the translation and zooming operations of the map;
and the evaluation result display submodule is used for displaying the evaluation result output by the test result evaluation module in a chart form on line.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210706512.4A CN115099607A (en) | 2022-06-21 | 2022-06-21 | Test data fusion and evaluation management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210706512.4A CN115099607A (en) | 2022-06-21 | 2022-06-21 | Test data fusion and evaluation management system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115099607A true CN115099607A (en) | 2022-09-23 |
Family
ID=83293081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210706512.4A Pending CN115099607A (en) | 2022-06-21 | 2022-06-21 | Test data fusion and evaluation management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115099607A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115577317A (en) * | 2022-09-30 | 2023-01-06 | 北京大数据先进技术研究院 | Data fusion effect evaluation method and system, electronic device and storage medium |
| CN116432472A (en) * | 2023-04-27 | 2023-07-14 | 中国人民解放军国防科技大学 | Comprehensive analysis and evaluation system and method for target range joint simulation test data |
-
2022
- 2022-06-21 CN CN202210706512.4A patent/CN115099607A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115577317A (en) * | 2022-09-30 | 2023-01-06 | 北京大数据先进技术研究院 | Data fusion effect evaluation method and system, electronic device and storage medium |
| CN115577317B (en) * | 2022-09-30 | 2024-04-05 | 北京大数据先进技术研究院 | Data fusion effect evaluation method, system, electronic equipment and storage medium |
| CN116432472A (en) * | 2023-04-27 | 2023-07-14 | 中国人民解放军国防科技大学 | Comprehensive analysis and evaluation system and method for target range joint simulation test data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10983994B2 (en) | Partition access method for query optimization | |
| CN110795509B (en) | Method and device for constructing index blood-margin relation graph of data warehouse and electronic equipment | |
| CN115099607A (en) | Test data fusion and evaluation management system | |
| US6622221B1 (en) | Workload analyzer and optimizer integration | |
| CN109710678B (en) | Real-time data system for industrial big data monitoring management and operation method | |
| US11055359B2 (en) | Hierarchical objects linkage data visualization | |
| US11537496B2 (en) | Audit logging database system and user interface | |
| EP3340078A1 (en) | Interactive user interface for dynamically updating data and data analysis and query processing | |
| US20200219006A1 (en) | Efficient data relationship mining using machine learning | |
| US20230359675A1 (en) | Chart-based time series regression model user interface | |
| CN114638234B (en) | Big data mining method and system applied to online business handling | |
| CN113159615A (en) | Intelligent information security risk measuring system and method for industrial control system | |
| US11948116B2 (en) | Systems and methods for risk data navigation | |
| CN112949269A (en) | Method, system, equipment and storage medium for generating visual data analysis report | |
| CN115640300A (en) | Big data management method, system, electronic equipment and storage medium | |
| HongJu et al. | Some key problems of data management in army data engineering based on big data | |
| CN111639121A (en) | Big data platform and method for constructing customer portrait | |
| CN114511353A (en) | Data analysis method and device | |
| Niu | Optimization of teaching management system based on association rules algorithm | |
| CN109828984B (en) | Analysis processing method and device, computer storage medium and terminal | |
| CN114691882A (en) | Multi-source data real-time calculation method and device, storage medium and equipment | |
| CN115803729A (en) | Direct data loading of middleware generated records | |
| Shao et al. | Optimization research of information management system based on big data technology | |
| US20160247077A1 (en) | System and method for processing raw data | |
| US20240143581A1 (en) | Graphic visualization of complex hierarchy data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |