CN116384341A - Engine test data processing method, storage medium and equipment - Google Patents

Engine test data processing method, storage medium and equipment Download PDF

Info

Publication number
CN116384341A
CN116384341A CN202211626632.XA CN202211626632A CN116384341A CN 116384341 A CN116384341 A CN 116384341A CN 202211626632 A CN202211626632 A CN 202211626632A CN 116384341 A CN116384341 A CN 116384341A
Authority
CN
China
Prior art keywords
data
file
parameter name
header
engine test
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211626632.XA
Other languages
Chinese (zh)
Inventor
陈海峰
刘晓娜
左明聪
罗军
刘晓
赵海楠
赵金珊
朱丹波
李万杰
路泽鑫
朱小江
王浩
黄立还
姚羽佳
赵涛
赵娜
安勇旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Aerospace Propulsion Testing Technique Institute
Original Assignee
Xian Aerospace Propulsion Testing Technique Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Aerospace Propulsion Testing Technique Institute filed Critical Xian Aerospace Propulsion Testing Technique Institute
Priority to CN202211626632.XA priority Critical patent/CN116384341A/en
Publication of CN116384341A publication Critical patent/CN116384341A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/12Use of codes for handling textual entities
    • G06F40/151Transformation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/174Form filling; Merging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/20Natural language analysis
    • G06F40/205Parsing
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention provides an engine test data processing method, a computer readable storage medium and terminal equipment, which are used for processing and analyzing text files with header + data, and can realize automatic format switching and data analysis of large-scale data of the type, and have the advantages of high data processing speed and high efficiency. In addition, the data can be processed by combining MATLAB and office and displayed in a form and a graph format, so that the error rate is greatly reduced while the efficiency is high, and the whole processing flow is simplified.

Description

Engine test data processing method, storage medium and equipment
Technical Field
The invention belongs to a data processing method, and particularly relates to an engine test data processing method, a computer readable storage medium and terminal equipment.
Background
At present, the process of engine test data processing is complicated, and the engine test data processing generally comprises the following steps: data processing, format typesetting, data summarization, data comparison analysis and data report generation. The data processing is mainly to collect and acquire the data of each measurement parameter according to the outline requirement of the test; the purpose of format typesetting is that the format of the data file processed by the acquisition software is disordered, and manual format adjustment is needed, so that the data volume is large, the parameters are more, the data processing workload is large, and errors are easy to occur; the data summarization mainly comprises the steps of sorting and classifying data result files obtained after data processing; the data comparison analysis is to compare and analyze the processed data with the past test data of the same model number to determine whether the data is abnormal in processing or whether the measurement state has problems; the data report generation is a process of writing the data processed in the steps into a standard report file according to the requirement of the test outline on the data. In the process of processing data, format typesetting and data comparison analysis are completed manually, the occupied proportion is large in the whole processing process, so that the data processing efficiency is low, errors are unavoidable due to large workload, and the data processing reliability is reduced.
The difficulty of format typesetting is mainly the following: 1. the data acquisition equipment is more in types, the equipment is manufactured by different manufacturers, the obtained text data format content has larger difference, and the data files have the common point that the text data format is displayed in a form of header plus data, and the header and the data are an integral file and cannot be directly divided, so that the data parameters cannot be directly extracted and analyzed; 2. when a text data file is imported into data processing software (such as EXCEL and ORIGIN), the processing software cannot correctly identify the content of the data file due to the existence of the header, and the header needs to be manually deleted and parameter name information needs to be added to correspond to the data column. Therefore, when the number of data files is large, the amount of data of the data parameters is large, and the manual processing is relied on, so that time and labor are wasted, and errors are easy to occur in the extraction process. In addition, the data comparison and analysis process is complicated, the data analysis is needed to be carried out in steps, the data result generated in each step can be processed in the next step after being manually operated, a finally needed report is regenerated, and if the middle analysis process is more, the working efficiency is greatly reduced, and the error rate is higher.
Disclosure of Invention
The invention provides an engine test data processing method, a computer readable storage medium and terminal equipment, which are used for solving the technical problems that in the existing engine test data processing process, format typesetting and data comparison and analysis are manually completed, so that the processing efficiency is low and errors are easy to occur.
In order to achieve the purpose, the invention is realized by adopting the following technical scheme:
the engine test data processing method is characterized by comprising the following steps of:
s1, separating a header of a data result file from data;
s2, positioning data corresponding to each parameter name in the header according to the sampling frequency, the data line number and the data byte number in the header;
s3, grouping the data according to the data corresponding to each parameter name to obtain a plurality of data groups;
s4, respectively and independently storing all parameter names and data groups to form a parameter name file and a plurality of data group files, and forming a mapping relation between the parameter name file and the data group files;
s5, reading the parameter name file and each data group file, importing the parameter name file and each data group file into a working memory space of the MATLAB by utilizing an OLE technology, and calling an internal data processing algorithm of the MATLAB program to perform data processing and calculation to obtain a calculation result;
s6, the calculation result is associated with the parameter name in the office in the format of a data table and a graph through a link and embedding mechanism between the VBA and the document.
Further, step S0 is further included before step S1, and the data result file is converted into a text format file; in step S4, the independent storage is specifically stored in a text file independently.
Further, the step S1 specifically includes:
if the parameter names in the header have identification features, distinguishing the header and the data by reading the row where the identification features are located; otherwise, scanning the data result file line by line, analyzing the corresponding parameter name characteristics by combining the key word information with the symbol, and distinguishing the header and the data.
Further, in step S2, the data corresponding to each parameter name in the header is located by the product of the sampling frequency, the data line number and the data byte number.
Further, in step S5, the reading of the parameter name file and each data set file is specifically that, according to the sizes of the parameter name file and each data set file, the required total memory storage space is calculated, and according to the size of the total memory storage space, the number of memory blocks is allocated, and the parameter name file and each data set file are stored in each memory block;
in step S5, the importing the parameter name file and each data set file into the working memory space of the MATLAB is specifically that the parameter name file and each data set file are sequentially imported into the working memory space of the MATLAB according to the order of generating the memory blocks.
Further, step S7 is further included after step S6, and word writing is performed to generate a result report.
The invention also proposes a computer-readable storage medium on which a computer program is stored, characterized in that the program, when executed by a processor, implements the steps of an engine test data processing method as described above.
In addition, the invention also provides a terminal device which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, and is characterized in that the steps of the engine test data processing method are realized when the processor executes the computer program.
Compared with the prior art, the invention has the following beneficial effects:
1. the invention provides an engine test data processing method, which is used for processing and analyzing data aiming at a text file with header plus data, and can realize automatic format switching and data analysis of a large amount of data of the type, and has the advantages of high data processing speed and high efficiency. In addition, the data can be processed by combining MATLAB and office and displayed in a form and a graph format, so that the error rate is greatly reduced while the efficiency is high, and the whole processing flow is simplified.
2. The processing method of the invention can carry out parameter screening on the files with large data volume or a plurality of data files according to selection and generate independent data processing files.
3. The processing method of the invention locates the data first, ensures the accuracy of the subsequent processing, can generate the result report, can realize the generation of a large amount of test data analysis report, and can realize the classification management of the data due to the association of the result and the parameter name.
4. When the invention separates the header and the data, two methods are provided, the identification characteristics of the parameter names can be utilized, and the method can also scan line by line, so that the application range of the method is wider.
Drawings
FIG. 1 is a schematic illustration of an engine test text data result file;
FIG. 2 is a flow chart of an embodiment of an engine test data processing method according to the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. The components of the embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
The data analysis is based on statistics, and usually in order to obtain the data parameters of each test, the data parameters and a large number of data result files of the plurality of tests need to be searched in the data result files of the equipment collected by a plurality of manufacturers, which is time-consuming and labor-consuming, requires tedious and repeated work and is easy to make mistakes.
As can be seen from analyzing the data result file to be searched, the data result file generated by the collection software of different manufacturers is mainly a file in the format of a text file (Txt), and if the data result file is a file of other types, the data result file can be converted into the format of the text file. In addition, as shown in fig. 1, these text data result files all have a common data format, and the most common format is a header+data format, where the header contains channel setting information, channel slope, parameter name, parameter unit, equipment manufacturer, etc., and the information in the header can be expressed by a single line or multiple lines. The data comprises a time sequence and a data sequence of corresponding parameters. Such a data structure facilitates the extraction of the required data by programming the corresponding program.
The invention provides an engine test text data format conversion method, which can improve the text data format conversion efficiency and the generation efficiency of analysis reports, reduce the error rate and more intensively, comprehensively and accurately reflect the objective condition of test data. As shown in fig. 2, the specific method is as follows:
s1, converting the data result file format output by each acquisition device into a text format file. If the data result file format output by the acquisition equipment is a text format file, conversion is not needed. In other embodiments of the present invention, the data result file format may also be converted to other format files.
S2, reading the text data result file converted into the text format obtained in the step S1, and separating the header from the data.
When the header and the data are separated, three main modes are as follows:
(1) If the parameter names in the header have specific characteristics (identification characteristics): such as the number of rows of the header, the number of rows of the data, the number of rows of the sampling frequency, and the like. By reading the specific lines, the keywords such as the pressure parameter is started by P, the vibration parameter is started by a, the temperature parameter is started by T, the flow parameter is started by G, the rotating speed parameter is started by n and the like are utilized, the header and the data are distinguished through the specific characteristics of the parameters, and the corresponding parameter name characteristics are analyzed.
(2) If the parameter names in the header have no specific characteristics, a progressive scanning mode can be adopted, and the corresponding parameter name characteristics are analyzed by utilizing keyword information in combination with separators, tab symbols, space symbols and the like, so that the header and the data are distinguished.
S3, data positioning and segmentation: and positioning the data according to the sampling frequency, the data line number and the data byte number in the header. And positioning the data corresponding to each parameter by calculating the sampling frequency data line number data byte number in the header. Dividing the data into a plurality of groups according to the data corresponding to each positioned parameter to form a plurality of data groups, wherein each data group comprises the data corresponding to each parameter. And simultaneously, forming a mapping relation between the parameter names in the header and the data sets, so that each parameter name corresponds to each data set one by one.
S4, parameter name and data group separated storage
The parameter names are stored separately in a text file, and each data set is also stored separately in a text file. If each column of data in the data is the data corresponding to one parameter, each column of data is respectively and independently stored in one text file, and if each row of data in the data is the data corresponding to one parameter, each row of data is respectively and independently stored in one text file. The method has the advantages that the volume of each parameter generated single text file is smaller, the memory allocation is smaller, the multi-thread technology is convenient to respectively and simultaneously read a plurality of text data result files, and the file reading speed is high and the operation efficiency is high. Meanwhile, the parameter names are separated from the data, so that even if the parameter names are wrong, the parameter names are convenient to modify without changing other parts, the data utilization efficiency is improved, and the implementation complexity is reduced.
S5, analyzing and generating a report by adopting a memory allocation technology, calculating the total memory storage space (total memory storage space=number of gamma bytes) according to the size of the read text file by utilizing the performance of the computer (different sizes of the memory of the computer), and allocating the number of memory blocks according to the memory size of the computer. By utilizing the OLE technology, a text file is sequentially imported into a working memory space in the MATLAB according to the sequence of generating memory blocks by a two-way communication method of programming language and the MATLAB program, and then an internal data processing algorithm of the MATLAB program is called to perform data processing and calculation. And then, a bidirectional communication method of office and programming language is utilized, and a link and embedding mechanism between VBA and a document is utilized to correlate a calculation result in MATLAB with a parameter name in a data table and graph format and write the calculation result into word to generate a result report.
The above-described methods, when embodied, may be converted to program products by a programming language such as VB, VC, or C++, among others.
The monitoring method of the present invention can be applied to a computer-readable storage medium, in which a computer program is stored, and the above-described processing method can be stored as a computer program in the computer-readable storage medium, which when executed by a processor, implements the steps of the above-described processing method.
In addition, the processing method of the present invention can also be applied to a terminal device, and the terminal device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the steps of the processing method of the present invention. The terminal device may be a computer, a notebook computer, a palm computer, various cloud servers, and other computing devices, and the processor may be a general-purpose processor, a digital signal processor, an application specific integrated circuit, or other programmable logic devices.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (8)

1. An engine test data processing method is characterized by comprising the following steps:
s1, separating a header of a data result file from data;
s2, positioning data corresponding to each parameter name in the header according to the sampling frequency, the data line number and the data byte number in the header;
s3, grouping the data according to the data corresponding to each parameter name to obtain a plurality of data groups;
s4, respectively and independently storing all parameter names and data groups to form a parameter name file and a plurality of data group files, and forming a mapping relation between the parameter name file and the data group files;
s5, reading the parameter name file and each data group file, importing the parameter name file and each data group file into a working memory space of the MATLAB by utilizing an OLE technology, and calling an internal data processing algorithm of the MATLAB program to perform data processing and calculation to obtain a calculation result;
s6, the calculation result is associated with the parameter name in the office in the format of a data table and a graph through a link and embedding mechanism between the VBA and the document.
2. The engine test data processing method according to claim 1, wherein: step S0 is also included before step S1, and the data result file is converted into a text format file; in step S4, the independent storage is specifically stored in a text file independently.
3. An engine test data processing method according to claim 1 or 2, characterized in that: the step S1 specifically comprises the following steps:
if the parameter names in the header have identification features, distinguishing the header and the data by reading the row where the identification features are located; otherwise, scanning the data result file line by line, analyzing the corresponding parameter name characteristics by combining the key word information with the symbol, and distinguishing the header and the data.
4. A method of engine test data processing according to claim 3, wherein: the step S2 is specifically to locate the data corresponding to each parameter name in the header by the product of the sampling frequency, the data line number and the data byte number.
5. The engine test data processing method according to claim 4, wherein: in step S5, the reading of the parameter name file and each data set file is specifically to calculate a required total memory storage space according to the sizes of the parameter name file and each data set file, allocate the number of memory blocks according to the size of the total memory storage space, and store the parameter name file and each data set file into each memory block;
in step S5, the importing the parameter name file and each data set file into the working memory space of the MATLAB is specifically that the parameter name file and each data set file are sequentially imported into the working memory space of the MATLAB according to the order of generating the memory blocks.
6. The engine test data processing method according to claim 5, wherein: step S7 is further included after step S6, and word writing is performed to generate a result report.
7. A computer-readable storage medium having stored thereon a computer program, characterized by: the program when executed by a processor implements the steps of an engine test data processing method as claimed in any one of claims 1 to 6.
8. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: the processor, when executing the computer program, implements the steps of a method for processing engine test data as claimed in any one of claims 1 to 6.
CN202211626632.XA 2022-12-16 2022-12-16 Engine test data processing method, storage medium and equipment Pending CN116384341A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211626632.XA CN116384341A (en) 2022-12-16 2022-12-16 Engine test data processing method, storage medium and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211626632.XA CN116384341A (en) 2022-12-16 2022-12-16 Engine test data processing method, storage medium and equipment

Publications (1)

Publication Number Publication Date
CN116384341A true CN116384341A (en) 2023-07-04

Family

ID=86960266

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211626632.XA Pending CN116384341A (en) 2022-12-16 2022-12-16 Engine test data processing method, storage medium and equipment

Country Status (1)

Country Link
CN (1) CN116384341A (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101742531A (en) * 2008-11-13 2010-06-16 中国移动通信集团设计院有限公司 Method and device for storing test data
CN103399848A (en) * 2013-06-21 2013-11-20 西安航天动力试验技术研究所 Engine test data standardized specific format leading-in processing method
CN105279144A (en) * 2015-10-10 2016-01-27 中国空气动力研究与发展中心高速空气动力研究所 Method and device for typesetting wind tunnel test data text files
CN105893482A (en) * 2016-03-29 2016-08-24 西安航天动力试验技术研究所 Engine test data fully-automatic extracting and Word report generating method
CN107992567A (en) * 2017-11-29 2018-05-04 北京天健通泰科技有限公司 Collecting method and data collecting system
CN108132986A (en) * 2017-12-14 2018-06-08 北京航天测控技术有限公司 A kind of immediate processing method of aircraft magnanimity biosensor assay data
CN112364613A (en) * 2020-10-30 2021-02-12 中国运载火箭技术研究院 Automatic generation system for aircraft test data interpretation report
CN114281761A (en) * 2021-12-21 2022-04-05 中国农业银行股份有限公司 Data file loading method and device, computer equipment and storage medium
CN114722794A (en) * 2022-04-22 2022-07-08 中国工商银行股份有限公司 Data extraction method and data extraction device
CN114860658A (en) * 2022-05-07 2022-08-05 博锐尚格科技股份有限公司 Data acquisition method and device, electronic equipment and storage medium
CN115289620A (en) * 2022-08-22 2022-11-04 浙江源创智控技术有限公司 Configurable text file reading and writing method based on building energy-saving system
CN115422143A (en) * 2022-09-22 2022-12-02 重庆美沣秦安汽车驱动系统有限公司 Method, system, storage medium and terminal for converting oscilloscope file into MDA file format

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101742531A (en) * 2008-11-13 2010-06-16 中国移动通信集团设计院有限公司 Method and device for storing test data
CN103399848A (en) * 2013-06-21 2013-11-20 西安航天动力试验技术研究所 Engine test data standardized specific format leading-in processing method
CN105279144A (en) * 2015-10-10 2016-01-27 中国空气动力研究与发展中心高速空气动力研究所 Method and device for typesetting wind tunnel test data text files
CN105893482A (en) * 2016-03-29 2016-08-24 西安航天动力试验技术研究所 Engine test data fully-automatic extracting and Word report generating method
CN107992567A (en) * 2017-11-29 2018-05-04 北京天健通泰科技有限公司 Collecting method and data collecting system
CN108132986A (en) * 2017-12-14 2018-06-08 北京航天测控技术有限公司 A kind of immediate processing method of aircraft magnanimity biosensor assay data
CN112364613A (en) * 2020-10-30 2021-02-12 中国运载火箭技术研究院 Automatic generation system for aircraft test data interpretation report
CN114281761A (en) * 2021-12-21 2022-04-05 中国农业银行股份有限公司 Data file loading method and device, computer equipment and storage medium
CN114722794A (en) * 2022-04-22 2022-07-08 中国工商银行股份有限公司 Data extraction method and data extraction device
CN114860658A (en) * 2022-05-07 2022-08-05 博锐尚格科技股份有限公司 Data acquisition method and device, electronic equipment and storage medium
CN115289620A (en) * 2022-08-22 2022-11-04 浙江源创智控技术有限公司 Configurable text file reading and writing method based on building energy-saving system
CN115422143A (en) * 2022-09-22 2022-12-02 重庆美沣秦安汽车驱动系统有限公司 Method, system, storage medium and terminal for converting oscilloscope file into MDA file format

Similar Documents

Publication Publication Date Title
US20130238619A1 (en) Data processing system, and data processing device
CN107463706B (en) Hadoop-based mass wave recording data storage and analysis method and system
CN110489317B (en) Cloud system task operation fault diagnosis method and system based on workflow
CN110275878B (en) Service data detection method and device, computer equipment and storage medium
CN111475517A (en) Data updating method and device, computer equipment and storage medium
CN108132986B (en) Rapid processing method for test data of mass sensors of aircraft
CN111061758A (en) Data storage method, device and storage medium
CN111400361A (en) Data real-time storage method and device, computer equipment and storage medium
CN111258973A (en) Storage and display method, device, equipment and medium of Redis slow log
CN112559482B (en) Binary data classification processing method and system based on distribution
CN114416783A (en) Method and device for evaluating dynamic cost of OLAP (on-line analytical processing) query engine
CN116644031B (en) Method and system for unified standardization of coal mine water damage data in different formats
CN116384341A (en) Engine test data processing method, storage medium and equipment
CN115544975B (en) Log format conversion method and device
US7587513B1 (en) Efficient storage of network and application data
CN114116811B (en) Log processing method, device, equipment and storage medium
CN111475405A (en) Regression testing method and device, computer equipment and storage medium
CN115827777A (en) Self-adaptive synchronization and difference identification method, device and equipment for multiple data sources
CN112306421B (en) Method and system for storing MDF file in analysis and measurement data format
CN110032523B (en) Register storage method based on address bit dynamic definition for diesel engine assembly test
CN107544090B (en) Seismic data analyzing and storing method based on MapReduce
CN106776704A (en) Statistical information collection method and device
CN116933143B (en) Flight parameter data classification method
CN110955710A (en) Method and device for processing dirty data in data exchange operation
CN117389980B (en) Log file analysis method and device, computer equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination