CN115080574B - Method and device for processing electronic product test data, computer equipment and storage medium - Google Patents
Method and device for processing electronic product test data, computer equipment and storage medium Download PDFInfo
- Publication number
- CN115080574B CN115080574B CN202211003078.XA CN202211003078A CN115080574B CN 115080574 B CN115080574 B CN 115080574B CN 202211003078 A CN202211003078 A CN 202211003078A CN 115080574 B CN115080574 B CN 115080574B
- Authority
- CN
- China
- Prior art keywords
- data
- test
- information
- test data
- metadata
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a method, a device, computer equipment and a storage medium for processing test data of an electronic product, wherein the method comprises the following steps: combing the test data range of the electronic product, and formulating the standard of the test data to obtain the formulated data standard; integrating test data of different servers or systems into a unified XML file; generating corresponding JSON files from test data of different servers or systems; extracting service data in the JSON file to form metadata, and storing data in the XML file into the metadata to obtain a metadata table; performing data cleaning and filtering on the metadata table, and then storing the metadata table after cleaning and filtering into a history backup table; index query is carried out on the historical backup table to obtain a query result; and displaying the query result in a visual mode. The invention solves the problem of homogenization of related test data acquisition standards, summarizes test data of different devices to the same data platform, and provides a data basis for big data application.
Description
Technical Field
The invention relates to the technical field of electronic product test data processing, in particular to a method and a device for processing electronic product test data, computer equipment and a storage medium.
Background
At present, an automatic test system is generally adopted to carry out testing in the detection process of avionic products, test data generated by the automatic test system covers original data, interpretation result data, test environment data and index interpretation data of each test stage of the products, and a large amount of generated data is dispersedly stored in each test system. The traditional processing mode mainly comprises a hand-reading data mode or a mode of summarizing different system data through excel, which can not meet the requirement of enterprises on the data, and at least has the following problems that 1, the data are distributed in different systems and are difficult to collect; 2. the data volume is large, and the analysis speed is slow; 3. and the analysis accuracy is low due to manual processing.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a method, a device, computer equipment and a storage medium for processing test data of an electronic product.
In order to solve the technical problems, the invention adopts the following technical scheme:
in a first aspect, the present embodiment provides a method for processing test data of an electronic product, including the following steps:
combing the test data range of the electronic product, and formulating the standard of the test data to obtain the formulated data standard;
integrating test data of different servers or systems into a unified XML file;
generating corresponding JSON files from test data of different servers or systems according to the formulated data standard;
extracting service data in the JSON file to form metadata, and storing data in the XML file into the metadata to obtain a metadata table;
performing data cleaning and filtering on the metadata table, and then storing the metadata table after cleaning and filtering into a history backup table;
index query is carried out on the historical backup table to obtain a query result;
and displaying the query result in a visual mode.
The further technical scheme is as follows: the method comprises the steps of carding a test data range of the electronic product, and formulating a standard of the test data to obtain a formulated data standard, wherein the test data range comprises data packet information, product basic information, test equipment information, execution information, test item information, test result set information, test environment information, test condition information and test state information.
The further technical scheme is as follows: in the step of generating corresponding JSON files from test data of different servers or systems according to the formulated data standard, the method further includes: test data of different servers or systems are transmitted to addresses corresponding to the servers or systems in real time, the test data are imported into a database through a packaged JDBC database interface, and the test data are transmitted and stored in a warehouse, so that identity authentication and data authority authentication of a user are required.
The further technical scheme is as follows: in the step of querying the index of the historical backup table to obtain the query result, the historical backup table is queried through interactive analysis index to obtain the query result.
In a second aspect, the present embodiment provides an apparatus for processing electronic product test data, including: the device comprises a carding formulation unit, an integration unit, a generation unit, an extraction storage unit, a cleaning storage unit, a query unit and a display unit;
the carding formulation unit is used for carding the test data range of the electronic product and formulating the standard of the test data to obtain the formulated data standard;
the integration unit is used for integrating the test data of different servers or systems into a unified XML file;
the generating unit is used for generating corresponding JSON files from the test data of different servers or systems according to the formulated data standard;
the extraction storage unit is used for extracting the service data in the JSON file to form metadata, and storing the data in the XML file into the metadata to obtain a metadata table;
the cleaning storage unit is used for cleaning and filtering data of the metadata table and then storing the metadata table after cleaning and filtering into a history backup table;
the query unit is used for querying the historical backup table index to obtain a query result;
and the display unit is used for visually displaying the query result.
The further technical scheme is as follows: in the carding formulation unit, the test data range comprises data packet information, product basic information, test equipment information, execution information, test item information, test result set information, test environment information, test condition information and test state information.
The further technical scheme is as follows: the generation unit further includes: test data of different servers or systems are transmitted to addresses corresponding to the servers or systems in real time, the test data are imported into a database through a packaged JDBC database interface, and the test data are transmitted and stored in a warehouse, so that identity authentication and data authority authentication of a user are required.
The further technical scheme is as follows: and in the query unit, querying the historical backup table through the interactive analysis index to obtain a query result.
In a third aspect, the present embodiment provides a computer device, which includes a memory and a processor, where the memory stores a computer program, and the processor executes the computer program to implement the method for processing electronic product test data as described above.
In a fourth aspect, the present embodiment provides a storage medium storing a computer program comprising program instructions which, when executed by a processor, implement the method of electronic product test data processing as described above.
Compared with the prior art, the invention has the beneficial effects that: the problem of unifying the acquisition standards of related test data is solved, the test data of different devices are summarized to the same data platform, a data base is provided for big data application, and important analysis reference can be provided for the overall performance and quality of a product.
The invention is further described below with reference to the accompanying drawings and specific embodiments.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a flowchart illustrating a method for processing test data of an electronic product according to an embodiment of the present invention;
FIG. 2 is a schematic block diagram of an apparatus for processing test data of an electronic product according to an embodiment of the present invention;
fig. 3 is a schematic block diagram of a computer device provided in an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items and includes such combinations.
Referring to the embodiment shown in fig. 1, the present invention discloses a method for processing test data of an electronic product, comprising the following steps:
s1, combing a test data range of an electronic product, and formulating a standard of test data to obtain a formulated data standard;
specifically, the test data range includes data packet information, product basic information, test equipment information, execution information, test item information, test result set information, test environment information, test condition information, and test status information.
Specifically, the established data standard comprises the following contents:
product information: including product name, product number, product code number, product model, system name, remark, etc.;
testing information: the method comprises the steps of testing type, testing stage, tester, testing order number, testing time, testing place, remark and the like;
and (3) testing environment: including temperature, humidity, vacuum, etc.;
and (3) testing conditions are as follows: the method comprises the steps of (1) channel, main and standby states, power supply voltage, local oscillation frequency and the like;
testing the working condition: comprises a circulation stage, normal temperature and pressure, normal temperature and vacuum, high temperature and low temperature;
testing equipment: comprises a testing instrument (such as a vector network analysis instrument, a spectrum analyzer and a signal source), a testing device (a vacuum tank, a high-low temperature box and a mechanical vibration table);
and (3) testing items: including project name, test basis, remark, serial number, etc.;
and (3) testing results: including test values, instrument traces, test sub-tables, test patterns, and other WORD, EXCEL files.
S2, integrating test data of different servers or systems into a unified XML file;
specifically, the test of different servers or systems includes a normal temperature test server test, an environmental test server test (a vacuum test, an incubator test), a mechanical test server test, and the like.
The normal temperature test server test comprises initial test, post-mechanical test and acceptance test; the normal temperature test data comprises a test parameter table, test instrument information, a test two-dimensional data table, an instrument track, an instrument graph, an appearance photo and the like.
The environment test server tests comprise tests of thermal cycle, thermal vacuum, temperature cycle aging and the like; the environmental test data comprises product information, test equipment, test instruments, test sequence files, temperature change records, test on duty data, temperature data, vacuum data, a test two-dimensional data table, instrument tracks, instrument graphs, test photos and the like.
The test data of the mechanical test server comprises product information, test equipment, test instruments, ESS vibration, impact vibration, random vibration, sinusoidal vibration, instrument graphs, test pictures and the like.
Specifically, the test data of different servers or systems are collected firstly, the data on the production line, the data generated by product detection, the data of the equipment and the like are collected in real time through detection equipment arranged on the site, and then the test data of different servers or systems are extracted to the servers in an XML mode according to a preset data format to form a unified XML file.
Specifically, different types of test data are stored on a unified server and comprise data such as relational data, pictures, documents and videos, and the relational data are stored in a database after designing a metadata structure according to data characteristics.
S3, generating corresponding JSON files from test data of different servers or systems according to the formulated data standard;
specifically, according to the analysis of the test data, the test data includes types of product information, test environment, test conditions, test equipment, test items, test results, and the like.
In the JSON file, the data types are used as set nodes, and each set node respectively comprises the following information:
1) Product information: key value pair data such as product name, product number, product code number, product model, system name, remark and the like are included;
2) Testing information: the method comprises the steps of testing type, testing stage, tester, testing order number, testing time, testing place, remark and other key value pair data;
3) And (3) testing environment: the device is of a digit group type and can be dynamically expanded, and key value pair data such as temperature, humidity, vacuum degree and the like are included;
4) And (3) testing conditions are as follows: the device is of a digit group type and can be dynamically expanded, and comprises key value pair data such as a channel, a main standby state, power supply voltage, local oscillator frequency and the like;
5) Testing the working condition: the data is in a numerical group type and comprises bond value pair data of a circulation stage, normal temperature and normal pressure, normal temperature and vacuum, high temperature, low temperature and the like;
6) And (3) testing equipment: the device is of a digital type and comprises key value pair data of a testing instrument (such as a vector network analysis instrument, a spectrum analyzer and a signal source), testing equipment (a vacuum tank, a high-low temperature box and a mechanical vibration table) and the like;
7) Test items: the method comprises the steps of acquiring key value pair data such as project names, test bases, remarks, serial numbers and the like;
8) And (3) testing results: the test system is of an array type and comprises test values, instrument tracks, test attached tables, test graphs and other WORD and EXCEL test accessories.
Specifically, test data of different servers or systems are transmitted to addresses corresponding to the servers or systems in real time, the test data are imported into a database through a packaged JDBC database interface, and the test data are transmitted and stored in a warehouse, so that identity authentication and data authority authentication of a user are required.
Particularly, the centralized control of the application system users is ensured through unified user storage and management; the login verification mode based on identity authentication can effectively ensure that the access strategy can be reliably and effectively executed, and prevent an attacker from impersonating a legal user to obtain the access right of resources; the password security of the user is ensured through a one-way password encryption technology; through the server certificate, the https protocol is used to avoid divulging a secret in the transmission process; the rationality of the access authority of the user is ensured by adopting an authorization management mode, the user can be ensured to access and only access authorized resources, the excessive right of individual administrators is limited by hierarchical authorization management, and a post-audit mechanism is ensured by a system audit log.
S4, extracting service data in the JSON file to form metadata, and storing data in the XML file into the metadata to obtain a metadata table;
specifically, after the test data form a JSON file format, structured metadata is formed, and data information is extracted from the JSON file according to the set nodes. And respectively extracting service data such as product information, test environment, test conditions, test working conditions, test equipment, test items, test results and the like according to the data types of the collection nodes.
Specific metadata includes the following:
1) Product information: describing the attribute of a product, wherein the attribute is fixed data of the product in the whole test process, and comprises data of a product name, a product number, a product code number, a product model, a system name, remarks and the like;
2) Testing information: describing test attributes, namely data recorded in a single test process of a product, including data such as test types, test stages, testers, test sheet numbers, test time, test places, remarks and the like;
3) And (3) testing environment: describing test environment information, namely temperature, humidity, vacuum degree and other data acquired by a product in a single test process;
4) And (3) testing conditions are as follows: describing test conditions, namely testing products under the conditions of different channels, main and standby states, power supply voltage, local oscillation frequency and the like in a single test process;
5) Testing the working condition: describing test working conditions, which are circulation stage information of the product in a single test, and comprise data such as normal temperature and normal pressure, normal temperature and vacuum, xth circulation high temperature, xth circulation low temperature, performance guarantee and the like;
6) Testing equipment: instruments and equipment used for the assay are described, such as: vector network analysis, a spectrum analyzer, a signal source, a vacuum tank, a high-low temperature box, a mechanical vibration table, a sensor and other data information;
7) Test items: test item information describing the product, such as: data such as project names, test bases, remarks and serial numbers;
8) And (3) testing results: test results describing the product test items, such as: test values, instrument trajectories, test sub-tables, test patterns, and other WORD, EXCEL test accessories.
Specifically, according to the service type of the test data, modeling analysis is carried out on the data, and modeling of different subjects is carried out on the data; for example: and processing the data of the original different systems into corresponding data model tables according to the product information, the test information and the test result information.
Specifically, first, corresponding metadata is created according to test data, the test data is stored in the metadata, then, core product information, test information and test result information are extracted, a corresponding model table is created, and other test information is processed into the three information tables to obtain a metadata table.
Specifically, the metadata table contains the following contents:
product information data sheet: the method comprises the following steps of testing piece type, product name, product model, product code, development stage, product number, system name, remark and the like;
test information data sheet: the method comprises the steps of testing type, testing stage, testing order number, testing person, testing time, testing place, remark and the like;
test condition data table: including condition names, condition values, etc.;
test environment data sheet: including environment name, environment value, etc.;
test condition data sheet: including the working condition name, the working condition value and the like;
test equipment data sheet: the method comprises the steps of equipment name, model specification, metering number, metering validity period, ground resistance and the like;
test item data sheet: the method comprises the steps of testing items, testing item names, testing bases, testing serial numbers, remarks and the like;
test results data sheet: including data type, result name, index requirement, unit, reserved decimal place, result value, conformity (1-conformity, 0-nonconformity, -1-nondescription), remark condition, etc.;
test instrument curve table: the method comprises the following steps of data type, test sub-item name, threshold value (value, name), curve point set (x point set, y point set), x-axis (unit, name, scale, maximum value, minimum value, type), y-axis (unit, name, scale, maximum value, minimum value, type), mark point (description, x value, y value, name), remark, result sequence number and the like;
test accessories table: including data type, attachment name, file format, file path, etc.
S5, performing data cleaning and filtering on the metadata table, and then storing the metadata table after cleaning and filtering into a history backup table;
specifically, data cleaning and filtering are carried out on the metadata table, data which do not meet the specifications are filtered, the metadata table is stored in a historical backup table, the backup is carried out for the purpose of post-processing data problems, tracing and analysis are good, and the data cleaning is carried out for the purpose of improving the speed of processing the data to the model table.
Specifically, during the process of testing a product, due to errors of logging, coding and testing, some invalid values and missing values may exist in data, and appropriate data cleaning processing needs to be given, and the test data needs to be reexamined and checked to remove repeated information and carry out data consistency checking.
Data cleansing filtering of metadata tables includes the following:
1. deleting invalid data
Invalid data refers to incomplete data and error data, and the invalid data is deleted in a whole case;
incomplete data: the data table defines the essential data missing, such as: the product name and the product number are not filled;
error data: the data format does not conform, and the value is out of the measuring range of the instrument, such as: the date format does not meet the format requirement, or the temperature data exceeds an interval of-120 to 120.
2. Data deduplication processing
In the whole test process, the product numbers, the test stages, the test sheet numbers, the test working conditions, the test conditions and the test items are used as main indexes to judge whether the data are repeated or not, the last piece of data is reserved, and the repeated data are deleted in the whole case.
3. Data consistency check
The consistency check is to check the reasonable value range and the mutual relation of each variable according to the definition and the integrity constraint of the data table, find out the data which exceeds the normal range and is contradictory to each other, and delete the data which is not consistent with the consistency in the whole case;
out-of-range data includes out-of-character definition length, out-of-range values, etc., such as: the length of the product name exceeds 256 bytes, and the test time exceeds the current date and time;
the contradictory data means that the test results under the same working condition and condition deviate greatly, and the data deviate under normal temperature, high and low temperature, or normal pressure and vacuum.
4. Data analysis extraction
1) Product information: only one piece of data is extracted from one product in the whole test process;
2) And (3) testing information: extracting a piece of data from each test stage in the whole test process of the product;
3) And (3) testing environment: extracting a plurality of pieces of data from each testing stage of the product;
4) And (3) testing conditions are as follows: extracting a piece of data from the product under the same condition in each test stage;
5) And (3) testing the working condition: extracting a piece of data from the product under the same working condition in each test stage;
6) Testing equipment: extracting data of a plurality of instruments and equipment in each test stage by the product;
7) And (3) testing items: extracting one piece of data from each test item of the product under the same working condition and condition in each test stage;
8) And (3) testing results: the product extracts one piece of data from each test item under the same working condition, condition and environment in each test stage.
S6, index query is carried out on the historical backup table to obtain a query result;
specifically, the historical backup table is queried through an interactive analytical index to obtain a query result.
Specifically, in order to improve the efficiency of data retrieval, according to the characteristics of product information, test information and test result information in the data model, an index is created in the fields of product ID and test ID, when the quantity of the queried data result set is large, the table result is queried concurrently, and the foreground is queried interactively to improve the user friendliness of the user.
Specifically, the index is reasonably used according to the query and screening fields of the table, the query efficiency is improved, the data modeling is reasonable, the data redundancy is reduced, the data volume is reduced, and the data processing speed is improved by adopting an interactive query and concurrent multi-core query interactive use mode.
And S7, visually displaying the query result.
Specifically, the query result is retrieved, queried and displayed by using a computer, a large screen or other display terminals.
Specifically, to better illustrate the technical solution of the present invention, the following specific examples are provided:
combing the test data range of the electronic product, identifying main data indexes and types, establishing different data standards according to different data types, integrating the test data of different systems into a unified XML file, and establishing a source data model to store the data in the XML file according to the data standards; designing different themes according to the characteristics of the service data, such as a product theme, a test information theme, a test result theme and the like; storing the test data in a classified manner, wherein the product theme mainly comprises product information such as product type, name, code number, model, development stage, serial number and the like; the test information theme mainly comprises test information such as a test stage, a cycle stage, a plan number, a tester, a test channel, test time, test conditions, test parameters and sub-parameters of the test; the test result theme mainly comprises test product ID, test steps, test time, test result values, scanning points, thresholds, interpretation states, instrument states, mark points and other test result related information; designing a corresponding data model table to store data of related information according to different data themes; for unstructured data, the data is stored in a server-specific directory, and the data is accessed through a path.
The invention solves the problem of uniformity of related test data acquisition standards, summarizes test data of different devices to the same data platform, provides a data base for big data application, and can provide important analysis reference for the overall performance and quality of products.
Referring to fig. 2, the present invention also discloses a device for processing test data of an electronic product, including: the carding formulation unit 10, the integration unit 20, the generation unit 30, the extraction storage unit 40, the cleaning storage unit 50, the query unit 60 and the display unit 70;
the combing and formulating unit 10 is used for combing the test data range of the electronic product and formulating the standard of the test data to obtain the formulated data standard;
the integration unit 20 is configured to integrate test data of different servers or systems into a unified XML file;
the generating unit 30 is configured to generate corresponding JSON files from test data of different servers or systems according to a formulated data standard;
the extraction storage unit 40 is configured to extract service data in the JSON file to form metadata, and store data in the XML file into the metadata to obtain a metadata table;
the cleaning storage unit 50 is used for performing data cleaning and filtering on the metadata table and then storing the metadata table after cleaning and filtering into a history backup table;
the query unit 60 is configured to query the historical backup table index to obtain a query result;
the display unit 70 is configured to visually display the query result.
In the carding formulation unit 10, the test data range includes data packet information, product basic information, test equipment information, execution information, test item information, test result set information, test environment information, test condition information, and test state information.
Wherein, the generating unit 30 further includes: test data of different servers or systems are transmitted to addresses corresponding to the servers or systems in real time, the test data are imported into a database through a packaged JDBC database interface, and the test data are transmitted and stored in a warehouse, so that identity authentication and data authority authentication of a user are required.
In the query unit 60, the historical backup table is queried through an interactive analysis index to obtain a query result.
It should be noted that, as can be clearly understood by those skilled in the art, the specific implementation process of the apparatus for processing electronic product test data and each unit may refer to the corresponding description in the foregoing method embodiment, and for convenience and conciseness of description, no further description is provided herein.
The apparatus for electronic product test data processing may be implemented in the form of a computer program that is executable on a computer device as shown in fig. 3.
Referring to fig. 3, fig. 3 is a schematic block diagram of a computer device according to an embodiment of the present application; the computer device 500 may be a terminal or a server, where the terminal may be an electronic device with a communication function, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a personal digital assistant, and a wearable device. The server may be an independent server or a server cluster composed of a plurality of servers.
Referring to fig. 3, the computer device 500 includes a processor 502, memory, and a network interface 505 connected by a system bus 501, where the memory may include a non-volatile storage medium 503 and an internal memory 504.
The non-volatile storage medium 503 may store an operating system 5031 and a computer program 5032. The computer programs 5032 comprise program instructions that, when executed, cause the processor 502 to perform a method of electronic product test data processing.
The processor 502 is used to provide computing and control capabilities to support the operation of the overall computer device 500.
The internal memory 504 provides an environment for the operation of the computer program 5032 in the non-volatile storage medium 503, and when the computer program 5032 is executed by the processor 502, the processor 502 can be caused to perform a method for electronic product test data processing.
The network interface 505 is used for network communication with other devices. Those skilled in the art will appreciate that the configuration shown in fig. 3 is a block diagram of only a portion of the configuration associated with the present application and does not constitute a limitation of the computer device 500 to which the present application may be applied, and that a particular computer device 500 may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
Wherein the processor 502 is configured to run the computer program 5032 stored in the memory to implement the following steps:
s1, combing a test data range of an electronic product, and formulating a standard of the test data to obtain a formulated data standard;
s2, integrating test data of different servers or systems into a unified XML file;
s3, generating corresponding JSON files from test data of different servers or systems according to the formulated data standard;
s4, extracting service data in the JSON file to form metadata, and storing the data in the XML file into the metadata to obtain a metadata table;
s5, performing data cleaning and filtering on the metadata table, and then storing the metadata table after cleaning and filtering into a history backup table;
s6, index query is carried out on the historical backup table to obtain a query result;
and S7, visually displaying the query result.
It should be understood that, in the embodiment of the present Application, the Processor 502 may be a Central Processing Unit (CPU), and the Processor 502 may also be other general-purpose processors, digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field-Programmable Gate arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, and the like. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
It will be understood by those skilled in the art that all or part of the flow of the method implementing the above embodiments may be implemented by a computer program instructing associated hardware. The computer program includes program instructions, and the computer program may be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the computer system to implement the flow steps of the embodiments of the method described above.
Accordingly, the present invention also provides a storage medium. The storage medium may be a computer-readable storage medium. The storage medium stores a computer program, wherein the computer program comprises program instructions which, when executed by a processor, implement the method of electronic product test data processing described above. The storage medium stores a computer program comprising program instructions which, when executed by a processor, implement the method described above. The program instructions include the steps of:
s1, combing a test data range of an electronic product, and formulating a standard of the test data to obtain a formulated data standard;
s2, integrating test data of different servers or systems into a unified XML file;
s3, generating corresponding JSON files from test data of different servers or systems according to the formulated data standard;
s4, extracting service data in the JSON file to form metadata, and storing the data in the XML file into the metadata to obtain a metadata table;
s5, performing data cleaning and filtering on the metadata table, and then storing the metadata table after cleaning and filtering into a history backup table;
s6, index query is carried out on the historical backup table to obtain a query result;
and S7, visually displaying the query result.
The storage medium may be a usb disk, a removable hard disk, a Read-Only Memory (ROM), a magnetic disk, or an optical disk, which can store various computer readable storage media.
Those of ordinary skill in the art will appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the components and steps of the various examples have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative. For example, the division of each unit is only one logic function division, and there may be another division manner in actual implementation. For example, various elements or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented.
The steps in the method of the embodiment of the invention can be sequentially adjusted, combined and deleted according to actual needs. The units in the device of the embodiment of the invention can be merged, divided and deleted according to actual needs. In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a storage medium. Based on such understanding, the technical solution of the present invention essentially or partially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a terminal, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention.
The above embodiments are preferred implementations of the present invention, and the present invention can be implemented in other ways without departing from the spirit of the present invention.
Claims (10)
1. The method for processing the test data of the electronic product is characterized by comprising the following steps of:
combing the test data range of the electronic product, and formulating the standard of the test data to obtain the formulated data standard;
integrating test data of different servers or systems into a unified XML file;
generating corresponding JSON files from test data of different servers or systems according to the formulated data standard;
extracting service data in the JSON file to form metadata, and storing data in the XML file into the metadata to obtain a metadata table;
performing data cleaning and filtering on the metadata table, and then storing the metadata table after cleaning and filtering into a history backup table;
querying the index of the historical backup table to obtain a query result;
visually displaying the query result;
after the test data form a JSON file format, structured metadata is formed, data information is extracted from the JSON file according to the set nodes, and business data of product information, test information, a test environment, test conditions, test working conditions, test equipment, test items and test results are respectively extracted according to the data types of the set nodes;
according to the service type of the test data, carrying out modeling analysis on the data, and carrying out modeling of different themes on the data; the method comprises the steps of processing original data of different systems into corresponding data model tables according to product information, test information and test result information, firstly creating corresponding metadata according to the test data, storing the test data in the metadata, then extracting core product information, test information and test result information, creating corresponding model tables, and processing other test information into the three information tables to obtain the metadata tables.
2. The method of claim 1, wherein in the step of combing the test data range of the electronic product and formulating the standard of the test data to obtain the formulated data standard, the test data range includes data packet information, product basic information, test equipment information, execution information, test item information, test result set information, test environment information, test condition information, and test status information.
3. The method for processing test data of electronic products according to claim 1, wherein the step of generating corresponding JSON files from test data of different servers or systems according to established data standards further comprises: test data of different servers or systems are transmitted to addresses corresponding to the servers or systems in real time, then the test data are imported into a database through a packaged JDBC database interface, and the test data are transmitted and stored in a warehouse, so that identity authentication and data authority authentication of a user are required.
4. The method of claim 1, wherein the indexing queries against the historical backup table to obtain query results step comprises querying the historical backup table by an interactive analytical index to obtain query results.
5. An apparatus for processing test data of an electronic product, comprising: the device comprises a carding formulation unit, an integration unit, a generation unit, an extraction storage unit, a cleaning storage unit, an inquiry unit and a display unit;
the carding formulation unit is used for carding the test data range of the electronic product and formulating the standard of the test data to obtain the formulated data standard;
the integration unit is used for integrating the test data of different servers or systems into a unified XML file;
the generating unit is used for generating corresponding JSON files from test data of different servers or systems according to the formulated data standard;
the extraction storage unit is used for extracting the service data in the JSON file to form metadata, and storing the data in the XML file into the metadata to obtain a metadata table;
the cleaning storage unit is used for cleaning and filtering data of the metadata table and then storing the metadata table after cleaning and filtering into a history backup table;
the query unit is used for querying the historical backup table index to obtain a query result;
the display unit is used for visually displaying the query result;
after the test data form a JSON file format, structured metadata is formed, data information is extracted from the JSON file according to the set nodes, and business data of product information, test information, a test environment, test conditions, test working conditions, test equipment, test items and test results are respectively extracted according to the data types of the set nodes;
according to the service type of the test data, carrying out modeling analysis on the data, and carrying out modeling of different themes on the data; the method comprises the steps of processing original data of different systems into corresponding data model tables according to product information, test information and test result information, firstly creating corresponding metadata according to the test data, storing the test data in the metadata, then extracting core product information, test information and test result information, creating corresponding model tables, and processing other test information into the three information tables to obtain the metadata tables.
6. The device for processing the test data of the electronic product as claimed in claim 5, wherein in the carding formulation unit, the test data range comprises data packet information, product basic information, test equipment information, execution information, test item information, test result set information, test environment information, test condition information and test status information.
7. The device for processing electronic product test data according to claim 5, wherein the generating unit further comprises: test data of different servers or systems are transmitted to addresses corresponding to the servers or systems in real time, the test data are imported into a database through a packaged JDBC database interface, and the test data are transmitted and stored in a warehouse, so that identity authentication and data authority authentication of a user are required.
8. The device for processing electronic product test data according to claim 5, wherein the query unit queries the historical backup table through an interactive analysis index to obtain the query result.
9. A computer arrangement, characterized in that the computer arrangement comprises a memory, on which a computer program is stored, and a processor, which when executing the computer program, carries out the method of electronic product test data processing according to any of claims 1-4.
10. A storage medium, characterized in that the storage medium stores a computer program comprising program instructions which, when executed by a processor, implement the method of electronic product test data processing according to any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211003078.XA CN115080574B (en) | 2022-08-22 | 2022-08-22 | Method and device for processing electronic product test data, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211003078.XA CN115080574B (en) | 2022-08-22 | 2022-08-22 | Method and device for processing electronic product test data, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115080574A CN115080574A (en) | 2022-09-20 |
| CN115080574B true CN115080574B (en) | 2022-11-18 |
Family
ID=83245033
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211003078.XA Active CN115080574B (en) | 2022-08-22 | 2022-08-22 | Method and device for processing electronic product test data, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115080574B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115598455B (en) * | 2022-11-15 | 2023-04-07 | 西安弘捷电子技术有限公司 | Automatic test system and test method for electronic information equipment |
| CN115600131B (en) * | 2022-11-28 | 2023-03-07 | 西安弘捷电子技术有限公司 | Automatic test system based on graphical test platform |
| CN115982646B (en) * | 2023-03-20 | 2023-07-18 | 西安弘捷电子技术有限公司 | Management method and system for multisource test data based on cloud platform |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112433948A (en) * | 2020-11-30 | 2021-03-02 | 上海天旦网络科技发展有限公司 | Simulation test system and method based on network data analysis |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104866426B (en) * | 2015-05-28 | 2017-10-17 | 华北计算技术研究所 | Software test integrated control method and system |
| GB2581861B (en) * | 2018-09-14 | 2022-10-05 | Sino Ic Tech Co Ltd | IC Test Information Management System Based on Industrial Internet |
| CN110718264A (en) * | 2019-09-23 | 2020-01-21 | 深圳忆联信息系统有限公司 | Method and device for testing information of solid state disk, computer equipment and storage medium |
| KR20230086768A (en) * | 2020-10-14 | 2023-06-15 | 지비에스 글로벌 바이오파마, 인크. | Plant drug analysis method and system for optimizing large-scale research |
-
2022
- 2022-08-22 CN CN202211003078.XA patent/CN115080574B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112433948A (en) * | 2020-11-30 | 2021-03-02 | 上海天旦网络科技发展有限公司 | Simulation test system and method based on network data analysis |
Non-Patent Citations (2)
| Title |
|---|
| 空间站多舱测试数据综合分析系统的设计与应用;许宗飞等;《航天器工程》;20170815;第26卷(第04期);122-127 * |
| 面向物联网系统历史数据服务的设计与实现;张玉杰等;《陕西科技大学学报》;20171025;第35卷(第05期);178-183 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115080574A (en) | 2022-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115080574B (en) | Method and device for processing electronic product test data, computer equipment and storage medium | |
| US11755628B2 (en) | Data relationships storage platform | |
| Arasu et al. | Data generation using declarative constraints | |
| US20130159353A1 (en) | Generating a test workload for a database | |
| US20130332423A1 (en) | Data lineage tracking | |
| Dai et al. | Data profiling technology of data governance regarding big data: review and rethinking | |
| Rozsnyai et al. | Discovering event correlation rules for semi-structured business processes | |
| CN111881011A (en) | Log management method, platform, server and storage medium | |
| Cobb et al. | Dynamic invariant detection for relational databases | |
| CN107153702A (en) | A kind of data processing method and device | |
| CN116662371A (en) | Cross-domain data fusion method | |
| CN116541372A (en) | Data asset management method and system | |
| CN109408502A (en) | A kind of data standard processing method, device and its storage medium | |
| CN113553341A (en) | Multidimensional data analysis method, multidimensional data analysis device, multidimensional data analysis equipment and computer readable storage medium | |
| Lautenschlager et al. | Chronix: Long term storage and retrieval technology for anomaly detection in operational data | |
| Ferranti et al. | Formalizing Property Constraints in Wikidata. | |
| CN116910023A (en) | Data management system | |
| CN107273293B (en) | Big data system performance test method and device and electronic equipment | |
| CN114281549A (en) | Data processing method and device | |
| CN113778996A (en) | Large data stream data processing method and device, electronic equipment and storage medium | |
| CN111309368A (en) | Development information management method, system, equipment and readable storage medium based on B/S framework | |
| CN113128848B (en) | Data quality monitoring method of all-service index, electronic equipment and storage medium | |
| Ge | On the Application of Big Data in Smart Transformation Enterprises | |
| Liu et al. | Automated insertion of exception handling for key and referential constraints | |
| Altınışık et al. | Software Architecture Recovery from Multiple Dependency Models |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |