CN108804106A - A kind of data analysis software optimization method based on allocation list management - Google Patents
A kind of data analysis software optimization method based on allocation list management Download PDFInfo
- Publication number
- CN108804106A CN108804106A CN201810400283.7A CN201810400283A CN108804106A CN 108804106 A CN108804106 A CN 108804106A CN 201810400283 A CN201810400283 A CN 201810400283A CN 108804106 A CN108804106 A CN 108804106A
- Authority
- CN
- China
- Prior art keywords
- target data
- data
- allocation list
- resolution rules
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
- G06F8/42—Syntactic analysis
- G06F8/427—Parsing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44505—Configuring for program initiating, e.g. using registry, configuration files
Abstract
The present invention relates to a kind of data analysis software optimization method based on allocation list management, including：The target data format allocation list of foundation and parsing rule configuration list are imported into database；The target data generated in collecting device operation forms target data set file；Establish the target data structure table of gathered data；According to the resolution rules in data resolution rules allocation list, parsing paraphrase is carried out to the target data structure table, judges whether analysis result is effective, effectively, then exports analysis result；In vain, then it is whether wrong that corresponding resolution rules in resolution rules allocation list are appraised and decided；Errorless, then reporting objectives data are invalid data；It is wrong, then import database after changing resolution rules allocation list.The present invention realizes the visualized management of data resolution rules by the decoupling to target data and data Context resolution, reduces the incidence of software errors and hardware fault, improves the generalization level and adaptive characteristic of data analysis method.
Description
Technical field
The present invention relates to software technology field, especially a kind of data analysis software optimization side based on allocation list management
Method.
Background technology
In industrial circle, data parsing is a kind of analysis method carrying out paraphrase to equipment running status, parameter.Equipment
Post-flight data parsing is often relatively low to the timeliness of troubleshooting, and for huge data interaction and designs improved demand,
Data resolution rules are often changeable, thus bring the higher costs of software maintenance, increase hardware control instructions failure
Possibility.Therefore, it is necessary to be fully considered on Functional Design, and there are certain surplus, structure data parse adaptive
Mechanism.
Invention content
In view of above-mentioned analysis, the present invention is intended to provide a kind of optimization method for software based on allocation list management, it is intended to drop
The cost and risk of low data maintenance realizes the visualization of data resolution rules by way of allocation list management.
The purpose of the present invention is mainly achieved through the following technical solutions：
A kind of data analysis software optimization method based on allocation list management, includes the following steps：
S1, the target data format allocation list of foundation is imported into database；
S2, by target data format carry out parsing form resolution rules allocation list；
S3, resolution rules allocation list is imported into database；
The target data generated in S4, collecting device operation forms target data set file；
S5, using the target data of acquisition as data item, establish target data structure table；
S6, according to the resolution rules in data resolution rules allocation list, parsing is carried out to the target data structure table and is released
Justice judges whether analysis result is effective, effectively, then exports analysis result；In vain, then enter S7；
Whether S7, to appraise and decide corresponding resolution rules in resolution rules allocation list wrong；Errorless, then reporting objectives data are non-
Method data；It is wrong, then change corresponding resolution rules item in resolution rules allocation list, and by modified resolution rules allocation list
Again database is imported.
Further, the target data format includes the content of each field of target data, byte number and to field
Explanation.
By the relationship for being defined clear design requirement and target data to target data format.
Further, in resolution rules allocation list, each field of target data format is carried out enumerating parsing paraphrase,
Each field initial value in field contents and analytic value are established into one-to-one relationship.
Allow the resolution rules allocation list of foundation that can carry out parsing paraphrase to each possibility of target data.
Further, each field is coped in data resolution rules allocation list to arrange respectively, and include the field all to have
Valid value.
By the above method, data is avoided to parse invalid situation, it is ensured that each initial value of field can be translated accordingly
At the analytic value made an appointment；If occurring the initial value not within value range in real data, handled according to invalid value.
Further, the mode for importing database uses ado database access interfaces, using sql like language
SELECT statement accesses reading to the entry in allocation list, and is deposited into database.
Sql like language has the characteristics that, towards set, height deproceduring is easy to use.
Further, the target data set files through network packet capturing or operation storage obtain.It is simple to operate.
Further, by the target data in target data set file according to the data lattice in target data format allocation list
Formula is formatted, and the target data of formatting is inserted into target data format allocation list, target data structure table is established.
Further, the process of the parsing paraphrase be by by the target data of formatting one by one, look by field searches
After looking for, carried out in insertion resolution rules allocation list；
Described search lookup be by in target data structure table one by one the value one by one of " field contents " in target
It is searched using the SELECT statement of sql like language in data resolution rules table, establishes index relative；
The inserted mode uses the INSERT sentences of sql like language, is inserted into using ado database interfaces.
Further, in searching for search procedure, the search condition including date or field data value is set.
Target data ranges are reduced, lookup paraphrase is carried out in resolution rules table for each field of each data,
To obtain the analysis result of a complete object data.
Further, resolution rules allocation list will be stated and data structure allocation list is managed as independent configuration item,
Top-of-form should clearly arrange at the beginning of design, before completing the collaborative design with its application scenarios, can not change.
The present invention has the beneficial effect that：
By the decoupling to target data and data Context resolution, the visualized management of data resolution rules is realized.It is right
In the software application of the present invention, the data that should be realized by the logic branch (if ... else, switch) of software code are parsed
Rule, application configuration table are managed, and software programming only needs the data parsing function except implementation rule, control its simplified it is soft
Part size of code.When resolution rules change, it is not necessary to modify software codes, can realize solution only by the modification of configuration file
The update for analysing content, reduces the incidence of software errors and hardware fault.
It, can be by the form of allocation list to data for the multiplexed format of plurality of devices in terms of General design
Resolution rules carry out unitized processing, improve the generalization level and adaptive characteristic of data analysis method.
Description of the drawings
Attached drawing is only used for showing the purpose of specific embodiment, and is not considered as limitation of the present invention, in entire attached drawing
In, identical reference mark indicates identical component.
Fig. 1 is flow chart of data processing figure of the embodiment of the present invention.
Specific implementation mode
Specifically describing the preferred embodiment of the present invention below in conjunction with the accompanying drawings, wherein attached drawing constitutes the application part, and
It is used to illustrate the principle of the present invention together with embodiments of the present invention.
Present embodiment discloses a kind of data analysis software optimization method based on allocation list management, as shown in Figure 1, including
Following steps：
Step S1, the target data format allocation list of foundation is imported into database；
Wherein, target data lattice configuration example is as shown in table 1, and the target data format that the present embodiment defines includes each word
Content, byte number and the explanation to field of section, the definition of field contents and corresponding byte number simultaneously can be arbitrary as desired
Definition, the target data format being not limited in table 1, the explanation of field according to the field of definition content and byte number specifically
It is bright, for example, field value range.
The target data format allocation list for importing database is the empty table of every attribute of the target data defined in gauge outfit.
1 target data format of table
| Serial number | Field contents | Byte number | Define explanation |
| 1 | Field 1 | 2 | Value range：0-3 |
| 2 | Field 2 | 4 | Value range：1-10 |
| …… | …… | …… | …… |
| 6 | Field 6 | n | Value range：1-XX |
Step S2, target data format is subjected to parsing and forms resolution rules allocation list；
In resolution rules allocation list, each field of target data format is carried out enumerating parsing paraphrase, it will be in field
Each field initial value establishes one-to-one relationship with analytic value in appearance.
Wherein, resolving is by data translation in target data format fields into the process of analytic value, the parsing of foundation
Rule is defined based on specific application demand；
In order to avoid data parse invalid situation, cope with each field in data resolution rules allocation list arranges respectively,
And include the field whole virtual value；Ensure that each initial value of field can translate into the analytic value made an appointment accordingly；
Wherein, the resolution rules definition configuration sample of target data is as shown in table 2.The value range section of 1 initial value of field
For [0,1,2,3], then the corresponding analytic value of initial value [parsing 1, parsing 2, parsing 3, parsing 4] is enumerated it one by one respectively in table
In.Wherein, the resolution rules definition configuration table of target data is as shown in table 2,
2 resolution rules allocation list of table
| Serial number | Field contents | Initial value | Analytic value |
| 1 | Field 1 | 0 | Parsing 1 |
| 2 | Field 1 | 1 | Parsing 2 |
| 3 | Field 1 | 2 | Parsing 3 |
| 4 | Field 1 | 3 | Parsing 4 |
| …… | …… | …… | …… |
| Field 6 | 1 | Parsing 1 | |
| …… | …… | …… | …… |
| Field 6 | XX | Parse XX |
Step S3, resolution rules allocation list is imported into database；
The present embodiment uses ado database access interfaces, using the SELECT statement of sql like language to the entry in allocation list
Access reading, and is stored in database.
Wherein, database may be provided in the database running equipment including business computer.
Step S4, the target data that acquisition and storage device generate in running forms target data set file；
It is obtained specifically, target data set file can be network packet capturing or operation storage, passes through movable storage medium
Target data set file is stored, the target data set file of acquisition is directed into database running equipment, is parsed as data
Initial data.
Step S5, using the target data of acquisition as data item, target data structure table is established.
Target data in target data set file is subjected to lattice according to the data format in target data format allocation list
Formula establishes target data structure table；
S6, according to the resolution rules in data resolution rules allocation list, to being parsed in the target data structure table
Paraphrase judges whether analysis result is effective, effectively, then exports analysis result；In vain, then enter S7；
Wherein, the process for parsing paraphrase be by the target data that will format one by one, searched by field searches after, be inserted into
It is carried out in resolution rules allocation list；
Specifically, search search be by in target data structure table one by one the value one by one of " field contents " in mesh
It is searched using the SELECT statement of sql like language in mark data resolution rules table, establishes index relative；
Optionally, the date can be set in the application, and the search conditions such as field data value reduce target data ranges, needle
Lookup paraphrase is carried out in resolution rules table to each field of each data, to obtain the solution of a complete object data
Analyse result；
Specifically, inserted mode is in the index relative of foundation, using the INSERT sentences of sql like language, ado numbers are used
It is carried out according to bank interface.
Whether S7, to appraise and decide corresponding resolution rules in resolution rules allocation list wrong；Errorless, then reporting objectives data are non-
Method data；It is wrong, then change corresponding resolution rules item in resolution rules allocation list, and by modified resolution rules allocation list
Again database is imported.
In an application of the invention, need to using resolution rules allocation list and data structure allocation list as independent configuration item into
Row management, changes controlled process.The top-of-form of resolution rules allocation list and data structure allocation list should define at the beginning of design
Agreement can not be changed before completing the collaborative design with its application scenarios.
In conclusion the present invention realizes data resolution rules by the decoupling to target data and data Context resolution
Visualized management.For the software application of the present invention, by should be by the logic branch (if ... else, switch) of software code
The data resolution rules of realization, application configuration table are managed, and software programming only needs the data parsing function except implementation rule,
It controls it and has simplified software code amount.When resolution rules change, it is not necessary to modify software codes, can be only by configuration file
Modification come realize parsing content update, reduce the incidence of software errors and hardware fault.
It, can be by the form of allocation list to data for the multiplexed format of plurality of devices in terms of General design
Resolution rules carry out unitized processing, improve the generalization level and adaptive characteristic of data analysis method.
It will be understood by those skilled in the art that realizing all or part of flow of above-described embodiment method, meter can be passed through
Calculation machine program is completed to instruct relevant hardware, and the program can be stored in computer readable storage medium.Wherein, institute
It is disk, CD, read-only memory or random access memory etc. to state computer readable storage medium.
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto,
Any one skilled in the art in the technical scope disclosed by the present invention, the change or replacement that can be readily occurred in,
It should be covered by the protection scope of the present invention.
Claims (10)
1. a kind of data analysis software optimization method based on allocation list management, which is characterized in that include the following steps：
S1, the target data format allocation list of foundation is imported into database；
S2, by target data format carry out parsing form resolution rules allocation list；
S3, resolution rules allocation list is imported into database；
The target data generated in S4, collecting device operation forms target data set file；
S5, using the target data of acquisition as data item, establish target data structure table；
S6, according to the resolution rules in data resolution rules allocation list, parsing paraphrase is carried out to the target data structure table, is sentenced
Whether disconnected analysis result is effective, effectively, then exports analysis result；In vain, then enter S7；
Whether S7, to appraise and decide corresponding resolution rules in resolution rules allocation list wrong；Errorless, then reporting objectives data are illegal number
According to；It is wrong, then corresponding resolution rules item in resolution rules allocation list is changed, and again by modified resolution rules allocation list
Import database.
2. data analysis software optimization method according to claim 1, which is characterized in that
The target data format includes content, byte number and the explanation to field of each field of target data.
3. data analysis software optimization method according to claim 1, which is characterized in that
In resolution rules allocation list, each field of target data format is carried out enumerating parsing paraphrase, it will be in field contents
Each field initial value establishes one-to-one relationship with analytic value.
4. data analysis software optimization method according to claim 3, which is characterized in that
Each field is arranged respectively in the data resolution rules allocation list, and includes the field whole virtual value.
5. data analysis software optimization method according to claim 1, which is characterized in that
The mode for importing database uses ado database access interfaces, using the SELECT statement of sql like language to allocation list
In entry access reading, and be deposited into database.
6. data analysis software optimization method according to claim 1, which is characterized in that
The target data set files through network packet capturing or operation storage obtain.
7. data analysis software optimization method according to claim 1, which is characterized in that
Target data in target data set file is formatted according to the data format in target data format allocation list,
The target data of formatting is inserted into target data format allocation list, target data structure table is established.
8. data analysis software optimization method according to claim 1, which is characterized in that
The process of the parsing paraphrase be by the target data that will format one by one, searched by field searches after, be inserted into and parse
It is carried out in rule configuration list；
Described search lookup be by in target data structure table one by one the value one by one of " field contents " in target data
It is searched using the SELECT statement of sql like language in resolution rules table, establishes index relative；
The inserted mode uses the INSERT sentences of sql like language, is inserted into using ado database interfaces.
9. data analysis software optimization method according to claim 8, which is characterized in that
In searching for search procedure, the search condition including date or field data value is set.
10. any data analysis software optimization methods of claim 1-9, which is characterized in that
The resolution rules allocation list and data structure allocation list are managed as independent configuration item, top-of-form is being set
Clearly arrange at the beginning of meter, before completing the collaborative design with its application scenarios, can not change.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810400283.7A CN108804106B (en) | 2018-04-28 | 2018-04-28 | Data analysis software optimization method based on configuration table management |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810400283.7A CN108804106B (en) | 2018-04-28 | 2018-04-28 | Data analysis software optimization method based on configuration table management |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108804106A true CN108804106A (en) | 2018-11-13 |
| CN108804106B CN108804106B (en) | 2022-04-19 |
Family
ID=64093107
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810400283.7A Active CN108804106B (en) | 2018-04-28 | 2018-04-28 | Data analysis software optimization method based on configuration table management |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108804106B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101931562A (en) * | 2010-09-29 | 2010-12-29 | 杭州华三通信技术有限公司 | Web log processing method and device |
| CN102799584A (en) * | 2011-05-24 | 2012-11-28 | 中华人民共和国天津出入境检验检疫局 | Processing method for screening and extraction of output data of detection instrument |
| CN105608088A (en) * | 2014-11-19 | 2016-05-25 | 中国航空工业集团公司西安飞机设计研究所 | Method for automatically creating database and dynamically recording data on the basis of configuration file |
-
2018
- 2018-04-28 CN CN201810400283.7A patent/CN108804106B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101931562A (en) * | 2010-09-29 | 2010-12-29 | 杭州华三通信技术有限公司 | Web log processing method and device |
| CN102799584A (en) * | 2011-05-24 | 2012-11-28 | 中华人民共和国天津出入境检验检疫局 | Processing method for screening and extraction of output data of detection instrument |
| CN105608088A (en) * | 2014-11-19 | 2016-05-25 | 中国航空工业集团公司西安飞机设计研究所 | Method for automatically creating database and dynamically recording data on the basis of configuration file |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108804106B (en) | 2022-04-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107704265B (en) | Configurable rule generation method for service flow | |
| CN106528129B (en) | A kind of Web application interface generation system and method | |
| US8856153B2 (en) | Creating data in a data store using a dynamic ontology | |
| CN105373469A (en) | Interface based software automation test method | |
| CN107644323A (en) | A kind of intelligent checks system of service-oriented stream | |
| CN103823797A (en) | FTP (file transfer protocol) based real-time industry database data synchronization system | |
| CN102164050A (en) | Log parsing method and log parsing node device | |
| CN102687124A (en) | Apparatus and method for analyzing query optimizer performance | |
| CN107391384A (en) | A kind of SQL statement detection method and system | |
| CN105677332A (en) | Software developing requirement management system | |
| CN105809309A (en) | Power system safety control strategy simulation system and simulation method thereof | |
| CN109299200A (en) | It is the method, device and equipment of database by data model translation | |
| CN103745010A (en) | Method and device for determining object attribute value based on CSV (Comma Separated Values) file | |
| CN107066551A (en) | The line and column storage method and system of a kind of tree shaped data | |
| CN103235757B (en) | Several apparatus and method that input domain tested object is tested are made based on robotization | |
| CN108766507A (en) | A kind of clinical quality index calculating method based on CQL Yu standard information model openEHR | |
| CN104462095B (en) | A kind of extracting method and device of query statement common portion | |
| CN100471136C (en) | Configuration rule detecting method and device | |
| CN101770367A (en) | Compressing method and compressing device of .NET file | |
| CN108804106A (en) | A kind of data analysis software optimization method based on allocation list management | |
| CN114218256B (en) | Access statement processing method, device, equipment and storage medium | |
| CN111597202B (en) | Battlefield situation information on-demand extraction method based on fractal theory | |
| CN111046066B (en) | Remote database object optimization method, device, equipment and storage medium | |
| CN113722288A (en) | Modeling method for time-space data statistics | |
| CN101339504B (en) | Human machine command output formats checking procedure based on text |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |