CN104699721B - A kind of high-volume industrial data organizes and implements method - Google Patents
A kind of high-volume industrial data organizes and implements method Download PDFInfo
- Publication number
- CN104699721B CN104699721B CN201310670073.7A CN201310670073A CN104699721B CN 104699721 B CN104699721 B CN 104699721B CN 201310670073 A CN201310670073 A CN 201310670073A CN 104699721 B CN104699721 B CN 104699721B
- Authority
- CN
- China
- Prior art keywords
- data
- parameter
- value
- backup
- index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The present invention proposes a kind of high-volume industrial data and organizes and implements method, includes the following steps：1）The logical construction of data is set；2）The physical arrangement of data is set；The physical arrangement includes information index table, message store table and parametric data table；3）Before system commencement of commercial operation, system data set is initialized；4）System takes data extraction or protection；Backup or update operation.A kind of high-volume industrial data of the present invention organizes and implements method, realizes extraction, update, backup and the protection of high-volume data.
Description
Technical field
The system software technical field for being related to high-volume data the invention belongs to be applied to auto industry etc. and using, especially
It is related to a kind of high-volume industrial data and organizes and implements method.
Background technology
The advantages of dynamic Control mode is replaced, electronic control mode, is to control accurate, easily scalable, modification and complete
It is kind.But the development of electron controls technology also leads to the drastically expansion of software data scale simultaneously.Certain vehicle electronic control units
The data volume exchange that used technological parameter reaches up to ten thousand a or even 100,000 upper, so huge during operation can cause to control
The upgrade maintenance of software causes many obstacles, but most direct disastrous effect is to seriously affect the operational efficiency of control software.
Traditional Method of Data Organization is into global variable by parameter definition, and this mode causes supplemental characteristic maintenance upgrade
Difficulty, and can not ensure the consistency that data are read and write when each module of system is concurrently run.These problems are difficult in its framework
It is interior while evade or solve.
Invention content
In order to solve the technical problem in the presence of background technology, the present invention proposes a kind of high-volume industrial data tissue
Implementation realizes extraction, update, backup and the protection of high-volume data.
The present invention technical solution be：A kind of high-volume industrial data organizes and implements method, it is characterised in that：It is described
Method includes the following steps：
1）The logical construction of data is set；
2）The physical arrangement of data is set；The physical arrangement includes information index table, message store table and supplemental characteristic
Table；
3）Before system commencement of commercial operation, system data set is initialized；
4）System takes data extraction or protection；Backup or update operation.
Above-mentioned steps 1）Parameter ID of the logical construction of middle data including data, parameter name, data type, logic are inclined
Shifting, value range, function description；Design logic structure is there are two purpose, first, Meaning of Information in physical arrangement is explained, second is that rule
The design of model physical arrangement, if be put into building, logical construction is equivalent to design drawing, and physical arrangement is equivalent to practical build
Building structure；All summary of parameters.An are formed into a parameter logistics information table.
Above-mentioned steps 2）Middle information index table is an integer array, and array element saves as message store table index；Number
Organizing subscript calculation formula is：Information index table subscript=parameter ID% information index table length；
Above-mentioned steps 2）Middle message store table is a structural array table；Each element includes three contents：Parameter ID, ginseng
Number length, parameter physical address.Parameter physical address is directed toward address of the parameter value in DSB data store block；Locate each element to refer to
A parameter in structural array table, each parameter includes several attributes, equally by taking building as an example, if a building has 24
Layer, every layer of only one set of house, this building only have so unit, then if this building is compared to a structural array table,
So the table has 24 elements, each one set of house of element representation（One parameter）, then there are some attributes in these houses, such as
Number（Parameter ID）, size（Parameter length）, house type etc..
Above-mentioned steps 2）Middle parametric data table is continuous sheet of memory block, wherein what is stored is the numerical value of parameter, including
Software code and other data values, the logical offset according to parameter store in order successively.
Above-mentioned steps 3）What middle system data set was initialized comprises the concrete steps that：
3.1）Data acquire：Determine the initial value of each data, initialization values are friction torque coefficients：Height idling
Setting value, vehicle speed sensor type set value etc.；
3.2）Logically in information table parameter sequence data collection value pad parameter tables of data；
3.3）Parameter to be initiated is arranged from small to large according to ID, successively fill message concordance list and message store table.
Above-mentioned steps 3.3）Fill message concordance list and message store table comprise the concrete steps that：
3.3.1）Take out a parameter；
3.3.2）Index value is obtained according to index value=parameter ID% parameter sums；
3.3.3）Judgment step 3.3.2）In index value whether correspond to position in concordance list and filled in, if so, being walked
Rapid 3.3.4）；If it is not, then fill in the index value of corresponding position；
3.3.4）Index value adds 1；
3.3.5）It is positioned according to index value to parameter storage table corresponding position；
3.3.6）Judge whether corresponding position has parameter and insert, if so, return to step 3.3.4）；If otherwise filling ginseng
Number storage table corresponds to position.
3.3.7）After the completion of all parameter fillings, return to step 3.3.1）.
The present invention devises a kind of high-volume industrial data and organizes and implements method, this method with it is innovative logically and physically
Based on structure definition, extraction, update, backup and the protection of high-volume data are realized.By it was verified that this method in work
It is more efficient and easy to maintain with common Method of Data Organization ratio in the application in industry field.
1）Devise a kind of data organization of system, operation and maintenance method, this method with it is innovative logically and physically
Based on structure design, and pass through mating data extraction method, realize extraction, update, backup and the guarantor of high-volume data
Shield.
2）On the basis of traditional data Logic Structure Design, data and code unified definition are parameter item by the present invention,
It is managed by unified mode.
3）Devise a kind of physical storage structure based on Hash table, with realize the separation of data information and numerical value storage and
It uses.
4）Realized based on above-mentioned logic, physical arrangement, devise a kind of relevant data extraction method, this method have compared with
High efficiency and ease for use.
5）In the case where above design is supported, data update, backup and guard method a kind of simple and be easily achieved are devised.
This method realizes complete industrial mass parameter tissue, maintenance and an operation method.It can using this method
To be stored, safeguarded, upgraded and backed up to data with relatively low cost, and data are avoided to a certain extent by multimode
The content conflicts concurrently used.
Description of the drawings
Fig. 1 is flow chart of the method for the present invention；
Fig. 2 is physical storage structure schematic diagram of the present invention；
Fig. 3 is parameter information initialization flowchart of the present invention；
Fig. 4 is data extraction flow chart of the present invention；
Specific embodiment
Referring to Fig. 1, the present invention proposes a kind of high-volume industrial data and organizes and implements method, and method includes the following steps：
1）The logical construction of data is set；For different industries, there is different data sets, according to this method, first
All data in system are classified by tradition and are organized into several parameter items, each parameter item is included as properties：Parameter
ID：The number of unique id parameter item in system, in same product line life cycle, ID immobilizes；Parameter name：Use word
Symbol string name identification parameter item, uses convenient for software developer；Data type：Characterising parameter data type；Logical offset：The ginseng
Relative position of the number in parameter logistics information table；Other attributes：Described including value range, function etc., for related personnel
It is referred in design use.
Software program code is also regarded as a kind of parameter by the method for the present invention, its type is appointed as CODE, in this way
The program of script and data are stored and be used, and all summary of parameters.An are formed a parameter logistics using in a manner of unified
Information table.
2）The physical arrangement of data is set；The physical arrangement includes information index table, message store table and supplemental characteristic
Table；
Information index table is an integer array, and array element saves as message store table index；Array index calculates public
Formula is：Information index table subscript=parameter ID% information index table length；
Message store table is a structural array table；Each element includes three contents：Parameter ID, parameter length, parameter
Physical address.Parameter physical address is directed toward address of the parameter value in DSB data store block, is in fig. 2 corresponding Flash units
Address.Locate each element and refer to a parameter in structural array table, each parameter includes several attributes, is equally with building
Example, if there are 24 floor, every layer of only one set of house in a building, this building only has so unit, then if this building ratio
Make a structural array table, then the table has 24 elements, each one set of house of element representation（One parameter）, then these rooms
Son has some attributes, such as number（Parameter ID）, size（Parameter length）, house type etc..
Information index table and message store table realize a Hash table structure, to realize according to parameter ID to parameter information
Straight deposit of structure directly takes.
Parametric data table is continuous sheet of memory block, wherein what is stored is the numerical value of parameter, including software code and its
His data value, the logical offset according to parameter store in order successively.The table is the basis of follow-up data update and backup.It is related
After the completion of Data Structure Design, data maintenance to realize the present invention and operation function before system commencement of commercial operation, are needed to being
System data set is initialized, and is specifically worked comprising both sides：
3）Before system commencement of commercial operation, system data set is initialized；It comprises the concrete steps that：
3.1）Data acquire：The affiliated commercial manufacturer of system rule of thumb determines each data with specific operating mode in the step
Initial value, initialization values are friction torque coefficients, i.e., low idling setting value, vehicle speed sensor type set value etc.；
3.2）Logically in information table parameter sequence data collection value pad parameter tables of data；
3.3）Parameter to be initiated is arranged from small to large according to ID, successively fill message concordance list and message store table；
Fill message concordance list and message store table comprise the concrete steps that：
3.3.1）Take out a parameter；
3.3.2）Index value is obtained according to index value=parameter ID% parameter sums；
3.3.3）Judgment step 3.3.2）In index value whether correspond to position in concordance list and filled in, if so, being walked
Rapid 3.3.4）；If it is not, then fill in the index value of corresponding position；
3.3.4）Index value adds 1；
3.3.5）It is positioned according to index value to parameter storage table corresponding position；
3.3.6）Judge whether corresponding position has parameter and insert, if so, return to step 3.3.4）；If otherwise filling ginseng
Number storage table corresponds to position.
3.3.7）After the completion of all parameter fillings, return to step 3.3.1）.
Data structure initializes：
The step includes the initialization to parameter reference table, message store table and parametric data table, realizes as follows：
1）Logically in information table parameter sequence data collection value pad parameter tables of data；
2）Parameter to be initiated is arranged from small to large according to ID, according to flow shown in Fig. 3 successively fill message concordance list
And message store table.
The daily maintenance operation of data：System initialization is completed, and can carry out normal daily maintenance operation, main to wrap
Include following content：
Data extraction/protection：
Since data storage method is numerical value and information separation storage, data must use this during system operation
The special extracting method of invention design extracts data value, and this method is as shown in Figure 4.
Specific data extraction/protection is described as follows：
1）The parameter that need to be used is extracted when module periodic duty starts, its value is copied in temporary variable；
2）These temporary variables are regarded corresponding parameter copy in the periodic duty to use；
3）End of operation if necessary, copy variable after modification is carried out copying back original parameter.
This extraction->Using->The design write back can be to a certain extent realized when multimode concurrently performs to parameter
Protection, prevent access conflict of the multimode to same parameters.And cost is only a Hash tables readings operation.
Data backup/update：
The backup and upgrading of following steps realization software can be used by the present invention：
1）Backup parametric data table：Parametric data table need to be only copied among corresponding backup file；
2）Software upgrading：Code or data modification, it is only necessary to extract a backup file, and according to logical message
The corresponding code of logical offset modification and data value in table, generate upgrade file, write back covering parametric data table.
It can be seen that need to only parametric data table region be operated by being upgraded using the present invention or being backed up, and
And extremely suitable typical products in mass production upgrading and backup by the way of upgrading/backup file.
Specific embodiments of the present invention 1：Certain 3 standard diesel oil automobile ECU controller software of model Europe
1）Structure design/initialization：
After the completion of nascent structure design/initialization, analyze it and use parameter 9144, totally 4151, information index table, table
Long 17KB, message store table totally 9144, the long 74KB of table, the common 1.54MB of parametric data table.
2）Data are extracted：
During parameter extraction, it is assumed that target component ID is 18036, inquires to obtain 18036 corresponding address according to above-mentioned steps
For 0x40018711, query argument tables of data obtains the parameter value as 0xFFFE.Through analysis, sampling process carries out modulo operation altogether
Once, comparison operation 1 time, interior access value 4 times.
3）Data backup/update：
Calibration（Backup）File size is 2.2MB, altogether write parameters 9144, write time totally 1 point 47 seconds.
Embodiment 2：Certain 4 standard diesel oil automobile ECU controller software of model Europe
1）Structure design/initialization：
After the completion of nascent structure design/initialization, analyze it and use parameter 12486, totally 4547, information index table, table
Long 19KB, message store table totally 12486, the long 100KB of table, the common 3MB of parametric data table.
2）Data are extracted：
During parameter extraction, it is assumed that target component ID is 39278, and query argument tables of data obtains the parameter value as 0x3FFF.
Through analysis, it is primary that sampling process carries out modulo operation altogether, comparison operation 2 times, interior access value 5 times.
3）Data backup/update：
Calibration（Backup）File size is 3.2MB, altogether write parameters 12486, write time totally 2 points 56 seconds.
Claims (4)
1. a kind of high-volume industrial data organizes and implements method, it is characterised in that：It the described method comprises the following steps：
1) logical construction of data is set；Parameter ID of the logical construction including data, parameter name, data type, logic
Offset, value range, function description；All summary of parameters.An are formed into a parameter logistics information table；
2) physical arrangement of data is set；The physical arrangement includes information index table, message store table and parametric data table；
3) before system commencement of commercial operation, system data set is initialized；
3.1) data acquire：Determine the initial value of each data, initialization values are friction torque coefficients；
3.2) logically in information table parameter sequence data collection value pad parameter tables of data；
3.3) parameter to be initiated is arranged from small to large according to ID, successively fill message concordance list and message store table；
3.3.1 a parameter) is taken out；
3.3.2 index value) is obtained according to index value=parameter ID% parameter sums；
3.3.3) judgment step 3.3.2) in index value whether correspond to position in concordance list and filled in, if so, carrying out step
3.3.4)；If it is not, then fill in the index value of corresponding position；
3.3.4) index value adds 1；
3.3.5 it) is positioned according to index value to parameter storage table corresponding position；
3.3.6) judge whether corresponding position has parameter and insert, if so, return to step 3.3.4)；If otherwise pad parameter is deposited
Storage table corresponds to position；
3.3.7) after the completion of all parameter fillings, return to step 3.3.1)；
4) system takes data extraction or protection；Backup or update operation；
The extraction or protection step are as follows：
1) parameter that need to be used is extracted when module periodic duty starts, its value is copied in temporary variable；
2) these temporary variables are regarded corresponding parameter copy in the periodic duty to use；
3) end of operation if necessary, copy variable after modification is carried out copying back original parameter；
The backup or update step are as follows：
1) backup parametric data table：Parametric data table is copied among corresponding backup file；
2) software upgrading：When code or data modification, a backup file, and the logical offset in logical message table are extracted
The corresponding code of modification and data value, generate upgrade file, write back covering parametric data table.
2. high-volume industrial data according to claim 1 organizes and implements method, it is characterised in that：Believe in the step 2)
Breath concordance list is an integer array, and array element saves as message store table index；Array index calculation formula is：Information rope
Draw table subscript=parameter ID% information index table length.
3. high-volume industrial data according to claim 1 organizes and implements method, it is characterised in that：Believe in the step 2)
It is a structural array table to cease storage table；Each element includes three contents：Parameter ID, parameter length, parameter physical address；Ginseng
Number physical address is directed toward address of the parameter value in DSB data store block.
4. high-volume industrial data according to claim 1 organizes and implements method, it is characterised in that：Join in the step 2)
Number tables of data are continuous sheet of memory blocks, wherein what is stored is the numerical value of parameter, including software code and other data values, according to
It is stored in order successively according to the logical offset of parameter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310670073.7A CN104699721B (en) | 2013-12-10 | 2013-12-10 | A kind of high-volume industrial data organizes and implements method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310670073.7A CN104699721B (en) | 2013-12-10 | 2013-12-10 | A kind of high-volume industrial data organizes and implements method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104699721A CN104699721A (en) | 2015-06-10 |
| CN104699721B true CN104699721B (en) | 2018-07-03 |
Family
ID=53346853
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310670073.7A Active CN104699721B (en) | 2013-12-10 | 2013-12-10 | A kind of high-volume industrial data organizes and implements method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104699721B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111158796B (en) * | 2019-12-25 | 2023-05-23 | 中国航空工业集团公司西安飞机设计研究所 | Data processing method of hydraulic control software |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5742809A (en) * | 1990-08-31 | 1998-04-21 | Fujitsu Limited | Database generic composite structure processing system |
| CN1665237A (en) * | 2004-03-05 | 2005-09-07 | 华为技术有限公司 | A method for implementing intelligent network service |
| CN101212689A (en) * | 2006-12-25 | 2008-07-02 | 青岛海信电器股份有限公司 | Method for software upgrade for digital TV signal receiver |
| CN102609282A (en) * | 2012-01-19 | 2012-07-25 | 苏州希图视鼎微电子有限公司 | Execution method for NAND flash curing codes |
| CN102623066A (en) * | 2012-01-19 | 2012-08-01 | 苏州希图视鼎微电子有限公司 | Saving and acquisition method for solidification code parameter table |
-
2013
- 2013-12-10 CN CN201310670073.7A patent/CN104699721B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5742809A (en) * | 1990-08-31 | 1998-04-21 | Fujitsu Limited | Database generic composite structure processing system |
| CN1665237A (en) * | 2004-03-05 | 2005-09-07 | 华为技术有限公司 | A method for implementing intelligent network service |
| CN101212689A (en) * | 2006-12-25 | 2008-07-02 | 青岛海信电器股份有限公司 | Method for software upgrade for digital TV signal receiver |
| CN102609282A (en) * | 2012-01-19 | 2012-07-25 | 苏州希图视鼎微电子有限公司 | Execution method for NAND flash curing codes |
| CN102623066A (en) * | 2012-01-19 | 2012-08-01 | 苏州希图视鼎微电子有限公司 | Saving and acquisition method for solidification code parameter table |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104699721A (en) | 2015-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101216846B (en) | Emulated data visualized and cooperated sharing method | |
| CN103593518B (en) | A kind of aircraft Modifying model system based on mode testing data | |
| CN101799753B (en) | Method and device for realizing tree structure | |
| CN102819426B (en) | Method for synchronizing AUTOSAR (automotive open system architecture) model to Simulink model | |
| CN102043719A (en) | Method for testing IEC61850 configuration description file | |
| CN106339247A (en) | Loading system and loading method for DLL (Dynamic Link Library) file | |
| JP2012093911A5 (en) | ||
| CN111080791A (en) | Building analysis method and system based on lightweight BIM model | |
| CN105022848A (en) | Method for processing Kinematics and Compliance characteristic data of sedan suspension | |
| US20160140261A1 (en) | Lean product modeling systems and methods | |
| CN112507449A (en) | Vehicle performance simulation data construction method based on XML | |
| CN105320669B (en) | Data storage, read method and data storage, reading device | |
| CN104424368B (en) | A kind of processing method of automotive suspension kinematics characteristic and kinetic characteristics data | |
| CN104699721B (en) | A kind of high-volume industrial data organizes and implements method | |
| CN103235757B (en) | Several apparatus and method that input domain tested object is tested are made based on robotization | |
| CN104898991A (en) | Automatic-RAL-based register access method and system | |
| CN105930354A (en) | Storage model conversion method and device | |
| CN103593730A (en) | Design parameter management system capable of backtracking | |
| CN104299170B (en) | Intermittent energy source mass data processing method | |
| CN103399776A (en) | Creation method and system for reusable MOCK | |
| CN104781814A (en) | Reference data segmentation from single to multiple tables | |
| Zhou et al. | SparkSCAN: a structure similarity clustering algorithm on spark | |
| Lang et al. | Virtual powertrain calibration at GM becomes a reality | |
| CN103856466A (en) | Acquisition terminal device capable of configuring protocols automatically | |
| US20090164197A1 (en) | Method for transforming overlapping paths in a logical model to their physical equivalent based on transformation rules and limited traceability |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |