CN107908798A - The processing method and system of a kind of data file - Google Patents
The processing method and system of a kind of data file Download PDFInfo
- Publication number
- CN107908798A CN107908798A CN201711386003.3A CN201711386003A CN107908798A CN 107908798 A CN107908798 A CN 107908798A CN 201711386003 A CN201711386003 A CN 201711386003A CN 107908798 A CN107908798 A CN 107908798A
- Authority
- CN
- China
- Prior art keywords
- data
- data file
- file
- processing method
- directory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/162—Delete operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses the processing method and system of a kind of data file, its processing method comprises the following steps：A, establishment file is pressed from both sides, and the data file for needing to store is stored in file；B, the data file on disk is obtained, wherein data file is stored with the data structure of shared drive；C, it is attached with local data base and decompresses to obtain the data file for needing to be handled；D, raw data file is subjected to format conversion and is screened using the first parameter.The present invention is stored the data file of clear data structure on disk with the data structure of shared drive, and it is loaded into shared drive, improve loading efficiency, and it supports loading at one, many places to use, extra EMS memory occupation is greatly reduced, while it can automatically extract data, and automatic judgement is carried out to test result and exports test report automatically, reliability is high, brings great convenience for the use of people.
Description
Technical field
The present invention relates to the processing method and system of data documents disposal technical field, specially a kind of data file.
Background technology
Data are a kind of expression-forms to true, concept or instruction, can be put and be handled by manual or automatic makeup, number
According to by explaining and after assigning certain meaning, becoming as information, data processing be collection to data, storage, retrieval plus
Work, conversion and transmission, the basic object of data processing be from it is substantial amounts of, be probably in rambling, elusive data
It is valuable, significant data to extract and derive for some specific people, data processing be system engineering and
The basic link automatically controlled, data processing through social production and social life every field, data processing technique
Development and its breadth and depth of application, greatly affect the process of human social development, prior art internal storage data can only
Used in individual process, if multiple processes need to use identical data, need to load respectively, update respectively, so as to lead
Extra EMS memory occupation is caused, and different personnel are manually entered test result, there are problems that test result disunity, for making for people
With making troubles.
The content of the invention
It is an object of the invention to provide the processing method and system of a kind of data file, to solve in above-mentioned background technology
The problem of proposition.
To achieve the above object, the present invention provides following technical solution：The processing method and system of a kind of data file, its
Processing method comprises the following steps：
A, establishment file is pressed from both sides, and the data file for needing to store is stored in file；
B, the data file on disk is obtained, wherein data file is stored with the data structure of shared drive；
C, it is attached with local data base and decompresses to obtain the data file for needing to be handled；
D, raw data file is subjected to format conversion and is screened using the first parameter, and using the data filtered out as straight
Connect test data；
E, direct test data is used into the second Parameter Switch as indirectly testing data, and by direct test data and indirectly testing
Data are contrasted with corresponding standard evaluation and test data respectively；
F, data file is loaded into shared drive by the way of memory mapping, and shared drive is initialized；
G, data update information is recorded based on the loading procedure, data update information includes the filename and first of data file
Temporal information；
H, processing is read out data file according to data update information.
Preferably, the step A includes：Establishment file folder is the Shared Folders for multi-user access, and need to
The data file of storage is stored in file.
Preferably, it is described before step B is carried out, further include：Data file is preserved with the data structure of shared inner side
In disk, and the data structure of shared inner side includes array, hash table, even numbers group and word lookup tree.
Preferably, the step C includes：Obtain the control file corresponding to the data file after decompression；And obtaining
In the case of failure, according to the content and form of the prespecified control file of database, for the Generating Data File after decompression
Control file corresponding to it.
Preferably, first parameter includes standard high value, standard low level value, frequency, duty cycle, rising tiltedly
Rate, maximum and minimum value, the second parameter includes upper punching, undershoot, square impact and negative punching, and the second parameter is by the first gain of parameter.
Preferably, it is described after step F, further include：1., detection is updated to the data file on disk；2., when
Determine that there are during the data file of renewal in need, it would be desirable to which the data file of renewal is copied under more new directory；3., will more
Data file under new directory is loaded into shared drive, and shared drive is initialized；4., by the number under data directory
Backup directory is moved to according to file；5., the data file under more new directory is moved under data directory, wherein, more new directory,
Data directory and backup directory are in identical file system；6., delete data file update before data file mapping.
Preferably, the time when first time information loads for loading procedure.
Preferably, after the step H, further include：If 1., first time indicated in the data update information that reads
Time in information is later than the time in the second temporal information, it is determined that data file has renewal；2., by under data directory more
New data file is mapped to shared drive and is waited；3., when the stand-by period exceeding preset time threshold, delete data
The data file mapping of file more fresh money.
Compared with prior art, beneficial effects of the present invention are as follows：
The present invention is stored the data file of clear data structure on disk with the data structure of shared drive, and is added
It is downloaded in shared drive, improves loading efficiency, and it supports loading at one, many places to use, and greatly reduces extra memory
Take, while it can automatically extract data, and automatic judgement is carried out to test result and exports test report automatically, can
It is high by property, bring great convenience for the use of people.
Brief description of the drawings
Fig. 1 is flow diagram of the present invention.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without making creative work
Embodiment, belongs to the scope of protection of the invention.
Referring to Fig. 1, the processing method and system of a kind of data file, its processing method comprise the following steps：
A, establishment file is pressed from both sides, and the data file for needing to store is stored in file；
B, the data file on disk is obtained, wherein data file is stored with the data structure of shared drive；
C, it is attached with local data base and decompresses to obtain the data file for needing to be handled；
D, raw data file is subjected to format conversion and is screened using the first parameter, and using the data filtered out as straight
Connect test data；
E, direct test data is used into the second Parameter Switch as indirectly testing data, and by direct test data and indirectly testing
Data are contrasted with corresponding standard evaluation and test data respectively；
F, data file is loaded into shared drive by the way of memory mapping, and shared drive is initialized；
G, data update information is recorded based on the loading procedure, data update information includes the filename and first of data file
Temporal information；
H, processing is read out data file according to data update information.
Step A includes：Establishment file folder is the Shared Folders for multi-user access, and the data that need to be stored are literary
Part is stored in file.
Before step B is carried out, further include：Data file is stored in disk with the data structure of shared inner side, and
The data structure of shared inner side includes array, hash table, even numbers group and word lookup tree.
Step C includes：Obtain the control file corresponding to the data file after decompression；And in the situation for obtaining failure
Under, it is the Generating Data File after decompression corresponding to it according to the content and form of the prespecified control file of database
Control file.
First parameter includes standard high value, standard low level value, frequency, duty cycle, the rate of rise, maximum and most
Small value, the second parameter includes upper punching, undershoot, square impact and negative punching, and the second parameter is by the first gain of parameter.
After step F, further include：1., detection is updated to the data file on disk；2., when determining exist
During the data file of renewal in need, it would be desirable to which the data file of renewal is copied under more new directory；3., by under more new directory
Data file is loaded into shared drive, and shared drive is initialized；4., by under data directory data file move
To backup directory；5., the data file under more new directory is moved under data directory, wherein, more new directory, data directory with
And backup directory is in identical file system；6., delete data file update before data file mapping.
Time when first time information loads for loading procedure.
After step H, further include：If 1., in first time information indicated in the data update information that reads when
Between be later than time in the second temporal information, it is determined that data file has renewal；2., by updated data text under data directory
Part is mapped to shared drive and is waited；3., when the stand-by period exceeding preset time threshold, delete data file update money
Data file mapping.
In use, the data file of clear data structure on disk is stored with the data structure of shared drive, and
It is loaded into shared drive, improves loading efficiency, and it supports loading at one, many places to use, and greatly reduces extra
EMS memory occupation, while it can automatically extract data, and test result is carried out automatic to judge and output test automatically
Report, reliability is high, brings great convenience for the use of people.
Although an embodiment of the present invention has been shown and described, for the ordinary skill in the art, can be with
Understanding without departing from the principles and spirit of the present invention can carry out these embodiments a variety of changes, modification, replace
And modification, the scope of the present invention is defined by the appended.
Claims (8)
1. the processing method and system of a kind of data file, it is characterised in that：Its processing method comprises the following steps：
A, establishment file is pressed from both sides, and the data file for needing to store is stored in file；
B, the data file on disk is obtained, wherein data file is stored with the data structure of shared drive；
C, it is attached with local data base and decompresses to obtain the data file for needing to be handled；
D, raw data file is subjected to format conversion and is screened using the first parameter, and using the data filtered out as straight
Connect test data；
E, direct test data is used into the second Parameter Switch as indirectly testing data, and by direct test data and indirectly testing
Data are contrasted with corresponding standard evaluation and test data respectively；
F, data file is loaded into shared drive by the way of memory mapping, and shared drive is initialized；
G, data update information is recorded based on the loading procedure, data update information includes the filename and first of data file
Temporal information；
H, processing is read out data file according to data update information.
2. the processing method and system of a kind of data file according to claim 1, it is characterised in that：In the step A
Including：Establishment file folder is the Shared Folders for multi-user access, and the data file that need to be stored is stored in file
In.
3. the processing method and system of a kind of data file according to claim 1, it is characterised in that：It is described to be walked
Before rapid B, further include：Data file is stored in disk with the data structure of shared inner side, and the data knot of shared inner side
Structure includes array, hash table, even numbers group and word lookup tree.
4. the processing method and system of a kind of data file according to claim 1, it is characterised in that：In the step C
Including：Obtain the control file corresponding to the data file after decompression；And in the case where obtaining failure, it is pre- according to database
The control file that the content and form of control file as defined in first are the Generating Data File after decompression corresponding to it.
5. the processing method and system of a kind of data file according to claim 1, it is characterised in that：First parameter
Including standard high value, standard low level value, frequency, duty cycle, the rate of rise, maximum and minimum value, the second parameter bag
Punching, undershoot, square impact and negative punching are included, and the second parameter is by the first gain of parameter.
6. the processing method and system of a kind of data file according to claim 1, it is characterised in that：It is described in step F
Afterwards, further include：1., detection is updated to the data file on disk；2., when determining that there are the data of renewal in need
During file, it would be desirable to which the data file of renewal is copied under more new directory；3., by the data file under more new directory be loaded into altogether
Enjoy in memory, and shared drive is initialized；4., the data file under data directory is moved to backup directory；5., will
Data file under more new directory is moved under data directory, wherein, more new directory, data directory and backup directory are same
In one file system；6., delete data file update before data file mapping.
7. the processing method and system of a kind of data file according to claim 1, it is characterised in that：The first time
Time when information loads for loading procedure.
8. the processing method and system of a kind of data file according to claim 1, it is characterised in that：The step H it
Afterwards, further include：If 1., the time in first time information indicated in the data update information that reads be later than the second time letter
Time in breath, it is determined that data file has renewal；2., updated data file under data directory is mapped to shared drive
And waited；3., when the stand-by period exceeding preset time threshold, delete data file update money data file mapping.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711386003.3A CN107908798A (en) | 2017-12-20 | 2017-12-20 | The processing method and system of a kind of data file |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711386003.3A CN107908798A (en) | 2017-12-20 | 2017-12-20 | The processing method and system of a kind of data file |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107908798A true CN107908798A (en) | 2018-04-13 |
Family
ID=61870594
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711386003.3A Pending CN107908798A (en) | 2017-12-20 | 2017-12-20 | The processing method and system of a kind of data file |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107908798A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108921417A (en) * | 2018-06-25 | 2018-11-30 | 泰康保险集团股份有限公司 | Data processing method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101257661A (en) * | 2008-04-09 | 2008-09-03 | 中兴通讯股份有限公司 | Method and system for considerable user service information load application |
| CN103530420A (en) * | 2013-10-30 | 2014-01-22 | 北京奇虎科技有限公司 | Data file dynamic update method and device |
| CN106653092A (en) * | 2017-01-05 | 2017-05-10 | 上海剑桥科技股份有限公司 | Processing method and processing system of DDR (Double Data Rate) test waveform data file |
| CN106708825A (en) * | 2015-07-29 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data file processing method and system |
-
2017
- 2017-12-20 CN CN201711386003.3A patent/CN107908798A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101257661A (en) * | 2008-04-09 | 2008-09-03 | 中兴通讯股份有限公司 | Method and system for considerable user service information load application |
| CN103530420A (en) * | 2013-10-30 | 2014-01-22 | 北京奇虎科技有限公司 | Data file dynamic update method and device |
| CN106708825A (en) * | 2015-07-29 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data file processing method and system |
| CN106653092A (en) * | 2017-01-05 | 2017-05-10 | 上海剑桥科技股份有限公司 | Processing method and processing system of DDR (Double Data Rate) test waveform data file |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108921417A (en) * | 2018-06-25 | 2018-11-30 | 泰康保险集团股份有限公司 | Data processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109656934B (en) | Source Oracle database DDL synchronization method and device based on log analysis | |
| CN103778148B (en) | Life cycle management method and equipment for data file of Hadoop distributed file system | |
| CA2367181A1 (en) | Method for extracting information from a database | |
| CN104021217B (en) | System and method for extracting fragment file and deleted file of mobile phone | |
| DE102010043265A1 (en) | Systems and methods for processing and managing object-related data for use by multiple applications | |
| CN100452034C (en) | Method and device for handling metadata | |
| CN106021301A (en) | Comparing system and method for data having different file formats | |
| CN102937924A (en) | File allocation table (FAT) data recovery method based on file characteristic and file system | |
| CN100354861C (en) | Data compresser,data decompresser and data managing system | |
| CN109284492B (en) | Method and device for generating notification document | |
| CN107908798A (en) | The processing method and system of a kind of data file | |
| CN104951482B (en) | A kind of method and device of the image file of operation Sparse formats | |
| CN117112769B (en) | Intelligent fault maintenance question-answering system and method based on large language model | |
| CN104156430A (en) | Device and method for fast extracting Android mobile phone data | |
| CN105956070A (en) | Method and system for integrating repetitive records | |
| CN108415918A (en) | A kind of equipment account management system and method | |
| CN106227857B (en) | Data-pushing and loading method and device | |
| CN105786916B (en) | A kind of storage method and system of the gradation directory based on large capacity table | |
| CN104392506B (en) | Data syn-chronization and data managing method are patrolled and examined in a kind of power station water conservancy project for supporting multiple terminals platform | |
| CN105894142A (en) | Electronic process based filing and modeling method | |
| CN104391945A (en) | Method and device for processing database file data index | |
| CN104821829B (en) | A kind of Huffman tree store method and system | |
| JP2006114047A (en) | Performance management data processing device using single table and its method | |
| CN108287788A (en) | A kind of use-case step matching method based on test case, system | |
| CN107122463A (en) | File saving method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180413 |