CN101169711A - Data conversion system and method - Google Patents
Data conversion system and method Download PDFInfo
- Publication number
- CN101169711A CN101169711A CNA2006100633508A CN200610063350A CN101169711A CN 101169711 A CN101169711 A CN 101169711A CN A2006100633508 A CNA2006100633508 A CN A2006100633508A CN 200610063350 A CN200610063350 A CN 200610063350A CN 101169711 A CN101169711 A CN 101169711A
- Authority
- CN
- China
- Prior art keywords
- data
- conversion
- file
- parameter
- bag
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention provides a data conversion method, which comprises packing a positioning method, a data read method, a data segmentation method and a data storage method of files with different formats into a data conversion module packet; setting parameters for performing data file format conversion including an original data file address, selection range of effective data in the data file, conversion manner of the data file and an access address of the data file generated after conversion; invoking the constructed the data conversion module packet, and transmitting the set parameters to the data conversion module packet; and executing various methods in the data conversion module packet according to the parameters. The invention also provides a data conversion system. The invention can realize batch access and storage format conversion of the data with different formats, so as to omit editing of a large number of bottom layer detailed processing codes, reduce the scale and the workload of software development, and decrease the software defect occurrence probability.
Description
Technical field
The present invention relates to a kind of data conversion system and method.
Background technology
In the data processing software exploitation, the most difficult is to obtain client's raw data fast and accurately, and is translated into standard data required in the software development process.
Obtain client's raw data, exactly the tables of data in client's raw data file (normally two-dimensional data table) data are read by software program, deposit in specific format file or the system.
The software developer only provided some to carry out the most basic the bottom data conversion method and the interface of data access towards single storage format in the past, during practical application, when reading the raw data of large quantities of different-formats, to write the application code of a large amount of bottom data conversions again, the data file is carried out data read one by one, so not only increase the overall size and the workload of writing software, be easy to generate software defect simultaneously.
Summary of the invention
In view of foregoing, be necessary to provide a kind of data conversion system, with the batch access of realization data in different formats and the conversion of storage format.
This data conversion system comprises that a data modular converter bag sets up the unit, a parameter setting unit, a call unit and a performance element, wherein: this data conversion module bag is set up the unit with various formatted file localization methods, method for reading data, data segmentation method, date storage method are encapsulated as a data modular converter bag; The parameter setting unit is set and is carried out the required parameter of document format data conversion, and this parameter comprises the raw data file address, the scope of choosing of valid data in this data file, the access address of the data file that the conversion regime of data file and conversion back are generated; Call unit calls the above-mentioned data conversion module bag of setting up, and the above-mentioned parameter that sets is sent to this data conversion module bag; The parameter that the performance element utilization is transmitted is carried out the whole bag of tricks in this data conversion module bag, finishes the screening of the reading of raw data, valid data and the data after the unloading conversion automatically.
The present invention also provides a kind of data transfer device, with the batch access of realization data in different formats and the conversion of storage format.
This data transfer device comprises step: with the localization method of various formatted files, method for reading data, data segmentation method, date storage method are encapsulated as a data modular converter bag; Document format data conversion desired parameters is carried out in setting, and this parameter comprises the raw data file address, the scope of choosing of valid data in this data file, the access address of the data file that the conversion regime of data file and conversion back are generated; Call the above-mentioned data conversion module bag of setting up, the parameter that sets is passed in this data conversion module bag; Utilize the above-mentioned parameter that transmits to carry out the whole bag of tricks in this data conversion module bag, finish the reading of raw data, the screening of valid data and the data after the unloading conversion.
The present invention can handle the as a whole data processing module of details operation packing with the some kinds of loaded down with trivial details bottom datas of different data format, conveniently to carry out unified data access and format conversion, avoid writing of a large amount of bottom treatment of details codes, and can reduce the scale and the workload of software development and reduce the probability that software defect produces.
Description of drawings
Fig. 1 is the applied environment figure of a preferred embodiment of data conversion system of the present invention.
Fig. 2 is the functional block diagram of data conversion system of the present invention.
Fig. 3 is the process flow diagram of data transfer device preferred embodiment of the present invention
Embodiment
Consulting shown in Figure 1ly, is the applied environment figure of a preferred embodiment of data conversion system of the present invention.This applied environment is made up of a basic computer system.This computer system comprises central processing unit 11, storer 13, input equipment 14, output device 15.Wherein this central processing unit 11 is made up of arithmetical unit and controller, is the control center of computing machine, and processing poweies such as computing, judgement are provided.
In preferred embodiment of the present invention, this data conversion system 2 can be stored in the external memory of computing machine, when needs carry out data-switching, instruct by I/O by central processing unit 11, this data conversion system 2 and need data converted file are called in execution processing among the RAM, carry out the conversion of document format data.
In other embodiments of the invention, this data conversion system 2 can also be stored in the mobile disk, by internal network or internet this data conversion system 2 is transferred in the computing machine, it is called among the RAM by the I/O instruction by the central processing unit 11 of this computing machine and to carry out, carry out the conversion of document format data.
Consulting shown in Figure 2ly, is the functional block diagram of data conversion system of the present invention.This data conversion system 2 comprises that a data modular converter bag sets up 22, one call units 24 in 20, one parameter setting unit, unit and a performance element 26.
Wherein, this data conversion module bag is set up unit 20 file location method, method for reading data, data segmentation method, date storage method is encapsulated as a data modular converter bag.File location method is meant the different program technic of searching specific data position in certain formatted file that relates in the various formatted data file processing; Method for reading data is meant the program technic that reads the data of assigned address in certain formatted file; Data segmentation method is meant continuous data is carried out the program technic of data screening by setting modes such as decollator; Date storage method is meant the program technic that specific data is stored in the assigned address of specified format file.
Described file location method is as Excel file, the sheet at specific data place, row, column; The text formatting file specifies from certain special field, as＜#####〉continuous data of beginning.
Described method for reading data as: read Excel file designating unit data, read text designating unit data.
Described data segmentation method as: continuous data stream is segmented into a plurality of data segments according to special symbol, and this special symbol is as " | ".
Described date storage method as: data cell is stored in Excel file assigned address; Data cell is stored in the text assigned address, increases the corresponding sign symbol of cutting apart, this cuts apart the sign symbol as " | ".
Described parameter setting unit 22 is used for carrying out parameter setting before carrying out the document format data conversion.Its parameter that sets comprises: the raw data file address of required conversion if raw data file is stored in the file, then needs to set the complete store path of raw data file; Set the scope of choosing of valid data in this raw data file, partial data that appointment is chosen or total data, this chooses scope as for the Excel file, useful data are placed on the row of the 5th among the sheet1 to eighth row, for the literal archives, useful data are placed on sign symbol＜#####〉afterwards up to file tail not; Set the conversion regime of this data file, specific data is another kind of form from a kind of format conversion, for example, from Excel file data format conversion to the text data layout, parameter is made as 1, the text Data Format Transform is to Excel file data form, parameter is made as 2, and Excel file data format conversion is to program array data layout, and parameter is made as 3, program array Data Format Transform is to Excel file data form, parameter is made as 4, and the text Data Format Transform is to program array data layout, and parameter is made as 5, program array Data Format Transform is to the text data layout, and parameter is made as 6; Set the access address of conversion back data,, but be stored in data file in internal memory, then need to set the complete store path of conversion back data file if conversion back data are not directly to be read by other programs.
Described call unit 24 is used to call the above-mentioned data conversion module bag of setting up, and the parameter that sets is passed to the whole bag of tricks in this data conversion module bag.
The parameter that described performance element 26 utilizations are transmitted is carried out the method in this data conversion module bag, read the Excel file data that needs conversion from the raw data file address that sets, utilize the file location method in the data conversion module bag, method for reading data, the scope of choosing of the data segmentation method valid data that basis sets in above-mentioned Excel file data, filter out valid data, again according to the type of this raw data file and the type corresponding parameters after will changing, utilize the date storage method in the data conversion module bag to convert these valid data to needed data layout, that is to say that the valid data that will be filtered out are stored in the assigned address of specified format file, the temporary file that this is converted to leaves in the access address that sets afterwards, so that down-stream is used.Data after this conversion also can directly be read by other programs in internal memory.
Consulting shown in Figure 3ly, is the process flow diagram of data transfer device preferred embodiment of the present invention.
Step S200, before carrying out the data file conversion, the different file location methods, method for reading data, data segmentation method and the date storage method that relate at first various general format data files will being handled are encapsulated as a data modular converter bag.
Step S202 sets this required address of carrying out the raw data file of document format data conversion.If this original data storage in file, needs to set the complete store path of raw data file.This raw data file can be the data file that is stored in the hard disk of computing machine 2, also can be the data file that is stored among External memory equipment such as USB, CD, floppy disk, the MP3.In this preferred embodiment, if the Excel file data need be converted to the text data.
Step S204 sets the scope of choosing of valid data in this raw data file.Raw data file generally is made up of the data of useful data and explanation, mark.In this step, according to the form of raw data file, the scope of useful data scope in the division raw data file and explanation, mark data.As to specify the 5th among sheet1 row be the useful data scope to eighth row.
Step S206, the conversion regime of setting raw data file.In preferred embodiment of the present invention, to be made as 1 by the parameter that the Excel file data is converted to the text data, to be made as 2 by text data-switching to the parameter of Excel file data, to be made as 3 by the parameter that the Excel file data is converted to the program array data, to be made as 4 by program array data-switching to the parameter of Excel file data, to be made as 5 by text data-switching to the parameter of program array data, will be made as 6 by program array data-switching to the parameter of text data.Used conversion regime is for to be converted to the text data by the Excel file data in this preferred embodiment, and parameter is 1.
Step S208, the access address of the data after the setting conversion.The data file that this conversion back is generated is a temporary file.This temporary file can be stored in the internal memory and directly be read by other programs.If the data after the conversion are not directly to be read by other programs in internal memory, but are stored in data file, then need to set the complete store path of conversion back data file, it can be stored on the hard disk, can also be stored in other memory devices.
Step S210 calls the data conversion module bag of being set up, and above-mentioned each parameter that sets is passed in the data conversion module bag in the corresponding method.
Step S212, the parameter that performance element 26 utilizations are transmitted is carried out the method in this data conversion module bag, read the Excel file data that needs conversion from the raw data file address that sets, utilize the file location method in the data conversion module bag, method for reading data, the scope of choosing of the data segmentation method valid data that basis sets in above-mentioned Excel file data, filter out valid data, again according to the type of this raw data file and the type corresponding parameters after will changing, utilize the date storage method in the data conversion module bag to convert these valid data to needed data layout, that is to say that the valid data that will be filtered out are stored in the assigned address of specified format file, the temporary file that this is converted to leaves in the access address that sets afterwards, so that down-stream is used.Data after this conversion also can directly be read by other programs in internal memory.
Claims (10)
1. a data conversion system is characterized in that, this system comprises that a data modular converter bag sets up the unit, a parameter setting unit, and a call unit and a performance element, wherein:
This data conversion module bag is set up the unit with various formatted file localization methods, and method for reading data, data segmentation method, date storage method are encapsulated as a data modular converter bag;
The parameter setting unit is set and is carried out the required parameter of document format data conversion, and this parameter comprises the raw data file address, the scope of choosing of valid data in this data file, the access address of the data file that the conversion regime of data file and conversion back are generated;
Call unit calls the above-mentioned data conversion module bag of setting up, and the above-mentioned parameter that sets is sent to this data conversion module bag;
The parameter that the performance element utilization is transmitted is carried out the whole bag of tricks in this data conversion module bag, finishes the screening of the reading of raw data, valid data and the data after the unloading conversion automatically.
2. data conversion system as claimed in claim 1 is characterized in that, described file location method is the program technic of searching specific data position in certain formatted file.
3. data conversion system as claimed in claim 1 is characterized in that, described method for reading data is the program technic that reads the data of assigned address in certain formatted file.
4. data conversion system as claimed in claim 1 is characterized in that, described data segmentation method is that continuous data is carried out the program technic of data screening by setting the decollator mode.
5. data conversion system as claimed in claim 1 is characterized in that, described date storage method is the program technic that specific data is stored in the assigned address of specified format file.
6. data conversion system as claimed in claim 1 is characterized in that the data after this conversion are directly read by other programs in internal memory.
7. data conversion system as claimed in claim 1 is characterized in that, if the data after this conversion are stored in the data file, then needs to set the complete store path of this conversion back data file.
8. a data transfer device is characterized in that, this method comprises the steps:
Localization method, method for reading data, data segmentation method, the date storage method of various formatted files are encapsulated as a data modular converter bag;
Document format data conversion desired parameters is carried out in setting, and this parameter comprises the raw data file address, the scope of choosing of valid data in this data file, the access address of the data file that the conversion regime of data file and conversion back are generated;
Call the above-mentioned data conversion module bag of setting up, the parameter that sets is passed in this data conversion module bag;
Utilize the above-mentioned parameter that transmits to carry out the whole bag of tricks in this data conversion module bag, finish the reading of raw data, the screening of valid data and the data after the unloading conversion.
9. data transfer device as claimed in claim 8 is characterized in that, wherein the data after the conversion are directly read by other programs in internal memory.
10. data transfer device as claimed in claim 8 is characterized in that, if the data after wherein changing are stored in the data file, then needs to set the complete store path of this conversion back data file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006100633508A CN101169711A (en) | 2006-10-27 | 2006-10-27 | Data conversion system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006100633508A CN101169711A (en) | 2006-10-27 | 2006-10-27 | Data conversion system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101169711A true CN101169711A (en) | 2008-04-30 |
Family
ID=39390351
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2006100633508A Pending CN101169711A (en) | 2006-10-27 | 2006-10-27 | Data conversion system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101169711A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102662678A (en) * | 2012-04-17 | 2012-09-12 | 中标软件有限公司 | Data processing device and memory data processing method thereof |
| CN102135963B (en) * | 2010-01-21 | 2013-04-24 | 深圳市智骏数据科技有限公司 | Data transfer method and system |
| CN104868987A (en) * | 2014-08-23 | 2015-08-26 | 深圳键桥通讯技术股份有限公司 | Data synchronization method based on set-card separation-type gateway device |
| CN105893392A (en) * | 2015-01-26 | 2016-08-24 | 大连达硕信息技术有限公司 | Data batch-loading method for intelligent multi-variable data processing |
| CN106227710A (en) * | 2016-07-26 | 2016-12-14 | 浪潮通用软件有限公司 | Data file conversion configuration method based on EXCEL |
| CN106844601A (en) * | 2017-01-16 | 2017-06-13 | 上海小海龟科技有限公司 | A kind of date storage method and data storage device |
| CN107908610A (en) * | 2017-12-04 | 2018-04-13 | 北京中燕信息技术有限公司 | A kind of data processing method and device |
| CN109344184A (en) * | 2018-08-03 | 2019-02-15 | 上海小渔数据科技有限公司 | Automatic processing method and device for data conversion |
| CN110515894A (en) * | 2019-08-02 | 2019-11-29 | 济南浪潮数据技术有限公司 | A kind of conversion method of data format, device, equipment and readable storage medium storing program for executing |
| CN110555073A (en) * | 2019-09-10 | 2019-12-10 | 政采云有限公司 | data processing method and device, electronic equipment and storage medium |
-
2006
- 2006-10-27 CN CNA2006100633508A patent/CN101169711A/en active Pending
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102135963B (en) * | 2010-01-21 | 2013-04-24 | 深圳市智骏数据科技有限公司 | Data transfer method and system |
| CN102662678B (en) * | 2012-04-17 | 2015-11-25 | 中标软件有限公司 | Data processing equipment and internal storage data disposal route thereof |
| CN102662678A (en) * | 2012-04-17 | 2012-09-12 | 中标软件有限公司 | Data processing device and memory data processing method thereof |
| CN104868987B (en) * | 2014-08-23 | 2018-05-01 | 深圳键桥通讯技术股份有限公司 | Method of data synchronization based on separation between machine and card formula gateway apparatus |
| CN104868987A (en) * | 2014-08-23 | 2015-08-26 | 深圳键桥通讯技术股份有限公司 | Data synchronization method based on set-card separation-type gateway device |
| CN105893392A (en) * | 2015-01-26 | 2016-08-24 | 大连达硕信息技术有限公司 | Data batch-loading method for intelligent multi-variable data processing |
| CN106227710A (en) * | 2016-07-26 | 2016-12-14 | 浪潮通用软件有限公司 | Data file conversion configuration method based on EXCEL |
| CN106844601A (en) * | 2017-01-16 | 2017-06-13 | 上海小海龟科技有限公司 | A kind of date storage method and data storage device |
| CN106844601B (en) * | 2017-01-16 | 2021-03-16 | 上海小海龟科技有限公司 | Data storage method and data storage device |
| CN107908610A (en) * | 2017-12-04 | 2018-04-13 | 北京中燕信息技术有限公司 | A kind of data processing method and device |
| CN109344184A (en) * | 2018-08-03 | 2019-02-15 | 上海小渔数据科技有限公司 | Automatic processing method and device for data conversion |
| CN110515894A (en) * | 2019-08-02 | 2019-11-29 | 济南浪潮数据技术有限公司 | A kind of conversion method of data format, device, equipment and readable storage medium storing program for executing |
| CN110555073A (en) * | 2019-09-10 | 2019-12-10 | 政采云有限公司 | data processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101169711A (en) | Data conversion system and method | |
| CN100504873C (en) | Method and system for managing an archived file system | |
| CN102201009B (en) | Form generating method and device | |
| CN109240654A (en) | Development approach and system based on template | |
| CN110018822A (en) | A kind of method and system automatically generating micro services function | |
| US7152055B2 (en) | Method and system for reducing document file size by deleting unused and duplicate template data | |
| US20160335291A1 (en) | System and method for providing a modern-era retrospective analysis for research and applications (merra) data analytic service | |
| CN101604241A (en) | A kind of code generating method of embedded system | |
| CN110688145B (en) | Android MVP code automatic generation method and device, medium and electronic equipment | |
| CN107301214A (en) | Data migration method, device and terminal device in HIVE | |
| CN104572671A (en) | Multi-tag file processor | |
| CN103488502A (en) | Method and device for loading data | |
| CN107688456A (en) | Document generating method, equipment and computer-readable recording medium | |
| CN1260546A (en) | Method and apparatus for storing and searching data in hand-held device | |
| CN115470235A (en) | Data processing method, device and equipment | |
| CN107168700B (en) | Basic development framework of full-automatic form WEB background management system based on SQL-SELECT drive | |
| CN103501341A (en) | Method and device for establishing Web service | |
| US20080306976A1 (en) | Process for dynamic table conversion | |
| WO2023249753A1 (en) | File system metadata layout for append-only storage | |
| CN110795920A (en) | Document generation method and device | |
| CN100419760C (en) | File segmenting method and device for FAT file system | |
| CN112558858B (en) | Method for acquiring access characteristics of super-large-scale application external memory based on dynamic IO perception | |
| CN115659920A (en) | Method and device for converting Excel process into cxp process | |
| CN104156209A (en) | Cross-platform application interface modeling method and device | |
| CN111027196B (en) | Simulation analysis task processing method and device for power equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20080430 |