CN104504029A - Data transformation information processing method and device - Google Patents

Data transformation information processing method and device Download PDF

Info

Publication number
CN104504029A
CN104504029A CN201410770715.5A CN201410770715A CN104504029A CN 104504029 A CN104504029 A CN 104504029A CN 201410770715 A CN201410770715 A CN 201410770715A CN 104504029 A CN104504029 A CN 104504029A
Authority
CN
China
Prior art keywords
data
transformed
conversion
miss
successful
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410770715.5A
Other languages
Chinese (zh)
Other versions
CN104504029B (en
Inventor
赵立贺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Gridsum Technology Co Ltd
Original Assignee
Beijing Gridsum Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Gridsum Technology Co Ltd filed Critical Beijing Gridsum Technology Co Ltd
Priority to CN201410770715.5A priority Critical patent/CN104504029B/en
Publication of CN104504029A publication Critical patent/CN104504029A/en
Application granted granted Critical
Publication of CN104504029B publication Critical patent/CN104504029B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data transformation processing method and a data transformation processing device. The data transformation processing method comprises the following steps: acquiring data to be transformed; executing transformation processing on the data to be transformed to obtain a transformation result; according to the transformation result, acquiring successfully-transformed data in the data to be transformed and unsuccessfully-transformed data in the data to be transformed, wherein the successfully-transformed data is data, which is successfully transformed into target data, in the data to be transformed, and the unsuccessfully-transformed data is data, which is unsuccessfully transformed into the target data, in the data to be transformed; storing the successfully-transformed data in the data to be transformed into a first target storage position and storing the unsuccessfully-transformed data in the data to be transformed into a second target storage position. By the data transformation processing method and the data transformation processing device, the problem of low efficiency of looking up information succeeded in and failed in data transformation is solved and furthermore, an effect of improving efficiency of inquiring the information succeeded in and failed in data transformation is achieved.

Description

Data transformations information processing method and device
Technical field
The present invention relates to data processing field, in particular to a kind of data transformations information processing method and device.
Background technology
Microsoft SQL Server Integration Services (Microsoft SQL Server Integration Services, referred to as SSIS) is the platform generating high-performance data integrated solution, such as, and the extraction of data warehouse, conversion and loading etc.SSIS carries journal function, the journal function carried comprises recording exceptional, warning, event action, cancellation, the important information such as unsuccessfully, but the detailed data information of data transformations success and data transformations failure cannot be recorded, data transformations refers to from source data and is converted into the processing procedure that target data comprises, and this processing procedure comprises conversion in type, Data Integration and refinement etc.
The method of the abnormal root of present analysis data transformations is the target database after the source database and data transformations transformed by the SQL statement correlation data of SSIS log recording, the method compared by manual analysis obtain transforming successfully with the data of data transformations failure, thus analyze and cause transforming abnormal root.As can be seen from foregoing description, in current solution, do not support the detailed data information automatically recording data transformations success and data transformations failure.This means user can only by manual analysis SQL statement obtain transforming successfully with the data of data transformations failure, it is low and easily make a fault to there is efficiency in this manual analysis method, and this is unfavorable for that user searches the root of data transformations exception.
For the problem that the information efficiency searching data transformations success and data transformations failure in correlation technique is low, at present effective solution is not yet proposed.
Summary of the invention
Fundamental purpose of the present invention is to provide a kind of data transformations information processing method and device, searches the low problem of data transformations information efficiency that is successful and data transformations failure to solve in correlation technique.
To achieve these goals, according to an aspect of the present invention, a kind of data transformations information processing method is provided.
Data transformations information processing method according to the present invention comprises: obtain data to be transformed; Treat conversion data and perform conversion processing, obtain conversion results; Conversion successful data in data to be transformed and data relay miss data to be transformed is obtained according to conversion results, wherein, transform successful data and refer to that in data to be transformed, successful conversion is the data of target data, transform miss data and refer to the unsuccessful data being converted into target data in data to be transformed; And the conversion successful data in data to be transformed is stored to first object memory location, and the conversion miss data in data to be transformed is stored to the second target storage position.
Further, obtain data to be transformed to comprise: from presetting database, obtain source data; Source data is stored to the 3rd target storage position; And obtain data to be transformed from the 3rd target storage position.
Further, treat conversion data execution conversion processing to comprise: determine default conversion types; Be target data according to default conversion types by data transformations to be transformed, wherein, the type of target data is for presetting conversion types; Set up the corresponding relation of target data and data to be transformed; And export the corresponding relation of target data and data to be transformed.
Further, the conversion successful data in data to be transformed is stored to first object memory location, and the conversion miss data in data to be transformed is stored to the second target storage position comprises: obtain preset data file layout; And be stored to first object memory location according to the conversion successful data in preset data file layout data just to be transformed, and according to preset data file layout, the conversion miss data in data to be transformed is stored to the second target storage position.
Further, after the conversion successful data obtained according to conversion results in data to be transformed and data relay miss data to be transformed, the method also comprises: transform failed type according to transforming successful data and transforming miss data parsing conversion miss data; And export the failed type of conversion miss data conversion.
To achieve these goals, according to a further aspect in the invention, a kind of data transformations signal conditioning package is provided.
Data transformations signal conditioning package according to the present invention comprises: the first acquiring unit, for obtaining data to be transformed; Conversion unit, performing conversion processing for treating conversion data, obtaining conversion results; Second acquisition unit, for obtaining conversion successful data in data to be transformed and data relay miss data to be transformed according to conversion results, wherein, transform successful data and refer to that in data to be transformed, successful conversion is the data of target data, transform miss data and refer to the unsuccessful data being converted into target data in data to be transformed; And storage unit, for the conversion successful data in data to be transformed is stored to first object memory location, and the conversion miss data in data to be transformed is stored to the second target storage position.
Further, the first acquiring unit comprises: the first acquisition module, for obtaining source data from presetting database; First memory module, for being stored to the 3rd target storage position by source data; And second acquisition module, for obtaining data to be transformed from the 3rd target storage position.
Further, conversion unit comprises: determination module, for determining default conversion types; Conversion module, for being target data according to presetting conversion types by data transformations to be transformed, wherein, the type of target data is for presetting conversion types; Set up module, for setting up the corresponding relation of target data and data to be transformed; And output module, for exporting the corresponding relation of target data and data to be transformed.
Further, storage unit comprises: the 3rd acquisition module, for obtaining preset data file layout; And second memory module, for being stored to first object memory location according to the conversion successful data in preset data file layout data just to be transformed, and according to preset data file layout, the conversion miss data in data to be transformed is stored to the second target storage position.
Further, this device also comprises: resolution unit, for transforming failed type according to transforming successful data and transforming miss data parsing conversion miss data; And output unit, transform the failed type of miss data conversion for exporting.
Pass through the present invention, adopt and automatically store conversion successful data in data to be transformed and data relay miss data to be transformed respectively, solve in correlation technique and search the low problem of data transformations information efficiency that is successful and data transformations failure, and then reach the effect improving the information efficiency searching data transformations success and data transformations failure.
Accompanying drawing explanation
The accompanying drawing forming a application's part is used to provide a further understanding of the present invention, and schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is the process flow diagram of the data transformations information processing method according to the embodiment of the present invention; And
Fig. 2 is the schematic diagram of the data transformations signal conditioning package according to the embodiment of the present invention.
Embodiment
It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.Below with reference to the accompanying drawings and describe the present invention in detail in conjunction with the embodiments.
The application's scheme is understood better in order to make those skilled in the art person, below in conjunction with the accompanying drawing in the embodiment of the present application, technical scheme in the embodiment of the present application is clearly and completely described, obviously, described embodiment is only the embodiment of the application's part, instead of whole embodiments.Based on the embodiment in the application, those of ordinary skill in the art are not making the every other embodiment obtained under creative work prerequisite, all should belong to the scope of the application's protection.
It should be noted that, term " first ", " second " etc. in the instructions of the application and claims and above-mentioned accompanying drawing are for distinguishing similar object, and need not be used for describing specific order or precedence.Should be appreciated that the data used like this can be exchanged, in the appropriate case so that the embodiment of the application described herein.In addition, term " comprises " and " having " and their any distortion, intention is to cover not exclusive comprising, such as, contain those steps or unit that the process of series of steps or unit, method, system, product or equipment is not necessarily limited to clearly list, but can comprise clearly do not list or for intrinsic other step of these processes, method, product or equipment or unit.
According to the embodiment of the present invention, provide a kind of data transformations information processing method.Fig. 1 is the process flow diagram of the data transformations information processing method according to the embodiment of the present invention.
As shown in Figure 1, this data transformations information processing method comprises following step S102 to step S108:
Step S102: obtain data to be transformed.
Data transformations refers to and raw data is converted into target data according to preset rules, and such as, data type conversion, Data Integration, data mining etc., the embodiment of the present invention is described to carry out data transformations based on SSIS platform.Data to be transformed refer to the data needing to perform conversion processing, and can be the data obtained from database, also can be the data obtained from other electrical forms, such as, and the data obtained from Excel form.Preferably, obtain data to be transformed to comprise: from presetting database, obtain source data; Source data is stored to the 3rd target storage position; And obtain data to be transformed from the 3rd target storage position.
Presetting database is data source data storehouse, particularly, can filter out the data needing to transform, i.e. source data by SQL statement from presetting database.In data transformations process, whether loss of data is there is in order to detect, the source data acquired can be carried out a dump, such as, be stored in the 3rd target storage position, thus, after completing data transformations, data after conversion and this source data can be compared to judge whether data transformations process exists loss of data, such as, before data transformations, source data amount is 100, transforming successful data volume after data transformations is 85, and transforming miss data amount is 10, then can obtain transforming obliterated data amount is 5.In dump procedure, occur that loss of data causes the above results inaccurate, the embodiment of the present invention obtains data to be transformed from the 3rd target storage position.
Step S104: treat conversion data and perform conversion processing, obtain conversion results.
SSIS platform can realize data transformations easily, and the embodiment of the present invention is described to adopt SSIS platform to carry out data transformations.Particularly, treat conversion data execution conversion processing to comprise: determine default conversion types; Be target data according to default conversion types by data transformations to be transformed, wherein, the type of target data is for presetting conversion types; Set up the corresponding relation of target data and data to be transformed; And export the corresponding relation of target data and data to be transformed.
Data transformations comprises polytype, and such as, conversion in type, Data Integration etc., default conversion types can be any one data transformations type.When adopting SSIS platform to carry out data transformations, user can pre-set data transformations type, when data transformations task start, SSIS platform can perform corresponding data conversion operation according to presetting conversion types automatically, obtain target data, analyze data transformations result further for the ease of user, set up the corresponding relation of target data and data to be transformed.Particularly, by corresponding with the target data that its conversion obtains for the data of successful conversion in data to be transformed and export, or be stored in further in target database.
Step S106: obtain conversion successful data in data to be transformed and data relay miss data to be transformed according to conversion results, wherein, transform successful data and refer to that in data to be transformed, successful conversion is the data of target data, transform miss data and refer to the unsuccessful data being converted into target data in data to be transformed.
After treating conversion data execution conversion processing, obtain the conversion successful data in data to be transformed and data relay miss data to be transformed, such as, different marks can be added for data relay successful data to be transformed and data relay miss data to be transformed in data transformations process, according to identifying the conversion successful data and data relay miss data to be transformed distinguished in data to be transformed, also in conversion process, the conversion successful data in data to be transformed can be taken out the memory headroom being stored in other positions from data to be transformed, thus conversion successful data in data to be transformed and data relay miss data to be transformed can be distinguished according to the position of content space.
Step S108: the conversion successful data in data to be transformed is stored to first object memory location, and the conversion miss data in data to be transformed is stored to the second target storage position.
First object memory location and the second target storage position can be any two not identical memory locations.The embodiment of the present invention is by obtaining the conversion successful data in data conversion process in data to be transformed and the conversion miss data in data to be transformed, and the conversion successful data in data to be transformed and the conversion miss data in data to be transformed are stored in different memory location respectively, realize automatically recording in data transformations process and change into merit data and transform miss data, thus can obtain easily and fast and check conversion successful data and transform miss data, solve and search the low problem of data transformations information efficiency that is successful and data transformations failure.In addition, according to transforming successful data and transforming the defect that miss data can analyze current data conversion quickly and accurately, increase work efficiency, reduce error rate.
Preferably, the conversion successful data in data to be transformed is stored to first object memory location, and the conversion miss data in data to be transformed is stored to the second target storage position comprises: obtain preset data file layout; And be stored to first object memory location according to the conversion successful data in preset data file layout data just to be transformed, and according to preset data file layout, the conversion miss data in data to be transformed is stored to the second target storage position.
Preset data file layout refers to the file layout that data store, and such as, can be TXT file layout, can be Excel form, also can be alternative document form.After the file layout that setting data stores, by the conversion successful data in data to be transformed and the conversion miss data in data to be transformed according to the stored in file format pre-set, such as, be stored as Excel form.The file layout that the embodiment of the present invention can select data to store flexibly, is convenient to the follow-up use treating the conversion successful data in conversion data and the conversion miss data in data to be transformed of user.
Preferably, after the conversion successful data obtained according to conversion results in data to be transformed and data relay miss data to be transformed, method also comprises: transform failed type according to transforming successful data and transforming miss data parsing conversion miss data; And export the failed type of conversion miss data conversion.
Data transformations unsuccessfully may cause due to reasons such as character length, character types, character sequences.Particularly, the type of multiple rule to data transformations failure can be pre-set detect.Such as, character length, character types, character sequence is detected successively.Be described for character length, first the character length all transforming successful data is detected, obtain maximum character length and minimum character length, traversal transforms miss data again, judge whether the character that each transforms miss data is between maximum character length and minimum character length respectively, particularly, a threshold value can be set, if transform character length in miss data and be not in by calculating the ratio that data volume between maximum character length and minimum character length and character length are in the data volume between maximum character length and minimum character length, if this ratio is greater than preset value, determine that the type of this data transformations failure is that character length is inconsistent, otherwise continue other and transform failed type detection, such as, detect character types, if detect the character string being letter formation all transforming successful data, and detect that transforming miss data is not all the character string be made up of letter, now determine that the type of data transformations failure is that character types are inconsistent.After detecting the failed type of default multiple conversions respectively, output detections result, such as, detect be character length do not mate cause data transformations failure time, can output character length not mate, user can transform failed root according to this testing result rapidly locating further, improves the efficiency of searching data transformations failure cause.
As can be seen from the above description, present invention achieves following technique effect:
The embodiment of the present invention is by obtaining data to be transformed, treat conversion data and perform conversion processing, obtain conversion results, conversion successful data in data to be transformed and data relay miss data to be transformed is obtained according to conversion results, and the conversion successful data in data to be transformed is stored to first object memory location, and the conversion miss data in data to be transformed is stored to the second target storage position.Conversion successful data in data to be transformed and the conversion miss data in data to be transformed are stored in different memory location by the embodiment of the present invention respectively, realize automatically recording in data transformations process and change into merit data and transform miss data, thus can obtain easily and fast and check conversion successful data and transform miss data, solve and search the low problem of data transformations information efficiency that is successful and data transformations failure.In addition, the embodiment of the present invention further according to the reason of the conversion successful data in data to be transformed and the conversion miss data automatic analysis data transformations failure in data to be transformed, can improve the efficiency of searching data transformations failure cause.
It should be noted that, can perform in the computer system of such as one group of computer executable instructions in the step shown in the process flow diagram of accompanying drawing, and, although show logical order in flow charts, but in some cases, can be different from the step shown or described by order execution herein.
According to the another aspect of the embodiment of the present invention, provide a kind of data transformations signal conditioning package, this data transformations signal conditioning package may be used for the data transformations information processing method performing the embodiment of the present invention, and the method for the embodiment of the present invention also can be performed by the data transformations signal conditioning package of the embodiment of the present invention.
Fig. 2 is the schematic diagram of the data transformations signal conditioning package according to the embodiment of the present invention, and as shown in Figure 2, this data transformations signal conditioning package comprises: the first acquiring unit 10, conversion unit 20, second acquisition unit 30 and storage unit 40.
First acquiring unit 10, for obtaining data to be transformed.
Data transformations refers to and raw data is converted into target data according to preset rules, such as, and data type conversion, Data Integration, data mining etc.Data to be transformed refer to the data needing to perform conversion processing, and can be the data obtained from database, also can be the data obtained from other electrical forms, such as, and the data obtained from Excel form.
Preferably, the first acquiring unit 10 comprises: the first acquisition module, for obtaining source data from presetting database; First memory module, for being stored to the 3rd target storage position by source data; And second acquisition module, for obtaining data to be transformed from the 3rd target storage position.
Conversion unit 20, performing conversion processing for treating conversion data, obtaining conversion results.
Alternatively, conversion unit 20 comprises: determination module, for determining default conversion types; Conversion module, for being target data according to presetting conversion types by data transformations to be transformed, wherein, the type of target data is for presetting conversion types; Set up module, for setting up the corresponding relation of target data and data to be transformed; And output module, for exporting the corresponding relation of target data and data to be transformed.
Second acquisition unit 30, for obtaining conversion successful data in data to be transformed and data relay miss data to be transformed according to conversion results, wherein, transform successful data and refer to that in data to be transformed, successful conversion is the data of target data, transform miss data and refer to the unsuccessful data being converted into target data in data to be transformed.
After treating conversion data execution conversion processing, obtain the conversion successful data in data to be transformed and data relay miss data to be transformed, such as, different marks can be added for data relay successful data to be transformed and data relay miss data to be transformed in data transformations process, according to identifying the conversion successful data and data relay miss data to be transformed distinguished in data to be transformed, also in conversion process, the conversion successful data in data to be transformed can be taken out the memory headroom being stored in other positions from data to be transformed, thus conversion successful data in data to be transformed and data relay miss data to be transformed can be distinguished according to the position of content space.
Storage unit 40, for the conversion successful data in data to be transformed is stored to first object memory location, and is stored to the second target storage position by the conversion miss data in data to be transformed.
First object memory location and the second target storage position are any two not identical memory locations.After point other places store conversion successful data in data to be transformed and data relay miss data to be transformed, user can in conjunction with the data transformations exception recorded in the conversion successful data in data to be transformed and data relay miss data to be transformed and data transformations daily record and failed information, such as, the log information of record when SSIS platform carries out data transformations, express-analysis goes out the reason of data transformations failure.
Preferably, storage unit 40 comprises: the 3rd acquisition module, for obtaining preset data file layout; And second memory module, for being stored to first object memory location according to the conversion successful data in preset data file layout data just to be transformed, and according to preset data file layout, the conversion miss data in data to be transformed is stored to the second target storage position.
Preferably, this device also comprises: resolution unit, for transforming failed type according to transforming successful data and transforming miss data parsing conversion miss data; And output unit, transform the failed type of miss data conversion for exporting.
Data transformations unsuccessfully may cause due to reasons such as character length, character types, character sequences.Particularly, the type of multiple rule to data transformations failure can be pre-set detect.Such as, character length, character types, character sequence is detected successively.
The embodiment of the present invention obtains data to be transformed by the first acquiring unit 10, converting unit 20 is treated conversion data and is performed conversion processing, obtain conversion results, second acquisition unit 30 obtains conversion successful data in data to be transformed and data relay miss data to be transformed according to conversion results, and the conversion successful data in data to be transformed is stored to first object memory location by storage unit 40, and the conversion miss data in data to be transformed is stored to the second target storage position.By the conversion successful data in data to be transformed and the conversion miss data in data to be transformed are stored in different memory location respectively, realize automatically recording in data transformations process and change into merit data and transform miss data, thus can obtain easily and fast and check conversion successful data and transform miss data, solve and search the low problem of data transformations information efficiency that is successful and data transformations failure.
Obviously, those skilled in the art should be understood that, above-mentioned of the present invention each module or each step can realize with general calculation element, they can concentrate on single calculation element, or be distributed on network that multiple calculation element forms, alternatively, they can realize with the executable program code of calculation element, thus, they can be stored and be performed by calculation element in the storage device, or they are made into each integrated circuit modules respectively, or the multiple module in them or step are made into single integrated circuit module to realize.Like this, the present invention is not restricted to any specific hardware and software combination.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1. a data transformations information processing method, is characterized in that, comprising:
Obtain data to be transformed;
Conversion processing is performed to described data to be transformed, obtains conversion results;
According to the conversion successful data in the described data to be transformed of described conversion results acquisition and described data relay miss data to be transformed, wherein, described conversion successful data refers to that in described data to be transformed, successful conversion is the data of target data, and described conversion miss data refers to the unsuccessful data being converted into target data in described data to be transformed; And
Conversion successful data in described data to be transformed is stored to first object memory location, and the conversion miss data in described data to be transformed is stored to the second target storage position.
2. data transformations information processing method according to claim 1, is characterized in that, obtains described data to be transformed and comprises:
Source data is obtained from presetting database;
Described source data is stored to the 3rd target storage position; And
Described data to be transformed are obtained from described 3rd target storage position.
3. data transformations information processing method according to claim 1, is characterized in that, performs conversion processing comprise described data to be transformed:
Determine default conversion types;
Be target data according to described default conversion types by described data transformations to be transformed, wherein, the type of described target data is described default conversion types;
Set up the corresponding relation of described target data and described data to be transformed; And
Export the corresponding relation of described target data and described data to be transformed.
4. data transformations information processing method according to claim 1, it is characterized in that, conversion successful data in described data to be transformed is stored to first object memory location, and the conversion miss data in described data to be transformed is stored to the second target storage position comprises:
Obtain preset data file layout; And
Be stored to described first object memory location according to the conversion successful data in the just described data to be transformed of described preset data file layout, and according to described preset data file layout, the conversion miss data in described data to be transformed be stored to described second target storage position.
5. data transformations information processing method according to claim 1, is characterized in that, after the conversion successful data obtained according to described conversion results in described data to be transformed and described data relay miss data to be transformed, described method also comprises:
Resolve described conversion miss data according to described conversion successful data and described conversion miss data and transform failed type; And
Export described conversion miss data and transform failed type.
6. a data transformations signal conditioning package, is characterized in that, comprising:
First acquiring unit, for obtaining data to be transformed;
Conversion unit, for performing conversion processing to described data to be transformed, obtains conversion results;
Second acquisition unit, for obtaining conversion successful data in described data to be transformed and described data relay miss data to be transformed according to described conversion results, wherein, described conversion successful data refers to that in described data to be transformed, successful conversion is the data of target data, and described conversion miss data refers to the unsuccessful data being converted into target data in described data to be transformed; And
Storage unit, for the conversion successful data in described data to be transformed is stored to first object memory location, and is stored to the second target storage position by the conversion miss data in described data to be transformed.
7. data transformations signal conditioning package according to claim 6, is characterized in that, described first acquiring unit comprises:
First acquisition module, for obtaining source data from presetting database;
First memory module, for being stored to the 3rd target storage position by described source data; And
Second acquisition module, for obtaining described data to be transformed from described 3rd target storage position.
8. data transformations signal conditioning package according to claim 6, is characterized in that, described conversion unit comprises:
Determination module, for determining default conversion types;
Conversion module, for being target data according to described default conversion types by described data transformations to be transformed, wherein, the type of described target data is described default conversion types;
Set up module, for setting up the corresponding relation of described target data and described data to be transformed; And
Output module, for exporting the corresponding relation of described target data and described data to be transformed.
9. data transformations signal conditioning package according to claim 6, is characterized in that, described storage unit comprises:
3rd acquisition module, for obtaining preset data file layout; And
Second memory module, for being stored to described first object memory location according to the conversion successful data in the just described data to be transformed of described preset data file layout, and according to described preset data file layout, the conversion miss data in described data to be transformed is stored to described second target storage position.
10. data transformations signal conditioning package according to claim 6, is characterized in that, described device also comprises:
Resolution unit, transforms failed type for resolving described conversion miss data according to described conversion successful data and described conversion miss data; And
Output unit, transforms failed type for exporting described conversion miss data.
CN201410770715.5A 2014-12-11 2014-12-11 Data convert information processing method and device Active CN104504029B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410770715.5A CN104504029B (en) 2014-12-11 2014-12-11 Data convert information processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410770715.5A CN104504029B (en) 2014-12-11 2014-12-11 Data convert information processing method and device

Publications (2)

Publication Number Publication Date
CN104504029A true CN104504029A (en) 2015-04-08
CN104504029B CN104504029B (en) 2018-06-26

Family

ID=52945427

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410770715.5A Active CN104504029B (en) 2014-12-11 2014-12-11 Data convert information processing method and device

Country Status (1)

Country Link
CN (1) CN104504029B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105975524A (en) * 2016-04-28 2016-09-28 成都理工大学 Data integration method and system used for geology monitoring
CN108241679A (en) * 2016-12-26 2018-07-03 北京国双科技有限公司 Data processing method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102298601A (en) * 2011-05-23 2011-12-28 北京捷成世纪科技股份有限公司 Conversion method of monitoring data of storage device oriented to radio and TV industry and converter
CN103605715A (en) * 2013-11-14 2014-02-26 北京国双科技有限公司 Method and device used for data integration processing of multiple data sources
US20140101091A1 (en) * 2012-10-04 2014-04-10 Adobe Systems Incorporated Rule-based extraction, transformation, and loading of data between disparate data sources
CN104063482A (en) * 2014-07-03 2014-09-24 浙江大学 Business data integration method oriented to real estate registration

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102298601A (en) * 2011-05-23 2011-12-28 北京捷成世纪科技股份有限公司 Conversion method of monitoring data of storage device oriented to radio and TV industry and converter
US20140101091A1 (en) * 2012-10-04 2014-04-10 Adobe Systems Incorporated Rule-based extraction, transformation, and loading of data between disparate data sources
CN103605715A (en) * 2013-11-14 2014-02-26 北京国双科技有限公司 Method and device used for data integration processing of multiple data sources
CN104063482A (en) * 2014-07-03 2014-09-24 浙江大学 Business data integration method oriented to real estate registration

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105975524A (en) * 2016-04-28 2016-09-28 成都理工大学 Data integration method and system used for geology monitoring
CN108241679A (en) * 2016-12-26 2018-07-03 北京国双科技有限公司 Data processing method and device
CN108241679B (en) * 2016-12-26 2020-07-03 北京国双科技有限公司 Data processing method and device

Also Published As

Publication number Publication date
CN104504029B (en) 2018-06-26

Similar Documents

Publication Publication Date Title
CN109388566B (en) Code coverage rate analysis method, device, equipment and storage medium
US10387236B2 (en) Processing data errors for a data processing system
CN109684847B (en) Automatic repairing method, device, equipment and storage medium for script loopholes
CN108985057B (en) Webshell detection method and related equipment
CN109934268B (en) Abnormal transaction detection method and system
CN109358898B (en) Information processing method and device, electronic equipment and storage medium
CN103365780A (en) Method and device for calculating coverage rate of abnormal test
CN112256635B (en) Method and device for identifying file type
CN106557419B (en) Program testing method and device
CN104504029A (en) Data transformation information processing method and device
CN110019762B (en) Problem positioning method, storage medium and server
CN110716843A (en) System fault analysis processing method and device, storage medium and electronic equipment
CN112637888B (en) Coverage hole area identification method, device, equipment and readable storage medium
CN105354224A (en) Knowledge data processing method and apparatus
CN108024090B (en) Abnormity positioning method and device for video monitoring platform
CN111309584A (en) Data processing method and device, electronic equipment and storage medium
CN110968779A (en) Processing method and device for crawling webpage information
CN113037521B (en) Method for identifying state of communication equipment, communication system and storage medium
US11386340B2 (en) Method and apparatus for performing block retrieval on block to be processed of urine sediment image
CN104794397A (en) Virus detection method and device
CN111722998B (en) Code quality control method, system, equipment and storage medium
CN107861842B (en) Metadata damage detection method, system, equipment and storage medium
CN113553587B (en) File detection method, device, equipment and readable storage medium
CN116431677B (en) Data routing method, system and readable storage medium based on memory database
CN113326511B (en) File repair method, system, equipment and medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Data transformation information processing method and device

Effective date of registration: 20190531

Granted publication date: 20180626

Pledgee: Shenzhen Black Horse World Investment Consulting Co., Ltd.

Pledgor: Beijing Guoshuang Technology Co.,Ltd.

Registration number: 2019990000503

PE01 Entry into force of the registration of the contract for pledge of patent right
CP02 Change in the address of a patent holder

Address after: 100083 No. 401, 4th Floor, Haitai Building, 229 North Fourth Ring Road, Haidian District, Beijing

Patentee after: Beijing Guoshuang Technology Co.,Ltd.

Address before: 100086 Beijing city Haidian District Shuangyushu Area No. 76 Zhichun Road cuigongfandian 8 layer A

Patentee before: Beijing Guoshuang Technology Co.,Ltd.

CP02 Change in the address of a patent holder