CN106991100A - Data lead-in method and device - Google Patents

Data lead-in method and device Download PDF

Info

Publication number
CN106991100A
CN106991100A CN201610041954.6A CN201610041954A CN106991100A CN 106991100 A CN106991100 A CN 106991100A CN 201610041954 A CN201610041954 A CN 201610041954A CN 106991100 A CN106991100 A CN 106991100A
Authority
CN
China
Prior art keywords
data
kettle
files
data source
importing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610041954.6A
Other languages
Chinese (zh)
Other versions
CN106991100B (en
Inventor
李飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN201610041954.6A priority Critical patent/CN106991100B/en
Publication of CN106991100A publication Critical patent/CN106991100A/en
Application granted granted Critical
Publication of CN106991100B publication Critical patent/CN106991100B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/258Data format conversion from or to a database

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The disclosure is directed to a kind of data lead-in method and device, method includes:Specify the KETTLE files for being used to import template as data being pre-created;Configuration information is set according to the information that reconfigures the need for being preset in the KETTLE files;Dynamic analysis is carried out to the KETTLE files according to the configuration information, to carry out data importing automatically.Change can be placed on ETL instruments using upper by the technical scheme of the disclosure, low with the business degree of coupling, it is easy to extend, and be not required to frequent updating code, can realize individual demand, support heat deployment.

Description

Data lead-in method and device
Technical field
This disclosure relates to Computer Applied Technology field, more particularly to a kind of data lead-in method and device.
Background technology
Data import feature is one of most common function among WEB application, and essentially all WEB should Can all there is such demand with central.
Correlation technique generally realizes correlation function by program code.To import EXCEL by WEB server Exemplified by file, the POI kits (the Apache POI, Apache that increase income that correlation technique is provided by JAVA POI is the open source code function storehouse of Apache Software Foundation, and POI provides API to java applet pair The function that Microsoft Office forms archives are read and write), the use provided by using POI kits Realized in realizing the API of EXCEL file import feature and import EXCEL file in WEB server.
But among actual development, when demand is constantly changed, aforesaid way needs frequently modification code Meet demand, for more have personalization demand, it is necessary to realized in an export function multiple functions by Button, or even can more have the interaction between system, its check logic is extremely complex, implements also more multiple It is miscellaneous, bottleneck is also likely to be present in performance.It can be seen that, the API of above-mentioned this direct utilization data import feature Need frequent updating code when demand is changed to import the mode of data, individual demand realize difficulty compared with Height is higher with the business degree of coupling.
The content of the invention
To overcome problem present in correlation technique, the disclosure provides a kind of data lead-in method and device.
According to the first aspect of the embodiment of the present disclosure there is provided a kind of data lead-in method, including:
Specify the KETTLE files for being used to import template as data being pre-created;
Configuration information is set according to the information that reconfigures the need for being preset in the KETTLE files;
Dynamic analysis is carried out to the KETTLE files according to the configuration information, led with carrying out data automatically Enter.
Further, the KETTLE files are the advance instrument using for generating KETTLE files, Data place according to the data source of the first preset kind is imported into the second preset kind according to setting logic is given birth to Into KETTLE files.
Further, the data source of first preset kind is EXCEL file.
Further:
The information reconfigured is needed to include data source in the KETTLE files;
It is described it is default the need for the information that reconfigures include the data source being related in the KETTLE files.
Further, the KETTLE files include:Data source importation, JavaScript code Partly, table importation, continuous query part, increase constant part, sequence duplicate removal part, field selection Partly, table output par, c, and/or do-nothing operation part;
The data source importation, includes the demand file of upload;
The JavaScript code part, including JavaScript scripts, the JavaScript Script is used to the cell in upper transmitting file carrying out data check and Data Format Transform;
The table importation, the data for obtaining a data source, including query statement;
The continuous query part, the row field for table to be inputted inside the data obtained and data source is carried out Compare;
The increase constant part, for the field assignment given tacit consent to database;
The sequence duplicate removal part, for carrying out repeating record verification to nominated bank's record in data source;
The field selected section, for selecting to insert the row of database;
The table output par, c, for selecting business table, specifies the row to be inserted to carry out data insertion;
The do-nothing operation part, for inserting abnormality processing.
Further, the automatic operation for carrying out data importing includes:Line number is entered by WEB server automatically According to importing.
According to the second aspect of the embodiment of the present disclosure there is provided a kind of data importing device, including:
KETTLE file designating unit, what is be pre-created for specifying is used for as data importing template KETTLE files;
Configuration information setting unit, for being reconfigured according to the need for presetting in the KETTLE files Information sets configuration information;
Service unit, for carrying out dynamic analysis to the KETTLE files according to the configuration information, with It is automatic to carry out data importing.
Further, the KETTLE files are the advance instrument using for generating KETTLE files, Data place according to the data source of the first preset kind is imported into the second preset kind according to setting logic is given birth to Into KETTLE files.
Further, the data source of first preset kind is EXCEL file.
Further:
The information reconfigured is needed to include data source in the KETTLE files;
It is described it is default the need for the information that reconfigures include the data source being related in the KETTLE files.
Further, the KETTLE files include:Data source importation, JavaScript code Partly, table importation, continuous query part, increase constant part, sequence duplicate removal part, field selection Partly, table output par, c, and/or do-nothing operation part;
The data source importation, includes the demand file of upload;
The JavaScript code part, including JavaScript scripts, the JavaScript Script is used to the cell in upper transmitting file carrying out data check and Data Format Transform;
The table importation, the data for obtaining a data source, including query statement;
The continuous query part, the row field for table to be inputted inside the data obtained and data source is carried out Compare;
The increase constant part, for the field assignment given tacit consent to database;
The sequence duplicate removal part, for carrying out repeating record verification to nominated bank's record in data source;
The field selected section, for selecting to insert the row of database;
The table output par, c, for selecting business table, specifies the row to be inserted to carry out data insertion;
The do-nothing operation part, for inserting abnormality processing.
Further, the service unit is used for, and data importing is carried out automatically by WEB server.
The technical scheme provided by this disclosed embodiment can include the following benefits:
The demand of change is embodied by KTL files, change ETL instruments are placed on using upper, with business The degree of coupling is low, it is easy to extend, and is not required to frequent updating code, can realize individual demand, supports heat deployment.
It should be appreciated that the general description of the above and detailed description hereinafter are only exemplary and explanatory , the disclosure can not be limited.
Brief description of the drawings
Accompanying drawing herein is merged in specification and constitutes the part of this specification, shows and meets this hair Bright embodiment, and for explaining principle of the invention together with specification.
Fig. 1 is a kind of flow chart of data lead-in method according to an exemplary embodiment;
Fig. 2 is a kind of data import system Organization Chart according to an exemplary embodiment;
Fig. 3 is generating EXCEL file according to importing logic according to an exemplary embodiment The logic realization flow chart of KETTLE files;
Fig. 4 is the method flow diagram of the parsing KETTLE files according to an exemplary embodiment;
Fig. 5 is a kind of block diagram of data importing device according to an exemplary embodiment.
Embodiment
Here exemplary embodiment will be illustrated in detail, its example is illustrated in the accompanying drawings.Following When description is related to accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous Key element.Embodiment described in following exemplary embodiment does not represent the institute consistent with the present invention There is embodiment.On the contrary, they are only and being described in detail in such as appended claims, of the invention one The example of the consistent apparatus and method of a little aspects.
Fig. 1 illustrates a kind of Organization Chart of data import system, as shown in figure 1, the present embodiment Described implementation method can relate to operation system 110, KETTLE services 120 and the number of targets imported According to storehouse 130.Wherein operation system 110 is responsible for KETTLE file edits, the executable KETTLE of generation File 111, and responsible data source configure 112, KETTLE services 120 and are responsible for dynamic data base configuration And parsing KETTLE files, to import data in database 130.
Fig. 2 is a kind of flow chart of data lead-in method according to an exemplary embodiment, this implementation Example is applicable to import the situation of data.As shown in Fig. 2 the data lead-in method bag described in the present embodiment Include:
In step S210, the KETTLE files for being used to import template as data being pre-created are specified.
KETTLE is that " Kettle E.T.T.L Environment " abbreviation, a set of foreign countries increase income ETL instruments, pure java writes, the efficient stable on data pick-up.It allows to manage different data sources Data, by providing the function that a patterned interface completes to realize you to want.The present embodiment will pass through The .ktr files of KETTLE instruments generation are referred to as KETTLE files.
The KETTLE files can be in advance using being used to generate the instruments of KETTLE files, according to by the What the data place that the data source of one preset kind imports the second preset kind according to setting logic was generated KETTLE files.
For example, the data in EXCEL file are imported in target database by WEB server, lead to Cross KETTLE instruments and realize that the node of import feature needs may include:EXCEL is inputted, stream is inputted, JavaScript code, value mapping, sequence duplicate removal, table output, do-nothing operation etc..
Fig. 3 is generating EXCEL file according to importing logic according to an exemplary embodiment The logic realization flow chart of KETTLE files, as shown in figure 3, realizing the KETTLE texts that the function is created Part includes:
A, EXCEL are inputted:The demand file mainly uploaded, for source data is EXCEL file, Can be .xls or .xlsx.
It should be noted that the step is steps necessary, is sentenced and imported exemplified by EXCEL file due to this, So inputted for EXCEL, but the source data including but not limited to EXCEL file that the present embodiment can be imported, It for example can also be TXT texts, SQLServer databases, ORACLE databases, MySQL numbers According to storehouse etc..
B, JavaScript code:The step is optional step.It can be write in JavaScript code JS scripts, data check sum can be carried out in actual application by each cell in upper transmitting file Changed according to form.Such as:Numeric type data verification, date format verification and character string are split, word Conversion between symbol string and other data types.Verification in a program by code can so be substantially reduced.
C, table input:The step is optional step, is mainly used in continuous query, when needing to carry out continuous query, It is a SELECT statement to obtain inside the data of a data source, node, is mainly used to the verification of data Matched with to importing data integrity.In practical business demand, a service fields need verification data With the presence or absence of coming whether verification data can import.It is to need associated services more to have some service fields The mark of field is inserted, then the node can just obtain very well service fields data or External system data source, it is more simple and clear than other schemes.
C, continuous query:It is that the row field for inputting table inside the data obtained and EXCEL is compared, it is main If completion and the accuracy of verification data.The node be based on table input and EXCEL data comparison, It is the comparison based on internal memory.
D, increase constant:The step is optional step, is the field assignment given tacit consent to for database.Constant Refer to when data are imported, the default value of some fields.For example:The state of record, time etc..
E, order recording repeat to record with removing:The step is optional step, but generally necessary. Record is repeated to nominated bank's record in EXCEL to verify.Sequence duplicate removal is to importing all records according to industry Duplicate removal or duplicate removal verification are done in business requirement, it is necessary to which writing code goes processing in conventional code, in this scenario, Business deduplication dictionary only need to be pointed out.
F, field selection:For selecting to insert the row of database, field mapping is carried out when being mainly introduced into.
G, table output:The step is steps necessary, for selecting business table, specifies the row to be inserted, inserts Enter data.The node can specify batch to insert or wall scroll insertion, can also designate whether same Handled in individual affairs.
H, do-nothing operation:The step is steps necessary, the abnormality processing for insertion.The node is to insertion Whether abnormal processing, mainly ignore exception, if ignoring exception, runs into and skips after insertion exception, Otherwise direct rollback.In KETTLE instruments, including two kinds of rollback types are selective, when token record occurs , can be by the selection of rollback type when abnormal, selection is rolled back to before whole data import, or rollback Before to exception record and continue executing with and skip the exception record.
This step is used for the one or more data source of provisional configuration in a KETTLE file, with Parsing KETTLE files in by the ephemeral data source with the data source specified in configuration information dynamically Assignment, reach only need to give the purpose that different configuration informations import data into different databases every time.
If for example, in flow chart described in Fig. 3, in KETTLE file creation process, table input is signified Fixed volatile data base is A databases, and the specified volatile data base of table output is B data storehouse, configuration In information, volatile data base A is specified to be configured to actual correspondence C data storehouse, volatile data base B is configured to Actual correspondence D databases, then in follow-up dynamic analysis KETTLE files, dynamically according to the configuration Information replaces A databases with C data storehouse, and B data storehouse is replaced with D databases.
It should be noted that the data source in the configuration information can be any type of KETTLE projects energy The data source of support, such as SQLServer databases, ORACLE databases, MySQL database.
In step S220, set according to the information that reconfigures the need for being preset in the KETTLE files Put configuration information.
The instrument that the present embodiment is used to generate KETTLE files refers to KETTLE instruments.This step is mainly led to Cross and the demand of change is placed among visual graphic file (KETTLE files), pass through KETTLE Instrument generates the data source configured in step S110 according to the logic for importing the data to be imported KETTLE files.The step of each node in the visual graphic file is processing importing business, patrols Collect and become apparent from, editor preserves file after completing, and file is uploaded into WEB server respective directories Under, import feature is triggered, is that the API provided using KETTLE parses the KETTLE files in fact (i.e. .ktr files) imports the data to be imported to WEB server.It should be noted that can basis The KETTLE graphical nodes that the KETTLE files are used are generated according to API encapsulation parsing classes to draw Hold up, it is described to be imported to WEB server importing to parse the KETTLE files using the parsing class engine Data.
In correlation technique, KETTLE files are primarily designed for helping to realize ETTL needs, are generally used Operated in extraction, conversion, cleaning of data etc., after above-mentioned functions generation KETTLE files, directly It is connected on inside KETTLE instruments to perform and can completes the operation such as extraction, conversion, cleaning of above-mentioned data, respectively Data source (including source database, the number of targets being related to inside configuration information, particularly KETTLE files Table input involved database during according to storehouse, and/or for continuous query), it is directly according to KETTLE The information that has configured inside file is performed.And the present embodiment is innovatively used for making using KETTLE files Template is imported for data, operation logic when mainly realizing that data are imported by KETTLE files, it is related to Each configuration information, the data source being particularly related to inside KETTLE files (including source database, mesh Mark database, and/or table input involved database during for continuous query) as creating KETTLE texts The temporary information of part, in real data importing process, the need for being preset in the KETTLE files The information reconfigured sets configuration information, to perform during the KETTLE files, dynamically matches somebody with somebody described in Confidence breath replaces the temporary information inside KETTLE files.
In step S230, dynamic analysis is carried out to the KETTLE files according to the configuration information, To carry out data importing automatically.
This step is used to read the data source that configuration database is configured, dynamic analysis KETTLE by dynamic File completes to import data to WEB server.
The API that this step can be provided using KETTLE parses the KETTLE files and led to WEB server Enter the data to be imported.The KETTLE that can be specifically used according to the generation KETTLE files schemes Shape node parses the KETTLE according to API encapsulation parsing class engines using the parsing class engine File imports the data to be imported to WEB server.
Fig. 4 is being used according to the generation KETTLE files according to an exemplary embodiment KETTLE graphical nodes parse institute according to API encapsulation parsing class engines using the parsing class engine The method flow diagram that KETTLE files import the data to be imported to WEB server is stated, as shown in figure 4, The method of the above-mentioned parsing KETTLE files may include:
In step S410, enforcement engine is called.
KETTL instruments provide some API, and the present embodiment is based on that these API are packaged to be formed to make by oneself The enforcement engine of the parsing class of justice, according to configuration information dynamic analysis KETTLE files.The present embodiment is parsed During KETTLE files, the enforcement engine is called first.
In the step s 420, KettleHander is called.
The API that this step is provided including the use of KETTL instruments:KettleEnvironment.init()、 EnvUtil.environmentInit () etc..
In step S430, resource information is initialized, converting objects is created.
The data source information configured is initialized, converting objects Transformation is created.
In step S440, the data source configured in parsing KETTLE files.
The real data source specified inside configuration information for converting objects.
In step S450, the dynamic state of parameters in configuration information is assigned to converting objects.
Converting objects described in the present embodiment refers to the letter reconfigured the need for being preset in KETTLE files The data source being related in breath, such as KETTLE files.
In step S460, execute () is performed.
The actual execution of the step is that the information reconfigured the need for being preset in KETTLE files is replaced For the implementing result after the corresponding informance specified in configuration information.
In step S470, import.
So far, that is, realize to KETTLE files and dynamically to be parsed according to configuration file, carry out data importing Process, realize the demand that change is tackled with constant code.
The present embodiment by carrying out dynamic analysis to the KETTLE files that are pre-created according to configuration information, with It is automatic to carry out data importing, the demand of change is embodied by KETTLE files, and need are imported according to actual Setting configuration information is sought, the data lead-in method and the business degree of coupling described in the present embodiment are low, it is easy to extend, Frequent updating code is not required to, individual demand can be realized, heat deployment is supported.
Fig. 5 is a kind of block diagram of data importing device according to an exemplary embodiment, such as Fig. 5 institutes Show, the data importing device described in the present embodiment includes KETTLE files designating unit 510, configuration information Setting unit 520 and service unit 530.
The KETTLE files designating unit 510 is configured to specify what is be pre-created to be used for as number According to the KETTLE files for importing template;
The configuration information setting unit 520 is configured to according to default in the KETTLE files Need the information reconfigured that configuration information is set;
The service unit 530 is configured to enter the KETTLE files according to the configuration information Mobile state is parsed, to carry out data importing automatically.
Further, the KETTLE files are the advance instrument using for generating KETTLE files, Data place according to the data source of the first preset kind is imported into the second preset kind according to setting logic is given birth to Into KETTLE files.
Further, the data source of first preset kind is EXCEL file.
Further:
The information reconfigured is needed to include data source in the KETTLE files;
It is described it is default the need for the information that reconfigures include the data source being related in the KETTLE files.
Further, the KETTLE files include:Data source importation, JavaScript code Partly, table importation, continuous query part, increase constant part, sequence duplicate removal part, field selection Partly, table output par, c, and/or do-nothing operation part;
The data source importation, includes the demand file of upload;
The JavaScript code part, including JavaScript scripts, the JavaScript Script is used to the cell in upper transmitting file carrying out data check and Data Format Transform;
The table importation, the data for obtaining a data source, including query statement;
The continuous query part, the row field for table to be inputted inside the data obtained and data source is carried out Compare;
The increase constant part, for the field assignment given tacit consent to database;
The sequence duplicate removal part, for carrying out repeating record verification to nominated bank's record in data source;
The field selected section, for selecting to insert the row of database;
The table output par, c, for selecting business table, specifies the row to be inserted to carry out data insertion;
The do-nothing operation part, for inserting abnormality processing.
Further, the service unit 530 is used for, and data importing is carried out automatically by WEB server.
On the device in above-described embodiment, wherein unit performs the concrete mode operated and had It is described in detail in the embodiment for closing this method, explanation will be not set forth in detail herein.
The embodiment that the data importing device that the present embodiment is provided can perform data lead-in method of the present invention is carried The data lead-in method of confession, possesses the corresponding functional module of execution method and beneficial effect.
Those skilled in the art will readily occur to this after considering specification and putting into practice invention disclosed herein Other embodiments of invention.The application is intended to any modification, purposes or the adaptability of the present invention Change, these modifications, purposes or adaptations follow the general principle of the present invention and including this public affairs Open undocumented common knowledge or conventional techniques in the art.Description and embodiments only by It is considered as exemplary, true scope and spirit of the invention are pointed out by following claim.
It should be appreciated that the invention is not limited in be described above and be shown in the drawings it is accurate Structure, and various modifications and changes can be being carried out without departing from the scope.The scope of the present invention is only by institute Attached claim is limited.

Claims (10)

1. a kind of data lead-in method, it is characterised in that including:
Specify the KETTLE files for being used to import template as data being pre-created;
Configuration information is set according to the information that reconfigures the need for being preset in the KETTLE files;
Dynamic analysis is carried out to the KETTLE files according to the configuration information, led with carrying out data automatically Enter.
2. according to the method described in claim 1, it is characterised in that the KETTLE files are advance Using the instrument for generating KETTLE files, patrolled according to by the data source of the first preset kind according to setting Collect the KETTLE files for the data place generation for importing the second preset kind.
3. the method according to any one of claim 1 to 2, it is characterised in that:
The information reconfigured is needed to include data source in the KETTLE files;
It is described it is default the need for the information that reconfigures include the data source being related in the KETTLE files.
4. according to the method described in claim 1, it is characterised in that the KETTLE files include: Data source importation, JavaScript code part, table importation, continuous query part, increase are normal Amount part, sequence duplicate removal part, field selected section, table output par, c, and/or do-nothing operation part;
The data source importation, includes the demand file of upload;
The JavaScript code part, including JavaScript scripts, the JavaScript Script is used to the cell in upper transmitting file carrying out data check and Data Format Transform;
The table importation, the data for obtaining a data source, including query statement;
The continuous query part, the row field for table to be inputted inside the data obtained and data source is carried out Compare;
The increase constant part, for the field assignment given tacit consent to database;
The sequence duplicate removal part, for carrying out repeating record verification to nominated bank's record in data source;
The field selected section, for selecting to insert the row of database;
The table output par, c, for selecting business table, specifies the row to be inserted to carry out data insertion;
The do-nothing operation part, for inserting abnormality processing.
5. according to the method described in claim 1, it is characterised in that the automatic operation for carrying out data importing Including:Data importing is carried out by WEB server automatically.
6. a kind of data importing device, it is characterised in that including:
KETTLE file designating unit, what is be pre-created for specifying is used for as data importing template KETTLE files;
Configuration information setting unit, for being reconfigured according to the need for presetting in the KETTLE files Information sets configuration information;
Service unit, for carrying out dynamic analysis to the KETTLE files according to the configuration information, with It is automatic to carry out data importing.
7. device according to claim 6, it is characterised in that the KETTLE files are advance Using the instrument for generating KETTLE files, patrolled according to by the data source of the first preset kind according to setting Collect the KETTLE files for the data place generation for importing the second preset kind.
8. the device according to any one of claim 6 to 7, it is characterised in that:
The information reconfigured is needed to include data source in the KETTLE files;
It is described it is default the need for the information that reconfigures include the data source being related in the KETTLE files.
9. device according to claim 6, it is characterised in that the KETTLE files include: Data source importation, JavaScript code part, table importation, continuous query part, increase are normal Amount part, sequence duplicate removal part, field selected section, table output par, c, and/or do-nothing operation part;
The data source importation, includes the demand file of upload;
The JavaScript code part, including JavaScript scripts, the JavaScript Script is used to the cell in upper transmitting file carrying out data check and Data Format Transform;
The table importation, the data for obtaining a data source, including query statement;
The continuous query part, the row field for table to be inputted inside the data obtained and data source is carried out Compare;
The increase constant part, for the field assignment given tacit consent to database;
The sequence duplicate removal part, for carrying out repeating record verification to nominated bank's record in data source;
The field selected section, for selecting to insert the row of database;
The table output par, c, for selecting business table, specifies the row to be inserted to carry out data insertion;
The do-nothing operation part, for inserting abnormality processing.
10. device according to claim 6, it is characterised in that the service unit is used for, leads to Cross WEB server and carry out data importing automatically.
CN201610041954.6A 2016-01-21 2016-01-21 Data import method and device Active CN106991100B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610041954.6A CN106991100B (en) 2016-01-21 2016-01-21 Data import method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610041954.6A CN106991100B (en) 2016-01-21 2016-01-21 Data import method and device

Publications (2)

Publication Number Publication Date
CN106991100A true CN106991100A (en) 2017-07-28
CN106991100B CN106991100B (en) 2021-10-01

Family

ID=59413621

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610041954.6A Active CN106991100B (en) 2016-01-21 2016-01-21 Data import method and device

Country Status (1)

Country Link
CN (1) CN106991100B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107679251A (en) * 2017-11-02 2018-02-09 成都信息工程大学 Universal Database abstracting method based on Spoon under big data environment
CN108182963A (en) * 2017-12-14 2018-06-19 山东浪潮云服务信息科技有限公司 A kind of medical data processing method and processing device
CN108256087A (en) * 2018-01-22 2018-07-06 北京腾云天下科技有限公司 A kind of data importing, inquiry and processing method based on bitmap structure
CN109875521A (en) * 2019-04-18 2019-06-14 厦门纳龙科技有限公司 A kind of analysis of ECG data and system
WO2019205415A1 (en) * 2018-04-22 2019-10-31 平安科技(深圳)有限公司 Data import management method and apparatus, mobile terminal and storage medium
CN110958292A (en) * 2019-09-17 2020-04-03 平安银行股份有限公司 File uploading method, electronic device, computer equipment and storage medium
CN111625581A (en) * 2020-04-28 2020-09-04 四川省金科成地理信息技术有限公司 System data processing method adopting button to start service
WO2024020163A3 (en) * 2022-07-20 2024-05-02 Lyght Ai System, method and apparatuses for improved script creation

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101655873A (en) * 2009-08-28 2010-02-24 金蝶软件(中国)有限公司 Single sign-on system as well as method and device for inputting and outputting data thereof
CN103309945A (en) * 2013-05-15 2013-09-18 上海证券交易所 Device for importing data to database
CN104361139A (en) * 2014-12-10 2015-02-18 用友软件股份有限公司 Data importing device and method
US20150220502A1 (en) * 2014-01-31 2015-08-06 Yahoo! Inc. Compressed serialization of data for communication from a client-side application
CN105068770A (en) * 2015-08-28 2015-11-18 国家电网公司 Data integration method and apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101655873A (en) * 2009-08-28 2010-02-24 金蝶软件(中国)有限公司 Single sign-on system as well as method and device for inputting and outputting data thereof
CN103309945A (en) * 2013-05-15 2013-09-18 上海证券交易所 Device for importing data to database
US20150220502A1 (en) * 2014-01-31 2015-08-06 Yahoo! Inc. Compressed serialization of data for communication from a client-side application
CN104361139A (en) * 2014-12-10 2015-02-18 用友软件股份有限公司 Data importing device and method
CN105068770A (en) * 2015-08-28 2015-11-18 国家电网公司 Data integration method and apparatus

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
徐济惠: ""一个数据共享系统的实现"", 《一个数据共享系统的实现》 *
王伟: ""干货放送:基于Kettle的数据处理实践"", 《HTTP ://TECH.ITL68.COM/A2015/1201/1783/000001783611.SHTML》 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107679251A (en) * 2017-11-02 2018-02-09 成都信息工程大学 Universal Database abstracting method based on Spoon under big data environment
CN108182963A (en) * 2017-12-14 2018-06-19 山东浪潮云服务信息科技有限公司 A kind of medical data processing method and processing device
CN108256087A (en) * 2018-01-22 2018-07-06 北京腾云天下科技有限公司 A kind of data importing, inquiry and processing method based on bitmap structure
WO2019205415A1 (en) * 2018-04-22 2019-10-31 平安科技(深圳)有限公司 Data import management method and apparatus, mobile terminal and storage medium
CN109875521A (en) * 2019-04-18 2019-06-14 厦门纳龙科技有限公司 A kind of analysis of ECG data and system
CN110958292A (en) * 2019-09-17 2020-04-03 平安银行股份有限公司 File uploading method, electronic device, computer equipment and storage medium
CN111625581A (en) * 2020-04-28 2020-09-04 四川省金科成地理信息技术有限公司 System data processing method adopting button to start service
WO2024020163A3 (en) * 2022-07-20 2024-05-02 Lyght Ai System, method and apparatuses for improved script creation

Also Published As

Publication number Publication date
CN106991100B (en) 2021-10-01

Similar Documents

Publication Publication Date Title
CN106991100A (en) Data lead-in method and device
TWI746690B (en) Method, device and server for generating natural language question answer
CN101174240B (en) Software testing management method and system thereof
CN106649100B (en) Automatic testing method and system
US8612939B2 (en) Multi trace parser
CN105608088B (en) A kind of database based on configuration file automatically creates and data dynamic recording method
CN108399130A (en) Method, device and equipment for automatically generating test case and readable storage medium
CN105989150B (en) A kind of data query method and device based on big data environment
CN111782265B (en) Software resource system based on field-level blood-relation and establishment method thereof
CN110059176B (en) Rule-based general text information extraction and information generation method
CN108509199A (en) Method, device, equipment and storage medium for automatically generating Chinese annotations
CN113887173B (en) Protocol dynamic group package and analysis method based on XML
CN101499063A (en) Tracing-based database schema evolution method and system
CN109933671A (en) Construct method, apparatus, computer equipment and the storage medium of personal knowledge map
CN116661756B (en) Object analysis method and device based on low-code DSL
CN113110832A (en) Intelligent efficient code generation method and device and storage medium
CN109992585A (en) Data lead-in method for office management system
CN112947896A (en) Directed graph-based component dependence analysis method
CN116955393A (en) Data processing method and device, electronic equipment and storage medium
CN109254774A (en) The management method and device of code in software development system
Gonzalez-Barahona et al. Repositories with public data about software development
CN116303641A (en) Laboratory report management method supporting multi-data source visual configuration
CN107577476A (en) A kind of Android system source code difference analysis method, server and medium based on Module Division
CN115809290A (en) Method, device, equipment and medium for generating data persistence layer entry
CN116880826B (en) Visualized code generation method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant