CN106886535A - A kind of data pick-up method and apparatus for being adapted to multiple data sources - Google Patents
A kind of data pick-up method and apparatus for being adapted to multiple data sources Download PDFInfo
- Publication number
- CN106886535A CN106886535A CN201510944006.9A CN201510944006A CN106886535A CN 106886535 A CN106886535 A CN 106886535A CN 201510944006 A CN201510944006 A CN 201510944006A CN 106886535 A CN106886535 A CN 106886535A
- Authority
- CN
- China
- Prior art keywords
- data
- rule
- pick
- data pick
- target data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of data pick-up method and apparatus for being adapted to multiple data sources are the embodiment of the invention provides, method therein includes：Corresponding data pick-up rule is determined according to target data Source Type；According to data pick-up rule generation data pick-up instruction；Adaptation processing is carried out to the target data source；Perform the data pick-up instruction and obtain target data from the target data source.When extraction demand changes, the embodiment of the present invention need to only be adjusted to the decimation rule in configuration file, and need not change any program code, not only effectively reduce maintenance cost, and substantially increase the stability of system.
Description
Technical field
The present invention relates to technical field of information processing, and in particular to a kind of data pick-up of adaptation multiple data sources
Method and apparatus.
Background technology
At present, enterprise has caused that the production efficiency and managerial skills of enterprise are obtained by using informatization resolve scheme
To being greatly enhanced.But, due to the difference of the data source types between different information systems, for example not
Same relevant database Oracle, MySQL, DB2, SQL Server etc. causes information and exchanges and shared
Become extremely difficult.
In order to realize the data exchange between different information systems, will by the way of hard coded more than prior art
Data extraction process to different types of data source solidifies in a program.But it is flexible by the way of hard coded
Property is very poor, and any change of data source is required for remodifying hard coded part, and not only processing cost is high,
And greatly reduce the stability of system.
The content of the invention
In order to solve the problems, such as to use hard coded high cost, stability poor in data extraction process in the prior art,
The embodiment of the present invention is expected to provide a kind of data pick-up method and apparatus for being adapted to multiple data sources.
A kind of data pick-up method for being adapted to multiple data sources is the embodiment of the invention provides, including：
Corresponding data pick-up rule is determined according to target data Source Type；
According to data pick-up rule generation data pick-up instruction；
Adaptation processing is carried out to the target data source；
Perform the data pick-up instruction and obtain target data from the target data source.
Preferably, it is described the step of corresponding data pick-up rule is determined according to target data Source Type before,
Also include：
Data pick-up rule is set in configuration file in advance；
Wherein, the data pick-up rule includes：Relevant database decimation rule, non-relational database
Decimation rule, data file decimation rule.
Preferably, the relevant database decimation rule is accomplished by the following way：
SELECT*FROM a WHERE b BETWEEN c AND d；
Wherein, a is database-name；B, c, d are data pick-up conditional parameter.
Preferably, it is described perform data pick-up instruction obtained from the target data source target data it
Before, also include：
When the data pick-up rule in be provided with data it is preposition treatment mark when, the target data source is held
The preposition treatment of row data.
Preferably, it is described perform data pick-up instruction obtained from the target data source target data it
Afterwards, also include：
When data postpositive disposal mark is provided with data pick-up rule, to the number of targets of the acquisition
According to execution data postpositive disposal.
A kind of data pick-up square law device for being adapted to multiple data sources is the embodiment of the invention provides, including：
Decimation rule determining module, for determining corresponding data pick-up rule according to target data Source Type；
Extraction instruction generation module, for according to data pick-up rule generation data pick-up instruction；
Data source adaptation module, for carrying out adaptation processing to the target data source；
Instruction performing module, target is obtained for performing the data pick-up instruction from the target data source
Data.
Preferably, described device, also includes：
Decimation rule setup module, for setting data pick-up rule in configuration file in advance；
Wherein, the data pick-up rule includes：Relevant database decimation rule, non-relational database
Decimation rule, data file decimation rule.
Preferably, the relevant database decimation rule is accomplished by the following way：
SELECT*FROM a WHERE b BETWEEN c AND d；
Wherein, a is database-name；B, c, d are data pick-up conditional parameter.
Preferably, described device, also includes：
The preposition processing module of data, for when data pick-up rule determined by the decimation rule determining module
In be provided with data it is preposition treatment mark when, to the target data source perform the preposition treatment of data.
Preferably, described device also includes：
Data postpositive disposal module, in determining data pick-up rule when the decimation rule determining module
When being provided with data postpositive disposal mark, the target data to the acquisition performs data postpositive disposal..
Compared with prior art, the embodiment of the present invention at least includes advantages below：
A kind of data pick-up method and apparatus of adaptation multiple data sources that the embodiment of the present invention is provided, pass through
Target data source determines data pick-up rule, is then instructed according to data pick-up rule generation data pick-up,
Target data is obtained from target data source finally by data pick-up instruction is performed.As can be seen that this hair
The data pick-up instruction that bright embodiment is generated is according to the data pick-up rule being previously defined in configuration file
Generated, without being realized by way of hard coded in a program as prior art, due to the configuration text
Part independently of system-program code, therefore, even if to extract in had different requirements, only need to configure
Decimation rule in file is adjusted, and need not change any program code, not only effectively reduces
Maintenance cost, and substantially increase the stability of system.
Brief description of the drawings
Fig. 1 is a kind of data pick-up method flow diagram for being adapted to multiple data sources provided in an embodiment of the present invention；
The data pick-up method flow diagram of Fig. 2 another adaptation multiple data sources provided in an embodiment of the present invention；
Fig. 3 is a kind of basic knot of data pick-up device for being adapted to multiple data sources provided in an embodiment of the present invention
Composition.
Specific embodiment
Embodiment one
Reference picture 1, shows a kind of data pick-up embodiment of the method one for being adapted to multiple data sources of the invention
The step of flow chart, can specifically include：
Step 101, corresponding data pick-up rule is determined according to target data Source Type；
Specifically, the target data source that the embodiment of the present invention is adapted to can be relevant database, non-relation
Type database NoSQL and data file.Wherein, relevant database can be Oracle, MySQL,
Any type of relevant database such as DB2, SQL Server；Data file can be TXT, XML,
Excel, CSV etc., the present invention is to the type of relevant database, the type of non-relational database and data
The type of file is not restricted.
Wherein, data pick-up rule describes how the extracted data from corresponding target data source, specific real
Now, the type according to target data source determines corresponding data pick-up rule, can specifically include：Relation
Type database decimation rule, non-relational database decimation rule and data file decimation rule etc..In addition, this
Art personnel can also set corresponding data pick-up rule according to the type of data source according to actual needs.
By taking relevant database decimation rule as an example, the rule can be described by defining SQL statement, for example：
SELECT*FROM a WHERE b BETWEEN c AND d；
Wherein, a is database-name；B, c, d are data pick-up conditional parameter, and the parameter can specifically held
It is input into by Java SetParameter methods during row.
Specifically, being performed for the method that non-relational database decimation rule can extract class by specifying
Dynamic Execution in journey, for example：com.cattsoft.idea.dataFilter；Wherein, dataFilter is fixed in advance
The data pick-up class of justice.
Wherein, data file decimation rule can determine according to the specific format and content of data file in practical application,
Such as cell location in Excel file, XML file interior joint title etc..
It should be noted that above simply to relevant database decimation rule, non-pass in the embodiment of the present invention
It is type database decimation rule for example, when implementing, can according to actual needs use different
SQL statement, data pick-up class or other manner set different data pick-up rules.
Step 102, according to data pick-up rule generation data pick-up instruction；
Specifically, data pick-up parameter is determined according to application, the data pick-up for then determining according to step 101
Rule generation data pick-up instruction, for example：
select ID,Name from person where ID between 100 And 999；
Wherein, person is the data table name that parameter a determines, ID, 100 and 999 are above-mentioned extraction
Corresponding parameter b, c and d in Sample Rules, the Rule Expression extracted from tables of data person ID between
Record between 100 and 999.
In addition, if target data source is non-relational database NoSQL or data file, then according in advance
The NoSQL decimation rules of definition, data file decimation rule generate corresponding data pick-up instruction.
Step 103, adaptation processing is carried out to the target data source；
Wherein, carrying out adaptation processing to target data source can specifically include：According to the difference of target data source
Type determines that corresponding data access drives.For example, using JDBC, Java IO, third party's Open-Source Tools,
The datakit realization that database is provided in itself is docked with bottom data source.When target data source be txt,
During the data file of xml etc, then it is right to be realized by the abstract class method based on file input/output interface IO
The adaptation of target data source is accessed.
Step 104, performs the data pick-up instruction and obtains target data from the target data source.
Specifically, so that target data source is relevant database as an example, that is, the SQL instructions of the generation are performed,
Target data is obtained from corresponding database.In addition, performing the data processing instructions can also be storage
Process.
To sum up, the embodiment of the present invention determines data pick-up rule according to target data source, then according to the data
Decimation rule generation data pick-up instruction, obtains finally by data pick-up instruction is performed from target data source
Take target data.As can be seen that the data pick-up instruction that the embodiment of the present invention is generated is according to pre-defined
Data pick-up rule in configuration file is generated, without passing through hard coded in a program as prior art
Mode realize, because the configuration file is independently of system-program code, therefore, even if to extract content
There are different requirements, the decimation rule in configuration file need to be only adjusted, and appoint without modification
What program code, it is to avoid because the Unpredictability mistake that modification code is brought, therefore substantially increase
The stability of system, effectively reduces maintenance cost.
Embodiment two
Reference picture 2, shows a kind of data pick-up embodiment of the method two for being adapted to multiple data sources of the invention
The step of flow chart, can specifically include：
Step 201, sets data pick-up rule in configuration file in advance；
Step 202, corresponding data pick-up rule are determined according to target data Source Type from the configuration file
Then；
Step 203, the data pick-up rule generation data pick-up instruction according to the determination；
Specifically, can be referred to according to the data pick-up rule ID for determining and the parameter being actually needed generation data pick-up
Order.If current data extraction instruction is SQL statement or storing process, directly according to incoming parameter
Carry out assignment execution；If the mode that the data pick-up rule is data pick-up class is defined, by Java
D ynamic instantiation parameter, and assignment is carried out by the reflex mechanism list that gets parms, wherein, data take out class reality
Example is the data pick-up instruction.
Step 204, adaptation processing is carried out to the target data source；
Whether step 205, judges be provided with the preposition treatment mark of data in the data pick-up rule, if
Have, perform step 206；Otherwise, step 207 is performed；
Step 206, preposition treatment is performed to target data source.
When data source needs preposition treatment, incoming required parameter simultaneously performs data prediction, for example, in advance
Some of target data source data are entered with the treatment such as row format conversion, data recombination.
Step 207, performs the data pick-up instruction and obtains target data from the target data source.
Whether step 208, judges be provided with data postpositive disposal mark in the data pick-up rule, if
Have, perform step 209；Otherwise, terminate current data to extract.
Step 209, the target data to the acquisition performs data postpositive disposal.
Specifically, the target data to getting enters the treatment such as line character conversion, date conversion so that the mesh
Mark data meet being actually needed for application.
Embodiment three
Reference picture 3, shows a kind of knot of the data pick-up device embodiment for being adapted to multiple data sources of the present invention
Structure block diagram, described device includes：Decimation rule determining module 301, extraction instruction generation module 302, data
Source adaptation module 303, instruction performing module 304；Wherein,
Decimation rule determining module 301, for determining corresponding data pick-up rule according to target data Source Type
Then；
Extraction instruction generation module 302, for according to data pick-up rule generation data pick-up instruction；
Data source adaptation module 303, for carrying out adaptation processing to the target data source；
Instruction performing module 304, obtains for performing the data pick-up instruction from the target data source
Target data.
In an alternate embodiment of the present invention where, described device, also includes：
Decimation rule setup module 305, for setting data pick-up rule in configuration file in advance；
Wherein, the data pick-up rule includes：Relevant database decimation rule, non-relational database
Decimation rule, data file decimation rule.
Specifically, SELECT*FROM a WHERE b BETWEEN c AND d；
Wherein, a is database-name；B, c, d are data pick-up conditional parameter.
In an alternate embodiment of the present invention where, described device, also includes：
The preposition processing module 306 of data, for when data pick-up determined by the decimation rule determining module
Be provided with rule data it is preposition treatment mark when, to the target data source perform the preposition treatment of data.
In an alternate embodiment of the present invention where, described device also includes：
Data postpositive disposal module 307, for when data pick-up determined by the decimation rule determining module
When data postpositive disposal mark is provided with rule, the target data to the acquisition performs data postpositive disposal
Step.
In specific implementation process, above-mentioned decimation rule determining module 301, extraction instruction generation module 302,
Data source adaptation module 303, instruction performing module 304, the preposition place of decimation rule setup module 305, data
Manage module 306, data postpositive disposal module 307 can be by the computer for possessing data-handling capacity or service
Central processing unit (CPU, Central Processing Unit) in device, microprocessor (MPU, Micro
Processing Unit), digital signal processor (DSP, Digital Signal Processor) or programmable
Logic array (FPGA, Field-Programmable Gate Array) is realized.
For device embodiment, because it is substantially similar to embodiment of the method, so the comparing of description is simple
Single, the relevent part can refer to the partial explaination of embodiments of method.
Each embodiment in this specification is described by the way of progressive, what each embodiment was stressed
All be the difference with other embodiment, between each embodiment identical similar part mutually referring to.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can be provided as method, device,
Or computer program product.Therefore, the embodiment of the present invention can use complete hardware embodiment, complete software reality
Apply example or the form with reference to the embodiment in terms of software and hardware.And, the embodiment of the present invention can be used
One or more wherein include the computer-usable storage medium of computer usable program code (including but not
Be limited to magnetic disk storage, CD-ROM, optical memory etc.) on implement computer program product form.
The embodiment of the present invention is with reference to method according to embodiments of the present invention, terminal device (system) and calculates
The flow chart and/or block diagram of machine program product is described.It should be understood that can be realized by computer program instructions
In each flow and/or square frame and flow chart and/or block diagram in flow chart and/or block diagram
The combination of flow and/or square frame.These computer program instructions to all-purpose computer, dedicated computing can be provided
The processor of machine, Embedded Processor or other programmable data processing terminal equipments to produce a machine,
So that produced by the instruction of computer or the computing device of other programmable data processing terminal equipments being used for
Realize what is specified in one flow of flow chart or multiple one square frame of flow and/or block diagram or multiple square frames
The device of function.
These computer program instructions may be alternatively stored in can guide computer or other programmable data processing terminals
In the computer-readable memory that equipment works in a specific way so that storage is in the computer-readable memory
In instruction produce include the manufacture of command device, the command device realization in one flow or many of flow chart
The function of being specified in one square frame of individual flow and/or block diagram or multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing terminal equipments,
So that performing series of operation steps on computer or other programmable terminal equipments to produce computer to realize
Treatment, so as on computer or other programmable terminal equipments perform instruction provide for realize stream
The step of the function of being specified in one flow of journey figure or multiple one square frame of flow and/or block diagram or multiple square frames
Suddenly.
Although having been described for the preferred embodiment of the embodiment of the present invention, those skilled in the art once obtain
Cicada basic creative concept, then can make other change and modification to these embodiments.So, it is appended
Claim be intended to be construed to include preferred embodiment and fall into range of embodiment of the invention have altered and
Modification.
Finally, in addition it is also necessary to explanation, herein, such as first and second or the like relational terms are only
Only be used for by an entity or operation with another entity or operate make a distinction, and not necessarily require or
Imply between these entities or operation there is any this actual relation or order.And, term " including ",
"comprising" or any other variant thereof is intended to cover non-exclusive inclusion so that including it is a series of will
Process, method, article or the terminal device of element not only include those key elements, but also including without clear and definite
Other key elements listed, or also include for this process, method, article or terminal device institute are intrinsic
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", not
Exclusion also exist in the process including the key element, method, article or terminal device it is other it is identical will
Element.
Above to a kind of data pick-up method and apparatus for being adapted to multiple data sources provided by the present invention, carry out
It is discussed in detail, specific case used herein is set forth to principle of the invention and implementation method,
The explanation of above example is only intended to help and understands the method for the present invention and its core concept；Simultaneously for
Those of ordinary skill in the art, thought of the invention, in specific embodiments and applications
Will change, in sum, this specification content should not be construed as limiting the invention.
Claims (10)
1. it is a kind of be adapted to multiple data sources data pick-up method, it is characterised in that methods described includes：
Corresponding data pick-up rule is determined according to target data Source Type；
According to data pick-up rule generation data pick-up instruction；
Adaptation processing is carried out to the target data source；
Perform the data pick-up instruction and obtain target data from the target data source.
2. method according to claim 1, it is characterised in that described true according to target data Source Type
Before the step of fixed corresponding data pick-up rule, also include：
Data pick-up rule is set in configuration file in advance；
Wherein, the data pick-up rule includes：Relevant database decimation rule, non-relational database
Decimation rule, data file decimation rule.
3. method according to claim 2, it is characterised in that the relevant database decimation rule
It is accomplished by the following way：
SELECT*FROM a WHERE b BETWEEN c AND d；
Wherein, a is database-name；B, c, d are data pick-up conditional parameter.
4. method according to claim 1, it is characterised in that the execution data pick-up instruction
Before obtaining target data from the target data source, also include：
When the data pick-up rule in be provided with data it is preposition treatment mark when, the target data source is held
The preposition treatment of row data.
5. method according to claim 4, it is characterised in that the execution data pick-up instruction
Obtained from the target data source after target data, also included：
When data postpositive disposal mark is provided with data pick-up rule, to the number of targets of the acquisition
According to execution data postpositive disposal.
6. it is a kind of be adapted to multiple data sources data pick-up device, it is characterised in that described device includes：
Decimation rule determining module, for determining corresponding data pick-up rule according to target data Source Type；
Extraction instruction generation module, for according to data pick-up rule generation data pick-up instruction；
Data source adaptation module, for carrying out adaptation processing to the target data source；
Instruction performing module, target is obtained for performing the data pick-up instruction from the target data source
Data.
7. device according to claim 6, it is characterised in that described device, also includes：
Decimation rule setup module, for setting data pick-up rule in configuration file in advance；
Wherein, the data pick-up rule includes：Relevant database decimation rule, non-relational database
Decimation rule, data file decimation rule.
8. device according to claim 7, it is characterised in that the relevant database decimation rule
It is accomplished by the following way：
SELECT*FROM a WHERE b BETWEEN c AND d；
Wherein, a is database-name；B, c, d are data pick-up conditional parameter.
9. device according to claim 6, it is characterised in that described device, also includes：
The preposition processing module of data, for when data pick-up rule determined by the decimation rule determining module
In be provided with data it is preposition treatment mark when, to the target data source perform the preposition treatment of data.
10. device according to claim 9, it is characterised in that described device also includes：
Data postpositive disposal module, in determining data pick-up rule when the decimation rule determining module
When being provided with data postpositive disposal mark, the target data to the acquisition performs data postpositive disposal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510944006.9A CN106886535A (en) | 2015-12-16 | 2015-12-16 | A kind of data pick-up method and apparatus for being adapted to multiple data sources |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510944006.9A CN106886535A (en) | 2015-12-16 | 2015-12-16 | A kind of data pick-up method and apparatus for being adapted to multiple data sources |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106886535A true CN106886535A (en) | 2017-06-23 |
Family
ID=59175346
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510944006.9A Pending CN106886535A (en) | 2015-12-16 | 2015-12-16 | A kind of data pick-up method and apparatus for being adapted to multiple data sources |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106886535A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108334634A (en) * | 2018-02-27 | 2018-07-27 | 北京中关村科金技术有限公司 | A kind of method, apparatus, equipment and the storage medium of extraction data information |
| CN108984700A (en) * | 2018-07-05 | 2018-12-11 | 腾讯科技（深圳）有限公司 | Data processing method and device, computer equipment and storage medium |
| CN109299177A (en) * | 2018-09-30 | 2019-02-01 | 江苏满运软件科技有限公司 | Data pick-up method, apparatus, storage medium and electronic equipment |
| CN109616215A (en) * | 2018-11-23 | 2019-04-12 | 金色熊猫有限公司 | Medical data abstracting method, device, storage medium and electronic equipment |
| CN110472102A (en) * | 2019-08-22 | 2019-11-19 | 北京锐安科技有限公司 | A kind of data processing method, device, equipment and storage medium |
| CN111597245A (en) * | 2020-05-20 | 2020-08-28 | 政采云有限公司 | Data extraction method and device, information statistics method and related equipment |
| CN112596851A (en) * | 2020-12-02 | 2021-04-02 | 中国人民解放军63921部队 | Multi-source heterogeneous data batch extraction method and analysis method of simulation platform |
| CN113127522A (en) * | 2019-12-31 | 2021-07-16 | 阿里巴巴集团控股有限公司 | Data processing method, device, system and storage medium |
| CN113688183A (en) * | 2021-10-27 | 2021-11-23 | 深圳市信润富联数字科技有限公司 | Multi-type data source extraction method, system, terminal equipment and storage medium |
| CN113947468A (en) * | 2021-12-20 | 2022-01-18 | 鲁信科技股份有限公司 | Data management method and platform |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020129005A1 (en) * | 2001-01-23 | 2002-09-12 | Republica Jyvaskyla Oy | Method and apparatus for regrouping data |
| CN101826100A (en) * | 2010-03-16 | 2010-09-08 | 中国测绘科学研究院 | Automatic integrated system and method of wide area network (WAN)-oriented multisource emergency information |
| CN102495892A (en) * | 2011-12-09 | 2012-06-13 | 北京大学 | Webpage information extraction method |
| CN102508912A (en) * | 2011-11-09 | 2012-06-20 | 深圳市同洲电子股份有限公司 | Method and system for data extracting, converting and loading |
| CN102902750A (en) * | 2012-09-20 | 2013-01-30 | 浪潮齐鲁软件产业有限公司 | Universal data extraction and conversion method |
| CN103810272A (en) * | 2014-02-11 | 2014-05-21 | 北京邮电大学 | Data processing method and system |
| CN103853830A (en) * | 2014-03-10 | 2014-06-11 | 浪潮集团山东通用软件有限公司 | Design method for supporting multi-cost object type opening data source of cost information |
| CN104142980A (en) * | 2014-07-15 | 2014-11-12 | 中电科华云信息技术有限公司 | Big data-based metadata model management system and method |
-
2015
- 2015-12-16 CN CN201510944006.9A patent/CN106886535A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020129005A1 (en) * | 2001-01-23 | 2002-09-12 | Republica Jyvaskyla Oy | Method and apparatus for regrouping data |
| CN101826100A (en) * | 2010-03-16 | 2010-09-08 | 中国测绘科学研究院 | Automatic integrated system and method of wide area network (WAN)-oriented multisource emergency information |
| CN102508912A (en) * | 2011-11-09 | 2012-06-20 | 深圳市同洲电子股份有限公司 | Method and system for data extracting, converting and loading |
| CN102495892A (en) * | 2011-12-09 | 2012-06-13 | 北京大学 | Webpage information extraction method |
| CN102902750A (en) * | 2012-09-20 | 2013-01-30 | 浪潮齐鲁软件产业有限公司 | Universal data extraction and conversion method |
| CN103810272A (en) * | 2014-02-11 | 2014-05-21 | 北京邮电大学 | Data processing method and system |
| CN103853830A (en) * | 2014-03-10 | 2014-06-11 | 浪潮集团山东通用软件有限公司 | Design method for supporting multi-cost object type opening data source of cost information |
| CN104142980A (en) * | 2014-07-15 | 2014-11-12 | 中电科华云信息技术有限公司 | Big data-based metadata model management system and method |
Non-Patent Citations (4)
| Title |
|---|
| 《数据库百科全书》编委会: "《数据库百科全书》", 30 September 2009, 上海：上海交通大学出版社 * |
| 张雪凤: "《数据库实验》", 31 August 2015, 上海：上海财经大学出版社 * |
| 李望平: "《科学数据库与信息技术论文集 第九集》", 30 September 2008, 北京：兵器工业出版社 * |
| 郑志勇（ARISZHENG）: "《金融数量分析基于MATLAB编程第2版》", 31 March 2013, 北京：北京航空航天大学出版社 * |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108334634A (en) * | 2018-02-27 | 2018-07-27 | 北京中关村科金技术有限公司 | A kind of method, apparatus, equipment and the storage medium of extraction data information |
| CN108984700A (en) * | 2018-07-05 | 2018-12-11 | 腾讯科技（深圳）有限公司 | Data processing method and device, computer equipment and storage medium |
| CN109299177A (en) * | 2018-09-30 | 2019-02-01 | 江苏满运软件科技有限公司 | Data pick-up method, apparatus, storage medium and electronic equipment |
| CN109616215A (en) * | 2018-11-23 | 2019-04-12 | 金色熊猫有限公司 | Medical data abstracting method, device, storage medium and electronic equipment |
| CN109616215B (en) * | 2018-11-23 | 2021-07-09 | 金色熊猫有限公司 | Medical data extraction method, device, storage medium and electronic equipment |
| CN110472102A (en) * | 2019-08-22 | 2019-11-19 | 北京锐安科技有限公司 | A kind of data processing method, device, equipment and storage medium |
| CN113127522A (en) * | 2019-12-31 | 2021-07-16 | 阿里巴巴集团控股有限公司 | Data processing method, device, system and storage medium |
| CN113127522B (en) * | 2019-12-31 | 2024-05-10 | 阿里巴巴集团控股有限公司 | Data processing method, device, system and storage medium |
| CN111597245B (en) * | 2020-05-20 | 2023-09-29 | 政采云有限公司 | Data extraction method and device and related equipment |
| CN111597245A (en) * | 2020-05-20 | 2020-08-28 | 政采云有限公司 | Data extraction method and device, information statistics method and related equipment |
| CN112596851A (en) * | 2020-12-02 | 2021-04-02 | 中国人民解放军63921部队 | Multi-source heterogeneous data batch extraction method and analysis method of simulation platform |
| CN113688183A (en) * | 2021-10-27 | 2021-11-23 | 深圳市信润富联数字科技有限公司 | Multi-type data source extraction method, system, terminal equipment and storage medium |
| CN113947468B (en) * | 2021-12-20 | 2022-04-08 | 鲁信科技股份有限公司 | Data management method and platform |
| CN113947468A (en) * | 2021-12-20 | 2022-01-18 | 鲁信科技股份有限公司 | Data management method and platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106886535A (en) | A kind of data pick-up method and apparatus for being adapted to multiple data sources | |
| US10713664B1 (en) | Automated evaluation and reporting of microservice regulatory compliance | |
| CN109344170B (en) | Stream data processing method, system, electronic device and readable storage medium | |
| CN110032369A (en) | A kind of code automatic generation method, device and medium | |
| CN104216961B (en) | A kind of data processing method and device | |
| CN110225095B (en) | Data processing method, device and system | |
| US9928288B2 (en) | Automatic modeling of column and pivot table layout tabular data | |
| CN110348578B (en) | Security event scenario deduction construction method, system, equipment and medium | |
| Silva et al. | Integrating big data into the computing curricula | |
| US20170193375A1 (en) | Rule guided fabrication of structured data and messages | |
| US20170103099A1 (en) | Database table data fabrication | |
| JP6419667B2 (en) | Test DB data generation method and apparatus | |
| CN107153702A (en) | A kind of data processing method and device | |
| US20210133195A1 (en) | Dynamic access paths | |
| CN105871998A (en) | Data displaying method and device | |
| CN108182204A (en) | The processing method and processing device of data query based on house prosperity transaction multi-dimensional data | |
| CN105468770A (en) | Data processing method and system | |
| CN106776644A (en) | A kind of reporting system collocation method and device | |
| CN107391533A (en) | Generate the method and device of graphic data base Query Result | |
| CN106294700A (en) | The storage of a kind of daily record and read method and device | |
| CN106843822A (en) | One kind performs code generating method and equipment | |
| CN116483707A (en) | Test method, test device, test apparatus, test program, and test program | |
| CN109582476A (en) | Data processing method, apparatus and system | |
| CN106599244B (en) | General original log cleaning device and method | |
| CN115480748A (en) | Service arrangement method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170623 |
|
| RJ01 | Rejection of invention patent application after publication |