CN108038182A - A kind of method and apparatus of the relation data library storage data based on Flume - Google Patents
A kind of method and apparatus of the relation data library storage data based on Flume Download PDFInfo
- Publication number
- CN108038182A CN108038182A CN201711292038.0A CN201711292038A CN108038182A CN 108038182 A CN108038182 A CN 108038182A CN 201711292038 A CN201711292038 A CN 201711292038A CN 108038182 A CN108038182 A CN 108038182A
- Authority
- CN
- China
- Prior art keywords
- database
- data
- rbo
- objective
- relationship
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
Abstract
The present invention provides a kind of method of the relation data library storage data based on Flume, including：Pre-set reconfigurable item, driven with the corresponding relational database of relational database type；Driven according to the reconfigurable item and relational database corresponding with relational database type, determine relationship by objective (RBO) database-driven；According to the relationship by objective (RBO) database-driven and the reconfigurable item, database connection is created；Further include：Data to be stored is obtained from Flume；According to database connection and the reconfigurable item, the data to be stored is stored to relationship by objective (RBO) database.Scheme provided by the invention can store the Flume data gathered to relational database.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of relation data library storage data based on Flume
Method and apparatus.
Background technology
Flume can provide the collection, polymerization and write-in Kafka, HDFS, Hive of file data, daily record data etc. etc.
Function.
In the prior art, can be used Flume provide file data, daily record data acquisition capacity gathered data and deposit
Storage, but the Flume data gathered can not be stored to relational database.
The content of the invention
, can an embodiment of the present invention provides a kind of method and apparatus of the relation data library storage data based on Flume
The Flume data gathered are stored to relational database.
In a first aspect, an embodiment of the present invention provides a kind of method of the relation data library storage data based on Flume, bag
Include：
Pre-set reconfigurable item, driven with the corresponding relational database of relational database type；
Driven according to the reconfigurable item and relational database corresponding with relational database type, determine that target is closed
It is database-driven；
According to the relationship by objective (RBO) database-driven and the reconfigurable item, database connection is created；
Further include：
Data to be stored is obtained from Flume；
According to database connection and the reconfigurable item, the data to be stored is stored to relationship by objective (RBO) data
Storehouse.
Preferably,
The reconfigurable item, including：The driving class of the relationship by objective (RBO) database；
It is described to be driven according to the reconfigurable item and relational database corresponding with relational database type, determine mesh
Relational database driving is marked, including：
According to the driving class of the relationship by objective (RBO) database, relationship by objective (RBO) type of database is determined；
Driven according to relational database corresponding with relational database type, determine the relationship by objective (RBO) type of database
Corresponding relationship by objective (RBO) database-driven.
Preferably,
The reconfigurable item, including：Database address, user name and user cipher；
It is described to be connected according to the relationship by objective (RBO) database-driven and the reconfigurable item, establishment database, including：
According to the relationship by objective (RBO) database-driven, the database address, the user name and the user cipher, wound
Build database connection.
Preferably,
The reconfigurable item, including：Single batch, separator, list of fields, database table；
It is described according to the database connection and the reconfigurable item, the data to be stored is stored to relationship by objective (RBO)
Database, including：
According to single batch, batch processing is carried out to the data to be stored, generation at least a collection of first is to be stored
Data, wherein, include at least one data per a collection of first data to be stored；
For every a collection of first data to be stored, it is performed both by：
According to the separator, data described in each in current first data to be stored are carried out with dividing processing, it is raw
Into at least one data item corresponding with data described in each bar；
According to the list of fields, the database table, each data item is spliced into database expression；
Connected using the database, the database expression is committed to relationship by objective (RBO) database.
Second aspect, an embodiment of the present invention provides a kind of device of the relation data library storage data based on Flume, bag
Include：
Setting unit, for setting reconfigurable item, being driven with the corresponding relational database of relational database type；
Creating unit, for the reconfigurable item that is set according to the setting unit and with relational database type phase
Corresponding relational database driving, determines relationship by objective (RBO) database-driven；According to the relationship by objective (RBO) database-driven and described
Reconfigurable item, creates database connection；
Acquiring unit, for obtaining data to be stored from Flume；
Storage unit, will for the database connection created according to the creating unit and the reconfigurable item
The data to be stored that the acquiring unit obtains is stored to relationship by objective (RBO) database.
Preferably,
The reconfigurable item, including：The driving class of the relationship by objective (RBO) database；
The creating unit, for the driving class according to the relationship by objective (RBO) database, determines relationship by objective (RBO) class database
Type；Driven according to relational database corresponding with relational database type, determine that the relationship by objective (RBO) type of database corresponds to
Relationship by objective (RBO) database-driven.
Preferably,
The reconfigurable item, including：Database address, user name and user cipher；
The creating unit, for according to the relationship by objective (RBO) database-driven, the database address, the user name
With the user cipher, database connection is created.
Preferably,
The reconfigurable item, including：Single batch, separator, list of fields, database table；
The storage unit, for according to single batch, batch processing being carried out to the data to be stored, generation is extremely
Few a collection of first data to be stored, wherein, include at least one data per a collection of first data to be stored；For each
First data to be stored is criticized, is performed both by：According to the separator, to described in each in current first data to be stored
Data carry out dividing processing, generate at least one data item corresponding with data described in each bar；According to the list of fields, described
Database table, database expression is spliced into by each data item；Connected using the database, by the database table
The relationship by objective (RBO) database is committed to up to formula.
The third aspect, an embodiment of the present invention provides a kind of computer-readable recording medium, including execute instruction, when the place of storage control
When managing the device execution execute instruction, the storage control performs the method described in any of the above-described embodiment.
Fourth aspect, an embodiment of the present invention provides a kind of storage control, including：Processor, memory and bus；
The memory is used to store execute instruction, and the processor is connected with the memory by the bus, when
During the storage control operation, the processor performs the execute instruction of the memory storage, so that the storage
Controller performs the method described in any of the above-described embodiment.
An embodiment of the present invention provides a kind of method and apparatus of the relation data library storage data based on Flume, wherein,
This method is driven using pre-set reconfigurable item and relational database, creates database connection, and connect using database
Connecing will store to relationship by objective (RBO) database from the data to be stored that Flume is obtained.The number that the program can gather Flume components
According to storing to relational database.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is attached drawing needed in technology description to be briefly described, it should be apparent that, drawings in the following description are the present invention
Some embodiments, for those of ordinary skill in the art, without creative efforts, can also basis
These attached drawings obtain other attached drawings.
Fig. 1 is a kind of method of relation data library storage data based on Flume provided by one embodiment of the present invention
Flow chart；
Fig. 2 is a kind of method for relation data library storage data based on Flume that another embodiment of the present invention provides
Flow chart；
Fig. 3 is a kind of device of relation data library storage data based on Flume provided by one embodiment of the present invention
Structure diagram.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, the technical solution in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, instead of all the embodiments, based on the embodiments of the present invention, those of ordinary skill in the art
The all other embodiments obtained on the premise of creative work is not made, belong to the scope of protection of the invention.
As shown in Figure 1, an embodiment of the present invention provides a kind of method of the relation data library storage data based on Flume,
This method may comprise steps of：
Step 101：Pre-set reconfigurable item, driven with the corresponding relational database of relational database type；
Step 102：Driven according to reconfigurable item and relational database corresponding with relational database type, determine mesh
Mark relational database driving；
Step 103：According to relationship by objective (RBO) database-driven and reconfigurable item, database connection is created；
Step 104：Data to be stored is obtained from Flume；
Step 105：According to database connection and reconfigurable item, data to be stored is stored to relationship by objective (RBO) database.
This method is driven using pre-set reconfigurable item and relational database, creates database connection, and utilize
Database connection will be stored to relationship by objective (RBO) database from the data to be stored that Flume is obtained.The program can be by Flume components
The data of collection are stored to relational database.
In one embodiment of the invention, driven to load relational database, reconfigurable item, including：Target is closed
It is the driving class of database；
Driven according to reconfigurable item and relational database corresponding with relational database type, determine relationship by objective (RBO) number
Driven according to storehouse, including：
According to the driving class of relationship by objective (RBO) database, relationship by objective (RBO) type of database is determined；
Driven according to relational database corresponding with relational database type, determine that relationship by objective (RBO) type of database corresponds to
Relationship by objective (RBO) database-driven.
Relational database includes different types, for example, one kind is desktop database, such as Access, FoxPro and
DBase etc., another kind of is client/server database, such as SQL Server, Oracle and Sybase etc..It is different types of
Relational database corresponds to different relational database drivings, is needed in practical application scene using the relational database configured
Class is driven to load corresponding relational database driving.
In one embodiment of the invention, in order to realize the connection with relational database, reconfigurable item, including：Number
According to storehouse address, user name and user cipher；
According to relationship by objective (RBO) database-driven and reconfigurable item, database connection is created, including：
According to relationship by objective (RBO) database-driven, database address, user name and user cipher, database connection is created.
The data interaction between relational database can be realized by database connection.
In one embodiment of the invention, can in order to which data to be stored to be changed into the form of relational database requirement
Become configuration item, including：Single batch, separator, list of fields, database table；
According to database connection and reconfigurable item, data to be stored is stored to relationship by objective (RBO) database, including：
According to single batch, batch processing is carried out to data to be stored, generates at least a collection of first data to be stored, its
In, include at least one data per a collection of first data to be stored；
For every a collection of first data to be stored, it is performed both by：
According to separator, dividing processing, generation and each bar are carried out to each data in current first data to be stored
The corresponding at least one data item of data；
According to list of fields, database table, each data item is spliced into database expression；
Connected using database, database expression is committed to relationship by objective (RBO) database.
In view of used in practical business scene relational database type, the address of relational database, database use
The projects such as name in an account book and the field in password, database-name, table name and table can be different and different with business, in order to provide
General relation data library storage Sink by above-mentioned project, it is necessary to be provided as reconfigurable item.Furthermore, it is contemplated that practical business number
Separator between data item in may be different, by separator for being reconfigurable item；, will batch in view of execution efficiency
Size is provided as reconfigurable item.The name of reconfigurable item can need self-defined according to business.
The present invention describes for convenience, and reconfigurable item and business implication explanation are as shown in table 1.Wherein, the single in table 1
Batch is referred to the batch size of data to be stored write-in relational database once.
Table 1
| Reconfigurable item | Explanation |
| driver.class | The driving class of relational database |
| driver.url | Database address |
| db.username | User name |
| db.password | User cipher |
| db.table | Tables of data |
| db.fields | List of fields |
| delimiter | Decollator |
| batchSize | Single batch |
As shown in Fig. 2, the embodiment of the present invention will carry out in detail the method for the relation data library storage data based on Flume
Ground illustrates that this method includes：
Step 201：Reconfigurable item is set, is driven with the corresponding relational database of relational database type, wherein, can
Become configuration item, including：The driving class of relationship by objective (RBO) database, database address, user name, user cipher, single batch, separation
Symbol, list of fields and database table.
Step 202：According to the driving class of relationship by objective (RBO) database, relationship by objective (RBO) type of database is determined.
Step 203：Driven according to relational database corresponding with relational database type, determine relationship by objective (RBO) database
The corresponding relationship by objective (RBO) database-driven of type.
Step 204：According to relationship by objective (RBO) database-driven, database address, user name and user cipher, database is created
Connection.
Step 205：Data to be stored is obtained from Flume.
Flume forms source, channel, sink by three parts, wherein, channel is that a kind of of short duration storage is held
Device, it is by the data buffer storage of the event forms received at source, until they are consumed by sinks, it
Bridge beam action altogether is played between source and sink, channel is a complete affairs, and this point ensure that data are being received
Uniformity when hair.
Step 206：According to single batch, batch processing is carried out to data to be stored, generation at least a collection of first is to be stored
Data, wherein, include at least one data per a collection of first data to be stored.
Due to the limitation of single batch, when data to be stored amount is larger, it is necessary to carry out batch processing.
Step 207：For every a collection of first data to be stored, it is performed both by：According to separator, to the current first number to be stored
Each data in carries out dividing processing, generates at least one data item corresponding with pieces of data.
Each data can split into multiple data item according to separator.
Step 208：According to list of fields, database table, each data item is spliced into database expression.
Each data item is matched with each field in list of fields, and according to the database table of configuration, by this batch
The corresponding each data item of secondary first data to be stored is spliced into database expression.
Step 209：Connected using database, database expression is committed to relationship by objective (RBO) database.
The configuration example of relation data library storage Sink based on the embodiment of the present invention is as follows：
Agent2mysql.sinks.k1.type=MyJdbcSink is 1.
Agent2mysql.sinks.k1.driver.class=org.gjt.mm.mysql.Drive r are 2.
Agent2mysql.sinks.k1.driver.url=jdbc:mysql://127.0.0.1:3306/myDB③
Agent2mysql.sinks.k1.db.username=myUserName is 4.
Agent2mysql.sinks.k1.db.password=myPassword is 5.
Agent2mysql.sinks.k1.db.table=myTable is 6.
Agent2mysql.sinks.k1.db.fields=myField1, myField2, myField3 are 7.
Agent2mysql.sinks.k1.delimiter=myDelimiter is 8.
Agent2mysql.sinks.k1.batchSize=100 is 9.
The meaning that each label represents in upper table is as follows：
A kind of 1. class of the relation data library storage Sink based on Flume
2. corresponding to the driving class of certain relational database
3. corresponding to the database address of the relational database described in 2.
4. corresponding to the user name of the database described in 3.
5. corresponding to the user cipher of the database described in 3.
6. corresponding to certain table in the database described in 3.
7. corresponding to some fields in certain table described in 6.
8. corresponding to the decollator that data are collected based on Flume
9. corresponding to the batch size for once writing data into database
As shown in figure 3, an embodiment of the present invention provides a kind of device of the relation data library storage data based on Flume,
Including：
Setting unit 301, for setting reconfigurable item, being driven with the corresponding relational database of relational database type
It is dynamic；
Creating unit 302, for the reconfigurable item that is set according to setting unit 301 and opposite with relational database type
The relational database driving answered, determines relationship by objective (RBO) database-driven；According to relationship by objective (RBO) database-driven and reconfigurable item,
Create database connection；
Acquiring unit 303, for obtaining data to be stored from Flume；
Storage unit 304, it is single by obtaining for the database connection created according to creating unit 302 and reconfigurable item
The data to be stored that member 303 obtains is stored to relationship by objective (RBO) database.
In one embodiment of the invention, reconfigurable item, including：The driving class of relationship by objective (RBO) database；
Creating unit 302, for the driving class according to relationship by objective (RBO) database, determines relationship by objective (RBO) type of database；Root
Driven according to relational database corresponding with relational database type, determine the corresponding relationship by objective (RBO) of relationship by objective (RBO) type of database
Database-driven.
In one embodiment of the invention, reconfigurable item, including：Database address, user name and user cipher；
Creating unit 302, for according to relationship by objective (RBO) database-driven, database address, user name and user cipher, wound
Build database connection.
In one embodiment of the invention, reconfigurable item, including：Single batch, separator, list of fields, data
Storehouse table；
Storage unit 304, for according to single batch, batch processing, generation at least a collection of the to be carried out to data to be stored
One data to be stored, wherein, include at least one data per a collection of first data to be stored；It is to be stored for every a collection of first
Data, are performed both by：According to separator, carry out dividing processing to each data in current first data to be stored, generation with
The corresponding at least one data item of pieces of data；According to list of fields, database table, each data item is spliced into database table
Up to formula；Connected using database, database expression is committed to relationship by objective (RBO) database.
The contents such as the information exchange between each unit, implementation procedure in above device, due to implementing with the method for the present invention
Example is based on same design, and particular content can be found in the narration in the method for the present invention embodiment, and details are not described herein again.
An embodiment of the present invention provides a kind of computer-readable recording medium, including execute instruction, when the processor of storage control performs
During execute instruction, the method for any of the above-described embodiment of storage control execution.
An embodiment of the present invention provides a kind of storage control, including：Processor, memory and bus；
Memory is used to store execute instruction, and processor is connected with memory by bus, when storage control is run,
Processor performs the execute instruction of memory storage, so that the method that storage control performs any of the above-described embodiment.
To sum up, each embodiment of the present invention at least has the effect that：
1st, in embodiments of the present invention, this method is driven using pre-set reconfigurable item and relational database, wound
Database connection is built, and will be stored using database connection from the data to be stored that Flume is obtained to relationship by objective (RBO) database.Should
The data that scheme can gather Flume components are stored to relational database.
It should be noted that herein, such as first and second etc relational terms are used merely to an entity
Or operation is distinguished with another entity or operation, is existed without necessarily requiring or implying between these entities or operation
Any actual relationship or order.Moreover, term " comprising ", "comprising" or its any other variant be intended to it is non-
It is exclusive to include, so that process, method, article or equipment including a series of elements not only include those key elements,
But also including other elements that are not explicitly listed, or further include solid by this process, method, article or equipment
Some key elements.In the absence of more restrictions, by sentence " including the key element that a 〃 〃 " is limited, it is not excluded that
Also there is other identical factor in the process, method, article or apparatus that includes the element.
One of ordinary skill in the art will appreciate that：Realizing all or part of step of above method embodiment can pass through
The relevant hardware of programmed instruction is completed, and foregoing program can be stored in computer-readable storage medium, the program
Upon execution, the step of execution includes above method embodiment；And foregoing storage medium includes：ROM, RAM, magnetic disc or light
Disk etc. is various can be with the medium of store program codes.
It is last it should be noted that：The foregoing is merely presently preferred embodiments of the present invention, is merely to illustrate skill of the invention
Art scheme, is not intended to limit the scope of the present invention.Any modification for being made within the spirit and principles of the invention,
Equivalent substitution, improvement etc., are all contained in protection scope of the present invention.
Claims (10)
- A kind of 1. method of the relation data library storage data based on Flume, it is characterised in that including：Pre-set reconfigurable item, driven with the corresponding relational database of relational database type；Driven according to the reconfigurable item and relational database corresponding with relational database type, determine relationship by objective (RBO) number Driven according to storehouse；According to the relationship by objective (RBO) database-driven and the reconfigurable item, database connection is created；Further include：Data to be stored is obtained from Flume；According to database connection and the reconfigurable item, the data to be stored is stored to relationship by objective (RBO) database.
- 2. the method for the relation data library storage data according to claim 1 based on Flume, it is characterised in thatThe reconfigurable item, including：The driving class of the relationship by objective (RBO) database；It is described to be driven according to the reconfigurable item and relational database corresponding with relational database type, determine that target is closed It is database-driven, including：According to the driving class of the relationship by objective (RBO) database, relationship by objective (RBO) type of database is determined；Driven according to relational database corresponding with relational database type, determine that the relationship by objective (RBO) type of database corresponds to Relationship by objective (RBO) database-driven.
- 3. the method for the relation data library storage data according to claim 1 based on Flume, it is characterised in thatThe reconfigurable item, including：Database address, user name and user cipher；It is described to be connected according to the relationship by objective (RBO) database-driven and the reconfigurable item, establishment database, including：According to the relationship by objective (RBO) database-driven, the database address, the user name and the user cipher, number is created Connected according to storehouse.
- 4. according to the method for any relation data library storage data based on Flume in claim 1-3, its feature exists In,The reconfigurable item, including：Single batch, separator, list of fields, database table；It is described according to the database connection and the reconfigurable item, the data to be stored is stored to relationship by objective (RBO) data Storehouse, including：According to single batch, batch processing is carried out to the data to be stored, generates at least a collection of first data to be stored, Wherein, at least one data are included per a collection of first data to be stored；For every a collection of first data to be stored, it is performed both by：According to the separator, data described in each in current first data to be stored are carried out with dividing processing, generation with The corresponding at least one data item of data described in each bar；According to the list of fields, the database table, each data item is spliced into database expression；Connected using the database, the database expression is committed to relationship by objective (RBO) database.
- A kind of 5. device of the relation data library storage data based on Flume, it is characterised in that including：Setting unit, for setting reconfigurable item, being driven with the corresponding relational database of relational database type；Creating unit, for the reconfigurable item that is set according to the setting unit and corresponding with relational database type Relational database driving, determine relationship by objective (RBO) database-driven；According to the relationship by objective (RBO) database-driven and described variable Configuration item, creates database connection；Acquiring unit, for obtaining data to be stored from Flume；Storage unit, for the database connection created according to the creating unit and the reconfigurable item, by described in The data to be stored that acquiring unit obtains is stored to relationship by objective (RBO) database.
- 6. the device of the relation data library storage data according to claim 5 based on Flume, it is characterised in thatThe reconfigurable item, including：The driving class of the relationship by objective (RBO) database；The creating unit, for the driving class according to the relationship by objective (RBO) database, determines relationship by objective (RBO) type of database；Root Driven according to relational database corresponding with relational database type, determine the corresponding target of the relationship by objective (RBO) type of database Relational database drives.
- 7. the device of the relation data library storage data according to claim 5 based on Flume, it is characterised in thatThe reconfigurable item, including：Database address, user name and user cipher；The creating unit, for according to the relationship by objective (RBO) database-driven, the database address, the user name and institute User cipher is stated, creates database connection.
- 8. according to the device of any relation data library storage data based on Flume in claim 5-7, its feature exists In,The reconfigurable item, including：Single batch, separator, list of fields, database table；The storage unit, for according to single batch, batch processing, generation at least one to be carried out to the data to be stored The first data to be stored is criticized, wherein, include at least one data per a collection of first data to be stored；For every a collection of institute The first data to be stored is stated, is performed both by：According to the separator, to data described in each in current first data to be stored Dividing processing is carried out, generates at least one data item corresponding with data described in each bar；According to the list of fields, the data Storehouse table, database expression is spliced into by each data item；Connected using the database, by the database expression It is committed to the relationship by objective (RBO) database.
- 9. a kind of computer-readable recording medium, it is characterised in that including execute instruction, refer to when the processor of storage control performs the execution When making, the storage control perform claim requires any method in 1-4.
- A kind of 10. storage control, it is characterised in that including：Processor, memory and bus；The memory is used to store execute instruction, and the processor is connected with the memory by the bus, when described When storage control is run, the processor performs the execute instruction of the memory storage, so that the storage control Device perform claim requires any method in 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711292038.0A CN108038182A (en) | 2017-12-08 | 2017-12-08 | A kind of method and apparatus of the relation data library storage data based on Flume |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711292038.0A CN108038182A (en) | 2017-12-08 | 2017-12-08 | A kind of method and apparatus of the relation data library storage data based on Flume |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108038182A true CN108038182A (en) | 2018-05-15 |
Family
ID=62101521
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711292038.0A Pending CN108038182A (en) | 2017-12-08 | 2017-12-08 | A kind of method and apparatus of the relation data library storage data based on Flume |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108038182A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109189346A (en) * | 2018-09-20 | 2019-01-11 | 郑州云海信息技术有限公司 | A kind of data processing method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095991A (en) * | 2016-06-21 | 2016-11-09 | 南京大学 | A kind of automatically generate from relevant database to the method for the code of MongoDB database data migration |
| CN106452819A (en) * | 2015-08-13 | 2017-02-22 | 腾讯科技（深圳）有限公司 | Data acquisition system and data acquisition method |
| CN106483860A (en) * | 2015-09-02 | 2017-03-08 | 上海宝信软件股份有限公司 | Automatic data collection middleware and its using method for PLC |
| CN106599197A (en) * | 2016-12-14 | 2017-04-26 | 深圳天源迪科信息技术股份有限公司 | Data acquisition and exchange engine |
| CN106611046A (en) * | 2016-12-16 | 2017-05-03 | 武汉中地数码科技有限公司 | Big data technology-based space data storage processing middleware framework |
-
2017
- 2017-12-08 CN CN201711292038.0A patent/CN108038182A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106452819A (en) * | 2015-08-13 | 2017-02-22 | 腾讯科技（深圳）有限公司 | Data acquisition system and data acquisition method |
| CN106483860A (en) * | 2015-09-02 | 2017-03-08 | 上海宝信软件股份有限公司 | Automatic data collection middleware and its using method for PLC |
| CN106095991A (en) * | 2016-06-21 | 2016-11-09 | 南京大学 | A kind of automatically generate from relevant database to the method for the code of MongoDB database data migration |
| CN106599197A (en) * | 2016-12-14 | 2017-04-26 | 深圳天源迪科信息技术股份有限公司 | Data acquisition and exchange engine |
| CN106611046A (en) * | 2016-12-16 | 2017-05-03 | 武汉中地数码科技有限公司 | Big data technology-based space data storage processing middleware framework |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109189346A (en) * | 2018-09-20 | 2019-01-11 | 郑州云海信息技术有限公司 | A kind of data processing method and device |
| CN109189346B (en) * | 2018-09-20 | 2021-08-10 | 郑州云海信息技术有限公司 | Data processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105701098B (en) | The method and apparatus for generating index for the table in database | |
| CN105160023B (en) | Graphics data inquiry processing method based on Cloud Server | |
| US9069818B2 (en) | Textual search for numerical properties | |
| CN105630803B (en) | The method and apparatus that Document image analysis establishes index | |
| WO2008066637A2 (en) | Generation of a multidimensional dataset from an associative database | |
| CN102270225A (en) | Data change log monitoring method and device | |
| CN104361018A (en) | Method and device for reorganizing electronic file information | |
| CN106055621A (en) | Log retrieval method and device | |
| US20200201844A1 (en) | Cluster-based random walk processing | |
| CN102117446A (en) | Method and system for deploying jobs attribute | |
| CN104268295A (en) | Data query method and device | |
| US11853279B2 (en) | Data storage using vectors of vectors | |
| CN106156070A (en) | A kind of querying method, Piece file mergence method and relevant apparatus | |
| CN106934591A (en) | Workflow flow path extracting method and system | |
| CN105144155A (en) | Visually representing queries of multi-source data | |
| CN104536908B (en) | A kind of magnanimity small records efficient storage management method towards unit | |
| CN108062399A (en) | Data processing method and device | |
| CN102932416B (en) | A kind of intermediate data storage method of information flow task, processing method and device | |
| US7725439B2 (en) | Handling column renaming as part of schema evolution in a data archiving tool | |
| CN110457398A (en) | Block data storage method and device | |
| CN114119068A (en) | Intelligent analysis method and management platform for pharmacy enterprise WeChat customer group | |
| CN108038182A (en) | A kind of method and apparatus of the relation data library storage data based on Flume | |
| CN106649800A (en) | Solr-based Chinese search method | |
| CN109344169A (en) | Data processing method and device | |
| US20170228449A1 (en) | Frequency Dependent Partial Index |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180515 |
|
| RJ01 | Rejection of invention patent application after publication |