CN101980190A - Method and device for quickly putting service data into base - Google Patents
Method and device for quickly putting service data into base Download PDFInfo
- Publication number
- CN101980190A CN101980190A CN2010105100506A CN201010510050A CN101980190A CN 101980190 A CN101980190 A CN 101980190A CN 2010105100506 A CN2010105100506 A CN 2010105100506A CN 201010510050 A CN201010510050 A CN 201010510050A CN 101980190 A CN101980190 A CN 101980190A
- Authority
- CN
- China
- Prior art keywords
- data
- data object
- collective
- data type
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and a device for quickly putting service data into a base. The method comprises that: according to a service data type, a basic data type object generating module generates a basic data type object containing the service data type; according to the structure of a database table for storing the service data, a set data object generating module generates a set data object, the set element type of which is the basic data type object; and a general service data base-putting interface module binds the corresponding values of the set data object or all basic data type objects of the data object set with the field of the database table and puts the data into the base. The method and the device can realize base putting of various service data, and has the advantages of high base-putting speed and high efficiency.
Description
Technical field
The present invention relates to computer realm, quick storage method of particularly a kind of business datum and device.
Background technology
There is a large amount of business datums need be stored in database in the transmission network management system, for example time slot, alarm, performance or the like, the data volume of these business datums is very big, if can not in time import database, will bring loss of data, takies disk space, influence problems such as efficiency of network management.
At present, the method for fast data storage has following two kinds:
1, (Structured Query Language, SQL) statement mainly are to insert the Insert statement to the structural texture query language, optimize these statements then, make fast data storage;
2, the quick warehousing interface warehouse-in that directly uses data base management system (DBMS) to carry.
Above-mentioned first method, when putting in storage by SQL statement such as Insert, data base management system (DBMS) needs log, even optimize statement, can not well improve warehouse-in efficiency, therefore, only is applicable to the situation that the business datum amount is less.For transmission network management system, the alarm data of every day may reach millions of, and performance data may reach several ten million bars, if adopt first method, a large amount of business datums can make the warehouse-in of business datum very consuming time, becomes the bottleneck of system.
Above-mentioned second method, warehousing interface needs and deposits the field binding of the database table of business datum fast, different business datums leaves in the different tables, therefore, for the quick warehousing interface of using data base management system (DBMS) to carry business datum is put in storage fast, the miscellaneous service module need be write corresponding code separately, and these interfaces use more complicated, make mistakes easily, like this, business module is encoded separately and is had the low and high problem of complexity of code efficiency.
In sum, first method can have a strong impact on the webmaster operational efficiency when the business datum amount is big, and the second method code efficiency is low, and makes mistakes easily, therefore, is necessary to provide a kind of general technology that can both put in storage fast at the miscellaneous service data.
Summary of the invention
The object of the present invention is to provide a kind of business datum method and apparatus of warehouse-in fast, can solve the low problem of business datum warehouse-in efficiency better.
According to an aspect of the present invention, a kind of business datum that the provides method of warehouse-in fast comprises:
A) according to traffic data type, basic data type object generation module generates a basic data type object that comprises all traffic data type;
B) according to the structure of depositing the database table of business datum, collective data object generation module generates the collective data object that its set element type is the basic data type object;
C) general-purpose service data warehousing interface module is with field binding and the warehouse-in of the corresponding value of all basic data type objects of collective data object or collective data object set with database table.
According to another aspect of the present invention, a kind of business datum that the provides device of warehouse-in fast comprises:
Basic data type object generation module is used to generate a basic data type object that comprises all traffic data type;
Collective data object generation module is used to generate its set element type the collective data object that is the basic data type object;
General-purpose service data warehousing interface module is used for field binding and warehouse-in with corresponding value of all basic data type objects of collective data object or collective data object set and database table.
Described device also comprises:
Table data object generation module is used to generate its set element type the table data object that is the collective data object, a record of described collective data object correspondence database table.
Compared with prior art, beneficial effect of the present invention is: the present invention has realized the warehouse-in of miscellaneous service data, has the advantage that storage is fast, efficient is high.
Description of drawings
Fig. 1 is the quick storage method process flow diagram of a kind of business datum provided by the invention;
Fig. 2 is the quick loading device structural representation of a kind of business datum that the embodiment of the invention provides;
Fig. 3 is the quick storage method process flow diagram of a kind of business datum that the embodiment of the invention provides.
Embodiment
, should be appreciated that following illustrated preferred embodiment only is used for description and interpretation the present invention, and be not used in qualification the present invention a preferred embodiment of the present invention will be described in detail below in conjunction with accompanying drawing.
Fig. 1 has shown the quick storage method process flow diagram of a kind of business datum provided by the invention, and as shown in Figure 1, step comprises:
Step 101: according to traffic data type, basic data type object generation module generates a basic data type object that comprises all traffic data type;
Step 102: according to the structure of the database table of depositing business datum, collective data object generation module generates the collective data object that its set element type is the basic data type object, a record of described collective data object correspondence database table;
Step 103: general-purpose service data warehousing interface module is with field binding and the warehouse-in of the corresponding value of all basic data type objects of collective data object or collective data object set with database table.
In the above-mentioned steps 102, the value of each set element of depositing in the described collective data object is the value that is stored in each field of database table, the sequence consensus of order and the field of database table.
Above-mentioned steps 103 comprises:
Collective data object or collective data object set are passed to described general-purpose service data warehousing interface module;
According to the information of the database table of depositing business datum, each field of ergodic data storehouse table is worth accordingly according to the position of field and all basic data type objects of field type taking-up collective data object or collective data object set;
In internal memory, described field and described basic data type object are worth binding accordingly;
Call the quick warehousing interface of data base management system (DBMS) with the disposable warehouse-in of the business datum of all bindings.
Fig. 2 has shown the quick loading device structural representation of a kind of business datum that the embodiment of the invention provides, and as shown in Figure 2, described device comprises:
Basic data type object generation module 21 is used for according to traffic data type, generates a basic data type object that comprises all traffic data type;
Collective data object generation module 22 is used for generating a collective data object that its set element type is the basic data type object according to the structure of depositing the database table of business datum;
Table data object generation module 23 is used to generate its set element type the table data object that is the collective data object, described table data object correspondence database table.
General-purpose service data warehousing interface module 24 is used for the corresponding value of all basic data type objects of collective data object or table data object and the field binding and the warehouse-in of database table.
Described general-purpose service data warehousing interface module 24 comprises:
Warehouse-in unit 242 is used to call the quick warehousing interface of data base management system (DBMS) with the disposable warehouse-in of the business datum of all bindings.
In the present embodiment, the basic data type object that above-mentioned basic data type object generation module 21 generates comprises int type and string type;
A record of the collective data object correspondence database table that above-mentioned collective data object generation module 22 generates;
The table data object correspondence database table that above-mentioned table data object generation module 23 generates.
The principle of work of described device is:
When business datum need be put in storage, described basic data type object generation module 21 generates the basic data type object that comprises int type and string type, described collective data object generation module 22 generates the collective data object that its set element type is the basic data type object, and described table data object generation module 23 generates the table data object that its set element type is the collective data object.Field according to the database table of depositing business datum, each business datum assignment is given the data item of corresponding int type and string type, and be inserted into collective data object back successively, after set element assignment in every collective data object is finished, the collective data object is inserted into table data object back, and collective data object or table data object and the information of depositing the database table of business datum are passed in the described binding unit 241 in the described general-purpose service data warehousing interface module 24.Described binding unit 241 is bound with each field of depositing the database table of business datum the corresponding value of all basic data type objects of collective data object or table data object in internal memory, and calls the quick warehousing interface of data base management system (DBMS) with the disposable warehouse-in of the business datum of all bindings by warehouse-in unit 242.
Fig. 3 has shown the quick storage method process flow diagram of a kind of business datum that the embodiment of the invention provides, and as shown in Figure 3, may further comprise the steps:
Step 301:, generate a basic data type object BcpField who comprises all basic data types according to traffic data type;
Step 302: according to the structure of the database table of depositing business datum, the collective data object B cpRecord that to generate its set element type be basic data type object BcpField;
Step 303: the table data object BcpTable that to generate its set element type be collective data object B cpRecord;
Step 304: in the corresponding data item of basic data type object BcpField under the collective data object B cpRecord of business datum assignment in the table data object BcpTable;
Step 305: will deposit the database table information of business datum and the general-purpose service data warehousing interface module that table data object BcpTable is passed to;
Step 306: in described general-purpose service data interface module, each basic data type object BcpField under each collective data object B cpRecord of traversal list data object BcpTable, and with each field the one by one binding in internal memory of the corresponding value of each basic data type object BcpField with database table;
Step 307: after all data are all bound, call quick warehousing interface that data base management system (DBMS) carries with the disposable warehouse-in of business datum.
In the above-mentioned steps 301, the basic data type object comprises int type and string type, the corresponding value of described basic data type object BcpField is the value that business datum is stored in each field of database table, and order is consistent with the order of the field of database table;
In the above-mentioned steps 302, described collective data object B cpRecord is corresponding with a record of database table;
In the above-mentioned steps 303, described table data object BcpTable is corresponding with the database table of depositing business datum.
The present invention puts in storage by the mode of constructing SQL statement, can realize the quick warehouse-in of miscellaneous service data, for example performance data warehouse-in can be brought up to per second from per second hundreds of bar and surpasses more than 10,000, avoided simultaneously each business module for the quick warehousing interface of using data base management system (DBMS) and carrying low, the complicated problems of code efficiency that causes of coding separately.
In sum, quick storage method of business datum of the present invention and device have greatly improved the warehouse-in efficiency and the code efficiency of business datum.
Although above the present invention is had been described in detail, the invention is not restricted to this, those skilled in the art of the present technique can carry out various modifications according to principle of the present invention.Therefore, all modifications of doing according to the principle of the invention all should be understood to fall into protection scope of the present invention.
Claims (8)
1. the method that business datum is put in storage fast is characterized in that, comprising:
A) according to traffic data type, basic data type object generation module generates a basic data type object that comprises all traffic data type;
B) according to the structure of depositing the database table of business datum, collective data object generation module generates the collective data object that its set element type is the basic data type object;
C) general-purpose service data warehousing interface module is with field binding and the warehouse-in of the corresponding value of all basic data type objects of collective data object or collective data object set with database table.
2. method according to claim 1 is characterized in that, described steps A) in, described basic data type object comprises the basic data type of all traffic data type.
3. method according to claim 1 is characterized in that, described step B) in, described collective data object is the set of basic data type object, a record of correspondence database.
4. method according to claim 1 is characterized in that, described step C) be specially:
Collective data object or collective data object set are passed to described general-purpose service data warehousing interface module;
According to the information of the database table of depositing business datum, travel through each field, and be worth accordingly according to all basic data type objects of field location and field type taking-up collective data object or collective data object set;
In internal memory, described field and described basic data type object are worth binding accordingly;
Call the quick warehousing interface of data base management system (DBMS) with the disposable warehouse-in of the business datum of all bindings.
5. method according to claim 4 is characterized in that, described step C) in, described collective data object set is a table data object of the correspondence database table of depositing business datum.
6. the device that business datum is put in storage fast is characterized in that, comprising:
Basic data type object generation module is used to generate a basic data type object that comprises all traffic data type;
Collective data object generation module is used to generate its set element type the collective data object that is the basic data type object;
General-purpose service data warehousing interface module is used for field binding and warehouse-in with corresponding value of all basic data type objects of collective data object or collective data object set and database table.
7. device according to claim 6 is characterized in that, described device also comprises:
Table data object generation module is used to generate its set element type the table data object that is the collective data object, a record of described collective data object correspondence database table.
8. according to claim 6 or 7 described devices, it is characterized in that described general-purpose service data warehousing interface module comprises:
The binding unit is used for the corresponding value of all basic data type objects of collective data object or table data object and each field binding of the database table of depositing business datum;
The warehouse-in unit is used to call the quick warehousing interface of data base management system (DBMS) with the disposable warehouse-in of the business datum of all bindings.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105100506A CN101980190A (en) | 2010-10-15 | 2010-10-15 | Method and device for quickly putting service data into base |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105100506A CN101980190A (en) | 2010-10-15 | 2010-10-15 | Method and device for quickly putting service data into base |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101980190A true CN101980190A (en) | 2011-02-23 |
Family
ID=43600692
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010105100506A Pending CN101980190A (en) | 2010-10-15 | 2010-10-15 | Method and device for quickly putting service data into base |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101980190A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104572456A (en) * | 2014-12-30 | 2015-04-29 | 北京锐安科技有限公司 | Data collection method and device |
| CN104699718A (en) * | 2013-12-10 | 2015-06-10 | 阿里巴巴集团控股有限公司 | Method and device for rapidly introducing business data |
| CN109144950A (en) * | 2018-07-20 | 2019-01-04 | 中国邮政储蓄银行股份有限公司 | The storage method and device of business datum |
| CN111008232A (en) * | 2019-11-23 | 2020-04-14 | 杭州米络星科技(集团)有限公司 | Business data storage method |
| CN114490672A (en) * | 2022-04-06 | 2022-05-13 | 成都九洲电子信息系统股份有限公司 | Table data input processing method and device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101170433A (en) * | 2006-10-25 | 2008-04-30 | 中兴通讯股份有限公司 | Database storage method |
| CN101321089A (en) * | 2008-07-07 | 2008-12-10 | 中兴通讯股份有限公司 | Warehouse entry method of performance data in telecommunication network management system |
| CN101719168A (en) * | 2010-01-25 | 2010-06-02 | 浪潮通信信息系统有限公司 | Algorithm configurability-based universal data loading method |
| CN101789021A (en) * | 2010-02-24 | 2010-07-28 | 浪潮通信信息系统有限公司 | Universal configurable database data migration method |
-
2010
- 2010-10-15 CN CN2010105100506A patent/CN101980190A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101170433A (en) * | 2006-10-25 | 2008-04-30 | 中兴通讯股份有限公司 | Database storage method |
| CN101321089A (en) * | 2008-07-07 | 2008-12-10 | 中兴通讯股份有限公司 | Warehouse entry method of performance data in telecommunication network management system |
| CN101719168A (en) * | 2010-01-25 | 2010-06-02 | 浪潮通信信息系统有限公司 | Algorithm configurability-based universal data loading method |
| CN101789021A (en) * | 2010-02-24 | 2010-07-28 | 浪潮通信信息系统有限公司 | Universal configurable database data migration method |
Non-Patent Citations (1)
| Title |
|---|
| 肖波: "主流web数据库开发技术研究", 《中国优秀硕士学位论文全文数据库，信息科技辑》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104699718A (en) * | 2013-12-10 | 2015-06-10 | 阿里巴巴集团控股有限公司 | Method and device for rapidly introducing business data |
| CN104699718B (en) * | 2013-12-10 | 2019-04-12 | 阿里巴巴集团控股有限公司 | Method and apparatus for being rapidly introduced into business datum |
| CN104572456A (en) * | 2014-12-30 | 2015-04-29 | 北京锐安科技有限公司 | Data collection method and device |
| CN104572456B (en) * | 2014-12-30 | 2018-10-12 | 北京锐安科技有限公司 | Collecting method and device |
| CN109144950A (en) * | 2018-07-20 | 2019-01-04 | 中国邮政储蓄银行股份有限公司 | The storage method and device of business datum |
| CN109144950B (en) * | 2018-07-20 | 2022-02-15 | 中国邮政储蓄银行股份有限公司 | Service data storage method and device |
| CN111008232A (en) * | 2019-11-23 | 2020-04-14 | 杭州米络星科技(集团)有限公司 | Business data storage method |
| CN114490672A (en) * | 2022-04-06 | 2022-05-13 | 成都九洲电子信息系统股份有限公司 | Table data input processing method and device and storage medium |
| CN114490672B (en) * | 2022-04-06 | 2022-06-21 | 成都九洲电子信息系统股份有限公司 | Table data input processing method and device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102867071B (en) | Management method for massive network management historical data | |
| CN106897322B (en) | A kind of access method and device of database and file system | |
| CN102725753B (en) | Method and apparatus for optimizing data access, method and apparatus for optimizing data storage | |
| CN101739453B (en) | Method and device for carrying out condition query on database table | |
| CN107807982B (en) | Consistency checking method and device for heterogeneous database | |
| CN101651576B (en) | Alarm information processing method and system | |
| CN102236672A (en) | Method and device for importing data | |
| CN104899295B (en) | A kind of heterogeneous data source data relation analysis method | |
| CN103902698A (en) | Data storage system and data storage method | |
| WO2015109250A1 (en) | CREATING NoSQL DATABASE INDEX FOR SEMI-STRUCTURED DATA | |
| CN103902702A (en) | Data storage system and data storage method | |
| CN103164323A (en) | Data automatic generation method and data automatic generation system | |
| CN103309904A (en) | Method and device for generating data warehouse ETL (Extraction, Transformation and Loading) codes | |
| CN101866350A (en) | Report generation method and device as well as WEB server | |
| CN101980190A (en) | Method and device for quickly putting service data into base | |
| WO2014058711A1 (en) | Creation of inverted index system, and data processing method and apparatus | |
| CN101710320A (en) | Statistical index data processing method and device | |
| CN103902701A (en) | Data storage system and data storage method | |
| CN104298736A (en) | Method and device for aggregating and connecting data as well as database system | |
| CN102779138A (en) | Hard disk access method of real time data | |
| CN103077192B (en) | A kind of data processing method and system thereof | |
| CN104317957A (en) | Open platform and system for processing reports and report processing method | |
| CN110471754A (en) | Method for exhibiting data, device, equipment and storage medium in job scheduling | |
| CN102467525A (en) | Document associating method and system | |
| CN111414362A (en) | Data reading method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20110223 |