CN105045816A - Access method and system for mass data - Google Patents

Access method and system for mass data Download PDF

Info

Publication number
CN105045816A
CN105045816A CN201510359672.6A CN201510359672A CN105045816A CN 105045816 A CN105045816 A CN 105045816A CN 201510359672 A CN201510359672 A CN 201510359672A CN 105045816 A CN105045816 A CN 105045816A
Authority
CN
China
Prior art keywords
storehouse
data
rule
mass data
routing rule
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510359672.6A
Other languages
Chinese (zh)
Inventor
邱光明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Feixun Data Communication Technology Co Ltd
Original Assignee
Shanghai Feixun Data Communication Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Feixun Data Communication Technology Co Ltd filed Critical Shanghai Feixun Data Communication Technology Co Ltd
Priority to CN201510359672.6A priority Critical patent/CN105045816A/en
Publication of CN105045816A publication Critical patent/CN105045816A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures

Abstract

The present invention provide an access method and system for mass data. The access method for mass data comprises the following steps of: setting a data routing rule; and according to the routing rule, splitting storage of the mass data stored in a database. The present invention can realize storage separated for reading and for writing and storage in different databases and tables, is more complete functions, is simpler in use and easy to extend with no need to plan a data size in advance, making secondary development much easier and the cost lower.

Description

A kind of access method of mass data and system
Technical field
The invention belongs to field of computer technology, relate to a kind of access method of database, particularly relate to a kind of access method and system of mass data.
Background technology
Along with extensively popularizing of internet, applications, the storage of mass data and access become the bottleneck problem of system.For a large-scale internet, applications, the PV (pageview, page browsing amount) of every day tens causes quite high load to database undoubtedly, causes great problem to the stability of system and extendability.The storage of big data quantity needs a large amount of database resources.The continuous growth of data volume requires that database purchase has extensibility, and when ensureing big data quantity, also wants the quality requirements such as guaranteed performance, high availability.
Improve web site performance by data cutting, data Layer extending transversely has become the mode of framework research staff first-selection.Horizontal cutting divided data storehouse, can reduce the load of single machine, reduces the loss that the machine of delaying causes to greatest extent simultaneously.By load balancing, effectively reduce the access load of single machine, reduce the possibility of the machine of delaying; By group scheme, solve the problem that one point data storehouse that the database machine of delaying brings can not be accessed; The speed and concurrency that read (Read) data in application is improve especially to greatest extent by read and write abruption strategy.
Existing scheme has:
1) commercial version database Sharding:MySQLProxy, provides MySQL protocol interface (non-JDBC), host-guest architecture, can load balance, read and write abruption, and failover etc., lua grammer is complicated, does not support point storehouse submeter of big data quantity.
2) Amoeba: support divided data storehouse example, the table that each data are identical, does not support affairs; Similar MySQLProxy, lua is abandoned in design, more simply.
3) CobarClient of research institute of Ali group exploitation, mainly towards small-scale database sharding cluster access, based on ibatis, needs layout data scale, lacks extendability; Have Cobar in addition, a complete DAL layer of Ali's group internal, realizes complete JDBC and acts on behalf of.
4) sharding that provides of HibernateShards, Hibernate, support divided data storehouse example, more complicated, advance planning data scale, and framework is not inconsistent.
5) guzz, many storehouses (virtual database, the routing rule of actual database is still self-defined), table are cut, read and write abruption, and distributed transaction support transparent between multiple stage database, and design object supports large-scale online production application; Ibatis need be replaced completely; Complete and framework is not inconsistent.
6) TDDL, the DAL of Taobao, very strong point storehouse submeter ability, still need data volume to realize planning, dynamic expansion is limited.
Prior art or certain function point can only be realized, or use complicated, not easily expand.That is, the storage problem of big data quantity is not thoroughly solved in available frame.
Summary of the invention
The shortcoming of prior art in view of the above, the object of the present invention is to provide a kind of access method and system of mass data, and the storage mode for solving existing mass data uses complicated, not easily expands, the problem that cost is high.
For achieving the above object and other relevant objects, the invention provides a kind of access method of mass data, the access method of described mass data comprises the following steps: setting data routing rule; Carry out fractionation according to described routing rule to the mass data stored in database to store.
Alternatively, when described data routing rule is read and write abruption, then according to legacy data storehouse split copy one write storehouse and one read storehouse.
Alternatively, when described data routing rule is that when dividing storehouse submeter, then select at least 1 table to split in legacy data storehouse, will be copied N number of storehouse by the table selected, each storehouse splits out M and opens table, and record splits rear routing rule accordingly; N and M be more than or equal to 1 positive integer.
Alternatively, described data routing rule comprises rule name, data true address, true library name, true table name, record open numbering, end of record (EOR) numbering, record start time and end of record (EOR) time.
Alternatively, the access method of described mass data also comprises: utilize general database connection method and the direct calling interface of method of operating, operates or/and inquire about splitting the data after storing according to described data routing rule.
The present invention also provides a kind of access system of mass data, and the access system of described mass data comprises: rule arranges module, setting data routing rule; Split memory module, module is set with described rule and is connected, according to described routing rule, fractionation is carried out to the mass data stored in database and store.
Alternatively, the access system of described mass data also comprises: read module, being connected with described fractionation memory module, utilizing general database connection method and the direct calling interface of method of operating, operating or/and inquire about splitting the data after storing according to described data routing rule.
Alternatively, described rule arranges module and comprises: read and write abruption rule setting unit, with the routing rule of the mode setting data of read and write abruption; Divide storehouse submeter rule setting unit, with the routing rule of the mode setting data of point storehouse submeter.
Alternatively, described fractionation memory module comprises: read storehouse copied cells, is connected, copies one read storehouse according to the fractionation of legacy data storehouse with described read and write abruption rule setting unit; Write storehouse copied cells, be connected with described read and write abruption rule setting unit, copy one according to the fractionation of legacy data storehouse and write storehouse.
Alternatively, described fractionation memory module also comprises: point storehouse copied cells, is connected, selects at least 1 table to split, copy N number of storehouse by by the table selected in legacy data storehouse with described point of storehouse submeter rule setting unit; N be more than or equal to 1 positive integer; Submeter copied cells, is connected with described point of storehouse copied cells, each storehouse is split out M and opens table; M be more than or equal to 1 positive integer; Routing rule record cell, is connected with submeter copied cells respectively with described point of storehouse copied cells, corresponding point storehouse submeter routing rule after record splits.
As mentioned above, the access method of mass data of the present invention and system, have following beneficial effect:
The present invention can realize read-write separating and store, and also can realize a point storehouse and divide tabular form to store, functionally more complete, more simple in use, and easily expands, and does not more need advance planning data scale, be easy to do secondary development, and cost is low.
Accompanying drawing explanation
Fig. 1 a is shown as a kind of realization flow schematic diagram of the access method of the mass data described in the embodiment of the present invention.
Fig. 1 b is shown as the another kind of realization flow schematic diagram of the access method of the mass data described in the embodiment of the present invention.
Fig. 2 is shown as another realization flow schematic diagram of the access method of the mass data described in the embodiment of the present invention.
The one that Fig. 3 is shown as the access system of the mass data described in the embodiment of the present invention realizes structural representation.
The one that the rule that Fig. 4 is shown as the access system of the mass data described in the embodiment of the present invention arranges module realizes structural representation.
The one that Fig. 5 is shown as the fractionation memory module of the access system of the mass data described in the embodiment of the present invention realizes structural representation.
Element numbers explanation
The access system of 100 mass data
110 rules arrange module
111 read and write abruption rule setting units
112 points of storehouse submeter rule setting units
120 split memory module
121 read storehouse copied cells
122 write storehouse copied cells
123 points of storehouse copied cellses
124 submeter copied cellses
125 routing rule record cells
130 read modules
S1 ~ S3 step
S21 ~ S22 step
Embodiment
Below by way of specific instantiation, embodiments of the present invention are described, those skilled in the art the content disclosed by this instructions can understand other advantages of the present invention and effect easily.The present invention can also be implemented or be applied by embodiments different in addition, and the every details in this instructions also can based on different viewpoints and application, carries out various modification or change not deviating under spirit of the present invention.It should be noted that, when not conflicting, the feature in following examples and embodiment can combine mutually.
It should be noted that, the diagram provided in following examples only illustrates basic conception of the present invention in a schematic way, then only the assembly relevant with the present invention is shown in graphic but not component count, shape and size when implementing according to reality is drawn, it is actual when implementing, and the kenel of each assembly, quantity and ratio can be a kind of change arbitrarily, and its assembly layout kenel also may be more complicated.
Refer to shown in Fig. 1 a and Fig. 1 b, the invention provides a kind of access method of mass data, the access method of described mass data comprises the following steps:
S1, setting data routing rule.Described data routing rule comprises rule name, data true address, true library name, true table name, record open numbering, end of record (EOR) numbering, record start time and end of record (EOR) time.
S2, carries out fractionation according to described routing rule to the mass data stored in database and stores.Or
S3, utilizes general database connection method and the direct calling interface of method of operating, operates or/and inquire about splitting the data after storing according to described data routing rule.
Further, shown in Figure 2, a kind of implementation procedure of the access method of described mass data is:
S21, when described data routing rule is read and write abruption, then according to legacy data storehouse split copy one write storehouse and one read storehouse.
S22, when described data routing rule is that when dividing storehouse submeter, then select at least 1 table to split in legacy data storehouse, will be copied N number of storehouse by the table selected, each storehouse splits out M and opens table, and record splits rear routing rule accordingly; N and M be more than or equal to 1 positive integer.The present invention can by Data distribution8 on different database (DB) servers by a series of segmentation rules (i.e. routing rule), specific database is accessed by routing rule route, what so each access plane was right has been not just separate unit database server, but N platform database server, so just can reduce the load pressure of single machine.The present invention is also by a series of segmentation rules, by Data distribution8 in the difference table of a database, such as article is divided into article_001, the sublists such as article_002, the horizontal split of several sublists constitutes again a complete article table in logic, and the object done so is also very simple in fact.To give an example explanation, 5000w bar data are had now in such as article table, now need to increase the new data of (insert) in this table, after insert, database can re-establish index for this table, and the capable data of 5000w set up that the system overhead of index still can not be ignored.But conversely, if this table is divided into 100 sublists, from article_001 until article_100,5000w is capable, and data are on average got off, 500,000 row data are just only had inside each sublist, the time of setting up index after at this moment only having the middle insertion of the table of the capable data of 50w (table) (insert) new data to one will be the decline of the order of magnitude, drastically increase the operational efficiency of database (DB), also improve the concurrency of database (DB).The benefit of certain submeter also more than these, also have the latching operation etc. of such as write operation, all can bring much obvious benefit.
In sum, point storehouse reduces the load of single-point machine.Submeter improves the efficiency of data manipulation, especially writes the efficiency that (Write) operates.
The protection domain of the access method of mass data of the present invention is not limited to the step execution sequence that the present embodiment is enumerated, and the step increase and decrease of the prior art that every principle according to the present invention is done, step are replaced the scheme realized and be all included in protection scope of the present invention.
The present invention also provides a kind of access system of mass data; the access system of described mass data can realize the access method of mass data of the present invention; but the implement device of the access method of mass data of the present invention includes but not limited to the structure of the access system of the mass data that the present embodiment is enumerated; the malformation of the prior art that every principle according to the present invention is done and replacement, be all included in protection scope of the present invention.
Shown in Figure 3, the access system 100 of described mass data comprises: rule arranges module 110, splits memory module 120, or read module 130.
Described rule arranges module 110 setting data routing rule.
Further, shown in Figure 4, described rule arranges module 110 and comprises: read and write abruption rule setting unit 111, point storehouse submeter rule setting unit 112.Described read and write abruption rule setting unit 111 is with the routing rule of the mode setting data of read and write abruption.Described point of storehouse submeter rule setting unit 112 is with the routing rule of the mode setting data of point storehouse submeter.
Described fractionation memory module 120 and described rule arrange module 110 and are connected, and carry out fractionation store according to described routing rule to the mass data stored in database.
Further, shown in Figure 5, described fractionation memory module 120 comprises: read storehouse copied cells 121, writes storehouse copied cells 122, point storehouse copied cells 123, submeter copied cells 124, routing rule record cell 125.
Described storehouse copied cells 121 of reading is connected with described read and write abruption rule setting unit 111, copies one read storehouse according to the fractionation of legacy data storehouse.
Described storehouse copied cells 122 of writing is connected with described read and write abruption rule setting unit 111, copies one write storehouse according to the fractionation of legacy data storehouse.
Described point of storehouse copied cells 123 is connected with described point of storehouse submeter rule setting unit 112, selects at least 1 table to split, copy N number of storehouse by by the table selected in legacy data storehouse; N be more than or equal to 1 positive integer.The present invention can by Data distribution8 on different database (DB) servers by a series of segmentation rules (i.e. routing rule), specific database is accessed by routing rule route, what so each access plane was right has been not just separate unit database server, but N platform database server, so just can reduce the load pressure of single machine.
Described submeter copied cells 124 is connected with described point of storehouse copied cells 112, each storehouse is split out M and opens table; M be more than or equal to 1 positive integer.The present invention is also by a series of segmentation rules, by Data distribution8 in the difference table of a database, such as article is divided into article_001, the sublists such as article_002, the horizontal split of several sublists constitutes again a complete article table in logic, and the object done so is also very simple in fact.To give an example explanation, 5000w bar data are had now in such as article table, now need to increase the new data of (insert) in this table, after insert, database can re-establish index for this table, and the capable data of 5000w set up that the system overhead of index still can not be ignored.But conversely, if this table is divided into 100 sublists, from article_001 until article_100,5000w is capable, and data are on average got off, 500,000 row data are just only had inside each sublist, the time of setting up index after at this moment only having the middle insertion of the table of the capable data of 50w (table) (insert) new data to one will be the decline of the order of magnitude, drastically increase the operational efficiency of database (DB), also improve the concurrency of database (DB).The benefit of certain submeter also more than these, also have the latching operation etc. of such as write operation, all can bring much obvious benefit.In sum, point storehouse reduces the load of single-point machine.Submeter improves the efficiency of data manipulation, especially writes the efficiency that (Write) operates.
Described routing rule record cell 125 is connected with submeter copied cells 124 respectively with described point of storehouse copied cells 123, corresponding point storehouse submeter routing rule after record splits.
Described read module 130 is connected with described fractionation memory module 120, utilizes general database connection method and the direct calling interface of method of operating, operates or/and inquire about splitting the data after storing according to described data routing rule.
The protection domain of the access system of mass data of the present invention is not limited to the module connection structure that the present embodiment is enumerated, and the module increase and decrease of the prior art that every principle according to the present invention is done, module are replaced or functions of modules shifts the scheme realized and is all included in protection scope of the present invention.
The present invention can realize utilizing toll free database MySQL to store mass data, and does not affect the access performance of data.By a series of segmentation rules (i.e. routing rule) by mass data horizontal distribution in different DB (database) or table (table), concrete DB or Table needing inquiry is found again, to carry out inquiring about (Query) operation by corresponding DB route or Table routing rule.
The present invention can realize read-write separating and store, and also can realize a point storehouse and divide tabular form to store, functionally more complete, more simple in use, and easily expands, and does not more need advance planning data scale, be easy to do secondary development, and cost is low.
In sum, the present invention effectively overcomes various shortcoming of the prior art and tool high industrial utilization.
Above-described embodiment is illustrative principle of the present invention and effect thereof only, but not for limiting the present invention.Any person skilled in the art scholar all without prejudice under spirit of the present invention and category, can modify above-described embodiment or changes.Therefore, such as have in art usually know the knowledgeable do not depart from complete under disclosed spirit and technological thought all equivalence modify or change, must be contained by claim of the present invention.

Claims (10)

1. an access method for mass data, is characterized in that, the access method of described mass data comprises the following steps:
Setting data routing rule;
Carry out fractionation according to described routing rule to the mass data stored in database to store.
2. the access method of mass data according to claim 1, is characterized in that: when described data routing rule is read and write abruption, then according to legacy data storehouse split copy one write storehouse and one read storehouse.
3. the access method of mass data according to claim 1, it is characterized in that: when described data routing rule is for point storehouse submeter, in legacy data storehouse, then select at least 1 table to split, N number of storehouse is copied by by the table selected, each storehouse splits out M and opens table, and record splits rear corresponding routing rule; N and M be more than or equal to 1 positive integer.
4. the access method of mass data according to claim 1, is characterized in that: described data routing rule comprises rule name, data true address, true library name, true table name, record open numbering, end of record (EOR) numbering, record start time and end of record (EOR) time.
5. the access method of the mass data according to Claims 2 or 3, is characterized in that, the access method of described mass data also comprises:
Utilizing general database connection method and the direct calling interface of method of operating, operating or/and inquire about splitting the data after storing according to described data routing rule.
6. an access system for mass data, is characterized in that, the access system of described mass data comprises:
Rule arranges module, setting data routing rule;
Split memory module, module is set with described rule and is connected, according to described routing rule, fractionation is carried out to the mass data stored in database and store.
7. the access system of mass data according to claim 6, is characterized in that, the access system of described mass data also comprises:
Read module, is connected with described fractionation memory module, utilizes general database connection method and the direct calling interface of method of operating, operates or/and inquire about splitting the data after storing according to described data routing rule.
8. the access system of mass data according to claim 6, is characterized in that, described rule arranges module and comprises:
Read and write abruption rule setting unit, with the routing rule of the mode setting data of read and write abruption;
Divide storehouse submeter rule setting unit, with the routing rule of the mode setting data of point storehouse submeter.
9. the access system of mass data according to claim 8, is characterized in that, described fractionation memory module comprises:
Read storehouse copied cells, be connected with described read and write abruption rule setting unit, copy one according to the fractionation of legacy data storehouse and read storehouse;
Write storehouse copied cells, be connected with described read and write abruption rule setting unit, copy one according to the fractionation of legacy data storehouse and write storehouse.
10. the access system of mass data according to claim 8, is characterized in that, described fractionation memory module also comprises:
Divide storehouse copied cells, be connected with described point of storehouse submeter rule setting unit, in legacy data storehouse, select at least 1 table to split, copy N number of storehouse by by the table selected; N be more than or equal to 1 positive integer;
Submeter copied cells, is connected with described point of storehouse copied cells, each storehouse is split out M and opens table; M be more than or equal to 1 positive integer;
Routing rule record cell, is connected with submeter copied cells respectively with described point of storehouse copied cells, corresponding point storehouse submeter routing rule after record splits.
CN201510359672.6A 2015-06-26 2015-06-26 Access method and system for mass data Pending CN105045816A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510359672.6A CN105045816A (en) 2015-06-26 2015-06-26 Access method and system for mass data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510359672.6A CN105045816A (en) 2015-06-26 2015-06-26 Access method and system for mass data

Publications (1)

Publication Number Publication Date
CN105045816A true CN105045816A (en) 2015-11-11

Family

ID=54452363

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510359672.6A Pending CN105045816A (en) 2015-06-26 2015-06-26 Access method and system for mass data

Country Status (1)

Country Link
CN (1) CN105045816A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105589937A (en) * 2015-12-14 2016-05-18 江苏鼎峰信息技术有限公司 Distributed database storage architecture system
CN105677761A (en) * 2015-12-30 2016-06-15 国网信息通信产业集团有限公司 Data sharding method and system
CN105868421A (en) * 2016-06-12 2016-08-17 浪潮通用软件有限公司 Data management method and data management device
CN105893466A (en) * 2016-03-28 2016-08-24 中国建设银行股份有限公司 Data processing method and system applied to database
CN105930387A (en) * 2016-04-14 2016-09-07 北京思特奇信息技术股份有限公司 Data operation system and method based on data routing and sharding
CN106547870A (en) * 2016-10-31 2017-03-29 天脉聚源(北京)科技有限公司 Point table method and device of data base
CN107402950A (en) * 2017-04-28 2017-11-28 阿里巴巴集团控股有限公司 Divide the document handling method and device of table based on point storehouse
CN107590257A (en) * 2017-09-20 2018-01-16 郑州云海信息技术有限公司 A kind of data base management method and device
CN108108434A (en) * 2017-12-19 2018-06-01 福建中金在线信息科技有限公司 A kind of method and device for managing database
CN108228848A (en) * 2018-01-10 2018-06-29 山东浪潮通软信息科技有限公司 A kind of expansible business datum divides library implementation method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102053982A (en) * 2009-11-02 2011-05-11 阿里巴巴集团控股有限公司 Method and equipment for managing database information
US20120203980A1 (en) * 2006-12-06 2012-08-09 Fusion-Io, Inc. Apparatus, system, and method for validating that a correct data segment is read from a data storage device
CN104516967A (en) * 2014-12-25 2015-04-15 国家电网公司 Electric power system mass data management system and use method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120203980A1 (en) * 2006-12-06 2012-08-09 Fusion-Io, Inc. Apparatus, system, and method for validating that a correct data segment is read from a data storage device
CN102053982A (en) * 2009-11-02 2011-05-11 阿里巴巴集团控股有限公司 Method and equipment for managing database information
CN104516967A (en) * 2014-12-25 2015-04-15 国家电网公司 Electric power system mass data management system and use method thereof

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105589937A (en) * 2015-12-14 2016-05-18 江苏鼎峰信息技术有限公司 Distributed database storage architecture system
CN105677761A (en) * 2015-12-30 2016-06-15 国网信息通信产业集团有限公司 Data sharding method and system
CN105893466A (en) * 2016-03-28 2016-08-24 中国建设银行股份有限公司 Data processing method and system applied to database
CN105893466B (en) * 2016-03-28 2019-09-20 中国建设银行股份有限公司 A kind of data processing method and system applied to database
CN105930387A (en) * 2016-04-14 2016-09-07 北京思特奇信息技术股份有限公司 Data operation system and method based on data routing and sharding
CN105868421A (en) * 2016-06-12 2016-08-17 浪潮通用软件有限公司 Data management method and data management device
CN106547870A (en) * 2016-10-31 2017-03-29 天脉聚源(北京)科技有限公司 Point table method and device of data base
CN107402950A (en) * 2017-04-28 2017-11-28 阿里巴巴集团控股有限公司 Divide the document handling method and device of table based on point storehouse
CN107402950B (en) * 2017-04-28 2020-05-29 阿里巴巴集团控股有限公司 File processing method and device based on sub-base and sub-table
CN107590257A (en) * 2017-09-20 2018-01-16 郑州云海信息技术有限公司 A kind of data base management method and device
CN108108434A (en) * 2017-12-19 2018-06-01 福建中金在线信息科技有限公司 A kind of method and device for managing database
CN108228848A (en) * 2018-01-10 2018-06-29 山东浪潮通软信息科技有限公司 A kind of expansible business datum divides library implementation method

Similar Documents

Publication Publication Date Title
CN105045816A (en) Access method and system for mass data
EP2758901B1 (en) Mechanism for updates in a database engine
CN102663117B (en) OLAP (On Line Analytical Processing) inquiry processing method facing database and Hadoop mixing platform
CN104685498B (en) The hardware implementation mode of polymerization/division operation:Hash table method
US8468171B2 (en) Attributed key-value-store database system
CN106528787B (en) query method and device based on multidimensional analysis of mass data
CN110674154B (en) Spark-based method for inserting, updating and deleting data in Hive
US20070016555A1 (en) Indexing method of database management system
CN102725739A (en) Distributed database system by sharing or replicating the meta information on memory caches
CN104866497A (en) Metadata updating method and device based on column storage of distributed file system as well as host
CN104657459A (en) Massive data storage method based on file granularity
CN102255962A (en) Distributive storage method, device and system
Dehne et al. Scalable real-time OLAP on cloud architectures
CN109710618A (en) The mixing storage method and system of knowledge mapping data relationship separation
Wang et al. Distributed storage and index of vector spatial data based on HBase
CN106709048A (en) High-performance computing-oriented distributed data organization method
CN111427847A (en) Indexing and query method and system for user-defined metadata
CN105677761A (en) Data sharding method and system
CN103473276A (en) Storage method of very large data and distributed database system and retrieval method thereof
CN107590257A (en) A kind of data base management method and device
CN110427364A (en) A kind of data processing method, device, electronic equipment and storage medium
WO2020041950A1 (en) Data update method, device, and storage device employing b+ tree indexing
CN105022791A (en) Novel KV distributed data storage method
CN103942301A (en) Distributed file system oriented to access and application of multiple data types
CN109828975A (en) A kind of extensive quick account book access system based on block chain

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20151111