CN103714163A - Pattern management method and system of NoSQL database - Google Patents
Pattern management method and system of NoSQL database Download PDFInfo
- Publication number
- CN103714163A CN103714163A CN201310744369.9A CN201310744369A CN103714163A CN 103714163 A CN103714163 A CN 103714163A CN 201310744369 A CN201310744369 A CN 201310744369A CN 103714163 A CN103714163 A CN 103714163A
- Authority
- CN
- China
- Prior art keywords
- data
- access
- update request
- pattern
- mode type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a pattern management method of a NoSQL database. The pattern management method specifically includes the following steps that firstly, accessing or updating requests are received; secondly, classification is performed on the accessing or updating requests according to pattern types, or new pattern types and interfaces corresponding to the new pattern types are constructed according to the accessing or updating requests; thirdly, according to a pattern management table connected into the database by the accessing or updating requests through the interfaces corresponding to the pattern types, pattern information in the pattern management table is obtained; fourthly, according to a route provided by the pattern management table, data stored under different pattern types in the database are accessed or updated according to the accessing or updating requests. According to the pattern management method of the NoSQL database, unified management of various heterogeneous data in the NoSQL database is performed; according to different types and features of the data, differential pattern and interface design is achieved, and the high reading and writing performance is ensured. Meanwhile, the universal schema management strategy and a universal read-write interface are provided, and convenience is provided for expansion of data patterns.
Description
Technical field
The present invention relates to a kind of schema management method and system of NoSQL database.
Background technology
Along with the arrival in mass data epoch, the data of all trades and professions are all in rapid expanding.Traditional relevant database is limited to data model and the system architecture of himself, is difficult to tackle the challenge of the store and management that data volume sharp increase brings.Under such background, NoSQL database has obtained development fast.NoSQL database has distributed framework, and data are carried out to horizontal division, and data structure is flexible, can tackle well the demand of mass data storage, and readwrite performance is also related to that storehouse has a clear superiority in.
In actual life, exist the multiple different data type that has, naming rule is different, possesses the data of different reading/writing characteristics simultaneously, and we are referred to as " isomeric data " by such data.Isomeric data configurations, does not have fixing form Schema(pattern), and NoSQL database itself does not provide the complete management to Schema.In read-write process, data exist with the form of binary data stream, have lost and have comprised data type, data length in interior various attributes and constraint condition.Meanwhile, isomeric data has different reading/writing characteristics, and the interface providing with NoSQL itself cannot obtain efficient readwrite performance.Therefore, when isomeric data is stored in NoSQL database, need unified schema management method, manage dissimilar schema, simultaneously for the different reading/writing characteristics of data, need the strategy of poor designs alienation, so that efficient readwrite performance to be provided.
Summary of the invention
Technical matters to be solved by this invention is, for the deficiencies in the prior art, to provide a kind of to dissimilar and the data of reading/writing characteristics and the schema management method of the NoSQL database that pattern is carried out unified management.
The technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of schema management method of NoSQL database, specifically comprises the following steps:
Step 1: receive access or update request;
Step 2: according to mode type, access or update request are classified, or create new model type and interface corresponding to corresponding new model type according to access or update request;
Step 3: be connected to the schema management table in database, the pattern information in obtaining mode admin table according to described access or update request;
Step 4: the pattern information providing according to schema management table, according to described access or update request by the interface accessing of associative mode type or be more kept at the data under different mode type in new database.
The invention has the beneficial effects as follows: the present invention, by the schema schema management method of NoSQL database is provided, has realized the unified management in database to multiple isomeric data; For the dissimilar and feature of data, the data pattern of optimizing design is provided, and the read-write interface of differentiation is provided, guarantee the high-performance of read-write; Meanwhile, provide general schema operating strategy and basic read-write interface, compatible already present data well, and provide convenience for the expansion of data pattern.
On the basis of technique scheme, the present invention can also do following improvement.
Further, described step 2 specifically comprises the following steps:
Step 2.1: judge whether described access or update request exist corresponding mode type, if existed, according to mode type, access or update request are classified, carry out step 3; Otherwise, carry out next step;
Step 2.2: judgement is request of access or update request; If request of access finishes; Otherwise, carry out next step;
Step 2.3: create the mode type of corresponding described update request in database, this mode type is saved in to schema management table, create the interface of corresponding this mode type, and preserve the data of described update request transmission by this interface.
Further, described mode type comprises markers key assignments pattern, data recording pattern and catalogue file pattern.
Further, in described step 3, in access or update request, comprise mode type, according to the relevant information of mode type obtaining mode in schema management table.
Further, the form of data storage is that schema name adds user's table name and adds row name in described schema management table; Whether whether storage content comprise data type, data length, be major key, be that sky, data scale, data precision and default value etc. indicate row.
Further, interface described in described step 2 and step 3, with timestamp information, is supported renewal and access to the data with different time stamp information.
Technical matters to be solved by this invention is, for the deficiencies in the prior art, to provide a kind of to dissimilar and the data of reading/writing characteristics and the schema management system of the NoSQL database that pattern is carried out unified management.
The technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of schema management system of NoSQL database, comprising: receiver module, interface module, url management table module and data processing module;
Described receiver module is used for receiving access or update request;
Described interface module is used for according to mode type, access or update request being classified, or creates new model type and interface corresponding to corresponding new model type according to access or update request;
Described url management table module is for being connected to the schema management table of database, the pattern information in obtaining mode admin table according to described access or update request;
Described data processing module is for the pattern information that provides according to schema management table, according to described access or update request by the interface accessing of associative mode type or be more kept at the data under different mode type in new database.
The invention has the beneficial effects as follows: the present invention, by the schema schema management system of NoSQL database is provided, has realized the unified management in database to multiple isomeric data; For the dissimilar and feature of data, the data pattern of optimizing design is provided, and the read-write interface of differentiation is provided, guarantee the high-performance of read-write; Meanwhile, provide general schema operating strategy and basic read-write interface, compatible already present data well, and provide convenience for the expansion of data pattern.
On the basis of technique scheme, the present invention can also do following improvement.
Further, described interface module comprises judge module and pattern creation module;
Described judge module, for judging whether described access or update request exist corresponding mode type, if existed, is classified to access or update request according to mode type; Otherwise judgement is request of access or update request; If request of access finishes; Otherwise, will upgrade please mode will be arrived to pattern creation module;
Described pattern creation module, for create the mode type of corresponding described update request at database, is saved in schema management table by this mode type, creates the interface of corresponding this mode type, and by this interface, preserves the data of described update request transmission.
Further, described mode type comprises markers key assignments pattern, data recording pattern and catalogue file pattern.
Further, in described url management table module, in access or update request, comprise mode type, according to the relevant information of mode type obtaining mode in schema management table.
Further, the form of data storage is that schema name adds user's table name and adds row name in described schema management table; Whether whether storage content comprise data type, data length, be major key, be that sky, data scale, data precision and default value etc. indicate row.
Further, interface described in described interface module and url management table module, with timestamp information, is supported renewal and access to the data with different time stamp information.
Accompanying drawing explanation
Fig. 1 is the schema management method flow diagram of a kind of NoSQL database described in the specific embodiment of the invention 1;
Fig. 2 is the schema management system architecture diagram of a kind of NoSQL database described in the specific embodiment of the invention 1;
Fig. 3 is the NoSQL database structure schematic diagram that the schema management method of a kind of NoSQL database described in the specific embodiment of the invention 2 forms;
Fig. 4 is for adopting schema1 and the original schema single-point inquiry comparison diagram of schema management method of the present invention;
Fig. 5 is for adopting schema2 and the original schema of schema management method of the present invention to upgrade performance comparison figure.
In accompanying drawing, the list of parts of each label representative is as follows:
1, receiver module, 2, interface module, 3, url management table module, 4, data processing module, 21, judge module, 22, pattern creation module.
Embodiment
Below in conjunction with accompanying drawing, principle of the present invention and feature are described, example, only for explaining the present invention, is not intended to limit scope of the present invention.
As shown in Figure 1, the schema management method of a kind of NoSQL database described in the specific embodiment of the invention 1, specifically comprises the following steps:
Step 1: receive access or update request;
Step 2: judge whether described access or update request exist corresponding mode type, if existed, according to mode type, access or update request are classified, carry out step 5; Otherwise, carry out next step;
Step 3: judgement is request of access or update request; If request of access finishes; Otherwise, carry out next step;
Step 4: create the mode type of corresponding described update request in database, this mode type is saved in to schema management table, create the interface of corresponding this mode type, and preserve the data of described update request transmission by this interface;
Step 5: be connected to the schema management table in database, the pattern information in obtaining mode admin table according to described access or update request;
Step 6: the pattern information providing according to schema management table, according to described access or update request by the interface accessing of associative mode type or be more kept at the data under different mode type in new database.
Described mode type comprises markers key assignments pattern, data recording pattern and catalogue file pattern.
In described step 5, in access or update request, comprise mode type, according to the relevant information of mode type obtaining mode in schema management table.
The form of data storage is that schema name adds user's table name and adds row name in described schema management table; Whether whether storage content comprise data type, data length, be major key, be that sky, data scale, data precision and default value etc. indicate row.
Interface described in described step 4 and step 5, with timestamp information, is supported renewal and access to the data with different time stamp information.
As shown in Figure 2, the schema management system for a kind of NoSQL database described in the specific embodiment of the invention 1, comprising: receiver module 1, interface module 2, url management table module 3 and data processing module 4;
Described receiver module 1 is for receiving access or update request;
Described interface module 2 for according to mode type to access or update request classify, or according to access or update request create new model type and interface corresponding to corresponding new model type;
Described url management table module 3 is for being connected to the schema management table of database, the pattern information in obtaining mode admin table according to described access or update request;
The pattern information of described data processing module 4 for providing according to schema management table, according to described access or update request by the interface accessing of associative mode type or be more kept at the data under different mode type in new database.
Described interface module 2 comprises judge module 21 and pattern creation module 22;
Described judge module 21, for judging whether described access or update request exist corresponding mode type, if existed, is classified to access or update request according to mode type; Otherwise judgement is request of access or update request; If request of access finishes; Otherwise, will upgrade please mode will be arrived to pattern creation module 22;
Described pattern creation module 22, for create the mode type of corresponding described update request at database, is preserved the data of described update request transmission, and this mode type is saved in to schema management table, and creates the interface of corresponding this mode type.
Described mode type comprises markers key assignments pattern, data recording pattern and catalogue file pattern.
In described url management table module, in access or update request, comprise mode type, according to the relevant information of mode type obtaining mode in schema management table.
The form of data storage is that schema name adds user's table name and adds row name in described schema management table; Whether whether storage content comprise data type, data length, be major key, be that sky, data scale, data precision and default value etc. indicate row.
Interface described in described interface module 2 and url management table module 3, with timestamp information, is supported renewal and access to the data with different time stamp information.
If shown in 3, it is the NoSQL database structure that the schema management method of a kind of NoSQL database described in the specific embodiment of the invention 2 forms; Specific as follows:
(1) in NoSQL database, set up Schema admin table SchemaMgrTable(as shown in subordinate list 1), the Rowkey of this table is schema name+user table name+row names, comprise Type(data type), Length(data length), whether Key(be major key), Null(non-NULL whether), SCA(data scale), PRE(data precision), DEF(default value) etc. indicate row, indicate respectively the corresponding attribute of a certain row in subscriber's meter.
Subordinate list 1.SchemaMgrTable
(1) when NoSQL Database or deletion user form, first upgrade Schema admin table.
(2), for three kinds of isomeric datas mentioned above, provide the data pattern of three kinds of optimizations---markers key-value pair pattern, data recording pattern and catalogue file pattern.
(3) on step (threes') basis, for user's form of different mode provides the data of optimization to write incoming interface.For data write request, first by schema type, request is classified, then the incoming interface of writing that calls different types of data is processed.
(4), on step (threes') basis, user's form of different mode is provided to the data access interface of optimization.For data access request, first by schema type, request is classified, then the access interface that calls different types of data is processed.
(5) on step (threes') basis, conventional data pattern is provided, other user's form is carried out to schema management, and provide basic data read and write interface to support user writable data.
(6) on the basis of abovementioned steps, the timestamp to data in NoSQL database manages, and the data read and write interface with timestamp information is provided, and supports renewal and access to different time stamp (versions of data) data.
Particularly, in above-mentioned steps (two), user submits to while building table request, first schema information is write to SchemaMgrTable, then set up form in database; User submits to while deleting table request, the schema information that first finds and delete this form in SchemaMgrTable, then in database Delete Table.
In above-mentioned steps (three), the pattern of three kinds of optimizations is described in detail respectively:
Markers key-value pair pattern (as shown in subordinate list 2), in this pattern, the major key of data form is the key of date+key(key-value pair) combination, each key was divided according to the date; There are row bunch, the value of the value(key-value pair that these row bunch comprise regular update) row; With timestamp, record the time scale information of key-value pair.
Subordinate list 2: markers key-value pair pattern schema
Data recording pattern (as shown in subordinate list 3), in this pattern, the major key of data form is data recording ID, has row bunch, these row bunch comprise each field corresponding to data recording.
Subordinate list 3: data recording pattern schema
Catalogue file pattern (as shown in subordinate list 4), in this pattern, the RowKey of data form is file path, has row bunch, and these row bunch comprise data file row, and these row are stored whole data file with the form of data stream.
Subordinate list 4: catalogue file pattern schema
The data read and write interface of optimizing in above-mentioned steps (four) (five), is hereinafter introduced according to different data patterns.
For markers key-value pair pattern, the batch updating interface of the value of providing (value) and the single-point query interface based on key (key), the batch that the support of batch updating interface has a plurality of key-value pairs of target when identical writes, the support of single-point query interface to same key sometime all value in section inquire about.Particularly, while receiving Data Update request, directly update data stream is disassembled, and carried out the batch updating operation of value row, the data that write are stamped to corresponding timestamp simultaneously.While receiving single-point inquiry request, first resolve the object time section of inquiry, obtain date (date) information, splice the major key (date+key) of tables of data, obtain markers to be checked, then according to major key, value value corresponding to all markers to be checked in record taken out.
For data recording pattern, provide incremental update and the whole access interface of data pattern.The source of data recording is document data record, the data that this document comprises all data forms in data recording pattern, renewal each time or access are all to take complete document data record as unit, and therefore, the renewal of data recording and access are the batch operations to all forms in pattern.When data writing records, from log file, by row, read successively the data of each data recording form, then the operation of the incremental update of executing data logging mode.Particularly, first, data form of each in new model more according to this; Secondly, for the renewal operation in data form, for each record, in comparison database, each field of current record and record to be written, as value does not all change, skips, otherwise, the write operation of each row in executive logging.Read while recording, the whole accessing operation of executing data pattern, then by Query Result data writing log file.Particularly, first all data forms in data query logging mode, travel through every table wherein, read each field of each data recording, and are write the data file of appointment.
For catalogue file pattern, provide incremental update and the whole access interface of file directory.During updating file catalogue, designated root catalogue, travel through this root directory, obtain all data files, file path, and nearest modification time, for each file path, find corresponding data file and the timestamp thereof in this path in table, if nearest modification time is later than this time, go out, upgrade data file corresponding to this document path, and be nearest modification time by update of time stamp; During file reading catalogue, traversal catalogue file tables of data, reads its data file row according to file path and obtains data file, and data file is write in corresponding path.
In above-mentioned steps (six), increasing to data form is provided, the basic operation such as deletes, change, look into, while carrying out these basic operations, the information of read operation target form and row from SchemaMgrTable first, then carry out corresponding operating in NoSQL database.
In above-mentioned steps (seven), provide the read-write interface with timestamp information.For write operation, user can stab the fixed time, otherwise acquiescence adopts current system time as timestamp, and each data writing has its corresponding timestamp.During data access, user can inquire about the data of fixed time stamp accordingly, or the not new latest data of stamp at fixed time.By the timestamp attribute of data, can in database, store the data of a plurality of versions, and support the inquiry of multi-edition data and access.
As shown in subordinate list 5, for markers key-value pair pattern, we have designed multiple schema and have carried out performance comparison analysis.
Subordinate list 5: contrast schema1
In contrast schema1, major key is the key of key-value pair, this key is divided no longer by date, but all timescale datas are all write to same a line.
As shown in Figure 4, for adopting schema1 and the original schema single-point inquiry comparison diagram of schema management method of the present invention; Along with data volume increases gradually, the timestamp of single file data increases, and has affected the performance of single-point inquiry, and the performance advantage that original schema compares contrast schema1 is more obvious.
Subordinate list 6: contrast schema2
As shown in subordinate list 6, contrast schema2 in, the key that major key is key-value pair, by date and time information be embodied in row bunch in different lines.
As shown in Figure 5, for adopting the present invention and the original schema2 of schema management method and the renewal performance comparison figure of original schema, obviously along with the date increases, the batch updating performance of markers key-value pair contrasts schema2 obvious performance boost.
The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (12)
1. a schema management method for NoSQL database, is characterized in that, specifically comprises the following steps:
Step 1: receive access or update request;
Step 2: according to mode type, access or update request are classified, or create new model type and interface corresponding to corresponding new model type according to access or update request;
Step 3: be connected to the schema management table in database, the pattern information in obtaining mode admin table according to described access or update request;
Step 4: the pattern information providing according to schema management table, according to described access or update request by the interface accessing of associative mode type or be more kept at the data under different mode type in new database.
2. the schema management method of a kind of NoSQL database according to claim 1, is characterized in that, described step 2 specifically comprises the following steps:
Step 2.1: judge whether described access or update request exist corresponding mode type, if existed, according to mode type, access or update request are classified, carry out step 3; Otherwise, carry out next step;
Step 2.2: judgement is request of access or update request; If request of access finishes; Otherwise, carry out next step;
Step 2.3: create the mode type of corresponding described update request in database, this mode type is saved in to schema management table, create the interface of corresponding this mode type, and preserve the data of described update request transmission by this interface.
3. the schema management method of a kind of NoSQL database according to claim 2, is characterized in that, described mode type comprises markers key assignments pattern, data recording pattern and catalogue file pattern.
4. according to the schema management method of a kind of NoSQL database described in claim 1-3 any one, it is characterized in that, in described step 3, in access or update request, comprise mode type, according to the relevant information of mode type obtaining mode in schema management table.
5. according to the schema management method of a kind of NoSQL database described in claim 4 any one, it is characterized in that, the form of data storage is that schema name adds user's table name and adds row name in described schema management table; Whether whether storage content comprise data type, data length, be major key, be that sky, data scale, data precision and default value indicate row.
6. the schema management method of a kind of NoSQL database according to claim 5, is characterized in that, interface described in described step 2 and step 3, with timestamp information, is supported renewal and access to the data with different time stamp information.
7. a schema management system for NoSQL database, comprising: receiver module, interface module, url management table module and data processing module;
Described receiver module is used for receiving access or update request;
Described interface module is used for according to mode type, access or update request being classified, or creates new model type and interface corresponding to corresponding new model type according to access or update request;
Described url management table module is for being connected to the schema management table of database, the pattern information in obtaining mode admin table according to described access or update request;
Described data processing module is for the pattern information that provides according to schema management table, according to described access or update request by the interface accessing of associative mode type or be more kept at the data under different mode type in new database.
8. the schema management system of a kind of NoSQL database according to claim 7, is characterized in that, described interface module comprises judge module and pattern creation module;
Described judge module, for judging whether described access or update request exist corresponding mode type, if existed, is classified to access or update request according to mode type; Otherwise judgement is request of access or update request; If request of access finishes; Otherwise, will upgrade please mode will be arrived to pattern creation module;
Described pattern creation module, for create the mode type of corresponding described update request at database, is saved in schema management table by this mode type, creates the interface of corresponding this mode type, and by this interface, preserves the data of described update request transmission.
9. the schema management system of a kind of NoSQL database according to claim 8, is characterized in that, described mode type comprises markers key assignments pattern, data recording pattern and catalogue file pattern.
10. according to the schema management system of a kind of NoSQL database described in claim 7-9 any one, it is characterized in that, the form of data storage is that schema name adds user's table name and adds row name in described schema management table; Whether whether storage content comprise data type, data length, be major key, be that sky, data scale, data precision and default value indicate row.
The schema management system of 11. a kind of NoSQL databases according to claim 10, it is characterized in that, in described url management table module, in access or update request, comprise mode type, according to the relevant information of mode type obtaining mode in schema management table.
The schema management system of 12. a kind of NoSQL databases according to claim 11, it is characterized in that, interface described in described interface module and url management table module, with timestamp information, is supported renewal and access to the data with different time stamp information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310744369.9A CN103714163B (en) | 2013-12-30 | 2013-12-30 | Pattern management method and system of NoSQL database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310744369.9A CN103714163B (en) | 2013-12-30 | 2013-12-30 | Pattern management method and system of NoSQL database |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103714163A true CN103714163A (en) | 2014-04-09 |
| CN103714163B CN103714163B (en) | 2017-02-15 |
Family
ID=50407138
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310744369.9A Active CN103714163B (en) | 2013-12-30 | 2013-12-30 | Pattern management method and system of NoSQL database |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103714163B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103955538A (en) * | 2014-05-19 | 2014-07-30 | 携程计算机技术（上海）有限公司 | HBase data persistence and query methods and HBase system |
| CN104408058A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Data access method and device |
| WO2016050112A1 (en) * | 2014-09-30 | 2016-04-07 | 华为技术有限公司 | Data storage method, storage apparatus and storage system |
| CN105550321A (en) * | 2015-12-12 | 2016-05-04 | 天津南大通用数据技术股份有限公司 | Method and apparatus for updating data based on same data structure |
| WO2016074370A1 (en) * | 2014-11-12 | 2016-05-19 | 华为技术有限公司 | Keyvalue database data table updating method and data table updating device |
| CN105787098A (en) * | 2016-03-18 | 2016-07-20 | 上海斐讯数据通信技术有限公司 | Oracle database table data historical track preservation method and system |
| CN107609181A (en) * | 2017-09-29 | 2018-01-19 | 北京酷我科技有限公司 | A kind of update data of database optimized algorithm |
| CN108089879A (en) * | 2016-11-21 | 2018-05-29 | 广州市动景计算机科技有限公司 | Increment updating method, equipment and programmable device |
| CN108763386A (en) * | 2018-05-19 | 2018-11-06 | 国云科技股份有限公司 | Polymorphic type report data sharing means based on NOSQL and its implementation |
| CN110088746A (en) * | 2016-12-14 | 2019-08-02 | 华为技术有限公司 | System, apparatus and method for data update notification |
| CN112364278A (en) * | 2020-11-23 | 2021-02-12 | 浪潮云信息技术股份公司 | Data classification optimization method based on CockroachDB bottom key values |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103020325A (en) * | 2013-01-17 | 2013-04-03 | 中国科学院计算机网络信息中心 | Distributed remote sensing data organization query method based on NoSQL database |
-
2013
- 2013-12-30 CN CN201310744369.9A patent/CN103714163B/en active Active
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103955538A (en) * | 2014-05-19 | 2014-07-30 | 携程计算机技术（上海）有限公司 | HBase data persistence and query methods and HBase system |
| CN103955538B (en) * | 2014-05-19 | 2017-05-24 | 上海携程商务有限公司 | HBase data persistence and query methods and HBase system |
| WO2016050112A1 (en) * | 2014-09-30 | 2016-04-07 | 华为技术有限公司 | Data storage method, storage apparatus and storage system |
| CN104408058A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Data access method and device |
| CN104408058B (en) * | 2014-10-29 | 2019-11-05 | 中国建设银行股份有限公司 | A kind of method and device of data access |
| CN107977396B (en) * | 2014-11-12 | 2021-07-20 | 华为技术有限公司 | Method and device for updating data table of KeyValue database |
| CN105900093A (en) * | 2014-11-12 | 2016-08-24 | 华为技术有限公司 | Keyvalue database data table updating method and data table updating device |
| AU2015316450B2 (en) * | 2014-11-12 | 2016-11-03 | Huawei Cloud Computing Technologies Co., Ltd. | Method for updating data table of KeyValue database and apparatus for updating table data |
| WO2016074370A1 (en) * | 2014-11-12 | 2016-05-19 | 华为技术有限公司 | Keyvalue database data table updating method and data table updating device |
| US10467192B2 (en) | 2014-11-12 | 2019-11-05 | Hauwei Technologies Co.,Ltd. | Method and apparatus for updating data table in keyvalue database |
| CN105900093B (en) * | 2014-11-12 | 2018-02-02 | 华为技术有限公司 | A kind of update method of the tables of data of KeyValue databases and table data update apparatus |
| CN107977396A (en) * | 2014-11-12 | 2018-05-01 | 华为技术有限公司 | A kind of update method of the tables of data of KeyValue databases and table data update apparatus |
| CN105550321A (en) * | 2015-12-12 | 2016-05-04 | 天津南大通用数据技术股份有限公司 | Method and apparatus for updating data based on same data structure |
| CN105787098A (en) * | 2016-03-18 | 2016-07-20 | 上海斐讯数据通信技术有限公司 | Oracle database table data historical track preservation method and system |
| CN105787098B (en) * | 2016-03-18 | 2019-10-25 | 上海斐讯数据通信技术有限公司 | A kind of oracle database table data history track store method and system |
| CN108089879A (en) * | 2016-11-21 | 2018-05-29 | 广州市动景计算机科技有限公司 | Increment updating method, equipment and programmable device |
| CN108089879B (en) * | 2016-11-21 | 2021-11-26 | 阿里巴巴（中国）有限公司 | Incremental updating method, equipment and programmable equipment |
| CN110088746A (en) * | 2016-12-14 | 2019-08-02 | 华为技术有限公司 | System, apparatus and method for data update notification |
| CN107609181A (en) * | 2017-09-29 | 2018-01-19 | 北京酷我科技有限公司 | A kind of update data of database optimized algorithm |
| CN108763386A (en) * | 2018-05-19 | 2018-11-06 | 国云科技股份有限公司 | Polymorphic type report data sharing means based on NOSQL and its implementation |
| CN112364278A (en) * | 2020-11-23 | 2021-02-12 | 浪潮云信息技术股份公司 | Data classification optimization method based on CockroachDB bottom key values |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103714163B (en) | 2017-02-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103714163A (en) | Pattern management method and system of NoSQL database | |
| US10915528B2 (en) | Pluggable storage system for parallel query engines | |
| US10831779B2 (en) | Seamless data migration across databases | |
| US11468103B2 (en) | Relational modeler and renderer for non-relational data | |
| US11468027B2 (en) | Method and apparatus for providing efficient indexing and computer program included in computer readable medium therefor | |
| US10360146B2 (en) | Group garbage collection for multi-version concurrency control in database systems | |
| US7483882B1 (en) | Dynamic management of multiple persistent data stores | |
| US9965510B2 (en) | Partition access method for query optimization | |
| CN102741843B (en) | Method and apparatus for reading data from database | |
| KR102177190B1 (en) | Managing data with flexible schema | |
| CN106716409A (en) | Method and system for adaptively building and updating column store database from row store database based on query demands | |
| US10860562B1 (en) | Dynamic predicate indexing for data stores | |
| CN102779138B (en) | The hard disk access method of real time data | |
| MX2010012866A (en) | Paging hierarchical data. | |
| CN103365987A (en) | Clustered database system and data processing method based on shared-disk framework | |
| US10095738B1 (en) | Dynamic assignment of logical partitions according to query predicate evaluations | |
| CN114860727A (en) | Zipper watch updating method and device | |
| CN110471925A (en) | Realize the method and system that index data is synchronous in search system | |
| CN109213760B (en) | High-load service storage and retrieval method for non-relational data storage | |
| CN112000666B (en) | Database management system of facing array | |
| CN102567527A (en) | Materialized view layout in distributive system under column-orientated storage environment and maintaining method of materialized view layout | |
| Singh | NoSQL: A new horizon in big data | |
| CN115718571B (en) | Data management method and device based on multidimensional features | |
| CN108959308A (en) | A kind of reply can supplemental data indexing means | |
| CN104657460A (en) | File search method based on large-scale file system load characteristic key words |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |