CN103177046A - Data processing method and data processing device based on line storage data base - Google Patents

Data processing method and data processing device based on line storage data base Download PDF

Info

Publication number
CN103177046A
CN103177046A CN2011104476297A CN201110447629A CN103177046A CN 103177046 A CN103177046 A CN 103177046A CN 2011104476297 A CN2011104476297 A CN 2011104476297A CN 201110447629 A CN201110447629 A CN 201110447629A CN 103177046 A CN103177046 A CN 103177046A
Authority
CN
China
Prior art keywords
row
target matrix
data base
stored data
list
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011104476297A
Other languages
Chinese (zh)
Other versions
CN103177046B (en
Inventor
隋琪
袁向阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201110447629.7A priority Critical patent/CN103177046B/en
Publication of CN103177046A publication Critical patent/CN103177046A/en
Application granted granted Critical
Publication of CN103177046B publication Critical patent/CN103177046B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data processing method and a data processing device based on a line storage data base. The data processing method includes the following steps: after a data base system receives the statement in the structured query language (SQL) for creating a target data sheet in the line storage data base, submitted by a user, a plurality of lists corresponding to the target data sheet are created in the line storage data base, and a corresponding consolidated view is created, wherein the lists are in one-to-one correspondence with the lists of the target data sheet respectively. When the data base system receives the request for processing the data in the target data sheet in the line storage data base, submitted by the user, the data base system correspondingly processes the data in corresponding lists based on the consolidated view corresponding to the target data sheet with the data processing request. According to the data processing method and the data processing device, column-oriented data base analog products based on the existing line storage data base products are realized, and users can enjoy the advantages of the column storage technology on the premise of not replacing data base products.

Description

A kind of data processing method and equipment based on the row stored data base
Technical field
The present invention relates to Internet technical field, relate in particular to a kind of data processing method and equipment based on the row stored data base.
Background technology
The row storage mode is the relational database memory technology implementation of present main flow, and its basic ideas are: data are stored according to behavior unit, and improve the efficient of inquiry by index technology.This mode is well suited for the scene of OLTP (On-Line Transaction Processing, Transaction Processing), is inserting frequently, deletes, upgrading operation, and the query aspects advantage of small data quantity (several rows) is comparatively outstanding.But along with the appearance of PB (PetaByte, 10,000,000 hundred million bytes) other ultra-large type data warehouse of level, the deficiency of row storage mode manifests gradually.
Because traditional data warehouse product is stored with behavior unit, and the data warehouse query manipulation many and upgrade and update less, and most query analysis all is based on some particular column and operates.Therefore, the data warehouse of realizing by the row storage mode inevitably can bring non-essential IO (Input/Output, input/output) operation.Simultaneously, the general character of the data in the data warehouse storage unit that the row storage mode is realized is less, is unfavorable for data compression.
Just for the deficiency of above line storage data warehouse, the column storage warehouse arises at the historic moment.Its basic realization approach is that data are stored according to the unit of classifying as, and by the relation between the different train value of chained representation.Because it is based on row and stores, can well overcome the defective of above line storage data warehouse.But, equally also there is deficiency in the column storage warehouse: at first, although the majority operation of data warehouse is for some specific row but not all is listed as, but most operations are for a few row but not a certain row, these operate in the column storage warehouse product of storing with the single unit of classifying as, will inevitably increase more query cost.Secondly, because the time of column storage warehouse appearance is shorter, although basic data warehouse function well satisfies, a lot of traditional row are stored data warehouse function ratio such as storing process etc., also can't be compatible, this has increased the difficulty of user's migration data warehouse system.In addition, allowing the user abandon for many years data warehouse product-specific investments, and turn to brand-new column storage warehouse product, itself is also a difficult choice.
Summary of the invention
The embodiment of the present invention provides a kind of data processing method and equipment based on the row stored data base, to realize the row memory technology based on the row stored data base.
In order to achieve the above object, the embodiment of the present invention provides a kind of data processing method of row stored data base, comprising:
Database Systems receive create in the stored data base of being expert at that the user submits to target matrix build list structure query language SQL statement after, create several lists corresponding with described target matrix in the stored data base of being expert at, and create the unified view of correspondence; Wherein, each row with described target matrix are corresponding one by one respectively in described several lists;
When described Database Systems receive the request that data in the described target matrix in described row stored data base that the user submits to process, described Database Systems are carried out respective handling according to the corresponding unified view of target matrix of ask processing to the data in respective list.
The embodiment of the present invention also provides a kind of Database Systems, comprising:
Receiver module, the stored data base of being expert at that is used for reception user submission creates the request of building list structure query language SQL statement and the data in the described target matrix in described row stored data base being processed of target matrix;
Emulation module, be used for when described receiver module receive the stored data base establishment target matrix of being expert at that the user submits to build list structure query language SQL statement after, being expert at creates several lists corresponding with described target matrix in stored data base, and creates the unified view of correspondence; Wherein, each row with described target matrix are corresponding one by one respectively in described several lists;
Processing module, be used for when described receiver module receives the request that the data in the described target matrix of described row stored data base of user's submission process, described Database Systems are carried out respective handling according to the corresponding unified view of target matrix of ask processing to the data in respective list.
Compared with prior art, in the technical scheme that the embodiment of the present invention provides, Database Systems create several lists corresponding with target matrix according to after receiving the SQL statement that creates target matrix in the stored data base of being expert in the stored data base of being expert at; When the processing request that receives the data in the target matrix of row in stored data base, data in respective list are carried out respective handling, realized simulation column storage database product on the basis of existing row stored data base product, made the user not need to change the advantage that obtains the row memory technology under the prerequisite of database product.
Description of drawings
The principle of work schematic diagram of the Database Systems that provide in the embodiment of the present invention is provided Fig. 1;
A kind of schematic flow sheet of data processing method based on the row stored data base that Fig. 2~3 provide for the embodiment of the present invention;
The structural representation of a kind of Database Systems that Fig. 4 provides for the embodiment of the present invention.
Embodiment
For row memory technology and row memory technology defective separately in prior art, the technical scheme that the embodiment of the present invention provides a kind of data to process, on the basis of existing row stored data base, the simulation column storage database is so that row stored data base product user need not to carry out the advantage that the stored data base replacement of products can obtain the row memory technology.
In order to realize the row memory technology based on the row stored data base, the technical scheme that the embodiment of the present invention provides is by arranging row storage simulator (hereinafter to be referred as " simulator ") in existing row stored data base system (hereinafter to be referred as " Database Systems "), and by this simulator, the table SQL statement is shown/deleted to building of receiving of Database Systems and process accordingly, realize list creating and deletion in the row stored data base.
Below in conjunction with the accompanying drawing in the application, the technical scheme in the application is carried out clear, complete description, obviously, described embodiment is a part of embodiment of the application, rather than whole embodiment.Based on the embodiment in the application, the every other embodiment that those of ordinary skills obtain under the prerequisite of not making creative work belongs to the scope that the application protects.
As shown in Figure 1, be the principle of work schematic diagram of the Database Systems that provide in the embodiment of the present invention, wherein:
By the simulator that arranges in the Database Systems of utilizing the embodiment of the present invention to provide, DBA (Database Administrator, the data base administrator) only need building of direct input standard to show/delete table SQL (Structured Query Language, Structured Query Language (SQL)) statement and can realize establishment and the deletion of list.
Wherein, build table during SQL statement when Database Systems receive, by simulator, it is decomposed into corresponding list creating SQL statement, and creates corresponding list according to this list creating SQL statement; Simultaneously, simulator creates corresponding unified view according to the table SQL that builds that receives.Wherein, unified view is the corresponding described virtual map table of building the tables of data of table SQL statement, and the form of the tables of data in this unified view and existing capable stored data base is the same.By unified view, the user can use the data manipulation of existing row stored data base and access mode to realize operation and access to above-mentioned list.
Correspondingly, delete table during SQL statement when Database Systems receive, can delete the corresponding unified view of table SQL statement deletion according to this by simulator; Simultaneously, simulator is resolved the table SQL that deletes that receives, and it is decomposed into corresponding list deletion SQL statement, and according to the corresponding list of this list deletion SQL statement deletion.
In embodiments of the present invention, build table during SQL statement when receiving, simulator is set up unified view after usually first creating list; Delete table during SQL statement when receiving, simulator is first deleted delete list after unified view usually.
After list creating, the user can be directly operates (comprise data inserting, deletion data and more new data) and accesses (comprising data query) corresponding list according to unified view.Because simulator is fully transparent to the conversion of the stsndard SQL statement of user input to the user, the operation of user's his-and-hers watches and access and tradition are the same to going the access of stored data base product, and be lower on the impact that the application of accessing corresponding table causes.
Based on the principle of work of above-mentioned Database Systems, the embodiment of the present invention provides a kind of data processing method based on the row stored data base, as shown in Figure 2, can comprise the following steps:
Step 201, Database Systems receive create target matrix in the stored data base of being expert at that the user submits to build the table SQL statement.
Concrete, the user can input on the inputting interface of simulator and build the table SQL statement, and according to the type of the capable stored data base of actual conditions select target.Wherein, target line stored data base type can comprise model and the version of target line stored data base product.
Step 202, Database Systems are expert at and are created several lists corresponding with described target matrix in stored data base, and the establishment unified view.
Concrete, Database Systems receive create in the stored data base of being expert at that the user submits to target matrix build list structure query language SQL statement after, can build the table SQL statement to this by simulator and resolve, obtain the row name that respectively is listed as in the table name of the table of building and this table.For each row name, simulator can create the list of a correspondence.Wherein, the row name of the table name of the table name of list and building table and respective column is corresponding.For example, the table name of list can be " table name row name ".Each list can comprise two row at least, and wherein row are used for storage line sign (RowID), and another row are used for the data of data table memory respective column.Interrelated by RowID between different lists (showing list corresponding to list creating SQL statement that SQL statement resolves into by same building) corresponding to same tables of data.
for example, Database Systems receive to be set up 20 row * 4 row and (is respectively id, name, age and salary) employee's Basic Information Table (table name is t) build the table SQL statement, Database Systems are resolved this SQL statement by simulator, obtain corresponding table name (t) and row name (id, name, age and salary), and corresponding each row name, create respectively a list, namely build together and stand 4 lists, put down in writing respectively corresponding 20 employees' id, name, (table name can be respectively id_t for age and salary, name_t, age_t and salary_t).Wherein, each list can comprise 2 row, and wherein row are used for storage line sign (row_id1~20), and another row are used for storing corresponding data, and is interrelated by RowID between 4 lists of corresponding data table t.
Simultaneously, Database Systems can also be resolved building the table SQL statement by simulator, generate and create the unified view SQL statement, and create the corresponding unified view of unified view SQL statement establishment according to this.For example, simulator can carry out association with the list of same tables of data take RowID as connection identifier, and creates the unified view corresponding to this tables of data.Wherein, in embodiments of the present invention, unified view is a virtual table of the different lists Joint Mapping one-tenth of corresponding same tables of data, and the name of unified view can be table name.
Step 203, when described Database Systems receive the request that data in the described target matrix in described row stored data base that the user submits to process, described Database Systems are carried out respective handling according to the corresponding unified view of target matrix of ask processing to the data in respective list.
Concrete, after the generation unified view, the user can initiate to process request to the data in the corresponding data table according to this unified view, and this data processing request comprises that data query, data are inserted, data are deleted or Data Update.When Database Systems receive the request that data in the described target matrix in described row stored data base that the user submits to process, according to the corresponding unified view of target matrix of ask processing, the data in respective list are carried out respective handling.
Take data query as example, suppose that a table has 50 row, the result set of an aggregate query has 50,000 row, and 3 data block store of these tables of data delegation's needs.If traditional row storage needs so to load 50000*3=150000 data block and just can obtain summarized results, and the technical scheme that the application of the invention embodiment provides only needs to load 50000 data blocks to get final product, and has improved the efficient of data query.
Owing to having created the unified view corresponding with tables of data, the user is based on unified view the processing request of data in tables of data and carries out, conversion and the access of whole row storage are fully transparent to the user, and be lower on the impact that the application of accessing the corresponding data table causes.The user only needs to use corresponding operating and the access instruction of existing row stored data base that the data in corresponding target line stored data base are operated and access, and can obtain to be listed as the advantage of the technology of storage.
In the technical scheme that the embodiment of the present invention provides, the process of delete list is similar with the flow process that creates table, and as shown in Figure 3, the data processing method that the embodiment of the present invention provides can also comprise the following steps:
What step 204, Database Systems received target matrix in the Delete Row stored data base that the user submits to deletes the table SQL statement.
Concrete, the user can input on the inputting interface of simulator and delete the table SQL statement, and the type of the capable stored data base of select target.Wherein, target line stored data base type can comprise model and the version of target line stored data base product.
Unified view corresponding to step 205, Database Systems deletion, and the list corresponding with described target matrix in the Delete Row stored data base.
Concrete Database Systems receive target matrix in the Delete Row stored data base that the user submits to delete the table SQL statement after, can resolve the table request of deleting that receives by simulator, generate the SQL statement of deleting unified view, to delete corresponding unified view.
Simultaneously, Database Systems can be resolved by simulator and be deleted the table SQL statement, obtain the table name of the table of deleting, and obtain corresponding row name (as obtain the row name of all correspondences in the data dictionary of database according to table name) according to this table name, and according to this table name and row the star delete the table SQL statement be decomposed into corresponding delete list SQL statement, to delete corresponding list.
Can learn by above description, in the technical scheme that the embodiment of the present invention provides, by simulator, the table SQL statement of building that receives is processed, realized simulation column storage database product on the basis of existing row stored data base product, made the user not need to change the advantage that obtains the row memory technology under the prerequisite of database product.Simultaneously, because simulator is fully transparent to the conversion of the stsndard SQL statement of user input to the user, the user is the same to the access of row stored data base product with tradition with access to the operation of corresponding data in tables of data, and is lower on the impact that the application of accessing corresponding table causes.
The below creates SQL statement and the technical scheme that the embodiment of the present invention provides is more clearly described as example simply to build with one build table SQL statement and the unified view that the table SQL statement resolves into some lists.
Constructive process:
DBA only need input the following table SQL statement of building:
create?table?t(id?varchar(10),
name?varchar(20),
rank?varchar(2),
salary?double(2));
Simulator receive above-mentioned build the table SQL statement after, it is decomposed into the SQL statement of following establishment list and unified view creates SQL statement:
Simulator creates respective list according to above-mentioned list creating SQL statement in the target line stored data base, and creates the corresponding unified view of SQL statement establishment according to above-mentioned unified view.
Delete procedure:
When needs are deleted the table of previous step establishment, below only need inputting, deletes DBA the table SQL statement:
delete?table?t;
Simulator receive this delete the table SQL statement after, it is decomposed into:
delete?view?t;
delete?table?id_t;
delete?table?name_t;
delete?table?rank_t;
delete?table?salary_t;
Simulator is according to above-mentioned deletion unified view SQL statement and the corresponding unified view of delete list SQL statement deletion, and the respective list in the target line stored data base.
Can find out by above description, by the simulator that the embodiment of the present invention provides, the data base administrator only needs building of Application standard to show/delete can realize the being expert at row storage on the stored data base product of table SQL statement.
Based on the identical technical conceive of said method embodiment, the embodiment of the present invention provides a kind of Database Systems, can be applied to the said method flow process.
As shown in Figure 4, the structural representation of a kind of Database Systems that provide for the embodiment of the present invention can comprise:
Receiver module 41, the stored data base of being expert at that is used for reception user submission creates the request of building list structure query language SQL statement and the data in the described target matrix in described row stored data base being processed of target matrix;
Emulation module 42, be used for when described receiver module 41 receive the stored data base establishment target matrix of being expert at that the user submits to build list structure query language SQL statement after, being expert at creates several lists corresponding with described target matrix in stored data base, and creates the unified view of correspondence; Wherein, each row with described target matrix are corresponding one by one respectively in described several lists;
Processing module 43, be used for when described receiver module 41 receives the request that the data in the described target matrix of described row stored data base of user's submission process, described Database Systems are carried out respective handling according to the corresponding unified view of target matrix of ask processing to the data in respective list.
Wherein, described emulation module 42 can specifically be used for, and by resolving the described table SQL statement of building, obtains each row name that is listed as in the table name of target matrix and this table; The list of the number of columns equal number of establishment and described target matrix in described row stored data base; Wherein, described list comprises two row at least, and wherein row are used for the storage line sign, and another row are used for the data of the respective column of storage target matrix; The table name of described list is corresponding with the row name of the table name of described target matrix and respective column.
Wherein, described emulation module 42 can also be used for, when described receiver module 41 receive target matrix in the Delete Row stored data base that the user submits to delete the table SQL statement after, the unified view that deletion is corresponding, and the list corresponding with described target matrix in the Delete Row stored data base.
Wherein, described emulation module 42 can also specifically be used for, and by resolving the described table SQL statement of deleting, obtains the table name of target matrix, and obtains corresponding row name according to the table name of described target matrix; Delete list corresponding to the name of row described in described row stored data base.
Wherein, the request processed of the data in the described target matrix in described row stored data base that receive of described receiver module 41 comprises: data query request, data are inserted request, data removal request or Data Update request.
By the description of above embodiment, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential general hardware platform, can certainly pass through hardware, but in a lot of situation, the former is better embodiment.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions are with so that a computer equipment (can be personal computer, server, the perhaps network equipment etc.) carry out the described method of each embodiment of the present invention.
It will be appreciated by those skilled in the art that accompanying drawing is the schematic diagram of a preferred embodiment, the module in accompanying drawing or flow process might not be that enforcement the present invention is necessary.
It will be appreciated by those skilled in the art that the module in the device in embodiment can be distributed in the device of embodiment according to the embodiment description, also can carry out respective change and be arranged in the one or more devices that are different from the present embodiment.The module of above-described embodiment can be merged into a module, also can further split into a plurality of submodules.
The invention described above embodiment sequence number does not represent the quality of embodiment just to description.
Above disclosed be only several specific embodiment of the present invention, still, the present invention is not limited thereto, the changes that any person skilled in the art can think of all should fall into protection scope of the present invention.

Claims (10)

1. the data processing method based on the row stored data base, is characterized in that, comprising:
Database Systems receive create in the stored data base of being expert at that the user submits to target matrix build list structure query language SQL statement after, create several lists corresponding with described target matrix in the stored data base of being expert at, and create the unified view of correspondence; Wherein, each row with described target matrix are corresponding one by one respectively in described several lists;
When described Database Systems receive the request that data in the described target matrix in described row stored data base that the user submits to process, described Database Systems are carried out respective handling according to the corresponding unified view of target matrix of ask processing to the data in respective list.
2. the method for claim 1, is characterized in that, described Database Systems are expert at and are created several lists corresponding with described target matrix in stored data base, are specially:
Described Database Systems are by resolving the described table SQL statement of building, and obtain each row name that is listed as in the table name of target matrix and this table;
Described Database Systems create the list with the number of columns equal number of described target matrix in described row stored data base; Wherein, described list comprises two row at least, and wherein row are used for the storage line sign, and another row are used for the data of the respective column of storage target matrix; The table name of described list is corresponding with the row name of the table name of described target matrix and respective column.
3. the method for claim 1, is characterized in that, also comprises:
Described Database Systems receive target matrix in the Delete Row stored data base that the user submits to delete the table SQL statement after, the unified view that deletion is corresponding, and the list corresponding with described target matrix in the Delete Row stored data base.
4. method as claimed in claim 3, is characterized in that, the list corresponding with described target matrix in described Database Systems Delete Row stored data base is specially:
Described Database Systems obtain the table name of target matrix by resolving the described table SQL statement of deleting, and obtain corresponding row name according to the table name of described target matrix;
List corresponding to row name described in the described row stored data base of described Database Systems deletion.
5. method as described in one of claim 1-4, is characterized in that, the described request that data in described target matrix in described row stored data base are processed comprises:
Data query request, data are inserted request, data removal request or Data Update request.
6. Database Systems, is characterized in that, comprising:
Receiver module, the stored data base of being expert at that is used for reception user submission creates the request of building list structure query language SQL statement and the data in the described target matrix in described row stored data base being processed of target matrix;
Emulation module, be used for when described receiver module receive the stored data base establishment target matrix of being expert at that the user submits to build list structure query language SQL statement after, being expert at creates several lists corresponding with described target matrix in stored data base, and creates the unified view of correspondence; Wherein, each row with described target matrix are corresponding one by one respectively in described several lists;
Processing module, be used for when described receiver module receives the request that the data in the described target matrix of described row stored data base of user's submission process, described Database Systems are carried out respective handling according to the corresponding unified view of target matrix of ask processing to the data in respective list.
7. Database Systems as claimed in claim 6, is characterized in that, described emulation module specifically is used for, and by resolving the described table SQL statement of building, obtains each row name that is listed as in the table name of target matrix and this table; The list of the number of columns equal number of establishment and described target matrix in described row stored data base; Wherein, described list comprises two row at least, and wherein row are used for the storage line sign, and another row are used for the data of the respective column of storage target matrix; The table name of described list is corresponding with the row name of the table name of described target matrix and respective column.
8. Database Systems as claimed in claim 6, it is characterized in that, described emulation module also is used for, when described receiver module receive target matrix in the Delete Row stored data base that the user submits to delete the table SQL statement after, the unified view that deletion is corresponding, and the list corresponding with described target matrix in the Delete Row stored data base.
9. Database Systems as claimed in claim 8, is characterized in that, described emulation module specifically is used for, and by resolving the described table SQL statement of deleting, obtains the table name of target matrix, and obtain corresponding row name according to the table name of described target matrix; Delete list corresponding to the name of row described in described row stored data base.
10. as the described Database Systems of claim 6-9 any one, it is characterized in that, the request that the data in the described target matrix in described row stored data base that described receiver module receives are processed comprises: data query request, data are inserted request, data removal request or Data Update request.
CN201110447629.7A 2011-12-26 2011-12-26 A kind of data processing method based on row storage data base and equipment Active CN103177046B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110447629.7A CN103177046B (en) 2011-12-26 2011-12-26 A kind of data processing method based on row storage data base and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110447629.7A CN103177046B (en) 2011-12-26 2011-12-26 A kind of data processing method based on row storage data base and equipment

Publications (2)

Publication Number Publication Date
CN103177046A true CN103177046A (en) 2013-06-26
CN103177046B CN103177046B (en) 2016-06-29

Family

ID=48636927

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110447629.7A Active CN103177046B (en) 2011-12-26 2011-12-26 A kind of data processing method based on row storage data base and equipment

Country Status (1)

Country Link
CN (1) CN103177046B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016041481A1 (en) * 2014-09-17 2016-03-24 Huawei Technologies Co., Ltd. Statement based migration for adaptively building and updating column store database from row store database based on query demands using disparate database systems
CN106815353A (en) * 2017-01-20 2017-06-09 星环信息科技(上海)有限公司 A kind of method and apparatus of data query
CN108984719A (en) * 2018-07-10 2018-12-11 上海达梦数据库有限公司 Data-erasure method, device, server and storage medium based on column storage
CN110019026A (en) * 2017-07-24 2019-07-16 北京京东尚科信息技术有限公司 A kind of method and apparatus of file clean-up
CN111984671A (en) * 2020-07-27 2020-11-24 北京天健源达科技股份有限公司 Method for generating view creating script
US12013826B2 (en) 2020-11-17 2024-06-18 Coupang Corp. Systems and methods for database query efficiency improvement

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2040180A1 (en) * 2007-09-24 2009-03-25 Hasso-Plattner-Institut für Softwaresystemtechnik GmbH ETL-less zero-redundancy system and method for reporting OLTP data
US20100088309A1 (en) * 2008-10-05 2010-04-08 Microsoft Corporation Efficient large-scale joining for querying of column based data encoded structures
CN102214215A (en) * 2011-06-07 2011-10-12 陆嘉恒 Rapid reverse nearest neighbour search method based on text information
US20110264667A1 (en) * 2010-04-27 2011-10-27 Stavros Harizopoulos Column-oriented storage in a row-oriented database management system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2040180A1 (en) * 2007-09-24 2009-03-25 Hasso-Plattner-Institut für Softwaresystemtechnik GmbH ETL-less zero-redundancy system and method for reporting OLTP data
US20100088309A1 (en) * 2008-10-05 2010-04-08 Microsoft Corporation Efficient large-scale joining for querying of column based data encoded structures
US20110264667A1 (en) * 2010-04-27 2011-10-27 Stavros Harizopoulos Column-oriented storage in a row-oriented database management system
CN102214215A (en) * 2011-06-07 2011-10-12 陆嘉恒 Rapid reverse nearest neighbour search method based on text information

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
于胜利 等: "基于行存储模型的模拟列存储策略研究", 《计算机研究与发展》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016041481A1 (en) * 2014-09-17 2016-03-24 Huawei Technologies Co., Ltd. Statement based migration for adaptively building and updating column store database from row store database based on query demands using disparate database systems
US10671594B2 (en) 2014-09-17 2020-06-02 Futurewei Technologies, Inc. Statement based migration for adaptively building and updating a column store database from a row store database based on query demands using disparate database systems
CN106815353A (en) * 2017-01-20 2017-06-09 星环信息科技(上海)有限公司 A kind of method and apparatus of data query
CN106815353B (en) * 2017-01-20 2020-02-21 星环信息科技(上海)有限公司 Data query method and equipment
CN110019026A (en) * 2017-07-24 2019-07-16 北京京东尚科信息技术有限公司 A kind of method and apparatus of file clean-up
CN110019026B (en) * 2017-07-24 2022-02-01 北京京东尚科信息技术有限公司 File cleaning method and device
CN108984719A (en) * 2018-07-10 2018-12-11 上海达梦数据库有限公司 Data-erasure method, device, server and storage medium based on column storage
CN108984719B (en) * 2018-07-10 2021-08-03 上海达梦数据库有限公司 Data deleting method and device based on column storage, server and storage medium
CN111984671A (en) * 2020-07-27 2020-11-24 北京天健源达科技股份有限公司 Method for generating view creating script
CN111984671B (en) * 2020-07-27 2023-09-12 北京天健源达科技股份有限公司 Method for generating view script
US12013826B2 (en) 2020-11-17 2024-06-18 Coupang Corp. Systems and methods for database query efficiency improvement

Also Published As

Publication number Publication date
CN103177046B (en) 2016-06-29

Similar Documents

Publication Publication Date Title
US9965504B2 (en) Transient and persistent representation of a unified table metadata graph
US10725987B2 (en) Forced ordering of a dictionary storing row identifier values
US9690799B2 (en) Unified architecture for hybrid database storage using fragments
US10474648B2 (en) Migration of unified table metadata graph nodes
CN103177046B (en) A kind of data processing method based on row storage data base and equipment
CN103810219B (en) Line storage database-based data processing method and device
US9898551B2 (en) Fast row to page lookup of data table using capacity index
US7836063B2 (en) Customizable data translation method and system
US9684702B2 (en) Database redistribution utilizing virtual partitions
CN101582767B (en) Authorization control method and authorization server
CN111767303A (en) Data query method and device, server and readable storage medium
CN104516967A (en) Electric power system mass data management system and use method thereof
CN104685496A (en) Pruning disk blocks of a clustered table in a relational database management system
CA3154438A1 (en) Commodity content data processing method,platform and system
US9348833B2 (en) Consolidation for updated/deleted records in old fragments
CN105243162A (en) Relational database storage-based objective data model query method and device
US9734173B2 (en) Assignment of data temperatures in a fragmented data set
CN106708996A (en) Method and system for full text search of relational database
CN106528898A (en) Method and device for converting data of non-relational database into relational database
US8700679B2 (en) Classic to in-memory cube conversion
CN112912870A (en) Tenant identifier conversion
CN106503040B (en) It is applicable in the KV database and its creation method of SQL query method
US9213716B2 (en) Hierarchical indicies
CN113946565B (en) Method and system for supporting heterogeneous data database and table migration
CN112052240A (en) HBase secondary memory index construction method based on coprocessor

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant