CN105653628B - A kind of querying method of the column storage database based on inverted index - Google Patents
A kind of querying method of the column storage database based on inverted index Download PDFInfo
- Publication number
- CN105653628B CN105653628B CN201510995756.9A CN201510995756A CN105653628B CN 105653628 B CN105653628 B CN 105653628B CN 201510995756 A CN201510995756 A CN 201510995756A CN 105653628 B CN105653628 B CN 105653628B
- Authority
- CN
- China
- Prior art keywords
- key
- column
- data
- storage database
- condition query
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/221—Column-oriented storage; Management thereof
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to field of database query technology, the querying method of especially a kind of column storage database based on inverted index, include the following steps, step S101: indexed mode definition, the value for the column being indexed will be needed to be converted to the key of concordance list, and using the key of its corresponding data as the column of concordance list, the row of falling of data mapping relations is realized；Step S102: condition query Context resolution parses the key of the former tables of data in index column family when carrying out condition query；Step S103: condition query in former tables of data, obtains corresponding content according to the key inquired, to realize the condition query of column storage database according to the key that step S102 is parsed.After adopting the above method, the present invention, by the corresponding relationship of original key and column family, is converted to the corresponding relationship of index column and data key by way of reversion index, to realize the condition query of column storage database, the perfect function of column storage database.
Description
Technical field
The present invention relates to field of database query technology, especially a kind of column storage database based on inverted index is looked into
Inquiry method.
Background technique
With the rise of big data, various NoSQL databases flourish, and mainly include key assignments storing data library, column
Storing data library, Document image analysis, four major class of graphic data base.Wherein with the with the fastest developing speed of column storage class, for
For column storage database, its main feature is that a key is directed toward multiple column families, column family itself also has certain hierarchical structure, such as
HBase, Cassandra etc., to realize the storage to complex data type.Column storage database type selecting is abundant, but it has
Natural drawback, that is, lack for column family condition query support, only support the unidirectional inquiry based on key.
Chinese invention patent CN 101404013A discloses a kind of storage of large data volume table of database and querying method, leads to
Atabase Physical Design and logical design are crossed to realize the storage " subregion " of mass data table, and is independent of database itself
It is no to have partitioning technique；This method according to the reasonable rule of the design of some characteristics specific to table of settling accounts day, according to rule come pair
Table definition carries out " subregion " design, makes to be recorded in and thinks that " distribution " automatic in database insertion process designs, makes to be recorded in data
Automatic " distribution " is into different storages " subregion " in the insertion process of library；Day checkout table after " subregion " is created according to rule design
Joint view is built, provides query function by joint view, the day checkout table being achieved has significantly on data query
Advantage, and for table space, there are the databases that size limits, and will not lead to data because day checkout table data volume is huge
Library table space reaches the upper limit and can not solve.
Summary of the invention
The technical problem to be solved in the invention provides a kind of querying method of column storage database based on inverted index.
In order to solve the above technical problems, the issuer of a kind of column storage database based on inverted index of the invention
Method includes the following steps,
Step S101: indexed mode definition will need the value for the column being indexed to be converted to the key of concordance list, and its is right
Column of the key for the data answered as concordance list realize the row of falling of data mapping relations；
Step S102: condition query Context resolution parses the former tables of data in index column family when carrying out condition query
Key；
Step S103: condition query obtains in former tables of data according to the key inquired according to the key that step S102 is parsed
Corresponding content is taken, to realize the condition query of column storage database.
Further, when the step S102 is specifically included in progress condition query, the value of condition is converted in inquiry
Hold, corresponding key is inquired in concordance list, obtains the related content of its column family, parses the former tables of data in index column family
Key.
After adopting the above method, the present invention is based on the index supports to key of column storage database itself, by inverting rope
The corresponding relationship of original key and column family is converted to the corresponding relationship of index column and data key by the mode drawn, to realize
The condition query of column storage database, the perfect function of column storage database.
Detailed description of the invention
Below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.
Fig. 1 is a kind of flow chart of the querying method of the column storage database based on inverted index of the present invention.
Specific embodiment
As shown in Figure 1, a kind of querying method of column storage database based on inverted index of the invention, including following step
Suddenly,
Step S101: indexed mode definition will need the value for the column being indexed to be converted to the key of concordance list, and its is right
Column of the key for the data answered as concordance list realize the row of falling of data mapping relations；
Step S102: condition query Context resolution parses the former tables of data in index column family when carrying out condition query
Key；
Step S103: condition query obtains in former tables of data according to the key inquired according to the key that step S102 is parsed
Corresponding content is taken, to realize the condition query of column storage database.
Further, when the step S102 is specifically included in progress condition query, the value of condition is converted in inquiry
Hold, corresponding key is inquired in concordance list, obtains the related content of its column family, parses the former tables of data in index column family
Key.
It is as follows to suppose there is former tables of data content:
Table 1: former tables of data
| key | Family:qualifier |
| k1 | F1:q1 |
| k1 | F2:q2 |
| k2 | F1:q1 |
The built-in index for key of column storage database, so very easily key can be inquired, but can not be right
Column family is inquired, it is therefore desirable to processing is indexed to the column family slightly to be inquired, to generate following inverted index table.
Table 2: inverted index table
| key | Family:qualifier |
| q1 | F1:k1 |
| q1 | F1:k2 |
| q2 | F2:k1 |
When needing to being indexed column family and inquiring, inquiry inverted index table first obtains corresponding key in tables of data,
Then it is gone to inquire actual data according to key.
Although specific embodiments of the present invention have been described above, those skilled in the art should be appreciated that this
It is merely illustrative of, various changes or modifications can be made to present embodiment, without departing from the principle and essence of invention, originally
The protection scope of invention is only limited by the claims that follow.
Claims (1)
1. a kind of querying method of the column storage database based on inverted index, which is characterized in that include the following steps,
Step S101: indexed mode definition will need the value for the column being indexed to be converted to the key of concordance list, and its is corresponding
Column of the key of data as concordance list realize the row of falling of data mapping relations；
Step S102: condition query Context resolution parses the former tables of data in index column family when carrying out condition query
Key；
Step S103: condition query, according to the key that step S102 is parsed, in former tables of data, according to the key acquisition pair inquired
The content answered, to realize the condition query of column storage database；
When the step S102 is specifically included in progress condition query, the value of condition is converted into inquiry content, in concordance list
Corresponding key is inquired, the related content of its column family is obtained, parses the key of the former tables of data in index column family.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510995756.9A CN105653628B (en) | 2015-12-28 | 2015-12-28 | A kind of querying method of the column storage database based on inverted index |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510995756.9A CN105653628B (en) | 2015-12-28 | 2015-12-28 | A kind of querying method of the column storage database based on inverted index |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105653628A CN105653628A (en) | 2016-06-08 |
| CN105653628B true CN105653628B (en) | 2019-08-13 |
Family
ID=56476911
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510995756.9A Active CN105653628B (en) | 2015-12-28 | 2015-12-28 | A kind of querying method of the column storage database based on inverted index |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105653628B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112559514B (en) * | 2019-09-25 | 2023-04-25 | 上海哔哩哔哩科技有限公司 | Information processing method and system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727465A (en) * | 2008-11-03 | 2010-06-09 | 中国移动通信集团公司 | Methods for establishing and inquiring index of distributed column storage database, device and system thereof |
| CN104111955A (en) * | 2013-04-22 | 2014-10-22 | 中国银联股份有限公司 | Combined inquiring method oriented to Hbase database |
-
2015
- 2015-12-28 CN CN201510995756.9A patent/CN105653628B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727465A (en) * | 2008-11-03 | 2010-06-09 | 中国移动通信集团公司 | Methods for establishing and inquiring index of distributed column storage database, device and system thereof |
| CN104111955A (en) * | 2013-04-22 | 2014-10-22 | 中国银联股份有限公司 | Combined inquiring method oriented to Hbase database |
Non-Patent Citations (1)
| Title |
|---|
| 解析PHP函数array_flip()在重复数组元素删除中的作用;无;《脚本之家》;20130627;正文 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105653628A (en) | 2016-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6535031B2 (en) | Data query method and apparatus | |
| EP3026579B1 (en) | Forced ordering of a dictionary storing row identifier values | |
| Whitman et al. | Spatial indexing and analytics on Hadoop | |
| CN103761318B (en) | A kind of method and system of relationship type synchronization of data in heterogeneous database | |
| JP6964384B2 (en) | Methods, programs, and systems for the automatic discovery of relationships between fields in a mixed heterogeneous data source environment. | |
| CN105260464B (en) | The conversion method and device of data store organisation | |
| Arora et al. | Modeling and querying data in mongodb | |
| US11288287B2 (en) | Methods and apparatus to partition a database | |
| CN104484471A (en) | Implementation method of high-performance data storage engine | |
| CN105279281A (en) | Internet-of-things data access method | |
| CN105760505A (en) | Hive-based historical data analysis and archiving method | |
| CN112214472A (en) | Meteorological grid point data storage and query method, device and storage medium | |
| CN112685446A (en) | Complex SQL query method, device, processor and storage medium through Elasticissearch database | |
| CN113468204A (en) | Data query method, device, equipment and medium | |
| CN103092992A (en) | Vector data preorder quadtree coding and indexing method based on Key / Value type NoSQL (Not only SQL) | |
| CN104239470A (en) | Distributed environment-oriented space data compound processing system and method | |
| CN105653628B (en) | A kind of querying method of the column storage database based on inverted index | |
| US10877959B2 (en) | Integrated database table access | |
| Jiang et al. | Vector spatial big data storage and optimized query based on the multi-level Hilbert grid index in HBase | |
| CN108959330B (en) | Database processing and data query method and device | |
| Haque et al. | Distributed RDF triple store using hbase and hive | |
| CN106649310B (en) | Data acquisition method and device | |
| He et al. | An LSM-tree index for spatial data | |
| Liu et al. | An optimized SFC approach for nD window querying on point clouds | |
| KR101679011B1 (en) | Method and Apparatus for moving data in DBMS |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 410013 Room 605, 6th Floor, N Unit, Luguyuyuan A4, 27 Wenxuan Road, Changsha High-tech Development Zone, Hunan Province Applicant after: Hunan ant software Limited by Share Ltd Address before: 410003 Room 607, Building A4, Lugu Enterprise Plaza, Changsha High-tech Zone, Hunan Province Applicant before: Hunan Yi Fang softcom limited |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |