CN103902701B - A kind of data-storage system and storage method - Google Patents
A kind of data-storage system and storage method Download PDFInfo
- Publication number
- CN103902701B CN103902701B CN201410126062.7A CN201410126062A CN103902701B CN 103902701 B CN103902701 B CN 103902701B CN 201410126062 A CN201410126062 A CN 201410126062A CN 103902701 B CN103902701 B CN 103902701B
- Authority
- CN
- China
- Prior art keywords
- data
- index
- data entry
- storage
- entry
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2272—Management thereof
Abstract
The invention discloses a kind of data-storage system and storage method, belongs to database processing technical field.This method includes：Index list is constructed according to the inquiry mode to the Data Entry in the first data storage；Each index in the index list is stored in the second data storage；Each Data Entry is obtained from the first data storage, acquired Data Entry is stored into the second data storage, wherein in the second data storage, each Data Entry includes the unique mark of Data Entry and associated data content；One or more associated Data Entry is determined according to the inquiry mode corresponding with each index, obtains the Data Entry identification list associated with index；The Data Entry identification list associated with each index is stored into the second data storage in association with the index name each indexed.The present invention can improve the search efficiency to business datum.
Description
Technical field
The invention belongs to database processing technical field, and in particular to a kind of data-storage system and storage method.
Background technology
The implementation of traditional data storage and access is generally based on relevant database or is based on nosql numbers
According to the distributed caching in storehouse.For relevant database implementation, data storage is in the disk of relevant database, application
Program accesses the data in database by sql sentences.Because the grammer of sql sentences is very flexible, therefore can support a variety of
Complex query under the conditions of sequence and a variety of packets, i.e., it can support the inquiry business of complexity.But relevant database needs
Data consistency is safeguarded, and safeguards a large amount of incidence relations, and data storage causes data query speed slow on hard disk, it is special
It is not that can have a strong impact on search efficiency in the case of high concurrent access.
For nosql database implementations, data are with key-value（key-value）To mode be stored in internal memory.
Under this implementation, because data storage is in internal memory, access speed is fast, and passes through standard api（Application programming connects
Mouthful）It is easy to use to obtain data.But this implementation can not support the complexity of a variety of sequences and multiple combinations condition well
Inquiry, the inquiry business of complexity can not be supported.
It can be seen that the implementation of above two data storage and access respectively has quality.And how to support complicated inquiry industry
Data access efficiency is improved on the premise of business, just turns into technical problem urgently to be resolved hurrily.
The content of the invention
In view of the above problems, it is proposed that the present invention so as to provide one kind overcome above mentioned problem or at least in part solve on
State the data-storage system and storage method of problem.
According to an aspect of the invention, there is provided a kind of date storage method, suitable for the first data storage will be come from
Data Entry store into the second data storage, this method includes：
It is every in index list according to the inquiry mode construction index list to the Data Entry in the first data storage
A kind of individual corresponding inquiry mode of index；
Each index in the index list is stored in the second data storage, wherein each index includes identifying the rope
The index name drawn；
Each Data Entry is obtained from the first data storage, acquired Data Entry is stored to the second data and deposited
In reservoir, wherein in the second data storage, each Data Entry includes the unique mark of Data Entry and associated
Data content；
One or more associated Data Entry is determined according to the inquiry mode corresponding with each index, and is determined
Unique mark of each Data Entry in the second data storage, obtain the Data Entry identification list associated with the index；
And
The Data Entry identification list associated with each index is stored in association with the index name each indexed
Into the second data storage.
Alternatively, the basis constructs index list, bag to the inquiry mode of the Data Entry in the first data storage
Include：
Sorted lists are established according to the sorting query mode to Data Entry, and according to the Querying by group side to Data Entry
Formula establishes group list；
Cartesian product is carried out according to sorted lists and group list, constructs the index list.
Alternatively, the index name is identified including sorting query mode and identified with Querying by group mode；
In second data storage, the unique mark of each Data Entry is deposited for the Data Entry in the first data
Unique mark in reservoir, and data content are the content obtained after each field of Data Entry is serialized.
Alternatively, the index name also includes data key values type；
In second data storage, the unique mark of each Data Entry also includes data key values type, and
Data content is the content obtained after each field corresponding with data key values type of Data Entry is serialized；
Wherein, the data key values type is used to identify key value information, and the key assignments is the one or more of Data Entry
Field name.
Alternatively, methods described also includes：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments, wherein described
Key assignments is one or more field names of Data Entry；
Index name is determined according to inquiry mode, the data associated with index name are searched from the second data storage
Entry identification list, and associated data are obtained from the second data storage according to the Data Entry identification list found
Content；
The data content got serialize, and obtained in the content after serializing is gone corresponding with key assignments
Content returns to application server.
Alternatively, methods described also includes：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments；
Index name is determined according to inquiry mode and key assignments, searched from the second data storage associated with index name
Data Entry identification list, and obtained from the second data storage according to the Data Entry identification list found associated
Data content；
The data content got serialize, the content after serializing will be gone to return to application server.
Alternatively, the Data Entry in the first data storage is stored in a manner of relevant database；And
Index in second data storage using index name as key, using associated Data Entry identification list as value
Key-value mode is stored, and Data Entry using the unique mark of Data Entry as key, using associated data content as value
Key-value mode stored.
According to another aspect of the present invention, there is provided a kind of data-storage system, suitable for the first data storage will be come from
Data Entry store into the second data storage, the system includes：
Index list structural unit, suitable for constructing rope according to the inquiry mode to the Data Entry in the first data storage
Draw list, each index in index list corresponds to a kind of inquiry mode；
Index storage unit, suitable for storing each index in the index list in the second data storage, wherein often
Individual index includes the index name for identifying the index；
Data Entry memory cell, suitable for obtaining each Data Entry from the first data storage, by acquired number
According to entry storage into the second data storage, wherein in the second data storage, each Data Entry includes Data Entry
Unique mark and associated data content；And
Associative cell, suitable for determining one or more associated number according to the inquiry mode corresponding with each index
According to entry, and unique mark of each Data Entry in the second data storage is determined, obtain the data associated with the index
Entry identification list；
Wherein, the index storage unit be configured to by the Data Entry identification list associated with each index with it is every
The index name of individual index stores into the second data storage in association.
Alternatively, the index list structural unit is configured to：
Sorted lists are established according to the sorting query mode to Data Entry, and according to the Querying by group side to Data Entry
Formula establishes group list；
Cartesian product is carried out according to sorted lists and group list, constructs the index list.
Alternatively, the index name is identified including sorting query mode and identified with Querying by group mode；
In second data storage, the unique mark of each Data Entry is deposited for the Data Entry in the first data
Unique mark in reservoir, and data content are the content obtained after each field of Data Entry is serialized.
Alternatively, the index name also includes data key values type；
In second data storage, the unique mark of each Data Entry also includes data key values type, and
Data content is the content obtained after each field corresponding with data key values type of Data Entry is serialized；
Wherein, the data key values type is used to identify key value information, and the key assignments is the one or more of Data Entry
Field name.
Alternatively, second data storage also includes query interface, and the query interface is configured to：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments, wherein described
Key assignments is one or more field names of Data Entry；
Index name is determined according to inquiry mode, the data associated with index name are searched from the second data storage
Entry identification list, and associated data are obtained from the second data storage according to the Data Entry identification list found
Content；
The data content got serialize, and obtained in the content after serializing is gone corresponding with key assignments
Content returns to application server.
Alternatively, second data storage also includes query interface, and the query interface is configured to：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments；
Index name is determined according to inquiry mode and key assignments, searched from the second data storage associated with index name
Data Entry identification list, and obtained from the second data storage according to the Data Entry identification list found associated
Data content；
The data content got serialize, the content after serializing will be gone to return to application server.
Alternatively, the Data Entry in the first data storage is stored in a manner of relevant database；And
Index in second data storage using index name as key, using associated Data Entry identification list as value
Key-value mode is stored, and Data Entry using the unique mark of Data Entry as key, using associated data content as value
Key-value mode stored.
According to another aspect of the invention, there is provided a kind of data query system, including the first data storage, data hair
Cloth server and the second data storage, wherein, the data distribution server includes above-mentioned data-storage system.
According to the said one of the present invention or multiple technical schemes, synchronous calculating is replaced by using off-line calculation, and it is whole
The advantages of closing traditional Relational DataBase and nosql databases, both having met will to the function of business datum progress complex query
Ask, solve the problems, such as again relatively low based on traditional Relational DataBase search efficiency, in particular improve under high concurrent environment
Efficiency data query.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, it is various other the advantages of and benefit it is common for this area
Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：
Fig. 1 shows the structural representation of data query system according to an embodiment of the invention；
Fig. 2 shows the structural representation of data-storage system according to an embodiment of the invention；And
Fig. 3 shows the schematic flow sheet of date storage method according to an embodiment of the invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Fig. 1 shows the structural representation of data query system according to an embodiment of the invention.Reference picture 1, this hair
The data query system of bright embodiment can include：First data storage 100, the data of data distribution server 20 and second are deposited
Reservoir 300, wherein data distribution server 20 respectively with the first data storage 100 and the communication link of the second data storage 300
Connect, and data distribution server 20 includes data-storage system 200, i.e. data-storage system 200 resides in data publication service
In device 20.
Data-storage system 200 100 can obtain each Data Entry from the first data storage, by acquired number
According to entry storage into the second data storage 300, wherein in the second data storage 300, each Data Entry includes number
Unique mark and associated data content according to entry.Data-storage system 200 can also be according to the first data storage
The various inquiry modes construction index list of Data Entry in device 100（The corresponding a kind of inquiry of each index in index list
Mode）, and each index in the index list is stored into the second data storage 300, wherein in the second data storage
In device 300, each index includes identifying the index name of the index and associated Data Entry identification list.
According to the above-mentioned processing of data-storage system 200, equivalent to being previously-completed under various inquiry modes to first
The inquiry of Data Entry in data storage 100, and Query Result is stored in the second data storage 300, that is, use from
Line computation instead of traditional synchronous calculating.So, when application server 400 needs to inquire about in the first data storage 100
During Data Entry, Query Result directly can be obtained from the query interface of the second data storage 300 offer, due to not needing
Calculated in real time according to specific inquiry mode, therefore improve data query speed.Specifically, the query interface receives
During the inquiry request sent to application server 400, rope is first determined according to the inquiry mode information carried in the inquiry request
Draw title, then obtained according to index name from the second data storage 200 corresponding to Data Entry identification list, last root
Data Entry set corresponding to being obtained according to the Data Entry identification list got from the second data storage 200.
First data storage 100 can be relevant database, such as Oracle, DB2, Microsoft SQL
Server and MySQL etc.；Second data storage 200 can be the no sql databases of key-value mode, such as redis data
Storehouse.In such cases, the data query system just incorporates the advantages of traditional Relational DataBase and nosql databases, both full
Foot carries out the functional requirement of complex query to business datum, solves again relatively low based on traditional Relational DataBase search efficiency
The problem of, in particular improve the efficiency data query under high concurrent environment.Wherein, redis is a key-value storages system
System, it supports the value types of storage to include string（Character string）、list（Chained list）、set（Set）、sorted set（Have
Ordered sets）And hash（Hash）Type.These data types all support push/pop, add/remove and take common factor, union and
Difference set and operation is waited, and these operations are all atomicities.
The specific composition and operation principle of the data-storage system 200 in above-mentioned data query system are carried out in detail below
Description.
Fig. 2 shows the structural representation of data-storage system according to an embodiment of the invention.The data storage system
System 200 may reside within data distribution server 20, the data distribution server 20 respectively with the first data storage 100
Communicated to connect with the second data storage 300, by the data-storage system 200, can will come from the first data storage
100 Data Entry is stored into the second data storage 300, so as to complete the issue of data.Wherein, the first data storage
100 can be relevant database, such as Oracle, DB2, Microsoft SQL Server and MySQL etc.；Second data are deposited
Reservoir 200 can be the no sql databases of key-value mode, such as redis databases.
Reference picture 2, the data-storage system 200 of the embodiment of the present invention can include：Index list structural unit 210, rope
Draw memory cell 220, Data Entry memory cell 230 and associative cell 240.
In view of the use actual conditions to business datum, the data query mode used in reality be it is limited, because
This, index list structural unit 210 can be according to the various inquiry mode structures to the Data Entry in the first data storage 100
Make index list, that is to say, that index list includes multiple indexes, a kind of each corresponding inquiry mode of index.
Sorting query mode is generally comprised to the inquiry mode of Data Entry（order by）With Querying by group mode
（group by）, and combination.Order by and group by quantity are limited, and most order
By with group by are used together, and therefore, index list structural unit 210 can be looked into first according to the sequence to Data Entry
Inquiry mode establishes sorted lists, and establishes group list according to the Querying by group mode to Data Entry, then, according to Sorted list
Table and group list carry out cartesian product, to construct the index list.Certainly, can also to the inquiry mode of Data Entry
It is other inquiry modes of the prior art, is even possible to other inquiry modes occurred, the embodiment of the present invention pair in the future
This is not limited.
After the construction complete index list of index list structural unit 210, index storage unit 220 can deposit in the second data
Each index in the index list is stored in reservoir 300, wherein each index include the mark index index name and
The Data Entry identification list associated with the index.In specific implementation, index storage unit 220 can be first by index name
As key（key）Store in second memory 300, corresponding value（vlaue）It is temporarily sky.Subsequently, associative cell 240 is passed through
After determining Data Entry identification list corresponding to index name, then using the Data Entry identification list as value and corresponding index
The associated storage of title is into the second data storage 300.For example, for redis databases, the type of corresponding value can be with
Using ordered set（sorted set）, that is, what the Data Entry mark in the Data Entry identification list stored was ordered into, its
Order inquiry mode as corresponding to index is determined.
In one implementation, the index name identifies including sorting query mode（orderID）And Querying by group
Mode identifies（groupID）.In another implementation, the index name includes data key values type, sorting query side
Formula identifies and Querying by group mode identifies.Wherein, the data key values type is used to identify key value information, and the key assignments is data
One or more field names of entry.In specific implementation, the data key values type can directly use the key assignments,
Can be the value after being encoded to key assignments, and the embodiment of the present invention is not limited to specific coded system.
For example, it is assumed that Data Entry has 4 fields, field name is respectively A, B, C, D, the key assignments of user's inquiry for A,
C }, then the value such as 2 after the data key values type can be { A, C } or be encoded to { A, C }.
Data Entry memory cell 230 is suitable to obtain each Data Entry from the first data storage 100, by acquired in
Data Entry store into the second data storage 300, wherein in the second data storage 300, each Data Entry bag
Include the unique mark of Data Entry and associated data content.Such as redis databases, each Data Entry be with
The unique mark of Data Entry is stored as key using associated data content as value.
When the index name identifies including sorting query mode to be identified with Querying by group mode, then deposited in the second data
In reservoir 300, the unique mark of each Data Entry is unique mark of the Data Entry in the first data storage 100,
Associated data content is the content obtained after each field of Data Entry is serialized.For example, when the first data
When memory 100 is relevant database, the unique mark can be the major key of Data Entry.
Wherein, serializing is carried out to each field of Data Entry to refer to：Each field of the Data Entry is taken out successively
Value, be combined into a sequence using the value of each field as a sequence Item, and between each sequence Item with separator for example
Comma is split；Or the value of each field of the Data Entry is taken out successively, by the title of each field and the value of field
A sequence is combined into as a sequence Item, and with decollator such as colon point between the title of field and the value of field
Cut, split between each sequence Item with separator such as comma.
For example, it is assumed that Data Entry has 4 fields, field name is respectively A, B, C, D, and corresponding field value is respectively a,
B, c, d, the then content obtained after being serialized are { a, b, c, d }, or are { A：A, B：B, C：C, D：d}.
When the index name includes data key values type, sorting query mode identifies and Querying by group mode identifies,
Then in the second data storage 300, the unique mark of each Data Entry is the Data Entry in the first data storage 100
In unique mark, associated data content is that Data Entry each field corresponding with data key values type is carried out into sequence
The content obtained after rowization.For example, when the first data storage 100 is relevant database, the unique mark can be number
According to the major key of entry.
For example, it is assumed that Data Entry has 4 fields, field name is respectively A, B, C, D, and corresponding field value is respectively a,
B, c, d, data key values type are { A, C }, then the content obtained after being serialized is { a, c }, or is { A：A, C：c}.
Associative cell 240 be suitable to determine to be associated according to the inquiry mode corresponding with each index one or more
Data Entry, and unique mark of each Data Entry in the second data storage 300 is determined, obtain associated with the index
Data Entry identification list.
A kind of each corresponding inquiry mode of index, for every kind of inquiry mode, associative cell 240 can construct to be looked into accordingly
Sentence is ask to obtain corresponding Data Entry from the first data storage 100.For example, work as first data storage
100 when being relevant database, and associative cell 240 can be according to inquiry mode constructing SQL statement, according to the SQL statement of construction
First data storage 100 is operated, so as to obtain Data Entry corresponding with the inquiry mode.SQL statement shows
Under such as：
Select*from table name sort by A group by B.
After associative cell 240 gets one or more Data Entries associated with the index, it is determined that each data strip
The major key of purpose unique mark, for example, Data Entry, so as to obtain the Data Entry identification list associated with the index, so
Afterwards, the index name that index storage unit 220 can be by the Data Entry identification list associated with each index with each indexing
Title stores into the second data storage 300 in association.In this way, just by the index stored in the second data storage and the rope
Data Entry set associative corresponding to drawing gets up.
Data-storage system 200 according to embodiments of the present invention, synchronous calculating is replaced by using off-line calculation, effectively
Improve the search efficiency of data.For example, can configuration querying interface, application service in second data storage 300
Device 400 need not access the first data storage 100 and be calculated in real time, but directly please with inquiry to obtain from query interface
Corresponding Data Entry is sought, in this way, avoiding the complicated inquiry computing to Data Entry in the first data storage 100, is carried
High inquiry velocity.
As it was previously stated, in one implementation, the index name of 300 storages is looked into including sequence in the second data storage
Inquiry mode identifies to be identified with Querying by group mode；In another implementation, the index name include data key values type,
Sorting query mode identifies to be identified with Querying by group mode.
Corresponding to two kinds of above-mentioned implementations, the mode that the query interface obtains inquiry data also has two kinds.One
In kind implementation, the process that query interface obtains data is：
The inquiry request from application server 400 is obtained, the inquiry request includes inquiry mode and key assignments；
Index name is determined according to inquiry mode, searched from the second data storage 300 associated with index name
Data Entry identification list, and correlation is obtained from the second data storage 300 according to the Data Entry identification list found
The data content of connection；
The data content got serialize, and obtained in the content after serializing is gone corresponding with key assignments
Content returns to application server 400.
Wherein, the inverse process that serializing is serializing is removed, it is easy before that it implements process those skilled in the art
The serialization process stated determines.
In another implementation, the process that query interface obtains data is：
The inquiry request from application server 400 is obtained, the inquiry request includes inquiry mode and key assignments；
Index name is determined according to inquiry mode and key assignments, searched and index name phase from the second data storage 300
The Data Entry identification list of association, and obtained according to the Data Entry identification list found from the second data storage 300
Take associated data content；
The data content got serialize, the content after serializing will be gone to return to application server 400.
One difference of two kinds of implementations is：In the first implementation, the content gone after serializing is whole
The content of Data Entry, it is also necessary to returned again to after therefrom obtaining content corresponding with key assignments to application server；It is real at second
In existing mode, the content gone after serializing is content corresponding with key assignments in Data Entry, can be directly returned to application service
Device.
Fig. 3 shows the schematic flow sheet of date storage method according to an embodiment of the invention, the data storage side
Method is suitable to store into the second data storage from the Data Entry of the first data storage, wherein the first data storage
Can be relevant database, for example, Oracle, DB2, Microsoft SQL Server and MySQL etc., the second data storage
Device can be the no sql databases of key-value mode, such as redis databases.
Reference picture 3, the data storage method can include：
Step S310, index list, index are constructed according to the inquiry mode to the Data Entry in the first data storage
Each index in list corresponds to a kind of inquiry mode；
Sorting query mode is generally comprised to the inquiry mode of Data Entry（order by）With Querying by group mode
（group by）, and combination.Order by and group by quantity are limited, and most order
By with group by are used together, and therefore, can establish sorted lists in a manner of the first sorting query according to Data Entry,
And group list is established according to the Querying by group mode to Data Entry；Then, flute is carried out according to sorted lists and group list
Karr product, construct the index list.Certainly, the inquiry mode to Data Entry can also be that of the prior art other are looked into
Inquiry mode, is even possible to other inquiry modes occurred in the future, and the embodiment of the present invention is without limitation.
Step S320, each index in the index list is stored in the second data storage；
In the second data storage, each index includes the index name of the mark index and associated with the index
Data Entry identification list.In this step, can be first using index name as key（key）Store in second memory,
Corresponding value（vlaue）It is temporarily sky.After Data Entry identification list corresponding to index name is determined in subsequent steps,
Again using the Data Entry identification list storage associated with corresponding index name as value into second memory.For example,
For redis databases, the type of corresponding value can use ordered set（sorted set）, that is, the data strip target that is stored
Know what the mark of the Data Entry in list was ordered into, its order inquiry mode as corresponding to index is determined.
In one implementation, the index name identifies including sorting query mode（orderID）And Querying by group
Mode identifies（groupID）.In another implementation, the index name includes data key values type, sorting query side
Formula identifies and Querying by group mode identifies.Wherein, the data key values type is used to identify key value information, and the key assignments is data
One or more field names of entry.In specific implementation, the data key values type can directly use the key assignments,
Can be the value after being encoded to key assignments, and the embodiment of the present invention is not limited to specific coded system.
Step S330, each Data Entry is obtained from the first data storage, acquired Data Entry storage is arrived
In second data storage；
In the second data storage, each Data Entry includes the unique mark of Data Entry and associated data
Content.Such as redis databases, each Data Entry is using the unique mark of Data Entry as key, with what is be associated
Data content is stored as value.
When the index name identifies including sorting query mode to be identified with Querying by group mode, then deposited in the second data
In reservoir, the unique mark of each Data Entry is unique mark of the Data Entry in the first data storage, is associated
Data content be obtained content after each field of Data Entry is serialized.For example, when the first data storage
For relevant database when, the unique mark can be Data Entry major key.
When the index name includes data key values type, sorting query mode identifies and Querying by group mode identifies,
Then in the second data storage, the unique mark of each Data Entry for the Data Entry in the first data storage only
One mark, after Data Entry each field corresponding with data key values type is to be serialized to associated data content
Obtained content.For example, when the first data storage is relevant database, the unique mark can be the master of Data Entry
Key.
Step S340, one or more associated data strip is determined according to the inquiry mode corresponding with each index
Mesh, and unique mark of each Data Entry in the second data storage is determined, obtain the Data Entry associated with the index
Identification list；
A kind of each corresponding inquiry mode of index, for every kind of inquiry mode, can construct corresponding query statement come from
Corresponding Data Entry is obtained in first data storage.For example, when first data storage is relevant database
When, first data storage can be operated according to the SQL statement of construction according to inquiry mode constructing SQL statement,
So as to obtain Data Entry corresponding with the inquiry mode.
After getting one or more Data Entries associated with the index, each Data Entry is further determined
The major key of unique mark, for example, Data Entry, so as to obtain the Data Entry identification list associated with the index.
Step S350 is related with the index name each indexed by the Data Entry identification list associated to each index
The storage of connection ground is into the second data storage, in this way, just that the index stored in the second data storage is corresponding with the index
Data Entry set associative gets up.
Date storage method according to embodiments of the present invention, synchronous calculating is replaced by using off-line calculation, is effectively carried
The high search efficiency of data.For example, configuration querying interface, application server it can be not required in second data storage
Access the first data storage to be calculated in real time, but data corresponding with inquiry request are directly obtained from query interface
Entry, in this way, avoiding the complicated inquiry computing to Data Entry in the first data storage, improve inquiry velocity.
That is, the date storage method of the embodiment of the present invention can also comprise the following steps：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments, wherein described
Key assignments is one or more field names of Data Entry；
Index name is determined according to inquiry mode, the data associated with index name are searched from the second data storage
Entry identification list, and associated data are obtained from the second data storage according to the Data Entry identification list found
Content；
The data content got serialize, and obtained in the content after serializing is gone corresponding with key assignments
Content returns to application server.
Or the date storage method of the embodiment of the present invention can also comprise the following steps：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments；
Index name is determined according to inquiry mode and key assignments, searched from the second data storage associated with index name
Data Entry identification list, and obtained from the second data storage according to the Data Entry identification list found associated
Data content；
The data content got serialize, the content after serializing will be gone to return to application server.
An application example of the invention given below.
In the application example, car dealer makes a price reduction ranking list data storage in traditional relevant database,
The car data entry stored in the relevant database includes following field name：
DealerId SpecId SpecName SpecImage SeriesId SeriesName BrandId
FactoryId
NewsId NewsType NewsTitle StartDate EndDate DTime Price OriginalPrice
PriceOffPercent OrdersLastMonth OrdersLastQuarter CreateTime
ModifyTime
PID CID SID KindId NewsTemplateId serieslevel InventoryState
PriceScope EquipCarId PackageName PackagePrice IsRecommend PriceW
IsLastWeek
3 Data Entries being exemplified below in the relevant database：
Data Entry 1：1104632012 sections of S53.0T Sportback~/upload/2013/7/19/l_
201307191945189324136.jpg2734 existing preferential 9.46 ten thousand yuan of the car abundance highests of S5337982664710 Audi of Audi S5
2013-12-3100:00:00.0002014-01-0500:00:00.0002013-12-3110:35:
33.7236334007280001319512013-12-3110:55:002013-12-3110:55:
00110000110100110105126713904070000641
Data Entry 2：1107712013 sections of S64.0TFSI~/upload/2013/4/19/l_
201304191833167634435.jpg2736 existing preferential 6.93 ten thousand yuan of the car abundance highests of S6337982665410 Audi of Audi S6
2013-12-3100:00:00.0002014-01-0500:00:00.0002013-12-3110:37:
12.510988700105800079712013-12-3110:55:002013-12-3110:55:
001100001101001101051267142950100000991
Data Entry 3：1122032012 sections of 30FSI are poly-talented~/upload/spec/12203/l_
201207041848360214178.jpg18 existing preferential 11.13 ten thousand yuan of the car abundance highests of A6L33982664130 Audi of Audi A6L
2013-12-3100:00:00.0002014-01-0500:00:00.0002013-12-3110:34:
25.46738090043280012170052013-12-2418:55:002013-12-3110:55:
00110000110100110105126713595050000391
The process issued to above-mentioned price reduction ranking list data is as follows：
（1）According to the inquiry mode to Data Entry in the price reduction ranking list data, sorted lists are constructed（Order by）
It is as follows:
As can be seen that in the sorted lists constructed, include 8 kinds of sorting query modes.
Construct group list（group by）It is as follows
new string[]{"BrandId","SeriesId","SpecId","PID","CID","BrandId,
PID","BrandId,CID","SeriesId,PID","SeriesId,CID","SpecId,PID","SeriesLevel"}
As can be seen that in the group list constructed, include 11 kinds of Querying by group modes.
Then, to the two progress cartesian product, multiple combinations are obtained, number of combinations is 8*11=88, i.e., in index list
Including 88 indexes, corresponding 88 kinds of inquiry modes.
（2）It is stored in every kind of querying condition as the key of index in redis databases, then key is：
"Promotion(PriceOffPercent desc,LessPrice desc,DTime desc|SpecId,
PID)"
Corresponding sorting query condition：
"PriceOffPercent desc,LessPrice desc,DTime desc"
Corresponding Querying by group condition：
"SpecId,PID"
（3）In redis databases in a manner of key-value data storage entry key values and value values, example is such as
Under：
Wherein, value values are to be serialized to generate according to type of service Promotion, and the partial code serialized is such as
Under：
（4）According to（2）Inquiry mode corresponding to the key acquisitions of middle generation, according to the inquiry mode got, from relationship type
Data Entry corresponding with the inquiry mode is obtained in database, and determines these Data Entries in redis databases
Key, obtain key lists.
（5）By storage associated with corresponding key lists the key of each index into redis databases, index is realized
With associating for Data Entry, so as to complete the issue of data.
Afterwards, it is possible to provide the api interface for data query to application server, inquire about the example of api interface such as
Under：
List<Promotion>list=Redis<Promotion>.Instance.GetData("
PriceOffPercent desc,LessPrice desc,DTime desc","SpecId,PID0").ToList();
Corresponding GetData methods are realized as follows：
After above-mentioned data-storage system on-line running, it is found that dealer makes a price reduction the tps of ranking list data-query interfaces
（Transactions Per Second, number of transactions/second）1023088 are brought up to from original 6714, performance obtains significantly
Lifting.
Algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment provided herein.
Various general-purpose systems can also be used together with teaching based on this.As described above, required by constructing this kind of system
Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It should be understood that it can utilize various
Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the specification that this place provides, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention
Example can be put into practice in the case of these no details.In some instances, known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help to understand one or more of each inventive aspect,
Above in the description to the exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：I.e. required guarantor
The application claims of shield features more more than the feature being expressly recited in each claim.It is more precisely, such as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following embodiment are expressly incorporated in the embodiment, wherein each claim is in itself
Separate embodiments all as the present invention.
Those skilled in the art, which are appreciated that, to be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodiment
Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or
Sub-component.In addition at least some in such feature and/or process or unit exclude each other, it can use any
Combination is to this specification（Including adjoint claim, summary and accompanying drawing）Disclosed in all features and so disclosed appoint
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification（Including adjoint power
Profit requirement, summary and accompanying drawing）Disclosed in each feature can be by providing the alternative features of identical, equivalent or similar purpose come generation
Replace.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included some features rather than further feature, but the combination of the feature of different embodiments means in of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
One of meaning mode can use in any combination.
The all parts embodiment of the present invention can be realized with hardware, or to be run on one or more processor
Software module realize, or realized with combinations thereof.It will be understood by those of skill in the art that it can use in practice
Microprocessor or digital signal processor（DSP）Come realize in data-storage system according to embodiments of the present invention some or
The some or all functions of person's whole part.The present invention is also implemented as perform method as described herein one
Divide either whole equipment or program of device（For example, computer program and computer program product）.It is such to realize this hair
Bright program can store on a computer-readable medium, or can have the form of one or more signal.It is such
Signal can be downloaded from internet website and obtained, and either provided on carrier signal or provided in the form of any other.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability
Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between bracket should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of some different elements and being come by means of properly programmed computer real
It is existing.In if the unit claim of equipment for drying is listed, several in these devices can be by same hardware branch
To embody.The use of word first, second, and third does not indicate that any order.These words can be explained and run after fame
Claim.
A1, a kind of date storage method, suitable for the Data Entry from the first data storage is stored to the second data
In memory, this method includes：
It is every in index list according to the inquiry mode construction index list to the Data Entry in the first data storage
A kind of individual corresponding inquiry mode of index；
Each index in the index list is stored in the second data storage, wherein each index includes identifying the rope
The index name drawn；
Each Data Entry is obtained from the first data storage, acquired Data Entry is stored to the second data and deposited
In reservoir, wherein in the second data storage, each Data Entry includes the unique mark of Data Entry and associated
Data content；
One or more associated Data Entry is determined according to the inquiry mode corresponding with each index, and is determined
Unique mark of each Data Entry in the second data storage, obtain the Data Entry identification list associated with the index；
And
The Data Entry identification list associated with each index is stored in association with the index name each indexed
Into the second data storage.
A2, the date storage method as described in A1, wherein, the basis is to the Data Entry in the first data storage
Inquiry mode constructs index list, including：
Sorted lists are established according to the sorting query mode to Data Entry, and according to the Querying by group side to Data Entry
Formula establishes group list；
Cartesian product is carried out according to sorted lists and group list, constructs the index list.
A3, the date storage method as described in A2, wherein, the index name is identified and is grouped including sorting query mode
Inquiry mode identifies；
In second data storage, the unique mark of each Data Entry is deposited for the Data Entry in the first data
Unique mark in reservoir, and data content are the content obtained after each field of Data Entry is serialized.
A4, the date storage method as described in A3, wherein, the index name also includes data key values type；
In second data storage, the unique mark of each Data Entry also includes data key values type, and
Data content is the content obtained after each field corresponding with data key values type of Data Entry is serialized；
Wherein, the data key values type is used to identify key value information, and the key assignments is the one or more of Data Entry
Field name.
A5, the date storage method as described in A3, wherein, in addition to：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments, wherein described
Key assignments is one or more field names of Data Entry；
Index name is determined according to inquiry mode, the data associated with index name are searched from the second data storage
Entry identification list, and associated data are obtained from the second data storage according to the Data Entry identification list found
Content；
The data content got serialize, and obtained in the content after serializing is gone corresponding with key assignments
Content returns to application server.
A6, the date storage method as described in A4, wherein, in addition to：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments；
Index name is determined according to inquiry mode and key assignments, searched from the second data storage associated with index name
Data Entry identification list, and obtained from the second data storage according to the Data Entry identification list found associated
Data content；
The data content got serialize, the content after serializing will be gone to return to application server.
A7, the date storage method as described in A1, wherein, the Data Entry in the first data storage is with relational data
Storehouse mode is stored；And
Index in second data storage using index name as key, using associated Data Entry identification list as value
Key-value mode is stored, and Data Entry using the unique mark of Data Entry as key, using associated data content as value
Key-value mode stored.
B1, a kind of data-storage system, suitable for the Data Entry from the first data storage is stored to the second data
In memory, the system includes：
Index list structural unit, suitable for constructing rope according to the inquiry mode to the Data Entry in the first data storage
Draw list, each index in index list corresponds to a kind of inquiry mode；
Index storage unit, suitable for storing each index in the index list in the second data storage, wherein often
Individual index includes the index name for identifying the index；
Data Entry memory cell, suitable for obtaining each Data Entry from the first data storage, by acquired number
According to entry storage into the second data storage, wherein in the second data storage, each Data Entry includes Data Entry
Unique mark and associated data content；And
Associative cell, suitable for determining one or more associated number according to the inquiry mode corresponding with each index
According to entry, and unique mark of each Data Entry in the second data storage is determined, obtain the data associated with the index
Entry identification list；
Wherein, the index storage unit be configured to by the Data Entry identification list associated with each index with it is every
The index name of individual index stores into the second data storage in association.
B2, the data-storage system as described in B1, wherein, the index list structural unit is configured to：
Sorted lists are established according to the sorting query mode to Data Entry, and according to the Querying by group side to Data Entry
Formula establishes group list；
Cartesian product is carried out according to sorted lists and group list, constructs the index list.
B3, the data-storage system as described in claim B2, wherein, the index name includes sorting query mode mark
Know and Querying by group mode identifies；
In second data storage, the unique mark of each Data Entry is deposited for the Data Entry in the first data
Unique mark in reservoir, and data content are the content obtained after each field of Data Entry is serialized.
B4, the data-storage system as described in claim B3, wherein, the index name also includes data key values class
Type；
In second data storage, the unique mark of each Data Entry also includes data key values type, and
Data content is the content obtained after each field corresponding with data key values type of Data Entry is serialized；
Wherein, the data key values type is used to identify key value information, and the key assignments is the one or more of Data Entry
Field name.
B5, the data-storage system as described in claim B3, wherein, second data storage also connects including inquiry
Mouthful, the query interface is configured to：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments, wherein described
Key assignments is one or more field names of Data Entry；
Index name is determined according to inquiry mode, the data associated with index name are searched from the second data storage
Entry identification list, and associated data are obtained from the second data storage according to the Data Entry identification list found
Content；
The data content got serialize, and obtained in the content after serializing is gone corresponding with key assignments
Content returns to application server.
B6, the data-storage system as described in claim B4, wherein, second data storage also connects including inquiry
Mouthful, the query interface is configured to：
The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments；
Index name is determined according to inquiry mode and key assignments, searched from the second data storage associated with index name
Data Entry identification list, and obtained from the second data storage according to the Data Entry identification list found associated
Data content；
The data content got serialize, the content after serializing will be gone to return to application server.
B7, the data-storage system as described in claim B1, wherein, Data Entry in the first data storage is to close
It is that type database mode is stored；And
Index in second data storage using index name as key, using associated Data Entry identification list as value
Key-value mode is stored, and Data Entry using the unique mark of Data Entry as key, using associated data content as value
Key-value mode stored.
C1, a kind of data query system, including the first data storage, data distribution server and the second data storage
Device, wherein, the data distribution server includes the data-storage system as any one of claim B1 to B7.
Claims (11)
- A kind of 1. date storage method, suitable for the Data Entry from the first data storage is stored to the second data storage In, first data storage is relevant database, and second data storage is the no sql data of key-value formula Storehouse, it includes query interface, and the query interface is suitable to receive the inquiry request that application server is sent, acquisition and inquiry request Corresponding Data Entry simultaneously returns to application server, and this method includes：Index list is constructed according to the inquiry mode to the Data Entry in the first data storage：According to the row to Data Entry Sequence inquiry mode establishes sorted lists, and establishes group list according to the Querying by group mode to Data Entry；According to Sorted list Table and group list carry out cartesian product, construct the index list, the corresponding a kind of inquiry of each index in index list Mode；Each index in the index list is stored in the second data storage, wherein each index includes identifying the index Index name, index in the second data storage using index name as key, using associated Data Entry identification list as value Key-value mode stored；Each Data Entry is obtained from the first data storage, by acquired Data Entry storage to the second data storage In, wherein in the second data storage, each Data Entry includes the unique mark of Data Entry and associated data Content, Data Entry are deposited by the unique mark of Data Entry for key, in a manner of associated data content is the key-value of value Storage；One or more associated Data Entry is determined according to the inquiry mode corresponding with each index, and determines each number According to unique mark of the entry in the second data storage, the Data Entry identification list associated with the index is obtained；AndThe Data Entry identification list associated with each index is stored with the index name each indexed in association to the In two data storages.
- 2. date storage method as claimed in claim 1, wherein, the index name is identified and divided including sorting query mode Group polling mode identifies；In second data storage, the unique mark of each Data Entry is the Data Entry in the first data storage In unique mark, and data content is obtained content after each field of Data Entry is serialized.
- 3. date storage method as claimed in claim 2, wherein, the index name also includes data key values type；In second data storage, the unique mark of each Data Entry also includes data key values type, and data Content is the content obtained after each field corresponding with data key values type of Data Entry is serialized；Wherein, the data key values type is used to identify key value information, and key assignments is one or more field names of Data Entry.
- 4. date storage method as claimed in claim 2, wherein, in addition to：The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments, wherein the key assignments For one or more field names of Data Entry；Index name is determined according to inquiry mode, the Data Entry associated with index name is searched from the second data storage Identification list, and obtained according to the Data Entry identification list found from the second data storage in associated data Hold；The data content got serialize, and content corresponding with key assignments is obtained in the content after serializing is gone Return to application server.
- 5. date storage method as claimed in claim 3, wherein, in addition to：The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments；Index name is determined according to inquiry mode and key assignments, the number associated with index name is searched from the second data storage Associated number is obtained from the second data storage according to entry identification list, and according to the Data Entry identification list found According to content；The data content got serialize, the content after serializing will be gone to return to application server.
- A kind of 6. data-storage system, suitable for the Data Entry from the first data storage is stored to the second data storage In, first data storage is relevant database, and second data storage is the no sql data of key-value formula Storehouse, it includes query interface, and the query interface is suitable to receive the inquiry request that application server is sent, acquisition and inquiry request Corresponding Data Entry simultaneously returns to application server, and the system includes：Index list structural unit, suitable for constructing index column according to the inquiry mode to the Data Entry in the first data storage Table：Sorted lists are established according to the sorting query mode to Data Entry, and built according to the Querying by group mode to Data Entry Vertical group list；Cartesian product is carried out according to sorted lists and group list, constructs the index list, in index list A kind of each corresponding inquiry mode of index；Index storage unit, suitable for storing each index in the index list in the second data storage, wherein each rope Draw the index name including identifying the index, the index in the second data storage using index name as key, with associated number Stored according to entry identification list for the key-value mode of value；Data Entry memory cell, suitable for obtaining each Data Entry from the first data storage, by acquired data strip Mesh is stored into the second data storage, wherein in the second data storage, each Data Entry includes Data Entry only One mark and associated data content, Data Entry using the unique mark of Data Entry as key, with associated data Hold and stored for the key-value mode of value；AndAssociative cell, suitable for determining one or more associated data strip according to the inquiry mode corresponding with each index Mesh, and unique mark of each Data Entry in the second data storage is determined, obtain the Data Entry associated with the index Identification list；Wherein, the index storage unit is configured to the Data Entry identification list associated with each index and each rope The index name drawn stores into the second data storage in association.
- 7. data-storage system as claimed in claim 6, wherein, the index name is identified and divided including sorting query mode Group polling mode identifies；In second data storage, the unique mark of each Data Entry is the Data Entry in the first data storage In unique mark, and data content is obtained content after each field of Data Entry is serialized.
- 8. data-storage system as claimed in claim 7, wherein, the index name also includes data key values type；In second data storage, the unique mark of each Data Entry also includes data key values type, and data Content is the content obtained after each field corresponding with data key values type of Data Entry is serialized；Wherein, the data key values type is used to identify key value information, and key assignments is one or more field names of Data Entry.
- 9. data-storage system as claimed in claim 7, wherein, the query interface is configured to：The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments, wherein the key assignments For one or more field names of Data Entry；Index name is determined according to inquiry mode, the Data Entry associated with index name is searched from the second data storage Identification list, and obtained according to the Data Entry identification list found from the second data storage in associated data Hold；The data content got serialize, and content corresponding with key assignments is obtained in the content after serializing is gone Return to application server.
- 10. data-storage system as claimed in claim 8, wherein, the query interface is configured to：The inquiry request from application server is obtained, the inquiry request includes inquiry mode and key assignments；Index name is determined according to inquiry mode and key assignments, the number associated with index name is searched from the second data storage Associated number is obtained from the second data storage according to entry identification list, and according to the Data Entry identification list found According to content；The data content got serialize, the content after serializing will be gone to return to application server.
- 11. a kind of data query system, including the first data storage, data distribution server and the second data storage, its In, the data distribution server includes the data-storage system as any one of claim 6-10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410126062.7A CN103902701B (en) | 2014-03-31 | 2014-03-31 | A kind of data-storage system and storage method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410126062.7A CN103902701B (en) | 2014-03-31 | 2014-03-31 | A kind of data-storage system and storage method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103902701A CN103902701A (en) | 2014-07-02 |
| CN103902701B true CN103902701B (en) | 2017-12-29 |
Family
ID=50994023
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410126062.7A Active CN103902701B (en) | 2014-03-31 | 2014-03-31 | A kind of data-storage system and storage method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103902701B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI819943B (en) * | 2022-12-30 | 2023-10-21 | 康和綜合證券股份有限公司 | Device and method for generating a data index, and computer program product thereof |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10380115B2 (en) | 2015-01-06 | 2019-08-13 | International Business Machines Corporation | Cross column searching a relational database table |
| CN106547786A (en) * | 2015-09-22 | 2017-03-29 | 阿里巴巴集团控股有限公司 | A kind of date storage method and device |
| CN108170726A (en) * | 2015-10-21 | 2018-06-15 | 华为技术有限公司 | Data query method and apparatus |
| CN105956140B (en) * | 2016-05-12 | 2019-03-22 | 无锡威泰迅电力科技有限公司 | The method that data are locally stored based on mixed mode mobile application |
| CN108206933B (en) * | 2016-12-16 | 2020-05-15 | 杭州海康威视数字技术股份有限公司 | Video data acquisition method and device based on video cloud storage system |
| CN107679136A (en) * | 2017-09-22 | 2018-02-09 | 上海携程商务有限公司 | The storage method and storage system of slide fastener table |
| CN110019553A (en) * | 2017-12-21 | 2019-07-16 | 北京奇虎科技有限公司 | Processing method, device and the computer readable storage medium of Recommendations data |
| CN108874873B (en) * | 2018-04-26 | 2022-04-12 | 北京空间科技信息研究所 | Data query method, device, storage medium and processor |
| CN110201393A (en) * | 2019-05-29 | 2019-09-06 | 北京金山安全软件有限公司 | Configuration data storage method and device and electronic equipment |
| CN110609839B (en) * | 2019-09-17 | 2021-05-25 | 北京海益同展信息科技有限公司 | Method, device and equipment for processing block chain data and readable storage medium |
| CN112069175B (en) * | 2020-08-25 | 2024-03-29 | 北京五八信息技术有限公司 | Data query method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5727197A (en) * | 1995-11-01 | 1998-03-10 | Filetek, Inc. | Method and apparatus for segmenting a database |
| CN101110074A (en) * | 2007-01-30 | 2008-01-23 | 浪潮乐金信息系统有限公司 | Data speedup query method based on file system caching |
| CN102222099A (en) * | 2011-06-21 | 2011-10-19 | 中兴通讯股份有限公司 | Methods and devices for storing and searching data |
| CN103631907A (en) * | 2013-11-26 | 2014-03-12 | 中国科学院信息工程研究所 | Method and system for migrating relational data to HBbase |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103177027B (en) * | 2011-12-23 | 2016-02-17 | 北京新媒传信科技有限公司 | Obtain the method and system of dynamic Feed index |
| CN102867070A (en) * | 2012-09-29 | 2013-01-09 | 瑞庭网络技术（上海）有限公司 | Method for updating cache of key-value distributed memory system |
-
2014
- 2014-03-31 CN CN201410126062.7A patent/CN103902701B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5727197A (en) * | 1995-11-01 | 1998-03-10 | Filetek, Inc. | Method and apparatus for segmenting a database |
| CN101110074A (en) * | 2007-01-30 | 2008-01-23 | 浪潮乐金信息系统有限公司 | Data speedup query method based on file system caching |
| CN102222099A (en) * | 2011-06-21 | 2011-10-19 | 中兴通讯股份有限公司 | Methods and devices for storing and searching data |
| CN103631907A (en) * | 2013-11-26 | 2014-03-12 | 中国科学院信息工程研究所 | Method and system for migrating relational data to HBbase |
Non-Patent Citations (1)
| Title |
|---|
| spreadsheet as a relational database engine;Jerzy Tyszkiewic;《Proceedings of the 2010 ACM SIGMOD International Conference on Management of data 》;20100731;第2010年卷;全文 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI819943B (en) * | 2022-12-30 | 2023-10-21 | 康和綜合證券股份有限公司 | Device and method for generating a data index, and computer program product thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103902701A (en) | 2014-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103902701B (en) | A kind of data-storage system and storage method | |
| CN103902702B (en) | A kind of data-storage system and storage method | |
| CN103902698A (en) | Data storage system and data storage method | |
| US9805079B2 (en) | Executing constant time relational queries against structured and semi-structured data | |
| CN108280365B (en) | Data access authority management method, device, terminal device and storage medium | |
| CN104685498B (en) | The hardware implementation mode of polymerization/division operation：Hash table method | |
| US9547664B2 (en) | Selecting candidate rows for deduplication | |
| CN104090962B (en) | Towards the nested query method of magnanimity distributed data base | |
| CN109416694A (en) | The key assignments storage system effectively indexed including resource | |
| CN106202548A (en) | Date storage method, lookup method and device | |
| CN104281664B (en) | Distributed figure computing system data segmentation method and system | |
| CN105683956A (en) | Densely grouping dimensional data | |
| CN103927607A (en) | Data processing method and device | |
| CN106055621A (en) | Log retrieval method and device | |
| WO2014000578A1 (en) | Method and apparatus for processing database data in distributed database system | |
| CN104504008B (en) | A kind of Data Migration algorithm based on nested SQL to HBase | |
| CN106462633B (en) | Efficiently storing related sparse data in a search index | |
| CN109087121A (en) | Marketing message release platform construction method and device | |
| EP2812815A1 (en) | Web page retrieval method and device | |
| CN106294418B (en) | Search method and searching system | |
| CN106095964A (en) | A kind of method that data are carried out visualization filing and search | |
| CN106599153A (en) | Multi-data-source-based waste industry search system and method | |
| CN104794130B (en) | Relation query method and device between a kind of table | |
| CN105117442A (en) | Probability based big data query method | |
| CN111639253A (en) | Data duplication judging method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C53 | Correction of patent for invention or patent application | ||
| CB02 | Change of applicant information |
Address after: 100080 Beijing city Haidian District Danleng Street No. 3 floor 11 block B room 1109 Applicant after: BEIJING PIERRE BLANEY SOFTWARE CO., LTD. Address before: 100080 Beijing city Haidian District Danleng Street No. 3 floor 11 block B room 1109 Applicant before: BEIJING CHESHANGHUI SOFTWARE CO., LTD. |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: APPLICANT; FROM: BEIJING CHESHANGHUI SOFTWARE CO., LTD. TO: BEIJING PIER BULAINI SOFTWARE CO., LTD. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |