CN103902701A - Data storage system and data storage method - Google Patents
Data storage system and data storage method Download PDFInfo
- Publication number
- CN103902701A CN103902701A CN201410126062.7A CN201410126062A CN103902701A CN 103902701 A CN103902701 A CN 103902701A CN 201410126062 A CN201410126062 A CN 201410126062A CN 103902701 A CN103902701 A CN 103902701A
- Authority
- CN
- China
- Prior art keywords
- data
- index
- carrier store
- content
- inquiry mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2272—Management thereof
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data storage system and a data storage method and belongs to the technical field of database processing. The data storage method includes: constructing an index list according to a querying manner for data entries in a first data storage unit; storing every index in the index list into a second data storage unit; acquiring data entries from the first data storage unit; storing the acquired data entries into the second storage unit, wherein the second data storage unit, each data entry contains a unique data entry identification and related data content; determining related one or more data entries according to a querying manner corresponding to each index and acquiring a data entry identification list related to the indexes; relatedly storing the data entry identification list related to each index and a name of each index into the second storage unit. The data storage system and the data storage method have the advantage that query efficiency for business data can be increased.
Description
Technical field
The invention belongs to database processing technical field, be specifically related to a kind of data-storage system and storage means.
Background technology
The implementation of traditional data storage and access is generally based on relevant database or the distributed caching based on nosql database.For relevant database implementation, data are stored in the disk of relevant database, and application program is by the data in sql statement accessing database.Because the grammer of sql statement is very flexible, therefore can support the complex query under multiple sequence and multiple point of set condition, can support complicated inquiry business.But relevant database needs service data consistance, and safeguard a large amount of incidence relations, and data are stored on hard disk, cause data query speed slow, particularly in high Concurrency Access situation, can have a strong impact on search efficiency.
For nosql database implementation, data are stored in internal memory in the right mode of key-value (key-value).Under this implementation, because data are stored in internal memory, access speed is fast, and by standard api(application programming interface) obtain data and be simple and easy to use.But this implementation cannot well be supported the complex query of multiple sequence and multiple combination condition, cannot support complicated inquiry business.
The implementation of visible above-mentioned two kinds of data storage and access respectively has quality.And how under the prerequisite of supporting complicated inquiry business, to improve data access efficiency, just become technical matters urgently to be resolved hurrily.
Summary of the invention
In view of the above problems, the present invention has been proposed to a kind of overcome the problems referred to above or the data-storage system addressing the above problem at least in part and storage means are provided.
According to an aspect of the present invention, provide a kind of date storage method, be suitable for the data entry from the first data-carrier store to store in the second data-carrier store, the method comprises:
According to the data strip object inquiry mode structure index in the first data-carrier store, the corresponding a kind of inquiry mode of each index in index;
In the second data-carrier store, store the each index in this index, wherein each index comprises the index name that identifies this index;
From the first data-carrier store, obtain each data entry, obtained data entry is stored in the second data-carrier store, wherein, in the second data-carrier store, each data entry comprises data strip object unique identification and the data content being associated;
Determine one or more data entry being associated according to the inquiry mode corresponding with each index, and determine the unique identification of each data entry in the second data-carrier store, obtain the data strip order identification list being associated with this index; And
The index name of the data strip order identification list being associated with each index and each index is stored in the second data-carrier store explicitly.
Alternatively, described basis, to the data strip object inquiry mode structure index in the first data-carrier store, comprising:
Set up sorted lists according to the sequence inquiry mode to data entry, and set up group list according to the grouping inquiry mode to data entry;
Carry out cartesian product according to sorted lists and group list, construct described index.
Alternatively, described index name comprises sequence inquiry mode mark and grouping inquiry mode mark;
In described the second data-carrier store, each data strip object unique identification is the unique identification of this data entry in the first data-carrier store, and data content is that each field of data strip object is carried out to the content obtaining after serializing.
Alternatively, described index name also comprises data key assignments;
In described the second data-carrier store, each data strip object unique identification also comprises data key assignments, and data content is that each corresponding with data key assignments data strip object field is carried out to the content obtaining after serializing;
Wherein, described data key assignments is used for identifying key assignments information, and described key assignments is the one or more field names of data strip object.
Alternatively, described method also comprises:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments, and wherein said key assignments is the one or more field names of data strip object;
Determine index name according to inquiry mode, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, and from go the content serializing, obtain the content of answering with key-value pair and return to application server.
Alternatively, described method also comprises:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments;
Determine index name according to inquiry mode and key assignments, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, will go the content after serializing to return to application server.
Alternatively, the data entry in the first data-carrier store is stored in relevant database mode; And
Index in the second data-carrier store is take index name as key, store take the data strip order identification list that is associated as key-value mode of value, and data entry is take data strip object unique identification as key, store take the data content that is associated as key-value mode of value.
According to a further aspect in the invention, provide a kind of data-storage system, be suitable for the data entry from the first data-carrier store to store in the second data-carrier store, this system comprises:
Index tectonic element, is suitable for according to the data strip object inquiry mode structure index in the first data-carrier store the corresponding a kind of inquiry mode of each index in index;
Index storage unit, is suitable in the second data-carrier store, storing the each index in this index, and wherein each index comprises the index name that identifies this index;
Data entry storage unit, be suitable for obtaining each data entry from the first data-carrier store, obtained data entry is stored in the second data-carrier store, and wherein, in the second data-carrier store, each data entry comprises data strip object unique identification and the data content being associated; And
Associative cell, is suitable for determining according to the inquiry mode corresponding with each index one or more data entry being associated, and determines the unique identification of each data entry in the second data-carrier store, obtains the data strip order identification list being associated with this index;
Wherein, described index storage unit is configured to the index name of the data strip order identification list being associated with each index and each index to store into explicitly in the second data-carrier store.
Alternatively, described index tectonic element is configured to:
Set up sorted lists according to the sequence inquiry mode to data entry, and set up group list according to the grouping inquiry mode to data entry;
Carry out cartesian product according to sorted lists and group list, construct described index.
Alternatively, described index name comprises sequence inquiry mode mark and grouping inquiry mode mark;
In described the second data-carrier store, each data strip object unique identification is the unique identification of this data entry in the first data-carrier store, and data content is that each field of data strip object is carried out to the content obtaining after serializing.
Alternatively, described index name also comprises data key assignments;
In described the second data-carrier store, each data strip object unique identification also comprises data key assignments, and data content is that each corresponding with data key assignments data strip object field is carried out to the content obtaining after serializing;
Wherein, described data key assignments is used for identifying key assignments information, and described key assignments is the one or more field names of data strip object.
Alternatively, described the second data-carrier store also comprises query interface, and described query interface is configured to:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments, and wherein said key assignments is the one or more field names of data strip object;
Determine index name according to inquiry mode, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, and from go the content serializing, obtain the content of answering with key-value pair and return to application server.
Alternatively, described the second data-carrier store also comprises query interface, and described query interface is configured to:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments;
Determine index name according to inquiry mode and key assignments, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, will go the content after serializing to return to application server.
Alternatively, the data entry in the first data-carrier store is stored in relevant database mode; And
Index in the second data-carrier store is take index name as key, store take the data strip order identification list that is associated as key-value mode of value, and data entry is take data strip object unique identification as key, store take the data content that is associated as key-value mode of value.
According to another aspect of the invention, provide a kind of data query system, comprised the first data-carrier store, data distribution server and the second data-carrier store, wherein, described data distribution server comprises above-mentioned data-storage system.
According to above-mentioned one or more technical schemes of the present invention, by adopting calculated off-line to replace synchronous calculating, and the advantage of integrating traditional relevant database and nosql database, both met the functional requirement of business datum being carried out to complex query, solve again the problem lower based on traditional relational Query Efficiency, particularly improved the efficiency data query under high concurrent environment.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to better understand technological means of the present invention, and can be implemented according to the content of instructions, and for above and other objects of the present invention, feature and advantage can be become apparent, below especially exemplified by the specific embodiment of the present invention.
Accompanying drawing explanation
By reading below detailed description of the preferred embodiment, various other advantage and benefits will become cheer and bright for those of ordinary skills.Accompanying drawing is only for the object of preferred implementation is shown, and do not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:
Fig. 1 shows the structural representation of data query system according to an embodiment of the invention;
Fig. 2 shows the structural representation of data-storage system according to an embodiment of the invention; And
Fig. 3 shows the schematic flow sheet of date storage method according to an embodiment of the invention.
Embodiment
Exemplary embodiment of the present disclosure is described below with reference to accompanying drawings in more detail.Although shown exemplary embodiment of the present disclosure in accompanying drawing, but should be appreciated that and can realize the disclosure and the embodiment that should do not set forth limits here with various forms.On the contrary, it is in order more thoroughly to understand the disclosure that these embodiment are provided, and can be by the those skilled in the art that conveys to complete the scope of the present disclosure.
Fig. 1 shows the structural representation of data query system according to an embodiment of the invention.With reference to Fig. 1, the data query system of the embodiment of the present invention can comprise: the first data-carrier store 100, data distribution server 20 and the second data-carrier store 300, wherein data distribution server 20 communicates to connect with the first data-carrier store 100 and the second data-carrier store 300 respectively, and data distribution server 20 comprises data-storage system 200, data-storage system 200 resides in data distribution server 20.
Data-storage system 200 can be from the first data-carrier store 100 obtains each data entry, obtained data entry is stored in the second data-carrier store 300, wherein, in the second data-carrier store 300, each data entry comprises data strip object unique identification and the data content being associated.Data-storage system 200 can also be constructed index (the corresponding a kind of inquiry mode of each index in index) by various inquiry modes according to the data strip object in the first data-carrier store 100, and by the each index stores in this index in the second data-carrier store 300, wherein, in the second data-carrier store 300, each index comprises the data strip order identification list that identifies the index name of this index and be associated.
According to the above-mentioned processing of data-storage system 200, be equivalent to complete in advance under various inquiry modes to data strip object inquiry in the first data-carrier store 100, and Query Result is stored in the second data-carrier store 300, adopt calculated off-line to replace traditional synchronous calculating.Like this, in the time that application server 400 need to be inquired about the data entry in the first data-carrier store 100, the query interface that can directly provide from the second data-carrier store 300 obtains Query Result, owing to not needing the inquiry mode according to concrete to calculate in real time, therefore improve data query speed.Particularly, when described query interface receives the inquiry request that application server 400 sends, first determine index name according to the inquiry mode information of carrying in described inquiry request, then from the second data-carrier store 200, obtain corresponding data strip order identification list according to index name, the data strip order identification list that last basis gets obtains corresponding data entry set from the second data-carrier store 200.
The first data-carrier store 100 can be relevant database, such as Oracle, DB2, Microsoft SQL Server and MySQL etc.; The second data-carrier store 200 can be the no sql database of key-value mode, for example redis database.In such cases, this data query system has just been integrated the advantage of traditional relational database and nosql database, both met the functional requirement of business datum being carried out to complex query, solve again the problem lower based on traditional relational Query Efficiency, particularly improved the efficiency data query under high concurrent environment.Wherein, redis is a key-value storage system, and its supports the value type of storage to comprise string(character string), list(chained list), set(set), sorted set(ordered set) and hash(Hash) type.These data types all support push/pop, add/remove and get common factor, union and difference set and etc. operation, and these operations are all atomicities.
Below concrete formation and the principle of work of the data-storage system 200 in above-mentioned data query system are described in detail.
Fig. 2 shows the structural representation of data-storage system according to an embodiment of the invention.This data-storage system 200 can reside in data distribution server 20, described data distribution server 20 communicates to connect with the first data-carrier store 100 and the second data-carrier store 300 respectively, by described data-storage system 200, can will store in the second data-carrier store 300 from the data entry of the first data-carrier store 100, thereby complete the issue of data.Wherein, the first data-carrier store 100 can be relevant database, such as Oracle, DB2, Microsoft SQL Server and MySQL etc.; The second data-carrier store 200 can be the no sql database of key-value mode, for example redis database.
With reference to Fig. 2, the data-storage system 200 of the embodiment of the present invention can comprise: index tectonic element 210, index storage unit 220, data entry storage unit 230 and associative cell 240.
Consider the use actual conditions to business datum, the data query mode using in reality is limited, therefore, index tectonic element 210 can be constructed index by various inquiry modes according to the data strip object in the first data-carrier store 100, that is to say, index comprises multiple index, the corresponding a kind of inquiry mode of each index.
The inquiry mode of data entry is generally comprised to sequence inquiry mode (order by) and grouping inquiry mode (group by), and the combination of the two.The quantity of order by and group by is limited, and most order by uses together with group by being, therefore, index tectonic element 210 can be first according to the sequence inquiry mode of data entry is set up to sorted lists, and set up group list according to the grouping inquiry mode to data entry, then, carry out cartesian product according to sorted lists and group list, construct described index.Certainly, can be also other inquiry modes of the prior art to the inquiry mode of data entry, or even other inquiry modes that likely occur in the future, the embodiment of the present invention does not limit this.
After index tectonic element 210 construction complete index, index storage unit 220 can be stored the each index in this index in the second data-carrier store 300, and wherein each index comprises the data strip order identification list that identifies the index name of this index and be associated with this index.In the time of specific implementation, index storage unit 220 can first using index name as key, (key) stores in second memory 300, and corresponding value (vlaue) is temporarily empty.Follow-up, determine after the data strip order identification list that index name is corresponding by associative cell 240, then storing in the second data-carrier store 300 that this data strip order identification list is associated with corresponding index name as value.For example, for redis database, the type of corresponding value can adopt ordered set (sorted set), and it is orderly that the data strip target in the data strip order identification list stored is known, and its order is determined by inquiry mode corresponding to index.
In one implementation, described index name comprises sequence inquiry mode mark (orderID) and grouping inquiry mode mark (groupID).In another kind of implementation, described index name comprises data key assignments, sequence inquiry mode mark and grouping inquiry mode mark.Wherein, described data key assignments is used for identifying key assignments information, and described key assignments is the one or more field names of data strip object.In the time of specific implementation, described data key assignments can directly adopt described key assignments, can be also the value after key assignments is encoded, and the embodiment of the present invention does not limit concrete coded system.
For example, tentation data entry has 4 fields, and field name is respectively A, B, C, D, and the key assignments of user inquiry is that { A, C}, described data key assignments can be that { A, C} can be also to the { value after A, C} encode for example 2.
Data entry storage unit 230 is suitable for obtaining each data entry from the first data-carrier store 100, obtained data entry is stored in the second data-carrier store 300, wherein, in the second data-carrier store 300, each data entry comprises data strip object unique identification and the data content being associated.For example, for redis database, each data entry is using data strip object unique identification as key, stores as value using the data content being associated.
In the time that described index name comprises sequence inquiry mode mark and grouping inquiry mode mark, in the second data-carrier store 300, each data strip object unique identification is the unique identification of this data entry in the first data-carrier store 100, and the data content being associated is that each field of data strip object is carried out to the content obtaining after serializing.For example, in the time that the first data-carrier store 100 is relevant database, this unique identification can be data strip object major key.
Wherein, each field of data entry is carried out to serializing and refer to: take out successively the value of this each field of data strip object, the value of each field is combined into a sequence as a sequence item, and cut apart with for example comma of separator between each sequence item; Or, take out successively the value of this each field of data strip object, the value of the title of each field and field is combined into a sequence as a sequence item, and between the title of field and the value of field, cut apart with for example colon of decollator, between each sequence item, cut apart with for example comma of separator.
For example, tentation data entry has 4 fields, and field name is respectively A, B, C, D, and corresponding field value is respectively a, b, and c, d, carries out the content that obtains after serializing for { a, b, c, d}, or be { A:a, B:b, C:c, D:d}.
In the time that described index name comprises data key assignments, sequence inquiry mode mark and grouping inquiry mode mark, in the second data-carrier store 300, each data strip object unique identification is the unique identification of this data entry in the first data-carrier store 100, and the data content being associated is that each corresponding with data key assignments data strip object field is carried out to the content obtaining after serializing.For example, in the time that the first data-carrier store 100 is relevant database, this unique identification can be data strip object major key.
For example, tentation data entry has 4 fields, and field name is respectively A, B, C, D, and corresponding field value is respectively a, b, and c, d, data key assignments be that { A, C}, the content of carrying out obtaining after serializing is { a, c}, or be { A:a, C:c}.
The corresponding a kind of inquiry mode of each index, for every kind of inquiry mode, associative cell 240 can be constructed corresponding query statement and from the first data-carrier store 100, be obtained corresponding data entry.For example, in the time that described the first data-carrier store 100 is relevant database, associative cell 240 can, according to inquiry mode constructing SQL statement, operate described the first data-carrier store 100 according to the SQL statement of structure, thereby obtains the data entry corresponding with this inquiry mode.SQL statement example is as follows:
Select*from table name sort by A group by B.
According to the data-storage system 200 of the embodiment of the present invention, by adopting calculated off-line to replace synchronous calculating, effectively raise the search efficiency of data.For example, can be in described the second data-carrier store 300 configuration querying interface, application server 400 does not need to access the first data-carrier store 100 and calculates in real time, but directly obtain the data entry corresponding with inquiry request from query interface, so, avoid the inquiry computing to data strip object complexity in the first data-carrier store 100, improved inquiry velocity.
As previously mentioned, in one implementation, in the second data-carrier store, the index name of 300 storages comprises sequence inquiry mode mark and grouping inquiry mode mark; In another kind of implementation, described index name comprises data key assignments, sequence inquiry mode mark and grouping inquiry mode mark.
Corresponding to two kinds of above-mentioned implementations, the mode that described query interface obtains data query also has two kinds.In one implementation, query interface obtains the process of data and is:
Obtain the inquiry request from application server 400, described inquiry request comprises inquiry mode and key assignments;
Determine index name according to inquiry mode, from the second data-carrier store 300, search the data strip order identification list being associated with index name, and from the second data-carrier store 300, obtain the data content being associated according to the data strip order identification list finding;
The data content getting is gone to serializing, and from go the content serializing, obtain the content of answering with key-value pair and return to application server 400.
Wherein, going serializing is the inverse process of serializing, and its specific implementation process those skilled in the art easily determine according to aforesaid serializing process.
In another kind of implementation, the process that query interface obtains data is:
Obtain the inquiry request from application server 400, described inquiry request comprises inquiry mode and key assignments;
Determine index name according to inquiry mode and key assignments, from the second data-carrier store 300, search the data strip order identification list being associated with index name, and from the second data-carrier store 300, obtain the data content being associated according to the data strip order identification list finding;
The data content getting is gone to serializing, will go the content after serializing to return to application server 400.
A difference of two kinds of implementations is: in the first implementation, going the content after serializing is whole data strip object content, returns to application server after also needing therefrom to obtain the content of answering with key-value pair again; In the second implementation, going the content after serializing is the content of answering with key-value pair in data entry, can directly return to application server.
Fig. 3 shows the schematic flow sheet of date storage method according to an embodiment of the invention, this date storage method is suitable for the data entry from the first data-carrier store to store in the second data-carrier store, wherein the first data-carrier store can be relevant database, such as Oracle, DB2, Microsoft SQL Server and MySQL etc., the second data-carrier store can be the no sql database of key-value mode, for example redis database.
With reference to Fig. 3, described data-carrier store method can comprise:
Step S310, according to the data strip object inquiry mode structure index in the first data-carrier store, the corresponding a kind of inquiry mode of each index in index;
The inquiry mode of data entry is generally comprised to sequence inquiry mode (order by) and grouping inquiry mode (group by), and the combination of the two.The quantity of order by and group by is limited, and most order by uses together with group by being, therefore, first basis is set up sorted lists to the sequence inquiry mode of data entry, and sets up group list according to the grouping inquiry mode to data entry; Then, carry out cartesian product according to sorted lists and group list, construct described index.Certainly, can be also other inquiry modes of the prior art to the inquiry mode of data entry, or even other inquiry modes that likely occur in the future, the embodiment of the present invention does not limit this.
Step S320 stores the each index in this index in the second data-carrier store;
In the second data-carrier store, each index comprises the data strip order identification list that identifies the index name of this index and be associated with this index.In this step, can first using index name as key, (key) store in second memory, corresponding value (vlaue) temporarily be sky.In follow-up step, determine after the data strip order identification list that index name is corresponding, then using this data strip order identification list as value and storing in second memory that corresponding index name is associated.For example, for redis database, the type of corresponding value can adopt ordered set (sorted set), and it is orderly that the data strip target in the data strip order identification list stored is known, and its order is determined by inquiry mode corresponding to index.
In one implementation, described index name comprises sequence inquiry mode mark (orderID) and grouping inquiry mode mark (groupID).In another kind of implementation, described index name comprises data key assignments, sequence inquiry mode mark and grouping inquiry mode mark.Wherein, described data key assignments is used for identifying key assignments information, and described key assignments is the one or more field names of data strip object.In the time of specific implementation, described data key assignments can directly adopt described key assignments, can be also the value after key assignments is encoded, and the embodiment of the present invention does not limit concrete coded system.
Step S330 obtains each data entry from the first data-carrier store, and obtained data entry is stored in the second data-carrier store;
In the second data-carrier store, each data entry comprises data strip object unique identification and the data content being associated.For example, for redis database, each data entry is using data strip object unique identification as key, stores as value using the data content being associated.
In the time that described index name comprises sequence inquiry mode mark and grouping inquiry mode mark, in the second data-carrier store, each data strip object unique identification is the unique identification of this data entry in the first data-carrier store, and the data content being associated is that each field of data strip object is carried out to the content obtaining after serializing.For example, in the time that the first data-carrier store is relevant database, this unique identification can be data strip object major key.
In the time that described index name comprises data key assignments, sequence inquiry mode mark and grouping inquiry mode mark, in the second data-carrier store, each data strip object unique identification is the unique identification of this data entry in the first data-carrier store, and the data content being associated is that each corresponding with data key assignments data strip object field is carried out to the content obtaining after serializing.For example, in the time that the first data-carrier store is relevant database, this unique identification can be data strip object major key.
Step S340, determines one or more data entry being associated according to the inquiry mode corresponding with each index, and determines the unique identification of each data entry in the second data-carrier store, obtains the data strip order identification list being associated with this index;
The corresponding a kind of inquiry mode of each index, for every kind of inquiry mode, can construct corresponding query statement and from the first data-carrier store, obtain corresponding data entry.For example, in the time that described the first data-carrier store is relevant database, can, according to inquiry mode constructing SQL statement, according to the SQL statement of structure, described the first data-carrier store be operated, thereby obtain the data entry corresponding with this inquiry mode.
Get after the one or more data entries that are associated with this index, more further determine each data strip object unique identification, for example, be data strip object major key, thereby obtain the data strip order identification list being associated with this index.
Step S350, the index name of the data strip order identification list being associated with each index and each index is stored in the second data-carrier store explicitly, so, just data entry set associative corresponding with this index the index of storing in the second data-carrier store is got up.
According to the date storage method of the embodiment of the present invention, by adopting calculated off-line to replace synchronous calculating, effectively raise the search efficiency of data.For example, can be in described the second data-carrier store configuration querying interface, application server does not need to access the first data-carrier store and calculates in real time, but directly obtain the data entry corresponding with inquiry request from query interface, so, avoid the inquiry computing to data strip object complexity in the first data-carrier store, improved inquiry velocity.
That is to say, the date storage method of the embodiment of the present invention can also comprise the steps:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments, and wherein said key assignments is the one or more field names of data strip object;
Determine index name according to inquiry mode, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, and from go the content serializing, obtain the content of answering with key-value pair and return to application server.
Or the date storage method of the embodiment of the present invention can also comprise the steps:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments;
Determine index name according to inquiry mode and key assignments, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, will go the content after serializing to return to application server.
Below provide an application example of the present invention.
In this application example, car dealer makes a price reduction ranking list data and is stored in traditional relevant database, and the car data entry of storing in this relevant database comprises following field name:
DealerId?SpecId?SpecName?SpecImage?SeriesId?SeriesName?BrandId?FactoryId
NewsId?NewsType?NewsTitle?StartDate?EndDate?DTime?Price?OriginalPrice
PriceOffPercent?OrdersLastMonth?OrdersLastQuarter?CreateTime?ModifyTime
PID?CID?SID?KindId?NewsTemplateId?serieslevel?InventoryState
PriceScope?EquipCarId?PackageName?PackagePrice?IsRecommend?PriceW
IsLastWeek
Below enumerate 3 data entries in this relevant database:
The existing the highest preferential 9.46 ten thousand yuan of 2013-12-3100:00:00.0002014-01-0500:00:00.0002013-12-3110 of car abundance of data entry 1:1104632012 money S53.0T Sportback～/S5 of S5337982664710 Audi of upload/2013/7/19/l_201307191945189324136.jpg2734 Audi: 35:33.7236334007280001319512013-12-3110:55:002013-12-311 0:55:00110000110100110105126713904070000641
Existing the highest preferential 6.93 ten thousand yuan of 2013-12-3100:00:00.0002014-01-0500:00:00.0002013-12-3110: 37:12.510988700105800079712013-12-3110:55:002013-12-3110: the 55:001100001101001101051267142950100000991 of car abundance of data entry 2:1107712013 money S64.0TFSI～/S6 of S6337982665410 Audi of upload/2013/4/19/l_201304191833167634435.jpg2736 Audi
Data entry 3:1122032012 money 30FSI is poly-talented～the existing the highest preferential 11.13 ten thousand yuan of 2013-12-3100:00:00.0002014-01-0500:00:00.0002013-12-3110 of the car abundance of/A6L of A6L33982664130 Audi of upload/spec/12203/l_201207041848360214178.jpg18 Audi: and 34:25.46738090043280012170052013-12-2418:55:002013-12-31 10:55:00110000110100110105126713595050000391
The process that above-mentioned price reduction ranking list data are issued is as follows:
(1) basis is to data strip object inquiry mode in these price reduction ranking list data, and structure sorted lists (Order by) is as follows:
Can find out, in constructed sorted lists, include 8 kinds of sequence inquiry modes.
Structure group list (group by) is as follows
new?string[]{"BrandId","SeriesId","SpecId","PID","CID","BrandId,PID","BrandId,CID","SeriesId,PID","SeriesId,CID","SpecId,PID","SeriesLevel"}
Can find out, in constructed group list, include 11 kinds of grouping inquiry modes.
Then, the two is carried out to cartesian product, obtain multiple combinations, number of combinations is 8*11=88, and index comprises 88 index, corresponding 88 kinds of inquiry modes.
(2) key using every kind of querying condition as index is stored in redis database, and key is:
"Promotion(PriceOffPercent?desc,LessPrice?desc,DTime?desc|SpecId,PID)"
Corresponding sequence querying condition:
"PriceOffPercent?desc,LessPrice?desc,DTime?desc"
Corresponding grouping querying condition:
"SpecId,PID"
(3) in redis database, store data strip object key value and value value in key-value mode, example is as follows:
Wherein, value value is to generate according to type of service Promotion serializing, and the partial code that carries out serializing is as follows:
(4) obtain corresponding inquiry mode according to the key generating in (2), according to the inquiry mode getting, from relevant database, obtain the data entry corresponding with this inquiry mode, and determine the key of these data entries in redis database, obtain key list.
(5) by the key of each index and storing in redis database that corresponding key list is associated, realize index associated with data strip object, thereby complete the issue of data.
Afterwards, just can be provided for to application server the api interface of data query, the example of inquiry api interface is as follows:
List<Promotion>list=Redis<Promotion>.Instance.GetData("PriceOffPercent?desc,LessPrice?desc,DTime?desc","SpecId,PID0").ToList();
Corresponding GetData method is achieved as follows:
By after above-mentioned data-storage system on-line running, find that dealer makes a price reduction the tps(Transactions Per Second of ranking list data query interface, number of transactions/second) bring up to 1023088, significantly lifting of performance acquisition from original 6714.
The algorithm providing at this is intrinsic not relevant to any certain computer, virtual system or miscellaneous equipment with demonstration.Various general-purpose systems also can with based on using together with this teaching.According to description above, it is apparent constructing the desired structure of this type systematic.In addition, the present invention is not also for any certain programmed language.It should be understood that and can utilize various programming languages to realize content of the present invention described here, and the description of above language-specific being done is in order to disclose preferred forms of the present invention.
In the instructions that provided herein, a large amount of details are described.But, can understand, embodiments of the invention can be put into practice in the situation that there is no these details.In some instances, be not shown specifically known method, structure and technology, so that not fuzzy understanding of this description.
Similarly, be to be understood that, in order to simplify the disclosure and to help to understand one or more in each inventive aspect, in the above in the description of exemplary embodiment of the present invention, each feature of the present invention is grouped together into single embodiment, figure or sometimes in its description.But, the method for the disclosure should be construed to the following intention of reflection: the present invention for required protection requires than the more feature of feature of clearly recording in each claim.Or rather, as reflected in claims below, inventive aspect is to be less than all features of disclosed single embodiment above.Therefore, claims of following embodiment are incorporated to this embodiment thus clearly, and wherein each claim itself is as independent embodiment of the present invention.
Those skilled in the art are appreciated that and can the module in the equipment in embodiment are adaptively changed and they are arranged in one or more equipment different from this embodiment.Module in embodiment or unit or assembly can be combined into a module or unit or assembly, and can put them in addition multiple submodules or subelement or sub-component.At least some in such feature and/or process or unit are mutually repelling, and can adopt any combination to combine all processes or the unit of disclosed all features in this instructions (comprising claim, summary and the accompanying drawing followed) and disclosed any method like this or equipment.Unless clearly statement in addition, in this instructions (comprising claim, summary and the accompanying drawing followed) disclosed each feature can be by providing identical, be equal to or the alternative features of similar object replaces.
In addition, those skilled in the art can understand, although embodiment more described herein comprise some feature rather than further feature included in other embodiment, the combination of the feature of different embodiment means within scope of the present invention and forms different embodiment.For example, in the following claims, the one of any of embodiment required for protection can be used with array mode arbitrarily.
All parts embodiment of the present invention can realize with hardware, or realizes with the software module of moving on one or more processor, or realizes with their combination.It will be understood by those of skill in the art that and can use in practice microprocessor or digital signal processor (DSP) to realize the some or all functions according to the some or all parts in the data-storage system of the embodiment of the present invention.The present invention can also be embodied as part or all equipment or the device program (for example, computer program and computer program) for carrying out method as described herein.Realizing program of the present invention and can be stored on computer-readable medium like this, or can there is the form of one or more signal.Such signal can be downloaded and obtain from internet website, or provides on carrier signal, or provides with any other form.
It should be noted above-described embodiment the present invention will be described rather than limit the invention, and those skilled in the art can design alternative embodiment in the case of not departing from the scope of claims.In the claims, any reference symbol between bracket should be configured to limitations on claims.Word " comprises " not to be got rid of existence and is not listed as element or step in the claims.Being positioned at word " " before element or " one " does not get rid of and has multiple such elements.The present invention can be by means of including the hardware of some different elements and realizing by means of the computing machine of suitably programming.In the unit claim of having enumerated some devices, several in these devices can be to carry out imbody by same hardware branch.The use of word first, second and C grade does not represent any order.Can be title by these word explanations.
A1, a kind of date storage method, be suitable for the data entry from the first data-carrier store to store in the second data-carrier store, and the method comprises:
According to the data strip object inquiry mode structure index in the first data-carrier store, the corresponding a kind of inquiry mode of each index in index;
In the second data-carrier store, store the each index in this index, wherein each index comprises the index name that identifies this index;
From the first data-carrier store, obtain each data entry, obtained data entry is stored in the second data-carrier store, wherein, in the second data-carrier store, each data entry comprises data strip object unique identification and the data content being associated;
Determine one or more data entry being associated according to the inquiry mode corresponding with each index, and determine the unique identification of each data entry in the second data-carrier store, obtain the data strip order identification list being associated with this index; And
The index name of the data strip order identification list being associated with each index and each index is stored in the second data-carrier store explicitly.
A2, date storage method as described in A1, wherein, described basis, to the data strip object inquiry mode structure index in the first data-carrier store, comprising:
Set up sorted lists according to the sequence inquiry mode to data entry, and set up group list according to the grouping inquiry mode to data entry;
Carry out cartesian product according to sorted lists and group list, construct described index.
A3, date storage method as described in A2, wherein, described index name comprises sequence inquiry mode mark and grouping inquiry mode mark;
In described the second data-carrier store, each data strip object unique identification is the unique identification of this data entry in the first data-carrier store, and data content is that each field of data strip object is carried out to the content obtaining after serializing.
A4, date storage method as described in A3, wherein, described index name also comprises data key assignments;
In described the second data-carrier store, each data strip object unique identification also comprises data key assignments, and data content is that each corresponding with data key assignments data strip object field is carried out to the content obtaining after serializing;
Wherein, described data key assignments is used for identifying key assignments information, and described key assignments is the one or more field names of data strip object.
A5, date storage method as described in A3, wherein, also comprise:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments, and wherein said key assignments is the one or more field names of data strip object;
Determine index name according to inquiry mode, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, and from go the content serializing, obtain the content of answering with key-value pair and return to application server.
A6, date storage method as described in A4, wherein, also comprise:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments;
Determine index name according to inquiry mode and key assignments, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, will go the content after serializing to return to application server.
A7, date storage method as described in A1, wherein, the data entry in the first data-carrier store is stored in relevant database mode; And
Index in the second data-carrier store is take index name as key, store take the data strip order identification list that is associated as key-value mode of value, and data entry is take data strip object unique identification as key, store take the data content that is associated as key-value mode of value.
B1, a kind of data-storage system, be suitable for the data entry from the first data-carrier store to store in the second data-carrier store, and this system comprises:
Index tectonic element, is suitable for according to the data strip object inquiry mode structure index in the first data-carrier store the corresponding a kind of inquiry mode of each index in index;
Index storage unit, is suitable in the second data-carrier store, storing the each index in this index, and wherein each index comprises the index name that identifies this index;
Data entry storage unit, be suitable for obtaining each data entry from the first data-carrier store, obtained data entry is stored in the second data-carrier store, and wherein, in the second data-carrier store, each data entry comprises data strip object unique identification and the data content being associated; And
Associative cell, is suitable for determining according to the inquiry mode corresponding with each index one or more data entry being associated, and determines the unique identification of each data entry in the second data-carrier store, obtains the data strip order identification list being associated with this index;
Wherein, described index storage unit is configured to the index name of the data strip order identification list being associated with each index and each index to store into explicitly in the second data-carrier store.
B2, data-storage system as described in B1, wherein, described index tectonic element is configured to:
Set up sorted lists according to the sequence inquiry mode to data entry, and set up group list according to the grouping inquiry mode to data entry;
Carry out cartesian product according to sorted lists and group list, construct described index.
B3, data-storage system as described in claim B2, wherein, described index name comprises sequence inquiry mode mark and grouping inquiry mode mark;
In described the second data-carrier store, each data strip object unique identification is the unique identification of this data entry in the first data-carrier store, and data content is that each field of data strip object is carried out to the content obtaining after serializing.
B4, data-storage system as described in claim B3, wherein, described index name also comprises data key assignments;
In described the second data-carrier store, each data strip object unique identification also comprises data key assignments, and data content is that each corresponding with data key assignments data strip object field is carried out to the content obtaining after serializing;
Wherein, described data key assignments is used for identifying key assignments information, and described key assignments is the one or more field names of data strip object.
B5, data-storage system as described in claim B3, wherein, described the second data-carrier store also comprises query interface, described query interface is configured to:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments, and wherein said key assignments is the one or more field names of data strip object;
Determine index name according to inquiry mode, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, and from go the content serializing, obtain the content of answering with key-value pair and return to application server.
B6, data-storage system as described in claim B4, wherein, described the second data-carrier store also comprises query interface, described query interface is configured to:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments;
Determine index name according to inquiry mode and key assignments, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, will go the content after serializing to return to application server.
B7, data-storage system as described in claim B1, wherein, the data entry in the first data-carrier store is stored in relevant database mode; And
Index in the second data-carrier store is take index name as key, store take the data strip order identification list that is associated as key-value mode of value, and data entry is take data strip object unique identification as key, store take the data content that is associated as key-value mode of value.
C1, a kind of data query system, comprise the first data-carrier store, data distribution server and the second data-carrier store, and wherein, described data distribution server comprises the data-storage system as described in any one in claim B1 to B7.
Claims (10)
1. a date storage method, is suitable for the data entry from the first data-carrier store to store in the second data-carrier store, and the method comprises:
According to the data strip object inquiry mode structure index in the first data-carrier store, the corresponding a kind of inquiry mode of each index in index;
In the second data-carrier store, store the each index in this index, wherein each index comprises the index name that identifies this index;
From the first data-carrier store, obtain each data entry, obtained data entry is stored in the second data-carrier store, wherein, in the second data-carrier store, each data entry comprises data strip object unique identification and the data content being associated;
Determine one or more data entry being associated according to the inquiry mode corresponding with each index, and determine the unique identification of each data entry in the second data-carrier store, obtain the data strip order identification list being associated with this index; And
The index name of the data strip order identification list being associated with each index and each index is stored in the second data-carrier store explicitly.
2. date storage method as claimed in claim 1, wherein, described basis, to the data strip object inquiry mode structure index in the first data-carrier store, comprising:
Set up sorted lists according to the sequence inquiry mode to data entry, and set up group list according to the grouping inquiry mode to data entry;
Carry out cartesian product according to sorted lists and group list, construct described index.
3. date storage method as claimed in claim 2, wherein, described index name comprises sequence inquiry mode mark and grouping inquiry mode mark;
In described the second data-carrier store, each data strip object unique identification is the unique identification of this data entry in the first data-carrier store, and data content is that each field of data strip object is carried out to the content obtaining after serializing.
4. date storage method as claimed in claim 3, wherein, described index name also comprises data key assignments;
In described the second data-carrier store, each data strip object unique identification also comprises data key assignments, and data content is that each corresponding with data key assignments data strip object field is carried out to the content obtaining after serializing;
Wherein, described data key assignments is used for identifying key assignments information, and described key assignments is the one or more field names of data strip object.
5. date storage method as claimed in claim 3, wherein, also comprises:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments, and wherein said key assignments is the one or more field names of data strip object;
Determine index name according to inquiry mode, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, and from go the content serializing, obtain the content of answering with key-value pair and return to application server.
6. date storage method as claimed in claim 4, wherein, also comprises:
Obtain the inquiry request from application server, described inquiry request comprises inquiry mode and key assignments;
Determine index name according to inquiry mode and key assignments, from the second data-carrier store, search the data strip order identification list being associated with index name, and from the second data-carrier store, obtain according to the data strip order identification list finding the data content being associated;
The data content getting is gone to serializing, will go the content after serializing to return to application server.
7. date storage method as claimed in claim 1, wherein, the data entry in the first data-carrier store is stored in relevant database mode; And
Index in the second data-carrier store is take index name as key, store take the data strip order identification list that is associated as key-value mode of value, and data entry is take data strip object unique identification as key, store take the data content that is associated as key-value mode of value.
8. a data-storage system, is suitable for the data entry from the first data-carrier store to store in the second data-carrier store, and this system comprises:
Index tectonic element, is suitable for according to the data strip object inquiry mode structure index in the first data-carrier store the corresponding a kind of inquiry mode of each index in index;
Index storage unit, is suitable in the second data-carrier store, storing the each index in this index, and wherein each index comprises the index name that identifies this index;
Data entry storage unit, be suitable for obtaining each data entry from the first data-carrier store, obtained data entry is stored in the second data-carrier store, and wherein, in the second data-carrier store, each data entry comprises data strip object unique identification and the data content being associated; And
Associative cell, is suitable for determining according to the inquiry mode corresponding with each index one or more data entry being associated, and determines the unique identification of each data entry in the second data-carrier store, obtains the data strip order identification list being associated with this index;
Wherein, described index storage unit is configured to the index name of the data strip order identification list being associated with each index and each index to store into explicitly in the second data-carrier store.
9. data-storage system as claimed in claim 8, wherein, described index tectonic element is configured to:
Set up sorted lists according to the sequence inquiry mode to data entry, and set up group list according to the grouping inquiry mode to data entry;
Carry out cartesian product according to sorted lists and group list, construct described index.
10. a data query system, comprises the first data-carrier store, data distribution server and the second data-carrier store, and wherein, described data distribution server comprises data-storage system as claimed in claim 8 or 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410126062.7A CN103902701B (en) | 2014-03-31 | 2014-03-31 | A kind of data-storage system and storage method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410126062.7A CN103902701B (en) | 2014-03-31 | 2014-03-31 | A kind of data-storage system and storage method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103902701A true CN103902701A (en) | 2014-07-02 |
| CN103902701B CN103902701B (en) | 2017-12-29 |
Family
ID=50994023
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410126062.7A Active CN103902701B (en) | 2014-03-31 | 2014-03-31 | A kind of data-storage system and storage method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103902701B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105354255A (en) * | 2015-10-21 | 2016-02-24 | 华为技术有限公司 | Data query method and apparatus |
| CN105760418A (en) * | 2015-01-06 | 2016-07-13 | 国际商业机器公司 | Method And System For Carrying Out Cross Column Searching On Relational Database Table |
| CN105956140A (en) * | 2016-05-12 | 2016-09-21 | 无锡威泰迅电力科技有限公司 | Local data storage method based on mixed-mode mobile application |
| CN106547786A (en) * | 2015-09-22 | 2017-03-29 | 阿里巴巴集团控股有限公司 | A kind of date storage method and device |
| CN107679136A (en) * | 2017-09-22 | 2018-02-09 | 上海携程商务有限公司 | The storage method and storage system of slide fastener table |
| CN108206933A (en) * | 2016-12-16 | 2018-06-26 | 杭州海康威视数字技术股份有限公司 | A kind of video data acquisition methods and device based on video cloud storage system |
| CN108874873A (en) * | 2018-04-26 | 2018-11-23 | 北京空间科技信息研究所 | Data query method, apparatus, storage medium and processor |
| CN110019553A (en) * | 2017-12-21 | 2019-07-16 | 北京奇虎科技有限公司 | Processing method, device and the computer readable storage medium of Recommendations data |
| CN110201393A (en) * | 2019-05-29 | 2019-09-06 | 北京金山安全软件有限公司 | Configuration data storage method and device and electronic equipment |
| CN110609839A (en) * | 2019-09-17 | 2019-12-24 | 北京海益同展信息科技有限公司 | Method, device and equipment for processing block chain data and readable storage medium |
| CN112069175A (en) * | 2020-08-25 | 2020-12-11 | 北京五八信息技术有限公司 | Data query method and device and electronic equipment |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI819943B (en) * | 2022-12-30 | 2023-10-21 | 康和綜合證券股份有限公司 | Device and method for generating a data index, and computer program product thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5727197A (en) * | 1995-11-01 | 1998-03-10 | Filetek, Inc. | Method and apparatus for segmenting a database |
| CN101110074A (en) * | 2007-01-30 | 2008-01-23 | 浪潮乐金信息系统有限公司 | Data speedup query method based on file system caching |
| CN102222099A (en) * | 2011-06-21 | 2011-10-19 | 中兴通讯股份有限公司 | Methods and devices for storing and searching data |
| CN102867070A (en) * | 2012-09-29 | 2013-01-09 | 瑞庭网络技术（上海）有限公司 | Method for updating cache of key-value distributed memory system |
| CN103177027A (en) * | 2011-12-23 | 2013-06-26 | 北京新媒传信科技有限公司 | Method and system for obtaining dynamic feed index |
| CN103631907A (en) * | 2013-11-26 | 2014-03-12 | 中国科学院信息工程研究所 | Method and system for migrating relational data to HBbase |
-
2014
- 2014-03-31 CN CN201410126062.7A patent/CN103902701B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5727197A (en) * | 1995-11-01 | 1998-03-10 | Filetek, Inc. | Method and apparatus for segmenting a database |
| CN101110074A (en) * | 2007-01-30 | 2008-01-23 | 浪潮乐金信息系统有限公司 | Data speedup query method based on file system caching |
| CN102222099A (en) * | 2011-06-21 | 2011-10-19 | 中兴通讯股份有限公司 | Methods and devices for storing and searching data |
| CN103177027A (en) * | 2011-12-23 | 2013-06-26 | 北京新媒传信科技有限公司 | Method and system for obtaining dynamic feed index |
| CN102867070A (en) * | 2012-09-29 | 2013-01-09 | 瑞庭网络技术（上海）有限公司 | Method for updating cache of key-value distributed memory system |
| CN103631907A (en) * | 2013-11-26 | 2014-03-12 | 中国科学院信息工程研究所 | Method and system for migrating relational data to HBbase |
Non-Patent Citations (1)
| Title |
|---|
| JERZY TYSZKIEWIC: "spreadsheet as a relational database engine", 《PROCEEDINGS OF THE 2010 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA 》 * |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10380115B2 (en) | 2015-01-06 | 2019-08-13 | International Business Machines Corporation | Cross column searching a relational database table |
| CN105760418A (en) * | 2015-01-06 | 2016-07-13 | 国际商业机器公司 | Method And System For Carrying Out Cross Column Searching On Relational Database Table |
| CN105760418B (en) * | 2015-01-06 | 2020-02-07 | 国际商业机器公司 | Method and system for performing cross-column search on relational database table |
| CN106547786A (en) * | 2015-09-22 | 2017-03-29 | 阿里巴巴集团控股有限公司 | A kind of date storage method and device |
| CN105354255A (en) * | 2015-10-21 | 2016-02-24 | 华为技术有限公司 | Data query method and apparatus |
| CN105956140A (en) * | 2016-05-12 | 2016-09-21 | 无锡威泰迅电力科技有限公司 | Local data storage method based on mixed-mode mobile application |
| CN105956140B (en) * | 2016-05-12 | 2019-03-22 | 无锡威泰迅电力科技有限公司 | The method that data are locally stored based on mixed mode mobile application |
| CN108206933A (en) * | 2016-12-16 | 2018-06-26 | 杭州海康威视数字技术股份有限公司 | A kind of video data acquisition methods and device based on video cloud storage system |
| CN108206933B (en) * | 2016-12-16 | 2020-05-15 | 杭州海康威视数字技术股份有限公司 | Video data acquisition method and device based on video cloud storage system |
| CN107679136A (en) * | 2017-09-22 | 2018-02-09 | 上海携程商务有限公司 | The storage method and storage system of slide fastener table |
| CN110019553A (en) * | 2017-12-21 | 2019-07-16 | 北京奇虎科技有限公司 | Processing method, device and the computer readable storage medium of Recommendations data |
| CN108874873A (en) * | 2018-04-26 | 2018-11-23 | 北京空间科技信息研究所 | Data query method, apparatus, storage medium and processor |
| CN108874873B (en) * | 2018-04-26 | 2022-04-12 | 北京空间科技信息研究所 | Data query method, device, storage medium and processor |
| CN110201393A (en) * | 2019-05-29 | 2019-09-06 | 北京金山安全软件有限公司 | Configuration data storage method and device and electronic equipment |
| CN110609839A (en) * | 2019-09-17 | 2019-12-24 | 北京海益同展信息科技有限公司 | Method, device and equipment for processing block chain data and readable storage medium |
| US11966412B2 (en) | 2019-09-17 | 2024-04-23 | Jingdong Technology Information Technology Co., Ltd. | Blockchain data processing method and apparatus, device, and readable storage medium |
| CN112069175A (en) * | 2020-08-25 | 2020-12-11 | 北京五八信息技术有限公司 | Data query method and device and electronic equipment |
| CN112069175B (en) * | 2020-08-25 | 2024-03-29 | 北京五八信息技术有限公司 | Data query method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103902701B (en) | 2017-12-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103902698A (en) | Data storage system and data storage method | |
| CN103902701A (en) | Data storage system and data storage method | |
| CN103902702A (en) | Data storage system and data storage method | |
| WO2016183539A1 (en) | Data partitioning and ordering | |
| CN102129425B (en) | The access method of big object set table and device in data warehouse | |
| US20140101167A1 (en) | Creation of Inverted Index System, and Data Processing Method and Apparatus | |
| CN102364464A (en) | Object instance versioning | |
| CN105117442B (en) | A kind of big data querying method based on probability | |
| CN104572920A (en) | Data arrangement method and data arrangement device | |
| CN104090962A (en) | Nested query method oriented to mass distributed-type database | |
| CN106326475A (en) | High-efficiency static hash table implement method and system | |
| US20230205755A1 (en) | Methods and systems for improved search for data loss prevention | |
| US11853279B2 (en) | Data storage using vectors of vectors | |
| CN104112011A (en) | Method and device for extracting mass data | |
| US20110264703A1 (en) | Importing Tree Structure | |
| CN103353901A (en) | Orderly table data management method and system based on Hadoop distributed file system (HDFS) | |
| CN108140022B (en) | Data query method and database system | |
| CN101963993B (en) | Method for fast searching database sheet table record | |
| CN102169491A (en) | Dynamic detection method for multi-data concentrated and repeated records | |
| CN109739854A (en) | A kind of date storage method and device | |
| CN104750743A (en) | System and method for ticking and rechecking transaction files | |
| CN103902693A (en) | Method of read-optimized memory database T-tree index structure | |
| CN110399396B (en) | Efficient data processing | |
| US9230011B1 (en) | Index-based querying of archived data sets | |
| US20160162814A1 (en) | Comparative peer analysis for business intelligence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C53 | Correction of patent of invention or patent application | ||
| CB02 | Change of applicant information |
Address after: 100080 Beijing city Haidian District Danleng Street No. 3 floor 11 block B room 1109 Applicant after: BEIJING PIERRE BLANEY SOFTWARE CO., LTD. Address before: 100080 Beijing city Haidian District Danleng Street No. 3 floor 11 block B room 1109 Applicant before: BEIJING CHESHANGHUI SOFTWARE CO., LTD. |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: APPLICANT; FROM: BEIJING CHESHANGHUI SOFTWARE CO., LTD. TO: BEIJING PIER BULAINI SOFTWARE CO., LTD. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |