CN105589969A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN105589969A CN105589969A CN201510987917.XA CN201510987917A CN105589969A CN 105589969 A CN105589969 A CN 105589969A CN 201510987917 A CN201510987917 A CN 201510987917A CN 105589969 A CN105589969 A CN 105589969A
- Authority
- CN
- China
- Prior art keywords
- inquiry
- attribute
- line number
- row storage
- row
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing method and device. The method comprises following steps: receiving the query request of a user, wherein the query request carries demanded-to-be-queried attribute and attribute value; if the column storage corresponding to the demanded-to-be-queried attribute is not stored, determining the line number corresponding to the demanded-to-be-queried attribute value from line storage; obtaining corresponding records from the line storage according to the determined line number; adding a setting value to the query times corresponding to the demanded-to-be-queried attribute; if the column storage corresponding to the demanded-to-be-queried attribute is stored, determining the line number corresponding to the demanded-to-be-queried attribute value from the line storage; and obtaining the records corresponding to the line number from the line storage. According to the method and the device of the invention, the problems that the present query processing speed is low and the utilization rate of the storage data is low are solved.
Description
Technical field
The present invention relates to technical field of data storage, relate in particular to a kind of method and device of data processing.
Background technology
Along with the various data of a large amount of business datums and community network accumulation are more and more, data storage methodThere is important impact for the inquiry velocity of data.
Row storage mode of the prior art is managed by row storage, and what read in internal memory is all some complete at every turnWhole row data, are applicable to the data processing of small lot. To the analysis and consult of large data sets, conventionally only useA few row of a logical table, if store data by the mode of row, due to every less important data volume readingVery large, and when inquiry in, may only be used a few row of a logical table, like this, in the time of inquiry, can readGet a large amount of extraneous data, thereby wasted bandwidth, reduced efficiency, affected query processing speed.
Row storage mode of the prior art is managed by row storage, only reads columns associated with the queryAccording to, can avoid the reading of irrelevant column data, but the data of which storage are while inquiring about, conventionally needThe data of different lines are reorganized into tuple, when tuple reconstructed operation in query processing process, impact is looked intoAsk processing speed.
Ranks mixing storage mode of the prior art is managed by row storage, and same piece of data preserves twoPart, a with row storage, a with row storage; The shared memory space of the method is two of initial dataDoubly, the data user rate of storage is low, and difficult in maintenance. PAX method is that a kind of conventional ranks mixStorage, its principle is: the data of reading in internal memory are stored by row in each page, have alleviated the generation of tuple reconstructValency. The all properties value of same tuple in same one page, tuple of reconstruct do not need by repeatedly input/The different train values of same tuple are obtained in output (I/O) from different files. PAX uses mixed structureTarget is to optimize high-speed cache from the performance of internal memory reading out data, but the magnetic disc i/o when processing large dataPerformance does not affect. PAX method just, after data are read in internal memory from external memory, is pressed the mode of row in pageTissue, and still store by the mode of row in storage. Because PAX method does not change reading of diskSpeed, has affected inquiry velocity.
For how improving query processing speed, the utilization rate that how to improve storage data is to need to solve at presentProblem.
Summary of the invention
The object of this invention is to provide a kind of method and device of data processing, to solve query processing speedSlowly the low problem of utilization rate of storage data.
The object of the invention is to be achieved through the following technical solutions:
A kind of data processing method, comprising:
Receive user's inquiry request, wherein, in described inquiry request, carry attribute and the attribute of required inquiryValue;
If do not preserve the row storage that the attribute of required inquiry is corresponding, from row storage, determine the genus of required inquiryProperty line number corresponding to value, according to the line number of determining, from row storage, obtain corresponding record and look into requiredThe inquiry times corresponding to attribute of asking increases setting value;
If preserve the row storage that the attribute of required inquiry is corresponding, from described row storage, determine required inquiryLine number corresponding to property value, and obtain record corresponding to described line number from row storage.
Optionally, after the inquiry times corresponding attribute of required inquiry is increased to set point number, the method alsoComprise:
In the time that inquiry times corresponding to the attribute of required inquiry reaches setting threshold, from row storage, determine instituteNeed corresponding all properties value and the line number information of attribute of inquiry, and by the property value of determining and line number informationStore with row storage mode.
Optionally, if carry the attribute of at least two required inquiries in described inquiry request, and described in preservingRequired inquiry is determined in the row storage corresponding to attribute of at least two required inquiries from described row storageThe line number that property value is corresponding, and obtain record corresponding to described line number from row storage, comprising:
For the attribute of each required inquiry, from row storage corresponding to the attribute of required inquiry, determine instituteThe line number set that needs the line number corresponding to property value of inquiry to form;
Determine described line number intersection of sets collection, and according to described line number intersection of sets collection, from row storage, obtainGet corresponding record.
Optionally, if carry the attribute of at least two required inquiries in described inquiry request, and described in not preservingThe row storage that in the attribute of at least two required inquiries, the attribute of at least one required inquiry is corresponding, from describedIn row storage, determine the line number corresponding to property value of required inquiry, and obtain described line number pair from row storageThe record of answering, comprising:
For the attribute of required inquiry that has corresponding row storage, deposit from the row that the attribute of required inquiry is correspondingChu Zhong, determines the line number corresponding to property value of required inquiry, and according to the line number of determining, stores from rowIn obtain corresponding record;
From the record getting, the attribute institute that determines the required inquiry that does not have corresponding row storage is correspondingRecord.
Based on the inventive concept same with method, the embodiment of the present invention provides a kind of data processing equipment, bagDraw together:
Receiver module, for receiving user's inquiry request, wherein, carries required looking in described inquiry requestAttribute and the property value of asking;
Processing module if for not preserving the row storage corresponding to attribute of required inquiry, is determined from row storageGo out the line number corresponding to property value of required inquiry, according to the line number of determining, from row storage, obtain correspondingRecord also increases setting value by the inquiry times corresponding attribute of required inquiry;
If preserve the row storage that the attribute of required inquiry is corresponding, from described row storage, determine required inquiryLine number corresponding to property value, and obtain record corresponding to described line number from row storage.
Optionally, after the inquiry times corresponding attribute of required inquiry is increased to set point number, described processingModule also for:
In the time that inquiry times corresponding to the attribute of required inquiry reaches setting threshold, from row storage, determine instituteNeed corresponding all properties value and the line number information of attribute of inquiry, and by the property value of determining and line number informationStore with row storage mode.
Optionally, if carry the attribute of at least two required inquiries in described inquiry request, and described in preservingRequired inquiry is determined in the row storage corresponding to attribute of at least two required inquiries from described row storageThe line number that property value is corresponding, and obtain record corresponding to described line number from row storage, described processing module is alsoBe used for:
For the attribute of each required inquiry, from row storage corresponding to the attribute of required inquiry, determine instituteThe line number set that needs the line number corresponding to property value of inquiry to form;
Determine described line number intersection of sets collection, and according to described line number intersection of sets collection, from row storage, obtainGet corresponding record.
Optionally, if carry the attribute of at least two required inquiries in described inquiry request, and described in not preservingThe row storage that in the attribute of at least two required inquiries, the attribute of at least one required inquiry is corresponding, from describedIn row storage, determine the line number corresponding to property value of required inquiry, and obtain described line number pair from row storageThe record of answering, described processing module also for:
For the attribute of required inquiry that has corresponding row storage, deposit from the row that the attribute of required inquiry is correspondingChu Zhong, determines the line number corresponding to property value of required inquiry, and according to the line number of determining, stores from rowIn obtain corresponding record;
From the record getting, the attribute institute that determines the required inquiry that does not have corresponding row storage is correspondingRecord.
The method of a kind of data processing that the embodiment of the present invention provides and device, reception user's inquiry requestAfter, if while not preserving row storage corresponding to the attribute of required inquiry, from row storage, determine required inquiryThe line number that property value is corresponding according to the line number of determining, is obtained corresponding record and by required from row storageThe inquiry times corresponding to attribute of inquiry increases setting value; If preserving the row that the attribute of required inquiry is corresponding depositsStorage is determined the line number corresponding to property value of required inquiry, and is obtained from row storage from described row storageThe record that described line number is corresponding. Improve the utilization rate of query processing speed and storage data.
Brief description of the drawings
A kind of data processing method flow chart that Fig. 1 provides for the embodiment of the present invention;
The another kind of data processing method flow chart that Fig. 2 provides for the embodiment of the present invention;
A kind of data processing equipment schematic diagram that Fig. 3 provides for the embodiment of the present invention.
Detailed description of the invention
Below in conjunction with accompanying drawing, the technical scheme that the embodiment of the present invention is provided is elaborated.
The embodiment of the present invention provides a kind of data processing method, as shown in Figure 1, comprises following operation:
Step 100, receive user's inquiry request, wherein, in described inquiry request, carry required inquiryAttribute and property value;
Step 110, determining while not preserving row storage corresponding to the attribute of required inquiry, by required inquiryInquiry times corresponding to attribute increase set point number, and from row storage, determine the property value of required inquiryCorresponding line number according to the line number of determining, is obtained corresponding record from row storage;
Step 120, determining while preserving row storage corresponding to the attribute of required inquiry, deposit from described rowIn storage, determine the line number corresponding to property value of required inquiry, and it is corresponding from row storage, to obtain described line numberRecord.
The method of a kind of data processing that the embodiment of the present invention provides, receives after user's inquiry request, if notWhile preserving row storage corresponding to the attribute of required inquiry, from row storage, determine the property value pair of required inquiryThe line number of answering according to the line number of determining, is obtained corresponding record and by the genus of required inquiry from row storageProperty corresponding inquiry times increase setting value; If preserve the row storage that the attribute of required inquiry is corresponding, from instituteState line number corresponding to property value of determining required inquiry in row storage, and obtain described line number from row storageCorresponding record, has improved query processing speed and has stored the utilization rate of data.
Optionally, after the inquiry times corresponding attribute of required inquiry is increased set point number by step 110,The method also comprises:
In the time that inquiry times corresponding to the attribute of required inquiry reaches setting threshold, from row storage, determine instituteNeed corresponding all properties value and the line number information of attribute of inquiry, and by the property value of determining and line number informationStore with row storage mode.
Storage means described in the embodiment of the present invention has reduced the storage of inessential attribute, instead of by dataTwo parts of simple reservations, only retain the row storage of important property, to depositing of data according to user's query noteContaining higher utilization rate. If when row storage damages due to a variety of causes, and corresponding row memory attribute alsoDo not lose, can ensure the redundancy of important property, avoided whole data all to lose. When allWhen attribute is all very important, data fully redundance.
Optionally, if carry the attribute of at least two required inquiries in described inquiry request, and described in preservingRequired inquiry is determined in the row storage corresponding to attribute of at least two required inquiries from described row storageThe line number that property value is corresponding, and obtain record corresponding to described line number from row storage, comprising:
For the attribute of each required inquiry, from row storage corresponding to the attribute of required inquiry, determine instituteThe line number set that needs the line number corresponding to property value of inquiry to form;
Determine described line number intersection of sets collection, and according to described line number intersection of sets collection, from row storage, obtainGet corresponding record.
Illustrate: if the corresponding line number set of attribute of the first inquiry is { 1,2,3}, the second inquiryThe corresponding line number set of attribute be { 2,3,4, }, determine described line number intersection of sets collection for 2,3},According to this line number set, from row storage, obtain corresponding record.
Optionally, if carry the attribute of at least two required inquiries in described inquiry request, and described in not preservingThe row storage that in the attribute of at least two required inquiries, the attribute of at least one required inquiry is corresponding, from describedIn row storage, determine the line number corresponding to property value of required inquiry, and obtain described line number pair from row storageThe record of answering, comprising:
For the attribute of required inquiry that has corresponding row storage, deposit from the row that the attribute of required inquiry is correspondingChu Zhong, determines the line number corresponding to property value of required inquiry, and according to the line number of determining, stores from rowIn obtain corresponding record.
From the record getting, the attribute institute that determines the required inquiry that does not have corresponding row storage is correspondingRecord.
Illustrate: if the corresponding line number set of attribute of the first inquiry is for { 1,2,3}, according to this rowNumber set is obtained corresponding record from row storage, from the record getting, determine do not exist rightThe corresponding record of attribute of the required inquiry of the row storage of answering.
Below to use structured query sentence (StructuredQuery in the inquiry request that user was sentLanguage, SQL) be example, the data storage and query method that the embodiment of the present invention is provided describes.
Embodiment mono-, as shown in Figure 2, comprises following process:
If the flow process with a querying attributes only in user's inquiry request:
Step 200, reception inquiry request;
Step 210, inquiry request is resolved;
Wherein, this step is (to use by the SQL syntax parsing device of the international standard in calling data storehouseIn the program that SQL statement is resolved) carry out.
Step 220, the querying attributes in the where condition in inquiry request is carried out to inquiry times statistics.
Step 230, judge whether the corresponding attribute column of attribute in querying condition has existed corresponding rowStorage.
If step 240 is judged and had corresponding row storage in database, in this row storage, enterRow query manipulation, and obtain corresponding line number.
Step 250, utilize line number, in the storage data of being expert at, obtain corresponding record, in the record obtaining,Utilize the executable operations method of row database to carry out other query filter operation;
Illustrate: where condition is with the operation of multiple conditions, as wherea 5andb<2, work as a>5After utilizing focus row to execute, obtain line number, then utilize line number to carry out the operation of b < 2, wherein b < 2 are itIts query filter operation.
Wherein, for example: a and b representative are respectively the oid row and name row in following table.
| Oid | Name |
| 1 | Zhang San |
| 2 | Xiao Ming |
| 3 | Little red |
| 4 | Xiao Fang |
| 5 | Xiao Jun |
Step 260, after having inquired about, returns to user by final Query Result.
In database, there is not corresponding row storage if step 270 is judged, judge querying attributes pairWhether the statistics number of answering has reached predetermined threshold value;
If so, perform step 280;
If not, perform step 290.
Step 280, by corresponding the attribute in corresponding inquiry request attribute column, to be listed as the mode of storageStore, this storage mode comprises two row, wherein one classifies corresponding line number as, and another classifies real row asData value (being property value); Then perform step 240 or step 290.
In step 290, the storage data of being expert at, carry out query manipulation, then continue execution step 260.
Wherein, above-mentioned steps 220-step 250 and step 270-step 290, be to hold by calling optimizerRow, wherein, described execution optimizer is the program of the optimal execution route for judging SQL; At thisIn embodiment, can carry out the statistics of inquiry times and the road that inquiry is carried out in judgement by described execution optimizerFootpath is row query path, or the query path of focus row, and wherein said focus is classified as in described execution optimizerThe row storage having existed.
Carrying out optimizer can be according to different condition, adaptively finds corresponding optimal execution route, at onceQuery path or the query path of focus row.
If the flow process with multiple queries attribute in user's inquiry request:
Receive inquiry request; Multiple attributes in where condition in inquiry request are carried out to inquiry times systemMeter; Judge whether the corresponding attribute column of attribute in querying condition has existed corresponding row storage mode.
In database, there is a corresponding row storage if judge, first in single-row, inquired aboutOperation, and obtains corresponding line number, then utilizes line number, obtains corresponding in original row storage dataAll records, then in the record of selecting, utilize the executable operations method of row database to carry out looking into of otherAsk filter operation.
In database, there is the row storage of multiple correspondences if judge, first looked in single-row at oneAsk operation, and obtain corresponding line number, then in another is single-row, carry out query manipulation, and obtain correspondenceLine number, then utilize this two line numbers, ask for common factor, then utilize this line number to occur simultaneously, originalIn row storage data, obtain corresponding all records, in the left back record selecting, utilize row databaseExecutable operations method is carried out other query filter operation.
In database, there is not corresponding row storage if judge, and determine corresponding statistical countingThrough having reached predetermined threshold value, trigger event, by corresponding querying condition attribute, then the side storing with rowFormula, this storage mode comprises two row, wherein one classifies corresponding line number as, another classifies real column data value as.
In database, there is not corresponding row storage if judge, and determine corresponding statistical counting notReach predetermined threshold value, be expert to store in data with the method for operating of row database and carry out query manipulation.
Execution returns to user by final Query Result after having inquired about.
Based on the inventive concept same with method, the embodiment of the present invention also provides a kind of data processing equipment, asShown in Fig. 3, comprising:
Receiver module 301, for receiving user's inquiry request, wherein, carries institute in described inquiry requestNeed attribute and the property value of inquiry;
Processing module 302, if for not preserving the row storage corresponding to attribute of required inquiry, from row storageDetermine the line number corresponding to property value of required inquiry, according to the line number of determining, it is right from row storage, to obtainThe record of answering also increases setting value by the inquiry times corresponding attribute of required inquiry;
If preserve the row storage that the attribute of required inquiry is corresponding, from described row storage, determine required inquiryLine number corresponding to property value, and obtain record corresponding to described line number from row storage.
The device of a kind of data processing that the embodiment of the present invention provides, receives after user's inquiry request, if notWhile preserving row storage corresponding to the attribute of required inquiry, from row storage, determine the property value pair of required inquiryThe line number of answering according to the line number of determining, is obtained corresponding record and by the genus of required inquiry from row storageProperty corresponding inquiry times increase setting value; If preserve the row storage that the attribute of required inquiry is corresponding, from instituteState line number corresponding to property value of determining required inquiry in row storage, and obtain described line number from row storageCorresponding record, has improved query processing speed and has stored the utilization rate of data.
Optionally, after the inquiry times corresponding attribute of required inquiry is increased to set point number, described processingModule also for:
In the time that inquiry times corresponding to the attribute of required inquiry reaches setting threshold, from row storage, determine instituteNeed corresponding all properties value and the line number information of attribute of inquiry, and by the property value of determining and line number informationStore with row storage mode.
Optionally, if carry the attribute of at least two required inquiries in described inquiry request, and described in preservingRequired inquiry is determined in the row storage corresponding to attribute of at least two required inquiries from described row storageThe line number that property value is corresponding, and obtain record corresponding to described line number from row storage, described processing module is alsoBe used for:
For the attribute of each required inquiry, from row storage corresponding to the attribute of required inquiry, determine instituteThe line number set that needs the line number corresponding to property value of inquiry to form;
Determine described line number intersection of sets collection, and according to described line number intersection of sets collection, from row storage, obtainGet corresponding record.
Optionally, if carry the attribute of at least two required inquiries in described inquiry request, and described in not preservingThe row storage that in the attribute of at least two required inquiries, the attribute of at least one required inquiry is corresponding, from describedIn row storage, determine the line number corresponding to property value of required inquiry, and obtain described line number pair from row storageThe record of answering, described processing module also for:
For the attribute of required inquiry that has corresponding row storage, deposit from the row that the attribute of required inquiry is correspondingChu Zhong, determines the line number corresponding to property value of required inquiry, and according to the line number of determining, stores from rowIn obtain corresponding record.
From the record getting, the attribute institute that determines the required inquiry that does not have corresponding row storage is correspondingRecord.
Those skilled in the art should understand, embodiments of the invention can be provided as method, system or meterCalculation machine program product. Therefore, the present invention can adopt complete hardware implementation example, completely implement software example or knotClose the form of the embodiment of software and hardware aspect. And the present invention can adopt at one or more wherein bagsThe computer-usable storage medium that contains computer usable program code (include but not limited to magnetic disc store,CD-ROM, optical memory etc.) form of the upper computer program of implementing.
The present invention is that reference is according to the method for the embodiment of the present invention, equipment (system) and computer program productThe flow chart of product and/or block diagram are described. Should understand can be by computer program instructions realization flow figure and/ or block diagram in each flow process and/or flow process in square frame and flow chart and/or block diagram and/Or the combination of square frame. Can provide these computer program instructions to all-purpose computer, special-purpose computer, embeddingThe processor of formula processor or other programmable data processing device, to produce a machine, makes by calculatingThe instruction that the processor of machine or other programmable data processing device is carried out produces for realizing at flow chart oneThe device of the function of specifying in square frame of individual flow process or multiple flow process and/or block diagram or multiple square frame.
These computer program instructions also can be stored in energy vectoring computer or other programmable data processing are establishedIn the standby computer-readable memory with ad hoc fashion work, make to be stored in this computer-readable memoryInstruction produce and comprise the manufacture of command device, this command device is realized in flow process or multiple of flow chartThe function of specifying in square frame of flow process and/or block diagram or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, makeMust on computer or other programmable devices, carry out sequence of operations step to produce computer implemented placeReason, thus the instruction of carrying out on computer or other programmable devices is provided for realizing one of flow chartThe step of the function of specifying in square frame of flow process or multiple flow process and/or block diagram or multiple square frame.
Although described the preferred embodiments of the present invention, once those skilled in the art obtain cicada baseThis creative concept, can make other change and amendment to these embodiment. So appended right is wantedAsk and be intended to be interpreted as comprising preferred embodiment and fall into all changes and the amendment of the scope of the invention.
Obviously, those skilled in the art can carry out various changes and modification and not depart from this present inventionBright spirit and scope. Like this, if of the present invention these amendment and modification belong to the claims in the present invention andWithin the scope of its equivalent technologies, the present invention be also intended to comprise these change and modification interior.
Claims (8)
1. a data processing method, is characterized in that, comprising:
Receive user's inquiry request, wherein, in described inquiry request, carry attribute and the attribute of required inquiryValue;
If while not preserving row storage corresponding to the attribute of required inquiry, from row storage, determine required inquiryThe line number that property value is corresponding according to the line number of determining, is obtained corresponding record and by required from row storageThe inquiry times corresponding to attribute of inquiry increases setting value;
If preserve the row storage that the attribute of required inquiry is corresponding, from described row storage, determine required inquiryLine number corresponding to property value, and obtain record corresponding to described line number from row storage.
2. method according to claim 1, is characterized in that, by corresponding the attribute of required inquiryAfter inquiry times increases set point number, the method also comprises:
In the time that inquiry times corresponding to the attribute of required inquiry reaches setting threshold, from row storage, determine instituteNeed corresponding all properties value and the line number information of attribute of inquiry, and by the property value of determining and line number informationStore with row storage mode.
3. method according to claim 1 and 2, is characterized in that, if take in described inquiry requestThe attribute of at least two required inquiries of band, and row corresponding to the attribute of at least two required inquiries described in preservingStore, from described row storage, determine the line number corresponding to property value of required inquiry, and from row storageObtain record corresponding to described line number, comprising:
For the attribute of each required inquiry, from row storage corresponding to the attribute of required inquiry, determine instituteThe line number set that needs the line number corresponding to property value of inquiry to form;
Determine described line number intersection of sets collection, and according to described line number intersection of sets collection, from row storage, obtainGet corresponding record.
4. method according to claim 1 and 2, is characterized in that, if take in described inquiry requestThe attribute of at least two required inquiries of band, and at least one in the attribute of at least two required inquiries described in not preservingThe property value of required inquiry is determined in the row storage corresponding to attribute of individual required inquiry from described row storageCorresponding line number, and obtain record corresponding to described line number from row storage, comprising:
For the attribute of required inquiry that has corresponding row storage, deposit from the row that the attribute of required inquiry is correspondingChu Zhong, determines the line number corresponding to property value of required inquiry, and according to the line number of determining, stores from rowIn obtain corresponding record;
From the record getting, the attribute institute that determines the required inquiry that does not have corresponding row storage is correspondingRecord.
5. a data processing equipment, is characterized in that, comprising:
Receiver module, for receiving user's inquiry request, wherein, carries required looking in described inquiry requestAttribute and the property value of asking;
Processing module, if when not preserving row storage corresponding to the attribute of required inquiry, from row storage reallyMake the line number corresponding to property value of required inquiry, according to the line number of determining, from row storage, obtain correspondenceRecord and corresponding the attribute of required inquiry inquiry times is increased to setting value;
If preserve the row storage that the attribute of required inquiry is corresponding, from described row storage, determine required inquiryLine number corresponding to property value, and obtain record corresponding to described line number from row storage.
6. device according to claim 5, is characterized in that, by corresponding the attribute of required inquiryInquiry times increases after set point number, described processing module also for:
In the time that inquiry times corresponding to the attribute of required inquiry reaches setting threshold, from row storage, determine instituteNeed corresponding all properties value and the line number information of attribute of inquiry, and by the property value of determining and line number informationStore with row storage mode.
7. according to the device described in claim 5 or 6, it is characterized in that, if take in described inquiry requestThe attribute of at least two required inquiries of band, and row corresponding to the attribute of at least two required inquiries described in preservingStore, from described row storage, determine the line number corresponding to property value of required inquiry, and from row storageObtain record corresponding to described line number, described processing module also for:
For the attribute of each required inquiry, from row storage corresponding to the attribute of required inquiry, determine instituteThe line number set that needs the line number corresponding to property value of inquiry to form;
Determine described line number intersection of sets collection, and according to described line number intersection of sets collection, from row storage, obtainGet corresponding record.
8. according to the device described in claim 5 or 6, it is characterized in that, if take in described inquiry requestThe attribute of at least two required inquiries of band, and at least one in the attribute of at least two required inquiries described in not preservingThe property value of required inquiry is determined in the row storage corresponding to attribute of individual required inquiry from described row storageCorresponding line number, and obtain record corresponding to described line number from row storage, described processing module also for:
For the attribute of required inquiry that has corresponding row storage, deposit from the row that the attribute of required inquiry is correspondingChu Zhong, determines the line number corresponding to property value of required inquiry, and according to the line number of determining, stores from rowIn obtain corresponding record;
From the record getting, the attribute institute that determines the required inquiry that does not have corresponding row storage is correspondingRecord.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510987917.XA CN105589969A (en) | 2015-12-23 | 2015-12-23 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510987917.XA CN105589969A (en) | 2015-12-23 | 2015-12-23 | Data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105589969A true CN105589969A (en) | 2016-05-18 |
Family
ID=55929548
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510987917.XA Pending CN105589969A (en) | 2015-12-23 | 2015-12-23 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105589969A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106777027A (en) * | 2016-12-08 | 2017-05-31 | 北京国电通网络技术有限公司 | MPP ranks blended data storage device and storage, querying method |
| CN109101516A (en) * | 2017-11-30 | 2018-12-28 | 新华三大数据技术有限公司 | A kind of data query method and server |
| CN110755063A (en) * | 2018-10-06 | 2020-02-07 | 江苏创越医疗科技有限公司 | Low-delay electrocardiogram drawing method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6606638B1 (en) * | 1998-07-08 | 2003-08-12 | Required Technologies, Inc. | Value-instance-connectivity computer-implemented database |
| CN102137157A (en) * | 2011-02-28 | 2011-07-27 | 浪潮(北京)电子信息产业有限公司 | Cloud memory system and implementation method thereof |
| CN102156714A (en) * | 2011-03-22 | 2011-08-17 | 清华大学 | Method for realizing self-adaptive vertical divided relational database and system thereof |
| CN102737132A (en) * | 2012-06-25 | 2012-10-17 | 天津神舟通用数据技术有限公司 | Multi-rule combined compression method based on database row and column mixed storage |
| CN103678556A (en) * | 2013-12-06 | 2014-03-26 | 华为技术有限公司 | Method for processing column-oriented database and processing equipment |
| CN103930887A (en) * | 2011-11-18 | 2014-07-16 | 惠普发展公司，有限责任合伙企业 | Query summary generation using row-column data storage |
| CN104750727A (en) * | 2013-12-30 | 2015-07-01 | 亿阳信通股份有限公司 | Column type memory storage and query device and column type memory storage and query method |
-
2015
- 2015-12-23 CN CN201510987917.XA patent/CN105589969A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6606638B1 (en) * | 1998-07-08 | 2003-08-12 | Required Technologies, Inc. | Value-instance-connectivity computer-implemented database |
| CN102137157A (en) * | 2011-02-28 | 2011-07-27 | 浪潮(北京)电子信息产业有限公司 | Cloud memory system and implementation method thereof |
| CN102156714A (en) * | 2011-03-22 | 2011-08-17 | 清华大学 | Method for realizing self-adaptive vertical divided relational database and system thereof |
| CN103930887A (en) * | 2011-11-18 | 2014-07-16 | 惠普发展公司，有限责任合伙企业 | Query summary generation using row-column data storage |
| CN102737132A (en) * | 2012-06-25 | 2012-10-17 | 天津神舟通用数据技术有限公司 | Multi-rule combined compression method based on database row and column mixed storage |
| CN103678556A (en) * | 2013-12-06 | 2014-03-26 | 华为技术有限公司 | Method for processing column-oriented database and processing equipment |
| CN104750727A (en) * | 2013-12-30 | 2015-07-01 | 亿阳信通股份有限公司 | Column type memory storage and query device and column type memory storage and query method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106777027A (en) * | 2016-12-08 | 2017-05-31 | 北京国电通网络技术有限公司 | MPP ranks blended data storage device and storage, querying method |
| CN109101516A (en) * | 2017-11-30 | 2018-12-28 | 新华三大数据技术有限公司 | A kind of data query method and server |
| US11269881B2 (en) | 2017-11-30 | 2022-03-08 | New H3C Big Data Technologies Co., Ltd. | Data query |
| CN110755063A (en) * | 2018-10-06 | 2020-02-07 | 江苏创越医疗科技有限公司 | Low-delay electrocardiogram drawing method |
| CN110755063B (en) * | 2018-10-06 | 2023-06-02 | 江苏创越医疗科技有限公司 | Low-delay electrocardiogram drawing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110837585B (en) | Multi-source heterogeneous data association query method and system | |
| US10769147B2 (en) | Batch data query method and apparatus | |
| CN110019218B (en) | Data storage and query method and equipment | |
| CN106528787B (en) | query method and device based on multidimensional analysis of mass data | |
| US9760604B2 (en) | System and method for adaptive filtering of data requests | |
| CN107515878B (en) | Data index management method and device | |
| US9703830B2 (en) | Translation of a SPARQL query to a SQL query | |
| CN108664516A (en) | Enquiring and optimizing method and relevant apparatus | |
| CN107622091A (en) | A kind of data base query method and device | |
| CN104885078A (en) | Method for two-stage query optimization in massively parallel processing database clusters | |
| EP2646928A1 (en) | Systems and methods for performing a nested join operation | |
| US11003649B2 (en) | Index establishment method and device | |
| CN107291770B (en) | Mass data query method and device in distributed system | |
| CN104182405A (en) | Method and device for connection query | |
| US8812492B2 (en) | Automatic and dynamic design of cache groups | |
| JP2013186890A (en) | Data management system and method using database middleware | |
| CN110019308A (en) | Data query method, apparatus, equipment and storage medium | |
| CN112559567A (en) | Query method and device suitable for OLAP query engine | |
| CN113836163A (en) | Data association query method, device, equipment and storage medium | |
| CN105589969A (en) | Data processing method and device | |
| CN111125199B (en) | Database access method and device and electronic equipment | |
| CN108073641B (en) | Method and device for querying data table | |
| CN116881287A (en) | Data query method and related equipment | |
| CN112182031B (en) | Data query method and device, storage medium and electronic device | |
| CN106919566A (en) | A kind of query statistic method and system based on mass data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160518 |
|
| RJ01 | Rejection of invention patent application after publication |