CN105718455A - Data query method and apparatus - Google Patents
Data query method and apparatus Download PDFInfo
- Publication number
- CN105718455A CN105718455A CN201410720347.3A CN201410720347A CN105718455A CN 105718455 A CN105718455 A CN 105718455A CN 201410720347 A CN201410720347 A CN 201410720347A CN 105718455 A CN105718455 A CN 105718455A
- Authority
- CN
- China
- Prior art keywords
- data
- bloom filter
- buffer memory
- query
- described data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data query method and apparatus used for solving the problem that the system performance is affected by a large amount of blank query of a database in the prior art. According to the data query method, when a server receives a query request, the server determines whether the data corresponding to the data identification carried by the query quest exists or not only according to a pre-stored bloom filter, and the server finds and returns the data only when the data corresponding to the data identification carried by the query quest exists, without needing to query the data identification carried by each query quest, so that the blank query can be effectively filtered, and unnecessary pressure on the database caused by blank query is avoided; and therefore, the purpose of lowering the database expenditure and improving the query efficiency is improved.
Description
Technical field
The application relates to field of computer technology, particularly relates to a kind of data query method under the concurrent scene of height and device.
Background technology
Computer nowadays technology, Internet technology fast development, daily life cannot leave the Internet, and increasing internet product is well known, and brings great convenience to the work of people, life, study.
At present; various information platforms are required for being based upon on corresponding data base, and for some Top Sites, the visit capacity of its background server is very surprising; now in the face of a large amount of inquiry request of user, the response of server feedback Query Result would generally produce to postpone.
And along with the arrival of big data age, high concurrent request for information can get more and more, when substantial amounts of client initiates inquiry request to server end within the same period, server can according to carrying major key in inquiry request, first whether inquiry own cache exist data corresponding to this major key (data that this major key is corresponding are: the data that inquire about), if buffer memory exists, the then data in direct return cache, if there is no, then inquire about in data base, and the data found are returned to client, this write back data is entered in buffer memory simultaneously, can directly search from buffer memory when inquiring about these data next time.
Under this mode, the data corresponding owing to saving partial query request in distributed caching, therefore can alleviate the inquiry pressure of data base to a certain extent.But, when occurring that a lot of skies look into (being namely absent from the data to inquire about in data base), server need nonetheless remain for query caching and data base, and due to the data of magnanimity in store in data base, query script will necessarily make data base increase much unnecessary inquiry, thus taking more system resource, reduce systematic function.
Summary of the invention
The embodiment of the present application provides a kind of data query method and device, in order to solve in prior art data base because a large amount of skies look into the problem of influential system performance.
A kind of data query method that the embodiment of the present application provides, including:
Receive inquiry request；
According to the Data Identification carried in described inquiry request, and the first Bloom filter pre-saved, it is judged that whether the data that described Data Identification is corresponding exist；
If existing, then obtain and return described data；
If being absent from, it is determined that inquire about unsuccessfully.
A kind of data query arrangement that the embodiment of the present application provides, including:
Receiver module, is used for receiving inquiry request；
Memory module, is used for storing the first Bloom filter；
Judge module, is used for according to the Data Identification carried in described inquiry request, and the first Bloom filter pre-saved, it is judged that whether the data that described Data Identification is corresponding exist；
Enquiry module, for when the judged result of described judge module is for being, obtaining and return described data, when the judged result at described judge module is no, it is determined that inquire about unsuccessfully.
A kind of data query method and apparatus that the embodiment of the present application provides, when the method server receives inquiry request, only need according to the Bloom filter prestored, judge whether the data that the Data Identification carried in this inquiry request is corresponding exist, and only search when it exists and return this data, inquire about without to the Data Identification carried in each inquiry request, look into thus sky can effectively be filtered, avoid sky to check data base and cause unnecessary pressure, thus reducing database overhead, promoting the purpose of search efficiency.
Accompanying drawing explanation
Accompanying drawing described herein is used for providing further understanding of the present application, constitutes the part of the application, and the schematic description and description of the application is used for explaining the application, is not intended that the improper restriction to the application.In the accompanying drawings:
The data query process that Fig. 1 provides for the embodiment of the present application；
The detailed process of the data query that Fig. 2 provides for the embodiment of the present application；
The data query arrangement structural representation that Fig. 3 provides for the embodiment of the present application.
Detailed description of the invention
For making the purpose of the application, technical scheme and advantage clearly, below in conjunction with the application specific embodiment and corresponding accompanying drawing, technical scheme is clearly and completely described.Obviously, described embodiment is only some embodiments of the present application, rather than whole embodiments.Based on the embodiment in the application, the every other embodiment that those of ordinary skill in the art obtain under not making creative work premise, broadly fall into the scope of the application protection.
The data query process that Fig. 1 provides for the embodiment of the present application, specifically includes:
S101: receive inquiry request.
In the embodiment of the present application, when user to inquire about certain data, user end to server can be first passed through and send inquiry request, wherein, carrying the Data Identification of the data to inquire about in this inquiry request, make server pass through this Data Identification, which data is the data knowing to inquiry be.This Data Identification can be generally the major key of data.Described server can be single server, it is also possible to a server cluster or distributed server.
S102: according to the Data Identification carried in this inquiry request, and the first Bloom filter pre-saved, it is judged that whether the data that this Data Identification is corresponding exist, if so, then perform step S103, otherwise, perform step S104.
In the embodiment of the present application, server has pre-saved the first Bloom filter, and this first Bloom filter is to generate previously according to all data stored in data base.By the Data Identification carried in inquiry request and this first Bloom filter, server can judge whether the data that this Data Identification is corresponding are present in data base.
Concrete, the concrete grammar generating Bloom filter is: preset the Serial No. of n position, each is 0, preset k hash function, the codomain of each hash function is 0～n, n and k is natural number, Data Identification for each data preserved in data base, the Data Identification of these data is inputted respectively this k hash function, obtain k hashed value, it is designated as H1 respectively, H2, H3, ... Hk, again by the H1 position in n bit digital sequence, H2 position, H3 position, ... Hk bit digital is set to 1, so, it is equivalent to the Data Identification " input " of these data Bloom filter, after the Data Identification of data all in data base is all inputted Bloom filter by Using such method, just obtain the first Bloom filter described in the embodiment of the present application.That is, the Bloom filter described in the embodiment of the present application specifically includes: n bit digital sequence (is made up of 0 or 1) and k hash function.
After server receives inquiry request by step S101, according to the Data Identification carried in this inquiry request and this first Bloom filter, judge whether the data that this Data Identification is corresponding are present in the method in data base and are: the Data Identification carried in this inquiry request is inputted respectively this k hash function, obtain k hashed value, it is designated as L1 respectively, L2, L3, ... Lk, in n bit digital sequence, judge L1 position respectively, L2 position, L3 position, ... whether the numeral of Lk position is 1, if being 1, then determine that the data that this Data Identification is corresponding are present in data base, if at least one is not 1, then determine that the data that this Data Identification is corresponding are not present in data base.
S103: obtain and return these data.
If the server determine that data exist, then can inquire about data corresponding to this Data Identification from data base and return to client.
S104: determine and inquire about unsuccessfully.
If the server determine that data are absent from, then can determine that this inquiry is looked into for sky, and then determine that this inquires about unsuccessfully, client can be returned to by inquiring about failed information.
From the generation method of above-mentioned Bloom filter with judge, based on Bloom filter, the method whether data exist, Bloom filter is not real data are all stored, but only record whether data exist with the Serial No. of a n position, therefore, server is for an inquiry request, only need to according to this Bloom filter, can judge whether it is that sky is looked into, if not sky is looked into, data are inquired about again from data base, otherwise, can no longer inquire about from data base, therefore can be prevented effectively from sky to check data base and cause unnecessary pressure, reduce database overhead, improve search efficiency.
Certainly, by the generation method of above-mentioned Bloom filter it can also be seen that, for being present in the data in data base, must can determine that it is present in data base by Bloom filter, for being not present in the data in data base, characteristic due to hash function itself, being also possible to be mistaken for by Bloom filter is present in data base, but, this False Rate (also referred to as false percent of pass) can be calculated by above-mentioned n and k, that is, by adjusting the value of n and k, False Rate can be made to be reduced to below acceptable scope, False Rate is such as made to be reduced to below one thousandth.
Additionally, for common Bloom filter, inputting data in Bloom filter is very easily, but, from Bloom filter, " deletion " data are comparatively difficult, such as, tentation data storehouse deletes certain data, then corresponding, the first Bloom filter in the embodiment of the present application is also answered the Data Identification of " deletion " these data, if but the simple H1 position that this Data Identification is corresponding in n bit digital sequence, H2 position, H3 position, ... the numeral of Hk position be set to 0 be clearly improper, this is because after other Data Identifications k hash function of input, being likely to also can corresponding H1 position, H2 position, H3 position, ... in Hk position some or certain several, therefore, in the embodiment of the present application, also can adopt follow-on Bloom filter, each numeral in n bit digital sequence is mainly put the number of times of 1 and is recorded by follow-on Bloom filter, when " deletion " data, the number of times that these data put 1 in each numeral that n bit digital sequence pair is answered can be subtracted 1, for n bit digital sequence one-bit digital, if it is 0 that this bit data is set to the number of times of 1, then this bit digital is changed to 0, so can delete data easily from Bloom filter.
In the step S103 shown in Fig. 1, after server determines that the data that the Data Identification carried in inquiry request is corresponding are present in data base, when obtaining and return these data, first can search these data in the buffer memory of self, if finding, then obtain and return this data, if not finding, in data base, then search these data, and the data found are returned to client.Searching the speed of data from own cache due to server will far faster than the speed searching data from data base, and therefore, server priority searches data from the buffer memory of self, can further improve the efficiency searching data.
Certainly, when server does not find data in the buffer memory of self, but when finding these data in data base, also the data found can be written in the buffer memory of self, in order to when next time inquires about these data, directly can find from the buffer memory of self.
Further, when server priority searches data in the buffer memory of self, make a look up also dependent on pre-saving the second Bloom filter, this second Bloom filter is previously according to all data genaration of storage in buffer memory, concrete, server can according to the Data Identification carried in inquiry request, and the second Bloom filter pre-saved, judge whether the data that this Data Identification is corresponding are present in buffer memory, if, from buffer memory, then obtain these data and return to client, otherwise, data base searches these data, and the data found are returned to client.Certainly, if according to the second Bloom filter determines that these data are not present in buffer memory, and when finding these data from data base, directly can find from buffer memory during for the ease of searching these data next time, the data found also can be written in the buffer memory of self by server, and according to all data stored in the buffer memory after writing these data, update the second Bloom filter.
The generation method of above-mentioned second Bloom filter is all similar with the first Bloom filter with using method, the two differs only in the first Bloom filter is according to the data genaration of storage in data base, second Bloom filter is according to the data genaration of storage in server buffer, repeats with regard to no longer generation and using method to the second Bloom filter here.
It should be noted that, the data query method that the embodiment of the present application provides can be applicable to height and concurrently inquires about more ecommerce scene, then the inquiry request described in the embodiment of the present application includes but not limited to querying commodity information request, transaction record inquiry request etc., described Data Identification includes but not limited to trade name, commercial product identification identification code (IDentity, ID) etc., described server includes but not limited to electricity business's Website server, paying server etc..
The detailed process of the data query that Fig. 2 provides for the embodiment of the present application, specifically includes following steps:
S201: server receives inquiry request.
S202: according to the Data Identification carried in inquiry request, and the first Bloom filter pre-saved, it is judged that whether the data that this Data Identification is corresponding exist, if so, perform step S203, otherwise performs step S206.
Wherein, this first Bloom filter is according to all data genaration of storage in data base.
S203: according to this Data Identification, and the second Bloom filter pre-saved, it is judged that whether the data that this Data Identification is corresponding are present in buffer memory, if so, perform step S204, otherwise performs step S205.
S204: obtain these data from buffer memory and return.
Wherein, this second Bloom filter is according to all data genaration of storage in buffer memory.
The data found are write in buffer memory by S205: search these data in data base and return, and according to all data stored in the buffer memory after writing these data, update the second Bloom filter.
S206: determine and inquire about unsuccessfully.
The data query method provided for the embodiment of the present application above, based on same thinking, the embodiment of the present application additionally provides a kind of data query arrangement, as shown in Figure 3.
The data query arrangement structural representation that Fig. 3 provides for the embodiment of the present application, specifically includes:
Receiver module 301, is used for receiving inquiry request；
Memory module 302, is used for storing the first Bloom filter；
Judge module 303, is used for according to the Data Identification carried in described inquiry request, and the first Bloom filter pre-saved, it is judged that whether the data that described Data Identification is corresponding exist；
Enquiry module 304, for when the judged result of described judge module 303 is for being, obtaining and return described data, when the judged result at described judge module 303 is no, it is determined that inquire about unsuccessfully.
Described memory module 302 specifically for, previously according to all data of storage in data base, generate the first corresponding Bloom filter and preserve.
Described enquiry module 304 specifically for, when the judged result of described judge module 303 is for being, search described data in the buffer, if finding, then obtain and return described data, if not finding, in data base, then search described data, and the data found are returned.
Described enquiry module 304 is additionally operable to, and when finding described data in the database, the data found is write in described buffer memory.
Described enquiry module 304 specifically for, when the judged result of described judge module 303 is for being, according to described Data Identification, and the second Bloom filter pre-saved, judge whether the data that described Data Identification is corresponding are present in buffer memory, if so, from buffer memory, then obtain described data and return, otherwise, data base searches described data, and the data found are returned, wherein, described second Bloom filter is according to all data genaration of storage in described buffer memory.
Described enquiry module 304 is additionally operable to, and when finding described data in the database, writes in described buffer memory by the data found, according to all data stored in the buffer memory after writing described data, updates the second Bloom filter.
A kind of data query method and apparatus that the embodiment of the present application provides, when the method server receives inquiry request, only need according to the Bloom filter prestored, judge whether the data that the Data Identification carried in this inquiry request is corresponding exist, and only search when it exists and return this data, inquire about without to the Data Identification carried in each inquiry request, look into thus sky can effectively be filtered, avoid sky to check data base and cause unnecessary pressure, thus reducing database overhead, promoting the purpose of search efficiency.
Those skilled in the art are it should be appreciated that embodiments herein can be provided as method, system or computer program.Therefore, the application can adopt the form of complete hardware embodiment, complete software implementation or the embodiment in conjunction with software and hardware aspect.And, the application can adopt the form at one or more upper computer programs implemented of computer-usable storage medium (including but not limited to disk memory, CD-ROM, optical memory etc.) wherein including computer usable program code.
The application describes with reference to flow chart and/or the block diagram according to the method for the embodiment of the present application, equipment (system) and computer program.It should be understood that can by the combination of the flow process in each flow process in computer program instructions flowchart and/or block diagram and/or square frame and flow chart and/or block diagram and/or square frame.These computer program instructions can be provided to produce a machine to the processor of general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device so that the instruction performed by the processor of computer or other programmable data processing device is produced for realizing the device of function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and can guide in the computer-readable memory that computer or other programmable data processing device work in a specific way, the instruction making to be stored in this computer-readable memory produces to include the manufacture of command device, and this command device realizes the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, make on computer or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computer or other programmable devices provides for realizing the step of function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.
In a typical configuration, computing equipment includes one or more processor (CPU), input/output interface, network interface and internal memory.
Internal memory potentially includes the forms such as the volatile memory in computer-readable medium, random access memory (RAM) and/or Nonvolatile memory, such as read only memory (ROM) or flash memory (flashRAM).Internal memory is the example of computer-readable medium.
Computer-readable medium includes permanent and impermanency, removable and non-removable media can by any method or technology to realize information storage.Information can be computer-readable instruction, data structure, the module of program or other data.The example of the storage medium of computer includes, but it is not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read only memory (ROM), Electrically Erasable Read Only Memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus or any other non-transmission medium, can be used for the information that storage can be accessed by a computing device.According to defining herein, computer-readable medium does not include temporary computer readable media (transitorymedia), such as data signal and the carrier wave of modulation.
It can further be stated that, term " includes ", " comprising " or its any other variant are intended to comprising of nonexcludability, so that include the process of a series of key element, method, commodity or equipment not only include those key elements, but also include other key elements being not expressly set out, or also include the key element intrinsic for this process, method, commodity or equipment.When there is no more restriction, statement " including ... " key element limited, it is not excluded that there is also other identical element in including the process of described key element, method, commodity or equipment.
It will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer program.Therefore, the application can adopt the form of complete hardware embodiment, complete software implementation or the embodiment in conjunction with software and hardware aspect.And, the application can adopt the form at one or more upper computer programs implemented of computer-usable storage medium (including but not limited to disk memory, CD-ROM, optical memory etc.) wherein including computer usable program code.
The foregoing is only embodiments herein, be not limited to the application.To those skilled in the art, the application can have various modifications and variations.All make within spirit herein and principle any amendment, equivalent replacement, improvement etc., should be included within claims hereof scope.
Claims (12)
1. a data query method, it is characterised in that including:
Receive inquiry request；
According to the Data Identification carried in described inquiry request, and the first Bloom filter pre-saved, it is judged that whether the data that described Data Identification is corresponding exist；
If existing, then obtain and return described data；
If being absent from, it is determined that inquire about unsuccessfully.
2. the method for claim 1, it is characterised in that pre-save described first Bloom filter, specifically include:
Previously according to all data of storage in data base, generate the first corresponding Bloom filter and preserve.
3. the method for claim 1, it is characterised in that obtain and return described data, specifically include:
Search described data in the buffer；
If finding, then obtain and return described data；
If not finding, then in data base, search described data, and the data found are returned.
4. method as claimed in claim 3, it is characterised in that described method also includes:
When finding described data in the database, the data found are write in described buffer memory.
5. the method for claim 1, it is characterised in that obtain and return described data, specifically include:
According to described Data Identification, and the second Bloom filter pre-saved, it is judged that whether the data that described Data Identification is corresponding are present in buffer memory, and wherein, described second Bloom filter is according to all data genaration of storage in described buffer memory；
If so, from buffer memory, then obtain described data and return；
Otherwise, data base searches described data, and the data found are returned.
6. method as claimed in claim 5, it is characterised in that described method also includes:
When finding described data in the database, the data found are write in described buffer memory；
According to all data stored in the buffer memory after writing described data, update the second Bloom filter.
7. a data query arrangement, it is characterised in that including:
Receiver module, is used for receiving inquiry request；
Memory module, is used for storing the first Bloom filter；
Judge module, is used for according to the Data Identification carried in described inquiry request, and the first Bloom filter pre-saved, it is judged that whether the data that described Data Identification is corresponding exist；
Enquiry module, for when the judged result of described judge module is for being, obtaining and return described data, when the judged result at described judge module is no, it is determined that inquire about unsuccessfully.
8. device as claimed in claim 7, it is characterised in that described memory module specifically for, previously according to all data of storage in data base, generate the first corresponding Bloom filter and preserve.
9. device as claimed in claim 7, it is characterized in that, described enquiry module specifically for, when the judged result of described judge module is for being, search described data in the buffer, if finding, then obtain and return described data, if not finding, then in data base, search described data, and the data found are returned.
10. the data found, when finding described data in the database, are write in described buffer memory by device as claimed in claim 9, it is characterised in that described enquiry module is additionally operable to.
11. device as claimed in claim 7, it is characterized in that, described enquiry module specifically for, when the judged result of described judge module is for being, according to described Data Identification, and the second Bloom filter pre-saved, judge whether the data that described Data Identification is corresponding are present in buffer memory, if so, from buffer memory, then obtain described data and return, otherwise, data base searches described data, and the data found are returned, wherein, described second Bloom filter is according to all data genaration of storage in described buffer memory.
12. device as claimed in claim 11, it is characterised in that described enquiry module is additionally operable to, when finding described data in the database, the data found are write in described buffer memory, according to all data stored in the buffer memory after writing described data, updates the second Bloom filter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410720347.3A CN105718455B (en) | 2014-12-01 | 2014-12-01 | A kind of data query method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410720347.3A CN105718455B (en) | 2014-12-01 | 2014-12-01 | A kind of data query method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105718455A true CN105718455A (en) | 2016-06-29 |
| CN105718455B CN105718455B (en) | 2019-06-14 |
Family
ID=56146280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410720347.3A Active CN105718455B (en) | 2014-12-01 | 2014-12-01 | A kind of data query method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105718455B (en) |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106469225A (en) * | 2016-09-28 | 2017-03-01 | 厦门嵘拓物联科技有限公司 | A kind of method that in intelligent workshop management, magnanimity manufaturing data accesses |
| CN106815334A (en) * | 2016-12-30 | 2017-06-09 | 晶赞广告（上海）有限公司 | A kind of data query method and device for terminal |
| CN107888659A (en) * | 2017-10-12 | 2018-04-06 | 北京京东尚科信息技术有限公司 | The processing method and system of user's request |
| CN108133031A (en) * | 2017-12-29 | 2018-06-08 | 北京搜狐新媒体信息技术有限公司 | A kind of method and device of filtered recommendation video candidate result |
| CN108427687A (en) * | 2017-02-15 | 2018-08-21 | 北京国双科技有限公司 | A kind of number of users processing method and processing device |
| CN109271408A (en) * | 2018-08-31 | 2019-01-25 | 阿里巴巴集团控股有限公司 | A kind of distributed data connection processing method, device, equipment and storage medium |
| CN109446172A (en) * | 2017-10-12 | 2019-03-08 | 贵阳朗玛信息技术股份有限公司 | Log storing method, read method and device |
| CN109597807A (en) * | 2018-10-25 | 2019-04-09 | 阿里巴巴集团控股有限公司 | Number storehouse list processing method and apparatus |
| CN109614407A (en) * | 2018-12-10 | 2019-04-12 | 北京奇艺世纪科技有限公司 | A kind of request processing method and equipment |
| CN109977261A (en) * | 2019-04-02 | 2019-07-05 | 北京奇艺世纪科技有限公司 | A kind of processing method of request of data, device and server |
| CN110209874A (en) * | 2019-04-24 | 2019-09-06 | 北京奇艺世纪科技有限公司 | Information processing method, device, electronic equipment and storage medium |
| CN110232095A (en) * | 2019-05-21 | 2019-09-13 | 中国平安财产保险股份有限公司 | A kind of method of data synchronization, device, storage medium and server |
| CN110765138A (en) * | 2019-10-31 | 2020-02-07 | 北京达佳互联信息技术有限公司 | Data query method, device, server and storage medium |
| CN110837521A (en) * | 2019-11-15 | 2020-02-25 | 北京金山云网络技术有限公司 | Data query method and device and server |
| CN110968599A (en) * | 2018-09-30 | 2020-04-07 | 北京国双科技有限公司 | Inquiry method and device based on Impala |
| CN111159213A (en) * | 2018-11-07 | 2020-05-15 | 航天信息股份有限公司 | Data query method, device, system and storage medium |
| CN111309737A (en) * | 2020-03-11 | 2020-06-19 | 支付宝(杭州)信息技术有限公司 | List query method, device and equipment |
| CN111488371A (en) * | 2020-04-07 | 2020-08-04 | 中国人民财产保险股份有限公司 | Data query method and device |
| CN112084216A (en) * | 2020-09-16 | 2020-12-15 | 上海宏路数据技术股份有限公司 | Data query system based on bloom filter |
| CN112199396A (en) * | 2020-10-14 | 2021-01-08 | 北京理工大学 | Industrial Internet identification query method and system facing MES |
| CN112528098A (en) * | 2020-12-16 | 2021-03-19 | 浙江百应科技有限公司 | Data query method, system, electronic equipment and storage medium |
| CN112818019A (en) * | 2021-01-29 | 2021-05-18 | 北京思特奇信息技术股份有限公司 | Query request filtering method applied to Redis client and Redis client |
| CN113254480A (en) * | 2020-02-13 | 2021-08-13 | 中国移动通信集团广东有限公司 | Data query method and device |
| CN113297266A (en) * | 2020-07-08 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Data processing method, device, equipment and computer storage medium |
| CN113691590A (en) * | 2021-07-28 | 2021-11-23 | 上海浦东发展银行股份有限公司 | Static resource acquisition method, system, device, computer equipment and storage medium |
| CN113760965A (en) * | 2020-06-17 | 2021-12-07 | 北京沃东天骏信息技术有限公司 | Data query method and device |
| CN114117187A (en) * | 2022-01-25 | 2022-03-01 | 深圳希施玛数据科技有限公司 | Data query method and related device |
| CN114880504A (en) * | 2022-07-08 | 2022-08-09 | 支付宝(杭州)信息技术有限公司 | Graph data query method, device and equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923568A (en) * | 2010-06-23 | 2010-12-22 | 北京星网锐捷网络技术有限公司 | Method for increasing and canceling elements of Bloom filter and Bloom filter |
| CN102810107A (en) * | 2011-06-01 | 2012-12-05 | 英业达股份有限公司 | Processing method for repeating data |
| US20130132408A1 (en) * | 2011-11-23 | 2013-05-23 | Mark Cameron Little | System and Method for Using Bloom Filters to Determine Data Locations in Distributed Data Stores |
| US20130159261A1 (en) * | 2011-12-20 | 2013-06-20 | Quantum Corporation | De-duplication reference tag reconciliation |
| CN103440249A (en) * | 2013-07-23 | 2013-12-11 | 南京烽火星空通信发展有限公司 | System and method for rapidly searching unstructured data |
| US20140040317A1 (en) * | 2012-07-31 | 2014-02-06 | Cisco Technology, Inc. | Methods and apparatuses for improving database search performance |
-
2014
- 2014-12-01 CN CN201410720347.3A patent/CN105718455B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923568A (en) * | 2010-06-23 | 2010-12-22 | 北京星网锐捷网络技术有限公司 | Method for increasing and canceling elements of Bloom filter and Bloom filter |
| CN102810107A (en) * | 2011-06-01 | 2012-12-05 | 英业达股份有限公司 | Processing method for repeating data |
| US20130132408A1 (en) * | 2011-11-23 | 2013-05-23 | Mark Cameron Little | System and Method for Using Bloom Filters to Determine Data Locations in Distributed Data Stores |
| US20130159261A1 (en) * | 2011-12-20 | 2013-06-20 | Quantum Corporation | De-duplication reference tag reconciliation |
| US20140040317A1 (en) * | 2012-07-31 | 2014-02-06 | Cisco Technology, Inc. | Methods and apparatuses for improving database search performance |
| CN103440249A (en) * | 2013-07-23 | 2013-12-11 | 南京烽火星空通信发展有限公司 | System and method for rapidly searching unstructured data |
Cited By (39)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106469225A (en) * | 2016-09-28 | 2017-03-01 | 厦门嵘拓物联科技有限公司 | A kind of method that in intelligent workshop management, magnanimity manufaturing data accesses |
| CN106469225B (en) * | 2016-09-28 | 2019-04-16 | 厦门嵘拓物联科技有限公司 | It is a kind of intelligence workshop management in magnanimity manufaturing data access method |
| CN106815334A (en) * | 2016-12-30 | 2017-06-09 | 晶赞广告（上海）有限公司 | A kind of data query method and device for terminal |
| CN108427687A (en) * | 2017-02-15 | 2018-08-21 | 北京国双科技有限公司 | A kind of number of users processing method and processing device |
| CN109446172A (en) * | 2017-10-12 | 2019-03-08 | 贵阳朗玛信息技术股份有限公司 | Log storing method, read method and device |
| CN107888659A (en) * | 2017-10-12 | 2018-04-06 | 北京京东尚科信息技术有限公司 | The processing method and system of user's request |
| CN108133031A (en) * | 2017-12-29 | 2018-06-08 | 北京搜狐新媒体信息技术有限公司 | A kind of method and device of filtered recommendation video candidate result |
| CN108133031B (en) * | 2017-12-29 | 2021-01-29 | 北京搜狐新媒体信息技术有限公司 | Method and device for filtering recommended video candidate result |
| US11188535B2 (en) | 2018-08-31 | 2021-11-30 | Beijing Oceanbase Technology Co., Ltd. | Distributed join operation processing method, apparatus, device, and storage medium |
| CN109271408A (en) * | 2018-08-31 | 2019-01-25 | 阿里巴巴集团控股有限公司 | A kind of distributed data connection processing method, device, equipment and storage medium |
| TWI716016B (en) * | 2018-08-31 | 2021-01-11 | 開曼群島商創新先進技術有限公司 | Distributed data connection processing method, device, equipment and storage medium |
| CN110968599B (en) * | 2018-09-30 | 2023-04-07 | 北京国双科技有限公司 | Inquiry method and device based on Impala |
| CN110968599A (en) * | 2018-09-30 | 2020-04-07 | 北京国双科技有限公司 | Inquiry method and device based on Impala |
| CN109597807A (en) * | 2018-10-25 | 2019-04-09 | 阿里巴巴集团控股有限公司 | Number storehouse list processing method and apparatus |
| CN111159213A (en) * | 2018-11-07 | 2020-05-15 | 航天信息股份有限公司 | Data query method, device, system and storage medium |
| CN109614407A (en) * | 2018-12-10 | 2019-04-12 | 北京奇艺世纪科技有限公司 | A kind of request processing method and equipment |
| CN109977261A (en) * | 2019-04-02 | 2019-07-05 | 北京奇艺世纪科技有限公司 | A kind of processing method of request of data, device and server |
| CN110209874A (en) * | 2019-04-24 | 2019-09-06 | 北京奇艺世纪科技有限公司 | Information processing method, device, electronic equipment and storage medium |
| CN110209874B (en) * | 2019-04-24 | 2021-08-20 | 北京奇艺世纪科技有限公司 | Information processing method, information processing device, electronic equipment and storage medium |
| CN110232095B (en) * | 2019-05-21 | 2024-04-02 | 中国平安财产保险股份有限公司 | Data synchronization method, device, storage medium and server |
| CN110232095A (en) * | 2019-05-21 | 2019-09-13 | 中国平安财产保险股份有限公司 | A kind of method of data synchronization, device, storage medium and server |
| CN110765138A (en) * | 2019-10-31 | 2020-02-07 | 北京达佳互联信息技术有限公司 | Data query method, device, server and storage medium |
| CN110837521A (en) * | 2019-11-15 | 2020-02-25 | 北京金山云网络技术有限公司 | Data query method and device and server |
| CN113254480B (en) * | 2020-02-13 | 2024-04-19 | 中国移动通信集团广东有限公司 | Data query method and device |
| CN113254480A (en) * | 2020-02-13 | 2021-08-13 | 中国移动通信集团广东有限公司 | Data query method and device |
| CN111309737A (en) * | 2020-03-11 | 2020-06-19 | 支付宝(杭州)信息技术有限公司 | List query method, device and equipment |
| CN111488371A (en) * | 2020-04-07 | 2020-08-04 | 中国人民财产保险股份有限公司 | Data query method and device |
| CN113760965A (en) * | 2020-06-17 | 2021-12-07 | 北京沃东天骏信息技术有限公司 | Data query method and device |
| CN113297266A (en) * | 2020-07-08 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Data processing method, device, equipment and computer storage medium |
| CN112084216A (en) * | 2020-09-16 | 2020-12-15 | 上海宏路数据技术股份有限公司 | Data query system based on bloom filter |
| CN112199396A (en) * | 2020-10-14 | 2021-01-08 | 北京理工大学 | Industrial Internet identification query method and system facing MES |
| CN112528098A (en) * | 2020-12-16 | 2021-03-19 | 浙江百应科技有限公司 | Data query method, system, electronic equipment and storage medium |
| CN112818019A (en) * | 2021-01-29 | 2021-05-18 | 北京思特奇信息技术股份有限公司 | Query request filtering method applied to Redis client and Redis client |
| CN112818019B (en) * | 2021-01-29 | 2024-02-02 | 北京思特奇信息技术股份有限公司 | Query request filtering method applied to Redis client and Redis client |
| CN113691590A (en) * | 2021-07-28 | 2021-11-23 | 上海浦东发展银行股份有限公司 | Static resource acquisition method, system, device, computer equipment and storage medium |
| CN114117187A (en) * | 2022-01-25 | 2022-03-01 | 深圳希施玛数据科技有限公司 | Data query method and related device |
| CN114117187B (en) * | 2022-01-25 | 2022-06-21 | 深圳希施玛数据科技有限公司 | Data query method and related device |
| CN114880504A (en) * | 2022-07-08 | 2022-08-09 | 支付宝(杭州)信息技术有限公司 | Graph data query method, device and equipment |
| WO2024008117A1 (en) * | 2022-07-08 | 2024-01-11 | 支付宝(杭州)信息技术有限公司 | Graph data query method, apparatus and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105718455B (en) | 2019-06-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105718455A (en) | Data query method and apparatus | |
| CN107247808B (en) | Distributed NewSQL database system and picture data query method | |
| US8122008B2 (en) | Joining tables in multiple heterogeneous distributed databases | |
| KR102564170B1 (en) | Method and device for storing data object, and computer readable storage medium having a computer program using the same | |
| CN102725755B (en) | Method and system of file access | |
| CN106547784B (en) | Data splitting and storing method and device | |
| US11269902B2 (en) | Time series data management method, device, and apparatus | |
| CN106202112A (en) | CACHE DIRECTORY method for refreshing and device | |
| CN108021717B (en) | Method for implementing lightweight embedded file system | |
| CN103488687A (en) | Searching system and searching method of big data | |
| CN110888837B (en) | Object storage small file merging method and device | |
| CN107391544B (en) | Processing method, device and equipment of column type storage data and computer storage medium | |
| CN111538724A (en) | Method for managing index | |
| CN105447166A (en) | Keyword based information search method and system | |
| CN104331453A (en) | Distributed file system and constructing method thereof | |
| CN104077397A (en) | Response method for distributed big data classification retrieval webpage | |
| CN107291768B (en) | Index establishing method and device | |
| CN111324665B (en) | Log playback method and device | |
| CN106547646B (en) | Data backup and recovery method and data backup and recovery device | |
| CN103914483A (en) | File storage method and device and file reading method and device | |
| CN109271449A (en) | A kind of distributed storage inquiry system file-based and querying method | |
| CN104834650A (en) | Method and system for generating effective query tasks | |
| CN106294886A (en) | A kind of method and system of full dose extracted data from HBase | |
| CN104166649B (en) | Caching method and equipment for search engine | |
| CN102955808A (en) | Data acquisition method and distributed file system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200918 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200918 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Patentee before: Alibaba Group Holding Ltd. |
|
| TR01 | Transfer of patent right |