CN109614407A - A kind of request processing method and equipment - Google Patents

A kind of request processing method and equipment Download PDF

Info

Publication number
CN109614407A
CN109614407A CN201811504076.2A CN201811504076A CN109614407A CN 109614407 A CN109614407 A CN 109614407A CN 201811504076 A CN201811504076 A CN 201811504076A CN 109614407 A CN109614407 A CN 109614407A
Authority
CN
China
Prior art keywords
identity
database
bloom filter
access request
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201811504076.2A
Other languages
Chinese (zh)
Inventor
艾国信
赵鸿楠
汤文强
周志成
宋超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201811504076.2A priority Critical patent/CN109614407A/en
Publication of CN109614407A publication Critical patent/CN109614407A/en
Withdrawn legal-status Critical Current

Links

Abstract

The present invention provides a kind of request processing method and equipment, it requests to be provided with Bloom filter in the memory of processing equipment, the identity of registration user is preserved in the memory, by controlling the Bloom filter according to the identity of the registration user saved in the memory, the access request for being sent to the request processing equipment to nonregistered user is filtered, wherein, identity is carried in the access request, obtain the filtered access request of the Bloom filter, the identity that the filtered access request of the Bloom filter carries is searched in first database, the filtered access request of the Bloom filter is handled according to lookup result.The present invention can effectively filter out nonregistered user to the access request to register the database of user service, mitigate to register the access pressure of the database of user service.

Description

A kind of request processing method and equipment
Technical field:
The present invention relates to internet system service field more particularly to a kind of request processing method and equipment.
Background technique:
Nowadays, Internet company often passes through database and provides miscellaneous data service for user, and user can be with It is accessed by sending request to the data in database.
When user accesses the webpage of certain Internet company, if the user is registration user, then the webpage can be to the interconnection The server of net company sends access request, which can inquire whether the user is registration user in the database, if It is that the information of the registration user stored in database (such as: head portrait, the pet name, viewing record etc.) will be returned to webpage In shown.
But except registration open air, there are also a large amount of nonregistered users, and when nonregistered user accesses the webpage, webpage Also access request can be sent to server, even if not having the information of nonregistered user in database, server equally also can be in number According to carrying out inquiry operation in library.So can be caused to database when a large amount of nonregistered users send access request to server Very big pressure.
Summary of the invention:
In view of the above problems, it proposes on the present invention overcomes the above problem or at least be partially solved in order to provide one kind A kind of request processing method and equipment, the technical solution for stating problem are as follows:
A kind of request processing method is applied in request processing equipment, is provided in the memory of the request processing equipment Bloom filter preserves the identity of registration user in the memory, which comprises
The Bloom filter is controlled according to the identity of the registration user saved in the memory, to nonregistered user The access request for being sent to the request processing equipment is filtered, wherein carries identity in the access request;
Obtain the filtered access request of the Bloom filter;
The identity that the filtered access request of the Bloom filter carries is searched in first database, according to looking into Result is looked for handle the filtered access request of the Bloom filter.
Optionally, the identity that the filtered access request of the Bloom filter is searched in first database and is carried Mark, is handled the filtered access request of the Bloom filter according to lookup result, comprising:
The identity that the filtered access request of the Bloom filter carries is searched in first database, if looked into It finds, then it is corresponding with the identity found to the user feedback for sending the filtered access request of Bloom filter Information searches the identity that the filtered access request of the Bloom filter carries if do not found in the second database Mark, is handled the filtered access request of the Bloom filter according to lookup result, wherein with the identity Corresponding information is stored in the first database.
Optionally, the identity that the filtered access request of the Bloom filter is searched in the second database and is carried Mark, is handled the filtered access request of the Bloom filter according to lookup result, comprising:
The identity that the filtered access request of the Bloom filter carries is searched in the second database, if looked into It finds, then it is corresponding with the identity found to the user feedback for sending the filtered access request of Bloom filter Information, and by the identity found and the corresponding information preservation of the identity found into the first database, If do not found, user is notified not inquire requested information.
Optionally, the identity that the filtered access request of the Bloom filter is searched in the second database and is carried Mark, is handled the filtered access request of the Bloom filter according to lookup result, further includes:
The identity mark that the filtered access request of the Bloom filter as described in not searching in second database carries Know, then lookup result is saved in the first database.
Optionally, the method, further includes:
It is monitored by monitoring node application server, when the identity for having new registration user is written to described answer With server and after being saved in the first database, the identity for the new registration user that the first database is saved Mark is saved in the memory of the request processing equipment.
Optionally, the method, further includes:
All or part of identity in the first database is divided into more parts of identity groups;
The more parts of identity groups are successively saved in the memory of the request processing equipment according to default preservation sequence In.
A kind of request processing equipment is provided with Bloom filter in the memory of the request processing equipment, in the memory The identity of registration user is preserved, the request processing equipment includes: the first filter element, first obtains unit and first Searching unit,
First filter element, for controlling the Bloom filter according to the registration user's saved in the memory Identity, the access request for being sent to the request processing equipment to nonregistered user are filtered, wherein the access is asked Identity is carried in asking;
The first obtains unit, for obtaining the filtered access request of the Bloom filter;
First searching unit, for searching the filtered access request of the Bloom filter in first database The identity of carrying is handled the filtered access request of the Bloom filter according to lookup result.
Optionally, first searching unit, including first searches subelement, third searches subelement and the first feedback Unit,
Described first searches subelement, asks for searching the filtered access of the Bloom filter in first database The identity of carrying is asked, if found, the first feedback subelement is triggered if do not found and triggers described the Three search subelement;
The third searches subelement, asks for searching the filtered access of the Bloom filter in the second database The identity for asking carrying is handled the filtered access request of the Bloom filter according to lookup result, wherein with The corresponding information of the identity is stored in the first database;
The first feedback subelement, for the user feedback to the transmission filtered access request of Bloom filter Information corresponding with the identity found.
Optionally, the third searches subelement, comprising: second searches subelement, the second feedback subelement, the first preservation Subelement and the first notice subelement,
Described second searches subelement, asks for searching the filtered access of the Bloom filter in the second database The identity of carrying is asked, if found, triggers the second feedback subelement and first saving subunit, if It does not find, then triggers the first notice subelement,
The second feedback subelement, for the user feedback to the transmission filtered access request of Bloom filter Information corresponding with the identity found;
First saving subunit, for by the identity found and the corresponding information of the identity found It is saved in the first database;
The first notice subelement, for notifying user not inquire requested information.
Optionally, the third searches subelement, further includes: the second saving subunit, for searching son described second It, will when unit does not search the identity that the filtered access request of the Bloom filter carries in second database Lookup result is saved in the first database.
Optionally, the equipment, further includes: the second storage unit,
Second storage unit, for being monitored by monitoring node application server, when there is new registration user Identity be written to the application server and be saved in after the first database, the first database is saved The new registration user identity be saved in it is described request processing equipment memory in.
Optionally, the equipment, further includes: the first grouped element and third storage unit,
First grouped element, for all or part of identity in the first database to be divided into more parts Identity group;
The third storage unit, for the more parts of identity groups to be successively saved in institute according to default preservation sequence In the memory for stating request processing equipment.
According to the above aspect of the present invention, a kind of request processing method provided by the invention and equipment, are requested in the memory of processing equipment It is provided with Bloom filter, the identity of registration user is preserved in the memory, which comprises it is grand to control the cloth Filter is sent to the request processing to nonregistered user and sets according to the identity of the registration user saved in the memory Standby access request is filtered, wherein carries identity in the access request;Obtain the Bloom filter filtering Access request afterwards;The identity that the filtered access request of the Bloom filter carries is searched in first database, The filtered access request of the Bloom filter is handled according to lookup result.The present invention can effectively filter out non-registered User mitigates to register the access pressure of the database of user service the access request to register the database of user service.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention, And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention Limitation.In the accompanying drawings:
Fig. 1 shows a kind of flow chart of request processing method provided in an embodiment of the present invention;
Fig. 2 shows the flow charts of another request processing method provided in an embodiment of the present invention;
Fig. 3 shows the flow chart of another request processing method provided in an embodiment of the present invention;
Fig. 4 shows the flow chart of another request processing method provided in an embodiment of the present invention;
Fig. 5 shows the flow chart of another request processing method provided in an embodiment of the present invention;
Fig. 6 shows the flow chart of another request processing method provided in an embodiment of the present invention;
Fig. 7 shows the flow chart of another request processing method provided in an embodiment of the present invention;
Fig. 8 shows a kind of structure chart for requesting processing equipment provided in an embodiment of the present invention;
Fig. 9 shows the structure chart of another request processing equipment provided in an embodiment of the present invention;
Figure 10 shows the structure chart of another request processing equipment provided in an embodiment of the present invention;
Figure 11 shows the structure chart of another request processing equipment provided in an embodiment of the present invention;
Figure 12 shows the structure chart of another request processing equipment provided in an embodiment of the present invention;
Figure 13 shows the structure chart of another request processing equipment provided in an embodiment of the present invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure It is fully disclosed to those skilled in the art.
As shown in Figure 1, a kind of request processing method provided in an embodiment of the present invention, is applied in request processing equipment, institute It states in the memory of request processing equipment and is provided with Bloom filter, the identity of registration user is preserved in the memory, it should Method may include:
S100, the control Bloom filter are according to the identity for registering user saved in the memory, to non-note The access request that volume user is sent to the request processing equipment is filtered, wherein carries identity in the access request Mark;
Specifically, Bloom filter is a very long binary vector and a series of random mapping functions, for retrieving Whether one element is in a set, the either request of registration user or nonregistered user transmission, all includes in request There is corresponding identity, what is wherein saved in memory is the identity of all registration users, it is believed that is registration user The set of identity, after user transmits the request to request processing equipment, by Bloom filter in registration user identity mark Know and find the identity of the user in set, for example, a user wants inquiry authentication information, first sends inquiry request to asking It asks in processing equipment, is compared by Bloom filter according to identity in memory and the identity in the inquiry request, Judge whether this user registers user, if it is, searching certification corresponding with the identity in first database Otherwise information refuses the inquiry request of this user.
S200, the filtered access request of Bloom filter is obtained;
S300, the identity that the filtered access request of the Bloom filter carries is searched in first database, The filtered access request of the Bloom filter is handled according to lookup result.
Specifically, first database can be the use that log type key value database Redis, Redis are an open sources ANSI C language writes, support network, it is memory-based also can persistence log type, Key-Value database, and provide more The API of kind of language, wherein ANSI is a kind of character code, expression be 0*80~0*FFFF range 2 bytes, the first data Library provides a distributed cache system to provide to access interface and the local data buffering of this first database to drop Low network pressure.
Wherein, the identity for registering user and information dispersion corresponding with identity are stored in more by first database In the independent equipment of platform, when register user issue request after, searched in first database registration user identity and Information corresponding with identity.
A kind of request processing method provided in an embodiment of the present invention can be applied in request processing equipment, the request It is provided with Bloom filter in the memory of processing equipment, the identity of registration user is preserved in the memory, described in control Bloom filter is sent at the request nonregistered user according to the identity of the registration user saved in the memory The access request of reason equipment is filtered, wherein is carried identity in the access request, is obtained the Bloom filter Filtered access request searches the identity mark that the filtered access request of the Bloom filter carries in first database Know, the filtered access request of the Bloom filter is handled according to lookup result.The present invention can filter out non-note The access request of volume user solves the problems, such as that registration user and nonregistered user cannot be distinguished in the prior art, mitigate redis with The access pressure of MySQL.
Optionally, as shown in Fig. 2, another kind request processing method provided in an embodiment of the present invention, may include:
S100, the control Bloom filter are according to the identity for registering user saved in the memory, to non-note The access request that volume user is sent to the request processing equipment is filtered, wherein carries identity in the access request Mark;
S200, the filtered access request of Bloom filter is obtained;
S310, the identity that the filtered access request of the Bloom filter carries is searched in first database, If found, S320 is thened follow the steps;If do not found, S330 is thened follow the steps;
S320, to the user feedback for sending the filtered access request of Bloom filter and the identity found Corresponding information;
S330, the identity that the filtered access request of the Bloom filter carries is searched in the second database, The filtered access request of the Bloom filter is handled according to lookup result, wherein corresponding with the identity Information be stored in the first database.
In order to facilitate understanding, be illustrated herein: a user issues the inquiry request of inquiry authentication information, passes through After Bloom filter is proved to be registration user, searched in first database and the consistent body of identity in the inquiry request Authentication information, if found, is just fed back to user, if do not found, just continues to look into the second database by part mark It looks for and the consistent identity of identity in the inquiry request.
Wherein, the second database can be MySQL, because the information needed for all registration users requires storage When, then the memory space needed is just very big, first database only enough stores some information often inquired, for without The information being often queried is stored in the second database, meanwhile, the second database preserves the information of first database whole.
Step S310 to step S330 can be a kind of specific executive mode of the step S300 in method shown in Fig. 1.
Optionally, as shown in figure 3, step S330 may further include in method shown in Fig. 2:
S331, the identity that the filtered access request of the Bloom filter carries is searched in the second database, If found, S332 is thened follow the steps;If do not found, S333 is thened follow the steps;
S332, to the user feedback for sending the filtered access request of Bloom filter and the identity found Corresponding information, and by the identity found and the corresponding information preservation of the identity found to first data In library;
S333, user is notified not inquire requested information.
In order to facilitate understanding, be illustrated herein: a user issues the inquiry request of inquiry authentication information, passes through After Bloom filter is proved to be registration user, searched in first database and the consistent body of identity in the inquiry request Authentication information, if found, is just fed back to user, if do not found, just continues to look into the second database by part mark Look for the consistent identity of identity in the inquiry request, if found in the second database and the inquiry request In the consistent identity of identity, then the information under the identity being stored in the second database is fed back to this User, and the identity and authentication information corresponding with the identity are saved in first database, facilitate the use Family can inquire the authentication information when inquiring authentication information next time more quickly, if do not found, notify the user Requested information is not inquired.
Optionally, on the basis of embodiment shown in Fig. 3, as shown in figure 4, step S330 can also be wrapped in method shown in Fig. 2 It includes:
The body that the filtered access request of S334, the Bloom filter as described in not searching in second database carries Lookup result, then be saved in the first database by part mark.
Wherein, the execution sequence of step S333 and step S334 are not limited in Fig. 4 a kind of, step S334 in Fig. 4 It can execute prior to step S333 or be executed parallel with step S333.
In order to facilitate understanding, be illustrated herein: a user issues the inquiry request of inquiry authentication information, passes through After Bloom filter is proved to be registration user, searched in first database and the consistent body of identity in the inquiry request Authentication information, if found, is just fed back to user, if do not found, just continues to look into the second database by part mark Look for the consistent identity of identity in the inquiry request, if found in the second database and the inquiry request In the consistent identity of identity, then the information under the identity being stored in the second database is fed back to this User, and the identity and authentication information corresponding with the identity are saved in first database, facilitate the use Family can inquire the authentication information when inquiring authentication information next time more quickly, if do not found, notify the user Requested information is not inquired, and the result that this is not found is saved in the first database, prevent the user Inquiry authentication information is repeated, wherein the corresponding information of identity can be authentication information, copyright information, the pet name, head portrait, affiliated Whether circle opens bubble ring and channel information etc..
Optionally, as shown in figure 5, another kind request processing method provided in an embodiment of the present invention, may include:
S100, the control Bloom filter are according to the identity for registering user saved in the memory, to non-note The access request that volume user is sent to the request processing equipment is filtered, wherein carries identity in the access request Mark;
S200, the filtered access request of Bloom filter is obtained;
S300, the identity that the filtered access request of the Bloom filter carries is searched in first database, The filtered access request of the Bloom filter is handled according to lookup result;
S400, it is monitored by monitoring node application server, when there is the identity of new registration user to be written to The application server is simultaneously saved in after the first database, the new registration user that the first database is saved Identity be saved in it is described request processing equipment memory in.
Wherein, monitoring node can be Zookeeper, and Zookeeper is distributed, open source code a distribution Application program coordination service is the manager of cluster, monitors the feedback that the state of each node in cluster is submitted according to node Next step reasonable operation is carried out, the function of monitoring node data variation of Zookeeper is mainly utilized in the present invention.
Specifically, the identity of new registration user and information corresponding with identity are written to application server first In, then be loaded into first database and the second database by application server, new registration is obtained when listening to application server After the identity of user and information corresponding with identity, request processing equipment sends to first database and obtains the new note Volume user identity request, wait application server load new registration user identity and with identity pair After the information to first database answered, the identity of new registration user is sent to request processing and set by first database Standby, request processing equipment saves the identity of new registration user in memory, and the above method can be regarded as grand to cloth A kind of update of filter.
As long as can all execute step S400 it is understood that there is new registration user, the first database can all be protected The identity of the new registration user deposited is saved in the memory of the request processing equipment, only wherein one shown in Fig. 5 The possible situation of kind.
Optionally, as shown in fig. 6, another kind request processing method provided in an embodiment of the present invention, may include:
S100, the control Bloom filter are according to the identity for registering user saved in the memory, to non-note The access request that volume user is sent to the request processing equipment is filtered, wherein carries identity in the access request Mark;
S200, the filtered access request of Bloom filter is obtained;
S300, the identity that the filtered access request of the Bloom filter carries is searched in first database, The filtered access request of the Bloom filter is handled according to lookup result;
S500, all or part of identity in the first database is divided into more parts of identity groups;
Wherein, it is identical to be divided into the quantity that more parts of identity groups can be every group of identity, it can also be with every group of identity The quantity of mark is different, is specifically divided according to the actual situation, is specifically divided into 1000 parts in the present invention.
S600, the more parts of identity groups are successively saved in the request processing equipment according to default preservation sequence In memory.
Specifically, all or part of identity in first database is carried out to be divided into multiple identity groups Afterwards, successively each identity group is saved in the memory of request processing equipment according to default preservation sequence, wherein default protect Deposit sequence, be it is pre-set, can be adjusted according to actual needs, main purpose be avoid to request processing equipment into It breaks down when row initialization.
As long as step S500 can be all executed, to first it is understood that needing to initialize request processing equipment All or part of identity in database be divided into more parts of identity groups and step S600 according to default preservation sequence according to It is only one of possible shown in Fig. 6 in the secondary memory that the more parts of identity groups are saved in the request processing equipment The case where.
Optionally, as shown in fig. 7, another kind request processing method provided in an embodiment of the present invention, may include:
S100, the control Bloom filter are according to the identity for registering user saved in the memory, to non-note The access request that volume user is sent to the request processing equipment is filtered, wherein carries identity in the access request Mark;
S200, the filtered access request of Bloom filter is obtained;
S300, the identity that the filtered access request of the Bloom filter carries is searched in first database, The filtered access request of the Bloom filter is handled according to lookup result;
S400, it is monitored by monitoring node application server, when there is the identity of new registration user to be written to The application server is simultaneously saved in after the first database, the new registration user that the first database is saved Identity be saved in it is described request processing equipment memory in;
S500, all or part of identity in the first database is divided into more parts of identity groups;
S600, the more parts of identity groups are successively saved in the request processing equipment according to default preservation sequence In memory.
Above-mentioned steps S100 to step S600 has been illustrated in the aforementioned embodiment, refers to previous embodiment, no longer It repeats.
Corresponding with above method embodiment, the embodiment of the invention also provides a kind of request processing equipments.
As shown in figure 8, a kind of request processing equipment provided in an embodiment of the present invention, in the memory of the request processing equipment It is provided with Bloom filter, the identity of registration user is preserved in the memory, the request processing equipment may include: First filter element 001, first obtains unit 002 and the first searching unit 003,
First filter element 001 is used for controlling the Bloom filter according to the registration saved in the memory The identity at family, the access request for being sent to the request processing equipment to nonregistered user are filtered, wherein the visit It asks in request and carries identity;
Specifically, Bloom filter is a very long binary vector and a series of random mapping functions, for retrieving Whether one element is in a set, the either request of registration user or nonregistered user transmission, all includes in request There is corresponding identity, what is wherein saved in memory is the identity of all registration users, it is believed that is registration user The set of identity, after user transmits the request to request processing equipment, by Bloom filter in registration user identity mark Know and find the identity of the user in set, for example, a user wants inquiry authentication information, first sends inquiry request to asking It asks in processing equipment, is compared by Bloom filter according to identity in memory and the identity in the inquiry request, Judge whether this user registers user, if it is, searching certification corresponding with the identity in first database Otherwise information refuses the inquiry request of this user.
The first obtains unit 002, for obtaining the filtered access request of the Bloom filter;
First searching unit 003, for searching the filtered access of the Bloom filter in first database The identity carried is requested, the filtered access request of the Bloom filter is handled according to lookup result.
Specifically, first database can be the use that log type key value database Redis, Redis are an open sources ANSI C language writes, support network, it is memory-based also can persistence log type, Key-Value database, and provide more The API of kind of language, wherein ANSI is a kind of character code, expression be 0*80~0*FFFF range 2 bytes, the first data Library provides a distributed cache system to provide to access interface and the local data buffering of this first database to drop Low network pressure.
Wherein, the identity for registering user and information dispersion corresponding with identity are stored in more by first database In the independent equipment of platform, when register user issue request after, searched in first database registration user identity and Information corresponding with identity.
A kind of request processing equipment provided in an embodiment of the present invention, it is described request processing equipment memory in be provided with Bu Long Filter preserves the identity of registration user in the memory, and the request processing equipment includes: the first filter element 001, first obtains unit 002 and the first searching unit 003, first filter element 001, for controlling the grand filtering of the cloth Device is sent to the request processing equipment to nonregistered user according to the identity of the registration user saved in the memory Access request is filtered, wherein carries identity in the access request;The first obtains unit 002, for obtaining Obtain the filtered access request of Bloom filter;First searching unit 003, for searching institute in first database The identity that the filtered access request of Bloom filter carries is stated, after filtering according to lookup result to the Bloom filter Access request handled.The present invention can filter out the access request of nonregistered user, and solution in the prior art can not area The problem of dispensing volume user and nonregistered user mitigates the access pressure of redis and MySQL.
Optionally, based on equipment shown in Fig. 8, as shown in figure 9, another kind request processing provided in an embodiment of the present invention is set Standby, first searching unit 003 may include that the first lookup subelement 0031, third lookup subelement 0032 and first are anti- Subelement 0033 is presented,
Described first searches subelement 0031, for searching the filtered visit of the Bloom filter in first database It asks the identity that request carries, if found, triggers the first feedback subelement 0033 and touched if do not found It sends out third described and searches subelement 0032;
The third searches subelement 0032, for searching the filtered visit of the Bloom filter in the second database It asks the identity that request carries, the filtered access request of the Bloom filter is handled according to lookup result, In, information corresponding with the identity is stored in the first database;
The first feedback subelement 0033, for the user to the transmission filtered access request of Bloom filter Feed back information corresponding with the identity found.
In order to facilitate understanding, be illustrated herein: a user issues the inquiry request of inquiry authentication information, passes through After Bloom filter is proved to be registration user, searched in first database and the consistent body of identity in the inquiry request Authentication information, if found, is just fed back to user, if do not found, just continues to look into the second database by part mark It looks for and the consistent identity of identity in the inquiry request.
Wherein, the second database can be MySQL, because the information needed for all registration users requires storage When, then the memory space needed is just very big, first database only enough stores some information often inquired, for without The information being often queried is stored in the second database, meanwhile, the second database preserves the information of first database whole.
Optionally, it is based on equipment shown in Fig. 9, as shown in Figure 10, another kind request processing provided in an embodiment of the present invention Equipment, the third search subelement 0032, may include: the second lookup subelement 00321, second feedback subelement 00322, First saving subunit 00323 and the first notice subelement 00324,
Described second searches subelement 00321, filtered for searching the Bloom filter in the second database The identity that access request carries triggers the second feedback subelement 00322 and described first and saves if found Subelement 00323 triggers the first notice subelement 00324 if do not found,
The second feedback subelement 00322, for the use to the transmission filtered access request of Bloom filter Feed back information corresponding with the identity found in family;
First saving subunit 00323, for the identity found and the identity found is corresponding Information preservation into the first database;
The first notice subelement 00324, for notifying user not inquire requested information.
In order to facilitate understanding, be illustrated herein: a user issues the inquiry request of inquiry authentication information, passes through After Bloom filter is proved to be registration user, searched in first database and the consistent body of identity in the inquiry request Authentication information, if found, is just fed back to user, if do not found, just continues to look into the second database by part mark Look for the consistent identity of identity in the inquiry request, if found in the second database and the inquiry request In the consistent identity of identity, then the information under the identity being stored in the second database is fed back to this User, and the identity and authentication information corresponding with the identity are saved in first database, facilitate the use Family can inquire the authentication information when inquiring authentication information next time more quickly, if do not found, notify the user Requested information is not inquired.
Optionally, based on equipment shown in Figure 10, as shown in figure 11, another kind request processing provided in an embodiment of the present invention is set Standby, it can also include: the second saving subunit 00325 that the third, which searches subelement 0032,
Second saving subunit 00325, for searching subelement 00321 in second database described second In when not searching the identity that the filtered access request of the Bloom filter carries, lookup result is saved in described the In one database.
In order to facilitate understanding, be illustrated herein: a user issues the inquiry request of inquiry authentication information, passes through After Bloom filter is proved to be registration user, searched in first database and the consistent body of identity in the inquiry request Authentication information, if found, is just fed back to user, if do not found, just continues to look into the second database by part mark Look for the consistent identity of identity in the inquiry request, if found in the second database and the inquiry request In the consistent identity of identity, then the information under the identity being stored in the second database is fed back to this User, and the identity and authentication information corresponding with the identity are saved in first database, facilitate the use Family can inquire the authentication information when inquiring authentication information next time more quickly, if do not found, notify the user Requested information is not inquired, and the result that this is not found is saved in the first database, prevent the user Inquiry authentication information is repeated, wherein the corresponding information of identity can be authentication information, copyright information, the pet name, head portrait, affiliated Whether circle opens bubble ring and channel information etc..
Optionally, it is based on equipment shown in Fig. 8, as shown in figure 12, another kind request processing provided in an embodiment of the present invention Equipment, the equipment can also include: the second storage unit 004,
Second storage unit 004, for being monitored by monitoring node application server, when there is new registration use The identity at family is written to the application server and is saved in after the first database, and the first database is protected The identity of the new registration user deposited is saved in the memory of the request processing equipment.
Wherein, monitoring node can be Zookeeper, and Zookeeper is distributed, open source code a distribution Application program coordination service is the manager of cluster, monitors the feedback that the state of each node in cluster is submitted according to node Next step reasonable operation is carried out, the function of monitoring node data variation of Zookeeper is mainly utilized in the present invention.
Specifically, the identity of new registration user and information corresponding with identity are written to application server first In, then be loaded into first database and the second database by application server, new registration is obtained when listening to application server After the identity of user and information corresponding with identity, request processing equipment sends to first database and obtains the new note Volume user identity request, wait application server load new registration user identity and with identity pair After the information to first database answered, the identity of new registration user is sent to request processing and set by first database Standby, request processing equipment saves the identity of new registration user in memory, and the above method can be regarded as grand to cloth A kind of update of filter.
Optionally, it is based on equipment shown in Fig. 8, as shown in figure 13, another kind request processing provided in an embodiment of the present invention Equipment, the equipment can also include: the first grouped element 005 and third storage unit 006,
First grouped element 005, for all or part of identity in the first database to be divided into More parts of identity groups;
Wherein, it is identical to be divided into the quantity that more parts of identity groups can be every group of identity, it can also be with every group of identity The quantity of mark is different, is specifically divided according to the actual situation, is specifically divided into 1000 parts in the present invention.
The third storage unit 006, for successively saving the more parts of identity groups according to default preservation sequence Into the memory of the request processing equipment.
Specifically, all or part of identity in first database is carried out to be divided into multiple identity groups Afterwards, successively each identity group is saved in the memory of request processing equipment according to default preservation sequence, wherein default protect Deposit sequence, be it is pre-set, can be adjusted according to actual needs, main purpose be avoid to request processing equipment into It breaks down when row initialization.
The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.

Claims (12)

1. a kind of request processing method, which is characterized in that be applied in request processing equipment, the memory of the request processing equipment In be provided with Bloom filter, preserved in the memory registration user identity, which comprises
The Bloom filter is controlled according to the identity of the registration user saved in the memory, nonregistered user is sent Access request to the request processing equipment is filtered, wherein carries identity in the access request;
Obtain the filtered access request of the Bloom filter;
The identity that the filtered access request of the Bloom filter carries is searched in first database, is tied according to searching Fruit handles the filtered access request of the Bloom filter.
2. the method according to claim 1, wherein described search the Bloom filter in first database The identity that filtered access request carries, according to lookup result to the filtered access request of the Bloom filter into Row processing, comprising:
The identity that the filtered access request of the Bloom filter carries is searched in first database, if searched It arrives, then to the user feedback letter corresponding with the identity found for sending the filtered access request of Bloom filter Breath searches the identity mark that the filtered access request of the Bloom filter carries if do not found in the second database Know, the filtered access request of the Bloom filter is handled according to lookup result, wherein with the identity pair The information answered is stored in the first database.
3. according to the method described in claim 2, it is characterized in that, described search the Bloom filter in the second database The identity that filtered access request carries, according to lookup result to the filtered access request of the Bloom filter into Row processing, comprising:
The identity that the filtered access request of the Bloom filter carries is searched in the second database, if searched It arrives, then to the user feedback letter corresponding with the identity found for sending the filtered access request of Bloom filter Breath, and by the identity found and the corresponding information preservation of the identity found into the first database, such as Fruit does not find, then user is notified not inquire requested information.
4. according to the method described in claim 3, it is characterized in that, described search the Bloom filter in the second database The identity that filtered access request carries, according to lookup result to the filtered access request of the Bloom filter into Row processing, further includes:
The identity that the filtered access request of the Bloom filter as described in not searching in second database carries, then Lookup result is saved in the first database.
5. the method according to claim 1, wherein further include:
It is monitored by monitoring node application server, when the identity for having new registration user is written to the application clothes Business device is simultaneously saved in after the first database, the identity for the new registration user that the first database is saved It is saved in the memory of the request processing equipment.
6. the method according to claim 1, wherein further include:
All or part of identity in the first database is divided into more parts of identity groups;
Successively the more parts of identity groups are saved according to default preservation sequence in the memory of the request processing equipment.
7. a kind of request processing equipment, which is characterized in that be provided with Bloom filter in the memory of the request processing equipment, institute The identity that registration user is preserved in memory is stated, the request processing equipment includes: the first filter element, the first acquisition list Member and the first searching unit,
First filter element, for controlling the Bloom filter according to the identity of the registration user saved in the memory Mark, the access request for being sent to the request processing equipment to nonregistered user are filtered, wherein in the access request Carry identity;
The first obtains unit, for obtaining the filtered access request of the Bloom filter;
First searching unit is carried for searching the filtered access request of the Bloom filter in first database Identity, the filtered access request of the Bloom filter is handled according to lookup result.
8. equipment according to claim 7, which is characterized in that first searching unit, including the first lookup subelement, Third searches subelement and the first feedback subelement,
Described first searches subelement, takes for searching the filtered access request of the Bloom filter in first database The identity of band triggers the first feedback subelement and triggers the third if do not found and look into if found Look for subelement;
The third searches subelement, takes for searching the filtered access request of the Bloom filter in the second database The identity of band is handled the filtered access request of the Bloom filter according to lookup result, wherein with it is described The corresponding information of identity is stored in the first database;
The first feedback subelement, for sending the user feedback of the filtered access request of Bloom filter and look into The corresponding information of the identity found.
9. equipment according to claim 8, which is characterized in that the third searches subelement, comprising: second searches son list Member, the second feedback subelement, the first saving subunit and the first notice subelement,
Described second searches subelement, takes for searching the filtered access request of the Bloom filter in the second database The identity of band triggers the second feedback subelement and first saving subunit, if do not looked into if found It finds, then triggers the first notice subelement,
The second feedback subelement, for sending the user feedback of the filtered access request of Bloom filter and look into The corresponding information of the identity found;
First saving subunit, for by the identity found and the corresponding information preservation of the identity found Into the first database;
The first notice subelement, for notifying user not inquire requested information.
10. equipment according to claim 9, which is characterized in that the third searches subelement, further includes: second saves Subelement, it is filtered for not searching the Bloom filter in second database in the second lookup subelement When the identity that access request carries, lookup result is saved in the first database.
11. equipment according to claim 7, which is characterized in that further include: the second storage unit,
Second storage unit, for being monitored by monitoring node application server, when the body for having new registration user Part mark is written to the application server and is saved in after the first database, the institute that the first database is saved The identity for stating new registration user is saved in the memory of the request processing equipment.
12. equipment according to claim 7, which is characterized in that further include: the first grouped element and third storage unit,
First grouped element, for all or part of identity in the first database to be divided into more parts of identity Mark group;
The third storage unit, for the more parts of identity groups to be successively saved in described ask according to default preservation sequence It asks in the memory of processing equipment.
CN201811504076.2A 2018-12-10 2018-12-10 A kind of request processing method and equipment Withdrawn CN109614407A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811504076.2A CN109614407A (en) 2018-12-10 2018-12-10 A kind of request processing method and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811504076.2A CN109614407A (en) 2018-12-10 2018-12-10 A kind of request processing method and equipment

Publications (1)

Publication Number Publication Date
CN109614407A true CN109614407A (en) 2019-04-12

Family

ID=66008799

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811504076.2A Withdrawn CN109614407A (en) 2018-12-10 2018-12-10 A kind of request processing method and equipment

Country Status (1)

Country Link
CN (1) CN109614407A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110209874A (en) * 2019-04-24 2019-09-06 北京奇艺世纪科技有限公司 Information processing method, device, electronic equipment and storage medium
CN112562151A (en) * 2020-12-03 2021-03-26 浪潮云信息技术股份公司 Access control system based on bloom filter
CN113377812A (en) * 2021-01-08 2021-09-10 北京数衍科技有限公司 Order duplication eliminating method and device for big data

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8499355B1 (en) * 2011-03-24 2013-07-30 Emc Corporation Authorization system having a bloom filtered authentication list for fraud detection
CN104572727A (en) * 2013-10-22 2015-04-29 阿里巴巴集团控股有限公司 Data querying method and device
CN105718455A (en) * 2014-12-01 2016-06-29 阿里巴巴集团控股有限公司 Data query method and apparatus
CN106603613A (en) * 2015-10-20 2017-04-26 阿里巴巴集团控股有限公司 Request processing method and apparatus
US20170250998A1 (en) * 2016-02-29 2017-08-31 Snoopwall, Inc. Systems and methods of preventing infection or data leakage from contact with a malicious host system
CN107888659A (en) * 2017-10-12 2018-04-06 北京京东尚科信息技术有限公司 The processing method and system of user's request

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8499355B1 (en) * 2011-03-24 2013-07-30 Emc Corporation Authorization system having a bloom filtered authentication list for fraud detection
CN104572727A (en) * 2013-10-22 2015-04-29 阿里巴巴集团控股有限公司 Data querying method and device
CN105718455A (en) * 2014-12-01 2016-06-29 阿里巴巴集团控股有限公司 Data query method and apparatus
CN106603613A (en) * 2015-10-20 2017-04-26 阿里巴巴集团控股有限公司 Request processing method and apparatus
US20170250998A1 (en) * 2016-02-29 2017-08-31 Snoopwall, Inc. Systems and methods of preventing infection or data leakage from contact with a malicious host system
CN107888659A (en) * 2017-10-12 2018-04-06 北京京东尚科信息技术有限公司 The processing method and system of user's request

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110209874A (en) * 2019-04-24 2019-09-06 北京奇艺世纪科技有限公司 Information processing method, device, electronic equipment and storage medium
CN110209874B (en) * 2019-04-24 2021-08-20 北京奇艺世纪科技有限公司 Information processing method, information processing device, electronic equipment and storage medium
CN112562151A (en) * 2020-12-03 2021-03-26 浪潮云信息技术股份公司 Access control system based on bloom filter
CN113377812A (en) * 2021-01-08 2021-09-10 北京数衍科技有限公司 Order duplication eliminating method and device for big data

Similar Documents

Publication Publication Date Title
US10831844B2 (en) Accessing databases
CN109614407A (en) A kind of request processing method and equipment
US9471647B2 (en) Node-level sub-queries in distributed databases
US8626747B2 (en) Automated query path reporting in distributed databases
US8200705B2 (en) Method and apparatus for applying database partitioning in a multi-tenancy scenario
CN101512525B (en) Encrypted data search
US20130290361A1 (en) Multi-geography cloud storage
US7974218B2 (en) Intersection-based configuration management
CN115361437B (en) Micro-service calling method and device, computer equipment and storage medium
JP2021519958A5 (en)
CN110427386A (en) Data processing method, device and computer storage medium
US10261949B2 (en) Packed row representation for efficient network serialization with direct column indexing in a network switch
WO2012053219A1 (en) Distributed database system and distributed data-processing system
CN107547599A (en) Resource allocation methods and system
US20160147838A1 (en) Receiving node, data management system, data management method and strage medium
JP5353682B2 (en) Configuration information management apparatus, distributed information management system, distributed information management method, and distributed information management program
CN107967273A (en) Data capture method, back end and system
US11151094B1 (en) Cluster gateway to multiple filesystems
CN107332836A (en) Data sharing method and device
US20200210595A1 (en) CryptoJSON Indexed Search Systems and Methods
CN103455641A (en) Crossing repeated retrieval system and method
CN104537081A (en) File management system and method
US20090094014A1 (en) Software System For Binding Model Data To View Components
US20170286490A1 (en) Implicit subscriptions in the connection protocol of a network switch
US11847107B2 (en) Key permission distribution

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20190412