CN110262885A

CN110262885A - A kind of data request processing method, apparatus, storage medium and computer equipment

Info

Publication number: CN110262885A
Application number: CN201910536917.6A
Authority: CN
Inventors: 田江明
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2019-06-20
Filing date: 2019-06-20
Publication date: 2019-09-20

Abstract

The invention discloses a kind of data request processing method, apparatus, storage medium and computer equipments, and the first request of data can be obtained from request queue to be processed；The data of the sender of the first request of data need to be back to according to the first request of data determination；When there is the request of data of incidence relation with the first request of data there are at least one in request queue to be processed, the data determined according to the first request of data are back to the sender of the first request of data respectively and there is the sender of each request of data of incidence relation with the first request of data, wherein, the data for being back to sender according to the need that each request of data with incidence relation determines respectively are identical.The data of acquisition can be back to the sender of multiple request of data by the present invention respectively after obtaining data according to certain request of data, it overcomes and needs the technical issues of data are obtained one by one to multiple request of data that need to return to the data in the prior art, improve the treatment effeciency of request of data.

Description

A kind of data request processing method, apparatus, storage medium and computer equipment

Technical field

The present invention relates to data processing field more particularly to a kind of data request processing method, apparatus, storage medium and meter Calculate machine equipment.

Background technique

Nowadays, with the diversification of Internet service and real time implementation, sender can pass through the offer to Internet service Quotient sends the mode of request of data, obtains the data of relevant Internet service.

In order to allow sender more efficiently to obtain the data of relevant Internet service, the provider of Internet service is logical Often in the request of data sent according to sender, after the requested data of the request of data are returned to sender in disk, It stores that data into memory cache, so that subsequent can rapidly return equally requests the request of data of the data.

However, before storing that data into memory cache, it is possible to can receive and equally request the multiple of the data Request of data is returned because can not also directly obtain the data from memory cache at this time, can only be by multiple data Request is added in queue to be processed, further according to multiple request of data in queue to be processed, is somebody's turn to do from disk in multiple times Data return to the sender of each request of data, reduce the efficiency of processing request of data.

Summary of the invention

In view of the above problems, the present invention provides a kind of one for overcoming the above problem or at least being partially solved the above problem Kind data request processing method, apparatus, storage medium and computer equipment.

A kind of data request processing method, comprising:

The first request of data is obtained from request queue to be processed；

The data of the sender of first request of data need to be back to according to the first request of data determination；

There are at least one in the request queue to be processed has the number of incidence relation with first request of data According to request when, by according to first request of data determine data be back to respectively first request of data sender and There is the sender of each request of data of incidence relation with first request of data, wherein respectively according to incidence relation Each request of data determine need be back to sender data it is identical.

Optionally, it first data will be back to respectively will ask according to the data that first request of data determines described The sender that asks and after having the sender of each request of data of incidence relation with first request of data, the method is also Include:

By in the request queue to be processed first request of data and with first request of data have be associated with Each request of data of relationship is deleted.

Optionally, the method also includes:

Obtain the second request of data that sender sends；

Second request of data is put into the request queue to be processed；

To at least one request of data in the request queue to be processed in addition to second request of data: determining basis The data that the need that the request of data obtains are back to sender are back to transmission with the need obtained according to second request of data Whether the data of side are identical, if identical, establish the incidence relation of the request of data Yu second request of data.

Optionally, described at least one data in the request queue to be processed in addition to second request of data are asked It asks: determining and be back to the data of sender and the need obtained according to second request of data according to the need that the request of data obtains Whether the data for being back to sender are identical, if identical, establish being associated with for the request of data and second request of data Relationship specifically includes:

According to preset order by a request of data in the request queue to be processed in addition to second request of data As current request to be analyzed；

Determine that the data for being back to sender according to the need of current request acquisition to be analyzed are asked with according to second data Whether the data for asking the need of acquisition to be back to sender are identical, if identical, establish current request to be analyzed and described second The incidence relation of request of data, if it is not the same, will then be removed in the request queue to be processed according to the preset order described Another request of data in request of data outside second request of data returns as current request to be analyzed and executes the determination It is returned according to the data that the need that current request to be analyzed obtains are back to sender with the need obtained according to second request of data It is back to the whether identical step of the data of sender.

Optionally, the determination according to the need that the request of data obtains be back to the data of sender with according to described second Whether the data that the need that request of data obtains are back to sender are identical, comprising:

It is asked according to demand file cryptographic Hash, demand file deviation post and second data that the request of data carries It asks the demand file cryptographic Hash of carrying, demand file deviation post to determine and is back to sender according to the need that the request of data obtains Data be back to the need obtained according to second request of data sender data it is whether identical.

Optionally, demand file cryptographic Hash, demand file deviation post and the institute carried according to the request of data State the demand file cryptographic Hash of the second request of data carrying, demand file deviation post determines the need obtained according to the request of data It is back to the data of sender and whether data that the need obtained according to second request of data are back to sender is identical, packet It includes:

The demand file Hash that the demand file cryptographic Hash and second request of data that the request of data is carried carry Value is compared, and obtains the first comparison result；

The demand file deviation post for obtaining request of data carrying obtains the quotient of unit data quantity divided by data, obtains institute State the second request of data carrying demand file deviation post divided by the data obtain unit data quantity quotient, by two quotient into Row compares, and obtains the second comparison result；

According to first comparison result and second comparison result, determination needs to return according to what the request of data obtained To sender data be back to the need obtained according to second request of data sender data it is whether identical.

Optionally, described after obtaining the first request of data in request queue to be processed, the method also includes:

The data failure of the sender of the first request of data as described in need to be back to according to the first request of data determination, Then there are at least two in the request queue to be processed has the request of data of incidence relation with first request of data When, it establishes and first request of data is with the incidence relation between each request of data of incidence relation, release described first The incidence relation of request of data and other request of data deletes first request of data in the request queue to be processed It removes.

A kind of data request processing device, comprising: the first request of data obtaining unit, returned data determination unit and data Return unit,

The first request of data obtaining unit, for obtaining the first request of data from request queue to be processed；

The returned data determination unit, for first data need to be back to according to the first request of data determination The data of the sender of request；

The data return unit, for there are at least one and first data in the request queue to be processed When requesting that there is the request of data of incidence relation, the data determined according to first request of data are back to described the respectively The sender of one request of data and the sender of each request of data with first request of data with incidence relation, wherein The data for being back to sender according to the need that each request of data with incidence relation determines respectively are identical.

A kind of storage medium is stored with computer executable instructions in the storage medium, and the computer is executable to be referred to When order is loaded and executed by processor, data request processing method described in any of the above embodiments is realized.

A kind of computer equipment, including processor, memory and be stored on the memory and can be in the processor The program of upper operation, the processor at least perform the steps of when executing program

The first request of data is obtained from request queue to be processed；

By above-mentioned technical proposal, a kind of data request processing method, apparatus, storage medium and calculating provided by the invention Machine equipment can obtain the first request of data from request queue to be processed；It needs to return according to first request of data determination To the data of the sender of first request of data；There are at least one and described first in the request queue to be processed When request of data has the request of data of incidence relation, the data determined according to first request of data are back to institute respectively It states the sender of the first request of data and there is the sender of each request of data of incidence relation with first request of data, In, the data for being back to sender according to the need that each request of data with incidence relation determines respectively are identical.The present invention can be with The data of acquisition are back to the sender of multiple request of data respectively after obtaining data according to certain request of data, are overcome existing Have and need the technical issues of data are obtained one by one to multiple request of data that need to return to the data in technology, improves data and ask The treatment effeciency asked.

The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention, And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can It is clearer and more comprehensible, the followings are specific embodiments of the present invention.

Detailed description of the invention

By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:

Fig. 1 shows a kind of flow diagram of data request processing method provided in an embodiment of the present invention；

Fig. 2 shows the flow diagrams of another data request processing method provided in an embodiment of the present invention；

What Fig. 3 showed a kind of incidence relation provided in an embodiment of the present invention illustrates schematic diagram；

What Fig. 4 showed another incidence relation provided in an embodiment of the present invention illustrates schematic diagram；

Fig. 5 shows the flow diagram of another data request processing method provided in an embodiment of the present invention；

Fig. 6 shows the flow diagram of another data request processing method provided in an embodiment of the present invention；

Fig. 7 shows the flow diagram of another data request processing method provided in an embodiment of the present invention；

Fig. 8 shows the flow diagram of another data request processing method provided in an embodiment of the present invention；

Fig. 9 show it is provided in an embodiment of the present invention it is a kind of establish incidence relation illustrate schematic diagram；

What Figure 10 showed that another kind provided in an embodiment of the present invention establishes incidence relation illustrates schematic diagram；

Figure 11 shows a kind of structural schematic diagram of data request processing device provided in an embodiment of the present invention.

Specific embodiment

Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure It is fully disclosed to those skilled in the art.

As shown in Figure 1, a kind of data request processing method provided in an embodiment of the present invention, may include:

S100, the first request of data is obtained from request queue to be processed；

Specifically, may exist one or more request of data in request queue to be processed, in multiple request of data Each request of data can be what the same sender issued, be also possible to what different senders issued.Multiple data are asked Each requested data of request of data can be identical in asking, and be also possible to different.In request queue to be processed Request of data can be to be ranked up in particular order, such as: according to request of data it is added to request queue to be processed In sequencing be ranked up.

It optionally, can be according to preset order from request to be processed when obtaining request of data from request queue to be processed Request of data is obtained in queue.In an alternate embodiment of the present invention, it can be asked in the way of " first in, first out " to be processed It asks and obtains request of data in queue.Optionally, the present invention can obtain a request of data from request queue to be processed every time, Multiple request of data can also be obtained from request queue to be processed every time.

Wherein, request of data can carry the information such as demand file cryptographic Hash and demand file deviation post.The present invention The demand file cryptographic Hash and demand file deviation post that can be carried according to request of data determine number determined by request of data According to.

S200, need to be back to according to the first request of data determination first request of data sender data；

Specifically, the data that step S200 is determined may include one of audio, video, program and picture or a variety of.

S300, there are at least one in the request queue to be processed has incidence relation with first request of data Request of data when, the transmission of first request of data will be back to respectively according to the data that first request of data determines The sender of side and each request of data with first request of data with incidence relation, wherein respectively according to association The data that the need that each request of data of relationship determines are back to sender are identical.

Wherein, present invention may determine that being respectively required for being back to the data of the sender of each request of data, when certain need to be back to When the data of the sender of a little request of data are identical, it can determine that these request of data have incidence relation.

Specifically, in the number for the sender that need to be back to first request of data according to the first request of data determination After accordingly, in addition to the sender that data are back to the first request of data, determining data can also be back to be processed ask Ask the sender in queue with the first request of data with the request of data of incidence relation.Optionally, the present invention will can be counted first According to the sender for being back to the first request of data, then data, which are back to, with the first request of data there are the data of incidence relation to ask The sender asked；Can also data be back to the sender of the first request of data and be had with the first request of data simultaneously and be associated with The sender of the request of data of relationship.

Optionally, the data of the requested data of the first request of data and the sender for being back to first request of data It can be identical.In other embodiments of the present invention, the requested data of the first request of data are also possible to be back to described first A part of the data of the sender of request of data, that is, the data for being back to the sender of request of data are requested than request of data Data it is more.In order to make it easy to understand, be illustrated herein: the requested data of the first request of data can be ABCDEFG is also possible to ABCDEFGHI then the data for being back to the sender of the first request of data can be ABCDEFG. That is the data for being back to the sender of the first request of data necessarily include the requested data of the first request of data.

In practical applications, the minimum data unit for being back to sender can be set, then be back to the data of sender Data volume be minimum data unit integral multiple.Optionally, the value range of minimum data unit can be for 1 data slice extremely 1 data block.Wherein, the size of 1 data slice is 16KB, includes 128 data slices in a data block.Such as setting is most Small data unit is 20MB, then the data volume for being back to the data of sender is the integral multiple of 20MB.But the first request of data institute The data of request can be any size, such as 16MB, then the present invention can be returned including the requested 16MB of the first request of data The data of 20MB inside.

Meanwhile first the requested data of request of data and has the request of data institute of incidence relation with the first request of data The data of request can identical or part it is identical.In practical applications, due to being back to the data volumes of the data of sender It is the integral multiple of minimum data unit, thus while the requested data transformation of multiple request of data is identical, but works as these When the requested data of request of data are respectively positioned on identical a certain number of minimum data units, the present invention can be certain by this The data of the minimum data unit of quantity are back to the requesting party of above-mentioned multiple request of data respectively.In order to make it easy to understand, herein Be illustrated: the requested data of the first request of data are the 11KB to 18KB of A file, and the second request of data is asked The data asked are the 13KB to 23KB of A file, it is assumed that the minimum data unit for being back to sender is 16KB, then is back to The data of first request of data are the 11KB to 27KB of A file, are asked due to having contained the second data in this segment data Requested data are sought, therefore 11KB to 27KB can be back to sender and the second number of the first request of data respectively According to the sender of request.

In other embodiments of the present invention, the minimum data unit for carrying out reading data can also be set, such as: data are It is read from disk, then when reading data from disk every time, can all read the data of integral multiple minimum data unit.It is false If the minimum data unit for carrying out reading data is also 1 piece, then certain amount piece can be all read from disk reading every time, and It is not in the case where reading half.Further, the minimum data unit for carrying out data buffer storage can also be set, such as: it will When being put into caching from the data read in disk, the data being put into every time are integral multiple minimum data unit.Optionally, into The minimum data unit of row reading data, the minimum data unit for carrying out data buffer storage and the minimum data list for being back to sender Position is all the same, and value range can be 1 data slice to 1 data block.

In practical applications, the present invention can draw the data of each file in disk according to above-mentioned minimum data unit It is divided into multiple data intervals.Such as: the size of A file is 56KB in disk, and above-mentioned minimum data unit is 16KB, then can be with A file is divided into four data intervals, is respectively as follows: 0KB to 16KB, 16KB to 32KB, 32KB to 48KB, 48KB to 56KB. In this case, if it is the 12KB to 17KB of A file that the first request of data is requested, the second request of data is requested It is the 13KB to 30KB of A file.Then the present invention can need to be back to the hair of the first request of data according to the first request of data determination The data for the side of sending are as follows: 0KB to 32KB.Correspondingly, the data that need to be back to the sender of the second request of data can also be determined Are as follows: 0KB to 32KB.Since the data that need to be back to the sender of the two request of data are identical, thus may determine that the two Request of data has incidence relation.

A kind of data request processing method provided in an embodiment of the present invention, can obtain first from request queue to be processed Request of data；The data of the sender of first request of data need to be back to according to the first request of data determination；Institute When stating in request queue to be processed that there are at least one to have the request of data of incidence relation with first request of data, by root It is back to the sender of first request of data respectively according to the data that first request of data determines and is counted with described first There is the sender of each request of data of incidence relation according to request, wherein respectively according to each request of data with incidence relation The data that determining need are back to sender are identical.The present invention can be after obtaining data according to certain request of data by the number of acquisition According to the sender for being back to multiple request of data respectively, overcomes and needed in the prior art to multiple number that need to return to the data The technical issues of obtaining data one by one according to request, improves the treatment effeciency of request of data.

The incidence relation of above-described embodiment introduction can be asks in the multiple data that need to be back to the identical data of sender It establishes between asking, is described in detail below with reference to Fig. 2, another kind data request processing side provided in an embodiment of the present invention Method can also include:

S400, the second request of data that sender sends is obtained；

S500, second request of data is put into the request queue to be processed；

Specifically, the second request of data can be inserted between other request of data in request queue to be processed, it can also The second request of data to be put into the head or tail portion of request queue to be processed.In general, the second request of data can be put Enter the position that sequence to be processed is last in request queue to be processed.For example, if queue to be processed is according to from head to tail portion Sequence processing data request, then the second request of data to be put into the end of queue to be processed, wherein request queue to be processed Head or tail portion be it is opposite, the head or tail portion of request queue to be processed can be specified according to actual needs.

S600, at least one request of data in the request queue to be processed in addition to second request of data: really It is fixed to need to return with what is obtained according to second request of data according to the data that the need that the request of data obtains are back to sender Whether the data to sender are identical, if identical, establish the incidence relation of the request of data Yu second request of data.

Specifically, can be simultaneously to all request of data in request queue to be processed in addition to second request of data: It determines and is back to the data of sender and the need obtained according to second request of data according to the need that each request of data obtains Whether the data for being back to sender are identical, obtain by the data that need to be back to sender and according to second request of data The identical request of data of data and the second request of data that sender need to be back to establish incidence relation.Place can also successively be treated Any data request in reason request queue in addition to second request of data: determination needs to return according to what the request of data obtained To sender data be back to the need obtained according to second request of data sender data it is whether identical, if phase Together, then the incidence relation of the request of data Yu second request of data is established.It is understood that step S400 is to step The execution sequencing of S600 and step S100 to S300 can be random order, and it is not limited here, Fig. 2 is shown only by the present invention It is one of situation.

It is understood that in request queue to be processed there may be need to be back to the data of sender with according to described The need that second request of data obtains are back to the identical multiple request of data of data of sender, there are two kinds of situations at this time:

A kind of situation is: the second request of data can respectively establish incidence relation, multiple number with multiple request of data According to also there is incidence relation between request mutually.It in order to facilitate understanding, is illustrated here in connection with Fig. 3: being asked to be processed It asks there may be the data that need to be back to sender in queue and is back to transmission according to the need that second request of data obtains The identical request of data B of data, request of data C and the request of data E of side, then the second request of data is asked with request of data B, data C and request of data E is asked to establish incidence relation respectively, and there is also passes between request of data B, request of data C and request of data E Connection relationship.

Another situation is that: the second request of data can also be associated with one of foundation in multiple request of data System, for example, the second request of data can be asked with first determined in multiple request of data with according to second data The identical request of data of data for asking the need of acquisition to be back to sender establishes incidence relation, and removing in multiple request of data should First be back to the identical request of data of the data of sender with the need obtained according to second request of data except its His request of data is back to the identical number of the data of sender with this first with the need obtained according to second request of data According to request, there is also incidence relations.It in order to facilitate understanding, is illustrated here in connection with Fig. 4: in request queue to be processed There may be the data that need to be back to sender and the data that sender is back to according to the need of second request of data acquisition Identical request of data B, request of data C and request of data E, in request queue to be processed determine first with according to described The identical request of data of data that the need that second request of data obtains are back to sender is request of data B, then the second data are asked It asks and establishes incidence relation with request of data B, also there is also passes between request of data B respectively by request of data C and request of data E Connection relationship.

Optionally, it is based on method shown in Fig. 2, as shown in figure 5, at another kind request of data provided in an embodiment of the present invention Reason method, step S600 can be specifically included:

S610, according to preset order by a data in the request queue to be processed in addition to second request of data Request is as current request to be analyzed；

Specifically, preset order can be the sequence from head to tail portion according to request queue to be processed, will successively remove A request of data outside second request of data is also possible to as current request to be analyzed according to request queue to be processed The sequence from tail portion to head, successively to be analyzed asked using a request of data in addition to second request of data as current It asks.Certain preset order can also be other sequences, only need to request successively to make by the total data in request queue to be processed For current request to be analyzed.

S620, determine that the current data to be analyzed for requesting the need obtained to be back to sender of basis are counted with according to described second Whether the data for being back to sender according to the need that request obtains are identical, if identical, then follow the steps S630, if it is not the same, Then follow the steps S640.

S630, the incidence relation for establishing current request and second request of data to be analyzed；

S640, according to the preset order by the data in the request queue to be processed in addition to second request of data Another request of data in request returns to step S620 as current request to be analyzed.

Specifically, being back to the data of sender and according to second data according to the need that current request to be analyzed obtains Whether the data that the need that request obtains are back to sender are identical, it can be determined that the current requested data of request to be analyzed and the Whether the requested data of two request of data are same or similar, when the need that current request to be analyzed obtains are back to the number of sender According to the need obtained according to second request of data be back to the data of sender it is identical when, then establish current request to be analyzed With the incidence relation of second request of data, described second otherwise will be removed in the request queue to be processed according to preset order Another request of data in request of data outside request of data repeats step S620, directly as current request to be analyzed Extremely by all request of data in request queue to be processed all as current request to be analyzed.

Under the premise of queue to be processed is requested according to the sequence processing data from head to tail portion, when suitable according to presetting Sequence using a request of data in the request queue to be processed in addition to second request of data as current request to be analyzed, And determine that the data for being back to sender according to the need of current request acquisition to be analyzed are obtained with according to second request of data Need be back to sender data it is identical when: if preset order is according to request queue to be processed from head to tail portion It sequentially, then can be by second successively using a request of data in addition to second request of data as current request to be analyzed Incidence relation is established in request of data and current request to be analyzed processed at first, is kept the level of incidence relation shorter, is realized It is more convenient.It, successively will be except described the if preset order is the sequence from tail portion to head according to request queue to be processed A request of data outside two request of data then can be determined quickly and be counted with according to described second as current request to be analyzed The identical current request to be analyzed of data for being back to sender according to the need that request obtains.

Optionally, method shown in Fig. 2, another kind data request processing method provided in an embodiment of the present invention, step are based on Determination is obtained according to the data that the need that the request of data obtains are back to sender with according to second request of data in rapid S600 Need be back to the whether identical detailed process of data of sender can be with are as follows: detailed process one is taken according to the request of data Demand file cryptographic Hash that the demand file cryptographic Hash of band, demand file deviation post and second request of data carry, Demand file deviation post determines that the data for being back to sender according to the need that the request of data obtains are counted with according to described second Whether the data for being back to sender according to the need that request obtains are identical.

Optionally, above-mentioned specific as shown in fig. 6, in another kind data request processing method provided in an embodiment of the present invention Process one may include:

The demand file that S651, the demand file cryptographic Hash which is carried and second request of data carry Cryptographic Hash is compared, and obtains the first comparison result；

Specifically, demand file cryptographic Hash can be according to MD5 Message Digest 5 (MD5Message-Digest Algorithm the hashed value) produced.According to the demand file cryptographic Hash and the second request of data carried by the request of data The demand file cryptographic Hash of carrying is compared, the first comparison result of generation, it can be determined that is obtained according to the request of data File belonging to the data of sender need to be back to and be back to the data institute of sender according to the need of the second request of data acquisition Whether the file of category is identical.If the demand file cryptographic Hash that the request of data carries is equal to the request that the second request of data carries File cryptographic Hash is then back to file belonging to the data of sender and according to the second data according to the need of request of data acquisition It is identical that the need that request obtains are back to file belonging to the data of sender.

S652, the demand file deviation post for obtaining request of data carrying obtain the quotient of unit data quantity divided by data, The quotient that the demand file deviation post that second request of data carries obtains unit data quantity divided by the data is obtained, by two A quotient is compared, and obtains the second comparison result；

Specifically, obtaining unit data quantity divided by data by the demand file deviation post that the request of data carries Quotient can determine that the need obtained according to the request of data are back to position of the data of sender in affiliated file.Pass through The demand file deviation post for obtaining the carrying of the second request of data obtains the quotient of unit data quantity divided by the data, can determine According to the second request of data obtain need be back to position of the data of sender in affiliated file, by by two quotient into Row compare, that is, by the need obtained according to the request of data be back to position of the data of sender in affiliated file and Position of the data of sender in affiliated file is back to according to the need that the second request of data obtains to be compared, and judges this The relationship of two positions, the second comparison result is exactly that two quotient are identical or not identical, if two quotient are identical, the two positions The relationship set be it is same or similar, if two quotient are not identical, the two positions are not related.

In order to make it easy to understand, be illustrated herein: if the demand file deviation post that the request of data carries is 1, It is 6 that data, which obtain unit data quantity, then 1 is 0 divided by 6 quotient, if the demand file deviation post that the second request of data carries is 3, then 3 be 0 divided by 6 quotient, and two quotient are equal, then are back to the data of sender affiliated according to the need that the request of data obtains File in position with according to the second request of data obtain need be back to position of the data of sender in affiliated file Set it is similar, if the second request of data carry demand file deviation post be also 1, according to the request of data obtain need return It is back to position of the data of sender in affiliated file and is back to sender's with the need obtained according to the second request of data Position of the data in affiliated file is identical.

S653, according to first comparison result and second comparison result, determine and to be obtained according to the request of data The data of sender need to be back to and whether data that the need obtained according to second request of data are back to sender are identical.

Specifically, can determine that the need obtained according to the request of data are back to sender's according to the first comparison result Whether file belonging to data with the need obtained according to the second request of data is back to file belonging to the data of sender identical. According to the second comparison result, it can determine that the need obtained according to the request of data are back to the data of sender in affiliated file In position with according to the second request of data obtain need whether be back to position of the data of sender in affiliated file There are the same or similar relationships.When the first comparison result is that the demand file cryptographic Hash that the request of data carries is equal to the second number According to the demand file cryptographic Hash that request carries, and the demand file deviation post that the request of data carries obtains unit divided by data The demand file deviation post that the quotient of data volume and second request of data carry obtains unit data quantity divided by the data Quotient it is equal when, then explanation is back to file belonging to the data of sender and according to second according to the need that the request of data obtains It is same file that the need that request of data obtains, which are back to file belonging to the data of sender, and is obtained according to the request of data Need be back to position of the data of sender in affiliated file with according to the second request of data obtain need be back to hair Position of the data for the side of sending in affiliated file is same or similar, it is possible to which determination is returned according to the need that the request of data obtains Be back to the data of sender and the need obtained according to second request of data to be back to the data of sender identical.

It is understood that when the first comparison result is that the demand file cryptographic Hash that the request of data carries is not equal to second Request of data carry demand file cryptographic Hash when, no matter the second comparison result whether be the request of data carry demand file Deviation post is removed divided by the demand file deviation post that the quotient that data obtain unit data quantity carries with second request of data It is equal with the quotient that the data obtain unit data quantity, all determine the number that sender is back to according to the need that the request of data obtains It is not identical according to the data for being back to sender with the need obtained according to second request of data.In order to make it easy to understand, herein into Row for example: being back to file belonging to the data of sender according to the need that the request of data obtains is file A, according to second It is file A that the need that request of data obtains, which are back to file belonging to the data of sender also, includes letter abcdefg in file A, When it is 3 that the need obtained according to the request of data, which are back to position of the data of sender in affiliated file, corresponding word Mother is c, when it is 5 that the need obtained according to the second request of data, which are back to position of the data of sender in affiliated file, Corresponding letter is e, it is therefore apparent that even if data belong to a file, but the position of data in this document is different, institute It needs to return with what is obtained according to second request of data with the data that the need obtained according to the request of data are back to sender Data to sender are not identical.

Similarly, when the second comparison result is that the demand file deviation post that the request of data carries obtains unit divided by data The demand file deviation post that the quotient of data volume and second request of data carry obtains unit data quantity divided by the data Quotient it is unequal when, no matter the first comparison result whether be the request of data carry demand file cryptographic Hash be equal to the second data The demand file cryptographic Hash carried is requested, all determines the data and basis for being back to sender according to the need that the request of data obtains The data that the need that second request of data obtains are back to sender are not identical.In order to make it easy to understand, carry out illustrating herein Bright: being back to file belonging to the data of sender according to the need that the request of data obtains is file A, according to the second request of data It is file B that the need of acquisition, which are back to file belonging to the data of sender also, includes in letter abcdefg, file B in file A Including alphabetical hijklnm, when the need obtained according to the request of data are back to position of the data of sender in affiliated file When being set to 3, corresponding letter is c, when the need obtained according to the second request of data are back to the data of sender in affiliated text When position in part is 5, corresponding letter is l, it is therefore apparent that even if position phase of two data in respectively affiliated file Together, but because affiliated file is different, the data and basis of sender are back to according to the need that the request of data obtains The data that the need that second request of data obtains are back to sender are not identical.

Optionally, it is based on method shown in FIG. 1, as shown in fig. 7, at another kind request of data provided in an embodiment of the present invention Reason method can also include: after the step S300 of above-described embodiment

S700, have by first request of data in the request queue to be processed and with first request of data Each request of data of incidence relation is deleted.

Specifically, the data of acquisition to be back to the sender of the first request of data in the ban, then successively data are back to When there is the sender of the request of data of incidence relation with the first request of data, it can be asked being back to data with the first data After the sender for seeking each request of data with incidence relation, successively by each number with the first request of data with incidence relation It deletes according to request, finally again deletes first request of data in request queue to be processed.For example, the data of acquisition are returned After being back to the sender of the first request of data, the request of data that there is incidence relation with the first request of data is searched, is often found As soon as with the first request of data have incidence relation request of data, data are back to the sender of the request of data, are returned After returning successfully, which is deleted, with the first request of data there is the request of data of incidence relation all to delete when all And then the first request of data is deleted.

Data are back to the sender of the first request of data and with the first request of data with incidence relation when simultaneously When the sender of request of data, can have in the sender that data are back to the first request of data and with the first request of data After the sender of the request of data of incidence relation, while there is incidence relation by the first request of data and with the first request of data Request of data delete.

Optionally, it is based on method shown in FIG. 1, as shown in figure 8, at another kind request of data provided in an embodiment of the present invention Reason method, after step sloo, the method can also include:

S800, as described in need to be back to according to the first request of data determination the sender of the first request of data data Failure, then there are at least two in the request queue to be processed has the data of incidence relation with first request of data When request, establishes and first request of data has incidence relation between each request of data of incidence relation, described in releasing The incidence relation of first request of data and other request of data, by first request of data in the request queue to be processed It deletes.

In order to facilitate understanding, herein for example: a kind of situation is as shown in figure 9, such as true according to first request of data Surely it need to be back to the data failure of the sender of first request of data, then existed at least in the request queue to be processed Two with first request of data have incidence relation request of data when, select one of them to have with the first request of data The request of data of incidence relation, by other and the first request of data have the request of data of incidence relation all with the request of data Establish incidence relation.For example, obtaining the number that need to be back to the sender of first request of data according to the first request of data According to before, there are incidence relations with the first request of data respectively by request of data A, request of data C and request of data E, when according to institute After stating the data failure that the first request of data obtains the sender that need to be back to first request of data, by request of data C Incidence relation is established with request of data A respectively with request of data E, releases request of data A, request of data C and request of data E and the The incidence relation of one request of data deletes the first request of data.

Another situation is as shown in Figure 10, and the first data as described in need to be back to according to the first request of data determination are asked The data failure of the sender asked then has there are at least two with first request of data in the request queue to be processed When relevant request of data, between multiple request of data that there is incidence relation first request of data mutually Incidence relation is all established respectively.For example, obtaining the transmission that need to be back to first request of data according to the first request of data Before the data of side, request of data A, request of data C and request of data E respectively with the first request of data there are incidence relation, when After the data failure for obtaining the sender that need to be back to first request of data according to first request of data, in data Incidence relation is established mutually between request A, request of data C and request of data E, releases request of data A, request of data C and data The incidence relation of E and the first request of data are requested, the first request of data is deleted.

Corresponding with above method embodiment, the embodiment of the invention also provides a kind of data request processing devices.

As shown in figure 11, a kind of data request processing device provided in an embodiment of the present invention may include: that the first data are asked Obtaining unit 100, returned data determination unit 200 and data return unit 300 are asked,

The first request of data obtaining unit 100, for obtaining the first request of data from request queue to be processed；

The returned data determination unit 200, for described first need to be back to according to the first request of data determination The data of the sender of request of data；

Specifically, the data that returned data determination unit 200 determines may include in audio, video, program and picture It is one or more.

The data return unit 300, for there are at least one and described first in the request queue to be processed When request of data has the request of data of incidence relation, the data determined according to first request of data are back to institute respectively It states the sender of the first request of data and there is the sender of each request of data of incidence relation with first request of data, In, the data for being back to sender according to the need that each request of data with incidence relation determines respectively are identical.

Specifically, obtaining the number that need to be back to the sender of first request of data according to first request of data After accordingly, in addition to the sender that data are back to the first request of data, the data of acquisition can also be back to be processed ask Ask the sender in queue with the first request of data with the request of data of incidence relation.Optionally, the present invention will can be counted first According to the sender for being back to the first request of data, then data, which are back to, with the first request of data there are the data of incidence relation to ask The sender asked；Can also data be back to the sender of the first request of data and be had with the first request of data simultaneously and be associated with The sender of the request of data of relationship.Wherein, the data of the sender of the first request of data are back to and are back to and the first number Have the data of the sender of the request of data of incidence relation identical according to request.

A kind of data request processing device provided in an embodiment of the present invention, can obtain first from request queue to be processed Request of data；The data of the sender of first request of data need to be back to according to the first request of data determination；Institute When stating in request queue to be processed that there are at least one to have the request of data of incidence relation with first request of data, by root It is back to the sender of first request of data respectively according to the data that first request of data determines and is counted with described first There is the sender of each request of data of incidence relation according to request, wherein respectively according to each request of data with incidence relation The data that determining need are back to sender are identical.The present invention can be after obtaining data according to certain request of data by the number of acquisition According to the sender for being back to multiple request of data respectively, overcomes and needed in the prior art to multiple number that need to return to the data The technical issues of obtaining data one by one according to request, improves the treatment effeciency of request of data.

Optionally, another data request processing device provided in an embodiment of the present invention, can also include: that the second data are asked It asks obtaining unit, request of data to be put into unit, identical data request determination unit and request of data relationship and establishes unit,

The second request of data obtaining unit, for obtaining the second request of data of sender's transmission；

The request of data is put into unit, for second request of data to be put into the request queue to be processed；

Specifically, the second request of data can be inserted between other request of data in request queue to be processed, it can also The second request of data to be put into the head or tail portion of request queue to be processed.In general, the second request of data can be put Enter the position that sequence to be processed is last in request queue to be processed.Specifically, can simultaneously in request queue to be processed remove institute It states all request of data outside the second request of data: determining the data for being back to sender according to the need that each request of data obtains Whether the data that sender is back to the need obtained according to second request of data are identical, will need to be back to the number of sender It is asked according to the identical request of data of the data of sender is back to the need obtained according to second request of data with the second data It asks and establishes incidence relation.Successively any data in request queue to be processed in addition to second request of data can also be asked It asks: determining and be back to the data of sender and the need obtained according to second request of data according to the need that the request of data obtains Whether the data for being back to sender are identical, if identical, establish being associated with for the request of data and second request of data Relationship.

The identical data requests determination unit, for removing second request of data in the request queue to be processed At least one outer request of data: it determines and is back to the data of sender according to the need that the request of data obtains and according to described the Whether the data that the need that two request of data obtain are back to sender are identical, if identical, trigger the request of data relationship Establish unit；

The request of data relationship establishes unit, for establishing being associated with for the request of data and second request of data System.

Optionally, another data request processing device provided in an embodiment of the present invention, the identical data request determine Unit includes: request determination unit and identical data determination unit to be analyzed,

The request determination unit to be analyzed, for described the will to be removed in the request queue to be processed according to preset order A request of data outside two request of data is as current request to be analyzed；

The identical data determination unit, for determining that the need obtained according to current request to be analyzed are back to sender's Whether data and the data that the need obtained according to second request of data are back to sender are identical, if identical, trigger The request of data relationship establishes unit, if it is not the same, then triggering the request determination unit to be analyzed according to described default Sequence makees another request of data in the request of data in the request queue to be processed in addition to second request of data For current request to be analyzed.

It is understood that request determination unit to be analyzed using a request of data as current request to be analyzed after, Identical data determination unit all can execute corresponding processing according to the current request to be analyzed.Above-mentioned request determination unit to be analyzed It can have circulation triggering relationship with identical data determination unit, successively to handle each request of data, until having handled All request of data.

Optionally, another data request processing device provided in an embodiment of the present invention, the identical data request determine Unit, can with specific reference to the request of data carry demand file cryptographic Hash, demand file deviation post and described second The demand file cryptographic Hash of request of data carrying, the determination of demand file deviation post are back to according to the need that the request of data obtains Whether the data of sender and the data that the need obtained according to second request of data are back to sender are identical.

Optionally, another data request processing device provided in an embodiment of the present invention, the identical data request determine Unit may include: the first comparison result obtaining unit, the second comparison result obtaining unit and the identical data determination unit,

The first comparison result obtaining unit, demand file cryptographic Hash for carrying the request of data and described the The demand file cryptographic Hash that two request of data carry is compared, and obtains the first comparison result；

The second comparison result obtaining unit, for obtain the request of data carrying demand file deviation post divided by Data obtain the quotient of unit data quantity, obtain the demand file deviation post of the second request of data carrying divided by the data The quotient for obtaining unit data quantity, two quotient are compared, and obtain the second comparison result；

The identical data determination unit, for determining according to first comparison result and second comparison result It is back to according to the data that the need that the request of data obtains are back to sender with the need obtained according to second request of data Whether the data of sender are identical.

Optionally, another data request processing device provided in an embodiment of the present invention, can also include: that request of data is deleted Except unit,

The request of data deletes unit, and being used for will be according to first request of data in the data return unit 300 Determining data are back to the sender of first request of data respectively and have incidence relation with first request of data Each request of data sender after, by first request of data in the request queue to be processed and with described first There is request of data each request of data of incidence relation to delete.

Optionally, another data request processing device provided in an embodiment of the present invention can also include: that request of data is closed It is lifting unit, it is described for that need to be back in the returned data determination unit 200 according to the first request of data determination In the case where the data failure of the sender of first request of data, there are at least two and institute in the request queue to be processed State the first request of data have incidence relation request of data when, trigger the request of data relationship establish unit establish with it is described First request of data has the incidence relation between each request of data of incidence relation, and releases first request of data and its The incidence relation of his request of data triggers the request of data and deletes unit for described first in the request queue to be processed Request of data is deleted.

A kind of storage medium provided in an embodiment of the present invention is stored with computer executable instructions in the storage medium, When the computer executable instructions are loaded and executed by processor, data request processing side described in any of the above embodiments is realized Method.

A kind of computer equipment provided in an embodiment of the present invention, including processor, memory and it is stored in the memory Program that is upper and can running on the processor, the processor at least perform the steps of when executing program

The first request of data is obtained from request queue to be processed；

The data request processing device includes processor and memory, and above-mentioned first request of data obtaining unit 100 is returned It returns data determination unit 200 and data return unit 300 etc. to store in memory as program unit, be executed by processor Above procedure unit stored in memory realizes corresponding function.

Include kernel in processor, is gone in memory to transfer corresponding program unit by kernel.Kernel can be set one Or more, by adjusting kernel parameter come according to certain request of data obtain data after the data of acquisition are back to multiple numbers respectively According to the sender of request.

Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/ Or the forms such as Nonvolatile memory, if read-only memory (ROM) or flash memory (flash RAM), memory include that at least one is deposited Store up chip.

The embodiment of the invention provides a kind of storage mediums, are stored thereon with program, real when which is executed by processor A kind of existing data request processing method.

The embodiment of the invention provides a kind of processor, the processor is for running program, wherein described program operation A kind of data request processing method described in Shi Zhihang.

The embodiment of the invention provides a kind of equipment, equipment include processor, memory and storage on a memory and can The step of program run on a processor, processor realizes above-mentioned any data request processing when executing program.

Equipment herein can be server, PC, PAD, mobile phone etc..

Present invention also provides a kind of computer program products, when executing on data processing equipment, are adapted for carrying out just The program of the step of beginningization above-mentioned any data request processing method.

It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more, The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces The form of product.

The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates, Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or The function of being specified in multiple boxes.

These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one The step of function of being specified in a box or multiple boxes.

In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net Network interface and memory.

Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/ Or the forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable Jie The example of matter.

Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data. The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM), Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates Machine readable medium does not include temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.

It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability It include so that the process, method, commodity or the equipment that include a series of elements not only include those elements, but also to wrap Include other elements that are not explicitly listed, or further include for this process, method, commodity or equipment intrinsic want Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including element There is also other identical elements in process, method, commodity or equipment.

It will be understood by those skilled in the art that embodiments herein can provide as method, system or computer program product. Therefore, complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in the application Form.It is deposited moreover, the application can be used to can be used in the computer that one or more wherein includes computer usable program code The shape for the computer program product implemented on storage media (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) Formula.

The above is only embodiments herein, are not intended to limit this application.To those skilled in the art, Various changes and changes are possible in this application.It is all within the spirit and principles of the present application made by any modification, equivalent replacement, Improve etc., it should be included within the scope of the claims of this application.

Claims

1. a kind of data request processing method characterized by comprising

The first request of data is obtained from request queue to be processed；

There are at least one in the request queue to be processed with first request of data there are the data of incidence relation to ask When asking, by according to first request of data determine data be back to respectively first request of data sender and with institute State the sender of each request of data of first request of data with incidence relation, wherein respectively according to each with incidence relation The data that the need that request of data determines are back to sender are identical.

2. the method according to claim 1, wherein in the number that will be determined according to first request of data There are each data of incidence relation according to the sender for being back to first request of data respectively and with first request of data After the sender of request, the method also includes:

There is incidence relation by first request of data in the request queue to be processed and with first request of data Each request of data delete.

3. the method according to claim 1, wherein further include:

Obtain the second request of data that sender sends；

Second request of data is put into the request queue to be processed；

To at least one request of data in the request queue to be processed in addition to second request of data: determining according to the number It is back to sender's with the need obtained according to second request of data according to the data that the need that request obtains are back to sender Whether data are identical, if identical, establish the incidence relation of the request of data Yu second request of data.

4. according to the method described in claim 3, it is characterized in that, it is described in the request queue to be processed remove described second At least one request of data outside request of data: the data and root that sender is back to according to the need that the request of data obtains are determined Whether the data for being back to sender according to the need that second request of data obtains are identical, if identical, establish the data and ask The incidence relation with second request of data is sought, is specifically included:

According to preset order using a request of data in the request queue to be processed in addition to second request of data as Current request to be analyzed；

Determine that the data for being back to sender according to the need of current request acquisition to be analyzed are obtained with according to second request of data Whether the data that the need obtained are back to sender are identical, if identical, establish current request to be analyzed and second data The incidence relation of request, if it is not the same, then described second will be removed in the request queue to be processed according to the preset order Another request of data in request of data outside request of data returns as current request to be analyzed and executes the determining basis The data that the need that current request to be analyzed obtains are back to sender are back to the need obtained according to second request of data The whether identical step of the data of sender.

5. according to the method described in claim 3, it is characterized in that, the determination is back to according to the need that the request of data obtains Whether the data of sender and the data that the need obtained according to second request of data are back to sender are identical, comprising:

It is taken according to demand file cryptographic Hash, demand file deviation post and second request of data that the request of data carries The demand file cryptographic Hash of band, demand file deviation post determine the number that sender is back to according to the need that the request of data obtains It is whether identical according to the data for being back to sender with the need obtained according to second request of data.

6. according to the method described in claim 5, it is characterized in that, the demand file Hash carried according to the request of data Value, the demand file cryptographic Hash of demand file deviation post and second request of data carrying, demand file deviation post Determination is returned according to the data that the need that the request of data obtains are back to sender with the need obtained according to second request of data Whether the data for being back to sender are identical, comprising:

The demand file cryptographic Hash that demand file cryptographic Hash that the request of data is carried and second request of data carry into Row compares, and obtains the first comparison result；

The demand file deviation post for obtaining request of data carrying obtains the quotient of unit data quantity divided by data, obtains described the The demand file deviation post that two request of data carry obtains the quotient of unit data quantity divided by the data, and two quotient are compared It is right, obtain the second comparison result；

According to first comparison result and second comparison result, determines and be back to hair according to the need that the request of data obtains Whether the data for the side of sending and the data that the need obtained according to second request of data are back to sender are identical.

7. the method according to claim 1, wherein obtaining the first data from request queue to be processed described After request, the method also includes:

The data failure of the sender of the first request of data, then exist as described in need to be back to according to the first request of data determination When there is the request of data of incidence relation with first request of data there are at least two in the request queue to be processed, build Vertical and described first request of data has the incidence relation between each request of data of incidence relation, releases first data and asks The incidence relation with other request of data is sought, first request of data in the request queue to be processed is deleted.

8. a kind of data request processing device characterized by comprising the first request of data obtaining unit, returned data determine Unit and data return unit,

The returned data determination unit, for first request of data need to be back to according to the first request of data determination Sender data；

The data return unit, for there are at least one and first request of data in the request queue to be processed When request of data with incidence relation, first number will be back to respectively according to the data that first request of data determines There is the sender of each request of data of incidence relation according to the sender of request and with first request of data, wherein respectively The data for being back to sender according to the need that each request of data with incidence relation determines are identical.

9. a kind of storage medium, which is characterized in that be stored with computer executable instructions, the computer in the storage medium When executable instruction is loaded and executed by processor, the described in any item data request processing sides of claim 1 to 7 as above are realized Method.

10. a kind of computer equipment, which is characterized in that including processor, memory and be stored on the memory and can be The program run on the processor, the processor at least perform the steps of when executing program

The first request of data is obtained from request queue to be processed；