CN106534309A - Data processing method and apparatus - Google Patents
Data processing method and apparatus Download PDFInfo
- Publication number
- CN106534309A CN106534309A CN201611001275.2A CN201611001275A CN106534309A CN 106534309 A CN106534309 A CN 106534309A CN 201611001275 A CN201611001275 A CN 201611001275A CN 106534309 A CN106534309 A CN 106534309A
- Authority
- CN
- China
- Prior art keywords
- data
- resource block
- request
- data resource
- pretreatment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Abstract
The invention provides a data processing method and apparatus. The method comprises the following steps: receiving multiple data requests and preprocessing requests from multiple clients within preset time, wherein the data requests comprise resource requests, the resource requests are oriented towards data resource blocks stored in a server, and the server store the multiple data resource blocks; analyzing orientations of the multiple resource requests so as to determine overlapped data resource blocks in the data resource blocks oriented by the multiple resource requests; selecting target data resource blocks from the overlapped data resource blocks; reading the target data resource blocks, and according to the preprocessing requests, preprocessing the target data resource blocks so as to obtain target data corresponding to the different clients; and respectively returning the target data in response to the multiple data requests to the multiple clients. The method and apparatus can improve the efficiency of the data processing method.
Description
Technical field
The present invention relates to data processing field, more particularly to a kind of data processing method and device.
Background technology
With data acquisition and the progress of information technology, the data resource that can be analyzed and processed comes more, data money
The size in source is increasing.For example, with the arrival in big data epoch, increasing data are associated, and needs are located
The data volume of reason is increasing.
Existing Data Data disposal methods efficiency has to be hoisted.
The content of the invention
Present invention solves the technical problem that being the efficiency for lifting data processing method.
To solve above-mentioned technical problem, the embodiment of the present invention provides a kind of data processing method, including：In the default time
The interior multiple request of data received from multiple client, the request of data include resource request and pretreatment request,
The resource request points to the data resource block of server storage, and the server storage has multiple data resource blocks；Point
The sensing of multiple resource requests is analysed, to determine the data money overlapped in data resource block that multiple resource requests are pointed to
Source block；The selection target data resource block in the data resource block of the overlap；The target data Resource Block is read, according to institute
Stating pretreatment request carries out pretreatment to the target data Resource Block, to obtain the target data of correspondence different clients；Point
The target data in response to the plurality of request of data is not returned to the plurality of client.
Optionally, the pretreatment request is carried in preprocessor；The server is asked according to the pretreatment
Pretreatment is carried out to the target data Resource Block includes：The target data Resource Block is carried out using the preprocessor
Pretreatment.
Optionally, the pretreatment request is carried in preprocessor；The server is asked according to the pretreatment
Pretreatment is carried out to the target data Resource Block includes：The preprocessor is converted to into what the server was adapted for carrying out
Server preprocessor；Pretreatment is carried out to the target data Resource Block using the server preprocessor.
Optionally, it is described to return the number of targets in response to the plurality of request of data to the plurality of client respectively
According to including：Notify to the plurality of client returned data respectively, the data notification indicates to return number to corresponding client
According to time；Send in response to the data from the client to multiple client respectively；After the completion of data is activation, to correspondence
Client send end notification.
Optionally, using following any one mode in the data resource block of the overlap selection target data resource block：
Select to overlap the most data resource block of number of times in the data resource block of the overlap as the target data Resource Block；Ginseng
The target data Resource Block is chosen according to the priority of multiple resource requests.
The embodiment of the present invention also provides a kind of data processing equipment, including：Request of data receiving unit, is suitable to default
The multiple request of data from multiple client are received in time, the request of data includes that resource request and pretreatment please
Ask, the resource request points to the data resource block of server storage, the server storage there are multiple data resource blocks；
Overlapped data Resource Block determining unit, is suitable to analyze the sensing of multiple resource requests, to determine multiple resource requests
The data resource block overlapped in the data resource block of sensing；Target data Resource Block determining unit, is suitable to the number in the overlap
According to selection target data resource block in Resource Block；Target data signal generating unit, is suitable to read the target data Resource Block, according to
The pretreatment request carries out pretreatment to the target data Resource Block, to obtain the target data of correspondence different clients；
Request-response unit, is suitable to the plurality of client return the target data in response to the plurality of request of data.
Optionally, the pretreatment request is carried in preprocessor, and the target data signal generating unit is suitable to utilize
The preprocessor carries out pretreatment to the target data Resource Block.
Optionally, the pretreatment request is carried in preprocessor；The target data signal generating unit includes：Program
Conversion subunit, is suitable to for the preprocessor to be converted to the server preprocessor that the server is adapted for carrying out；In advance
Subelement is processed, is suitable to carry out pretreatment to the target data Resource Block using the server preprocessor.
Optionally, the request-response unit includes：Time announcement unit, is suitable to return to the plurality of client respectively
Data notification, the data notification indicate the opportunity to corresponding client returned data；Data transmission unit, be suitable to respectively to
Multiple client is sent in response to the data from the client；End notification unit, is suitable to after the completion of data is activation, to right
The client answered sends end notification.
Optionally, the target data Resource Block determining unit includes that priority is chosen unit or overlaps selection unit；Institute
State priority and choose unit, be suitable to select to overlap the most data resource block conduct of number of times in the data resource block of the overlap
The target data Resource Block；Described overlap chooses unit, is suitable to reference to described in the priority of multiple resource requests is chosen
Target data Resource Block.
Compared with prior art, the technical scheme of the embodiment of the present invention has the advantages that：
In embodiments of the present invention, by the request of data from multiple client is received within the default time, these
Resource request is included in request of data, the data resource block overlapped in the data resource block for determining multiple resource requests sensings,
Selection target data resource block in the data resource block of overlap, reads target data Resource Block, and based on the mesh for reading
Mark data resource block, returns the target data in response to the plurality of request of data to the plurality of client respectively.This
In scheme, target data Resource Block is read every time, can be based on the target data Resource Block for reading to multiple clients
End returned data, rather than data Resource Block is individually read and based on the number of targets for reading for each request of data
According to Resource Block returned data, such that it is able to reduce the reading times to data Resource Block, and then the effect of data processing can be lifted
Rate.
Further, the selection target data resource block in the data resource block of the overlap, can be in the data for overlapping
Select to overlap in Resource Block the most data resource block of number of times as the target data Resource Block, or with reference to multiple institutes
The priority for stating resource request chooses the target data Resource Block, or can also be default other the selection sides of server
Formula, such as according to request order.Wherein, can with reference to the priority selection target data Resource Block of multiple resource requests
To take into account the priority of resource request；Select to overlap the most data resource block of number of times in the data resource block for overlapping as institute
Target data Resource Block is stated, can be reduced to greatest extent and the number of times for reading is repeated to same resource, such that it is able to lift number
According to the efficiency for processing.
Description of the drawings
Fig. 1 is a kind of flow chart of data processing method in the embodiment of the present invention；
Fig. 2 is a kind of flow chart for implementing of step S14 in Fig. 1；
Fig. 3 is a kind of structural representation of the application scenarios of data processing method in the embodiment of the present invention；
Fig. 4 is a kind of resource processing sequence schematic diagram in the embodiment of the present invention；
Fig. 5 is a kind of structural representation of data processing equipment in the embodiment of the present invention.
Specific embodiment
As stated in the Background Art, with data acquisition and the progress of information technology, the data money that can be analyzed and processed
Source comes more, and the size of data resource is increasing.For example, with the arrival in big data epoch, increasing data are by phase
Mutual correlation, needs processed data volume increasing.Existing Data Data disposal methods efficiency has to be hoisted.
In embodiments of the present invention, by the request of data from multiple client is received within the default time, these
Resource request is included in request of data, the data resource block overlapped in the data resource block for determining multiple resource requests sensings,
Selection target data resource block in the data resource block of overlap, reads target data Resource Block, and based on the mesh for reading
Mark data resource block, returns the target data in response to the plurality of request of data to the plurality of client respectively.This
In scheme, target data Resource Block is read every time, can be based on the target data Resource Block for reading to multiple clients
End returned data, rather than data Resource Block is individually read and based on the number of targets for reading for each request of data
According to Resource Block returned data, such that it is able to reduce the reading times to data Resource Block, and then the effect of data processing can be lifted
Rate.
It is understandable to enable above-mentioned purpose of the invention, feature and beneficial effect to become apparent from, below in conjunction with the accompanying drawings to this
The specific embodiment of invention is described in detail.
Fig. 1 is a kind of flow chart of data processing method in the embodiment of the present invention.Referring to Fig. 1, in the embodiment of the present invention
Data processing method can include：
Step S11, receives the multiple request of data from multiple client, within the default time in the request of data
Including resource request and pretreatment request, the resource request points to the data resource block of server storage, the server
Be stored with multiple data resource blocks.
Step S12, analyzes the sensing of multiple resource requests, to determine that the data that multiple resource requests are pointed to are provided
The data resource block overlapped in source block.
Step S13, the selection target data resource block in the data resource block of the overlap.
Step S14, reads the target data Resource Block, is asked to the target data Resource Block according to the pretreatment
Pretreatment is carried out, to obtain the target data of correspondence different clients；
Step S15, returns the target data in response to the plurality of request of data to the plurality of client respectively.
Data processing method as shown in Figure 1 goes for server, can be single server can also be distribution
Formula server.Multiple data resource blocks can be stored in server.These data resource blocks can be the data that can be split
Resource cutting is obtained, and these data resource blocks are the child resources of data resource.Content between data resource block is not intersected, and
Can be independent these data resource blocks are processed, such as independent is read out to these data resource blocks.
In being embodied as, data resource carried out cutting obtain data resource block including following manner：According to number
According to file volume percent cutting in resource, by the sub-file number cutting of data resource, by cpu data cutting, provide by history
Source degree on probation cutting etc..
Client can be the equipment for needing from server to obtain data, for example, can be the equipment such as computer, mobile phone.Visitor
Family end and server can support common communications protocol, meet common communications framework, so that client can be to service
Device sends request of data.
Resource request can be included in the request of data of client, these resource requests can point to data resource block
Can be that the data resource block is pointed to by above-mentioned data resource.
For example, if data resource is the A files of 20 row data of being stored with, A files can be divided into two block numbers according to Resource Block, point
Bao Han not front 10 row data and rear 10 row data.Now, if data recourse requests are the requests to A files, the resource request
Above-mentioned two data resource block is pointed to, that is, points to the data resource block comprising 10 row data before A files and comprising after A files
The data resource block of 10 row data.
In the example of another indefiniteness, if data resource is the A catalogues of 20 files of being stored with, A catalogues can be with
It is divided into two block numbers according to Resource Block, respectively comprising front 10 parts of files and rear 10 files.Now, if data recourse requests are to A mesh
The request of record, then resource request sensing above-mentioned two data resource block, that is, number of the sensing comprising 10 files before A catalogues
According to Resource Block and the data resource block comprising 10 files after A files.
In being embodied as, the Preset Time in step S11 can include following any one or more time：Work as service
When device is in idle condition, can be with regular time section as the default time, section is in the time period at every fixed time
The multiple request of data for receiving are analyzed；When server is read out to target data Resource Block, can be with to the mesh
Mark data resource block be read out needed for time as the default time, upper target data Resource Block is read out when
The interior data recourse requests for receiving are analyzed, to determine next target data Resource Block.
The default time can also be called resource period, and when server is in idle condition, resource period can be
The default time, when being read out to target data Resource Block, resource period can be read access time.That is, resource period
It can not be regular time value.
It is understood that the above-mentioned data resource of request can be included in the request of data received in resource period
Resource request, it is also possible to including the resource request of request target data resource block, can also include request target data resource block
In certain partial data request.The sensing of server analysis these resource requests, can include determining that these resource requests are pointed to
Data resource block.
In addition, in being embodied as, data resource block can include that further data divide data resource for obtaining
Block, but data resource block is by as an entirety reading.
In being embodied as, in step S13 in the data resource block of the overlap selection target data resource block, can be with
It is to select to overlap in the data resource block for overlapping the most data resource block of number of times as the target data Resource Block, also may be used
Being to choose the target data Resource Block with reference to the priority of multiple resource requests, or can also be that server is preset
Other selection modes, for example, choose etc. according to the sequencing for receiving request of data.
Wherein, the priority selection target data Resource Block with reference to multiple resource requests can be taken into account resource and ask
The priority asked；In the data resource block for overlapping, select overlap number of times most data resource block is provided as the target data
Source block, can reduce to greatest extent and repeat the number of times for reading to same resource, such that it is able to lift the efficiency of data processing.
In being embodied as, carrying out pretreatment to target data Resource Block according to pretreatment request in step S14 can be
The ongoing data of target data Resource Block are screened or processed, to obtain target data.
For example, when the big data resource that target data Resource Block is a certain main body of correspondence, target data Resource Block is entered
Row pretreatment can be screened, such as filter out to should main body certain characteristic data；When target data Resource Block
For video resource when, target data Resource Block is carried out pretreatment can be by video resource be converted to send the data please
The video resource that the terminal asked is adapted, for example, carry out conversion of resolution etc..
In being embodied as, pretreatment request can be carried in preprocessor；The server is according to the pre- place
Reason request carries out pretreatment to the target data Resource Block to be included：Using the preprocessor to the target data resource
Block carries out pretreatment.
When pretreatment failure is carried out to the target program using described and processing routine, phase can be asked with ending resource
Operation is closed, exits to discharge server resource；Or associative operation can also be continued executing with according to the setting of server.
Referring to Fig. 2, in an embodiment of the present invention, the server is asked to the target data according to the pretreatment
Resource Block carries out pretreatment can be included：
The preprocessor is converted to the server preprocessor that the server is adapted for carrying out by step S141；
Step S142, carries out pretreatment to the target data Resource Block using the server preprocessor.
Wherein, the preprocessor is converted to the process of the server preprocessor that the server is adapted for carrying out
In, preprocessor can be optimized, to lift execution efficiency；Can also only be that preprocessor is converted into into server
The program that the language specified is write, or preprocessor is converted into meeting the program of preset rules.
In the example of an indefiniteness, returned in response to institute to the plurality of client in step S15 respectively in Fig. 1
The target data for stating multiple request of data can include：
Notify to the plurality of client returned data respectively, the data notification indicates to return number to corresponding client
According to time；
Send in response to the data from the client to multiple client respectively；
After the completion of data is activation, end notification is sent to corresponding client.
Below referring to Fig. 3, data processing method as shown in Figure 1 is further described.
For convenience of description, it is assumed that within the default time, the request of data from three clients is received, is differentiation side
Just, these three clients are named as into the first client 21, the second client 22 and the 3rd client 23.It is wherein objective from first
Comprising the resource request for pointing to the first data resource block and the 4th data resource block in the request of data at family end 21；It is objective from second
Comprising the resource request for pointing to the first data resource block and the second data resource block in the request of data at family end 22；It is objective from the 3rd
Comprising the resource request for pointing to the second data resource block in the request of data at family end 23.
As can be seen that the data resource block overlapped in the data resource block of multiple resource requests sensings is the first data resource
Block and the second data resource block.Target data resource can be chosen in the first data resource block and the second data resource block now
Block.
If the priority from the resource request of different clients is different, wherein from the resource request of the 3rd client 23
Priority it is higher, then can choose the second data resource block as target data Resource Block.
It is assumed that the second data resource block is chosen in above process as target data Resource Block, have read the second data
Resource Block, and response is returned to the second client 22 and the 3rd client 23 respectively based on the second data resource block for reading
In the data of its request of data, the request of data received during the second data resource block is read can be now analyzed.
It is understood that based on the second data resource block for reading to the second client 22 and the 3rd client respectively
23 return the data in response to its request of data, can include carrying out the second data resource block the process of pretreatment.
In the request of data that analysis is received during the second data resource block is read, also by from the first client 21
Point to the resource request of the first data resource block and the 4th data resource block, provide from first data of sensing of the second client 22
The resource request of source block is used as the request of data for receiving.That is, when target data Resource Block is chosen, by what is do not responded before
The data recourse requests included as the request of data received in Preset Time by data recourse requests.
It is understood that the data processing method in the embodiment of the present invention can also include：If within the default time
Request of data from a client is have received only, then the data resource block that can be pointed to the request of data is used as target
Data resource block.
In addition, in being embodied as, if request of data is directed to the request of data of data resource, the data resource is comprising more
Individual data Resource Block, then once can determine in multiple continuous resource periods, read many numbers that the data resource is included
According to Resource Block.
In the embodiment of the present invention, a kind of resource processing sequence schematic diagram is referring to Fig. 4, below in conjunction with Fig. 4 to as shown in Figure 1
Data processing method is illustrated.
Referring to Fig. 4, below by taking the process processed to a certain data resource as an example, to data processing as shown in Figure 1
Method is further described.Data resource as shown in Figure 4 can include data resource block 41, data resource block 42 and number
According to Resource Block 43.
Program A can come from the first request of data, and server can carry out pretreatment to data Resource Block using program A,
To meet with a response in the data of the first request of data.Server has been arranged in continuous three resource periods and has read data Resource Block
41st, data resource block 42 and data resource block 43.
In t1Moment, server receive the second request of data, and the second request of data can be in the 4th data resource
The request of data resource block 41 and data Resource Block 42, carries program B in the second request of data, to carry out pretreatment.
Due to t1Moment is located in the resource period for reading data Resource Block, so after the resource period terminates then right
The request of data received in the resource period is processed.After the resource period for reading data Resource Block 41 terminates, receive data
According to Resource Block 42, now program A and program B carry out pretreatment to data Resource Block 42.
Program C can come from the 3rd request of data, and the 3rd request of data can be connect before data Resource Block 41 is read
The request of data for receiving, or the request received when data Resource Block 41 is read or read data Resource Block 42.
Read in the resource period of data Resource Block 43, program A and program C carry out pretreatment to data Resource Block 43.
In the example of an indefiniteness, the data resource in Fig. 4 can be a certain video resource, and client is by point
The mode for hitting data resource chart has initiated the request to data resource, and the corresponding client of program C can have recorded last time
The position of viewing, can be to the request of data resource by clicking on continuation viewing initiation.Program A, program B and program C can be right
Running time-frequency resource carries out the program processed with the suitability of terminal.
In the example of another indefiniteness, the data resource in Fig. 4 can also be that big data field record corresponds to certain
The data of a little main bodys, wherein data resource block can be the different main bodys of correspondence.Data resource in Fig. 4 can also be and correspond to certain
The data of one main body, data resource block therein can to should be in main body different time sections data, or according to which
The data resource block divided by his mode.Program A, program B and program C can be data screening programs.
Each data resource block in Fig. 4 can include data resource sub-block, and the resource request in request of data can also
It is directed to data resource sub-block.Fig. 4 illustrate only the processing procedure to a data resource, in being embodied as, server
Parallel multiple data resources can be processed.
It is understood that above-mentioned data resource block 41, data resource block 42, data resource block 43, program A, program B,
The titles such as program C, the first request of data, the second request of data and the 3rd request of data are only for convenience of description, and non-limiting
Description.
The embodiment of the present invention make use of the concept that localized calculation and functional expression are calculated, wherein localized calculation to refer to：It is right
In one section of code, the program affects only act on the program limit included by this section of code.Functional expression is calculated and is referred to：Given journey
Sequence is input into and designated program code, and program output can be uniquely determined.Preprocessor can only support localized calculation and letter
Numerical expression is calculated, that is to say, that for the input of preprocessor, its value can be only capable of acting on the variable in the preprocessor
And calculating process, and for unique program is input into, the unique program output of correspondence.
In embodiments of the present invention, by the request of data from multiple client is received within the default time, these
Resource request is included in request of data, the data resource block overlapped in the data resource block for determining multiple resource requests sensings,
Selection target data resource block in the data resource block of overlap, reads target data Resource Block, and based on the mesh for reading
Mark data resource block, returns the target data in response to the plurality of request of data to the plurality of client respectively.This
In scheme, target data Resource Block is read every time, can be based on the target data Resource Block for reading to multiple clients
End returned data, rather than data Resource Block is individually read and based on the number of targets for reading for each request of data
According to Resource Block returned data, such that it is able to reduce the reading times to data Resource Block, and then the effect of data processing can be lifted
Rate.
The embodiment of the present invention also provides a kind of data processing equipment, and its structural representation is referring to Fig. 5.
Data processing equipment can include：
Request of data receiving unit 51, the multiple data for being suitable to receive within the default time from multiple client please
Ask, the request of data includes resource request and pretreatment request, the resource request points to the data of server storage
Resource Block, the server storage have multiple data resource blocks；
Overlapped data Resource Block determining unit 52, is suitable to analyze the sensing of multiple resource requests, to determine multiple institutes
The data resource block overlapped in the data resource block for stating resource request sensing；
Target data Resource Block determining unit 53, is suitable to the selection target data resource in the data resource block of the overlap
Block；
Target data signal generating unit 54, is suitable to read the target data Resource Block, is asked to institute according to the pretreatment
Stating target data Resource Block carries out pretreatment, to obtain the target data of correspondence different clients；
Request-response unit 55, is suitable to the plurality of client return the mesh in response to the plurality of request of data
Mark data.
In being embodied as, the pretreatment request can be carried in preprocessor, and the target data generates single
Unit 54 is suitable to carry out pretreatment to the target data Resource Block using the preprocessor.
When pretreatment request is carried in preprocessor, the target data signal generating unit 54 can include：
Program transformation subelement (not shown), is suitable to for the preprocessor to be converted to what the server was adapted for carrying out
Server preprocessor；
Pretreatment subelement (not shown), is suitable to using the server preprocessor to the target data Resource Block
Carry out pretreatment.
In being embodied as, the request-response unit 55 can include：
Time announcement unit (not shown), is suitable to notify to the plurality of client returned data respectively, the data are led to
Know the opportunity indicated to corresponding client returned data；
Data transmission unit (not shown), is suitable to send in response to the number from the client to multiple client respectively
According to；
End notification unit (not shown), is suitable to after the completion of data is activation, sends end notification to corresponding client.
In being embodied as, the target data Resource Block determining unit 53 can include that priority chooses unit or overlap
Choose unit；
The priority chooses unit (not shown), is suitable to select to overlap number of times most in the data resource block of the overlap
Many data resource blocks are used as the target data Resource Block；
Described overlap chooses unit (not shown), is suitable to choose the target with reference to the priority of multiple resource requests
Data resource block.
Implementing for data processing equipment in the embodiment of the present invention may refer to data processing method with beneficial effect,
This does not repeat.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
Instruct related hardware to complete with by program, the program can be stored in a computer-readable recording medium, storage
Medium can include：ROM, RAM, disk or CD etc..
Although present disclosure is as above, the present invention is not limited to this.Any those skilled in the art, without departing from this
In the spirit and scope of invention, can make various changes or modifications, therefore protection scope of the present invention should be with claim institute
The scope of restriction is defined.
Claims (10)
1. a kind of data processing method, it is characterised in that include：
The multiple request of data from multiple client are received within the default time, the request of data includes resource request
And pretreatment request, the data resource block of the resource request sensing server storage, the server storage have multiple institutes
State data resource block；
The sensing of multiple resource requests is analyzed, to determine what is overlapped in data resource block that multiple resource requests are pointed to
Data resource block；
The selection target data resource block in the data resource block of the overlap；
The target data Resource Block is read, pretreatment is carried out to the target data Resource Block according to pretreatment request,
To obtain the target data of correspondence different clients；Return in response to the plurality of request of data to the plurality of client respectively
The target data.
2. data processing method according to claim 1, it is characterised in that the pretreatment request is carried on pretreatment journey
In sequence；The server carries out pretreatment to the target data Resource Block according to pretreatment request to be included：Using described
Preprocessor carries out pretreatment to the target data Resource Block.
3. data processing method according to claim 1, it is characterised in that the pretreatment request is carried on pretreatment journey
In sequence；The server carries out pretreatment to the target data Resource Block according to pretreatment request to be included：
The preprocessor is converted to into the server preprocessor that the server is adapted for carrying out；
Pretreatment is carried out to the target data Resource Block using the server preprocessor.
4. data processing method according to claim 1, it is characterised in that described to return to the plurality of client respectively
Include in response to the target data of the plurality of request of data：
Notify to the plurality of client returned data respectively, the data notification is indicated to corresponding client returned data
Time；
Send in response to the data from the client to multiple client respectively；
After the completion of data is activation, end notification is sent to corresponding client.
5. data processing method according to claim 1, it is characterised in that using following any one mode in the overlap
Data resource block in selection target data resource block：
Select to overlap the most data resource block of number of times in the data resource block of the overlap as the target data resource
Block；
The target data Resource Block is chosen with reference to the priority of multiple resource requests.
6. a kind of data processing equipment, it is characterised in that include：
Request of data receiving unit, is suitable to the multiple request of data from multiple client are received within the default time, described
Request of data includes resource request and pretreatment request, and the resource request points to the data resource block of server storage,
The server storage has multiple data resource blocks；
Overlapped data Resource Block determining unit, is suitable to analyze the sensing of multiple resource requests, to determine multiple resources
The data resource block overlapped in the data resource block that request is pointed to；
Target data Resource Block determining unit, is suitable to the selection target data resource block in the data resource block of the overlap；
Target data signal generating unit, is suitable to read the target data Resource Block, is asked to the target according to the pretreatment
Data resource block carries out pretreatment, to obtain the target data of correspondence different clients；
Request-response unit, is suitable to the plurality of client return the number of targets in response to the plurality of request of data
According to.
7. data processing equipment according to claim 6, it is characterised in that the pretreatment request is carried on pretreatment journey
In sequence, the target data signal generating unit is suitable to carry out pre- place to the target data Resource Block using the preprocessor
Reason.
8. data processing equipment according to claim 6, it is characterised in that the pretreatment request is carried on pretreatment journey
In sequence；The target data signal generating unit includes：
Program transformation subelement, is suitable to for the preprocessor to be converted to the server pretreatment that the server is adapted for carrying out
Program；
Pretreatment subelement, is suitable to carry out pretreatment to the target data Resource Block using the server preprocessor.
9. data processing equipment according to claim 6, it is characterised in that the request-response unit includes：
Time announcement unit, is suitable to notify to the plurality of client returned data respectively, the data notification is indicated to correspondence
Client returned data opportunity；
Data transmission unit, is suitable to send in response to the data from the client to multiple client respectively；
End notification unit, is suitable to after the completion of data is activation, sends end notification to corresponding client.
10. data processing equipment according to claim 6, it is characterised in that the target data Resource Block determining unit
Choose unit or overlap including priority and choose unit；
The priority chooses unit, is suitable to select to overlap the most data resource of number of times in the data resource block of the overlap
Block is used as the target data Resource Block；
Described overlap chooses unit, is suitable to choose the target data Resource Block with reference to the priority of multiple resource requests.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611001275.2A CN106534309A (en) | 2016-11-14 | 2016-11-14 | Data processing method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611001275.2A CN106534309A (en) | 2016-11-14 | 2016-11-14 | Data processing method and apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106534309A true CN106534309A (en) | 2017-03-22 |
Family
ID=58351691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611001275.2A Pending CN106534309A (en) | 2016-11-14 | 2016-11-14 | Data processing method and apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106534309A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107911438A (en) * | 2017-11-06 | 2018-04-13 | 出门问问信息科技有限公司 | The method, apparatus and system of data processing |
| CN113111078A (en) * | 2021-06-15 | 2021-07-13 | 深圳华锐金融技术股份有限公司 | Resource data processing method and device, computer equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101925045A (en) * | 2009-06-17 | 2010-12-22 | 中兴通讯股份有限公司 | Method and system for providing user service data |
| CN102098175A (en) * | 2011-01-26 | 2011-06-15 | 浪潮通信信息系统有限公司 | Alarm association rule obtaining method of mobile internet |
| CN103501339A (en) * | 2013-09-30 | 2014-01-08 | 华为技术有限公司 | Metadata processing method and metadata server |
| CN104811394A (en) * | 2015-04-21 | 2015-07-29 | 深圳市出众网络有限公司 | Method and system for saving traffic for accessing server |
| CN105490948A (en) * | 2015-12-28 | 2016-04-13 | 传线网络科技（上海）有限公司 | Method and system for data packet distribution |
-
2016
- 2016-11-14 CN CN201611001275.2A patent/CN106534309A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101925045A (en) * | 2009-06-17 | 2010-12-22 | 中兴通讯股份有限公司 | Method and system for providing user service data |
| CN102098175A (en) * | 2011-01-26 | 2011-06-15 | 浪潮通信信息系统有限公司 | Alarm association rule obtaining method of mobile internet |
| CN103501339A (en) * | 2013-09-30 | 2014-01-08 | 华为技术有限公司 | Metadata processing method and metadata server |
| CN104811394A (en) * | 2015-04-21 | 2015-07-29 | 深圳市出众网络有限公司 | Method and system for saving traffic for accessing server |
| CN105490948A (en) * | 2015-12-28 | 2016-04-13 | 传线网络科技（上海）有限公司 | Method and system for data packet distribution |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107911438A (en) * | 2017-11-06 | 2018-04-13 | 出门问问信息科技有限公司 | The method, apparatus and system of data processing |
| CN113111078A (en) * | 2021-06-15 | 2021-07-13 | 深圳华锐金融技术股份有限公司 | Resource data processing method and device, computer equipment and storage medium |
| CN113111078B (en) * | 2021-06-15 | 2021-10-29 | 深圳华锐金融技术股份有限公司 | Resource data processing method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7721288B2 (en) | Organizing transmission of repository data | |
| CN102148805B (en) | Feature matching method and device | |
| EP3855362A1 (en) | Convolution processing method, apparatus, and storage medium of convolutional neural network | |
| CN109902446B (en) | Method and apparatus for generating information prediction model | |
| US20170251072A1 (en) | System and method for annotating client-server transactions | |
| CN106534309A (en) | Data processing method and apparatus | |
| CN109408330A (en) | Log analysis method, device, terminal device and readable storage medium storing program for executing | |
| CN106356077A (en) | Laughter detection method and device | |
| CN110941553A (en) | Code detection method, device, equipment and readable storage medium | |
| CN113543117A (en) | Prediction method and device for number portability user and computing equipment | |
| CN111258765A (en) | Load balancing method and device, computing equipment and storage medium | |
| CN113452581B (en) | Method and device for extracting characteristics of streaming data, storage medium and computer equipment | |
| CN105975577A (en) | Data optimization method and device in big data processing | |
| CN108182116A (en) | A kind of bidding documents analysis method, device, equipment and storage medium | |
| US8402471B2 (en) | Methods and apparatus to benchmark a computer system based on executing instructions using different numbers of threads | |
| CN111026991B (en) | Data display method and device and computer equipment | |
| US7530013B2 (en) | Optimizer of interdependent information | |
| JP2009026029A (en) | Transaction control device, transaction control method, transaction control program and storage medium with the program stored | |
| CN112866044B (en) | Network equipment state information acquisition method and device | |
| CN109116997A (en) | A kind of searching method and device based on phonetic | |
| CN111767435B (en) | User behavior analysis method and device | |
| JP2004171592A5 (en) | ||
| CN111538902B (en) | Information pushing method and device, storage medium and electronic equipment | |
| CN112347330A (en) | Distributed parallel acquisition method for urban big data | |
| CN111104529B (en) | Index file control method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170322 |
|
| RJ01 | Rejection of invention patent application after publication |