CN106326499A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN106326499A CN106326499A CN201610899295.XA CN201610899295A CN106326499A CN 106326499 A CN106326499 A CN 106326499A CN 201610899295 A CN201610899295 A CN 201610899295A CN 106326499 A CN106326499 A CN 106326499A
- Authority
- CN
- China
- Prior art keywords
- external cache
- configuration information
- user profile
- data base
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing method and device which are used for improving the operation efficiency of operation objects under the high concurrency condition. The method comprises steps as follows: acquiring a request for operation of an operation object, wherein the request for operation of the operation object comprises a user identification and an operation object identification; inquiring whether user information corresponding to the user identification exists in an external cache, and acquiring the user information corresponding to the user identification from the external cache if user information corresponding to the user identification exists in the external cache; inquiring whether configuration information corresponding to the operation object identification exists in a memory, and acquiring the configuration information corresponding to the operation object identification from the memory if configuration information corresponding to the operation object identification exists in the memory; operating an operation object and generating operation information comprising the user identification and the operation object identification when the user information corresponding to the user identification is matched with the configuration information corresponding to the operation object identification; writing the operation information in a sub-table of a database.
Description
Technical field
The present invention relates to Internet technical field, be specifically related to a kind of data processing method and device.
Background technology
Needing to operate operation object in actual production process, such as during network direct broadcasting, user is permissible
Obtaining some virtual item, wherein virtual item can be understood as operating object, and the process obtaining virtual item can be then right
Operation object carries out the process operated.In the prior art, need to use data base's list table pair when operation object being operated
The data needed in operation or produce back up and cache, but are as the universal of mobile Internet, there is height the most right
Operation object carries out situation about operating, and finds that data base there will be card to single table concurrent update existing in actual production is tested
As, make the operation waiting time lengthen, inefficient.
Summary of the invention
In view of this, the present invention provides a kind of data processing method and device, the most right to solve height in prior art
Waiting time length, inefficient technical problem when operation object operates.
For solving the problems referred to above, the technical scheme that the present invention provides is as follows:
A kind of data processing method, described method includes:
Obtaining the request operating operation object, the described request operating operation object includes that user marks
Know and operated object mark；
Whether inquiry external cache exists the user profile that described ID is corresponding, if deposited in described external cache
In the user profile that described ID is corresponding, from described external cache, obtain the user profile that described ID is corresponding；
Whether audit memory exists the configuration information that described operated object mark is corresponding, if described internal memory exists institute
State the configuration information that operated object mark is corresponding, from described internal memory, obtain the configuration information that described operated object mark is corresponding；
When the configuration information corresponding with described operated object mark when the user profile that described ID is corresponding mates, right
Described operation object carries out operating and generate the operation information including described ID and described operated object mark；
By in described operation information write to a point of table of data base.
Accordingly, described by the write of described operation information in a point of table of data base, including:
Calculate data base according to described ID and divide table sequence number, described operation information write to data base is had described
Data base divides in a point of table of table sequence number.
Accordingly, described described operation object is operated after, described method also includes:
Recalculate the user profile that described ID is corresponding, and corresponding by recalculating the described ID obtained
User profile write in described data base and cover the user profile that original described ID is corresponding；
Send to described external cache and delete the use that instruction is corresponding to delete the described ID in described external cache
Family information and described in include the operation information of described ID.
Accordingly, after whether there is, in described inquiry external cache, the user profile that described ID is corresponding, institute
Method of stating also includes:
If described external cache does not exist the user profile that described ID is corresponding, read from described data base
User profile corresponding for described ID is also preserved to described external cache by user profile that described ID is corresponding.
Accordingly, described method also includes:
Configuration information corresponding to described operation object after updating write described data base covers original described in
After the configuration information that operation object is corresponding, receive the notice that configuration information corresponding to described operation object has updated；
Delete the configuration information that the described operated object mark in described internal memory is corresponding.
Accordingly, after whether there is, in described audit memory, the configuration information that described operated object mark is corresponding, institute
Method of stating also includes:
If described internal memory does not exist the configuration information that described operated object mark is corresponding, read from described data base
Configuration information corresponding for described operated object mark is also preserved in the most described by configuration information that described operated object mark is corresponding
In depositing.
Accordingly, described method also includes:
Receiving inquiry operation information request, described inquiry operation information request includes ID；
Inquire about and whether described external cache exists the operation information including described ID, if described external cache
Include the operation information of described ID described in middle existence, from described external cache, include described ID described in acquisition
Operation information；If including the operation information of described ID described in described external cache does not exist, from described data
Include the operation information of described ID described in storehouse is read and the described operation information including described ID is preserved
To described external cache.
A kind of data processing equipment, described device includes:
First acquiring unit, for obtaining the operation request that operates of object, described operates operation object
Request include ID and operated object mark；
Second acquisition unit, for inquiring about whether external cache exists the user profile that described ID is corresponding, as
The most described external cache exists the user profile that described ID is corresponding, from described external cache, obtains described user mark
Know corresponding user profile；
Whether the 3rd acquiring unit, exist the configuration information that described operated object mark is corresponding in audit memory, as
The most described internal memory exists the configuration information that described operated object mark is corresponding, from described internal memory, obtains described operation object mark
Know corresponding configuration information；
Signal generating unit, for when the user profile that described ID the is corresponding configuration corresponding with described operated object mark
During information matches, described operation object is operated and generates include described ID and described operated object mark
Operation information；
First writing unit, for by described operation information write to a point of table of data base.
Accordingly, described first writing unit specifically for:
Calculate data base according to described ID and divide table sequence number, described operation information write to data base is had described
Data base divides in a point of table of table sequence number.
Accordingly, described device also includes:
Second writing unit, for recalculating the user profile that described ID is corresponding, and will recalculate and obtain
User profile corresponding to described ID write in described data base and cover the user that original described ID is corresponding
Information；
Transmitting element, deletes instruction to delete the described user in described external cache for sending to described external cache
User profile that mark is corresponding and described in include the operation information of described ID.
Accordingly, described device also includes:
4th acquiring unit, if there is not, in described external cache, the user profile that described ID is corresponding,
From described data base, read user profile corresponding to described ID and user profile corresponding for described ID is protected
Deposit to described external cache.
Accordingly, described device also includes:
First receives unit, and the configuration information corresponding for the described operation object after updating writes described data base
After the configuration information that the original described operation object of middle covering is corresponding, receive configuration information corresponding to described operation object the most more
New notice；
Delete unit, for deleting the configuration information that the described operated object mark in described internal memory is corresponding.
Accordingly, described device also includes:
5th acquiring unit, if there is not, in described internal memory, the configuration information that described operated object mark is corresponding,
From described data base, read configuration information corresponding to described operated object mark and corresponding for described operated object mark is joined
Confidence breath preserves to described internal memory.
Accordingly, described device also includes:
Second receives unit, is used for receiving inquiry operation information request, and described inquiry operation information request includes that user marks
Know；
For inquiring about whether to exist in described external cache, 6th acquiring unit, includes that the operation of described ID is believed
Breath, if including the operation information of described ID described in existing in described external cache, obtains from described external cache
The described operation information including described ID；If including described ID described in described external cache does not exist
Operation information, includes the operation information of described ID and includes described user by described described in reading from described data base
The operation information of mark preserves to described external cache.
As can be seen here, the embodiment of the present invention has the advantages that
The embodiment of the present invention uses external cache to cache user profile, use the internal memory configuration to infrequently revising
Information caches, and uses and obtains user profile from external cache, obtains configuration information from internal memory, completes operation object
Operation, in a point table of operation information write into Databasce operation produced, by the classification of data storage minimizing simultaneously
Read-write to data base, and use data base to divide table raising data base to be inserted simultaneously into or the number of concurrent of more new data, thus improve
The processing speed operating operation object and efficiency, reach higher performance requirement.
Accompanying drawing explanation
The flow chart of the Fig. 1 data processing method embodiment one for providing in the embodiment of the present invention；
The flow chart of the Fig. 2 data processing method embodiment two for providing in the embodiment of the present invention；
The schematic diagram of the Fig. 3 data processing equipment embodiment for providing in the embodiment of the present invention.
Detailed description of the invention
Understandable for enabling the above-mentioned purpose of the present invention, feature and advantage to become apparent from, real with concrete below in conjunction with the accompanying drawings
The embodiment of the present invention is described in further detail by mode of executing.
In the prior art, the system operated operation object generally uses the form of data base and external cache to enter
, the phenomenons such as card in the case of concomitantly, can be there is at height in row data backup and caching.
Finding in actually generating test, the Backup Data in data base uses simple tabular form storage, the effect of concurrent update
Rate is relatively low.Assume that current data individual data table can be inserted simultaneously into or the bar number of more new data is n, but currently have n+m individual right
Operation object is when carrying out the request operated, data base can only the operation of n inserted or updated data of this table of priority treatment, and remain
Remaining m operation can only first wait until that the operation that data base is presently processing finishes and could continue down to perform, depositing of single table
Storage structure can cause the situation that the most more high latency is the longest.And when only using external cache as data buffer storage, to behaviour
It is required for setting up socket when configuration information required for obtaining when object operates, user profile to go to access external cache
Server, needs to set up, send and receive multiple operations such as network request during connecting socket, takies substantial amounts of system
System resource, repeatedly connect socket during once-through operation also can increase the total time of handling process simultaneously, if once in a while because
The external factor such as network cause socket connection failure cannot read configuration information, also result in this operation failure.
To this end, provide a kind of data processing method and device in the embodiment of the present invention, in the embodiment of the present invention, data deposits
Storage structure includes data base and two kinds of cachings, two kinds of cachings be respectively support height external cache concomitantly (such as Redis or
Memcached etc.) and server native internal memory.Operation generation is operated to the user's letter updated after information and operation
Cease, the configuration information of renewal uses data base as the while of in data backup memory, and the form raising data base of use point table
The number of concurrent of inserted or updated data.For the configuration information seldom revised, it is cached in server native internal memory, for some
User-dependent and needs often amendment user profile is buffered in external cache, when user profile changes, deletes
Except the caching in external cache and read up-to-date backup from data base.Stored by the classification of data, it is possible to make system reach
To higher performance requirement, improve the efficiency of operation.
Based on above-mentioned thought, shown in Figure 1, it is shown that the data processing method embodiment provided in the embodiment of the present invention
One, the present embodiment can apply to, in server, may comprise steps of:
Step 101: obtain the request operating operation object, the request operating operation object includes using
Family mark and operated object mark.
According to actual application scenarios, operation object is carried out operation can be multiple, such as in network direct broadcasting class application journey
Obtaining the operation of stage property in sequence, game class application program, use shopping class application program operation buying commodity etc., it is right to operate
As being the stage property being acquired or purchased commodity etc..Server can obtain the carrying out operation object of user's transmission
The request of operation, can include ID and the mark of operation object sending this request user in this request.
Step 102: whether there is the user profile that ID is corresponding, if deposited in external cache in inquiry external cache
In the user profile that ID is corresponding, from external cache, obtain the user profile that ID is corresponding.
In some possible implementations of the present invention, if external cache does not exist the user that ID is corresponding
Information, reads user profile corresponding to ID from data base and preserves user profile corresponding for ID to outside
In caching.
In the present embodiment, external cache is used to cache the user that can change according to operation object is operated
Information, user profile such as user account remaining sum etc..In some cases, possibly cannot smoothly complete operation object is entered
The operation of row, then need to reacquire user profile when again receiving the request operating operation object, and from outward
Portion's caching obtains user profile and can reduce the access times to data base, to improve the speed that operation object is operated
Degree.
After completing the operation to operation object, user profile can change, and needs the user's letter deleting in external cache
, if then there is not user's letter that ID is corresponding in external cache in the user profile of the backup in breath more new database
During breath, just need from data base, read user profile corresponding to ID and user profile corresponding for ID preserved
To external cache, in order to next time directly can obtain up-to-date user profile from external cache.
, if there is behaviour in internal memory in step 103: whether there is the configuration information that operated object mark is corresponding in audit memory
Make the configuration information that object identity is corresponding, from internal memory, obtain the configuration information that operated object mark is corresponding.
In some possible implementations of the present invention, if internal memory does not exist the configuration that operated object mark is corresponding
Information, configuration information corresponding for operated object mark is also protected by read operation object identity is corresponding from data base configuration information
Deposit to internal memory.
The internal memory of server is not easy to the amendment of data compared to external cache, the most in the present embodiment, uses service
The internal memory of device caches the configuration information infrequently revised, and configuration information represents the attribute of operation object, such as stage property or commodity
Price etc..From internal memory, obtain user profile to reduce the access times to data base and can reduce and external cache
Connect quantity, to improve the speed that operation object is operated.
In some possible implementations of the present invention, it is also possible to including: the operation object after updating is corresponding
After configuration information write into Databasce covers the configuration information that original operation object is corresponding, receive operation corresponding the joining of object
Confidence ceases the notice updated；Delete the configuration information that the operated object mark in internal memory is corresponding.
Namely when needing the configuration information updating operation object, first amendment data base operates the configuration that object is corresponding
Information, server by operate notice that configuration information corresponding to object updated by JMS (Java Message Service,
Java Message Service) it is pushed to all to provide the server that operation object is operated, so that each server is connecing
Actively delete the configuration information in internal memory, in order to hold after receiving the notice that configuration information corresponding to operation object has updated next time
Row reads up-to-date configuration information when operating operation object from data base, if i.e. there is not operation object in internal memory
The situation of the configuration information that mark is corresponding, at this moment needs read operation object identity is corresponding from data base configuration information general
Configuration information corresponding to operated object mark preserves to internal memory.
In addition, it should be noted that obtain user profile in the present embodiment and obtain the order of configuration information not
Need to limit, namely the order between step 102 and step 103 is not defined.
Step 104: when the configuration information corresponding with operated object mark when the user profile that ID is corresponding mates, right
Operation object carries out operating and generate the operation information including ID and operated object mark.
After user profile is mated with configuration information and can be carried out the operation to operation object, operation information, example can be generated
Being a certain commodity as operated object, user profile is user account remaining sum, and configuration information is commodity price, more than user account
When volume is more than commodity price, can perform to buy the operation of these commodity, after operating successfully, can generate operation information should with record
Secondary operation.
In some possible implementations of the present invention, after operation object is operated, also include: again count
Calculate the user profile that ID is corresponding, and in the user profile write into Databasce corresponding by recalculating the ID obtained
Cover the user profile that original ID is corresponding；Send to external cache and delete instruction to delete the user in external cache
Identify corresponding user profile and include the operation information of ID.
After operating successfully, user profile can occur to change accordingly, and such as user account remaining sum reduces, and at this moment needs to update
User profile in data base, and delete the user profile of this user in external cache and the operation information that this user is corresponding.
Step 105: by operation information write to a point of table of data base.
Operation information carries out storage by the form of point table can improve the performance of the inserted or updated data of database concurrency.
In some possible implementations of the present invention, implementing of step 105 may include that
Calculate data base according to ID and divide table sequence number, the write of operation information is had data base to data base and divides table sequence
Number a point of table in.
In actual applications, can calculate according to certain Hash rule according to ID and belong to this ID
Unique cryptographic Hash, is divided into difference cryptographic Hash in multiple packet, and each packet can correspond to a data base and divides table sequence number,
So can calculate the data base corresponding to this ID according to ID and divide table sequence number, this ID will be included
Operation information write into Databasce divides in table accordingly.
It addition, can also receive inquiry operation information request in the present embodiment, inquiry operation information request includes user
Mark；Whether inquiry external cache exists the operation information including ID, includes user if external cache exists
The operation information of mark, obtains the operation information including ID from external cache；If external cache does not exist bag
Include the operation information of ID, read from data base and include the operation information of ID and the behaviour of ID will be included
Information of making preserves to external cache.
Namely user can also inquire about produced operation information at any time, similar, in order to reduce the access to data base
Operation information cache in external cache, is preferentially obtained the operation letter that a certain ID is corresponding from external cache by number of times
Breath, if not including the operation information of this ID in external cache, visiting again data base and obtaining and operation information protected
Deposit to external cache, in order to during inquiry operation information next time, operation information can be obtained from external cache.
So, the embodiment of the present invention uses external cache to cache user profile, use internal memory to infrequently revising
Configuration information cache, use from external cache obtain user profile, from internal memory obtain configuration information, complete behaviour
Make the operation of object, in a point of table of the operation information write into Databasce simultaneously operation produced, deposited by the classification of data
Storage reduces the read-write to data base, and uses data base to divide table raising data base to be inserted simultaneously into or the number of concurrent of more new data, from
And improve the processing speed and efficiency that operation object is operated, reach higher performance requirement.
Shown in Figure 2, it is shown that the data processing method embodiment one provided in the embodiment of the present invention, the present embodiment can
To be applied in server, may comprise steps of:
Step 201: obtain the request operating operation object, the request operating operation object includes using
Family mark and operated object mark.
Step 202: whether there is, in inquiry external cache, the user profile that ID is corresponding, if it is, enter step
203, if it does not, enter step 204.
Step 203: obtain the user profile that ID is corresponding from external cache.
Step 204: read user profile corresponding to ID from data base and by user's letter corresponding for ID
Breath preserves to external cache.
Step 205: whether there is the configuration information that operated object mark is corresponding in audit memory, if it is, enter step
206, if it does not, enter step 207.
Step 206: obtain the configuration information that operated object mark is corresponding from internal memory.
Step 207: read operation object identity is corresponding from data base configuration information is the most corresponding by operated object mark
Configuration information preserve in internal memory.
Step 207: when the configuration information corresponding with operated object mark when the user profile that ID is corresponding mates, right
Operation object carries out operating and generate the operation information including ID and operated object mark.
Step 208: calculate data base according to ID and divide table sequence number, has data by the write of operation information to data base
Storehouse is divided in a point of table of table sequence number.
Step 209: recalculate the user profile that ID is corresponding, and corresponding by recalculating the ID obtained
User profile write into Databasce in cover the user profile that original ID is corresponding.
Step 210: send to external cache and delete user's letter that instruction is corresponding to delete the ID in external cache
Cease and include the operation information of ID.
It addition, can also be in the configuration information write into Databasce that the operation object after updating is corresponding based on the present embodiment
After covering the configuration information that original operation object is corresponding, receive the notice that configuration information corresponding to operation object has updated,
Delete the configuration information that the operated object mark in internal memory is corresponding.
Inquiry operation information request, inquiry can also be received when user needs to inquire about operation information based on the present embodiment
Operation information request includes ID；Whether inquiry external cache exists the operation information including ID, if outward
There is the operation information including ID in portion's caching, from external cache, obtain the operation information including ID；As
External cache does not really exist the operation information including ID, from data base, reads the operation information including ID
And the operation information including ID is preserved to external cache.
So, the embodiment of the present invention uses external cache to cache user profile, use internal memory to infrequently revising
Configuration information cache, use from external cache obtain user profile, from internal memory obtain configuration information, complete behaviour
Make the operation of object, in a point of table of the operation information write into Databasce simultaneously operation produced, deposited by the classification of data
Storage reduces the read-write to data base, and uses data base to divide table raising data base to be inserted simultaneously into or the number of concurrent of more new data, from
And improve the processing speed and efficiency that operation object is operated, reach higher performance requirement.
Hereinafter, again as a example by the operation obtaining stage property in the application is the operation to operation object, the present invention is implemented
The data processing method provided in example realization in actual applications illustrates.
User sends the request of acquisition stage property by the interface in application program to server, and the request of this acquisition stage property is i.e.
For the request operating operation object, including ID and stage property mark in this request, stage property mark is behaviour
Make object identity.
After server receives ID and stage property mark, need to obtain the various information required for operation.According to
Whether stage property mark audit memory exists the configuration information that this stage property mark is corresponding, if it is, obtain configuration letter from internal memory
Breath, if it does not, automatically read configuration information and be again saved in server memory from the backup of data base.Mark according to user
Knowing and inquire about whether there is the user account information that this ID is corresponding from external cache, user account information is user's letter
Breath, if it is, obtain user account information, if it does not, automatically read user's account from the backup of data base from external cache
Family information is also saved in external cache again.
Server is according to conditions such as the stage property prices in the remaining sum in user account information, user gradation and configuration information
Judge whether user can obtain this stage property, if it is, the user profile that i.e. ID is corresponding is corresponding with operated object mark
Configuration information coupling, then obtain stage property operation success, then generate consumption pipelined data, consumption pipelined data be above-mentioned reality
Execute the operation information in example.Using ID to calculate the consumption pipelined data of this user according to certain Hash rule should
The data base deposited divides table sequence number, and is inserted in point table of this sequence number by consumption pipelined data.Meanwhile, acquisition stage property is calculated
Rear remaining remaining sum, updates user account information, and user account information is updated in data base.
When inserting consumption pipelined data in data base and updating user account information all successes, actively delete outside slow
User account information caching in depositing and consumption pipelined data caching, in order to next time can be automatically from data when user obtains stage property
Storehouse is read correct user account information and newly-increased consumption can be read from data base when inquiry consumption pipelined data
Pipelined data.
Furthermore it is also possible to consumption status code returns to after obtaining stage property success user, but consumption status code is successfully
Time, represent user and the most successfully obtain this stage property.
And when needs change configuration information (such as stage property price), operation personnel submit this stage property to server
Stage property mark and up-to-date configuration information, the configuration information of this stage property in server update data base, server will be joined by JMS
The notice that confidence breath has updated is pushed to all servers that can provide and obtain stage property operation, after server receives this notice
Actively delete the configuration information of this stage property preserved in internal memory, in order to when user obtains this stage property next time, each server energy
Up-to-date configuration information backup is read from data base.
So, the bar number of data base's inserted or updated data of same time can be improved by point table storage, commonly use but not
The configuration information often updated uses internal memory to replace external cache to cache, it is possible to reduce server because setting up socket band
Next resource consumption also shortens process operation required time, and it is up-to-date server can be made immediately to obtain by JMS real-time informing
Configuration information.
Shown in Figure 3, it is shown that the data processing equipment embodiment provided in the embodiment of the present invention, may include that
First acquiring unit 301, for obtaining the request operating operation object, operates operation object
Request includes ID and operated object mark.
Second acquisition unit 302, for inquiring about whether external cache exists the user profile that ID is corresponding, if
External cache exists the user profile that ID is corresponding, from external cache, obtains the user profile that ID is corresponding.
Whether the 3rd acquiring unit 303, exist the configuration information that operated object mark is corresponding in audit memory, if
Internal memory exists the configuration information that operated object mark is corresponding, from internal memory, obtains the configuration information that operated object mark is corresponding.
Signal generating unit 304, for when the user profile that ID the is corresponding configuration information corresponding with operated object mark
During coupling, operation object is operated and is generated the operation information including ID and operated object mark.
First writing unit 305, for by operation information write to a point of table of data base.
In some possible implementations of the present invention, the first writing unit can be specifically for:
Calculate data base according to ID and divide table sequence number, the write of operation information is had data base to data base and divides table sequence
Number a point of table in.
In some possible implementations of the present invention, the data processing equipment provided in the present embodiment may include that
Second writing unit, for recalculating the user profile that ID is corresponding, and will recalculate the use obtained
The user profile write into Databasce that family mark is corresponding covers the user profile that original ID is corresponding；
Transmitting element, deletes, for sending to external cache, the use that instruction is corresponding to delete the ID in external cache
Family information and include the operation information of ID.
In some possible implementations of the present invention, the data processing equipment provided in the present embodiment may include that
, if there is not the user profile that ID is corresponding, from data base in external cache in the 4th acquiring unit
User profile corresponding for ID is also preserved to external cache by user profile that middle reading ID is corresponding.
In some possible implementations of the present invention, the data processing equipment provided in the present embodiment may include that
First receives unit, covers former in the configuration information write into Databasce that the operation object after updating is corresponding
After operation configuration information corresponding to object begun, receive the notice that configuration information corresponding to operation object has updated；
Delete unit, for deleting the configuration information that the operated object mark in internal memory is corresponding.
In some possible implementations of the present invention, the data processing equipment provided in the present embodiment may include that
, if there is not the configuration information that operated object mark is corresponding, from data base in internal memory in the 5th acquiring unit
Configuration information corresponding for operated object mark is also preserved to internal memory by configuration information that middle read operation object identity is corresponding.
In some possible implementations of the present invention, the data processing equipment provided in the present embodiment may include that
Second receives unit, is used for receiving inquiry operation information request, and inquiry operation information request includes ID；
6th acquiring unit, for inquiring about whether there is the operation information including ID in external cache, if outward
There is the operation information including ID in portion's caching, from external cache, obtain the operation information including ID；As
External cache does not really exist the operation information including ID, from data base, reads the operation information including ID
And the operation information including ID is preserved to external cache.
So, the embodiment of the present invention uses external cache to cache user profile, use internal memory to infrequently revising
Configuration information cache, use from external cache obtain user profile, from internal memory obtain configuration information, complete behaviour
Make the operation of object, in a point of table of the operation information write into Databasce simultaneously operation produced, deposited by the classification of data
Storage reduces the read-write to data base, and uses data base to divide table raising data base to be inserted simultaneously into or the number of concurrent of more new data, from
And improve the processing speed and efficiency that operation object is operated, reach higher performance requirement.
It should be noted that each embodiment uses the mode gone forward one by one to describe in this specification, each embodiment emphasis is said
Bright is all the difference with other embodiments, and between each embodiment, identical similar portion sees mutually.For reality
For executing system disclosed in example or device, owing to it corresponds to the method disclosed in Example, so describe is fairly simple, phase
See method part in place of pass to illustrate.
Also, it should be noted in this article, the relational terms of such as first and second or the like is used merely to one
Entity or operation separate with another entity or operating space, and not necessarily require or imply between these entities or operation
There is relation or the order of any this reality.And, term " includes ", " comprising " or its any other variant are intended to contain
Comprising of lid nonexcludability, so that include that the process of a series of key element, method, article or equipment not only include that those are wanted
Element, but also include other key elements being not expressly set out, or also include for this process, method, article or equipment
Intrinsic key element.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that
Including process, method, article or the equipment of described key element there is also other identical element.
The method described in conjunction with the embodiments described herein or the step of algorithm can direct hardware, processor be held
The software module of row, or the combination of the two implements.Software module can be placed in random access memory (RAM), internal memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, depositor, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
Described above to the disclosed embodiments, makes professional and technical personnel in the field be capable of or uses the present invention.
Multiple amendment to these embodiments will be apparent from for those skilled in the art, as defined herein
General Principle can realize without departing from the spirit or scope of the present invention in other embodiments.Therefore, the present invention
It is not intended to be limited to the embodiments shown herein, and is to fit to and principles disclosed herein and features of novelty phase one
The widest scope caused.
Claims (14)
1. a data processing method, it is characterised in that described method includes:
Obtain the operation request that operates of object, the described request that operation object is operated include ID with
And operated object mark；
Whether inquiry external cache exists the user profile that described ID is corresponding, if there is institute in described external cache
State the user profile that ID is corresponding, from described external cache, obtain the user profile that described ID is corresponding；
Whether audit memory exists the configuration information that described operated object mark is corresponding, if described internal memory exists described behaviour
Make the configuration information that object identity is corresponding, from described internal memory, obtain the configuration information that described operated object mark is corresponding；
When the configuration information corresponding with described operated object mark when the user profile that described ID is corresponding mates, to described
Operation object carries out operating and generate the operation information including described ID and described operated object mark；
By in described operation information write to a point of table of data base.
Method the most according to claim 1, it is characterised in that described by one of described operation information write to data base
Divide in table, including:
Calculate data base according to described ID and divide table sequence number, the write of described operation information is had described data to data base
Storehouse is divided in a point of table of table sequence number.
Method the most according to claim 1, it is characterised in that described described operation object is operated after, institute
Method of stating also includes:
Recalculate the user profile that described ID is corresponding, and the use corresponding by recalculating the described ID obtained
Family information writes in described data base and covers the user profile that original described ID is corresponding；
Send to described external cache and delete user's letter that instruction is corresponding to delete the described ID in described external cache
Breath and described in include the operation information of described ID.
4. according to the method described in claim 1 or 3, it is characterised in that whether exist described in described inquiry external cache
After the user profile that ID is corresponding, described method also includes:
If described external cache does not exist the user profile that described ID is corresponding, read described from described data base
User profile corresponding for described ID is also preserved to described external cache by user profile that ID is corresponding.
Method the most according to claim 1, it is characterised in that described method also includes:
Configuration information corresponding to described operation object after updating writes in described data base and covers original described operation
After the configuration information that object is corresponding, receive the notice that configuration information corresponding to described operation object has updated；
Delete the configuration information that the described operated object mark in described internal memory is corresponding.
Method the most according to claim 1 or 5, it is characterised in that whether there is described operation in described audit memory
After the configuration information that object identity is corresponding, described method also includes:
If described internal memory does not exist the configuration information that described operated object mark is corresponding, read described from described data base
Configuration information corresponding for described operated object mark is also preserved to described internal memory by configuration information that operated object mark is corresponding.
7. according to the method described in claim 1 or 3, it is characterised in that described method also includes:
Receiving inquiry operation information request, described inquiry operation information request includes ID；
Inquire about and whether described external cache exists the operation information including described ID, if described external cache is deposited
In the described operation information including described ID, from described external cache, described in acquisition, include the behaviour of described ID
Make information；If including the operation information of described ID described in described external cache does not exist, from described data base
Include the operation information of described ID described in reading and the described operation information including described ID is preserved to institute
State in external cache.
8. a data processing equipment, it is characterised in that described device includes:
First acquiring unit, for obtaining the request that operation object is operated, described to asking that operation object operates
Ask and include ID and operated object mark；
Second acquisition unit, for inquiring about whether external cache exists the user profile that described ID is corresponding, if institute
State and external cache exists the user profile that described ID is corresponding, from described external cache, obtain described ID pair
The user profile answered；
Whether the 3rd acquiring unit, exist the configuration information that described operated object mark is corresponding in audit memory, if institute
State and internal memory exists the configuration information that described operated object mark is corresponding, from described internal memory, obtain described operated object mark pair
The configuration information answered；
Signal generating unit, for when the user profile that described ID the is corresponding configuration information corresponding with described operated object mark
During coupling, described operation object is operated and generates include described ID and the operation of described operated object mark
Information；
First writing unit, for by described operation information write to a point of table of data base.
Device the most according to claim 8, it is characterised in that described first writing unit specifically for:
Calculate data base according to described ID and divide table sequence number, the write of described operation information is had described data to data base
Storehouse is divided in a point of table of table sequence number.
Device the most according to claim 8, it is characterised in that described device also includes:
Second writing unit, for recalculating the user profile that described ID is corresponding, and will recalculate the institute obtained
State in the user profile described data base of write that ID is corresponding and cover the user profile that original described ID is corresponding；
Transmitting element, deletes instruction to delete the described ID in described external cache for sending to described external cache
Corresponding user profile and described in include the operation information of described ID.
Device described in 11. according to Claim 8 or 10, it is characterised in that described device also includes:
, if there is not the user profile that described ID is corresponding, from institute in described external cache in the 4th acquiring unit
State and data base reads user profile corresponding to described ID and user profile corresponding for described ID is preserved extremely
In described external cache.
12. devices according to claim 8, it is characterised in that described device also includes:
First receives unit, writes in described data base for the configuration information that the described operation object after updating is corresponding and covers
After covering the configuration information that original described operation object is corresponding, receive what configuration information corresponding to described operation object had updated
Notice；
Delete unit, for deleting the configuration information that the described operated object mark in described internal memory is corresponding.
Device described in 13. according to Claim 8 or 12, it is characterised in that described device also includes:
, if there is not the configuration information that described operated object mark is corresponding, from institute in described internal memory in the 5th acquiring unit
State and data base reads configuration information corresponding to described operated object mark and by configuration letter corresponding for described operated object mark
Breath preserves to described internal memory.
Device described in 14. according to Claim 8 or 10, it is characterised in that described device also includes:
Second receives unit, is used for receiving inquiry operation information request, and described inquiry operation information request includes ID；
6th acquiring unit, for inquiring about whether described external cache exists the operation information including described ID, as
Include the operation information of described ID described in the most described external cache exists, from described external cache, obtain described bag
Include the operation information of described ID；If including the operation letter of described ID described in described external cache does not exist
Breath, read from described data base described in include the operation information of described ID and include described ID by described
Operation information preserves to described external cache.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610899295.XA CN106326499B (en) | 2016-10-14 | 2016-10-14 | A kind of data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610899295.XA CN106326499B (en) | 2016-10-14 | 2016-10-14 | A kind of data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106326499A true CN106326499A (en) | 2017-01-11 |
| CN106326499B CN106326499B (en) | 2019-10-18 |
Family
ID=57817743
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610899295.XA Active CN106326499B (en) | 2016-10-14 | 2016-10-14 | A kind of data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106326499B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106919683A (en) * | 2017-03-02 | 2017-07-04 | 惠州市亿能电子有限公司 | A kind of method and functional module of quick search data |
| CN108563697A (en) * | 2018-03-22 | 2018-09-21 | 腾讯科技（深圳）有限公司 | A kind of data processing method, device and storage medium |
| CN108768859A (en) * | 2018-05-17 | 2018-11-06 | 迈普通信技术股份有限公司 | Data processing method, apparatus and system |
| CN109660570A (en) * | 2017-10-10 | 2019-04-19 | 武汉斗鱼网络科技有限公司 | Low discharge high real-time stage property distribution method, storage medium, equipment and system |
| CN109800229A (en) * | 2018-12-29 | 2019-05-24 | 深圳云天励飞技术有限公司 | Data access method and relevant device |
| CN110516061A (en) * | 2019-07-24 | 2019-11-29 | 视联动力信息技术股份有限公司 | A kind of data processing method, device and computer readable storage medium |
| CN111787416A (en) * | 2020-05-21 | 2020-10-16 | 视联动力信息技术股份有限公司 | Data packet processing method and device and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101178693A (en) * | 2007-12-14 | 2008-05-14 | 沈阳东软软件股份有限公司 | Data cache method and system |
| CN102332007A (en) * | 2011-08-06 | 2012-01-25 | 浪潮电子信息产业股份有限公司 | Cache-server hardware configuration system for enhancing hit ratio of file access |
| CN102722405A (en) * | 2012-06-06 | 2012-10-10 | 新浪网技术(中国)有限公司 | Counting method in high concurrent and multithreaded application and system |
| CN104504158A (en) * | 2015-01-19 | 2015-04-08 | 浪潮(北京)电子信息产业有限公司 | Memory caching method and device for rapidly updating business |
-
2016
- 2016-10-14 CN CN201610899295.XA patent/CN106326499B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101178693A (en) * | 2007-12-14 | 2008-05-14 | 沈阳东软软件股份有限公司 | Data cache method and system |
| CN102332007A (en) * | 2011-08-06 | 2012-01-25 | 浪潮电子信息产业股份有限公司 | Cache-server hardware configuration system for enhancing hit ratio of file access |
| CN102722405A (en) * | 2012-06-06 | 2012-10-10 | 新浪网技术(中国)有限公司 | Counting method in high concurrent and multithreaded application and system |
| CN104504158A (en) * | 2015-01-19 | 2015-04-08 | 浪潮(北京)电子信息产业有限公司 | Memory caching method and device for rapidly updating business |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106919683A (en) * | 2017-03-02 | 2017-07-04 | 惠州市亿能电子有限公司 | A kind of method and functional module of quick search data |
| CN106919683B (en) * | 2017-03-02 | 2020-04-28 | 惠州市亿能电子有限公司 | Method and system for quickly querying data |
| CN109660570A (en) * | 2017-10-10 | 2019-04-19 | 武汉斗鱼网络科技有限公司 | Low discharge high real-time stage property distribution method, storage medium, equipment and system |
| CN108563697A (en) * | 2018-03-22 | 2018-09-21 | 腾讯科技（深圳）有限公司 | A kind of data processing method, device and storage medium |
| CN108768859A (en) * | 2018-05-17 | 2018-11-06 | 迈普通信技术股份有限公司 | Data processing method, apparatus and system |
| CN108768859B (en) * | 2018-05-17 | 2021-05-25 | 迈普通信技术股份有限公司 | Data processing method, device and system |
| CN109800229A (en) * | 2018-12-29 | 2019-05-24 | 深圳云天励飞技术有限公司 | Data access method and relevant device |
| CN109800229B (en) * | 2018-12-29 | 2021-10-08 | 深圳云天励飞技术有限公司 | Data access method and related equipment |
| CN110516061A (en) * | 2019-07-24 | 2019-11-29 | 视联动力信息技术股份有限公司 | A kind of data processing method, device and computer readable storage medium |
| CN111787416A (en) * | 2020-05-21 | 2020-10-16 | 视联动力信息技术股份有限公司 | Data packet processing method and device and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106326499B (en) | 2019-10-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106326499A (en) | Data processing method and device | |
| US10459978B2 (en) | Distributed graph processing system that support remote data read with proactive bulk data transfer | |
| US9639468B2 (en) | Temporal clones to identify valid items from a set of items | |
| CN103678556B (en) | The method and processing equipment of columnar database processing | |
| CN104657483B (en) | Handle method, processing node, Centroid and the cluster of affairs | |
| CN103312624B (en) | A kind of Message Queuing Services system and method | |
| CN111340470B (en) | Block chain transaction processing method, node and contract container | |
| CN102609488B (en) | Client, data query method of client, server and data query system | |
| CN106156070B (en) | A kind of querying method, file mergences method and relevant apparatus | |
| CN108196879A (en) | Method for processing business, device, equipment and computer readable storage medium | |
| JP2021502655A (en) | Data query | |
| CN104423982B (en) | The processing method and processing equipment of request | |
| CN105701112A (en) | Data processing method, apparatus and system | |
| CN102902763B (en) | The method of association, retrieving information process data and process information task and device | |
| CN110196847A (en) | Data processing method and device, storage medium and electronic device | |
| CN108932286B (en) | Data query method and device | |
| US8380663B2 (en) | Data integrity in a database environment through background synchronization | |
| CN104301233A (en) | Route access method, route access system and user terminal | |
| WO2019100853A1 (en) | Page query method, device, and electronic apparatus | |
| CN107665255A (en) | Method, apparatus, equipment and the storage medium of key value database data change | |
| CN110008738A (en) | For the caching method of block chain contract data, device, medium and calculate equipment | |
| CN102360389A (en) | Method for implementing data set specific management policies with respect to data | |
| CN109727030A (en) | Account data storage method in a kind of block chain | |
| CN104616354A (en) | Method for quickly loading space data through three-dimensional GIS (global information system) | |
| CN102819570B (en) | A kind of data access method, Apparatus and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |