CN101087333B - A processing method of large-capacity user information - Google Patents
A processing method of large-capacity user information Download PDFInfo
- Publication number
- CN101087333B CN101087333B CN2006100275635A CN200610027563A CN101087333B CN 101087333 B CN101087333 B CN 101087333B CN 2006100275635 A CN2006100275635 A CN 2006100275635A CN 200610027563 A CN200610027563 A CN 200610027563A CN 101087333 B CN101087333 B CN 101087333B
- Authority
- CN
- China
- Prior art keywords
- carried out
- subscription
- state
- request
- quitting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to process method of big volume user information, the method uses serial recording mode to record user information and change of state, and update database termly; the inquiring request which is before updating database, the correct inquiring result can be obtained by the pretreatment operation. Comparing with current technique, the invention decreases the load of database, in time of user information can be guaranteed, efficiency of inquiring of user information is increased.
Description
Technical field
The present invention relates to the disposal route of user profile in the mobile communication, particularly relate to a kind of process method of big volume.
Background technology
Along with the fast development of mobile value-added service, number of users also progressively increases.In the process of developing value-added services user management, because number of users very huge (in several hundred million ranks), the variation of user profile is very frequent, promptly and accurately provide user profile to become a difficult problem based on Large Volume Data.Because uncertainty and user inquiring information that user profile changes get uncertain; Carry out the modification of database physical store if respond the User Status variation at any time; May cause database update very frequent; And because data volume is very huge, database update can bring great load.If but how untimely modification user profile guarantees user's the consistent difficult problem that just becomes with real data of Query Result.
The management of user profile is mainly concerned with following several aspect:
The user profile storage is stored in the database; The user profile change comprises increase, deletion, modification etc.Need make amendment to user profile in the database; The user profile inquiry is returned user related information according to specified requirements.
Suppose that there are 100,000,000 user profile in certain system now, traditional way is when user's information-change is arranged, just in time to carry out database manipulation.Use the state of a certain service to become inertia like certain user, so just need in more than one hundred million records, seek this relevant content, carry out database UPDATE operation then by activity.Because the data measurer is big, the content of Search and Orientation appointment is consumption of natural resource very, and carries out having relevant data base set irrespectives of size such as index upgrade operation behind the content update and also can consume ample resources.The variation time of occurrence of user state information is unfixing; Possibly in certain long duration section, have no variation; Also having a large amount of variations concentrated in certain short time period; Can cause database loads very unbalanced like this, can cause database overload in testing laboratory's environment under the extreme case and can't operate as normal.
Summary of the invention
The objective of the invention is provides a kind of process method of big volume for the defective that overcomes above-mentioned prior art existence.
The object of the invention can be realized through following technical scheme: a kind of process method of big volume is characterized in that this method is carried out record through the Flow Record mode to the change of user profile and User Status, and regularly concentrates the storehouse that Updates Information; The query requests that before regularly concentrating the storehouse that Updates Information, takes place obtains correct Query Result through the Query Result pretreatment operation.
Described Flow Record mode is: the corresponding alter operation that takes place recently, generating a new data-base recording is Flow Record, and is inserted in the database table.
Described Query Result pretreatment operation is: Flow Record is sorted according to the time order and function order, and according to the time order and function order, Flow Record is carried out state-transition, obtain end-state.
Described state-transition is:
Carried out customized operation, end-state is customized state;
At first carried out customized operation, carried out the request of quitting the subscription of then, end-state is quit the subscription of affirmation for waiting for;
At first carried out customized operation, carried out the request of quitting the subscription of then, carried out the request of quitting the subscription of that repeats then, end-state is quit the subscription of affirmation for waiting for;
At first carried out customized operation, carried out the request of quitting the subscription of then, carried out illegal subscribe request then, end-state is quit the subscription of affirmation for waiting for;
At first carried out customized operation, carried out the request of quitting the subscription of then, carried out the request of quitting the subscription of then again, end-state is for quitting the subscription of state;
At first carried out customized operation, carried out the request of quitting the subscription of then, end-state is quit the subscription of affirmation for waiting for.
This method is regularly cleared up the data in the database through the mode of writing database store process, deletes unnecessary junk data.
This method is regularly cleared up the data in the database through the mode of writing database store process, deletes unnecessary junk data.
Compared with prior art, the present invention has reduced most resource consumption owing to reduced overall search operation; The resource fundamental sum UPDATE class of operation that the system level operation such as database index variation that the insertion operation brings consume seemingly; The variation of user profile is described through the mode that generates new record like this; Reduced by 70% Database Systems consumption; Also just reduce the load of database update, guaranteed the promptness of user profile simultaneously again, improved the efficient of user profile inquiry.
Description of drawings
Fig. 1 is a state transition diagram of the present invention.
Embodiment
As shown in Figure 1, a kind of process method of big volume, this method is carried out record through the Flow Record mode to the change of user profile and User Status, and regularly concentrates the storehouse that Updates Information; The query requests that before regularly concentrating the storehouse that Updates Information, takes place obtains correct Query Result through the Query Result pretreatment operation.
Present embodiment at first goes into to write database with the Flow Record of the variation of user profile and User Status, regularly carries out the state Unified Treatment of data then.The search request that before user profile is unified, takes place, its Query Result is through handling when showing to guarantee result's correctness.This method has effectively reduced the database access number of times, has improved the efficient of user profile inquiry.
For the load that reduces database update can guarantee the promptness of user profile simultaneously again, present embodiment has adopted the mode of regularly concentrating the storehouse that Updates Information in conjunction with the pretreated method of Query Result, has effectively solved a Query Result difficult problem consistent with real data.
For solving the problem of database overload, present embodiment has designed a kind of mode of Flow Record and has carried out the record that user profile changes.Use the state of a certain service to become inertia like certain user, then generate a new data-base recording and be inserted in the database table to write down the alter operation of nearest generation by activity.Owing to reduced overall search operation, reduced most resource consumption.The resource fundamental sum UPDATE class of operation that the system level operation such as database index variation that the insertion operation brings consume seemingly.Describe the variation of user profile like this through the mode that generates new record, reduced by 70% Database Systems consumption.
Increased after the Flow Record, database loads is effectively reduced, but brings two new problems simultaneously:
A. each user uses the status information of a certain service to be described by many data-base recordings, and end-state can't be confirmed, final user state information can not be provided.
B. along with the continuous increase of Flow Record, the database table scale does not stop to increase, and need regularly clear up.
For addressing the above problem, increased following algorithm:
When carrying out the user state information inquiry, return all information that all these users use a certain business.This is comprising all Flow Records of user profile, then according to the dynamic interim final user profile that generates of all information of Flow Record.Because user profile change comprises order business, quit the subscription of business, quit the subscription of operation such as professional affirmations, with regard to more complicated, adopt following algorithm to carry out based on the process of Flow Record generation final result:
A, at first the Flow Record with this user profile sorts according to the time order and function order, has reflected the sequencing of user profile change.
B, according to the time order and function order, the Flow Record that user profile is changed carries out state-transition according to following state transition diagram, obtains end-state.
Process shown in Figure 1 is following:
(1) carried out the user and ordered operation, final user's state is a subscription status.
(2) at first carried out user's order, carried out the user then and quit the subscription of professional request, end-state is quit the subscription of affirmation for waiting for.
(3) at first carried out user's order, carried out the user then and quit the subscription of professional request, carried out the service request of quitting the subscription of of repetition then, end-state is quit the subscription of affirmation for waiting for.
(4) at first carried out user's order, carried out the user then and quit the subscription of professional request, carried out illegal subscription services request then, end-state is quit the subscription of affirmation for waiting for.
(5) at first carried out user's order, carried out the user then and quit the subscription of professional request, carried out the service unsubscription request then, end-state is that business is quit the subscription of.
(6) at first carried out user's order, carried out customer service then and quit the subscription of operation, end-state is quit the subscription of affirmation for waiting for.
Present embodiment adopts the mode of writing database store process regularly the content in the database to be cleared up, and deletes unnecessary junk data, reduces table length.Can the database redirection activity be focused on, improve the efficient of data base manipulation.
Claims (3)
1. a process method of big volume is characterized in that, this method is carried out record through the Flow Record mode to the change of user profile and User Status, and regularly concentrates the storehouse that Updates Information; The query requests that before regularly concentrating the storehouse that Updates Information, takes place obtains correct Query Result through the Query Result pretreatment operation; Described Flow Record mode is: the corresponding alter operation that takes place recently, and generating a new data-base recording is Flow Record, and is inserted in the database table;
Described Query Result pretreatment operation is: Flow Record is sorted according to the time order and function order, and according to the time order and function order, Flow Record is carried out state-transition, obtain end-state.
2. a kind of process method of big volume according to claim 1 is characterized in that, described state-transition is:
Carried out customized operation, end-state is customized state;
At first carried out customized operation, carried out the request of quitting the subscription of then, end-state is quit the subscription of affirmation for waiting for;
At first carried out customized operation, carried out the request of quitting the subscription of then, carried out the request of quitting the subscription of that repeats then, end-state is quit the subscription of affirmation for waiting for;
At first carried out customized operation, carried out the request of quitting the subscription of then, carried out illegal subscribe request then, end-state is quit the subscription of affirmation for waiting for;
At first carried out customized operation, carried out the request of quitting the subscription of then, carried out the request of quitting the subscription of then again, end-state is for quitting the subscription of state;
At first carried out customized operation, carried out the request of quitting the subscription of then, end-state is quit the subscription of affirmation for waiting for.
3. a kind of process method of big volume according to claim 1 is characterized in that, this method is regularly cleared up the data in the database through the mode of writing database store process, deletes unnecessary junk data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006100275635A CN101087333B (en) | 2006-06-11 | 2006-06-11 | A processing method of large-capacity user information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006100275635A CN101087333B (en) | 2006-06-11 | 2006-06-11 | A processing method of large-capacity user information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101087333A CN101087333A (en) | 2007-12-12 |
| CN101087333B true CN101087333B (en) | 2012-06-13 |
Family
ID=38938083
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006100275635A Active CN101087333B (en) | 2006-06-11 | 2006-06-11 | A processing method of large-capacity user information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101087333B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1493998A (en) * | 2002-10-29 | 2004-05-05 | ��ʿͨ��ʽ���� | Information updating apparatus and its method, and recording medium for recording information updating program |
| CN1595928A (en) * | 2003-09-12 | 2005-03-16 | 华为技术有限公司 | A method for updating network equipment data information |
-
2006
- 2006-06-11 CN CN2006100275635A patent/CN101087333B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1493998A (en) * | 2002-10-29 | 2004-05-05 | ��ʿͨ��ʽ���� | Information updating apparatus and its method, and recording medium for recording information updating program |
| CN1595928A (en) * | 2003-09-12 | 2005-03-16 | 华为技术有限公司 | A method for updating network equipment data information |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101087333A (en) | 2007-12-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108874971B (en) | Tool and method applied to mass tagged entity data storage | |
| CN100468402C (en) | Sort data storage and split catalog inquiry method based on catalog tree | |
| CN100504869C (en) | Information co-sharing systems and methods for managing electronic information | |
| CN101840400B (en) | Multilevel classification retrieval method and system | |
| US20090254594A1 (en) | Techniques to enhance database performance | |
| CN103020255A (en) | Hierarchical storage method and hierarchical storage device | |
| CN104021198A (en) | Relational database information retrieval method and device based on ontology semantic index | |
| CN103488702A (en) | SorlCloud based unstructured data retrieval method and system | |
| CN101963993B (en) | Method for fast searching database sheet table record | |
| CN116361487A (en) | Multi-source heterogeneous policy knowledge graph construction and storage method and system | |
| CN114860727A (en) | Zipper watch updating method and device | |
| CN108984626B (en) | Data processing method and device and server | |
| CN104794567B (en) | A kind of Infectious Diseases Data management method based on HBase | |
| CN108763562A (en) | A kind of construction method based on big data skill upgrading data exchange efficiency | |
| CN103543959A (en) | Method and device for mass data caching | |
| CN104391947A (en) | Real-time processing method and system of mass GIS (geographic information system) data | |
| CN104834663A (en) | Full-text retrieval system facing optical disc library | |
| US8660974B2 (en) | Inference over semantic network with some links omitted from indexes | |
| CN101087333B (en) | A processing method of large-capacity user information | |
| CN103714121A (en) | Index record management method and device | |
| CN200976656Y (en) | Novel large-capacity user information processing system | |
| CN101719159A (en) | Data management method and device | |
| CN101588455B (en) | Topicalization receiving and recording system of media material | |
| CN104834664A (en) | Optical disc juke-box oriented full text retrieval system | |
| CN112685557A (en) | Visualized information resource management method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |