CN109144992A - A kind of method and apparatus of data storage - Google Patents

A kind of method and apparatus of data storage Download PDF

Info

Publication number
CN109144992A
CN109144992A CN201710451809.XA CN201710451809A CN109144992A CN 109144992 A CN109144992 A CN 109144992A CN 201710451809 A CN201710451809 A CN 201710451809A CN 109144992 A CN109144992 A CN 109144992A
Authority
CN
China
Prior art keywords
stored
data
information
caching
characteristic information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710451809.XA
Other languages
Chinese (zh)
Inventor
年静
钱雪娣
罗达
许丹丹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN201710451809.XA priority Critical patent/CN109144992A/en
Publication of CN109144992A publication Critical patent/CN109144992A/en
Pending legal-status Critical Current

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses the method and apparatus of data storage, are related to field of computer technology.One specific embodiment of this method includes: to store data to be stored into caching;Message queue is added in the characteristic information of the data to be stored;The characteristic information is obtained from the message queue using the first process, and is searched data to be stored corresponding with the characteristic information and then stored into database.The embodiment can be improved data rate memory, promote the robustness of storage system.

Description

A kind of method and apparatus of data storage
Technical field
The present invention relates to the method and apparatus that field of computer technology more particularly to a kind of data store.
Background technique
It obtains the data that user provides and carries out storing this process and be widely used in many business scenarios, for example, It needs to obtain the registration informations such as the account name, password and mailbox of user in Account Registration, is stored so as to as offer The foundation of service;The comment information for needing to obtain user when acquiring and commenting on, is stored to show in corresponding review pages Face;In the personal information for carrying out needing to obtain user when personal information registration, stored in order to inquiring and authenticating.
The data that the scheme of the prior art directly provides user are stored into database, be in the operation of write-in database These data can be called after success, and save successfully prompt to user feedback data.
In realizing process of the present invention, at least there are the following problems in the prior art for inventor's discovery: existing data are deposited Method for storing has extremely strong dependence for the writing speed of database, and data need to write direct in database;On the one hand, exist Under the high concurrent state that multi-user stores simultaneously, the writing speed of database is unable to satisfy demand, cause to occur it is waiting for a long time, The problem of poor user experience or even data storage failure;On the other hand, the strong of storage system is led to for the dependence of database Strong property is poor, will affect the normal operation of storage system if database goes wrong, or even the accident of loss of data occurs.
Summary of the invention
In view of this, the embodiment of the present invention provides a kind of method and apparatus of data storage, data storage speed can be improved Degree, promotes the robustness of storage system.
To achieve the above object, according to an aspect of an embodiment of the present invention, a kind of method of data storage, packet are provided It includes:
Data to be stored is stored into caching;
Message queue is added in the characteristic information of the data to be stored;
The characteristic information is obtained from the message queue using the first process, and is searched and the characteristic information pair Then the data to be stored answered is stored into database.
Optionally, the data to be stored is equipped with status indication;The method also includes:
It after the step of obtaining the characteristic information in the message queue, is determined and the feature using the first process The status indication of the corresponding data to be stored of information is not synchronize;And
After searching then step that data to be stored corresponding with the characteristic information is stored into database, by the shape State label is to have synchronized by non-synchronous vacations.
Optionally, the method also includes:
After data to be stored is stored the step into caching, using described in the second procedure retrieval caching in described in wait deposit Data are stored up, are that the not synchronous data to be stored is stored into the database by status indication.
Optionally, the method also includes:
After the step of message queue is added in the characteristic information of the data to be stored, searches and exist in the caching Duration is greater than duration threshold value and status indication is the data to be stored synchronized and then is deleted from the caching.
Optionally, the method also includes:
Before the step of obtaining the characteristic information in the message queue, determining there is new feature using the first process Information is added into the message queue, and determines that first process is idle.
Optionally, the method also includes:
After data to be stored to be stored to the step into caching, if it is determined that the data to be stored is not deposited successfully Storage then stores the data to be stored into the database to the caching.
Optionally, the method also includes:
Before data to be stored to be stored to the step into caching, the every terms of information stored as needed generates structuring number Data to be stored is obtained accordingly;And
Data to be stored, which is stored the step into caching, includes:
The data to be stored is parsed to obtain the every terms of information for needing to store, and the every terms of information is stored respectively In corresponding data table into caching;
Searching then step that data to be stored corresponding with the characteristic information is stored into database includes:
Data to be stored corresponding with the characteristic information is searched, parses the data to be stored then to obtain needing depositing The every terms of information of storage, and the every terms of information is stored respectively in the corresponding data table into database.
Optionally, it is described to it is data cached include registration information and/or relevant information;The registration information includes user At least one of in name, password, the pet name, mobile phone and mailbox, the relevant information includes handset binding state, mailbox binding shape At least one of in state, unbundlings user name, grade, source, registion time and registration IP;The caching is that Redis is cached.
To achieve the above object, other side according to an embodiment of the present invention provides a kind of device of data storage, Include:
Cache memory module, for storing data to be stored into caching;
Message adding module, for message queue to be added in the characteristic information of the data to be stored;
First synchronization module, for using the first process to obtain the characteristic information, Yi Jicha from the message queue Data to be stored corresponding with the characteristic information is looked for then to store into database.
Optionally, the data to be stored is equipped with status indication;
First synchronization module is also used to determine that the status indication of data to be stored corresponding with the characteristic information is It does not synchronize;And after searching data to be stored corresponding with the characteristic information and then storing into database, by the state Label is to have synchronized by non-synchronous vacations.
Optionally, described device further include:
Status indication is not synchronous for retrieving the data to be stored in the caching by the second synchronization module The data to be stored is stored into the database.
Optionally, described device further include:
Removing module, length is greater than duration threshold value in the presence of for searching in the caching and status indication is to have synchronized Then the data to be stored is deleted from the caching.
Optionally, first synchronization module is also used to, described in being obtained from the message queue using the first process Before characteristic information, determining has new characteristic information to be added into the message queue, and determines that first process is idle.
Optionally, described device further include:
Cache memory module, for if it is determined that the data to be stored is not successfully stored to the caching, then will The data to be stored is stored into the database.
Optionally, described device further include:
Data Integration module, the every terms of information for storing as needed generate structural data to obtain number to be stored According to;
The cache memory module is also used to parse the data to be stored to obtain the every terms of information for needing to store, and The every terms of information is stored respectively in the corresponding data table into caching;
First synchronization module is also used to search data to be stored corresponding with the characteristic information, then described in parsing Data to be stored stores the correspondence into database to obtain the every terms of information for needing to store, and by the every terms of information respectively In tables of data.
Optionally, it is described to it is data cached include registration information and/or relevant information;The registration information includes user At least one of in name, password, the pet name, mobile phone and mailbox, the relevant information includes handset binding state, mailbox binding shape At least one of in state, unbundlings user name, grade, source, registion time and registration IP;The caching is that Redis is cached.
To achieve the above object, another aspect according to an embodiment of the present invention provides a kind of electronics of data storage Equipment, comprising:
One or more processors;
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processing Device is at least realized:
Data to be stored is stored into caching;
Message queue is added in the characteristic information of the data to be stored;
The characteristic information is obtained from the message queue using the first process, and is searched and the characteristic information pair Then the data to be stored answered is stored into database.
To achieve the above object, another aspect according to an embodiment of the present invention provides a kind of computer-readable medium, On be stored with computer program, at least realized when described program is executed by processor:
Data to be stored is stored into caching;
Message queue is added in the characteristic information of the data to be stored;
The characteristic information is obtained from the message queue using the first process, and is searched and the characteristic information pair Then the data to be stored answered is stored into database.
One embodiment in foregoing invention has the following advantages that or the utility model has the advantages that because uses data to be stored head It first stores to caching, is then gradually stored data to be stored using distributed process to the technological means of database, one side Using the high read or write speed of caching, reduce be reflected in user side data storage it is time-consuming, improve user experience, and can be with The problems such as avoiding the data exception and storage failure under the conditions of high concurrent, has reached the technology effect for improving data rate memory Fruit increases the form of data storage, is gone by this on the other hand by the secondary storage structure of setting caching and database The mode of coupling improves data storage efficiency, even if the either side in caching and database goes wrong, can also repair Another party is relied on during multiple and exercises normal store function, has reached the technical effect for improving system robustness.
Further effect possessed by above-mentioned non-usual optional way adds hereinafter in conjunction with specific embodiment With explanation.
Detailed description of the invention
Attached drawing for a better understanding of the present invention, does not constitute an undue limitation on the present invention.Wherein:
Fig. 1 is the schematic diagram of the key step of the method for data storage according to an embodiment of the present invention;
Fig. 2 be the embodiment of the present invention data storage method be applied to user's registration scene when key step signal Figure;
Fig. 3 is the schematic diagram of the main modular of the device of data storage according to an embodiment of the present invention;
Fig. 4 is that the embodiment of the present invention can be applied to exemplary system architecture figure therein;
Fig. 5 is adapted for the structural representation of the computer system for the terminal device or server of realizing the embodiment of the present invention Figure.
Specific embodiment
Below in conjunction with attached drawing, an exemplary embodiment of the present invention will be described, including the various of the embodiment of the present invention Details should think them only exemplary to help understanding.Therefore, those of ordinary skill in the art should recognize It arrives, it can be with various changes and modifications are made to the embodiments described herein, without departing from scope and spirit of the present invention.Together Sample, for clarity and conciseness, descriptions of well-known functions and structures are omitted from the following description.
Fig. 1 is the schematic diagram of the key step of the method for data storage according to an embodiment of the present invention.
As shown in Figure 1, a kind of method of data storage provided according to an embodiment of the present invention, comprising:
S10 stores data to be stored into caching.Data to be stored is to be stored and not yet stored to data Data in library, this step store data to be stored first into caching, are higher than database using the writing speed of caching The characteristics of writing speed, improves the speed of data storage;After data to be stored is stored into caching, it can be checked or be adjusted With, therefore it is presented as that data have been stored in user side, to substantially increase the corresponding speed of business, shorten user's Waiting time promotes user experience.
Message queue is added in the characteristic information of the data to be stored by S11.The characteristic information of data to be stored be with to The unique corresponding information of storing data can uniquely retrieve corresponding data to be stored by characteristic information. Characteristic information can be one/several information in data to be stored, be also possible to that other are obtained by certain way with to The unique corresponding information of storing data;For example, Hash operation can be carried out to data to be stored to obtain condition code, with this feature Code is used as key, key-value pair storage is carried out using data to be stored as value, at this time then using this feature code as the characteristic information.Disappear Breath queue is the queue of a first in, first out formula, for storing characteristic information, so that characteristic information is performed process as task (such as first process and the second process hereinafter) is extracted to complete.
S12 obtains the characteristic information using the first process from the message queue, and searches and believe with the feature It ceases corresponding data to be stored and then stores into database.First process be distinguish in this present embodiment execute step S10 and Another distributed process of the system process of S11, i.e. system process can constantly repeat step S10 and S11, constantly will be wait deposit Storage data store to caching and add task in message queue, and the first process is then triggered under certain condition, with system process Then asynchronous operation gets characteristic information from message queue and executes corresponding data store tasks.It should be noted that institute Stating database is the database using traditional magnetic hard-disk or solid state hard disk as storage medium.
The condition that first process is triggered, which can be, detects that message queue and the first process is added in new characteristic information It is idle;After first process is triggered, the progress of one or more features information can be disposably taken out according to the sequence of message queue Processing will not trigger the first process and take again during the treatment if there is new characteristic information that message queue is added again Characteristic information out, but after the corresponding data to be stored of the characteristic information taken out is disposed by the first process, next Secondary characteristic information is triggered when being added into message queue.The reason of being arranged in this way is the characteristic information pair in message queue The data to be stored answered has been stored in caching for checking and calling, therefore suitably delaying to write database manipulation will not be right Normal service has an impact;In order to save the write-in resource and computing resource of database as far as possible, gradually using 1 treatment progress Data to be stored is written in database.It certainly, can be with if the write-in resource and computing resource of database have a margin 2 or 2 or more the first processes are set, by set interval or message queue in the trigger conditions such as number of tasks, will Information to be stored in deposit message queue substantially evenly distributes to these the first processes, to further increase number to be stored According to the speed of write-in database.
In addition to the message queue, in some alternative embodiments, the present embodiment, which can also be arranged, has consumed queue, After taking out the task comprising characteristic information in message queue, which removes first process from message queue;First process After being disposed, task deposit is consumed in queue, to realize the cleaning for message queue.Having consumed queue can be with For carrying out quality examination, such as check by way of selection whether is the corresponding data to be stored of characteristic information in each task It has been stored in database.Cleaning can also be executed to having consumed queue as needed.
The caching should have higher data read-write efficiency, and can satisfy the requirement of distributed data processing; Optionally, the caching can be the Redis database configured based on memory.The message queue should have first in, first out Data access logic keeps the processing time-consuming of each task average as far as possible to guarantee fairness;Optionally, the message queue can be with It is MQ (Message Queue, message queue), such as can be the MQ built in Redis database;The characteristic information quilt at this time It is stored in message-oriented middleware used in MQ and is then added to MQ;Correspondingly, when the message queue is MQ, described first Process is the worker process cooperated with MQ.
From the above it can be seen that the method for the data storage provided according to an embodiment of the present invention, because using Data to be stored is stored to caching first, is then gradually stored data to be stored to database using distributed process Technological means reduces the data storage time-consuming for being reflected in user side, improves use on the one hand using the high read or write speed of caching Family experience, and to avoid data exception under the conditions of high concurrent and the problems such as failing can be stored, reach raising data and has deposited The technical effect of speed is stored up, on the other hand by the secondary storage structure of setting caching and database, increases data storage Form improves data storage efficiency by way of this uncoupling, reduces dependence of the data write-in manipulation to database Property, even if the either side in caching and database goes wrong, another party can also be relied in repair process and is exercised normally Store function, reached improve system robustness technical effect.
In some alternative embodiments, the data to be stored is equipped with status indication;The method also includes:
It after the step of obtaining the characteristic information in the message queue, is determined and the feature using the first process The status indication of the corresponding data to be stored of information is not synchronize;And
After searching then step that data to be stored corresponding with the characteristic information is stored into database, by the shape State label is to have synchronized by non-synchronous vacations.
The present embodiment, which further provides, judges whether data to be stored has completed synchronous method.Wherein, the shape State label is that uniquely corresponding label, status indication have at least two diacritic states, be respectively intended to data to be stored Mark its corresponding data to be stored not yet synchronous and synchronized.For example, can be stored by an interim table wait store Data and its status indication, are arranged 2 fields in interim table, and one of field stores data to be stored, another field Be used to store status indication, status indication can be set to 0 and 1, respectively indicate data to be stored do not synchronize with it is synchronous.
In some alternative embodiments, the method also includes:
After data to be stored is stored the step into caching, using described in the second procedure retrieval caching in described in wait deposit Data are stored up, are that the not synchronous data to be stored is stored into the database by status indication.
The characteristic information being stored in message queue in order to prevent is abnormal or loses, and improves the serious forgiveness of storage system and is good for Strong property, the present embodiment check the data to be stored in caching by the second process, if it find that having in not synchronous shape The data to be stored of state, then stored into database;Second process is similarly distributed treatment process, can be with the system System process and the first process asynchronous operation, second process for example can be the worker process with MQ cooperation.The The trigger condition of two processes can be prefixed time interval, for example, the second process can be set to every 1 hour, 12 hours or It is triggered within 24 hours primary;The trigger condition of second process can also be the characteristic information quantity that message queue receives, such as It is triggered when message queue receives 500 characteristic informations, so as to adapt to service pressure, has found that it is likely that appearance in time Mistake.
In some alternative embodiments, the method also includes:
After the step of message queue is added in the characteristic information of the data to be stored, searches and exist in the caching Duration is greater than duration threshold value and status indication is the data to be stored synchronized and then is deleted from the caching.
The present embodiment further provides the method cleared up caching.In the present embodiment, what is saved in caching is Data to be stored, can be to being stored in data in order to improve the calling speed of user data in some other embodiment Before user data in library is operated, user data is read from database first and is stored into caching, needed again in this way It can be directly called from caching when secondary calling user data, to improve the speed of data call.Either which kind of mode, The amount of data to be stored or user data in caching can be more and more huger with the use of system, is limited to memory capacity limit System, needs to clear up the data in caching.
The present embodiment be provided with threshold value duration, preset time (such as daily moment in morning) retrieval caching in wait cache Data, and will existing duration is greater than threshold value duration (such as 3 days) in the buffer and status indication is the number to be cached synchronized According to deletion.So it can either guarantee not being synchronized to will not being deleted to data cached for database, and can control caching Capacity occupy.In addition, in the present embodiment, after data to be stored is stored into caching, can simultaneously by storage time with to Storing data is associated preservation, so as to subsequent calculating data to be stored existing duration in the buffer.
In some alternative embodiments, the method also includes:
After data to be stored to be stored to the step into caching, if it is determined that the data to be stored is not deposited successfully Storage then stores the data to be stored into the database to the caching.It, can when caching is written in data to be stored To judge whether to be written successfully according to the return value of the function used;If be not successfully written, in order to ensure that data will not It loses, directly data to be stored is written in database.
In other optional embodiments, can not also it be successfully stored determining the data to be stored to institute When stating caching, carries out primary or multiple write buffer and attempt, if still cannot succeed, then the data to be stored is deposited Storage is into the database.
In some alternative embodiments, the method also includes:
Before data to be stored to be stored to the step into caching, the every terms of information stored as needed generates structuring number Data to be stored is obtained accordingly;And
Data to be stored, which is stored the step into caching, includes:
The data to be stored is parsed to obtain the every terms of information for needing to store, and the every terms of information is stored respectively In corresponding data table into caching;
Searching then step that data to be stored corresponding with the characteristic information is stored into database includes:
Data to be stored corresponding with the characteristic information is searched, parses the data to be stored then to obtain needing depositing The every terms of information of storage, and the every terms of information is stored respectively in the corresponding data table into database.
The present embodiment, which is directed to, to be needed to be optimized using the data that multiple tables of data are stored;When total appearance of data When measuring identical, containing multinomial information and the storage speed of data that every terms of information needs to be stored respectively to different tables of data, phase It is slow for only having the storage speed of the data of an information, such as user's registration, user information registration, questionnaire tune Look into etc., belong to this kind of scene.In this regard, the present embodiment will need first the every terms of information that stores be integrated into one (if there is Need to be integrated into two or multinomial, the principle that should be followed is to reduce the project sum for needing to store) structuring number According to and stored, specifically, obtained data to be stored can be stored into database, write tables of data due to reducing Quantity, therefore a large amount of time can be saved for data are written in multiple tables of data directly into database;Except this Except, the data to be stored can also be stored in the buffer, the time can be further saved relative to write-in database.
In the present embodiment, for containing multinomial information, the data for needing to be stored using multiple tables of data, in order to make It can be checked and be called when storing in the buffer, be provided in the buffer in database it is the same or similar respectively and respectively The corresponding multiple tables of data of item information are generated according to the every terms of information first after getting the every terms of information for needing to store The data to be stored of structuring and preservation store successful message to user feedback after preservation finishes;Then, it parses wait store Data and respectively by it includes every terms of information store into caching in corresponding tables of data, thus make caching realize and database Identical function.It can be seen that the present embodiment execute speed on relative to directly to database write-in have very big advantage, especially Speed when storage entry data is further improved, will can quickly store successful message feedback to user.
In subsequent synchronisation to the database the step of, when data to be stored is further stored into database, solve again The structural data is analysed to obtain the every terms of information for needing to store, it is right then respectively to store the every terms of information into database In the tables of data answered.Alternatively, data can also be obtained directly from each tables of data in caching and the correspondence number of database is written According in table.
Current embodiment require that the every terms of information of storage is integrated into single structural data and carries out transimission and storage, relatively The time can be saved in storage every terms of information respectively.Wherein, structural data refers to using the preservation of certain data interchange format Data, such as the data saved with JSON format or XML format.
In some alternative embodiments, application scenarios of the invention are user's registration, including new user's registration, mailbox/ Phone number binding and unbundlings etc., it is described to it is data cached include registration information and/or relevant information;The registration information includes At least one of in user name, password, the pet name, mobile phone and mailbox, the relevant information includes handset binding state, mailbox binding At least one of in state, unbundlings user name, grade, source, registion time and registration IP;The caching is that Redis is cached.
The application method of technical solution in order to further illustrate the present invention, below by a specific embodiment to this Inventive method is described in detail.
Fig. 2 be the embodiment of the present invention data storage method be applied to user's registration scene when key step signal Figure.
The application scenarios of the present embodiment are user's registration, including new user's registration, mailbox/phone number binding and unbundlings Deng.It needs to save to the information of server when user's registration to generally comprise: as the user name of registration information, password, the pet name, hand Machine and mailbox etc., and the handset binding state as relevant information, mailbox binding state, unbundlings user name, grade, source, Registion time and registration IP etc..
As shown in Fig. 2, when being applied to user's registration scene, which comprises
Check value and expired time are written into the cookie of user terminal when user terminal accesses enrollment page by S200, and The check value and the expired time are saved in server-side.By the registration information of user and relevant information store to caching or In database, and when verification user name, phone number, mailbox etc. or other process steps, first from the cookie of user terminal It is middle to obtain the check value and expired time, and it is compared with the check value of server-side and expired time, however, it is determined that it uses The check value at family end and the check value of server-side are identical, and determine that the check value of user terminal is not out of date according to expired time, then into One step executes process.Otherwise stop follow-up process, and return to the prompt informations such as registration failure to user terminal.The function of step S200 It is filtering fallacious user, malicious registration can be prevented.
S201 obtains the user data comprising registration information and relevant information that user terminal is sent, then by the user (user data and the structural data generated according to user data correspond to the number to be stored in previous embodiment to data According to) be written with JSON format in the data field of interim table;It further include status flag field in interim table, the value of the field is 0 Perhaps 1 information for respectively indicating in same interim table in data field is not yet synchronized in database or has been synchronized to number It is 0 according to the initial value that status flag field in library, is arranged.Interim table for temporarily saving user data and its state in the buffer Label, can be also used for saving other information relevant to user data.Interim table can give birth to when needing to save user data At.
S202, judges whether user data is successfully written interim table.S203 is thened follow the steps if not, if executing step S204 and S207.
S203 is registered to client feeds back and is lost if interim table successfully is not written in user data and status indication The prompt information lost.Interim table can save in the database, can also save in the buffer.
S204 succeeds in registration if interim table successfully is written in user data and status indication to client feeds back Prompt information, and execute the instruction user data in the interim table stored into Redis caching.Further, will face When table in user data store to Redis cache, the data field in interim table can be parsed to obtain registration information and correlation Then information respectively stores projects in registration information and relevant information to the corresponding data being arranged in Redis caching In table.Tables of data includes such as Basic Information Table, extension information table, log-on message table, mobile phone concordance list, mailbox concordance list, ID Concordance list, pet name concordance list, registration correlation table, change_log log sheet etc., every terms of information is in a manner of key-value pair in correspondence Tables of data in store respectively.
S205 judges whether successfully to store the interim table into Redis caching or in database.If otherwise executing step Rapid S206;It is cached successfully if then determining and writing Redis.
S206 parses the data field of the interim table to obtain registration information and relevant information, and by the registration Every terms of information in information and the relevant information is stored into database in corresponding tables of data.I.e. successfully will not be interim Table store to Redis caching in and database in when, then execute database write enter process, data directly are written into every terms of information In library, to prevent loss of data.
The corresponding characteristic information of user data is added in message-oriented middleware S207, and it is flat to MQ to send the message-oriented middleware Platform stores message-oriented middleware addition message queue.Characteristic information be with the one-to-one information of user data, i.e., it is logical One group of user data can be uniquely determined by crossing characteristic information.Characteristic information for example can be user name when registration.
Above-mentioned steps S200 to S207 is executed by system process, the quantity of system process and with no restrictions, i.e. S200 is extremely Step S207 can be completed jointly by the system process of different number, and after step S207 is finished, message-oriented middleware is sent out It send to MQ platform, and is added in message queue.If synchronized process (corresponding to the first process in previous embodiment) is idle at this time, The event that can be then added by message-oriented middleware triggers, and starts to execute synchronous process.
S208, synchronized process obtain the message-oriented middleware of preset quantity from message queue.It is synchronous in order to improve treatment effeciency Process, which can be configured as, once takes out multiple message-oriented middlewares, i.e., once synchronizes to multiple groups user data.
S209, the characteristic information that synchronized process includes according to message-oriented middleware are searched in Redis caching or in database Interim table corresponding with this feature information.
S210, synchronized process judge whether the status flag field in the interim table is 0.If status flag field is 0, It determines that the user data in interim table is not yet synchronized, then executes step S211;If status flag field is 1, it is determined that face When table in user data be synchronized, if still there is untreated message-oriented middleware, continue to handle, otherwise can be temporary Stop activity waiting to be triggered again.
S211, synchronized process parse the data field of the interim table to obtain registration information and relevant information, and will Every terms of information in the registration information and the relevant information is stored into database in corresponding tables of data, so as to by user Data are synchronized in database.
S212 judges whether to synchronize success.If so, thening follow the steps S213;If it is not, then terminating.In addition, synchronously completing Afterwards, the every terms of information in the registration information and the relevant information can also be stored further to Redis and be delayed by synchronized process It deposits in corresponding tables of data, Redis caching was in fact had been written into step S204, guarantee that user's registration is complete Any function in normal operating front end writes the case where write buffer fails when primary caching is in order to for front registration again here and does one Secondary leak repairing.
The status flag field of interim table is revised as 1 by S213.
Above-mentioned steps S208 to S213 is synchronized process by the key step of user data synchronization to database.Optionally, After synchronized process completes the corresponding synchronous working of a message-oriented middleware, which can also be added and disappeared Take in queue, having consumed queue can be used to carry out quality examination, such as the feature in each task is checked by way of selection Whether the corresponding data to be stored of information has been stored in database.Cleaning can also be executed to having consumed queue as needed. In addition, step S208 to S213 is the process that synchronized process synchronizes the corresponding user data of a message-oriented middleware, when When synchronized process once gets multiple message-oriented middlewares, repeat step S208 to S213 until all message-oriented middleware all by It is disposed.
In above-mentioned steps, even if step S212 judgement does not synchronize success, synchronized process can also terminate this subtask, therefore It is likely to occur the case where user data being not yet synchronized does not establish task but in message queue;Furthermore in some unexpected feelings Under condition, it is also possible to the problems such as message-oriented middleware loss occur, above situation can all cause the user data in caching can not be by It is synchronized in database.
For this problem, the present embodiment is further provided with retrieval process;Retrieval process can be configured as timing and touch Hair, also can be configured as triggering when message queue new task number reaches certain amount, after triggering, retrieval process can be retrieved Status indication is interim table that field is 0 in Redis caching, and by the user data synchronization in these interim tables to database In.By the way that retrieval process is arranged, the serious forgiveness of method is improved.
In addition, having an adverse effect in order to avoid the ephemeral data in caching is excessive, the present embodiment is also optional to be provided with Deletion process.Deletion process is similar with retrieval process, can be configured as that clocked flip, also to can be configured as task queue new Triggering when number of tasks reaches certain amount.On triggering, deletion process can Redis caching in choose creation time away from it is current when Between more than preset duration (preset duration is configured according to traffic pressure, and traffic pressure hour preset duration can be longer, retain compared with It is prolonged user data, on the contrary then shorter) interim table and it is deleted from Redis caching.It, can be with if deleting failure Carry out limited times to retry, not reprocessed if still can not being deleted after retrying, when next deletion process is triggered again into Row processing.
Fig. 3 is the schematic diagram of the main modular of the device of data storage according to an embodiment of the present invention.
As shown, the device 300 of the data storage provided according to an embodiment of the present invention, comprising:
Cache memory module 301, for storing data to be stored into caching;
Message adding module 302, for message queue to be added in the characteristic information of the data to be stored;
First synchronization module 303, for using the first process to obtain the characteristic information from the message queue, and Data to be stored corresponding with the characteristic information is searched then to store into database.
Optionally, the data to be stored is equipped with status indication;
First synchronization module 303 is also used to determine the status indication of data to be stored corresponding with the characteristic information Not synchronize;And after searching data to be stored corresponding with the characteristic information and then storing into database, by the shape State label is to have synchronized by non-synchronous vacations.
Optionally, described device 300 further include:
Status indication is not synchronize for retrieving the data to be stored in the caching by the second synchronization module 304 The data to be stored store into the database.
Optionally, described device 300 further include:
Removing module 305, it is long in the presence of for being searched in the caching to be greater than duration threshold value and status indication is together Then the data to be stored of step is deleted from the caching.
Optionally, first synchronization module 303 is also used to, and institute is being obtained from the message queue using the first process Before stating characteristic information, determining has new characteristic information to be added into the message queue, and determines that first process is idle.
Optionally, described device 300 further include:
Cache memory module 306, for if it is determined that the data to be stored is not successfully stored to the caching, then The data to be stored is stored into the database.
Optionally, described device 300 further include:
Data Integration module 307, the every terms of information for storing as needed generate structural data to obtain wait store Data, and when needed save the data to be stored of the structuring into database and/or caching;
The cache memory module 301 is also used to parse the data to be stored to obtain needing the every terms of information that stores, And the every terms of information is stored respectively in the corresponding data table into caching;
First synchronization module 303 is also used to search data to be stored corresponding with the characteristic information, then parses The data to be stored is stored into database respectively to obtain the every terms of information for needing to store, and by the every terms of information In corresponding data table.
Optionally, it is described to it is data cached include registration information and/or relevant information;The registration information includes user At least one of in name, password, the pet name, mobile phone and mailbox, the relevant information includes handset binding state, mailbox binding shape At least one of in state, unbundlings user name, grade, source, registion time and registration IP;The caching is that Redis is cached.
From the above it can be seen that the device of the data storage provided according to an embodiment of the present invention, because using Data to be stored is stored to caching first, is then gradually stored data to be stored to database using distributed process Technological means reduces the data storage time-consuming for being reflected in user side, improves use on the one hand using the high read or write speed of caching Family experience, and to avoid data exception under the conditions of high concurrent and the problems such as failing can be stored, reach raising data and has deposited The technical effect of speed is stored up, on the other hand by the secondary storage structure of setting caching and database, increases data storage Form improves data storage efficiency by way of this uncoupling, reduces dependence of the data write-in manipulation to database Property, even if the either side in caching and database goes wrong, another party can also be relied in repair process and is exercised normally Store function, reached improve system robustness technical effect.
Fig. 4 is shown can be using the exemplary of the device for the method or data storage that the data of the embodiment of the present invention store System architecture 400.
As shown in figure 4, system architecture 400 may include terminal device 401,402,403, network 404 and server 405. Network 404 between terminal device 401,402,403 and server 405 to provide the medium of communication link.Network 404 can be with Including various connection types, such as wired, wireless communication link or fiber optic cables etc..
User can be used terminal device 401,402,403 and be interacted by network 404 with server 405, to receive or send out Send message etc..Various telecommunication customer end applications, such as the application of shopping class, net can be installed on terminal device 401,402,403 The application of page browsing device, searching class application, instant messaging tools, mailbox client, social platform software etc..
Terminal device 401,402,403 can be the various electronic equipments with display screen and supported web page browsing, packet Include but be not limited to smart phone, tablet computer, pocket computer on knee and desktop computer etc..
Server 405 can be to provide the server of various services, such as utilize terminal device 401,402,403 to user The website browsed provides the background server that user's registration is supported.Background server can be to the user's registration data received It is stored, and user data is fed back into terminal device when needed.
It should be noted that the method for the storage of data provided by the embodiment of the present invention is generally executed by server 405, phase The device of Ying Di, data storage are generally positioned in server 405.
It should be understood that the number of terminal device, network and server in Fig. 4 is only schematical.According to realization need It wants, can have any number of terminal device, network and server.
According to an embodiment of the invention, the present invention also provides a kind of electronic equipment and a kind of readable storage medium storing program for executing.
Fig. 5 is adapted for the structural representation of the computer system for the terminal device or server of realizing the embodiment of the present invention Figure.
Below with reference to Fig. 5, it illustrates the computer systems 500 for the terminal device for being suitable for being used to realize the embodiment of the present invention Structural schematic diagram.Terminal device shown in Fig. 5 is only an example, function to the embodiment of the present invention and should not use model Shroud carrys out any restrictions.
As shown in figure 5, computer system 500 includes central processing unit (CPU) 501, it can be read-only according to being stored in Program in memory (ROM) 502 or be loaded into the program in random access storage device (RAM) 503 from storage section 508 and Execute various movements appropriate and processing.In RAM 503, also it is stored with system 500 and operates required various programs and data. CPU 501, ROM 502 and RAM 503 are connected with each other by bus 504.Input/output (I/O) interface 505 is also connected to always Line 504.
I/O interface 505 is connected to lower component: the importation 506 including keyboard, mouse etc.;It is penetrated including such as cathode The output par, c 507 of spool (CRT), liquid crystal display (LCD) etc. and loudspeaker etc.;Storage section 508 including hard disk etc.; And the communications portion 509 of the network interface card including LAN card, modem etc..Communications portion 509 via such as because The network of spy's net executes communication process.Driver 510 is also connected to I/O interface 505 as needed.Detachable media 511, such as Disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on as needed on driver 510, in order to read from thereon Computer program be mounted into storage section 508 as needed.
Particularly, according to an embodiment of the invention, the process of the schematic diagram description of key step may be implemented as above Computer software programs.For example, the embodiment of the present invention includes a kind of computer program product comprising being carried on computer can The computer program on medium is read, which includes the program for executing method shown in the schematic diagram of key step Code.In such embodiments, which can be downloaded and installed from network by communications portion 509, and/ Or it is mounted from detachable media 511.When the computer program is executed by central processing unit (CPU) 501, the present invention is executed System in the above-mentioned function that limits.
It should be noted that computer-readable medium shown in the present invention can be computer-readable signal media or meter Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device, Or above-mentioned any appropriate combination.In the present invention, computer readable storage medium can be it is any include or storage journey The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this In invention, computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal, Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium Program code can transmit with any suitable medium, including but not limited to: wireless, electric wire, optical cable, RF etc. are above-mentioned Any appropriate combination.
Flow chart and block diagram in attached drawing are illustrated according to the system of various embodiments of the invention, method and computer journey The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation A part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or more Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction It closes to realize.
Being described in module involved in the embodiment of the present invention can be realized by way of software, can also be by hard The mode of part is realized.Described module also can be set in the processor, for example, can be described as: a kind of processor packet Include cache memory module, message adding module and the first synchronization module.Wherein, the title of these modules is not under certain conditions Restriction to the module itself is constituted, for example, message adding module is also described as " for by the data to be stored Message queue is added in characteristic information ".
As on the other hand, the present invention also provides a kind of computer-readable medium, which be can be Included in equipment described in above-described embodiment;It is also possible to individualism, and without in the supplying equipment.Above-mentioned calculating Machine readable medium carries one or more program, when said one or multiple programs are executed by the equipment, makes Obtaining the equipment includes:
Data to be stored is stored into caching;
Message queue is added in the characteristic information of the data to be stored;
The characteristic information is obtained from the message queue using the first process, and is searched and the characteristic information pair Then the data to be stored answered is stored into database.
Technical solution according to an embodiment of the present invention stores data to be stored because using to caching, then first Data to be stored is gradually stored to the technological means of database using distributed process, on the one hand utilizes the high read-write speed of caching Degree reduces the data storage time-consuming for being reflected in user side, improves user experience, and can be to avoid under the conditions of high concurrent Data exception and storage failure the problems such as, reached improve data rate memory technical effect, on the other hand pass through setting The secondary storage structure of caching and database increases the form of data storage, improves number by way of this uncoupling According to storage efficiency, data write-in manipulation is reduced to the dependence of database, even if the either side in caching and database goes out Existing problem can also rely on another party in repair process and exercise normal store function, reach and improved system robustness Technical effect.
Above-mentioned specific embodiment, does not constitute a limitation on the scope of protection of the present invention.Those skilled in the art should be bright It is white, design requirement and other factors are depended on, various modifications, combination, sub-portfolio and substitution can occur.It is any Made modifications, equivalent substitutions and improvements etc. within the spirit and principles in the present invention, should be included in the scope of the present invention Within.

Claims (18)

1. a kind of method of data storage characterized by comprising
Data to be stored is stored into caching;
Message queue is added in the characteristic information of the data to be stored;
The characteristic information is obtained from the message queue using the first process, and is searched corresponding with the characteristic information Then data to be stored is stored into database.
2. the method according to claim 1, wherein the data to be stored is equipped with status indication;It is described Method further include:
It after the step of obtaining the characteristic information in the message queue, is determined and the characteristic information using the first process The status indication of corresponding data to be stored is not synchronize;And
After searching then step that data to be stored corresponding with the characteristic information is stored into database, by the state mark Note is to have synchronized by non-synchronous vacations.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
After data to be stored is stored the step into caching, using described in the second procedure retrieval caching in described in number to be stored According to the data to be stored by status indication for not synchronization is stored into the database.
4. according to the method described in claim 2, it is characterized in that, the method also includes:
After the step of message queue is added in the characteristic information of the data to be stored, there are durations for lookup in the caching Greater than duration threshold value and status indication is the data to be stored synchronized and then is deleted from the caching.
5. the method according to claim 1, wherein the method also includes:
Before the step of obtaining the characteristic information in the message queue, determining there is new characteristic information using the first process It is added into the message queue, and determines that first process is idle.
6. the method according to claim 1, wherein the method also includes:
After data to be stored to be stored to the step into caching, if it is determined that the data to be stored be not successfully stored to The caching then stores the data to be stored into the database.
7. the method according to claim 1, wherein the method also includes:
Before data to be stored to be stored to the step into caching, the every terms of information that stores as needed generate structural data with Obtain data to be stored;And
Data to be stored, which is stored the step into caching, includes:
The data to be stored is parsed to obtain the every terms of information for needing to store, and the every terms of information is stored respectively to slow In the corresponding data table deposited;
Searching then step that data to be stored corresponding with the characteristic information is stored into database includes:
Corresponding with characteristic information data to be stored is searched, the data to be stored is then parsed and is stored with obtaining needs Every terms of information, and the every terms of information is stored respectively in the corresponding data table into database.
8. the method according to claim 1, wherein it is described to it is data cached include registration information and/or correlation Information;The registration information includes at least one in user name, password, the pet name, mobile phone and mailbox, and the relevant information includes At least one of in handset binding state, mailbox binding state, unbundlings user name, grade, source, registion time and registration IP; The caching is that Redis is cached.
9. a kind of device of data storage characterized by comprising
Cache memory module, for storing data to be stored into caching;
Message adding module, for message queue to be added in the characteristic information of the data to be stored;
First synchronization module, for using the first process to obtain the characteristic information from the message queue, and search with Then the corresponding data to be stored of the characteristic information is stored into database.
10. device according to claim 9, which is characterized in that the data to be stored is equipped with status indication;
First synchronization module is also used to determine that the status indication of data to be stored corresponding with the characteristic information is not same Step;And after searching data to be stored corresponding with the characteristic information and then storing into database, by the status indication It is to have synchronized by non-synchronous vacations.
11. device according to claim 10, which is characterized in that described device further include:
Status indication is described in synchronization for retrieving the data to be stored in the caching by the second synchronization module Data to be stored is stored into the database.
12. device according to claim 10, which is characterized in that described device further include:
Removing module, in the presence of for being searched in the caching it is long be greater than duration threshold value and status indication be synchronized described in Then data to be stored is deleted from the caching.
13. device according to claim 9, which is characterized in that first synchronization module is also used to, using first into For journey before obtaining the characteristic information in the message queue, determination has new characteristic information to be added into the message queue, with And determine that first process is idle.
14. device according to claim 9, which is characterized in that described device further include:
Cache memory module then will be described for if it is determined that the data to be stored is not successfully stored to the caching Data to be stored is stored into the database.
15. device according to claim 9, which is characterized in that described device further include:
Data Integration module, the every terms of information for storing as needed generate structural data to obtain data to be stored;
The cache memory module is also used to parse the data to be stored to obtain needing the every terms of information that stores, and by institute It states in the corresponding data table that every terms of information is stored respectively into caching;
First synchronization module is also used to search data to be stored corresponding with the characteristic information, and then parsing is described wait deposit Storage data store the corresponding data into database to obtain the every terms of information for needing to store, and by the every terms of information respectively In table.
16. device according to claim 9, which is characterized in that it is described to it is data cached include registration information and/or correlation Information;The registration information includes at least one in user name, password, the pet name, mobile phone and mailbox, and the relevant information includes At least one of in handset binding state, mailbox binding state, unbundlings user name, grade, source, registion time and registration IP; The caching is that Redis is cached.
17. a kind of electronic equipment characterized by comprising
One or more processors;
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors are real Now such as method described in any one of claims 1-8.
18. a kind of computer-readable medium, is stored thereon with computer program, which is characterized in that described program is held by processor Such as method described in any one of claims 1-8 is realized when row.
CN201710451809.XA 2017-06-15 2017-06-15 A kind of method and apparatus of data storage Pending CN109144992A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710451809.XA CN109144992A (en) 2017-06-15 2017-06-15 A kind of method and apparatus of data storage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710451809.XA CN109144992A (en) 2017-06-15 2017-06-15 A kind of method and apparatus of data storage

Publications (1)

Publication Number Publication Date
CN109144992A true CN109144992A (en) 2019-01-04

Family

ID=64829837

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710451809.XA Pending CN109144992A (en) 2017-06-15 2017-06-15 A kind of method and apparatus of data storage

Country Status (1)

Country Link
CN (1) CN109144992A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109873904A (en) * 2019-03-05 2019-06-11 平安科技(深圳)有限公司 User of message status report process method, device and the storage medium of message push
CN113034715A (en) * 2021-03-02 2021-06-25 创优数字科技(广东)有限公司 Attendance data processing method and device, server and storage medium
CN113076290A (en) * 2021-04-12 2021-07-06 百果园技术(新加坡)有限公司 File deletion method, device, equipment, system and storage medium
WO2023124841A1 (en) * 2021-12-28 2023-07-06 中兴通讯股份有限公司 Method for storing feature in database, electronic device and computer readable storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103116634A (en) * 2012-06-12 2013-05-22 上海雷腾软件有限公司 System for supporting high concurrent cache task queue and asynchronous batch operation method thereof
US20140095438A1 (en) * 2012-09-28 2014-04-03 Oracle International Corporation Tracking row and object database activity into block level heatmaps
CN103886079A (en) * 2014-03-26 2014-06-25 北京京东尚科信息技术有限公司 Data processing method and system
CN104572838A (en) * 2014-12-11 2015-04-29 北京京东尚科信息技术有限公司 Improved system and method for writing data to database
CN105205175A (en) * 2015-10-15 2015-12-30 北京农信互联科技有限公司 Data operation method and system for distributed database cluster
CN105956032A (en) * 2016-04-25 2016-09-21 百度在线网络技术(北京)有限公司 Cache data synchronization method, system and apparatus
CN105956166A (en) * 2016-05-19 2016-09-21 北京京东尚科信息技术有限公司 Database reading-writing method and database reading-writing apparatus
CN106294607A (en) * 2016-07-29 2017-01-04 北京奇虎科技有限公司 Data cached update method and updating device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103116634A (en) * 2012-06-12 2013-05-22 上海雷腾软件有限公司 System for supporting high concurrent cache task queue and asynchronous batch operation method thereof
US20140095438A1 (en) * 2012-09-28 2014-04-03 Oracle International Corporation Tracking row and object database activity into block level heatmaps
CN103886079A (en) * 2014-03-26 2014-06-25 北京京东尚科信息技术有限公司 Data processing method and system
CN104572838A (en) * 2014-12-11 2015-04-29 北京京东尚科信息技术有限公司 Improved system and method for writing data to database
CN105205175A (en) * 2015-10-15 2015-12-30 北京农信互联科技有限公司 Data operation method and system for distributed database cluster
CN105956032A (en) * 2016-04-25 2016-09-21 百度在线网络技术(北京)有限公司 Cache data synchronization method, system and apparatus
CN105956166A (en) * 2016-05-19 2016-09-21 北京京东尚科信息技术有限公司 Database reading-writing method and database reading-writing apparatus
CN106294607A (en) * 2016-07-29 2017-01-04 北京奇虎科技有限公司 Data cached update method and updating device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109873904A (en) * 2019-03-05 2019-06-11 平安科技(深圳)有限公司 User of message status report process method, device and the storage medium of message push
WO2020177384A1 (en) * 2019-03-05 2020-09-10 平安科技(深圳)有限公司 Method and apparatus for reporting and processing user message status of message pushing, and storage medium
CN109873904B (en) * 2019-03-05 2021-08-03 平安科技(深圳)有限公司 User message state reporting processing method, device and storage medium for message pushing
CN113034715A (en) * 2021-03-02 2021-06-25 创优数字科技(广东)有限公司 Attendance data processing method and device, server and storage medium
CN113076290A (en) * 2021-04-12 2021-07-06 百果园技术(新加坡)有限公司 File deletion method, device, equipment, system and storage medium
CN113076290B (en) * 2021-04-12 2024-01-30 百果园技术(新加坡)有限公司 File deletion method, device, equipment, system and storage medium
WO2023124841A1 (en) * 2021-12-28 2023-07-06 中兴通讯股份有限公司 Method for storing feature in database, electronic device and computer readable storage medium

Similar Documents

Publication Publication Date Title
CN110019211A (en) The methods, devices and systems of association index
CN109144992A (en) A kind of method and apparatus of data storage
CN108984553B (en) Caching method and device
CN109447641B (en) Method and apparatus for transmitting blockchain data to blockchain browser
CN109413127A (en) A kind of method of data synchronization and device
CN107633014A (en) A kind of date storage method and server
EP3058481B1 (en) Acceleration based on cached flows
CN108874513A (en) Handle method, system, electronic equipment and the computer-readable medium of timed task
CN109657174A (en) Method and apparatus for more new data
CN110334036A (en) A kind of method and apparatus for realizing data cached scheduling
CN109032796A (en) A kind of data processing method and device
CN109388626A (en) Method and apparatus for being numbered to traffic assignments
CN109918191A (en) A kind of method and apparatus of the anti-frequency of service request
CN110334145A (en) The method and apparatus of data processing
CN113094434A (en) Database synchronization method, system, device, electronic equipment and medium
CN109842621A (en) A kind of method and terminal reducing token storage quantity
CN107943846B (en) Data processing method and device and electronic equipment
CN110321252A (en) A kind of method and apparatus of craft services scheduling of resource
CN110019496A (en) Data read-write method and system
CN109150790A (en) The recognition methods of Web page crawler and device
CN110782310B (en) Method, device and system for asynchronously acquiring user attribute information from third-party platform
CN110083501A (en) Interface calls method of counting and device
CN110020373A (en) The method and apparatus that static page is stored, browsed
CN109947736A (en) The method and system calculated in real time
CN116611411A (en) Business system report generation method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190104

RJ01 Rejection of invention patent application after publication