CN109783258A - A kind of message treatment method, device and server - Google Patents
A kind of message treatment method, device and server Download PDFInfo
- Publication number
- CN109783258A CN109783258A CN201910129887.7A CN201910129887A CN109783258A CN 109783258 A CN109783258 A CN 109783258A CN 201910129887 A CN201910129887 A CN 201910129887A CN 109783258 A CN109783258 A CN 109783258A
- Authority
- CN
- China
- Prior art keywords
- message
- overstocked
- restored
- buffer tag
- sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The embodiment of the invention provides a kind of message treatment method, device and servers, are related to field of computer technology, obtain message to realize message consumer according to the sequence of message arrival message system.Embodiments herein includes: to receive the message reduction instruction for carrying specified parameter, and specified parameter is for identifying specified buffer tag, and specified buffer tag is for identifying overstocked message to be restored；Then the specified corresponding overstocked message to be restored of buffer tag is obtained in the database；Overstocked message to be restored is ranked up according to the sequence of the time of reception from morning to night again, and successively sends each overstocked message to be restored to message system according to ranking results, at the time of the time of reception is that message system receives overstocked message.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of message treatment method, device and server.
Background technique
Message system is the system share memory space that message is stored by one, what the message producer can send needs
Message is sent in message system, when message consumer needs to obtain this message, then this message is taken out from message system.
Currently, in order to improve the speed of caching, usually being adopted if the message in message system needs to be buffered in the database
It is cached with multi-threaded parallel, since per thread processing speed is different, causes the sequence of message arrival message system and message slow
The sequence deposited is different.And when the message in database is restored to message system, it is carried out generally according to the sequence of message caching
Reduction so that the sequence of message sequence and message the arrival message system after reduction is also different, prevent message consumer from by
The sequence of message system is reached according to message to obtain message.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of message treatment method, device and server, to realize that message disappears
Expense person reaches the sequence of message system according to message to obtain message.Specific technical solution is as follows:
In a first aspect, provide a kind of message treatment method, it is applied to destination server, the destination server can be with
Message system and database carry out information exchange, which comprises
The message reduction instruction for carrying specified parameter is received, the specified parameter is described for identifying specified buffer tag
Specified buffer tag is for identifying overstocked message to be restored；
The corresponding overstocked message to be restored of the specified buffer tag is obtained in the database；
Overstocked message to be restored is ranked up according to the sequence of the time of reception from morning to night, and according to ranking results to institute
State message system and successively send each overstocked message to be restored, the time of reception be message system receive overstocked message when
It carves.
Optionally, the method also includes:
Message cache instruction is received, includes: the queue wait cache the affiliated queue of overstocked message in the message cache instruction
The cluster identity of mark and the affiliated cluster of the queue；
According to each preset time character string, the cluster identity and the queue identity, each preset time character is determined
Go here and there corresponding buffer tag, preset time character string is used to indicate the period locating for the time of reception wait cache overstocked message；
Each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message into the database.
Optionally, described that overstocked message to be restored is ranked up according to the sequence of the time of reception from morning to night, and according to
Ranking results successively send each overstocked message to be restored to the message system, comprising:
According to the period sequence from morning to night of preset time string representation, each specified buffer tag is arranged
Sequence；
According to the sequence of the time of reception from morning to night, respectively to the corresponding overstocked message to be restored of each specified buffer tag
It is ranked up；
According to the sequence of the time of reception from morning to night, Xiang Suoshu message system successively sends each overstocked message to be restored.
Optionally, the method also includes:
Message cache instruction is received, includes: the queue wait cache the affiliated queue of overstocked message in the message cache instruction
The cluster identity of mark and the affiliated cluster of the queue；
According to each default cryptographic Hash, the cluster identity and the queue identity, determine that each default cryptographic Hash is corresponding
Buffer tag, the default cryptographic Hash are used to indicate the corresponding cryptographic Hash of mark wait cache overstocked message；
Each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message into the database.
Optionally, described that overstocked message to be restored is ranked up according to the sequence of the time of reception from morning to night, and according to
Ranking results successively send each overstocked message to be restored to the message system, comprising:
According to the sequence of the time of reception from morning to night, respectively to the corresponding overstocked message to be restored of each specified buffer tag
Carry out internal sort；
According to the internal sort of the corresponding overstocked message to be restored of each specified buffer tag as a result, according to the time of reception from morning to
The sequence in evening, overstocked message to be restored corresponding to each specified buffer tag carry out merger sequence；
According to the merger ranking results of the corresponding overstocked message to be restored of each specified buffer tag, Xiang Suoshu message system according to
It is secondary to send each overstocked message to be restored.
Second aspect provides a kind of message processing apparatus, is applied to destination server, and the destination server can be with
Message system and database carry out information exchange, and described device includes:
Receiving module, for receiving the message reduction instruction for carrying specified parameter, the specified parameter is specified for identifying
Buffer tag, the specified buffer tag is for identifying overstocked message to be restored；
Obtain module, for obtain in the database the received specified buffer tag of the receiving module it is corresponding to
It restores and overstocks message；
Sending module, the overstocked message to be restored for being obtained to the acquisition module according to the time of reception from morning to night
Sequence is ranked up, and successively sends each overstocked message to be restored to message system according to ranking results, and the time of reception is
At the time of message system receives overstocked message.
Optionally, described device further include: the first determining module and the first preserving module；
The receiving module is also used to receive message cache instruction, includes: overstocked wait cache in the message cache instruction
The queue identity of the affiliated queue of message and the cluster identity of the affiliated cluster of the queue；
First determining module, for according to each preset time character string, the received cluster of the receiving module
Mark and the queue identity, determine the corresponding buffer tag of each preset time character string, and preset time character string is used for table
Show the period locating for the time of reception wait cache overstocked message；
First preserving module, for corresponding overstocked message is corresponding to protect wait cache by each buffer tag and buffer tag
It deposits into the database.
Optionally, the sending module, is specifically used for:
According to the period sequence from morning to night of preset time string representation, each specified buffer tag is arranged
Sequence；According to the sequence of the time of reception from morning to night, overstocked message to be restored corresponding to each specified buffer tag is carried out respectively
Sequence；According to the sequence of the time of reception from morning to night, Xiang Suoshu message system successively sends each overstocked message to be restored.
Optionally, described device further include: the second determining module and the second preserving module；
The receiving module is also used to receive message cache instruction, includes: overstocked wait cache in the message cache instruction
The queue identity of the affiliated queue of message and the cluster identity of the affiliated cluster of the queue；
Second determining module, for according to each default cryptographic Hash, the received cluster identity of the receiving module
With the queue identity, each default corresponding buffer tag of cryptographic Hash is determined, the default cryptographic Hash is for indicating wait cache
Overstock the corresponding cryptographic Hash of mark of message；
Second preserving module, for corresponding overstocked message is corresponding to protect wait cache by each buffer tag and buffer tag
It deposits into the database.
Optionally, the sending module, is specifically used for:
According to the sequence of the time of reception from morning to night, respectively to the corresponding overstocked message to be restored of each specified buffer tag
Carry out internal sort；According to the internal sort of the corresponding overstocked message to be restored of each specified buffer tag as a result, according to the time of reception from
The early sequence to evening carries out merger sequence to the corresponding overstocked message to be restored of each specified buffer tag；According to each specified caching
The merger ranking results of the corresponding overstocked message to be restored of label, Xiang Suoshu message system successively send each to be restored overstock and disappear
Breath.
The third aspect provides a kind of message handling system, including destination server described in above-mentioned second aspect, above-mentioned
The database and message system that second aspect is related to；
It is corresponding with buffer tag to slow that the database is used to receive each buffer tag that the destination server is sent
Pressure message is stockpiled, corresponding overstocked message is corresponding to be saved to a cache unit wait cache by each buffer tag and buffer tag
In.
Fourth aspect, provides a kind of server, and the server includes processor, communication interface, memory and communication
Bus, wherein processor, communication interface, memory complete mutual communication by communication bus；
Memory, for storing computer program；
Processor when for executing the program stored on memory, realizes any of the above-described message treatment method
Step.
5th aspect, it is described computer-readable to deposit the embodiment of the invention also provides a kind of computer readable storage medium
Computer program is stored in storage media, the computer program is realized when being executed by processor at any of the above-described message
Manage method and step.
6th aspect, the embodiment of the invention also provides a kind of computer program products comprising instruction, when it is being calculated
When being run on machine, so that computer executes any of the above-described message treatment method step.
A kind of message treatment method, device and server provided in an embodiment of the present invention, due to restoring to be restored overstock
When message, overstocked message to be restored can be ranked up according to the sequence of the time of reception from morning to night, then according to respectively to also
The ranking results of the overstocked message of original, successively send each overstocked message to be restored to message system.As it can be seen that the present invention can will respectively to
It restores overstocked message and produces the order restoring to message system into message system according to message, disappear so the present invention can be realized
Sequence after breath reduction reaches the sequence unification of message system with message, and message consumer can reach message system according to message
Sequence obtain message.
Certainly, implement any of the products of the present invention or method it is not absolutely required at the same reach all the above excellent
Point.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described.
Fig. 1 is a kind of message handling system structural schematic diagram provided in an embodiment of the present invention；
Fig. 2 is a kind of message treatment method flow chart provided in an embodiment of the present invention；
Fig. 3 is a kind of message treatment method illustrative diagram provided in an embodiment of the present invention；
Fig. 4 is a kind of message treatment method illustrative diagram provided in an embodiment of the present invention；
Fig. 5 is a kind of message processing apparatus structural schematic diagram provided in an embodiment of the present invention；
Fig. 6 is a kind of structural schematic diagram of server provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention is described.
Message treatment method provided in an embodiment of the present invention can be applied in message handling system shown in FIG. 1, this is
System includes: message system, destination server and database.Connection between message system, destination server and database
Think wireless connection.
Wherein, message system, including multiple system servers, for receiving and storing the message of message producer transmission.
And cluster identity and queue identity are added for the message received.The connection between each system server in message system is equal
It can be wireless connection.
Destination server includes: caching and recovery module, needs for the overstocked message in message system to be cached to for working as
When in database, determined according to the cluster identity of overstocked message and queue identity wait cache overstocked message, then by message system
In be cached in database wait cache overstocked message；When needing to revert to the overstocked message in database in message system
When, according to the buffer tag of overstocked message, send overstocked message to be restored in message system from database.
Database can be distributed memory system (HBase), for receiving each buffer tag of destination server transmission
It is corresponding with buffer tag wait cache overstocked message, each buffer tag is corresponding with buffer tag wait cache overstocked message pair
It should save into a cache unit (Block).
In another embodiment, database can integrate in destination server.
In conjunction with Fig. 1, the embodiment of the invention provides a kind of message treatment methods, are applied to destination server, destination service
Device can carry out information exchange with message system and database, as shown in Fig. 2, this method comprises:
Step 201, the message reduction instruction for carrying specified parameter is received.
In embodiments of the present invention, message is overstock due to existing in message system, so overstocked message is cached to number
In the case where according to library, when message overstocked in some queue of message system is reduced to preset threshold, destination server be can receive
It restores and instructs to message, so that the overstocked message of the queue cached in database is restored to message system by destination server
In.
Alternatively, the presence server failure in the old cluster, or when old cluster needs to change the geographical location of cluster, and lead
When cause needs to dispose new cluster replacement old cluster, message storage can will be overstock in old cluster into database.When new cluster portion
Administration finishes when needing to restore the overstocked message in old cluster, and destination server can receive message reduction instruction, so that mesh
Overstocked message in the old cluster cached in database is restored in new cluster by mark server.
Wherein, specify parameter for identifying specified buffer tag；Specified buffer tag is for identifying overstocked message to be restored.
Specified parameter includes: cluster identity and queue identity.For example, cluster identity can be cluster identity (identity, ID),
Queue identity can be queued name.
In a kind of embodiment, destination server can receive message reduction instruction, may include in message reduction instruction
Specified parameter, or including cache tag (TAG).It include: cluster identity, queue identity, timestamp and caching in TAG
Reason.Such as: the reason of caching marked in TAG, is: ClusterMigration, indicates to migrate due to cluster, need
Cache the overstocked message in old cluster.
Wherein, timestamp is used for the time of tag cache, for example, timestamp can be when receiving message cache instruction
It moment, can be at the time of being got when caching overstocked message from message system, can also be will be wait cache overstocked message
At the time of when being saved in database.
Step 202, the specified corresponding overstocked message to be restored of buffer tag is obtained in the database.
The method for obtaining overstocked message to be restored are as follows: according to specified parameter, determine specified buffer tag；Then according to specified
Buffer tag obtains overstocked message to be restored from database.
The mode for obtaining specified buffer tag may include following three kinds:
First way can obtain cluster ID and the team according to cluster ID and queued name from destination server
The corresponding buffer tag of column name (MD5) (cache overstock message when, destination server can by cluster ID, queued name and
Relational DBMS that MD5 is corresponding to be stored in destination server (My Structured Query Language,
MySQL in)).Or MD5 can be calculated directly by cluster ID and the queued name in destination server.
The second way, if repeatedly storing the overstocked message of same queue in same cluster in database, then can be with
According to cluster ID and queued name, work as pre reduction from timestamp distance in the cluster ID and corresponding TAG of queue is obtained in MySQL
Moment nearest TAG, obtains the corresponding MD5 of the TAG.
The third mode can also restore the TAG in instruction according to message, the corresponding MD5 of the TAG is obtained from MySQL.
After getting MD5, then the corresponding each overstocked message to be restored of the MD5 is obtained from HBase and (is being cached wait cache
It, can corresponding with MD5 wait cache, overstocked message is corresponding to be stored in HBase by MD5 when overstocking message).
Step 203, overstocked message to be restored is ranked up according to the sequence of the time of reception from morning to night, and according to sequence
As a result each overstocked message to be restored is successively sent to message system.
Wherein, at the time of the time of reception is that message system receives overstocked message.
In a kind of embodiment, then the time of reception of available each overstocked message to be restored disappears to be restored overstock
Breath is ranked up according to the sequence of the time of reception from morning to night (i.e. to each overstocked message to be restored according to message production to message system
The sequence of system is ranked up), each overstocked message to be restored is successively sent to message system further according to ranking results.
Such as: the sequence of three overstocked message to be restored after being ranked up according to the sequence of the time of reception from morning to night
Are as follows: message 1, message 2 and message 3.Destination server first can send message 1 to message system, then send to message system
Message 2, then message 3 is sent to message system.
A kind of message treatment method provided in an embodiment of the present invention can be right due to when restoring overstocked message to be restored
Overstocked message to be restored is ranked up according to the sequence of the time of reception from morning to night, then according to the row of each overstocked message to be restored
Sequence is as a result, successively send each overstocked message to be restored to message system.As it can be seen that the present invention can press each overstocked message to be restored
The order restoring to message system is produced into message system according to message.So the present invention can be realized the sequence after message reduction
The sequence for reaching message system with message is unified, and message consumer can disappear according to the sequence that message reaches message system to obtain
Breath.
It is understood that the premise restored to overstocked message is to overstock message to be buffered in the database, it is
The message reduction process for supporting the corresponding embodiment of Fig. 2, the embodiment of the invention also provides two kinds of message cache way, corresponding
In every kind of message cache way, a kind of message reduction mode is each provided, individually below to two kinds of cache way and two kinds
The corresponding reduction mode of cache way is illustrated:
Mode one: in conjunction with Fig. 3, when caching overstocked message, presetting T time character string, (preset time character string is used for
Indicate the period locating for the time of reception wait cache overstocked message), the corresponding MD5 of each time character string, according to respectively to
The time of reception for overstocking message is cached, it will be respectively wait cache the corresponding storage of the corresponding MD5 of overstocked message.Restoring product to be restored
When pressing message, overstocked message to be restored corresponding to each MD5 sorts according to the sequence of the time of reception from morning to night, and according to row
Sequence is as a result, successively send each overstocked message to be restored to message system.
Specifically, message cache way one comprising the following three steps:
The first step receives message cache instruction.It wherein, include: wait cache the affiliated team of overstocked message in message cache instruction
The cluster identity of the queue identity of column and the affiliated cluster of the queue.Cluster identity can be cluster ID, and queue identity can be team
Column name.
In embodiments of the present invention, when the overstocked message of a queue in message system is excessive, destination server can
To receive message cache instruction, so that destination server caches the overstocked message in the queue into database.
Alternatively, the presence server failure in the old cluster, or when old cluster needs to change the geographical location of cluster, and lead
When causing to dispose the new cluster old cluster of replacement, destination server can receive message cache instruction, so that destination service
Device caches the overstocked message in old cluster into database.
, can be from message system in a kind of embodiment, in the corresponding cluster of the cluster identity, queue identity is corresponding
It is obtained in queue wait cache overstocked message.
For example, cluster identity in message cache instruction is 1, queue identity A, then destination server is from message system
It is obtained in the queue A that cluster 1 includes wait cache overstocked message, it can be understood as the message for including in current queue A is to slow
Stockpile pressure message.
Optionally, it may also include time parameter in message cache instruction, such as time parameter is 2018010105, then cluster
It identifies in corresponding cluster, in the corresponding queue of queue identity in 1,05:59 in 05:00 to 2018 on January on January 1st, 2018
Between message system receives in section message be wait cache overstocked message.
Second step determines each preset time character string according to each preset time character string, cluster identity and queue identity
Corresponding buffer tag.
In embodiments of the present invention, 24 time character strings can be preset, for distinguishing one day 24 hour.According to pre-
If time character string, cluster identity and queue identity, the corresponding MD5 of each preset time character string is determined.Such as: time character
String are as follows: 2018080101, indicate that the time of reception wait cache overstocked message is in the 01:00-2018 August 1 on the 1st of August in 2018
In 01:59 period day.
Alternatively, can also obtain when caching in the corresponding queue of overstocked message first reception wait cache overstocked message
The time of reception T2 that quarter T1 and the last item wait caching overstocked message determines preset time character string according to the difference of T2 and T1
Number.Such as: T1=2018 August 01:12 on the 1st, T2=2018 August 03:22 on the 1st, then 20 points of T2-T1=2 hour, then
3 time character strings can be set, be respectively as follows: 2018080101,2018080102 and 2018080103.Wherein,
2018080101 indicate: the time of reception wait cache overstocked message is on August 01:00-2018 August 1 day 01 1,2018:
In 59 periods.2018080102 indicate: the time of reception wait cache overstocked message is in the 02:00-2018 on the 1st of August in 2018
In on August 1,02:59 period in.2018080103 indicate: the time of reception wait cache overstocked message is on August 1st, 2018
In 1 03:59 period of 03:00-2018 August.
In a kind of embodiment, cluster identity, queue identity and preset time string-concatenation can be tied according to splicing
Fruit calculates the buffer tag (MD5) for overstocking message.According to MD5 and respectively wait cache the ID of overstocked message, line unit (RowKey) is determined,
That is, RowKey=MD5+MessageID.RowKey and RowKey is corresponding wait cache overstocked message, and correspondence is stored in HBase
In.
It in another embodiment, can also be according to cluster identity, queue identity, preset time character string and time
Stamp, determines the buffer tag wait cache overstocked message；It is overstocked wait cache again by buffer tag, respectively wait cache overstocked message identifier
Message identifier is corresponding, and wait cache, overstocked message is corresponding to be saved in the database.
In embodiments of the present invention, it is made of due to the RowKey in HBase MD5 and MessageID, a MD5
A corresponding Block, multiple Block form a region (Region), and different Region is distributed in different regional services
(RegionServer) in, it can achieve the purpose of equally loaded.And the MessageID in RowKey is for distinguishing each product
Message is pressed, avoids conflicting.
In embodiments of the present invention, by buffer tag, respectively wait cache overstocked message identifier, wait cache overstocked message identifier
It is corresponding after caching that overstocked message is corresponding and saving in the database, can using cluster identity, queue identity and timestamp as
Cache tag (TAG), by the Relational DBMS (My of the corresponding preservation of TAG and MD5 to destination server
Structured Query Language, MySQL) in.Optionally, can also be including caching in TAG the reason of.
Third step, each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message into database.
In a kind of embodiment, the time of reception respectively wait cache overstocked message is obtained, is then according to the time of reception
Period determines that each buffer tag is corresponding corresponding with buffer tag to slow wait cache overstocked message, then by each buffer tag
The corresponding preservation of pressure message is stockpiled into database.
Corresponding to above-mentioned message cache way one, it includes following four step that message, which restores mode one:
The first step receives and carries the message reduction instruction for specifying parameter, and then according to specifying, parameter is determining to specify caching mark
Label, then the specified corresponding overstocked message to be restored of buffer tag is obtained in the database.Wherein, specify parameter specified for identifying
Buffer tag；Specified buffer tag is for identifying overstocked message to be restored.
In a kind of embodiment, specified parameter can be with are as follows: cluster identity and queue identity, cluster identity can be cluster
ID, queue identity can be queued name.Since when message caches, cluster ID, queued name and MD5 are that correspondence is stored in
In MySQL, so destination server can obtain cluster ID from MySQL and queued name is corresponding in message reduction
MD5.
Such as: if the corresponding overstocked message to be restored of cluster ID and queued name caching when, altogether be equipped with 24 it is default when
Between character string, then message restore when, 24 MD5 can be obtained according to cluster ID and queue identity.
In another embodiment, specified parameter can be TAG.Due to when message caches, cluster ID, queued name,
MD5 and TAG is that correspondence is stored in MySQL, wherein N number of MD5 corresponds to unique TAG.So in message reduction, target
Server can obtain the corresponding N number of MD5 of the TAG from MySQL.
Such as: if the corresponding overstocked message to be restored of TAG in caching, is equipped with 24 preset time character strings altogether, then exists
When message restores, 24 MD5 can be obtained according to the TAG.
Second step, according to the period sequence from morning to night of preset time string representation, to each specified buffer tag
It is ranked up.
Such as: 3 MD5:MD5 (1) of specified gain of parameter in instructing, MD5 (2) and MD5 (3), MD5 are restored according to message
(1) time character string in are as follows: the time character string in 2018080102, MD5 (2) are as follows: in 2018080103, MD5 (3) when
Between character string are as follows: 2018080101.The sequence of the period that then this 3 MD5 are indicated according to time character string from morning to night, into
Sequence after row sequence are as follows: MD5 (3), MD5 (1) and MD5 (2).
Third step, it is corresponding to be restored to each specified buffer tag respectively according to the sequence of the time of reception from morning to night
Overstocked message is ranked up.
Such as: specified buffer tag has corresponded to 3 overstocked message to be restored, is respectively as follows: message 1, message 2 and message 3.Disappear
The time of reception of breath 1 are as follows: 201808010005, the time of reception of message 2 are as follows: 201808010003, the time of reception of message 3
Are as follows: 201808010001.The then sequence to this 3 overstocked message to be restored according to the time of reception from morning to night, after being ranked up
Sequence are as follows: message 3, message 2 and message 1.
In embodiments of the present invention, the second step of message reduction mode one and third step may be performed simultaneously, can also be by
It is executed according to the sequence for executing third step after second step is first carried out, it can also be according to first carrying out the sequence for executing second step after third step
It executes, what the application did not limited the two steps executes sequence.
4th step, then the sequence according to the time of reception from morning to night, successively sends each to be restored overstocked to message system
Message.
In a kind of embodiment, first each specified buffer tag can be ranked up, then according to the time of reception from morning to
The sequence in evening is ranked up the corresponding overstocked message to be restored of first specified buffer tag, according still further to ranking results, to disappearing
Breath system successively sends the corresponding overstocked message to be restored of first specified buffer tag.It is corresponding to other specified buffer tags again
Overstocked message to be restored successively execute the above operation.
In another embodiment, each specified buffer tag can be ranked up, then to each specified buffer tag pair
The overstocked message to be restored answered is ranked up.After the completion of sequence, further according to ranking results, successively sent to message system respectively to also
The overstocked message of original.
Mode two: in conjunction with Fig. 4, when caching overstocked message, presetting N number of cryptographic Hash, (default cryptographic Hash is for indicating to slow
Stockpile the corresponding cryptographic Hash of mark of pressure message), the corresponding MD5 of each cryptographic Hash, according to the mark respectively wait cache overstocked message
Know corresponding cryptographic Hash, it will be respectively wait cache the corresponding storage of the corresponding MD5 of overstocked message.Restoring overstocked message to be restored
When, overstocked message to be restored corresponding to each MD5 sorts according to the sequence of the time of reception from morning to night, is then tied according to sequence
Fruit stores each overstocked message to be restored Dao data storage (DataLog) in order, then takes out from DataLog and to message
System successively sends each overstocked message to be restored.
Specifically, message cache way two comprising the following three steps:
The first step receives message cache instruction.It wherein, include: wait cache the affiliated team of overstocked message in message cache instruction
The cluster identity of the queue identity of column and the affiliated cluster of the queue.
This step is identical as the first step of message cache way one, can refer to the correlation of the first step in message cache way one
Description, details are not described herein.
Second step determines that each default cryptographic Hash is corresponding slow according to each default cryptographic Hash, cluster identity and queue identity
Deposit label.
In embodiments of the present invention, N number of cryptographic Hash can be preset.According to default cryptographic Hash, cluster identity and queue identity,
Calculate each default corresponding MD5 of cryptographic Hash.Such as: default cryptographic Hash is 1, indicates the corresponding Kazakhstan ID wait cache overstocked message
Uncommon value is 1, i.e., according to the calculated MD5 of cryptographic Hash 1 mark wait cache overstocked message are as follows: the product that the cryptographic Hash of message id is 1
Press message.
Alternatively, can also be according to wait cache the quantity of overstocked message, the size wait cache overstocked message and destination server
The size of memory determines the quantity of cryptographic Hash.
In a kind of embodiment, cluster identity, queue identity and default cryptographic Hash can be spliced, according to splicing result meter
Calculate the buffer tag (MD5) wait cache overstocked message.According to MD5 and respectively wait cache the ID of overstocked message, line unit is determined
(RowKey), that is, RowKey=MD5+MessageID.RowKey and RowKey is corresponding wait cache overstocked message, it is corresponding to protect
There are in HBase.
It in another embodiment, can also be according to cluster identity, queue identity, default cryptographic Hash and timestamp, really
Determine the buffer tag wait cache overstocked message；Again by buffer tag, respectively wait cache overstocked message identifier, wait cache overstocked message mark
Know corresponding wait cache the corresponding preservation of overstocked message in the database.
Third step, each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message into database.
In a kind of embodiment, the cryptographic Hash respectively wait cache overstocked message is calculated, is then determined respectively wait cache overstocked message
Corresponding buffer tag, each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message into database.
Corresponding to above-mentioned message cache way two, it includes following four step that message, which restores mode two:
The first step receives and carries the message reduction instruction for specifying parameter, and then according to specifying, parameter is determining to specify caching mark
Label, then the specified corresponding overstocked message to be restored of buffer tag is obtained in the database.Wherein, specify parameter specified for identifying
Buffer tag；Specified buffer tag is for identifying overstocked message to be restored.
In a kind of embodiment, specified parameter can be with are as follows: cluster identity and queue identity, cluster identity can be cluster
ID, queue identity can be queued name.Since when message caches, cluster ID, queued name and MD5 are that correspondence is stored in
In MySQL, so destination server can obtain cluster ID from MySQL and queued name is corresponding in message reduction
MD5.
Such as: if the corresponding overstocked message to be restored of cluster ID and queued name in caching, is equipped with N number of default Hash altogether
Value can obtain N number of MD5 according to cluster ID and queue identity then when message is restored.
In another embodiment, specified parameter can be TAG.Due to when message caches, cluster ID, queued name,
MD5 and TAG is that correspondence is stored in MySQL.Wherein, N number of MD5 corresponds to unique TAG.So in message reduction, target
Server can obtain the corresponding N number of MD5 of the TAG from MySQL.
Such as: if the corresponding overstocked message to be restored of TAG caching when, altogether be equipped with N number of default cryptographic Hash, then message also
When former, N number of MD5 can be obtained according to the TAG.
Second step, it is corresponding to be restored to each specified buffer tag respectively according to the sequence of the time of reception from morning to night
It overstocks message and carries out internal sort.
In embodiments of the present invention, since the corresponding overstocked message number to be restored of N number of MD5 is larger, can not will be needed
It restores to overstock message while calling in memory and be ranked up, so can only be carried out by external sort to each overstocked message to be restored
Sequence.Wherein, external sort includes: internal sort and merger sequence.
Internal sort refers to: the corresponding overstocked message to be restored of buffer tag will be each specified respectively, call in memory, according to
The sequence of the time of reception from morning to night, is ranked up.
Such as: specified buffer tag has corresponded to 3 overstocked message to be restored, is respectively as follows: message 1, message 2 and message 3.Disappear
The time of reception of breath 1 are as follows: 201808010005, the time of reception of message 2 are as follows: 201808010003, the time of reception of message 3
Are as follows: 201808010001.The then sequence to this 3 overstocked message to be restored according to the time of reception from morning to night carries out internal sort
Sequence afterwards are as follows: message 3, message 2 and message 1.
Third step, according to the internal sort of the corresponding overstocked message to be restored of each specified buffer tag as a result, when according to receiving
Sequence from morning to night is carved, merger sequence is carried out to the corresponding overstocked message to be restored of each specified buffer tag.
Such as: there are 3 specified buffer tags, is respectively as follows: label 1, label 2 and label 3, the corresponding message 1 of label 1 and message
2, the corresponding message 3 of label 2 and message 4, label 3 correspond to message 5 and message 6.Corresponding first, three labels is then taken to disappear respectively
Breath: message 1, message 3 and message 5 are ranked up this three message according to the sequence of the time of reception from morning to night.Assuming that disappearing
The time of reception of breath 1 then makes number one message 1 earlier than message 3 and message 5, and removes a piece of news from label 1: disappearing
Breath 2.Further according to the sequence of the time of reception from morning to night, message 2, message 3 and message 5 are ranked up, until 3 specified labels
Corresponding overstocked message to be restored, which all sorts, to be finished.
4th step, according to the merger ranking results of the corresponding overstocked message to be restored of each specified buffer tag, to message system
System successively sends each overstocked message to be restored.
In a kind of embodiment, it will successively be stored in DataLog by each overstocked message to be restored of merger sequence, number
According to one location information (offset) of maintenance in library, position locating for the overstocked message to be restored that next needs of expression are acquired
It sets.When restoring overstocked message to be restored, destination server can successively obtain each overstocked message to be restored according to offset,
And each overstocked message to be restored is sent to message system.
Using the embodiment of the present invention, the time of message system can be reached according to message, to each overstocked message to be restored into
Row sequence sends each overstocked message to be restored to message system then further according to ranking results.It can be ensured that message restores
It is unified to the sequence of message system and the sequence of message arrival message system.
For the prior art using the message of multi-threaded parallel caching when message restores, message reverts to the sequence of message system
It is different from the message arrival sequence of message system, it is possible that message consumer is caused to be operated according to the message got
The message inaccuracy that operation order mistake or message consumer get.Such as: message system successively receive two for
The operation information comprising operational order of object A, respectively message 1, message 2.
The operational order that message 1 includes is: by A multiplied by 2, the operational order that message 2 includes is: by A plus 10.According to
Multi-threaded parallel caches this two message, becomes the sequence of this two message in message reduction: message 2, message 1, then
Message consumer is when obtaining two message for object A, it will first gets message 2, then gets message 1.Cause pair
Object A is executed: first plus 10, multiplied by 2.As it can be seen that the sequence of message 1 and message 2 changes, message consumer's execution will lead to
Operation order mistake.
In another example the message that commodity A is bought in message system shares 5, sequence are as follows: message 1, message 2, message 3, message
4 and message 5.This five message cached using multi-threaded parallel, if reverting to the sequence of message system in message reduction
Are as follows: message 5, message 4, message 3, message 2 and message 1.At this point, message consumer needs first 3 of acquisition purchase commodity A to disappear
Breath, should obtain message 1, message 2 and message 3, but after message restores, acquisition is message 5, message 4 and message originally
3.So the prior art using the message of multi-threaded parallel caching after message reduction, may cause that message consumer receives disappears
Breath inaccuracy.
And in embodiments of the present invention, it can guarantee that overstocked message to be restored, in reduction, is produced in message according to message
Sequence to message system sorts, and successively sends each overstocked message to be restored, therefore this to message system according to ranking results
The sequence for the message that inventive embodiments can allow message consumer to receive produces the sequence unification to message system with message.So
The embodiment of the present invention can be improved the accuracy for the operation order that message consumer is operated according to the message got, and
Improve the message accuracy that message consumer receives.
Corresponding to above method embodiment, as shown in figure 5, being answered the embodiment of the invention provides a kind of message processing apparatus
For destination server, destination server can carry out information exchange with message system and database, which includes: reception mould
Block 501 obtains module 502 and sending module 503.
Receiving module 501, for receiving the message reduction instruction for carrying specified parameter, specified parameter is specified slow for identifying
Label is deposited, specified buffer tag is for identifying overstocked message to be restored；
Module 502 is obtained, it is corresponding to be restored for obtaining the received specified buffer tag of receiving module in the database
Overstock message；
Sending module 503, for obtaining overstocked message to be restored that module obtains according to the time of reception from morning to night
Sequence is ranked up, and successively sends each overstocked message to be restored to message system according to ranking results, and the time of reception is message
At the time of system receives overstocked message.
Optionally, which can also include: the first determining module and the first preserving module；
Receiving module 501, is also used to receive message cache instruction, includes: wait cache overstocked message in message cache instruction
The cluster identity of the queue identity of affiliated queue and the affiliated cluster of the queue；
First determining module, for according to each preset time character string, the received cluster identity of receiving module and queue mark
Know, determines the corresponding buffer tag of each preset time character string, preset time character string is for indicating wait cache overstocked message
The time of reception locating for the period；
First preserving module, for each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message extremely
In database.
Optionally, sending module 503 can be specifically used for:
According to the period sequence from morning to night of preset time string representation, each specified buffer tag is arranged
Sequence；According to the sequence of the time of reception from morning to night, overstocked message to be restored corresponding to each specified buffer tag is carried out respectively
Sequence；According to the sequence of the time of reception from morning to night, each overstocked message to be restored is successively sent to message system.
Optionally, which can also include: the second determining module and the second preserving module；
Receiving module 501, is also used to receive message cache instruction, includes: wait cache overstocked message in message cache instruction
The cluster identity of the queue identity of affiliated queue and the affiliated cluster of the queue；
Second determining module is used for according to each default cryptographic Hash, the received cluster identity of receiving module and queue identity, really
The fixed each default corresponding buffer tag of cryptographic Hash, default cryptographic Hash are used to indicate the corresponding Kazakhstan of mark wait cache overstocked message
Uncommon value；
Second preserving module, for each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message extremely
In database.
Optionally, sending module 503 can be specifically used for:
According to the sequence of the time of reception from morning to night, respectively to the corresponding overstocked message to be restored of each specified buffer tag
Carry out internal sort；According to the internal sort of the corresponding overstocked message to be restored of each specified buffer tag as a result, according to the time of reception from
The early sequence to evening carries out merger sequence to the corresponding overstocked message to be restored of each specified buffer tag；According to each specified caching
The merger ranking results of the corresponding overstocked message to be restored of label, each overstocked message to be restored is successively sent to message system.
A kind of message processing apparatus provided in an embodiment of the present invention can be right due to when restoring overstocked message to be restored
Overstocked message to be restored is ranked up according to the sequence of the time of reception from morning to night, then according to the row of each overstocked message to be restored
Sequence is as a result, successively send each overstocked message to be restored to message system.As it can be seen that the present invention can press each overstocked message to be restored
The order restoring to message system is produced into message system according to message, so the present invention can be realized the sequence after message reduction
The sequence for reaching message system with message is unified, and message consumer can disappear according to the sequence that message reaches message system to obtain
Breath.
The embodiment of the invention also provides a kind of servers, as shown in fig. 6, including processor 601, communication interface 602, depositing
Reservoir 603 and communication bus 604, wherein processor 601, communication interface 602, memory 603 are completed by communication bus 604
Mutual communication,
Memory 603, for storing computer program；
Processor 601 when for executing the program stored on memory 603, is realized in above method embodiment by mesh
Mark the step of server executes.
The communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component
Interconnect, PCI) bus or expanding the industrial standard structure (Extended Industry Standard
Architecture, EISA) bus etc..The communication bus can be divided into address bus, data/address bus, control bus etc..For just
It is only indicated with a thick line in expression, figure, it is not intended that an only bus or a type of bus.
Communication interface is for the communication between above-mentioned electronic equipment and other equipment.
Memory may include random access memory (Random Access Memory, RAM), also may include non-easy
The property lost memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, memory may be used also
To be storage device that at least one is located remotely from aforementioned processor.
Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit,
CPU), network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital Signal
Processing, DSP), it is specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing
It is field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete
Door or transistor logic, discrete hardware components.
In another embodiment provided by the invention, a kind of computer readable storage medium is additionally provided, which can
It reads to be stored with computer program in storage medium, the computer program realizes any of the above-described Message Processing when being executed by processor
The step of method.
In another embodiment provided by the invention, a kind of computer program product comprising instruction is additionally provided, when it
When running on computers, so that computer executes any message treatment method in above-described embodiment.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program
Product includes one or more computer instructions.When loading on computers and executing the computer program instructions, all or
It partly generates according to process or function described in the embodiment of the present invention.The computer can be general purpose computer, dedicated meter
Calculation machine, computer network or other programmable devices.The computer instruction can store in computer readable storage medium
In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer
Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center
User's line (DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or
Data center is transmitted.The computer readable storage medium can be any usable medium that computer can access or
It is comprising data storage devices such as one or more usable mediums integrated server, data centers.The usable medium can be with
It is magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard disk
Solid State Disk (SSD)) etc..
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for device reality
For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are included within the scope of protection of the present invention.
Claims (12)
1. a kind of message treatment method, which is characterized in that be applied to destination server, the destination server can be with message system
System and database carry out information exchange, which comprises
The message reduction instruction for carrying specified parameter is received, the specified parameter is described specified for identifying specified buffer tag
Buffer tag is for identifying overstocked message to be restored；
The corresponding overstocked message to be restored of the specified buffer tag is obtained in the database；
Overstocked message to be restored is ranked up according to the sequence of the time of reception from morning to night, and is disappeared according to ranking results to described
Breath system successively sends each overstocked message to be restored, at the time of the time of reception is that message system receives overstocked message.
2. the method according to claim 1, wherein the method also includes:
Message cache instruction is received, includes: the queue identity wait cache the affiliated queue of overstocked message in the message cache instruction,
With the cluster identity of the affiliated cluster of the queue；
According to each preset time character string, the cluster identity and the queue identity, each preset time character string pair is determined
The buffer tag answered, preset time character string are used to indicate the period locating for the time of reception wait cache overstocked message；
Each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message into the database.
3. according to the method described in claim 2, it is characterized in that, it is described to overstocked message to be restored according to the time of reception from morning
Sequence to evening is ranked up, and successively sends each overstocked message to be restored to the message system according to ranking results, comprising:
According to the period sequence from morning to night of preset time string representation, each specified buffer tag is ranked up；
According to the sequence of the time of reception from morning to night, overstocked message to be restored corresponding to each specified buffer tag is carried out respectively
Sequence；
According to the sequence of the time of reception from morning to night, Xiang Suoshu message system successively sends each overstocked message to be restored.
4. the method according to claim 1, wherein the method also includes:
Message cache instruction is received, includes: the queue identity wait cache the affiliated queue of overstocked message in the message cache instruction,
With the cluster identity of the affiliated cluster of the queue；
According to each default cryptographic Hash, the cluster identity and the queue identity, each default corresponding caching of cryptographic Hash is determined
Label, the default cryptographic Hash are used to indicate the corresponding cryptographic Hash of mark wait cache overstocked message；
Each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message into the database.
5. according to the method described in claim 4, it is characterized in that, it is described to overstocked message to be restored according to the time of reception from morning
Sequence to evening is ranked up, and successively sends each overstocked message to be restored to the message system according to ranking results, comprising:
According to the sequence of the time of reception from morning to night, overstocked message to be restored corresponding to each specified buffer tag is carried out respectively
Internal sort；
According to the internal sort of the corresponding overstocked message to be restored of each specified buffer tag as a result, from morning to night according to the time of reception
Sequentially, overstocked message to be restored corresponding to each specified buffer tag carries out merger sequence；
According to the merger ranking results of the corresponding overstocked message to be restored of each specified buffer tag, Xiang Suoshu message system is successively sent out
Send each overstocked message to be restored.
6. a kind of message processing apparatus, which is characterized in that be applied to destination server, the destination server can be with message system
System and database carry out information exchange, and described device includes:
Receiving module, for receiving the message reduction instruction for carrying specified parameter, the specified parameter is for identifying specified caching
Label, the specified buffer tag is for identifying overstocked message to be restored；
Module is obtained, it is corresponding to be restored for obtaining the received specified buffer tag of the receiving module in the database
Overstock message；
Sending module, sequence of the overstocked message to be restored according to the time of reception from morning to night for being obtained to the acquisition module
It is ranked up, and successively sends each overstocked message to be restored to message system according to ranking results, the time of reception is message
At the time of system receives overstocked message.
7. device according to claim 6, which is characterized in that described device further include: the first determining module and first is protected
Storing module；
The receiving module is also used to receive message cache instruction, includes: wait cache overstocked message in the message cache instruction
The cluster identity of the queue identity of affiliated queue and the affiliated cluster of the queue；
First determining module, for according to each preset time character string, the received cluster identity of the receiving module
With the queue identity, determine the corresponding buffer tag of each preset time character string, preset time character string for indicate to
It caches and overstocks the period locating for the time of reception of message；
First preserving module, for each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message extremely
In the database.
8. device according to claim 7, which is characterized in that the sending module is specifically used for:
According to the period sequence from morning to night of preset time string representation, each specified buffer tag is ranked up；It presses
According to the sequence of the time of reception from morning to night, the corresponding overstocked message to be restored of each specified buffer tag is ranked up respectively；
According to the sequence of the time of reception from morning to night, Xiang Suoshu message system successively sends each overstocked message to be restored.
9. device according to claim 6, which is characterized in that described device further include: the second determining module and second is protected
Storing module；
The receiving module is also used to receive message cache instruction, includes: wait cache overstocked message in the message cache instruction
The cluster identity of the queue identity of affiliated queue and the affiliated cluster of the queue；
Second determining module, for according to each default cryptographic Hash, the received cluster identity of the receiving module and institute
Queue identity is stated, determines each default corresponding buffer tag of cryptographic Hash, the default cryptographic Hash is for indicating overstocked wait cache
The corresponding cryptographic Hash of the mark of message；
Second preserving module, for each buffer tag and buffer tag is corresponding wait cache the corresponding preservation of overstocked message extremely
In the database.
10. device according to claim 9, which is characterized in that the sending module is specifically used for:
According to the sequence of the time of reception from morning to night, overstocked message to be restored corresponding to each specified buffer tag is carried out respectively
Internal sort；According to the internal sort of the corresponding overstocked message to be restored of each specified buffer tag as a result, according to the time of reception from morning to
The sequence in evening, overstocked message to be restored corresponding to each specified buffer tag carry out merger sequence；According to each specified buffer tag
The merger ranking results of corresponding overstocked message to be restored, Xiang Suoshu message system successively send each overstocked message to be restored.
11. a kind of message handling system, which is characterized in that including destination server described in claim 6-10 and right
It is required that database and message system that 6-10 is related to；
The database is used to receive each buffer tag product to be cached corresponding with buffer tag that the destination server is sent
Message is pressed, corresponding overstocked message is corresponding to be saved into a cache unit wait cache by each buffer tag and buffer tag.
12. a kind of server, which is characterized in that including processor, communication interface, memory and communication bus, wherein processing
Device, communication interface, memory complete mutual communication by communication bus；
Memory, for storing computer program；
Processor when for executing the program stored on memory, realizes any method and step of claim 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910129887.7A CN109783258B (en) | 2019-02-21 | 2019-02-21 | Message processing method and device and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910129887.7A CN109783258B (en) | 2019-02-21 | 2019-02-21 | Message processing method and device and server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109783258A true CN109783258A (en) | 2019-05-21 |
| CN109783258B CN109783258B (en) | 2021-02-23 |
Family
ID=66485857
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910129887.7A Active CN109783258B (en) | 2019-02-21 | 2019-02-21 | Message processing method and device and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109783258B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111683140A (en) * | 2020-06-05 | 2020-09-18 | 北京百度网讯科技有限公司 | Method and apparatus for distributing messages |
| CN111813370A (en) * | 2020-07-08 | 2020-10-23 | 上海雪湖科技有限公司 | Multi-path parallel merging and sorting system based on FPGA |
| CN113296977A (en) * | 2021-02-24 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Message processing method and device |
| CN113489635A (en) * | 2021-06-18 | 2021-10-08 | 深圳软牛科技有限公司 | WeChat-based message recovery method and related equipment |
| CN113778701A (en) * | 2021-01-07 | 2021-12-10 | 北京沃东天骏信息技术有限公司 | Message processing method and device, electronic device and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102469033A (en) * | 2010-11-01 | 2012-05-23 | 阿里巴巴集团控股有限公司 | Message subscription system and message sending method |
| US20150067067A1 (en) * | 2013-08-27 | 2015-03-05 | International Business Machines Corporation | Data Communications In A Distributed Computing Environment |
| US20150271256A1 (en) * | 2014-03-19 | 2015-09-24 | Dell Products L.P. | Message Processing Using Dynamic Load Balancing Queues in a Messaging System |
| CN108228363A (en) * | 2017-12-22 | 2018-06-29 | 中国银联股份有限公司 | A kind of message method and device |
| CN108270662A (en) * | 2017-12-26 | 2018-07-10 | 微梦创科网络科技（中国）有限公司 | A kind of message distributing method, device and equipment |
| CN108664337A (en) * | 2018-03-23 | 2018-10-16 | 北京奇艺世纪科技有限公司 | A kind of the message decompression method and device of distributed system |
| US20190042336A1 (en) * | 2017-08-07 | 2019-02-07 | Apple Inc. | Methods and apparatus for scheduling time sensitive operations among independent processors |
-
2019
- 2019-02-21 CN CN201910129887.7A patent/CN109783258B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102469033A (en) * | 2010-11-01 | 2012-05-23 | 阿里巴巴集团控股有限公司 | Message subscription system and message sending method |
| US20150067067A1 (en) * | 2013-08-27 | 2015-03-05 | International Business Machines Corporation | Data Communications In A Distributed Computing Environment |
| US20150271256A1 (en) * | 2014-03-19 | 2015-09-24 | Dell Products L.P. | Message Processing Using Dynamic Load Balancing Queues in a Messaging System |
| US20190042336A1 (en) * | 2017-08-07 | 2019-02-07 | Apple Inc. | Methods and apparatus for scheduling time sensitive operations among independent processors |
| CN108228363A (en) * | 2017-12-22 | 2018-06-29 | 中国银联股份有限公司 | A kind of message method and device |
| CN108270662A (en) * | 2017-12-26 | 2018-07-10 | 微梦创科网络科技（中国）有限公司 | A kind of message distributing method, device and equipment |
| CN108664337A (en) * | 2018-03-23 | 2018-10-16 | 北京奇艺世纪科技有限公司 | A kind of the message decompression method and device of distributed system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111683140A (en) * | 2020-06-05 | 2020-09-18 | 北京百度网讯科技有限公司 | Method and apparatus for distributing messages |
| CN111683140B (en) * | 2020-06-05 | 2024-03-19 | 北京百度网讯科技有限公司 | Method and apparatus for distributing messages |
| CN111813370A (en) * | 2020-07-08 | 2020-10-23 | 上海雪湖科技有限公司 | Multi-path parallel merging and sorting system based on FPGA |
| CN111813370B (en) * | 2020-07-08 | 2023-10-31 | 上海雪湖科技有限公司 | Multi-path parallel merging and sequencing system based on FPGA |
| CN113778701A (en) * | 2021-01-07 | 2021-12-10 | 北京沃东天骏信息技术有限公司 | Message processing method and device, electronic device and medium |
| CN113296977A (en) * | 2021-02-24 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Message processing method and device |
| CN113489635A (en) * | 2021-06-18 | 2021-10-08 | 深圳软牛科技有限公司 | WeChat-based message recovery method and related equipment |
| CN113489635B (en) * | 2021-06-18 | 2023-08-18 | 深圳软牛科技有限公司 | WeChat-based message recovery method and related equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109783258B (en) | 2021-02-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109783258A (en) | A kind of message treatment method, device and server | |
| US20210056073A1 (en) | Block data storage system in an event historian | |
| US9842134B2 (en) | Data query interface system in an event historian | |
| US10606806B2 (en) | Method and apparatus for storing time series data | |
| CN107066570A (en) | Data managing method and device | |
| CN107025289B (en) | A kind of method and relevant device of data processing | |
| CN105450618A (en) | Operation method and operation system of big data process through API (Application Programming Interface) server | |
| CN104750740A (en) | Data renewing method and device | |
| CN105637510B (en) | Acceleration based on cache flow | |
| US10812322B2 (en) | Systems and methods for real time streaming | |
| CN109885786A (en) | Data buffer storage processing method, device, electronic equipment and readable storage medium storing program for executing | |
| CN109800269A (en) | Data managing method, device, computer equipment and storage medium | |
| WO2014065115A1 (en) | Rule distribution server, as well as event processing system, method, and program | |
| CN104216698A (en) | Webpage registration method and relative device | |
| US9658924B2 (en) | Event data merge system in an event historian | |
| US20160125060A1 (en) | Asynchronous processing time metrics | |
| CN114416868A (en) | Data synchronization method, device, equipment and storage medium | |
| CN111753019A (en) | Data partitioning method and device applied to data warehouse | |
| CN113626449A (en) | Data storage method, data query method and related equipment | |
| CN112699187A (en) | Associated data processing method, device, equipment, medium and product | |
| CN104536784B (en) | Real-time system update method and device | |
| CN110008243A (en) | A kind of tables of data processing method and processing device | |
| CN109918213A (en) | A kind of message treatment method, device and server | |
| US10579601B2 (en) | Data dictionary system in an event historian | |
| CN109254880A (en) | A kind of method and device handling database delay machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |