CN113064742A - Message processing method, device, equipment and storage medium - Google Patents
Message processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113064742A CN113064742A CN202110386257.5A CN202110386257A CN113064742A CN 113064742 A CN113064742 A CN 113064742A CN 202110386257 A CN202110386257 A CN 202110386257A CN 113064742 A CN113064742 A CN 113064742A
- Authority
- CN
- China
- Prior art keywords
- message
- preset
- queue
- service
- produced
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 31
- 238000012545 processing Methods 0.000 claims abstract description 90
- 230000000903 blocking effect Effects 0.000 claims abstract description 53
- 230000003111 delayed effect Effects 0.000 claims description 30
- 238000000034 method Methods 0.000 claims description 27
- 230000005540 biological transmission Effects 0.000 claims description 22
- 230000008569 process Effects 0.000 claims description 15
- 230000008859 change Effects 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 238000007639 printing Methods 0.000 claims description 5
- 230000000737 periodic effect Effects 0.000 claims description 3
- 230000003139 buffering effect Effects 0.000 claims 1
- 238000012423 maintenance Methods 0.000 abstract description 15
- 238000005516 engineering process Methods 0.000 abstract description 3
- 230000008676 import Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000011161 development Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to the technical field of big data, and discloses a message processing method, a device, equipment and a storage medium, which are used for improving service maintenance efficiency and code readability and improving message processing efficiency. The message processing method comprises the following steps: generating a service switch and a service message queue according to an environment configuration object through a preset consumer tool class; respectively transmitting a plurality of produced messages into corresponding service message queues through a service switch; caching at least one produced message pushed from a service message queue in real time into a preset blocking queue in a local service through a preset subscriber; reading each batch of message data in batch from a preset blocking queue every other preset waiting time, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread. In addition, the invention also relates to a block chain technology, and each batch of message data can be stored in the block chain node.
Description
Technical Field
The invention relates to the field of batch updating of big data technology, in particular to a message processing method, a device, equipment and a storage medium.
Background
The message queue middleware is an important component in a distributed system, mainly solves the problems of application decoupling, asynchronous messages, traffic peak clipping, message communication and the like, and realizes a high-performance, high-availability, scalable and final consistency framework.
The message queue rabbitmq is one of common message queue middleware, only basic rabbitmq method calls are provided in the market at present, and common method call dependency packages comprise an advanced message queue protocol (amqp) based on a micro-framework springboot and a message-driven stream-rabbitit based on a security tool package springbound. The amqp dependency package is directly used in a project, and because the calling method of the amqp is referred to as a character string instead of an object, the method for creating the message queue needs to be called one by one or declared one by one in one class, so that not only is the code amount large, but also the consumption server cannot be controlled according to the internet protocol address through a class declaration mode, and the problems of high service maintenance cost and low service maintenance efficiency are caused, and the existing message queue is lack of controllable batch consumption messages, so that the problems of server resource waste and low message throughput rate exist.
Disclosure of Invention
The invention provides a message processing method, a message processing device, message processing equipment and a storage medium, which are used for improving service maintenance efficiency and code readability and improving message processing efficiency.
In order to achieve the above object, a first aspect of the present invention provides a message processing method, including: instantiating an environment configuration object, generating a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establishing a corresponding binding relationship between the service switch and the service message queue, wherein the service message queue is a real-time message queue or a delay message queue; transmitting a produced message to the service switch through a preset message middleware, transmitting the produced message to the service message queue through the service switch according to the binding relationship, transmitting the produced message with the expired delayed transmission time into the real-time message queue when the produced message waits for a preset delayed transmission time in the delayed message queue, wherein the delayed transmission time corresponding to the same delayed message queue is the same; receiving at least one produced message pushed by the real-time message queue through a preset subscriber, and caching the at least one produced message into a preset blocking queue; and reading each batch of message data from the preset blocking queue in batch at intervals of preset waiting time, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread.
Optionally, in a first implementation manner of the first aspect of the present invention, the instantiating an environment configuration object, generating a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establishing a corresponding binding relationship between the service switch and the service message queue, where the service message queue is a real-time message queue or a delayed message queue, includes: instantiating an environment configuration object, and starting a preset consumer tool class, wherein the environment configuration object comprises a preset real-time switch name, a preset real-time message queue name, a preset delay switch name, a preset delay message queue name and a preset delay sending time length, and the preset delay sending time length is in one-to-one correspondence with a preset queue sequence number rule; generating a service switch and a service message queue according to the preset real-time switch name, the preset delay switch name, the preset real-time message queue name and the preset delay message queue name through the preset consumer tool class, wherein the service switch comprises a real-time switch and a delay switch, and the service message queue comprises a real-time message queue and a delay message queue; and respectively setting a delay sequence number and a delay parameter of a delay message queue based on the preset queue sequence number rule and the delay sending duration corresponding to the queue sequence number rule, and establishing a corresponding binding relationship between the service switch and the service message queue.
Optionally, in a second implementation manner of the first aspect of the present invention, the transmitting a produced message to the service switch through a preset message middleware, transmitting the produced message to the service message queue through the service switch according to the binding relationship, and transmitting the produced message with a delay transmission time expired to the real-time message queue when the produced message waits for a preset delay transmission time in the delay message queue, where delay transmission times corresponding to the same delay message queue are the same, includes: receiving a produced message sent by a preset producer tool class, and transmitting the produced message to the service switch through a preset message middleware, wherein the produced message carries an expected consumption time limit which is used for indicating that the produced message is a real-time message or a delay message; determining a message type corresponding to the produced message based on the expected consumption time, and matching a corresponding target switch from the service switches according to the message type, wherein the target switch is a real-time switch or a delay switch; the produced message is transmitted into a corresponding service message queue through the target switch according to the binding relationship, and the delay sending time lengths corresponding to the same delay message queue are the same; when the produced message waits for a preset delay sending time length in the delay message queue, the produced message with the expired delay sending time length is transmitted to the real-time switch, and the produced message with the expired delay sending time length is stored in the real-time message queue through the real-time switch.
Optionally, in a third implementation manner of the first aspect of the present invention, the receiving, by a preset subscriber, at least one produced message pushed by the real-time message queue, and caching the at least one produced message in a preset blocking queue includes: receiving at least one produced message pushed by the real-time message queue through a preset subscriber, and performing data format conversion on each produced message to obtain a converted message data set; and writing the converted message data set into a preset blocking queue, wherein the preset blocking queue is a memory buffer area.
Optionally, in a fourth implementation manner of the first aspect of the present invention, the reading each batch of message data in batch from the preset blocking queue every preset waiting duration, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread includes: reading each batch of message data from the preset blocking queue in batch at intervals of preset waiting time according to the preset maximum consumption quantity of each batch, wherein the quantity of each batch of message data is less than or equal to the preset maximum consumption quantity of each batch; creating an actual consumer thread in a preset consumer thread pool according to the number of the preset maximum consumer threads, processing each batch of message data through the actual consumer thread to obtain a processing result, and sending the processing result to a message middleware, so that the message middleware transmits a message state corresponding to each produced message.
Optionally, in a fifth implementation manner of the first aspect of the present invention, after the batch reading of each batch of message data from the preset blocking queue at every preset waiting duration, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread, the message processing method further includes: carrying out periodic scanning on the environment configuration object through a preset configuration change thread; when detecting that the configuration information of the environment configuration object is changed, acquiring the changed environment configuration object, transmitting the changed environment configuration object into a preset subscription state corresponding to a subscriber according to the changed environment configuration object, and changing the size of the preset consumer thread pool.
Optionally, in a sixth implementation manner of the first aspect of the present invention, after the batch reading of each batch of message data from the preset blocking queue at every preset waiting duration, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread, the message processing method further includes: initializing a link identification of an actual consumer thread; and respectively recording all consumption process data of the actual consumer thread into a preset current thread local variable and a preset log printing object based on the link identification of the actual consumer thread.
A second aspect of the present invention provides a message processing apparatus, including: the generating module is used for instantiating an environment configuration object, generating a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establishing a corresponding binding relationship between the service switch and the service message queue, wherein the service message queue is a real-time message queue or a delay message queue; the system comprises an input module, a service message queue and a delay message queue, wherein the input module is used for inputting produced messages to the service switch through a preset message middleware, the produced messages are input to the service message queue through the service switch according to the binding relationship, when the produced messages wait for a preset delay sending time length in the delay message queue, the produced messages with the delay sending time length due are input to the real-time message queue, and the delay sending time lengths corresponding to the same delay message queue are the same; the cache module is used for receiving at least one produced message pushed by the real-time message queue through a preset subscriber and caching the at least one produced message into a preset blocking queue; and the processing module is used for reading each batch of message data in batch from the preset blocking queue every other preset waiting time, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread.
Optionally, in a first implementation manner of the second aspect of the present invention, the generating module is specifically configured to: instantiating an environment configuration object, and starting a preset consumer tool class, wherein the environment configuration object comprises a preset real-time switch name, a preset real-time message queue name, a preset delay switch name, a preset delay message queue name and a preset delay sending time length, and the preset delay sending time length is in one-to-one correspondence with a preset queue sequence number rule; generating a service switch and a service message queue according to the preset real-time switch name, the preset delay switch name, the preset real-time message queue name and the preset delay message queue name through the preset consumer tool class, wherein the service switch comprises a real-time switch and a delay switch, and the service message queue comprises a real-time message queue and a delay message queue; and respectively setting a delay sequence number and a delay parameter of a delay message queue based on the preset queue sequence number rule and the delay sending duration corresponding to the queue sequence number rule, and establishing a corresponding binding relationship between the service switch and the service message queue.
Optionally, in a second implementation manner of the second aspect of the present invention, the importing module is specifically configured to: receiving a produced message sent by a preset producer tool class, and transmitting the produced message to the service switch through a preset message middleware, wherein the produced message carries an expected consumption time limit which is used for indicating that the produced message is a real-time message or a delay message; determining a message type corresponding to the produced message based on the expected consumption time, and matching a corresponding target switch from the service switches according to the message type, wherein the target switch is a real-time switch or a delay switch; the produced message is transmitted into a corresponding service message queue through the target switch according to the binding relationship, and the delay sending time lengths corresponding to the same delay message queue are the same; when the produced message waits for a preset delay sending time length in the delay message queue, the produced message with the expired delay sending time length is transmitted to the real-time switch, and the produced message with the expired delay sending time length is stored in the real-time message queue through the real-time switch.
Optionally, in a third implementation manner of the second aspect of the present invention, the cache module is specifically configured to: receiving at least one produced message pushed by the real-time message queue through a preset subscriber, and performing data format conversion on each produced message to obtain a converted message data set; and writing the converted message data set into a preset blocking queue, wherein the preset blocking queue is a memory buffer area.
Optionally, in a fourth implementation manner of the second aspect of the present invention, the processing module is specifically configured to: reading each batch of message data from the preset blocking queue in batch at intervals of preset waiting time according to the preset maximum consumption quantity of each batch, wherein the quantity of each batch of message data is less than or equal to the preset maximum consumption quantity of each batch; creating an actual consumer thread in a preset consumer thread pool according to the number of the preset maximum consumer threads, processing each batch of message data through the actual consumer thread to obtain a processing result, and sending the processing result to a message middleware, so that the message middleware transmits a message state corresponding to each produced message.
Optionally, in a fifth implementation manner of the second aspect of the present invention, the message processing apparatus further includes: the scanning module is used for periodically scanning the environment configuration object through a preset configuration change thread; and the changing module is used for acquiring the changed environment configuration object when detecting that the configuration information of the environment configuration object is changed, transmitting the changed environment configuration object into a preset subscription state corresponding to a subscriber according to the changed environment configuration object, and changing the size of the preset consumer thread pool.
Optionally, in a sixth implementation manner of the second aspect of the present invention, the message processing apparatus further includes: the initialization module is used for initializing the link identification of the actual consumer thread; and the recording module is used for recording all consumption process data of the actual consumer thread into a preset local variable of the current thread and a preset log printing object respectively based on the link identification of the actual consumer thread.
A third aspect of the present invention provides a message processing apparatus, comprising: a memory and at least one processor, the memory having instructions stored therein; the at least one processor invokes the instructions in the memory to cause the message processing apparatus to perform the message processing method described above.
A fourth aspect of the present invention provides a computer-readable storage medium having stored therein instructions, which, when run on a computer, cause the computer to execute the above-described message processing method.
In the technical scheme provided by the invention, an environment configuration object is instantiated, a service switch and a service message queue are generated according to the environment configuration object through a preset consumer tool class, and a corresponding binding relationship is established between the service switch and the service message queue, wherein the service message queue is a real-time message queue or a delay message queue; transmitting a produced message to the service switch through a preset message middleware, transmitting the produced message to the service message queue through the service switch according to the binding relationship, transmitting the produced message with the expired delayed transmission time into the real-time message queue when the produced message waits for a preset delayed transmission time in the delayed message queue, wherein the delayed transmission time corresponding to the same delayed message queue is the same; receiving at least one produced message pushed by the real-time message queue through a preset subscriber, and caching the at least one produced message into a preset blocking queue; and reading each batch of message data from the preset blocking queue in batch at intervals of preset waiting time, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread. In the embodiment of the invention, the service switch and the service message queue are created in the message middleware according to the environment configuration object by the preset consumer tool class, so that the development cost and the service maintenance cost are reduced, and the service maintenance efficiency and the code readability are improved. The actual consumer thread is created in the preset consumer thread pool, and the actual consumer thread is called to carry out batch consumption on each batch of message data in the blocking queue, so that the resource consumption and the pressure of the server are reduced, and the message processing efficiency is improved.
Drawings
Fig. 1 is a schematic diagram of an embodiment of a message processing method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of another embodiment of a message processing method according to an embodiment of the present invention;
FIG. 3 is a diagram of an embodiment of a message processing apparatus according to an embodiment of the present invention;
fig. 4 is a schematic diagram of another embodiment of a message processing apparatus according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an embodiment of a message processing device in the embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a message processing method, a message processing device, message processing equipment and a message processing storage medium, which are used for consuming messages in batches through consumer tools, reducing resource consumption and pressure of a server and improving message processing efficiency.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," or "having," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of understanding, a specific flow of the embodiment of the present invention is described below, and referring to fig. 1, an embodiment of a message processing method in the embodiment of the present invention includes:
101. and instantiating an environment configuration object, generating a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establishing a corresponding binding relationship between the service switch and the service message queue, wherein the service message queue is a real-time message queue or a delay message queue.
Specifically, the server starts a preset consumer tool class and instantiates an environment configuration object; the method comprises the steps that a server calls a preset consumer tool class, a service switch and a service message queue are created according to an environment configuration object, the service switch is a real-time switch and/or a delay switch, the service message queue is a real-time message queue and/or a delay message queue, and the service switch and the service message queue are mapped and bound one by one on the basis of a preset routing rule, wherein the preset routing rule is used for indicating configuration information for binding the service switch and the service message queue, and the preset routing rule can be dynamically configured according to an actual service application scene. That is, the real-time switch and the real-time message queue have a one-to-one correspondence, the delay switch and the delay message queue have a one-to-one correspondence, and the delay message queue and the real-time switch have a many-to-one correspondence.
It is to be understood that the execution subject of the present invention may be a message processing apparatus, and may also be a terminal or a server, which is not limited herein. The embodiment of the present invention is described by taking a server as an execution subject.
102. The method comprises the steps that produced messages are transmitted to a service switch through preset message middleware, the produced messages are transmitted to a service message queue through the service switch according to a binding relation, when the produced messages wait for preset delay transmission time length in a delay message queue, the produced messages with due delay transmission time length are transmitted to a real-time message queue, and the delay transmission time lengths corresponding to the same delay message queue are the same.
Specifically, the server receives a produced message generated and sent by a preset producer tool class, wherein the produced message is a real-time message or a delay message; and the server respectively transmits the real-time message or the delay message into a real-time message queue or a delay message queue through the service switch according to the corresponding binding relationship, and the delay sending time lengths in the same delay message queue are the same. For example, the produced messages A, B, C, D, E and F respectively correspond to delayed sending time lengths of 5 seconds, 3 seconds, 1 second, 5 seconds and 3 seconds, and the delay queue number includes queue _005, queue _003 and queue _001, where the delay queue number corresponding to the delayed sending time length of 5 seconds is queue _005, the delay queue number corresponding to the delayed sending time length of 3 seconds is queue _003, and the delay queue number corresponding to the delayed sending time length of 1 second is queue _001, the server pushes the produced messages a and E to the delay message queue with the delay queue number of queue _005, the server pushes the produced messages B, C and F to the delay message queue with the delay queue number of queue _003, and the server pushes the produced message D to the delay message queue with the delay queue number of queue _ 001.
103. And receiving at least one produced message pushed by the real-time message queue through a preset subscriber, and caching the at least one produced message into a preset blocking queue.
The preset number of subscribers may be 0 or multiple, and is not specifically limited herein, when the preset number of subscribers is 0, the server determines that the message is not consumed temporarily and only serves as a temporary storage message, and when the concurrence peak value is smaller than the expected threshold value, the server resets that the preset number of subscribers is larger than 0 and performs message consumption again. Specifically, the server receives at least one produced message transmitted from the real-time message queue through a preset subscriber, and the server stores the at least one produced message into a preset blocking queue through the preset subscriber.
104. Reading each batch of message data in batch from a preset blocking queue every other preset waiting time, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread.
Specifically, the server periodically reads preset data of the maximum consumption quantity of each batch from a preset blocking queue in batch according to a preset waiting time to obtain a reading result; when the reading result is a null value, the server continues to execute the next data reading operation; and when the reading result is not a null value, the server creates an actual consumer thread in a preset consumer thread pool, and the server performs service processing on each batch of message data through the actual consumer thread. It can be understood that the server can flexibly control the number of messages consumed in each batch, and can also perform multi-thread consumption on the message data in each batch, so that the server improves the message processing efficiency in a batch processing mode.
Further, the server stores each batch of message data in the blockchain database, which is not limited herein.
In the embodiment of the invention, the service switch and the service message queue are created in the message middleware according to the environment configuration object by the preset consumer tool class, so that the development cost and the service maintenance cost are reduced, and the service maintenance efficiency and the code readability are improved. The actual consumer thread is created in the preset consumer thread pool, and the actual consumer thread is called to carry out batch consumption on each batch of message data in the blocking queue, so that the resource consumption and the pressure of the server are reduced, and the message processing efficiency is improved.
Referring to fig. 2, another embodiment of the message processing method according to the embodiment of the present invention includes:
201. and instantiating an environment configuration object, generating a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establishing a corresponding binding relationship between the service switch and the service message queue, wherein the service message queue is a real-time message queue or a delay message queue.
The environment configuration object is RabbitContext and is applied to a message middleware Rabbitmq, the environment configuration object comprises a preset maximum consumption quantity of each batch and a preset maximum consumer thread quantity, and also can comprise a preset waiting time and a subscriber server internet protocol address (IP), and the preset waiting time is used for indicating the estimated waiting time for pulling the maximum quantity of messages.
Optionally, the server instantiates an environment configuration object and starts a preset consumer tool class, where the environment configuration object includes a preset real-time switch name, a preset real-time message queue name, a preset delay switch name, a preset delay message queue name and a preset delay sending time length, and the preset delay sending time length corresponds to a preset queue number rule one to one; the server generates a service switch and a service message queue according to a preset real-time switch name, a preset delay switch name, a preset real-time message queue name and a preset delay message queue name through a preset consumer tool class, wherein the service switch comprises the real-time switch and the delay switch, and the service message queue comprises the real-time message queue and the delay message queue; the server respectively sets a delay sequence number and a delay parameter of a delay message queue based on a preset queue sequence number rule and a delay sending time length corresponding to the queue sequence number rule, and establishes a corresponding binding relationship between the service switch and the service message queue. It should be noted that the number of the real-time switches and the number of the real-time message queues are both 1, the number of the delay switches and the number of the delay message queues may be greater than or equal to 0, and in the same environment configuration object, the number of the real-time switches and the number of the real-time message queues are equal, and the number of the delay switches and the number of the delay message queues are equal.
202. The method comprises the steps that produced messages are transmitted to a service switch through preset message middleware, the produced messages are transmitted to a service message queue through the service switch according to a binding relation, when the produced messages wait for preset delay transmission time length in a delay message queue, the produced messages with due delay transmission time length are transmitted to a real-time message queue, and the delay transmission time lengths corresponding to the same delay message queue are the same.
It should be noted that the produced message may be a real-time message, and after the produced message reaches a specified time length (i.e., a preset delay sending time length) in the delay queue, the produced message is transmitted to the real-time switch, and then the real-time switch transmits the produced message to the real-time message queue.
Optionally, first, the server receives a produced message sent by a preset producer tool, and transmits the produced message to the service switch through a preset message middleware, where the produced message carries an expected consumption timeliness, and the expected consumption timeliness is used to indicate that the produced message is a real-time message or a delay message; then, the server determines the message type corresponding to the produced message based on the expected consumption time efficiency, and matches a corresponding target switch from the service switch according to the message type, wherein the target switch is a real-time switch or a delay switch; then, the server transmits the produced messages to the corresponding service message queues through the target switch according to the binding relationship, the delay sending time lengths corresponding to the same delay message queue are the same, namely, the server transmits the real-time messages to the real-time switch, then transmits the real-time messages to the real-time message queues through the real-time switch, transmits the delay messages to the delay switch with the sequence number corresponding to the expected consumption time, and then transmits the delay messages to the corresponding delay queues through the delay switch. And finally, when the produced message waits for the preset delay sending time length in the delay message queue, the server transmits the produced message with the expired delay sending time length to the real-time switch, and stores the produced message with the expired delay sending time length into the real-time message queue through the real-time switch.
It can be understood that the delayed sending durations corresponding to the produced messages in the same message queue are the same; when the service message queue corresponding to the produced message is a delay message queue and the delay sending time length corresponding to the produced message expires, the server stores the produced message into the real-time switch through the message middleware and stores the produced message with the expired delay sending time length into the real-time message queue through the real-time switch, and the delay message queue and the corresponding real-time switch have a preset binding rule, wherein the preset binding rule is used for indicating that the produced message in the delay message queue is transmitted into the corresponding real-time message queue.
203. And receiving at least one produced message pushed by the real-time message queue through a preset subscriber, and caching the at least one produced message into a preset blocking queue.
Wherein the at least one produced message may include a message already existing in the real-time message queue and may also include a message that is delayed from being introduced by the message queue. The real-time messages in the real-time message queue are processed by preset subscribers, and the same subscriber can process a plurality of real-time messages (i.e., at least one produced message) at one time, and a plurality of subscribers can process the real-time messages in the same real-time message queue at the same time, for example, the real-time message queue a has 3 preset subscribers, and each subscriber subscribes 4 messages at each time, so that 3 preset subscribers can process 3 × 4 messages at most, i.e., 12 messages at the same time, thereby improving the real-time message processing efficiency.
Optionally, the server receives at least one produced message pushed by the real-time message queue through a preset subscriber, and performs data format conversion on each produced message to obtain a converted message data set; and the server writes the converted message data set into a preset blocking queue, wherein the preset blocking queue is a memory buffer area. It will be appreciated that for distributed systems, the server performs data format conversion on each produced message in order to accommodate the different formats that the message middleware pushes for different dependent packets. When the server sends a message through a preset producer tool class, the server converts the environment configuration object into a JS object numbered notation JSON character string, and then the server converts the JSON character string into an object through a preset consumer tool class for processing.
204. Reading each batch of message data in batch from a preset blocking queue every other preset waiting time, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread.
The number of the actual consumer threads may be 1, may be multiple, and is not specifically limited herein, and when the number of the message data in the preset blocking queue is 0, the number of the actual consumer threads is 0. Optionally, the server reads each batch of message data in batch from a preset blocking queue every other preset waiting time according to a preset maximum consumption number of each batch, where the number of each batch of message data is less than or equal to the preset maximum consumption number of each batch; the server creates an actual consumer thread in a preset consumer thread pool according to the number of the preset maximum consumer threads, processes each batch of message data through the actual consumer thread to obtain a processing result, and sends the processing result to the message middleware, so that the message middleware transmits a message state corresponding to each produced message. That is, when the actual consumer thread notifies the message middleware that the processing result is the completion of the processing, the message middleware will push the new batch message to the predetermined blocking queue. The preset maximum consumption quantity per batch is used for indicating a threshold value of the maximum quantity of the message data read in batches from the preset blocking queue each time, and the preset maximum consumer thread quantity is used for indicating a threshold value of the maximum quantity of the actual consumer threads. The preset maximum consumption quantity of each batch and the preset maximum consumer thread quantity are preset in an environment configuration object, and dynamic configuration is carried out according to an actual application scene.
Further, the server initializes the link identification of the actual consumer thread; and the server records all consumption process data of the actual consumer thread into a preset current thread local variable and a preset log printing object respectively based on the link identification of the actual consumer thread. It can be understood that the server records all consumption process data of the actual consumer thread into the preset current thread local variable and the preset log printing object MDC according to the link identifier of the actual messenger thread, so that all consumption processes can be tracked by the link, thereby reducing the service maintenance cost.
205. And periodically scanning the environment configuration object through a preset configuration change thread.
Specifically, the server stores configuration information of the environment configuration object by using preset configuration variables, wherein the preset configuration variables comprise maximum processing thread number, maximum single consumption number and subscriber internet protocol addresses; when the preset consumer tool class is started, the maximum number of processing threads, the maximum number of single consumption and the subscriber internet protocol address are respectively consistent with the variable values corresponding to the current environment configuration object; when the server periodically detects that the maximum number of processing threads, the maximum number of single consumption and the subscriber internet protocol address are respectively inconsistent with the respective corresponding variable values in the current environment configuration object through a preset configuration change thread, the server determines that the environment configuration object has configuration information change.
206. When detecting that the configuration information of the environment configuration object is changed, acquiring the changed environment configuration object, transmitting the changed environment configuration object into a preset subscription state corresponding to a subscriber according to the changed environment configuration object, and changing the size of a preset consumer thread pool.
Specifically, when it is detected that the configuration information of the environment configuration object is changed, the server obtains the changed environment configuration object, the server transmits a preset subscription state of the subscriber according to the changed environment configuration object (that is, the maximum number of processing threads, the maximum number of single consumption and the internet protocol address of the subscriber), and changes the size of a preset thread pool of the subscriber, and then, the server assigns variables in the environment configuration object to variables corresponding to the current thread so as to compare next time. When the internet protocol address of the subscriber is inconsistent with the internet protocol address of the current server, the server logs off all the subscribers (namely, the preset subscribers) in the real-time message queue in the environment configuration object; when the internet protocol address of the subscriber is consistent with the internet protocol address of the current server and the thread number is inconsistent with the subscriber number, the server registers or cancels the subscriber in the real-time message queue in the environment configuration object; when the consumption quantity of each batch is inconsistent, the server logs out all subscribers and re-registers the subscribers in the real-time message queue in the environment configuration object. Further, when the message is produced and the preset maximum consumption quantity of each batch is changed, the server reinitializes all subscribers in the real-time message queue in the environment configuration object through a preset configuration change thread; when the preset maximum number of the consumer threads is changed, the server registers or cancels part of the subscribers in the real-time message queue in the environment configuration object, and enlarges or reduces the size of the preset consumer thread pool.
In the embodiment of the invention, the service switch and the service message queue are created in the message middleware according to the environment configuration object by the preset consumer tool class, so that the development cost and the service maintenance cost are reduced, and the service maintenance efficiency and the code readability are improved. The actual consumer thread is created in the preset consumer thread pool, and the actual consumer thread is called to carry out batch consumption on each batch of message data in the blocking queue, so that the resource consumption and the pressure of the server are reduced, and the message processing efficiency is improved.
With reference to fig. 3, the message processing method in the embodiment of the present invention is described above, and a message processing apparatus in the embodiment of the present invention is described below, where an embodiment of the message processing apparatus in the embodiment of the present invention includes:
a generating module 301, configured to instantiate an environment configuration object, generate a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establish a corresponding binding relationship between the service switch and the service message queue, where the service message queue is a real-time message queue or a delayed message queue;
an import module 302, configured to import a produced message to a service switch through a preset message middleware, import the produced message to a service message queue through the service switch according to a binding relationship, and import the produced message with a delay sending duration expired into a real-time message queue when the produced message waits for a preset delay sending duration in the delay message queue, where delay sending durations corresponding to the same delay message queue are the same;
the caching module 303 is configured to receive at least one produced message pushed by the real-time message queue through a preset subscriber, and cache the at least one produced message in a preset blocking queue;
the processing module 304 is configured to read each batch of message data in batch from a preset blocking queue every preset waiting duration, create an actual consumer thread in a preset consumer thread pool, and perform service processing on each batch of message data through the actual consumer thread.
Further, each batch of message data is stored in the blockchain database, which is not limited herein.
In the embodiment of the invention, the service switch and the service message queue are created in the message middleware according to the environment configuration object by the preset consumer tool class, so that the development cost and the service maintenance cost are reduced, and the service maintenance efficiency and the code readability are improved. The actual consumer thread is created in the preset consumer thread pool, and the actual consumer thread is called to carry out batch consumption on each batch of message data in the blocking queue, so that the resource consumption and the pressure of the server are reduced, and the message processing efficiency is improved.
Referring to fig. 4, another embodiment of a message processing apparatus according to an embodiment of the present invention includes:
a generating module 301, configured to instantiate an environment configuration object, generate a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establish a corresponding binding relationship between the service switch and the service message queue, where the service message queue is a real-time message queue or a delayed message queue;
an import module 302, configured to import a produced message to a service switch through a preset message middleware, import the produced message to a service message queue through the service switch according to a binding relationship, and import the produced message with a delay sending duration expired into a real-time message queue when the produced message waits for a preset delay sending duration in the delay message queue, where delay sending durations corresponding to the same delay message queue are the same;
the caching module 303 is configured to receive at least one produced message pushed by the real-time message queue through a preset subscriber, and cache the at least one produced message in a preset blocking queue;
the processing module 304 is configured to read each batch of message data in batch from a preset blocking queue every preset waiting duration, create an actual consumer thread in a preset consumer thread pool, and perform service processing on each batch of message data through the actual consumer thread.
Optionally, the generating module 301 may be further specifically configured to:
instantiating an environment configuration object, and starting a preset consumer tool class, wherein the environment configuration object comprises a preset real-time switch name, a preset real-time message queue name, a preset delay switch name, a preset delay message queue name and a preset delay sending time length, and the preset delay sending time length is in one-to-one correspondence with a preset queue sequence number rule;
generating a service switch and a service message queue according to a preset real-time switch name, a preset delay switch name, a preset real-time message queue name and a preset delay message queue name through a preset consumer tool class, wherein the service switch comprises the real-time switch and the delay switch, and the service message queue comprises the real-time message queue and the delay message queue;
and respectively setting a delay sequence number and a delay parameter of the delay message queue based on a preset queue sequence number rule and a delay sending time length corresponding to the queue sequence number rule, and establishing a corresponding binding relationship between the service switch and the service message queue.
Optionally, the incoming module 302 may be further specifically configured to:
receiving a produced message sent by a preset producer tool, transmitting the produced message to a service switch through a preset message middleware, wherein the produced message carries expected consumption timeliness which is used for indicating that the produced message is a real-time message or a delay message;
determining a message type corresponding to the produced message based on the expected consumption time efficiency, and matching a corresponding target switch from the service switches according to the message type, wherein the target switch is a real-time switch or a delay switch;
the produced messages are transmitted into corresponding service message queues through a target switch according to the binding relationship, and the delay sending time lengths corresponding to the same delay message queue are the same;
and when the produced message waits for the preset delay sending time length in the delay message queue, the produced message with the expired delay sending time length is transmitted to the real-time switch, and the produced message with the expired delay sending time length is stored in the real-time message queue through the real-time switch.
Optionally, the caching module 303 may be further specifically configured to:
receiving at least one produced message pushed by a real-time message queue through a preset subscriber, and performing data format conversion on each produced message to obtain a converted message data set;
and writing the converted message data set into a preset blocking queue, wherein the preset blocking queue is a memory buffer area.
Optionally, the processing module 304 may be further specifically configured to:
reading each batch of message data in batch from a preset blocking queue every other preset waiting time according to a preset maximum consumption quantity of each batch, wherein the quantity of each batch of message data is less than or equal to the preset maximum consumption quantity of each batch;
and creating an actual consumer thread in a preset consumer thread pool according to the preset maximum consumer thread number, processing each batch of message data through the actual consumer thread to obtain a processing result, and sending the processing result to the message middleware so that the message middleware transmits a message state corresponding to each produced message.
Optionally, the message processing apparatus further includes:
a scanning module 305, configured to perform periodic scanning on the environment configuration object through a preset configuration change thread;
the changing module 306 is configured to, when it is detected that the configuration information of the environment configuration object is changed, obtain the changed environment configuration object, transmit a subscription state corresponding to a preset subscriber according to the changed environment configuration object, and change a size of a preset consumer thread pool.
Optionally, the message processing apparatus further includes:
an initialization module 307, configured to initialize a link identifier of an actual consumer thread;
the recording module 308 is configured to record all consumption process data of the actual consumer thread into a preset local variable of the current thread and a preset log print object, respectively, based on the link identifier of the actual consumer thread.
In the embodiment of the invention, the service switch and the service message queue are created in the message middleware according to the environment configuration object by the preset consumer tool class, so that the development cost and the service maintenance cost are reduced, and the service maintenance efficiency and the code readability are improved. The actual consumer thread is created in the preset consumer thread pool, and the actual consumer thread is called to carry out batch consumption on each batch of message data in the blocking queue, so that the resource consumption and the pressure of the server are reduced, and the message processing efficiency is improved.
Fig. 3 and fig. 4 describe the message processing apparatus in the embodiment of the present invention in detail from the perspective of modularization, and the message processing apparatus in the embodiment of the present invention is described in detail from the perspective of hardware processing.
Fig. 5 is a schematic structural diagram of a message processing apparatus 500 according to an embodiment of the present invention, where the message processing apparatus 500 may have a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 510 (e.g., one or more processors) and a memory 520, and one or more storage media 530 (e.g., one or more mass storage devices) for storing applications 533 or data 532. Memory 520 and storage media 530 may be, among other things, transient or persistent storage. The program stored on the storage medium 530 may include one or more modules (not shown), each of which may include a sequence of instructions operating on the message processing apparatus 500. Still further, the processor 510 may be configured to communicate with the storage medium 530 to execute a series of instruction operations in the storage medium 530 on the message processing device 500.
The message processing apparatus 500 may also include one or more power supplies 540, one or more wired or wireless network interfaces 550, one or more input-output interfaces 560, and/or one or more operating systems 531, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, and the like. Those skilled in the art will appreciate that the message processing device configuration shown in fig. 5 does not constitute a limitation of the message processing device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The present invention also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium, and which may also be a volatile computer-readable storage medium, having stored therein instructions, which, when run on a computer, cause the computer to perform the steps of the message processing method.
The present invention also provides a message processing device, which includes a memory and a processor, where the memory stores instructions, and the instructions, when executed by the processor, cause the processor to execute the steps of the message processing method in the foregoing embodiments.
Further, the computer-readable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the blockchain node, and the like.
The block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A message processing method, characterized in that the message processing method comprises:
instantiating an environment configuration object, generating a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establishing a corresponding binding relationship between the service switch and the service message queue, wherein the service message queue is a real-time message queue or a delay message queue;
transmitting a produced message to the service switch through a preset message middleware, transmitting the produced message to the service message queue through the service switch according to the binding relationship, transmitting the produced message with the expired delayed transmission time into the real-time message queue when the produced message waits for a preset delayed transmission time in the delayed message queue, wherein the delayed transmission time corresponding to the same delayed message queue is the same;
receiving at least one produced message pushed by the real-time message queue through a preset subscriber, and caching the at least one produced message into a preset blocking queue;
and reading each batch of message data from the preset blocking queue in batch at intervals of preset waiting time, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread.
2. The message processing method according to claim 1, wherein the instantiating the environment configuration object, generating a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establishing a corresponding binding relationship between the service switch and the service message queue, wherein the service message queue is a real-time message queue or a delayed message queue, and comprises:
instantiating an environment configuration object, and starting a preset consumer tool class, wherein the environment configuration object comprises a preset real-time switch name, a preset real-time message queue name, a preset delay switch name, a preset delay message queue name and a preset delay sending time length, and the preset delay sending time length is in one-to-one correspondence with a preset queue sequence number rule;
generating a service switch and a service message queue according to the preset real-time switch name, the preset delay switch name, the preset real-time message queue name and the preset delay message queue name through the preset consumer tool class, wherein the service switch comprises a real-time switch and a delay switch, and the service message queue comprises a real-time message queue and a delay message queue;
and respectively setting a delay sequence number and a delay parameter of a delay message queue based on the preset queue sequence number rule and the delay sending duration corresponding to the queue sequence number rule, and establishing a corresponding binding relationship between the service switch and the service message queue.
3. The message processing method according to claim 1, wherein the transmitting a produced message to the service switch through a preset message middleware, transmitting the produced message to the service message queue through the service switch according to the binding relationship, transmitting the produced message with the expired delayed transmission duration to the real-time message queue when the produced message waits for a preset delayed transmission duration in the delayed message queue, and the delayed transmission durations corresponding to the same delayed message queue are the same, comprises:
receiving a produced message sent by a preset producer tool class, and transmitting the produced message to the service switch through a preset message middleware, wherein the produced message carries an expected consumption time limit which is used for indicating that the produced message is a real-time message or a delay message;
determining a message type corresponding to the produced message based on the expected consumption time, and matching a corresponding target switch from the service switches according to the message type, wherein the target switch is a real-time switch or a delay switch;
the produced message is transmitted into a corresponding service message queue through the target switch according to the binding relationship, and the delay sending time lengths corresponding to the same delay message queue are the same;
when the produced message waits for a preset delay sending time length in the delay message queue, the produced message with the expired delay sending time length is transmitted to the real-time switch, and the produced message with the expired delay sending time length is stored in the real-time message queue through the real-time switch.
4. The message processing method according to claim 1, wherein the receiving, by a preset subscriber, at least one produced message pushed by the real-time message queue and buffering the at least one produced message into a preset blocking queue comprises:
receiving at least one produced message pushed by the real-time message queue through a preset subscriber, and performing data format conversion on each produced message to obtain a converted message data set;
and writing the converted message data set into a preset blocking queue, wherein the preset blocking queue is a memory buffer area.
5. The message processing method according to claim 1, wherein the batch reading of each batch of message data from the preset blocking queue at every preset waiting duration, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread comprises:
reading each batch of message data from the preset blocking queue in batch at intervals of preset waiting time according to the preset maximum consumption quantity of each batch, wherein the quantity of each batch of message data is less than or equal to the preset maximum consumption quantity of each batch;
creating an actual consumer thread in a preset consumer thread pool according to the number of the preset maximum consumer threads, processing each batch of message data through the actual consumer thread to obtain a processing result, and sending the processing result to a message middleware, so that the message middleware transmits a message state corresponding to each produced message.
6. The message processing method according to any one of claims 1 to 5, wherein after the batch reading of each batch of message data from the preset blocking queue at every preset waiting duration, creating an actual consumer thread in a preset consumer thread pool, and performing business processing on each batch of message data by the actual consumer thread, the message processing method further comprises:
carrying out periodic scanning on the environment configuration object through a preset configuration change thread;
when detecting that the configuration information of the environment configuration object is changed, acquiring the changed environment configuration object, transmitting the changed environment configuration object into a preset subscription state corresponding to a subscriber according to the changed environment configuration object, and changing the size of the preset consumer thread pool.
7. The message processing method according to any one of claims 1 to 5, wherein after the batch reading of each batch of message data from the preset blocking queue at every preset waiting duration, creating an actual consumer thread in a preset consumer thread pool, and performing business processing on each batch of message data by the actual consumer thread, the message processing method further comprises:
initializing a link identification of an actual consumer thread;
and respectively recording all consumption process data of the actual consumer thread into a preset current thread local variable and a preset log printing object based on the link identification of the actual consumer thread.
8. A message processing apparatus, characterized in that the message processing apparatus comprises:
the generating module is used for instantiating an environment configuration object, generating a service switch and a service message queue according to the environment configuration object through a preset consumer tool class, and establishing a corresponding binding relationship between the service switch and the service message queue, wherein the service message queue is a real-time message queue or a delay message queue;
the system comprises an input module, a service message queue and a delay message queue, wherein the input module is used for inputting produced messages to the service switch through a preset message middleware, the produced messages are input to the service message queue through the service switch according to the binding relationship, when the produced messages wait for a preset delay sending time length in the delay message queue, the produced messages with the delay sending time length due are input to the real-time message queue, and the delay sending time lengths corresponding to the same delay message queue are the same;
the cache module is used for receiving at least one produced message pushed by the real-time message queue through a preset subscriber and caching the at least one produced message into a preset blocking queue;
and the processing module is used for reading each batch of message data in batch from the preset blocking queue every other preset waiting time, creating an actual consumer thread in a preset consumer thread pool, and performing service processing on each batch of message data through the actual consumer thread.
9. A message processing apparatus, characterized in that the message processing apparatus comprises: a memory and at least one processor, the memory having instructions stored therein;
the at least one processor invokes the instructions in the memory to cause the message processing apparatus to perform the message processing method of any of claims 1-7.
10. A computer-readable storage medium having instructions stored thereon, wherein the instructions, when executed by a processor, implement a message processing method as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110386257.5A CN113064742A (en) | 2021-04-12 | 2021-04-12 | Message processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110386257.5A CN113064742A (en) | 2021-04-12 | 2021-04-12 | Message processing method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113064742A true CN113064742A (en) | 2021-07-02 |
Family
ID=76566606
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110386257.5A Pending CN113064742A (en) | 2021-04-12 | 2021-04-12 | Message processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113064742A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113626221A (en) * | 2021-08-10 | 2021-11-09 | 迈普通信技术股份有限公司 | Message enqueuing method and device |
| CN113656191A (en) * | 2021-07-19 | 2021-11-16 | 中国电子科技集团公司第十五研究所 | Historical message playback method and device of message middleware |
| CN113704297A (en) * | 2021-08-03 | 2021-11-26 | 深圳兆日科技股份有限公司 | Method and module for processing service processing request and computer readable storage medium |
| CN114296910A (en) * | 2021-12-02 | 2022-04-08 | 武汉物易云通网络科技有限公司 | Multi-partition queue sequential consumption method and device |
| CN113656191B (en) * | 2021-07-19 | 2024-05-24 | 中国电子科技集团公司第十五研究所 | Historical message playback method and device of message middleware |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111741014A (en) * | 2020-07-21 | 2020-10-02 | 平安国际智慧城市科技股份有限公司 | Message sending method, device, server and storage medium |
| CN112181683A (en) * | 2020-09-27 | 2021-01-05 | 中国银联股份有限公司 | Concurrent consumption method and device for message middleware |
| CN112181677A (en) * | 2020-09-02 | 2021-01-05 | 珠海格力电器股份有限公司 | Service processing method and device, storage medium and electronic device |
| US20210042172A1 (en) * | 2019-08-09 | 2021-02-11 | Ciena Corporation | Normalizing messaging flows in a microservice architecture |
-
2021
- 2021-04-12 CN CN202110386257.5A patent/CN113064742A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20210042172A1 (en) * | 2019-08-09 | 2021-02-11 | Ciena Corporation | Normalizing messaging flows in a microservice architecture |
| CN111741014A (en) * | 2020-07-21 | 2020-10-02 | 平安国际智慧城市科技股份有限公司 | Message sending method, device, server and storage medium |
| CN112181677A (en) * | 2020-09-02 | 2021-01-05 | 珠海格力电器股份有限公司 | Service processing method and device, storage medium and electronic device |
| CN112181683A (en) * | 2020-09-27 | 2021-01-05 | 中国银联股份有限公司 | Concurrent consumption method and device for message middleware |
Non-Patent Citations (2)
| Title |
|---|
| WOHU007: ""RabbitMQ 入门系列（2）— 生产者、消费者、信道、代理、队列、交换器、路由键定、交换器"", 《HTTPS://BLOG.CSDN.NET/WOHU1104/ARTICLE/DETAILS/91469419》 * |
| 裴鹏飞: ""支持事务的分布式消息队列中间件的设计与实现"", 《中国优秀硕士论文全文数据库》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113656191A (en) * | 2021-07-19 | 2021-11-16 | 中国电子科技集团公司第十五研究所 | Historical message playback method and device of message middleware |
| CN113656191B (en) * | 2021-07-19 | 2024-05-24 | 中国电子科技集团公司第十五研究所 | Historical message playback method and device of message middleware |
| CN113704297A (en) * | 2021-08-03 | 2021-11-26 | 深圳兆日科技股份有限公司 | Method and module for processing service processing request and computer readable storage medium |
| CN113704297B (en) * | 2021-08-03 | 2024-02-23 | 深圳兆日科技股份有限公司 | Processing method, module and computer readable storage medium for business processing request |
| CN113626221A (en) * | 2021-08-10 | 2021-11-09 | 迈普通信技术股份有限公司 | Message enqueuing method and device |
| CN113626221B (en) * | 2021-08-10 | 2024-03-15 | 迈普通信技术股份有限公司 | Message enqueuing method and device |
| CN114296910A (en) * | 2021-12-02 | 2022-04-08 | 武汉物易云通网络科技有限公司 | Multi-partition queue sequential consumption method and device |
| CN114296910B (en) * | 2021-12-02 | 2022-11-22 | 武汉物易云通网络科技有限公司 | Multi-partition queue sequential consumption method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113064742A (en) | Message processing method, device, equipment and storage medium | |
| US7219121B2 (en) | Symmetrical multiprocessing in multiprocessor systems | |
| EP2321937B1 (en) | Load balancing for services | |
| CN110278161B (en) | Message distribution method, device and system based on user mode protocol stack | |
| CN113691611B (en) | Block chain distributed high-concurrency transaction processing method, system, equipment and storage medium | |
| CN113259415B (en) | Network message processing method and device and network server | |
| US5802307A (en) | Network communications subsystem and method for digital computer system employing protocol stack having diverse lower-level network driver components optimized for each of base and enhance operating systems | |
| EP0871307A2 (en) | Apparatus for flexible control of interrupts in multiprocessor systems | |
| CN110333916B (en) | Request message processing method, device, computer system and readable storage medium | |
| CN113992600A (en) | Multi-rate mode data transmission control method and device based on cache queue | |
| CN114610765B (en) | Stream calculation method, device, equipment and storage medium | |
| CN111711675A (en) | Solution for concurrent message transmission in local area network | |
| US6826634B2 (en) | Extended message block for network device drivers | |
| CN113271336B (en) | DPDK-based robot middleware DDS data transmission method, electronic equipment and computer-readable storage medium | |
| CN113687962A (en) | Request processing method, device, equipment and storage medium | |
| CN114285906A (en) | Message processing method and device, electronic equipment and storage medium | |
| CN113992644A (en) | Internet of things gateway system based on non-service technology and data processing method thereof | |
| CN109257227B (en) | Coupling management method, device and system in data transmission | |
| CN113055493B (en) | Data packet processing method, device, system, scheduling device and storage medium | |
| CN111988283A (en) | Data transmission method, system, device and computer readable storage medium | |
| CN101909283B (en) | M2M (Machine-to-Machine) platform and method for sharing load downloaded with in high capacity | |
| CN112202914A (en) | Message pushing method and device | |
| CN111240867A (en) | Information communication system and method | |
| CN112769741B (en) | Message communication method and electronic equipment | |
| CN114756732A (en) | Data query method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211028 Address after: Room 201, building a, No.1 Qianwan 1st Road, Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong Province (settled in Shenzhen Qianhai business secretary Co., Ltd.) Applicant after: Shenzhen saiante Technology Service Co.,Ltd. Address before: 1-34 / F, Qianhai free trade building, 3048 Xinghai Avenue, Mawan, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong 518000 Applicant before: Ping An International Smart City Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right |