CN108021358A - A kind of data processing method and device - Google Patents
A kind of data processing method and device Download PDFInfo
- Publication number
- CN108021358A CN108021358A CN201711351063.1A CN201711351063A CN108021358A CN 108021358 A CN108021358 A CN 108021358A CN 201711351063 A CN201711351063 A CN 201711351063A CN 108021358 A CN108021358 A CN 108021358A
- Authority
- CN
- China
- Prior art keywords
- message
- consumer
- queue
- theme
- maincenter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/20—Software design
Abstract
The invention discloses a kind of data processing method and device, to make data handling procedure simpler, intelligent.This method includes：The message of the different themes of collection is sent to message maincenter corresponding with theme by Message Collectors, and message maincenter pushes messages to the consumer of topic of subscription, and the message got is pushed to corresponding processor and is handled by consumer.Above-mentioned technical proposal is based on the intelligent consuming method for subscribing to model, in the method, the message producer becomes publisher, and message consumer then becomes subscriber, and the theme message of multiple dimensions is supported to subscribe to, it is mutually isolated between each theme, it is unaffected, on the basis of existing queue, compared to former queue, take out multiple standards entities, business side needs only to pay close attention to topic defined in oneself, and the message processing logic of processor, internal message transfer details is shielded completely, it is so that simpler in whole processing procedure, automatically, intelligence.
Description
Technical field
The present invention relates to technical field of data processing, more particularly to a kind of data processing method and device.
Background technology
Productive consumption person's model, is a kind of common technology in all kinds of programming languages.The model is in production and living
That applies is very extensive, such as queuing etc. of calling out the numbers.It at least possesses three entities：The producer, consumer, buffering queue.Production
Person, can have one or more to produce certain data, and the data of production will be introduced into buffering queue；Buffering queue, for facing
When store creation data.Buffering queue both ends, one end are connected to the producer, one end is connected to consumer, are then given birth to when queue full
Production person cannot be again toward interpolation data in queue, and when queue empty, consumer can not also obtain consumption data from queue again；Consumption
Person, can there is one or more consumer, and data are obtained from buffer queue and are consumed, and each consumer is every time from buffering team
One is taken in row.
Current more commonly used way is to use in the concurrent tool-class of Java JDK to provide BlockingQueue, its tool
Body, which is realized, also to be had very much, is not stated wherein distinguishing tired.Such as LinkedBlockingQueue, it is an obstruction based on chained list
Queue, in chained list one end addition element, if having expired to block, the other end removes element, if queue is sky, just blocks.
Above-mentioned existing implementation, in scene is actually used, however it remains problems with：It only provides a queue, owns
Operation to queue is required for business side oneself to operate；Whom the producer, consumer be, is specified entirely by business side；Multiple producers,
Multiple consumers can not only be realized by a queue；Mapping relations between the multiple producers and consumer can not embody；It is right
In single queue, single consumer's handling capacity is certainly very low, customer count can not be dynamically adjusted, to improve handling capacity.
The content of the invention
In view of the above problems, it is proposed that the present invention overcomes the above problem in order to provide one kind or solves at least in part
State a kind of data processing method and device of problem.To make data handling procedure simpler, intelligent.
The present invention provides a kind of data processing method, including：
The message of the different themes of collection is sent to message maincenter corresponding with the theme by Message Collectors；
The message is pushed to the consumer for subscribing to the theme by the message maincenter；
The message got is pushed to corresponding processor and is handled by the consumer.
In one embodiment, the method may also include：
Detect the state of consumer queue；
The quantity of consumer is adjusted according to the state of consumer queue.
In one embodiment, the state of the detection consumer queue, it may include：
The consumption status of consumer queue are monitored by the Consumption rate of real-time sampling consumer queue；
The quantity that consumer is adjusted according to the state of consumer queue, including：
When the Consumption rate of the consumer queue reaches predetermined threshold value, the quantity of consumer is adjusted.
In one embodiment, it is described when the Consumption rate of the consumer queue reaches predetermined threshold value, to consumer
Quantity be adjusted, it may include：
When the Consumption rate of the consumer queue is less than the first predetermined threshold value, increase the quantity of consumer；
When the Consumption rate of the consumer queue is higher than the second predetermined threshold value, the quantity of consumer is reduced.
In one embodiment, the message of the different themes of collection is sent to and the theme pair by the Message Collectors
The message maincenter answered, it may include：
The theme is corresponded with message maincenter, and corresponding message maincenter is determined according to the theme of message.
The present invention also provides a kind of data processing equipment, including：
Sending module, disappear corresponding with the theme is sent to for Message Collectors by the message of the different themes of collection
Breath maincenter；
The message, the consumer for subscribing to the theme is pushed to for the message maincenter by pushing module；
Processing module, is pushed to corresponding processor by the message got for the consumer and is handled.
In one embodiment, described device may also include：
Detection module, for detecting the state of consumer queue；
Module is adjusted, for adjusting the quantity of consumer according to the state of consumer queue.
In one embodiment, the detection module, it may include：
Monitoring submodule, the consumption of consumer queue is monitored for the Consumption rate by real-time sampling consumer queue
State；
The adjustment module, including：
Submodule is adjusted, for when the Consumption rate of the consumer queue reaches predetermined threshold value, to the number of consumer
Amount is adjusted.
In one embodiment, the adjustment submodule, it may include：
Adding unit, for when the Consumption rate of the consumer queue is less than the first predetermined threshold value, increasing consumer
Quantity；
Unit is reduced, for when the Consumption rate of the consumer queue is higher than the second predetermined threshold value, reducing consumer
Quantity.
In one embodiment, the sending module, it may include：
Determination sub-module, corresponds for the theme and message maincenter, corresponding disappear is determined according to the theme of message
Breath maincenter.
The technical solution that the embodiment of the present invention provides can include the following benefits：
Above-mentioned technical proposal, disappear corresponding with theme is sent to by Message Collectors by the message of the different themes of collection
Breath maincenter, message maincenter push messages to the consumer of topic of subscription, and the message got is pushed to corresponding by consumer
Processor is handled.Above-mentioned technical proposal is based on the intelligent consuming method for subscribing to model, in the method, message production
Person becomes publisher, and message consumer then becomes subscriber, and supports that the theme message of multiple dimensions is subscribed to, each theme it
Between it is mutually isolated, it is unaffected, on the basis of existing queue, compared to former queue, take out multiple standards entities, business side is only
Only need to pay close attention to topic defined in oneself, and the message processing logic of processor, internal message transfer details quilt completely
Shielding, so that simpler, automatic, intelligent in whole processing procedure.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by the explanations write
Specifically noted structure is realized and obtained in book, claims and attached drawing.
Below by drawings and examples, technical scheme is described in further detail.
Brief description of the drawings
Attached drawing is used for providing a further understanding of the present invention, and a part for constitution instruction, the reality with the present invention
Apply example to be used to explain the present invention together, be not construed as limiting the invention.In the accompanying drawings：
Fig. 1 is a kind of flow chart of data processing method in the embodiment of the present invention；
Fig. 2 is the network architecture diagram of the data processing method of the embodiment of the present invention；
Fig. 3 is the flow chart of another data processing method in the embodiment of the present invention；
Fig. 4 is the flow chart of another data processing method in the embodiment of the present invention；
Fig. 5 is the flow chart of another data processing method in the embodiment of the present invention；
Fig. 6 is the sequence diagram of the data processing method in the embodiment of the present invention；
Fig. 7 is a kind of block diagram of data processing equipment in the embodiment of the present invention.
Embodiment
The preferred embodiment of the present invention is illustrated below in conjunction with attached drawing, it will be appreciated that described herein preferred real
Apply example to be merely to illustrate and explain the present invention, be not intended to limit the present invention.
Fig. 1 show a kind of flow chart of data processing method in the embodiment of the present invention, as shown in Figure 1, the data processing
Method comprises the following steps S11-S13：
The message of the different themes of collection is sent to message maincenter corresponding with theme by step S11, Message Collectors.
Step S12, message maincenter push messages to the consumer of topic of subscription.
The message got is pushed to corresponding processor and is handled by step S13, consumer.
Message Collectors collect the message of different themes (topic), and the message that Message Collectors will can be collected into, passes through
Topic is automatically matched to corresponding message maincenter, and message is automatically pushed to subscribe to the consumer of the topic by message maincenter
(consumer) queue (queue), after consumer gets corresponding message, will be pushed to corresponding processor (processor)
Carry out business processing.The network architecture diagram of above-described embodiment is as shown in Figure 2.
The message of the different themes of collection, is sent to and master by the above method of the embodiment of the present invention by Message Collectors
Corresponding message maincenter is inscribed, message maincenter pushes messages to the consumer of topic of subscription, and consumer pushes away the message got
Corresponding processor is given to be handled.Above-mentioned technical proposal is based on the intelligent consuming method for subscribing to model, in this method
In, the message producer becomes publisher, and message consumer then becomes subscriber, and supports the theme message of multiple dimensions to order
Read, it is mutually isolated between each theme, it is unaffected, on the basis of existing queue, compared to former queue, it is real to take out multiple standards
Body, business side need only to pay close attention to topic defined in oneself, and the message processing logic of processor, in internal message
Turn details to be shielded completely, so that simpler, automatic, intelligent in whole processing procedure.
In one embodiment, as shown in figure 3, the data processing method can also include the steps of S14-S15：
Step S14, detects the state of consumer queue.
Step S15, the quantity of consumer is adjusted according to the state of consumer queue.
In the present embodiment, intelligent brain will periodically detect quene state, the idle condition in queue, adjust automatically
The consumption quantity of consumer, can also automatically switch to backup queue after queue full, backup queue and major queue mutually mutually based on
It is standby, to have the function that the intelligent peak that disappears.
In one embodiment, as shown in figure 4, step S14 can be embodied as following steps S141：
Step S141, the consumption status of consumer queue are monitored by the Consumption rate of real-time sampling consumer queue.
Step S15 can be embodied as following steps S151：
Step S151, when the Consumption rate of consumer queue reaches predetermined threshold value, is adjusted the quantity of consumer.
In the present embodiment, sampler (sampling) monitors consumer queue consumption status by real-time sampling, by going out
Team's speed of joining the team tentatively judges queue consumption status, intelligent brain is notified if reaching early warning threshold values and will adjust back, for intelligent brain
Decision-making.
In one embodiment, step S151 can be embodied as following steps A1-A2：
Step A1, when the Consumption rate of consumer queue is less than the first predetermined threshold value, increases the quantity of consumer.
Step A2, when the Consumption rate of consumer queue is higher than the second predetermined threshold value, reduces the quantity of consumer.
In the present embodiment, the first predetermined threshold value is less than the second predetermined threshold value, when the Consumption rate of consumer queue is less than the
During one predetermined threshold value, then increase consumer to accelerate to consume message, when the Consumption rate of consumer queue is higher than the second default threshold
During value, then the data of consumer are reduced to avoid blocking.
In one embodiment, as shown in figure 5, step S11 can be embodied as following steps S111：
Step S111, theme are corresponded with message maincenter, and corresponding message maincenter is determined according to the theme of message.
In the present embodiment, a topic corresponds to a message maincenter, and a message maincenter corresponds to multiple consumers, so that
Enable message maincenter that the message of different themes quickly is sent to corresponding consumer.
Fig. 6 is the sequence diagram of data processing method provided in an embodiment of the present invention.As shown in fig. 6, idiographic flow is as follows：
The message of the different themes of collection is sent to message maincenter corresponding with theme by step S61, Message Collectors.
Message Collectors collect message, and topic and message body (content) are included in message.One topic corresponds to one
A message maincenter, corresponding message maincenter is found according to the topic of message.One message maincenter corresponds to multiple consumers, one
Consumer corresponds to an intelligent brain, and a consumer can be consumed by multiple threads at the same time.
Step S62, message maincenter obtain the theme of message.
Step S63, message maincenter give out information.
Message maincenter is by news release into corresponding queue.Each message maincenter is a runnable thread, as long as
There is message body will be automatically by news release to corresponding consumer in queue.
The message of issue is pushed to the consumer for subscribing to the theme by step S64, message maincenter.
Step S65, consumer receive message.
Step S66, real-time sampling is carried out to consumer queue, and sampled result is sent to intelligent brain.
Step S67, intelligent brain judge whether to adjust consumer queue according to sampled result.
Consumer samples and can carry out in real time when message is received, if judged by sampling rate in numerous
The busy stage, it will automatic increase thread is consumed.
The message got is pushed to corresponding processor and is handled by step S68, consumer.
Consumer is by news release to processor, can automatically processing message after processor receives message.
Step S69, processor handle message.
Based on same inventive concept, the embodiment of the present invention additionally provides a kind of data processing equipment, since the device is solved
Certainly the principle of problem is similar to aforementioned data processing method, therefore the implementation of the device may refer to the implementation of preceding method, weight
Multiple part repeats no more.
Fig. 7 show a kind of block diagram of data processing equipment in the embodiment of the present invention, as shown in fig. 7, the data processing fills
Put including：
Sending module 71, message corresponding with theme is sent to for Message Collectors by the message of the different themes of collection
Maincenter；
Pushing module 72, the consumer of topic of subscription is pushed messages to for message maincenter；
Processing module 73, is pushed to corresponding processor by the message got for consumer and is handled.
The message of the different themes of collection, is sent to and master by the above device of the embodiment of the present invention by Message Collectors
Corresponding message maincenter is inscribed, message maincenter pushes messages to the consumer of topic of subscription, and consumer pushes away the message got
Corresponding processor is given to be handled.Above-mentioned technical proposal is based on the intelligent consuming method for subscribing to model, in this method
In, the message producer becomes publisher, and message consumer then becomes subscriber, and supports the theme message of multiple dimensions to order
Read, it is mutually isolated between each theme, it is unaffected, on the basis of existing queue, compared to former queue, it is real to take out multiple standards
Body, business side need only to pay close attention to topic defined in oneself, and the message processing logic of processor, in internal message
Turn details to be shielded completely, so that simpler, automatic, intelligent in whole processing procedure.
In one embodiment, which may also include：
Detection module, for detecting the state of consumer queue；
Module is adjusted, for adjusting the quantity of consumer according to the state of consumer queue.
In one embodiment, detection module, it may include：
Monitoring submodule, the consumption of consumer queue is monitored for the Consumption rate by real-time sampling consumer queue
State；
Module is adjusted, including：
Adjust submodule, for when the Consumption rate of consumer queue reaches predetermined threshold value, to the quantity of consumer into
Row adjustment.
In one embodiment, submodule is adjusted, it may include：
Adding unit, for when the Consumption rate of consumer queue is less than the first predetermined threshold value, increasing the number of consumer
Amount；
Unit is reduced, for when the Consumption rate of consumer queue is higher than the second predetermined threshold value, reducing the number of consumer
Amount.
In one embodiment, sending module, it may include：
Determination sub-module, corresponds for theme and message maincenter, is determined according to the theme of message in corresponding message
Pivot.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program
Product.Therefore, the present invention can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.Moreover, the present invention can use the computer for wherein including computer usable program code in one or more
The shape for the computer program product that usable storage medium is implemented on (including but not limited to magnetic disk storage and optical memory etc.)
Formula.
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or square frame in journey and/or square frame and flowchart and/or the block diagram.These computer programs can be provided
The processors of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that the instruction performed by computer or the processor of other programmable data processing devices, which produces, to be used in fact
The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, thus in computer or
The instruction performed on other programmable devices is provided and is used for realization in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a square frame or multiple square frames.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
God and scope.In this way, if these modifications and changes of the present invention belongs to the scope of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to comprising including these modification and variations.
Claims (10)
- A kind of 1. data processing method, it is characterised in that including：The message of the different themes of collection is sent to message maincenter corresponding with the theme by Message Collectors；The message is pushed to the consumer for subscribing to the theme by the message maincenter；The message got is pushed to corresponding processor and is handled by the consumer.
- 2. the method as described in claim 1, it is characterised in that the method further includes：Detect the state of consumer queue；The quantity of consumer is adjusted according to the state of consumer queue.
- 3. method as claimed in claim 2, it is characterised in that the state of the detection consumer queue, including：The consumption status of consumer queue are monitored by the Consumption rate of real-time sampling consumer queue；The quantity that consumer is adjusted according to the state of consumer queue, including：When the Consumption rate of the consumer queue reaches predetermined threshold value, the quantity of consumer is adjusted.
- 4. method as claimed in claim 3, it is characterised in that described when the Consumption rate of the consumer queue reaches default During threshold value, the quantity of consumer is adjusted, including：When the Consumption rate of the consumer queue is less than the first predetermined threshold value, increase the quantity of consumer；When the Consumption rate of the consumer queue is higher than the second predetermined threshold value, the quantity of consumer is reduced.
- 5. such as the method any one of claim 1-4, it is characterised in that the Message Collectors are main by the difference of collection The message of topic is sent to message maincenter corresponding with the theme, including：The theme is corresponded with message maincenter, and corresponding message maincenter is determined according to the theme of message.
- A kind of 6. data processing equipment, it is characterised in that including：The message of the different themes of collection, is sent in message corresponding with the theme by sending module for Message Collectors Pivot；The message, the consumer for subscribing to the theme is pushed to for the message maincenter by pushing module；Processing module, is pushed to corresponding processor by the message got for the consumer and is handled.
- 7. device as claimed in claim 6, it is characterised in that described device further includes：Detection module, for detecting the state of consumer queue；Module is adjusted, for adjusting the quantity of consumer according to the state of consumer queue.
- 8. device as claimed in claim 7, it is characterised in that the detection module, including：Monitoring submodule, the consumption shape of consumer queue is monitored for the Consumption rate by real-time sampling consumer queue State；The adjustment module, including：Adjust submodule, for when the Consumption rate of the consumer queue reaches predetermined threshold value, to the quantity of consumer into Row adjustment.
- 9. device as claimed in claim 8, it is characterised in that the adjustment submodule, including：Adding unit, for when the Consumption rate of the consumer queue is less than the first predetermined threshold value, increasing the number of consumer Amount；Unit is reduced, for when the Consumption rate of the consumer queue is higher than the second predetermined threshold value, reducing the number of consumer Amount.
- 10. such as the device any one of claim 6-9, it is characterised in that the sending module, including：Determination sub-module, corresponds for the theme and message maincenter, is determined according to the theme of message in corresponding message Pivot.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711351063.1A CN108021358A (en) | 2017-12-15 | 2017-12-15 | A kind of data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711351063.1A CN108021358A (en) | 2017-12-15 | 2017-12-15 | A kind of data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108021358A true CN108021358A (en) | 2018-05-11 |
Family
ID=62073824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711351063.1A Pending CN108021358A (en) | 2017-12-15 | 2017-12-15 | A kind of data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108021358A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109032821A (en) * | 2018-08-27 | 2018-12-18 | 百度在线网络技术（北京）有限公司 | Theme message processing method, device, equipment and storage medium |
| CN110688228A (en) * | 2019-10-09 | 2020-01-14 | 北京思特奇信息技术股份有限公司 | Method, system and electronic equipment for guaranteeing distributed system message time sequence |
| CN110875935A (en) * | 2018-08-30 | 2020-03-10 | 阿里巴巴集团控股有限公司 | Message publishing, processing and subscribing method, device and system |
| WO2020259354A1 (en) * | 2019-06-26 | 2020-12-30 | 深圳前海微众银行股份有限公司 | Queue adjustment method, apparatus and device, and computer-readable storage medium |
| CN112291121A (en) * | 2020-12-30 | 2021-01-29 | 金锐同创(北京)科技股份有限公司 | Data processing method and related equipment |
| CN112882846A (en) * | 2021-02-19 | 2021-06-01 | 深圳市云网万店科技有限公司 | Data processing method and device of message queue, computer equipment and storage medium |
| CN115211092A (en) * | 2020-03-02 | 2022-10-18 | 深圳市欢太科技有限公司 | Message pulling method and device and computer storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104092767A (en) * | 2014-07-21 | 2014-10-08 | 北京邮电大学 | Posting/subscribing system for adding message queue models and working method thereof |
| CN105721553A (en) * | 2016-01-25 | 2016-06-29 | 中国联合网络通信有限公司广东省分公司 | Self-adaptive cluster message dispatcher |
| CN106598760A (en) * | 2016-12-19 | 2017-04-26 | 北京奇虎科技有限公司 | Message queue consumption method and apparatus |
| US9674131B1 (en) * | 2015-12-04 | 2017-06-06 | International Business Machines Corporation | Message delivery system |
| CN107197015A (en) * | 2017-05-23 | 2017-09-22 | 阿里巴巴集团控股有限公司 | A kind of message treatment method and device based on Message Queuing system |
| CN107332787A (en) * | 2017-06-29 | 2017-11-07 | 北京奇艺世纪科技有限公司 | A kind of message distributing method and device |
| CN107391275A (en) * | 2017-06-30 | 2017-11-24 | 联想(北京)有限公司 | A kind of message treatment method and electronic equipment |
-
2017
- 2017-12-15 CN CN201711351063.1A patent/CN108021358A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104092767A (en) * | 2014-07-21 | 2014-10-08 | 北京邮电大学 | Posting/subscribing system for adding message queue models and working method thereof |
| US9674131B1 (en) * | 2015-12-04 | 2017-06-06 | International Business Machines Corporation | Message delivery system |
| CN105721553A (en) * | 2016-01-25 | 2016-06-29 | 中国联合网络通信有限公司广东省分公司 | Self-adaptive cluster message dispatcher |
| CN106598760A (en) * | 2016-12-19 | 2017-04-26 | 北京奇虎科技有限公司 | Message queue consumption method and apparatus |
| CN107197015A (en) * | 2017-05-23 | 2017-09-22 | 阿里巴巴集团控股有限公司 | A kind of message treatment method and device based on Message Queuing system |
| CN107332787A (en) * | 2017-06-29 | 2017-11-07 | 北京奇艺世纪科技有限公司 | A kind of message distributing method and device |
| CN107391275A (en) * | 2017-06-30 | 2017-11-24 | 联想(北京)有限公司 | A kind of message treatment method and electronic equipment |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109032821A (en) * | 2018-08-27 | 2018-12-18 | 百度在线网络技术（北京）有限公司 | Theme message processing method, device, equipment and storage medium |
| CN109032821B (en) * | 2018-08-27 | 2021-12-28 | 百度在线网络技术（北京）有限公司 | Automatic driving subject message processing method, device, equipment and storage medium |
| CN110875935A (en) * | 2018-08-30 | 2020-03-10 | 阿里巴巴集团控股有限公司 | Message publishing, processing and subscribing method, device and system |
| WO2020259354A1 (en) * | 2019-06-26 | 2020-12-30 | 深圳前海微众银行股份有限公司 | Queue adjustment method, apparatus and device, and computer-readable storage medium |
| CN110688228A (en) * | 2019-10-09 | 2020-01-14 | 北京思特奇信息技术股份有限公司 | Method, system and electronic equipment for guaranteeing distributed system message time sequence |
| CN115211092A (en) * | 2020-03-02 | 2022-10-18 | 深圳市欢太科技有限公司 | Message pulling method and device and computer storage medium |
| CN115211092B (en) * | 2020-03-02 | 2023-12-22 | 深圳市欢太科技有限公司 | Message pulling method and device and computer storage medium |
| CN112291121A (en) * | 2020-12-30 | 2021-01-29 | 金锐同创(北京)科技股份有限公司 | Data processing method and related equipment |
| CN112882846A (en) * | 2021-02-19 | 2021-06-01 | 深圳市云网万店科技有限公司 | Data processing method and device of message queue, computer equipment and storage medium |
| CN112882846B (en) * | 2021-02-19 | 2024-02-09 | 深圳市云网万店科技有限公司 | Data processing method and device for message queue, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108021358A (en) | A kind of data processing method and device | |
| US10884844B2 (en) | Data stream processor and method to counteract anomalies in data streams transiting a distributed computing system | |
| CN109032914A (en) | Resource occupation data predication method, electronic equipment, storage medium | |
| EP2466824B1 (en) | Service scheduling method and device | |
| CN109766200A (en) | A kind of message queue processing method, device, equipment and storage medium | |
| CN112272217B (en) | Kafka cluster load balancing method, system, equipment and medium | |
| CN108089814A (en) | A kind of date storage method and device | |
| CN107026708B (en) | Data processing method and device | |
| CN112507029A (en) | Data processing system and data real-time processing method | |
| CN105786571A (en) | Mobile terminal and control method thereof | |
| CN101415107A (en) | A kind of reliable multilevel medium storage method | |
| JP2014520316A (en) | Traffic control method and traffic control apparatus | |
| CN109982034A (en) | Access request processing method and processing device in video monitoring system | |
| CN106095638A (en) | The method of a kind of server resource alarm, Apparatus and system | |
| US8001297B2 (en) | Dynamic adjusting send rate of buffered data | |
| US20160316320A1 (en) | Electronic apparatus, uploading method and non-transitory computer readable storage medium thereof | |
| CN109766198A (en) | Stream Processing method, apparatus, equipment and computer readable storage medium | |
| CN115168030B (en) | Dynamic regulation log acquisition and processing method, device and storage medium | |
| CN102750185B (en) | A kind of data adaptive output method and system | |
| KR20190041192A (en) | Method and device for collecting log based on rule | |
| CN108089930A (en) | The sending method and device of data | |
| CN114885018B (en) | Message pushing method, device, equipment and storage medium based on double queues | |
| CN110968483A (en) | Service data acquisition method and device and electronic equipment | |
| CN110347518A (en) | Message treatment method and device | |
| CN109495544A (en) | A kind of message data treating method and apparatus and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180511 |
|
| RJ01 | Rejection of invention patent application after publication |