CN114363407A

CN114363407A - Message service method and device, readable storage medium and electronic equipment

Info

Publication number: CN114363407A
Application number: CN202111604539.4A
Authority: CN
Inventors: 徐东
Original assignee: Shanghai Ruosu Technology Co ltd
Current assignee: Shanghai Ruosu Technology Co ltd
Priority date: 2021-12-24
Filing date: 2021-12-24
Publication date: 2022-04-15
Anticipated expiration: 2041-12-24
Also published as: CN114363407B

Abstract

The application provides a message service method and device, a readable storage medium and electronic equipment, and relates to the field of data communication. The method comprises the following steps: receiving M theme messages which are issued by a first producer and correspond to a first message server, wherein the first producer is one of a plurality of producers of different departments of a target group; determining blocks corresponding to the M theme messages respectively based on the M theme messages and a preset fragmentation mode; the M theme messages are respectively stored in the blocks corresponding to the M theme messages, so that consumers of different departments of a target group subscribe for consumption, the purpose that a service and a data team can be simultaneously supported only by deploying one set of message service in the target group is achieved, the operation and maintenance cost is reduced, and the capacity of high availability, no loss of messages and dynamic capacity expansion is achieved.

Description

Message service method and device, readable storage medium and electronic equipment

Technical Field

The present application relates to the field of data communication, and in particular, to a message service method and apparatus, a readable storage medium, and an electronic device.

Background

The existing message service has a very large selectable range, but the selection type is different under different scenes. Today groups include business and data teams, which tend to use rabbitmessage queues (rabbitmq), and data teams primarily use the Kafka platform. The RabbiMQ can guarantee that messages are not lost, but does not guarantee high concurrency of messages. The Kafka platform can guarantee high concurrency of messages, but does not meet the requirement that messages are not lost. In addition, messages between the business team and the data team are not communicated, and each business line needs to deploy a plurality of sets of message service queues according to requirements, so that the operation and maintenance cost is greatly increased.

Disclosure of Invention

The present application is proposed to solve the above-mentioned technical problems. The embodiment of the application provides a message service method and device, a readable storage medium and electronic equipment.

In a first aspect, an embodiment of the present application provides a message service method, which is applied to a first message server, where the first message server is one of a plurality of message servers included in a message server cluster, and the method includes: receiving M theme messages which are issued by a first producer and correspond to a first message server, wherein the first producer is one of a plurality of producers of different departments of a target group; determining blocks corresponding to the M theme messages respectively based on the M theme messages and a preset fragmentation mode; and respectively storing the M theme messages into blocks corresponding to the M theme messages so as to facilitate the consumers of different departments of the target group to subscribe for consumption.

With reference to the first aspect, in some implementations of the first aspect, after the storing the M topic messages in respective corresponding blocks of the M topic messages, the method further includes: receiving subscription information for the M topic messages; and based on the subscription information, pushing M theme messages to N consumers corresponding to the subscription information.

With reference to the first aspect, in some implementations of the first aspect, based on the subscription information, pushing M topic messages to N consumers corresponding to the subscription information includes: determining message category information corresponding to the M topic messages based on the subscription information; determining distribution strategy information corresponding to the M subject messages based on the message category information corresponding to the M subject messages; and pushing M subject messages to the N consumers based on the distribution strategy information.

With reference to the first aspect, in some implementations of the first aspect, based on the subscription information, pushing M topic messages to N consumers corresponding to the subscription information includes: based on the subscription information, pushing a first subject message to a first consumer corresponding to the subscription information, and if a behavior of pushing the first subject message to a second consumer exists, starting error reporting; the first consumer is one of N consumers, the first subject message is one of M subject messages, and the second consumer is one of N consumers.

With reference to the first aspect, in some implementations of the first aspect, based on the subscription information, pushing M topic messages to N consumers corresponding to the subscription information includes: and based on the subscription information, pushing a first subject message to a first consumer corresponding to the subscription information, wherein if other message servers in the message server cluster start a subscription service behavior, the other message servers exist as backups.

With reference to the first aspect, in some implementations of the first aspect, based on the subscription information, pushing M topic messages to N consumers corresponding to the subscription information includes: and pushing the first topic message to N consumers corresponding to the subscription information based on the subscription information so that the N consumers consume the first topic message together.

With reference to the first aspect, in some implementations of the first aspect, after pushing M topic messages to N consumers corresponding to subscription information based on the subscription information, the method further includes: receiving consumption completion information sent by each of N consumers; and updating the consumption sequence information corresponding to the M theme messages based on the consumption completion information sent by the N consumers respectively.

In a second aspect, an embodiment of the present application provides a message service method, which is applied to an electronic device corresponding to a first producer, where the first producer is one of multiple producers of different departments of a target group, and the electronic device corresponding to the first producer is connected to multiple message servers included in a message server cluster, and the method includes: generating P theme messages corresponding to the first producer; determining blocks corresponding to the P subject messages respectively based on a plurality of message servers included in the message server cluster; and respectively sending the P theme messages to blocks corresponding to the P theme messages so as to respectively store the P theme messages to message servers corresponding to the P theme messages, so that the P theme messages are subscribed and consumed by consumers of different departments of the target group.

In a third aspect, an embodiment of the present application provides a message service method, which is applied to an electronic device corresponding to a first consumer, where the first consumer is one of multiple consumers in different departments of a target group, and the electronic device corresponding to the first consumer is connected to multiple message servers included in a message server cluster, and the method includes: sending subscription information for Q topic messages in the message server cluster; determining a message server corresponding to each of the Q topic messages based on the subscription information; and acquiring and consuming the Q theme messages based on the connection relationship between the electronic equipment corresponding to the first consumer and the message servers corresponding to the Q theme messages.

With reference to the third aspect, in some implementation manners of the first aspect, after obtaining and consuming the Q theme messages based on a connection relationship between the electronic device corresponding to the first consumer and the message server corresponding to each of the Q theme messages, the method further includes: and sending consumption completion information to the message servers corresponding to the Q theme messages respectively so that the message servers corresponding to the Q theme messages respectively reserve or delete the Q theme messages.

In a fourth aspect, an embodiment of the present application provides a message service apparatus, which is applied to a first message server, where the first message server is one of a plurality of message servers included in a message server cluster, and the apparatus includes: the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving M theme messages which are issued by a first producer and correspond to a first message server, and the first producer is one of a plurality of producers of different cause departments of a target group; the first determining module is used for determining blocks corresponding to the M theme messages respectively based on the M theme messages and a preset fragmentation mode; and the storage module is used for respectively storing the M theme messages to the blocks corresponding to the M theme messages so as to facilitate the consumers of different cause departments of the target group to subscribe for consumption.

In a fifth aspect, an embodiment of the present application provides a message service apparatus, which is applied to an electronic device corresponding to a first producer, where the first producer is one of a plurality of producers of different departments of a target group, and the electronic device corresponding to the first producer is connected to a plurality of message servers included in a message server cluster, and the apparatus includes: the generating module is used for generating P theme messages corresponding to the first producer; the second determining module is used for determining blocks corresponding to the P theme messages respectively based on a plurality of message servers included in the message server cluster; and the sending module is used for sending the P theme messages to blocks corresponding to the P theme messages respectively so as to store the P theme messages to message servers corresponding to the P theme messages respectively, so that the P theme messages are subscribed and consumed by consumers of different causes of the target group.

In a sixth aspect, an embodiment of the present application provides a message service apparatus, applied to an electronic device corresponding to a first consumer, where the first consumer is one of a plurality of consumers in different departments of a target group, and the electronic device corresponding to the first consumer is connected to a plurality of message servers included in a message server cluster, the apparatus including: the receiving module is used for sending subscription information aiming at Q topic messages in the message server cluster; a third determining module, configured to determine, based on the subscription information, message servers corresponding to the Q topic messages, respectively; and the consumption module is used for acquiring and consuming the Q theme messages based on the connection relation between the electronic equipment corresponding to the first consumer and the message servers corresponding to the Q theme messages.

In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, where the storage medium stores a computer program for executing the method mentioned in the first aspect and/or the second aspect and/or the third aspect.

In an eighth aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory for storing processor-executable instructions; the processor is configured to perform the method of the first aspect and/or the second aspect and/or the third aspect.

The message service method provided by the embodiment of the application can achieve the purpose that a target group can simultaneously support business and data teams only by deploying one set of message service, greatly reduces operation and maintenance cost, and has the capabilities of high availability, no message loss and dynamic capacity expansion. Compared with the message queue service in the prior art, the method not only retains the advantage of no message loss of a service system, but also combines the advantage of high concurrency of data stream processing of a data team, and solves the problems of no message intercommunication, high operation and maintenance cost and the like among service lines in the current group.

Drawings

Fig. 1 is a flowchart illustrating a message service method according to an embodiment of the present application.

Fig. 2 is a flowchart illustrating a message service method according to another embodiment of the present application.

Fig. 3 is a flowchart illustrating a message service method according to another embodiment of the present application.

Fig. 4 is a flowchart illustrating a message service method according to another embodiment of the present application.

Fig. 5 is a flowchart illustrating a message service method according to another embodiment of the present application.

Fig. 6 is a flowchart illustrating a message service method according to another embodiment of the present application.

Fig. 7 is a flowchart illustrating a message service method according to another embodiment of the present application.

Fig. 8 is a flowchart illustrating a message service method according to another embodiment of the present application.

Fig. 9 is a schematic structural diagram illustrating a message service method according to another embodiment of the present application.

Fig. 10 is a flowchart illustrating a message service method according to another embodiment of the present application.

Fig. 11 is a flowchart illustrating a message service method according to another embodiment of the present application.

Fig. 12 is a diagram illustrating an application scenario of a message service method according to an embodiment of the present application.

Fig. 13 is a schematic structural diagram of a message service device according to an embodiment of the present application.

Fig. 14 is a schematic structural diagram of a message service device according to an embodiment of the present application.

Fig. 15 is a schematic structural diagram of a message service device according to an embodiment of the present application.

Fig. 16 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Summary of the application

At present, a group has a plurality of departments, each department has its own product, and some of the products are micro-services and some are single services. Nowadays, the asynchronous messages existing inside the product mainly use RabbiMQ, rockmq, ActiveMQ, and the like. The message queue can guarantee that the messages are not lost, but cannot guarantee high concurrency of the messages. The Kafka platform is mainly used by data teams at present, and mainly ensures high concurrency of messages, but the messages are easy to lose. In addition, the messages between different service lines in the group are not intercommunicated, so that a plurality of environments need to be deployed and maintained for each service line according to the requirements of the service line, and the operation and maintenance cost is increased.

In order to solve the above problem, an embodiment of the present application provides a message service method, which achieves the purpose that only one set of message service needs to be deployed inside a target group to simultaneously support a business team and a data team, reduces operation and maintenance costs, and has high availability, no message loss, and dynamic capacity expansion capabilities. The message service method according to the embodiment of the present application is described in detail below with reference to fig. 1 to 12.

First, an overall flow of the message service method related in the embodiment of the present application is described. Fig. 1 is a flowchart illustrating a message service method according to an embodiment of the present application. As shown in fig. 1, the method includes producer 0 and producer 1, message server 0, message server 1 and message server 3, tile 0 corresponding to message server 0, tile 1 corresponding to message server 1, tiles 2 and 3 corresponding to message server 3, and a consumer. All message servers and tiles may also be referred to as a service cluster, and a service cluster may include a plurality of message servers, each of which may contain a plurality of tiles. When a producer issues a message to a server cluster, the server cluster fragments according to the received subject message and stores the subject message on a message server according to a fragmentation rule. Consumers may subscribe to the block to obtain messages published by the producer.

Fig. 2 is a flowchart illustrating a message service method according to another embodiment of the present application. As shown in fig. 2, the message service method provided by the embodiment of the present application is applied to a first message server, where the first message server is one of a plurality of message servers included in a message server cluster, and the method includes the following steps.

Step S110, receiving M topic messages issued by the first producer and corresponding to the first message server. Wherein the first producer is one of a plurality of producers of different departments of the target group, and M is a positive integer.

Illustratively, the subject message may be a consumption message, a settlement message, a payment message, and the like. For example, in an e-commerce payment process, a user payment may generate a message that the collection was successful.

Illustratively, the producer is used to send the subject message to the message server. The consumer is used to retrieve data from the message server. The messages are classified by subject, the producer is responsible for sending the messages to a specific block, and the consumer is responsible for subscribing the block and consuming.

Illustratively, a target clique may be an enterprise that includes a multi-tiered organizational structure. The cause department may be a functional department corresponding to the target group.

Step S120, based on the M theme messages and the preset slicing mode, determining the blocks corresponding to the M theme messages respectively.

Illustratively, the preset fragmentation mode comprises the corresponding relation between the subject message and the block and/or the corresponding relation between the block and the message server. The preset fragmentation mode is stored in the message server, the message server synchronizes the preset fragmentation mode to the producer, and the producer directly sends the theme message to the corresponding block according to the preset fragmentation mode when producing the theme message, wherein the block is also clustered, so that the block which is not more than 1/3 is down theoretically, and the success of sending the theme message is not influenced. The consumer obtains the preset slicing mode on the message server according to the subscribed topic message, and then obtains the topic message by going to the subscription block.

Step S130, the M theme messages are respectively stored in the blocks corresponding to the M theme messages, so that the consumers of different departments of the target group subscribe to consumption.

It should be understood that after the producer creates the theme message, the theme message is divided into a plurality of corresponding blocks according to the preset corresponding relationship between the theme message and the blocks, and then the message server corresponding to each of the plurality of blocks is determined according to the corresponding relationship between the blocks and the message server.

Specifically, the first message server includes a plurality of blocks, and the storing of the M topic messages in the blocks corresponding to the M topic messages is equivalent to the storing of the M topic messages in the first message servers corresponding to the M topic messages.

The message service method provided by the embodiment of the application can realize message intercommunication among different departments of the target group, and the requirement of a business and data team can be met simultaneously only by deploying the message service method in the target group, so that the operation and maintenance cost is reduced, and meanwhile, multiple tenants are supported, and different business lines or product configuration access strategies and hardware network resources are configured according to different tenants, so that unified message service is realized. Compared with the message queue service in the prior art, the method not only retains the advantage of no message loss of a service system, but also combines the advantage of high concurrency of data stream processing of a data team, and solves the problems of no message intercommunication, high operation and maintenance cost and the like among service lines in the current group.

Although the embodiment of fig. 2 refers to the message service method for the first server, it is understood that the message service method can also be applied to a scenario including more servers, and for a scenario including more servers, the message service method only needs to be executed for each server.

In other embodiments of the present application, a message server cluster includes a plurality of message servers. The message server can receive a plurality of theme messages issued by a plurality of producers; each message server corresponds to a plurality of blocks, and the block corresponding to each subject message is determined according to a fragmentation rule preset by the message server; and storing each topic message on a message server corresponding to the block according to the block corresponding to each topic message and the corresponding relation between the block and the server.

Fig. 3 is a flowchart illustrating a message service method according to another embodiment of the present application. The embodiment shown in fig. 3 is extended based on the embodiment shown in fig. 2, and the differences between the embodiment shown in fig. 3 and the embodiment shown in fig. 2 will be emphasized below, and the descriptions of the same parts will not be repeated.

As shown in fig. 3, the message service method provided in the embodiment of the present application further includes the following steps after the M theme messages are respectively stored in the blocks corresponding to the M theme messages (step S130).

Step S210, receiving subscription information for the M topic messages.

Illustratively, subscription information may be understood as a subscription of a consumer to a subject message. The message server will push the subject message to the consumer only if the consumer subscribes to the subject message.

Step S220, based on the subscription information, pushing M topic messages to N consumers corresponding to the subscription information, where N is a positive integer.

Illustratively, the consumer may be one, a plurality or a group. In addition, one consumer may subscribe to consume the same topic message, multiple consumers may subscribe to consume the same topic message, or different consumption groups may subscribe to one topic message.

In the actual application process, the consumer links the message server corresponding to the topic message and obtains the fragmentation rule of the block according to the subscribed topic message, and then subscribes the block on the message server corresponding to the topic message and obtains the topic message. And the message server receives the subscription information aiming at the topic message, and pushes the topic message to the subscribed consumers based on the subscription information.

According to the message service method provided by the embodiment of the application, the first message server pushes the M theme messages to the N consumers based on the subscription information aiming at the M theme messages. Compared with a point-to-point consumption mode in the prior art, the message service method provided by the embodiment of the application can be consumed by subscribed consumers as long as the consumers subscribe the topic messages and the topic messages published on the block can be consumed by the subscribed consumers, fully meets the application requirements of one-to-many or many-to-many, and realizes a message service with high availability, no message loss and dynamic inclusion.

Fig. 4 is a flowchart illustrating a message service method according to another embodiment of the present application. As shown in fig. 4, the number of consumers in different service scenarios is different, and the consumption patterns adopted by the consumers are also different. Wherein the consumption mode includes an exclusive mode, a fast failure mode, a sharing mode, and a routing key mode.

In an embodiment, based on the subscription information, pushing M topic messages to N consumers corresponding to the subscription information includes: based on the subscription information, pushing a first subject message to a first consumer corresponding to the subscription information, and if a behavior of pushing the first subject message to a second consumer exists, starting error reporting; the first consumer is one of N consumers, the first subject message is one of M subject messages, and the second consumer is one of N consumers.

Specifically, in the exclusive mode, only one consumer can consume the same theme message, and if the message server starts another service subscription, the message server directly starts error reporting, so that the accuracy and the effectiveness of the consumption result are ensured. As shown in FIG. 3, when consumer A consumes in the exclusive mode, consumer A subscribes to and consumes the subject message.

In an embodiment, based on the subscription information, pushing M topic messages to N consumers corresponding to the subscription information includes: and based on the subscription information, pushing a first subject message to a first consumer corresponding to the subscription information, wherein if other message servers in the message server cluster start a subscription service behavior, the other message servers exist as backups.

Specifically, in the fast failure mode, only one consumer can consume the same subject message, other message servers start the subscription service without reporting an error but do not consume, and other message servers exist as backups. If the message server corresponding to the consuming consumer is down, the other message servers which are backed up are automatically started to consume the messages, so that the consumption integrity of the subject messages is ensured. As shown in fig. 3, when consuming using the fast failure mode, consumer B1 subscribes to and consumes the topic message, and when consumer B2 starts subscribing to the topic message, the message server corresponding to consumer B2 exists as a backup.

In an embodiment, based on the subscription information, pushing M topic messages to N consumers corresponding to the subscription information includes: and pushing the first topic message to N consumers corresponding to the subscription information based on the subscription information so that the N consumers consume the first topic message together.

Specifically, in the sharing mode, multiple consumers collectively consume the same subject message. Messages in this mode are sent to consumers in a polling manner to meet business development requirements. As shown in FIG. 3, consumers C1 and C2 consume in a shared mode, and consumer C1 and consumer C2 may subscribe to and consume the subject message simultaneously.

Fig. 5 is a flowchart illustrating a message service method according to another embodiment of the present application. The embodiment shown in fig. 5 is extended based on the embodiment shown in fig. 2, and the differences between the embodiment shown in fig. 5 and the embodiment shown in fig. 2 will be emphasized below, and the descriptions of the same parts will not be repeated.

As shown in fig. 5, the message service method provided in the embodiment of the present application, based on the subscription information, pushes M topic messages to N consumers corresponding to the subscription information (step S220), and includes the following steps.

Step S310, based on the subscription information, determining the message category information corresponding to the M topic messages.

For example, each topic message may be divided into at least one category topic, and the message category information corresponding to each topic message may be determined according to the divided category topic.

Step S320, determining distribution policy information corresponding to the M topic messages based on the message category information corresponding to each of the M topic messages.

Illustratively, the distribution policy information may be a pre-customized Key policy. The distribution policy information may be stored in a first message server that distributes the M topic messages according to the distribution policy information.

Step S330, based on the distribution strategy information, M theme messages are pushed to N consumers.

Specifically, M subject messages are distributed to corresponding consumers based on a Key policy. For example, the first message server pushes the subject message with Key 1-10 to consumer a, and pushes the subject message with Key greater than 11 to consumer B. Wherein the mode corresponds to the route key mode in the consumption mode fig. 3.

The message service method provided by the embodiment of the application determines the message category information corresponding to the M theme messages based on the subscription information, and then determines the distribution strategy information corresponding to the M theme messages based on the message category information corresponding to the M theme messages, so that the M theme messages are pushed to N consumers according to the distribution strategy information, the order of consumption is ensured, and the actual requirements of the consumers are better met.

Fig. 6 is a flowchart illustrating a message service method according to another embodiment of the present application. The embodiment shown in fig. 6 is extended based on the embodiment shown in fig. 5, and the differences between the embodiment shown in fig. 5 and the embodiment shown in fig. 6 will be emphasized below, and the descriptions of the same parts will not be repeated.

As shown in fig. 6, in the embodiment of the present application, after pushing M topic messages to N consumers corresponding to subscription information based on the subscription information (step S310), the following steps are further included.

Step S410, receiving consumption completion information sent by each of the N consumers.

Illustratively, the consumption completion information may be understood as the consumer having completed the operation of obtaining data from the message server. The consumption completion information is fed back to the message server by the consumer.

Step S420, based on the consumption completion information sent by each of the N consumers, the consumption sequence information corresponding to the M theme messages is updated.

Illustratively, the consumption sequence information may be understood as the consumption sequence corresponding to each of the M topic messages.

It should be appreciated that in actual practice, a message will be generated for each order created. As the order continues, a plurality of topic messages are generated. The topic messages can be processed in a cursor mode, each topic message is arranged in sequence, each topic message corresponds to one consumption sequence information, and consumption is carried out according to the consumption sequence information.

For example, the consumption sequence corresponding to the M topic messages is: a first subject message, a second subject message, a third subject message. After the first theme message is consumed, the second theme message can be consumed, and then the M theme messages are consumed in sequence according to the consumption sequence.

In the actual application process, a message server receives a plurality of theme messages issued by a plurality of producers; the message server corresponds to a plurality of blocks, and the block corresponding to each topic message is determined according to a fragmentation rule preset by the server; and storing each topic message on a message server corresponding to the block according to the block corresponding to each topic message and the corresponding relation between the block and the server. After the message server receives the subscription information sent by the consumer, the message server pushes the subject message to the consumer; and the message server receives the consumption completion information of the consumer and updates the consumption sequence information corresponding to the plurality of theme messages.

According to the message service method provided by the embodiment of the application, the consumption sequence information corresponding to the M theme messages is updated based on the consumption completion information sent by the N consumers respectively, the consumption position can be determined in real time, and repeated consumption is avoided.

Fig. 7 is a flowchart illustrating a message service method according to another embodiment of the present application. As shown in fig. 7, in the embodiment of the present application, the method is applied to an electronic device corresponding to a first producer, where the first producer is one of a plurality of producers of different departments of a target group, and the electronic device corresponding to the first producer is connected to a plurality of message servers included in a message server cluster, and the method includes the following steps.

Step S510, P theme messages corresponding to the first producer are generated, where P is a positive integer.

Illustratively, the first producer corresponds to the client area. When the first producer produces or creates each message, the unique identification of the current subject message is generated according to the current time.

Step S520, determining a block corresponding to each of the P topic messages based on the plurality of message servers included in the message server cluster.

Specifically, based on a plurality of message servers included in the message server cluster, the first producer links the plurality of message servers and obtains a correspondence between the message servers and the tiles. Based on the unique ID identification of the current subject message and the corresponding relation between the message server and the block, the subject message can be determined to be sent to the corresponding block.

Step S530, the P theme messages are respectively sent to the blocks corresponding to the P theme messages, so that the P theme messages are respectively stored in the message servers corresponding to the P theme messages, and consumers of different departments of the target group subscribe to and consume the messages.

Illustratively, the tiles correspond to hard disks to which the server cannot directly connect. The topic message payload is sent to the message server through the connection of the intermediate agent, which is equivalent to sending the topic message to the intermediate agent, and the intermediate agent helps the message server to write the topic message in the block.

In the message service method provided by the embodiment of the application, a first producer generates P theme messages, and determines blocks corresponding to the P theme messages based on a plurality of message servers included in a message server cluster; and then the P theme messages are respectively sent to the blocks corresponding to the P theme messages so as to respectively store the P theme messages to the message servers corresponding to the P theme messages, thereby realizing the purpose of subscribing and consuming the consumers of different departments of the target group. The message service method supports the requirements of business and data teams at the same time, not only contains the requirements of high availability of a business system and no loss of messages, but also combines the high concurrency of data flow processing of the data teams, and greatly reduces the operation and maintenance use cost.

Fig. 8 is a flowchart illustrating a message service method according to another embodiment of the present application. As shown in fig. 8, a producer produces a plurality of theme messages, then the producer links the message server and obtains the correspondence between the message server and the tile stored in the message server, sends the theme message to the corresponding tile according to the correspondence between the theme message and the tile and the correspondence between the message server and the tile, and stores the theme message in the message server corresponding to the tile. And simultaneously, concurrently writing the theme message into Bookie in the BookKeeper of the storage system, and once the block of the message server is successfully written, returning the information that the storage system is successfully written by the message server. The storage system supports a backup ack mechanism, a cross-ground strategy and a remote backup replication mechanism, and further realizes the dynamic capacity expansion function of the message service.

Fig. 9 is a flowchart illustrating a message service method according to another embodiment of the present application. As shown in fig. 9, the message service method provided in the embodiment of the present application is applied to an electronic device corresponding to a first consumer, where the first consumer is one of a plurality of consumers in different departments of a target group, and the electronic device corresponding to the first consumer is connected to a plurality of message servers included in a message server cluster, and the method includes the following steps.

Step S610, sending subscription information for Q topic messages in the message server cluster.

Illustratively, the first consumer wants to subscribe to and consume Q topic messages, so the first consumer sends subscription information to the message server in the message service cluster responsible for the Q topic messages.

Step S620, determining, based on the subscription information, respective message servers corresponding to the Q topic messages.

Specifically, based on the subscription information of the Q topic messages, the blocks corresponding to the Q topic messages can be determined. Based on the corresponding relation between the blocks and the message server, the message server where the block corresponding to each of the Q subject messages is located can be determined.

Step S630, based on the connection relationship between the electronic device corresponding to the first consumer and the message server corresponding to each of the Q theme messages, obtaining the Q theme messages and consuming the Q theme messages.

Specifically, based on the connection relationship between the electronic device corresponding to the first consumer and the message servers corresponding to the Q theme messages, the message server pushes the Q theme messages to the first consumer, and the first consumer acquires the Q theme messages and then consumes the Q theme messages.

Fig. 10 is a flowchart illustrating a message service method according to another embodiment of the present application. As shown in fig. 10, in the actual application process, the consumer obtains the corresponding relationship between the topic message and the block, and according to the corresponding relationship between the topic message and the block, the consumer links the server lists (i.e. the message server 0, the message server 1, and the message server 2) corresponding to the topic message, and subscribes to the block corresponding to each message server; and the consumer receives the theme messages pushed by the message servers and consumes the theme messages, and after the consumption is finished, the consumption finishing information is sent to the message servers.

Compared with a point-to-point consumption mode in the prior art, the message service method provided by the embodiment of the application has the advantages that as long as the consumer subscribes the theme message, the message server pushes the theme message to the consumer, and the first consumer consumes the theme message after acquiring the theme message, so that the application requirements of one-to-many or many-to-many are fully met, and the message service with high availability, no message loss and dynamic inclusion is realized.

Fig. 11 is a flowchart illustrating a message service method according to another embodiment of the present application. The embodiment shown in fig. 11 is extended based on the embodiment shown in fig. 10, and the differences between the embodiment shown in fig. 11 and the embodiment shown in fig. 10 will be emphasized below, and the descriptions of the same parts will not be repeated.

As shown in fig. 11, in the embodiment of the present application, after obtaining and consuming Q theme messages based on the connection relationship between the electronic device corresponding to the first consumer and the message server corresponding to each of the Q theme messages (step S630), the following steps are further included.

Step S710, the consumption completion information is sent to the message servers corresponding to the Q theme messages, so that the message servers corresponding to the Q theme messages keep or delete the Q theme messages.

Specifically, after the consumer completes consuming, the consumer sends the consumption completion information to the first message server through an Acknowledgement Character (ACK) mechanism. The first message server will decide whether to keep or delete M topic messages according to the policy, and theoretically, the M topic messages can be permanently kept in the first message server.

According to the message service method provided by the embodiment of the application, after consumption is completed, a consumer sends consumption completion information to the message servers corresponding to the Q theme messages, and the message servers corresponding to the Q theme messages are favorable for determining to reserve or delete the Q theme messages.

In other embodiments of the present application, the message service method provides a visual management page, which facilitates viewing and previewing of the message service. In addition, the background management page also provides functions of tenant opening, policy configuration and the like, so that the requirements of multiple tenants are further met, and the application range of the message service method is expanded.

Fig. 12 is a diagram illustrating an application scenario of a message service method according to an embodiment of the present application. As shown in fig. 12, the target group corresponds to a message service cluster, and the message service cluster includes tenant 1, tenant 2, tenant 3, and tenant 4. Each tenant corresponds to a department in the target group. The tenant 1 corresponds to a data center department, the tenant 2 corresponds to a market department, the tenant 3 corresponds to a business department, and the tenant 4 corresponds to a platform. Each department includes a plurality of microservices. The data center department includes a map service, the market department includes a coupon service and a data extraction service, the business department includes a data extraction service, and the platform includes a user service. Each user service may produce different kinds of subject messages. For example, the subject categories of the subject message 1 and the subject message 2 are different. And each service produces different types of theme messages, and the produced theme messages are distributed to consumers for consumption based on the message service method provided by the embodiment of the application.

Method embodiments of the present application are described in detail above in conjunction with fig. 1-12, and apparatus embodiments of the present application are described in detail below in conjunction with fig. 13-16. It is to be understood that the description of the method embodiments corresponds to the description of the apparatus embodiments, and therefore reference may be made to the preceding method embodiments for parts not described in detail.

Fig. 13 is a schematic structural diagram of a message service device according to an embodiment of the present application. As shown in fig. 13, the message service apparatus provided in this embodiment of the present application is applied to a first message server, where the first message server is one of a plurality of message servers included in a message server cluster, and the apparatus includes a receiving module 800, a first determining module 810, and a storing module 820. The receiving module 800 is configured to receive M topic messages issued by a first producer and corresponding to a first message server, where the first producer is one of multiple producers of different departments of a target group. The first determining module 810 is configured to determine, based on the M topic messages and a preset fragmentation manner, respective corresponding blocks of the M topic messages. The storage module 820 is used for storing the M topic messages to the blocks corresponding to the M topic messages, so that the consumers of different departments of the target group subscribe to consumption.

In an embodiment of the present application, the message service device is further configured to receive subscription information for the M topic messages; and based on the subscription information, pushing M theme messages to N consumers corresponding to the subscription information.

In the embodiment of the application, the message service device is further configured to determine, based on the subscription information, message category information corresponding to each of the M topic messages; determining distribution strategy information corresponding to the M subject messages based on the message category information corresponding to the M subject messages; and pushing M subject messages to the N consumers based on the distribution strategy information.

In the embodiment of the application, the message service device is further configured to push a first subject message to a first consumer corresponding to the subscription information based on the subscription information, and if a behavior of pushing the first subject message to a second consumer exists, start error reporting; the first consumer is one of N consumers, the first subject message is one of M subject messages, and the second consumer is one of N consumers.

In this embodiment of the application, the message service device is further configured to push the first subject message to the first consumer corresponding to the subscription information based on the subscription information, and if the subscription service behavior is started by another message server in the message server cluster, the another message server exists as a backup.

In this embodiment of the application, the message service device is further configured to push the first topic message to N consumers corresponding to the subscription information based on the subscription information, so that the N consumers collectively consume the first topic message.

In the embodiment of the application, the message service device is further configured to receive consumption completion information sent by each of the N consumers; and updating the consumption sequence information corresponding to the M theme messages based on the consumption completion information sent by the N consumers respectively.

Fig. 14 is a schematic structural diagram of a message service device according to an embodiment of the present application. As shown in fig. 14, the message service apparatus according to the embodiment of the present application is applied to an electronic device corresponding to a first producer, the first producer being one of a plurality of producers of different departments of a target group, the electronic device corresponding to the first producer being connected to a plurality of message servers included in a message server cluster, and the apparatus includes a generating module 900, a second determining module 910, and a sending module 920. The generating module 900 is configured to generate P theme messages corresponding to the first producer. The second determining module 910 is configured to determine, based on a plurality of message servers included in the message server cluster, a block corresponding to each of the P topic messages. The sending module 920 is configured to send the P topic messages to the blocks corresponding to the P topic messages, so as to store the P topic messages to the message servers corresponding to the P topic messages, respectively, so as to enable the consumers of different departments of the target group to subscribe to and consume.

Fig. 15 is a schematic structural diagram of a message service device according to an embodiment of the present application. As shown in fig. 15, the message service apparatus provided in the embodiment of the present application is applied to an electronic device corresponding to a first consumer, where the first consumer is one of a plurality of consumers in different departments of a target group, and the electronic device corresponding to the first consumer is connected to a plurality of message servers included in a message server cluster, and the apparatus includes a receiving module 1000, a third determining module 1001, and a consuming module 1002. The receiving module 1000 is configured to send subscription information for Q topic messages in the message server cluster. The third determining module 1001 is configured to determine, based on the subscription information, a message server corresponding to each of the Q topic messages. The consumption module 1002 is configured to obtain and consume Q theme messages based on a connection relationship between an electronic device corresponding to a first consumer and a message server corresponding to each of the Q theme messages.

Next, an electronic apparatus according to an embodiment of the present application is described with reference to fig. 16. Fig. 16 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

As shown in fig. 16, the electronic device 1000 includes one or more processors 1001 and memory 1002.

The processor 1002 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device 1000 to perform desired functions.

Memory 1002 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory can include, for example, Random Access Memory (RAM), cache memory (or the like). The non-volatile memory may include, for example, Read Only Memory (ROM), a hard disk, flash memory, and the like. One or more computer program instructions may be stored on a computer-readable storage medium and executed by the processor 1002 to implement the message service methods of the various embodiments of the present application mentioned above and/or other desired functions. Various contents such as a preset fragmentation manner may also be stored in the computer-readable storage medium.

In one example, the electronic device 1000 may further include: an input device 1003 and an output device 1004, which are interconnected by a bus system and/or other form of connection mechanism (not shown).

The input device 1003 may include, for example, a keyboard, a mouse, or the like.

The output device 1004 may output various information including a theme message and the like to the outside. The output devices 1004 may include, for example, a display, speakers, a printer, and a communication network and its connected remote output devices, among others.

Of course, for simplicity, only some of the components of the electronic device 1000 relevant to the present application are shown in fig. 16, and components such as buses, input/output interfaces, and the like are omitted. In addition, the electronic device 1000 may include any other suitable components depending on the particular application.

In addition to the above-described methods and apparatus, embodiments of the present application may also be a computer program product comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the message service method according to various embodiments of the present application described above in this specification.

The computer program product may include program code for carrying out operations for embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.

Furthermore, embodiments of the present application may also be a computer-readable storage medium having stored thereon computer program instructions, which, when executed by a processor, cause the processor to perform the steps in the message service method according to various embodiments of the present application described above in this specification.

A computer-readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The foregoing describes the general principles of the present application in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present application are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present application. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the foregoing disclosure is not intended to be exhaustive or to limit the disclosure to the precise details disclosed.

The block diagrams of devices, apparatuses, systems referred to in this application are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".

It should also be noted that in the devices, apparatuses, and methods of the present application, the components or steps may be decomposed and/or recombined. These decompositions and/or recombinations are to be considered as equivalents of the present application.

The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the application to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims

1. A message service method applied to a first message server, the first message server being one of a plurality of message servers included in a message server cluster, the method comprising:

receiving M theme messages which are issued by a first producer and correspond to the first message server, wherein the first producer is one of a plurality of producers of different departments of a target group;

determining blocks corresponding to the M theme messages respectively based on the M theme messages and a preset fragmentation mode;

and respectively storing the M theme messages into blocks corresponding to the M theme messages so as to facilitate the consumers of different departments of the target group to subscribe for consumption.

2. The message service method according to claim 1, wherein after the storing the M subject messages into the respective corresponding blocks of the M subject messages, further comprising:

receiving subscription information for the M topic messages;

and pushing the M topic messages to N consumers corresponding to the subscription information based on the subscription information.

3. The message service method according to claim 2, wherein the pushing the M topic messages to N consumers corresponding to the subscription information based on the subscription information comprises:

determining message category information corresponding to the M topic messages respectively based on the subscription information;

determining distribution strategy information corresponding to the M subject messages based on the message category information corresponding to the M subject messages;

pushing the M subject messages to the N consumers based on the distribution policy information.

4. The message service method according to claim 2, wherein the pushing the M topic messages to N consumers corresponding to the subscription information based on the subscription information comprises:

based on the subscription information, pushing a first subject message to a first consumer corresponding to the subscription information, and if a behavior of pushing the first subject message to a second consumer exists, starting error reporting; wherein the first consumer is one of the N consumers, the first subject message is one of the M subject messages, and the second consumer is one of the N consumers.

5. The message service method according to claim 2, wherein the pushing the M topic messages to N consumers corresponding to the subscription information based on the subscription information comprises:

and based on the subscription information, pushing a first subject message to a first consumer corresponding to the subscription information, wherein if other message servers in the message server cluster start a subscription service behavior, the other message servers exist as backups.

6. The message service method according to claim 2, wherein the pushing the M topic messages to N consumers corresponding to the subscription information based on the subscription information comprises:

and pushing a first topic message to N consumers corresponding to the subscription information based on the subscription information so that the N consumers commonly consume the first topic message.

7. The message service method according to any one of claims 2 to 6, wherein after the pushing the M topic messages to the N consumers corresponding to the subscription information based on the subscription information, the method further comprises:

receiving consumption completion information sent by the N consumers respectively;

and updating the consumption sequence information corresponding to the M theme messages based on the consumption completion information sent by the N consumers respectively.

8. A message service method applied to an electronic device corresponding to a first producer, the first producer being one of a plurality of producers of different departments of a target group, the electronic device corresponding to the first producer being connected to a plurality of message servers included in a message server cluster, the method comprising:

generating P theme messages corresponding to the first producer;

determining a block corresponding to each of the P subject messages based on a plurality of message servers included in the message server cluster;

and respectively sending the P theme messages to blocks corresponding to the P theme messages so as to respectively store the P theme messages to message servers corresponding to the P theme messages, so that the P theme messages are subscribed and consumed by consumers of different departments of the target group.

9. A message service method applied to an electronic device corresponding to a first consumer, the first consumer being one of a plurality of consumers of different departments of a target group, the electronic device corresponding to the first consumer being connected to a plurality of message servers included in a message server cluster, the method comprising:

sending subscription information for the Q topic messages in the message server cluster;

determining a message server corresponding to each of the Q topic messages based on the subscription information;

and acquiring and consuming the Q theme messages based on the connection relationship between the electronic equipment corresponding to the first consumer and the message servers corresponding to the Q theme messages.

10. The message service method according to claim 6, wherein after the Q theme messages are acquired and consumed based on the connection relationship between the electronic device corresponding to the first consumer and the message server corresponding to each of the Q theme messages, the method further comprises:

and sending consumption completion information to the message servers corresponding to the Q theme messages so that the message servers corresponding to the Q theme messages reserve or delete the Q theme messages.

11. A message service apparatus, applied to a first message server, the first message server being one of a plurality of message servers included in a message server cluster, the apparatus comprising:

the receiving module is used for receiving M theme messages which are issued by a first producer and correspond to the first message server, wherein the first producer is one of a plurality of producers of different cause departments of a target group;

a first determining module, configured to determine, based on the M theme messages and a preset fragmentation mode, respective corresponding blocks of the M theme messages;

and the storage module is used for respectively storing the M theme messages to the blocks corresponding to the M theme messages so as to facilitate the consumers of different cause departments of the target group to subscribe for consumption.

12. A message service apparatus applied to an electronic device corresponding to a first producer, the first producer being one of a plurality of producers of different departments of a target group, the electronic device corresponding to the first producer being connected to a plurality of message servers included in a message server cluster, the apparatus comprising:

a generating module, configured to generate P theme messages corresponding to the first producer;

a second determining module, configured to determine, based on a plurality of message servers included in the message server cluster, a block corresponding to each of the P topic messages;

and the sending module is used for sending the P theme messages to blocks corresponding to the P theme messages respectively so as to store the P theme messages to message servers corresponding to the P theme messages respectively, so that the P theme messages are subscribed and consumed by consumers of different cause departments of the target group.

13. A message service apparatus applied to an electronic device corresponding to a first consumer, the first consumer being one of a plurality of consumers of different departments of a target group, the electronic device corresponding to the first consumer being connected to a plurality of message servers included in a message server cluster, the apparatus comprising:

a receiving module, configured to send subscription information for Q topic messages in the message server cluster;

a third determining module, configured to determine, based on the subscription information, message servers corresponding to the Q topic messages, respectively;

and the consumption module is used for acquiring and consuming the Q theme messages based on the connection relationship between the electronic equipment corresponding to the first consumer and the message servers corresponding to the Q theme messages.

14. A computer-readable storage medium, characterized in that the storage medium stores a computer program for performing the method of any of the preceding claims 1 to 10.

15. An electronic device, characterized in that the electronic device comprises:

a processor;

a memory for storing the processor-executable instructions;

the processor configured to perform the method of any of the preceding claims 1 to 10.