CN111629054A - Message processing method, device and system, electronic equipment and readable storage medium - Google Patents

Message processing method, device and system, electronic equipment and readable storage medium Download PDF

Info

Publication number
CN111629054A
CN111629054A CN202010460497.0A CN202010460497A CN111629054A CN 111629054 A CN111629054 A CN 111629054A CN 202010460497 A CN202010460497 A CN 202010460497A CN 111629054 A CN111629054 A CN 111629054A
Authority
CN
China
Prior art keywords
message
node
target
message queue
service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010460497.0A
Other languages
Chinese (zh)
Other versions
CN111629054B (en
Inventor
潘礼
文峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Kingsoft Cloud Network Technology Co Ltd
Original Assignee
Beijing Kingsoft Cloud Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Kingsoft Cloud Network Technology Co Ltd filed Critical Beijing Kingsoft Cloud Network Technology Co Ltd
Priority to CN202010460497.0A priority Critical patent/CN111629054B/en
Publication of CN111629054A publication Critical patent/CN111629054A/en
Application granted granted Critical
Publication of CN111629054B publication Critical patent/CN111629054B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/562Brokering proxy services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/12Avoiding congestion; Recovering from congestion
    • H04L47/125Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/24Traffic characterised by specific attributes, e.g. priority or QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/51Discovery or management thereof, e.g. service location protocol [SLP] or web services

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The embodiment of the application provides a message processing method, a message processing device, a message processing system, electronic equipment and a readable storage medium, and relates to the technical field of cloud computing. The method comprises the following steps: the control node determines a target computing node for receiving a message to be sent from a plurality of computing nodes; determining a target message queue service for forwarding a message to be sent from a plurality of message queue services based on a target computing node; sending a message to be sent to a target message queue service; the middleware node receives a message to be sent through the target message queue service and forwards the message to be sent to the target computing node; and the target computing node executes the operation corresponding to the message to be sent. Based on the above processing, the probability of network service interruption can be reduced.

Description

Message processing method, device and system, electronic equipment and readable storage medium
Technical Field
The present application relates to the field of communications technologies, and in particular, to a message processing method, an apparatus, a system, an electronic device, and a readable storage medium.
Background
With the rapid development of cloud computing and virtualization technologies, in some cloud computing implementation scenarios, large-scale physical machines and virtual machine resources may be managed based on a cluster management system, and the cluster management system may be an OpenStack system or other systems.
In the related art, the cluster management system may include a control Node (Controller Node) and a computing Node (computer Node). The control node may receive a message for operating the computing node and forward the message to the computing node, and the computing node may perform corresponding operations according to the message, for example, allocating a virtual machine resource, starting a virtual machine, closing the virtual machine, and the like.
In addition, in order to facilitate the control Node to manage the computing nodes, the cluster management system may further include a Middleware Node (Middleware Node). The control node may send a message to the middleware node, and the middleware node may forward the message to the corresponding computing node; in addition, in the network architecture in the related art, messages are forwarded through a global MQ (Message Queue) service deployed in a middleware node, and due to the limitation of service capability processing of the global MQ service, when there are many computing nodes in the network, the pressure of the MQ service is inevitably increased, which may cause Message forwarding failure and cause network service interruption.
Disclosure of Invention
An object of the embodiments of the present application is to provide a message processing method, device, system, electronic device, and readable storage medium, which can reduce the probability of network service interruption. The specific technical scheme is as follows:
in a first aspect, in order to achieve the above object, an embodiment of the present application discloses a message processing method, where the method is applied to a control node in a message processing system, the message processing system further includes a middleware node and a plurality of computing nodes, and a plurality of message queue services are deployed in the middleware node, where the method includes:
determining a computing node for receiving a message to be sent from the plurality of computing nodes as a target computing node;
determining a target message queue service for forwarding the message to be sent from the plurality of message queue services based on the target computing node;
and sending the message to be sent to the target message queue service, so that the middleware node forwards the message to be sent to the target computing node through the target message queue service.
Optionally, the determining, based on the target computing node, a target message queue service for forwarding the message to be sent from the plurality of message queue services includes:
and determining the message queue service corresponding to the target computing node from the corresponding relation between the preset computing node and the plurality of message queue services, wherein the message queue service is used as the target message queue service for forwarding the message to be sent.
Optionally, the method further includes:
sending a first request message to the middleware node for determining a computing node in the message processing system where an update occurs;
and updating the corresponding relation when receiving the identifier of the updated computing node and the identifier of the corresponding message queue service in the message processing system, which are sent by the middleware node.
Optionally, the determining, based on the target computing node, a target message queue service for forwarding the message to be sent from the plurality of message queue services includes:
sending a service determination message to the middleware node containing an identification of the target computing node;
when receiving an identifier of a message queue service sent by the middleware node, determining the message queue service to which the identifier of the message queue service belongs as a target message queue service for forwarding the message to be sent; and the identifier of the message queue service is determined by the middleware node from the corresponding relation between a preset computing node and the plurality of message queue services according to the identifier of the target computing node.
Optionally, before the determining, from the plurality of computing nodes, a computing node for receiving a message to be sent as a target computing node, the method further includes:
sending a second request message to the middleware node for acquiring the computing service deployed in the target computing node;
and receiving the identification of the computing service deployed in the target computing node, which is sent by the middleware node.
In a second aspect, in order to achieve the above object, an embodiment of the present application discloses a message processing method, where the method is applied to a middleware node in a message processing system, the message processing system further includes a control node and a plurality of computing nodes, and a plurality of message queue services are deployed in the middleware node, and the method includes:
receiving a message to be sent by the control node through a target message queue service in the plurality of message queue services; wherein the target message queue service is determined from the plurality of message queue services based on a target computing node of the plurality of computing nodes for receiving the message to be sent;
and forwarding the message to be sent to the target computing node through the target message queue service.
Optionally, before the receiving, by a target message queue service of the plurality of message queue services, a message to be sent by the control node, the method further includes:
receiving a service determination message containing the identification of the target computing node sent by the control node;
determining a message queue service corresponding to the target computing node from the corresponding relation between a preset computing node and the plurality of message queue services as a target message queue service;
and sending the identification of the target message queue service to the control node.
Optionally, the method further includes:
receiving a first request message sent by the control node and used for determining a computing node updated in the message processing system;
and sending the identification of the updated computing node and the identification of the corresponding message queue service in the message processing system to the control node.
Optionally, before the receiving, by a target message queue service of the plurality of message queue services, a message to be sent by the control node, the method further includes:
receiving an identifier of the target message queue service uploaded by the target computing node and an identifier of a computing service deployed in the target computing node;
and recording the corresponding relation between the target computing node and the target message queue service and the computing service deployed in the target computing node.
Optionally, after receiving the identifier of the target message queue service uploaded by the target computing node and the identifier of the computing service deployed in the target computing node, the method further includes:
and when receiving a second request message which is sent by the control node and used for acquiring the computing service deployed in the target computing node, sending the identification of the computing service deployed in the target computing node to the control node.
Optionally, after receiving the identifier of the target message queue service uploaded by the target computing node and the identifier of the computing service deployed in the target computing node, the method further includes:
and when the distance from the last time when the heartbeat message sent by the target computing node through the computing service is received reaches a preset time and the heartbeat message sent by the target computing node through the computing service is not received again, determining that the target computing node cannot provide the computing service.
In a third aspect, in order to achieve the above object, an embodiment of the present application discloses a message processing method, where the method is applied to a target computing node in a message processing system, the message processing system further includes a control node and a middleware node, and a plurality of message queue services are deployed in the middleware node, and the method includes:
receiving a message to be sent, which is sent by the middleware node through a target message queue service in the plurality of message queue services, wherein the target message queue service is determined from the plurality of message queue services based on the target computing node;
and executing the operation corresponding to the message to be sent.
Optionally, before the receiving a message to be sent, which is sent by the middleware node through a target message queue service in the plurality of message queue services, the method further includes:
uploading the identifier of the target message queue service and the identifier of the computing service deployed in the target computing node to the middleware node.
Optionally, the method further includes:
and sending a corresponding heartbeat message to the middleware node through the computing service according to a preset period.
In a fourth aspect, in order to achieve the above object, an embodiment of the present application discloses a message processing system, where the system includes a control node, a middleware node, and multiple computing nodes, where the middleware node is deployed with multiple message queue services, where:
the control node is used for determining a computing node used for receiving a message to be sent from the plurality of computing nodes as a target computing node; determining a target message queue service for forwarding the message to be sent from the plurality of message queue services based on the target computing node; sending the message to be sent to the target message queue service;
the middleware node is configured to receive the message to be sent through the target message queue service and forward the message to be sent to the target computing node;
and the target computing node is used for executing the operation corresponding to the message to be sent.
In a fifth aspect, in order to achieve the above object, an embodiment of the present application discloses a message processing apparatus, where the apparatus is applied to a control node in a message processing system, the message processing system further includes a middleware node and a plurality of computing nodes, and a plurality of message queue services are deployed in the middleware node, the apparatus includes:
a first determining module, configured to determine, from the plurality of computing nodes, a computing node for receiving a message to be sent as a target computing node;
a second determining module, configured to determine, based on the target computing node, a target message queue service for forwarding the message to be sent from the plurality of message queue services;
a sending module, configured to send the message to be sent to the target message queue service, so that the middleware node forwards the message to be sent to the target computing node through the target message queue service.
Optionally, the second determining module is specifically configured to determine, from a preset correspondence between the computing node and the plurality of message queue services, a message queue service corresponding to the target computing node, as a target message queue service for forwarding the message to be sent.
Optionally, the apparatus further comprises:
an update module, configured to send, to the middleware node, a first request message for determining a computing node in the message processing system where an update occurs;
and updating the corresponding relation when receiving the identifier of the updated computing node and the identifier of the corresponding message queue service in the message processing system, which are sent by the middleware node.
Optionally, the second determining module is specifically configured to
Sending a service determination message to the middleware node containing an identification of the target computing node;
when receiving an identifier of a message queue service sent by the middleware node, determining the message queue service to which the identifier of the message queue service belongs as a target message queue service for forwarding the message to be sent; and the identifier of the message queue service is determined by the middleware node from the corresponding relation between a preset computing node and the plurality of message queue services according to the identifier of the target computing node.
Optionally, the apparatus further comprises:
a processing module, configured to send a second request message to the middleware node, where the second request message is used to obtain a computing service deployed in the target computing node;
and receiving the identification of the computing service deployed in the target computing node, which is sent by the middleware node.
In a sixth aspect, in order to achieve the above object, an embodiment of the present application discloses a message processing apparatus, where the apparatus is applied to a middleware node in a message processing system, the message processing system further includes a control node and a plurality of computing nodes, and a plurality of message queue services are deployed in the middleware node, the apparatus includes:
a first receiving module, configured to receive, through a target message queue service in the multiple message queue services, a message to be sent that is sent by the control node; wherein the target message queue service is determined from the plurality of message queue services based on a target computing node of the plurality of computing nodes for receiving the message to be sent;
and the forwarding module is used for forwarding the message to be sent to the target computing node through the target message queue service.
Optionally, the apparatus further comprises:
a first processing module, configured to receive a service determination message sent by the control node and including an identifier of the target computing node, before the message to be sent by the control node is received through a target message queue service in the plurality of message queue services;
determining a message queue service corresponding to the target computing node from the corresponding relation between a preset computing node and the plurality of message queue services as a target message queue service;
and sending the identification of the target message queue service to the control node.
Optionally, the apparatus further comprises:
the second processing module is used for receiving a first request message which is sent by the control node and used for determining a computing node which is updated in the message processing system;
and sending the identification of the updated computing node and the identification of the corresponding message queue service in the message processing system to the control node.
Optionally, the apparatus further comprises:
a second receiving module, configured to receive, before receiving, through a target message queue service of the multiple message queue services, a message to be sent by the control node, an identifier of the target message queue service uploaded by the target computing node and an identifier of a computing service deployed in the target computing node;
and recording the corresponding relation between the target computing node and the target message queue service and the computing service deployed in the target computing node.
Optionally, the apparatus further comprises:
a sending module, configured to send, after receiving the identifier of the target message queue service uploaded by the target computing node and the identifier of the computing service deployed in the target computing node, the identifier of the computing service deployed in the target computing node to the control node when receiving a second request message sent by the control node and used to acquire the computing service deployed in the target computing node.
Optionally, the apparatus further comprises:
and the determining module is used for determining that the target computing node cannot provide the computing service when the distance between the last time the heartbeat message sent by the target computing node through the computing service is received and the time the heartbeat message sent by the target computing node through the computing service is not received again after the identifier of the target message queue service uploaded by the target computing node and the identifier of the computing service deployed in the target computing node are received.
In a seventh aspect, in order to achieve the above object, an embodiment of the present application discloses a message processing apparatus, where the apparatus is applied to a target computing node in a message processing system, the message processing system further includes a control node and a middleware node, and a plurality of message queue services are deployed in the middleware node, and the apparatus includes:
a receiving module, configured to receive a message to be sent, which is sent by the middleware node through a target message queue service in the multiple message queue services, where the target message queue service is determined from the multiple message queue services based on the target computing node;
and the processing module is used for executing the operation corresponding to the message to be sent.
Optionally, the apparatus further comprises:
an upload module, configured to upload, to the middleware node, an identifier of a target message queue service and an identifier of a computing service deployed in the target computing node before the receiving of a message to be sent, where the message to be sent is sent by the middleware node through the target message queue service in the multiple message queue services.
Optionally, the apparatus further comprises:
and the sending module is used for sending the corresponding heartbeat message to the middleware node through the computing service according to a preset period.
On the other hand, in order to achieve the above object, an embodiment of the present application further discloses an electronic device, which includes a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to implement the message processing method according to the first aspect when executing the program stored in the memory.
On the other hand, in order to achieve the above object, an embodiment of the present application further discloses an electronic device, which includes a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to implement the message processing method according to the second aspect when executing the program stored in the memory.
On the other hand, in order to achieve the above object, an embodiment of the present application further discloses an electronic device, which includes a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to implement the message processing method according to the third aspect when executing the program stored in the memory.
On the other hand, in order to achieve the above object, an embodiment of the present application further discloses a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the message processing method according to the first aspect is implemented.
On the other hand, in order to achieve the above object, an embodiment of the present application further discloses a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the message processing method according to the second aspect.
On the other hand, in order to achieve the above object, an embodiment of the present application further discloses a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the message processing method according to the third aspect is implemented.
On the other hand, in order to achieve the above object, an embodiment of the present application further discloses a computer program product containing instructions, which when run on a computer, causes the computer to execute the message processing method according to the first aspect.
On the other hand, in order to achieve the above object, an embodiment of the present application further discloses a computer program product containing instructions, which when run on a computer, causes the computer to execute the message processing method according to the second aspect.
On the other hand, in order to achieve the above object, an embodiment of the present application further discloses a computer program product containing instructions, which when run on a computer, causes the computer to execute the message processing method according to the third aspect.
The embodiment of the application provides a message processing method, wherein a control node determines a target computing node for receiving a message to be sent from a plurality of computing nodes; determining a target message queue service for forwarding a message to be sent from a plurality of message queue services based on a target computing node; sending a message to be sent to a target message queue service; the middleware node receives a message to be sent through the target message queue service and forwards the message to be sent to the target computing node; and the target computing node executes the operation corresponding to the message to be sent.
Based on the above processing, the middleware node may deploy a plurality of message queue services, and forward the message to be sent to the target computing node to the determined target message queue service, that is, the service traffic may be divided into a plurality of message queue services, thereby avoiding that the same message queue service shares all the service traffic, reducing the service pressure of the message queue service, and further reducing the probability of network service interruption.
Of course, not all advantages described above need to be achieved at the same time in the practice of any one product or method of the present application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a diagram of a prior art network architecture;
fig. 2 is an architecture diagram of a message processing system according to an embodiment of the present application;
fig. 3 is a flowchart of a message processing method according to an embodiment of the present application;
fig. 4 is a flowchart of a message processing method according to an embodiment of the present application;
fig. 5 is a flowchart of a message processing method according to an embodiment of the present application;
fig. 6 is a signaling interaction diagram of a message processing method according to an embodiment of the present application;
fig. 7 is a block diagram of a message processing apparatus according to an embodiment of the present application;
fig. 8 is a block diagram of a message processing apparatus according to an embodiment of the present application;
fig. 9 is a block diagram of a message processing apparatus according to an embodiment of the present application;
fig. 10 is a block diagram of an electronic device according to an embodiment of the present disclosure;
fig. 11 is a block diagram of an electronic device according to an embodiment of the present disclosure;
fig. 12 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a diagram of a network architecture in the prior art.
In fig. 1, the network comprises a control node, a middleware node, a cluster 1 and a cluster 2. A global message queue service is deployed in the middleware node, the cluster 1 includes a computing node 1, a computing node 2 and a computing node 3, and the cluster 2 includes a computing node 4, a computing node 5 and a computing node 6.
In the network architecture, messages are forwarded through a global message queue service deployed in a middleware node, and due to the limitation of service capability processing of the message queue service, when there are many computing nodes in a network, the pressure of the message queue service is inevitably increased, so that message forwarding failure may be caused, and network service interruption may be caused.
In order to solve the above problem, an embodiment of the present application provides a message processing system, which may refer to fig. 2.
The system shown in fig. 2 may include a control node, a middleware node, a cluster 1, and a cluster 2. The middleware node is provided with a message queue service 1 and a message queue service 2, the cluster 1 comprises a computing node 1, a computing node 2 and a computing node 3, and the cluster 2 comprises a computing node 4, a computing node 5 and a computing node 6.
In the system shown in fig. 2, the computing node in the cluster 1 corresponds to the message queue service 1, and the computing node in the cluster 2 corresponds to the message queue service 2, that is, the message queue service 1 is used for forwarding messages to the computing nodes in the cluster 1, and the message queue service 2 is used for forwarding messages to the computing nodes in the cluster 2.
The control node may determine a target computing node (e.g., computing node 2) for receiving a message to be sent from among the plurality of computing nodes, and may further determine a target message queue service (i.e., message queue service 1) for forwarding the message to be sent from among the plurality of message queue services (i.e., message queue service 1 and message queue service 2) based on the computing node 2, and send the message to be sent to the message queue service 1. The middleware node may receive the message to be sent through the message queue service 1, and forward the message to be sent to the computing node 2, and then the computing node 2 may execute an operation corresponding to the message to be sent.
As can be seen, a plurality of message queue services may be deployed in the middleware node, and the message that needs to be sent to the target computing node is forwarded to the determined target message queue service, that is, the service traffic may be divided into a plurality of message queue services, thereby avoiding that the same message queue service shares all the service traffic, reducing the service pressure of the message queue service, and further reducing the probability of network service interruption.
With regard to other embodiments of the above-described message processing system, reference may be made to the following detailed description of method embodiments with regard to a control node, a middleware node, and a target compute node.
Referring to fig. 3, fig. 3 is a flowchart of a message processing method provided in an embodiment of the present application, where the method may be applied to a control node in the above system, and the method may include the following steps:
s301: a computing node for receiving a message to be sent is determined from a plurality of computing nodes as a target computing node.
S302: a target message queue service for forwarding a message to be sent is determined from a plurality of message queue services based on a target computing node.
S303: and sending the message to be sent to the target message queue service, so that the middleware node forwards the message to be sent to the target computing node through the target message queue service.
As can be seen, based on the message processing method provided in the embodiment of the present application, a plurality of message queue services may be deployed in the middleware node, and a message that needs to be sent to the target computing node is forwarded to the determined target message queue service, that is, the traffic flow may be divided into a plurality of message queue services, so that the same message queue service is prevented from sharing all traffic flows, the traffic pressure of the message queue services is reduced, and the probability of network traffic interruption may be reduced.
In step S301, a Nova-API (Nova-Application Programming Interface) service may be deployed in the control node, and the control node may receive, through the Nova-API service, a message (i.e., a message to be sent) sent by a user to the computing node through the client.
The message to be sent may include an identifier of a virtual machine that the user needs to manage, and the Nova-API service may determine, according to the identifier of the virtual machine in the message to be sent, a computing node (i.e., a target computing node) where the virtual machine that the user needs to manage is located.
In one embodiment, S302 may include the steps of: and determining the message queue service corresponding to the target computing node from the corresponding relation between the preset computing node and the plurality of message queue services as the target message queue service for forwarding the message to be sent.
In the embodiment of the present application, the correspondence between the computing node and the message queue service deployed in the middleware node may be specified by a technician when the request message processing system is deployed. The number of message queue services deployed in the middleware node may be determined by a technician according to the number of compute nodes and the service requirements in the current request message processing system.
In one implementation, the correspondence may be obtained by the control node from the middleware node. For example, when a new computing node comes online, the new computing node may notify the middleware node of its corresponding message queue service, and further, the control node may obtain the correspondence between the computing node and the message queue service from the middleware node.
In an embodiment, the control node may further update the correspondence, and the method may further include the following steps: sending a first request message to the middleware node for determining a computing node in the message processing system where an update occurs; and when receiving the identification of the updated computing node and the identification of the corresponding message queue service in the message processing system, which are sent by the middleware node, updating the corresponding relation.
In one implementation, the control node may periodically request information from the middleware node for the compute nodes in the message processing system where the update occurs.
The newly online computing node may notify the middleware node of its corresponding message queue service, and accordingly, when the middleware node receives the first request message sent by the control node, the middleware node may send, to the control node, an identifier of the computing node that has been updated in the previous period and an identifier of the corresponding message queue service, and further, the control node may update the correspondence relationship according to the received information.
For example, when a computing node is newly brought online, the control node may record the computing node and the corresponding message queue service in the corresponding relationship; alternatively, when a computing node is offline, the control node may delete the computing node from the correspondence.
In one implementation, the compute node may upload a heartbeat message to the middleware node, and the middleware node may determine the offline compute node according to the heartbeat message of the compute node.
In one embodiment, S302 may include the steps of:
step one, sending a service determination message containing the identification of the target computing node to the middleware node.
And step two, when receiving the identifier of the message queue service sent by the middleware node, determining the message queue service to which the identifier of the message queue service belongs as the message queue service for forwarding the message to be sent.
The identifier of the message queue service is determined by the middleware node according to the identifier of the target computing node from the corresponding relation between the preset computing node and the plurality of message queue services.
In one implementation, the control node may send a service determination message carrying an identifier of the target computing node to the middleware node through the Nova-API service to request to determine a message queue service for forwarding the message to be sent.
After receiving the service determination message, the middleware node may determine, from the preset correspondence between the computing node and the multiple message queue services deployed by itself, a message queue service corresponding to the target computing node, and send an identifier of the message queue service to the control node.
Further, the control node may determine the message queue service to which the identifier of the message queue service belongs as a message queue service for forwarding the message to be sent (i.e., a target message queue service).
In one embodiment, the control node may further determine services (i.e., computing services) that can be provided by the computing nodes in the message processing system, and before S301, the method may further include the steps of: sending a second request message to the middleware node, wherein the second request message is used for acquiring computing services deployed in the target computing node; and receiving the identification of the computing service deployed in the target computing node, which is sent by the middleware node.
In one implementation, when a target computing node comes online, the middleware node may determine the computing services deployed in the target computing node.
Accordingly, the control node may request, from the middleware node, a query for computing services deployed in a newly online computing node (i.e., a target computing node in the embodiment of the present application) through the Nova-API service.
Based on the above processing, the control node can determine the computing services supported by the message processing system.
Referring to fig. 4, fig. 4 is a flowchart of a message processing method provided by an embodiment of the present application, where the method may be applied to a middleware node in the above system, and the method may include the following steps:
s401: and receiving the message to be sent by the control node through a target message queue service in the plurality of message queue services.
The target message queue service is determined from the plurality of message queue services based on a target computing node in the plurality of computing nodes for receiving a message to be sent.
S402: and forwarding the message to be sent to the target computing node through the target message queue service.
As can be seen, based on the message processing method provided in the embodiment of the present application, a plurality of message queue services may be deployed in the middleware node, and a message that needs to be sent to the target computing node is forwarded to the determined target message queue service, that is, the traffic flow may be divided into a plurality of message queue services, so that the same message queue service is prevented from sharing all traffic flows, the traffic pressure of the message queue services is reduced, and the probability of network traffic interruption may be reduced.
In step S401, the target computing node is the computing node where the virtual machine that the user needs to manage is located. The message to be sent received by the control node may include an identifier of a virtual machine that the user needs to manage, and the control node may determine, according to the identifier of the virtual machine, a target computing node where the virtual machine that the user needs to manage is located, and further may determine, based on the target computing node, a target message queue service for forwarding the message to be sent from among a plurality of message queue services deployed in the middleware node.
In one embodiment, prior to S401, the method may include the steps of: receiving a service determination message which is sent by a control node and contains an identifier of a target computing node; determining a message queue service corresponding to a target computing node from the corresponding relation between a preset computing node and a plurality of message queue services as a target message queue service; and sending the identification of the target message queue service to the control node.
In one implementation, services may also be deployed in the middleware node. When a new computing node is online, the services can determine the message queue service corresponding to the new online computing node and record the message queue service locally.
Subsequently, when the middleware node receives a service determination message which is sent by the control node through the services and contains the identifier of the target computing node, the identifier of the target computing node can be extracted, and a message queue service (namely, a target message queue service) corresponding to the target computing node is determined according to a local record, so that the identifier of the target message queue service can be sent to the control node, and correspondingly, the control node can determine that the target message queue service is the message queue service for forwarding the message to be sent.
In one embodiment, the method may further comprise the steps of: receiving a first request message sent by a control node and used for determining a computing node updated in a message processing system; and sending the identification of the computing node which is updated in the message processing system and the identification of the corresponding message queue service to the control node.
In one implementation, the control node may periodically request information from the middleware node for the compute nodes in the message processing system where the update occurs.
The newly online computing node may notify the middleware node of its corresponding message queue service, and accordingly, when the middleware node receives the first request message sent by the control node, the middleware node may send, to the control node, an identifier of the computing node that has been updated in the previous period and an identifier of the corresponding message queue service, and further, the control node may update the correspondence relationship according to the received information.
For example, when a computing node is newly brought online, the control node may record the computing node and the corresponding message queue service in the corresponding relationship; alternatively, when a computing node is offline, the control node may delete the computing node from the correspondence.
In one implementation, the compute node may upload a heartbeat message to the middleware node, and the middleware node may determine the offline compute node according to the heartbeat message of the compute node.
In one embodiment, before step S401, the method may further include the steps of:
step one, receiving an identifier of a target message queue service uploaded by a target computing node and an identifier of a computing service deployed in the target computing node.
And step two, recording the corresponding relation between the target computing node and the target message queue service and the computing service deployed in the target computing node.
In one implementation, when a target computing node comes online, the target computing node may actively send an identifier of a message queue service corresponding to the target computing node (i.e., a target message queue service) and an identifier of a computing service deployed by the target computing node to a services deployed in a middleware section.
Correspondingly, the middleware node may record the information locally, that is, the middleware node may determine, through the services, the message queue service corresponding to each computing node in the message processing system and the computing service deployed by each computing node.
In one embodiment, after receiving the identification of the computing service uploaded by the target computing node, the method may further comprise the steps of: and when receiving a second request message which is sent by the control node and used for acquiring the computing service deployed in the target computing node, sending the identification of the computing service deployed in the target computing node to the control node.
In one implementation, the control node may request the middleware node to query the computing service deployed in the target computing node through the Nova-API service, and accordingly, the middleware node may send an identifier of the computing service deployed in the target computing node to the control node through the services, and further, the control node may determine the computing service supported by the message processing system.
In one embodiment, the method may further comprise the steps of: and when the distance from the last time when the heartbeat message sent by the target computing node through the computing service is received reaches the preset time and the heartbeat message sent by the target computing node through the computing service is not received again, determining that the target computing node cannot provide the computing service.
In one implementation, after the target computing node is online, the target computing node may send a heartbeat message to a services service deployed in the middleware node through a computing service according to a preset period. The duration of the preset period is a preset duration.
Correspondingly, for any computing service (which may be referred to as a target computing service) in the target computing node, when the middleware node detects that the distance from the last heartbeat message sent by the target computing node through the target computing service reaches a preset time and the heartbeat message sent by the target computing node through the target computing service is not received again, it indicates that the target computing node cannot provide the target computing service currently.
Referring to fig. 5, fig. 5 is a flowchart of a message processing method provided in this embodiment, where the method may be applied to a target computing node in the above system, and the target computing node may be any computing node in the above system, and the method may include the following steps:
s501: and receiving a message to be sent, which is sent by the middleware node through a target message queue service in the plurality of message queue services.
Wherein the target message queue service is determined from a plurality of message queue services based on the target computing node.
S502: and executing the operation corresponding to the message to be sent.
As can be seen, based on the message processing method provided in the embodiment of the present application, a plurality of message queue services may be deployed in the middleware node, and a message that needs to be sent to the target computing node is forwarded to the determined target message queue service, that is, the traffic flow may be divided into a plurality of message queue services, so that the same message queue service is prevented from sharing all traffic flows, the traffic pressure of the message queue services is reduced, and the probability of network traffic interruption may be reduced.
In step S502, the operation corresponding to the message to be sent may include an operation of managing virtual machine resources in the target computing node, for example, an operation of allocating virtual machine resources in the target computing node, starting a virtual machine, and closing the virtual machine.
In one embodiment, prior to step 501, the method may further comprise the steps of: and uploading the identifier of the target message queue service and the identifier of the computing service deployed in the target computing node to the middleware node.
When the target computing node is online, the target computing node may actively send an identifier of a message queue service corresponding to the target computing node (i.e., the target message queue service) and an identifier of a computing service deployed by the target computing node to the services deployed in the middleware section.
Based on the processing, the message processing system can automatically discover the lower-layer computing service, thereby avoiding the condition of service interruption caused by restarting the service when the message processing system expands the capacity and improving the reliability of the network.
In one embodiment, the method may further comprise the steps of: and sending a corresponding heartbeat message to the middleware node through the computing service according to a preset period.
In one implementation, after the target computing node is online, the target computing node may send a heartbeat message to a services service deployed in the middleware node through a computing service according to a preset period.
Correspondingly, for any computing service in the target computing node (i.e., the target computing service in the embodiment of the present application), when the middleware node detects that the distance from the last heartbeat message sent by the target computing node through the target computing service is received to reach the preset time length, and the heartbeat message sent by the target computing node through the target computing service is not received again, it indicates that the target computing node cannot provide the target computing service currently.
Referring to fig. 6, fig. 6 is a signaling interaction diagram of a message processing method provided in the embodiment of the present application, where the method may be applied to a control node, a middleware node, and a target computing node in the above system, and the method may include the following steps:
s601: the control node determines a computing node for receiving a message to be sent as a target computing node.
S602: the control node determines a target message queue service for forwarding a message to be sent from a plurality of message queue services deployed in the middleware node based on the target computing node.
S603: and the control node sends the message to be sent to the target message queue service.
S604: the middleware node receives a message to be sent through the target message queue service.
S605: and the middleware node forwards the message to be sent to the target computing node through the target message queue service.
S606: and the target computing node executes the operation corresponding to the message to be sent.
Based on the same inventive concept, referring to fig. 7, fig. 7 is a structural diagram of a message processing apparatus provided in an embodiment of the present application, where the apparatus is applied to a control node in a message processing system, the message processing system further includes a middleware node and a plurality of computing nodes, and a plurality of message queue services are deployed in the middleware node, and the apparatus includes:
a first determining module 701, configured to determine, from a plurality of computing nodes, a computing node for receiving a message to be sent as a target computing node;
a second determining module 702, configured to determine, based on the target computing node, a target message queue service for forwarding a message to be sent from the plurality of message queue services;
the sending module 703 is configured to send a message to be sent to the target message queue service, so that the middleware node forwards the message to be sent to the target computing node through the target message queue service.
Optionally, the second determining module 702 is specifically configured to determine, from the preset corresponding relationship between the computing node and the multiple message queue services, a message queue service corresponding to the target computing node, as a target message queue service for forwarding the message to be sent.
Optionally, the apparatus further comprises:
the updating module is used for sending a first request message to the middleware node and determining a computing node which is updated in the message processing system;
and when receiving the identification of the updated computing node and the identification of the corresponding message queue service in the message processing system, which are sent by the middleware node, updating the corresponding relation.
Optionally, the second determining module 702 is specifically configured to
Sending a service determination message containing an identification of the target computing node to the middleware node;
when receiving an identifier of a message queue service sent by a middleware node, determining the message queue service to which the identifier of the message queue service belongs as a target message queue service for forwarding a message to be sent; the identifier of the message queue service is determined by the middleware node according to the identifier of the target computing node from the corresponding relation between the preset computing node and the plurality of message queue services.
Optionally, the apparatus further comprises:
the processing module is used for sending a second request message to the middleware node and acquiring the computing service deployed in the target computing node;
and receiving the identification of the computing service deployed in the target computing node, which is sent by the middleware node.
Based on the same inventive concept, referring to fig. 8, fig. 8 is a structural diagram of a message processing apparatus provided in an embodiment of the present application, where the apparatus is applied to a middleware node in a message processing system, the message processing system further includes a control node and a plurality of computing nodes, and a plurality of message queue services are deployed in the middleware node, and the apparatus includes:
a first receiving module 801, configured to receive a message to be sent, which is sent by a control node, through a target message queue service in a plurality of message queue services; the target message queue service is determined from the plurality of message queue services based on a target computing node used for receiving a message to be sent in the plurality of computing nodes;
the forwarding module 802 is configured to forward a message to be sent to a target computing node through a target message queue service.
Optionally, the apparatus further comprises:
the first processing module is used for receiving a service determination message which is sent by the control node and contains the identification of the target computing node before receiving a message to be sent by the control node through a target message queue service in the plurality of message queue services;
determining a message queue service corresponding to a target computing node from the corresponding relation between a preset computing node and a plurality of message queue services as a target message queue service;
and sending the identification of the target message queue service to the control node.
Optionally, the apparatus further comprises:
the second processing module is used for receiving a first request message which is sent by the control node and used for determining a computing node which is updated in the message processing system;
and sending the identification of the computing node which is updated in the message processing system and the identification of the corresponding message queue service to the control node.
Optionally, the apparatus further comprises:
the second receiving module is used for receiving the identifier of the target message queue service uploaded by the target computing node and the identifier of the computing service deployed in the target computing node before receiving the message to be sent and sent by the control node through the target message queue service in the plurality of message queue services;
and recording the corresponding relation between the target computing node and the target message queue service and the computing service deployed in the target computing node.
Optionally, the apparatus further comprises:
and the sending module is used for sending the identifier of the computing service deployed in the target computing node to the control node when receiving a second request message which is sent by the control node and used for acquiring the computing service deployed in the target computing node after receiving the identifier of the target message queue service uploaded by the target computing node and the identifier of the computing service deployed in the target computing node.
Optionally, the apparatus further comprises:
the determining module is used for determining that the target computing node cannot provide the computing service when the distance between the last received heartbeat message sent by the target computing node through the computing service reaches the preset time and the heartbeat message sent by the target computing node through the computing service is not received again after receiving the identifier of the target message queue service uploaded by the target computing node and the identifier of the computing service deployed in the target computing node.
Based on the same inventive concept, referring to fig. 9, fig. 9 is a structural diagram of a message processing apparatus provided in an embodiment of the present application, where the apparatus is applied to a target computing node in a message processing system, the message processing system further includes a control node and a middleware node, and a plurality of message queue services are deployed in the middleware node, and the apparatus includes:
a receiving module 901, configured to receive a to-be-sent message sent by a middleware node through a target message queue service in multiple message queue services, where the target message queue service is determined from the multiple message queue services based on a target computing node;
the processing module 902 is configured to execute an operation corresponding to a message to be sent.
Optionally, the apparatus further comprises:
and the uploading module is used for uploading the identifier of the target message queue service and the identifier of the computing service deployed in the target computing node to the middleware node before receiving the message to be sent, which is sent by the middleware node through the target message queue service in the plurality of message queue services.
Optionally, the apparatus further comprises:
and the sending module is used for sending the corresponding heartbeat message to the middleware node through the computing service according to the preset period.
An embodiment of the present application further provides an electronic device, as shown in fig. 10, including a memory 1001 and a processor 1002;
a memory 1001 for storing a computer program;
the processor 1002 is configured to implement the message processing method applied to the control node according to the embodiment of the present application when executing the program stored in the memory 1001.
Specifically, the message processing method applied to the control node includes:
determining a computing node for receiving a message to be sent from a plurality of computing nodes as a target computing node;
determining a target message queue service for forwarding a message to be sent from a plurality of message queue services based on a target computing node;
and sending the message to be sent to the target message queue service, so that the middleware node forwards the message to be sent to the target computing node through the target message queue service.
It should be noted that other implementation manners of the message processing method applied to the control node are the same as those of the foregoing method embodiment, and are not described herein again.
An embodiment of the present application further provides an electronic device, as shown in fig. 11, including a memory 1101 and a processor 1102;
a memory 1101 for storing a computer program;
the processor 1102 is configured to implement the message processing method applied to the middleware node according to the embodiment of the present application when executing the program stored in the memory 1101.
Specifically, the message processing method applied to the middleware node includes:
receiving a message to be sent by a control node through a target message queue service in a plurality of message queue services; the target message queue service is determined from the plurality of message queue services based on a target computing node used for receiving a message to be sent in the plurality of computing nodes;
and forwarding the message to be sent to the target computing node through the target message queue service.
It should be noted that other implementation manners of the message processing method applied to the middleware node are partially the same as those of the foregoing method embodiments, and are not described again here.
An embodiment of the present application further provides an electronic device, as shown in fig. 12, including a memory 1201 and a processor 1202;
a memory 1201 for storing a computer program;
the processor 1202 is configured to implement the message processing method applied to the target computing node according to the embodiment of the present application when executing the program stored in the memory 1201.
Specifically, the message processing method applied to the target computing node includes:
receiving a message to be sent, which is sent by a middleware node through a target message queue service in a plurality of message queue services, wherein the target message queue service is determined from the plurality of message queue services based on a target computing node;
and executing the operation corresponding to the message to be sent.
It should be noted that other implementation manners of the message processing method applied to the target computing node are the same as those of the foregoing method embodiment, and are not described herein again.
The electronic device may be provided with a communication interface for realizing communication between the electronic device and another device.
The processor, the communication interface, and the memory are configured to communicate with each other through a communication bus, where the communication bus may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The communication bus may be divided into an address bus, a data bus, a control bus, etc.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
The embodiment of the present application also provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is enabled to execute the message processing method applied to the control node provided by the embodiment of the present application.
The embodiment of the present application further provides a computer-readable storage medium, in which instructions are stored, and when the instructions are executed on a computer, the computer is enabled to execute the message processing method applied to the middleware node provided by the embodiment of the present application.
The embodiment of the present application further provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is enabled to execute the message processing method applied to the target computing node provided by the embodiment of the present application.
Embodiments of the present application further provide a computer program product containing instructions, which when run on a computer, cause the computer to execute the message processing method applied to the control node provided in the embodiments of the present application.
Embodiments of the present application further provide a computer program product containing instructions, which when run on a computer, cause the computer to execute the message processing method applied to the middleware node provided in the embodiments of the present application.
Embodiments of the present application further provide a computer program product containing instructions, which when run on a computer, cause the computer to execute the message processing method applied to the target computing node provided in the embodiments of the present application.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus, system, electronic device, computer-readable storage medium, and computer program product embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference may be made to some descriptions of the method embodiments for relevant points.
The above description is only for the preferred embodiment of the present application and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims (31)

1. A message processing method applied to a control node in a message processing system, wherein the message processing system further includes a middleware node and a plurality of computing nodes, and a plurality of message queue services are deployed in the middleware node, the method comprising:
determining a computing node for receiving a message to be sent from the plurality of computing nodes as a target computing node;
determining a target message queue service for forwarding the message to be sent from the plurality of message queue services based on the target computing node;
and sending the message to be sent to the target message queue service, so that the middleware node forwards the message to be sent to the target computing node through the target message queue service.
2. The method of claim 1, wherein determining a target message queue service from the plurality of message queue services for forwarding the message to be sent based on the target computing node comprises:
and determining the message queue service corresponding to the target computing node from the corresponding relation between the preset computing node and the plurality of message queue services, wherein the message queue service is used as the target message queue service for forwarding the message to be sent.
3. The method of claim 2, further comprising:
sending a first request message to the middleware node for determining a computing node in the message processing system where an update occurs;
and updating the corresponding relation when receiving the identifier of the updated computing node and the identifier of the corresponding message queue service in the message processing system, which are sent by the middleware node.
4. The method of claim 1, wherein determining a target message queue service from the plurality of message queue services for forwarding the message to be sent based on the target computing node comprises:
sending a service determination message to the middleware node containing an identification of the target computing node;
when receiving an identifier of a message queue service sent by the middleware node, determining the message queue service to which the identifier of the message queue service belongs as a target message queue service for forwarding the message to be sent; and the identifier of the message queue service is determined by the middleware node from the corresponding relation between a preset computing node and the plurality of message queue services according to the identifier of the target computing node.
5. The method of claim 1, further comprising:
sending a second request message to the middleware node for acquiring the computing service deployed in the target computing node;
and receiving the identification of the computing service deployed in the target computing node, which is sent by the middleware node.
6. A message processing method applied to a middleware node in a message processing system, the message processing system further comprising a control node and a plurality of computing nodes, wherein a plurality of message queue services are deployed in the middleware node, the method comprising:
receiving a message to be sent by the control node through a target message queue service in the plurality of message queue services; wherein the target message queue service is determined from the plurality of message queue services based on a target computing node of the plurality of computing nodes for receiving the message to be sent;
and forwarding the message to be sent to the target computing node through the target message queue service.
7. The method of claim 6, wherein before said receiving a message to be sent by said control node through a target message queue service of said plurality of message queue services, said method further comprises:
receiving a service determination message containing the identification of the target computing node sent by the control node;
determining a message queue service corresponding to the target computing node from the corresponding relation between a preset computing node and the plurality of message queue services as a target message queue service;
and sending the identification of the target message queue service to the control node.
8. The method of claim 6, further comprising:
receiving a first request message sent by the control node and used for determining a computing node updated in the message processing system;
and sending the identification of the updated computing node and the identification of the corresponding message queue service in the message processing system to the control node.
9. The method of claim 6, wherein before said receiving a message to be sent by said control node through a target message queue service of said plurality of message queue services, said method further comprises:
receiving an identifier of the target message queue service uploaded by the target computing node and an identifier of a computing service deployed in the target computing node;
and recording the corresponding relation between the target computing node and the target message queue service and the computing service deployed in the target computing node.
10. The method of claim 9, wherein after said receiving an identification of the target message queue service uploaded by the target computing node and an identification of a computing service deployed in the target computing node, the method further comprises:
and when receiving a second request message which is sent by the control node and used for acquiring the computing service deployed in the target computing node, sending the identification of the computing service deployed in the target computing node to the control node.
11. The method of claim 9, wherein after said receiving an identification of the target message queue service uploaded by the target computing node and an identification of a computing service deployed in the target computing node, the method further comprises:
and when the distance from the last time when the heartbeat message sent by the target computing node through the computing service is received reaches a preset time and the heartbeat message sent by the target computing node through the computing service is not received again, determining that the target computing node cannot provide the computing service.
12. A message processing method applied to a target computing node in a message processing system, wherein the message processing system further comprises a control node and a middleware node, and a plurality of message queue services are deployed in the middleware node, the method comprising:
receiving a message to be sent, which is sent by the middleware node through a target message queue service in the plurality of message queue services, wherein the target message queue service is determined from the plurality of message queue services based on the target computing node;
and executing the operation corresponding to the message to be sent.
13. The method of claim 12, wherein prior to the receiving the message to be sent by the middleware node through the target message queue service of the plurality of message queue services, the method further comprises:
uploading the identifier of the target message queue service and the identifier of the computing service deployed in the target computing node to the middleware node.
14. The method of claim 13, further comprising:
and sending a corresponding heartbeat message to the middleware node through the computing service according to a preset period.
15. A message processing system, the system comprising a control node, a middleware node, and a plurality of compute nodes, the middleware node having a plurality of message queue services deployed therein, wherein:
the control node is used for determining a computing node used for receiving a message to be sent from the plurality of computing nodes as a target computing node; determining a target message queue service for forwarding the message to be sent from the plurality of message queue services based on the target computing node; sending the message to be sent to the target message queue service;
the middleware node is configured to receive the message to be sent through the target message queue service and forward the message to be sent to the target computing node;
and the target computing node is used for executing the operation corresponding to the message to be sent.
16. A message processing apparatus applied to a control node in a message processing system, the message processing system further comprising a middleware node and a plurality of computing nodes, the middleware node having a plurality of message queue services deployed therein, the apparatus comprising:
a first determining module, configured to determine, from the plurality of computing nodes, a computing node for receiving a message to be sent as a target computing node;
a second determining module, configured to determine, based on the target computing node, a target message queue service for forwarding the message to be sent from the plurality of message queue services;
a sending module, configured to send the message to be sent to the target message queue service, so that the middleware node forwards the message to be sent to the target computing node through the target message queue service.
17. The apparatus according to claim 16, wherein the second determining module is specifically configured to determine, from a preset correspondence relationship between the computing node and the plurality of message queue services, a message queue service corresponding to the target computing node as a target message queue service for forwarding the message to be sent.
18. The apparatus of claim 17, further comprising:
an update module, configured to send, to the middleware node, a first request message for determining a computing node in the message processing system where an update occurs;
and updating the corresponding relation when receiving the identifier of the updated computing node and the identifier of the corresponding message queue service in the message processing system, which are sent by the middleware node.
19. The apparatus according to claim 16, wherein the second determination module is specifically configured to determine the second threshold value
Sending a service determination message to the middleware node containing an identification of the target computing node;
when receiving an identifier of a message queue service sent by the middleware node, determining the message queue service to which the identifier of the message queue service belongs as a target message queue service for forwarding the message to be sent; and the identifier of the message queue service is determined by the middleware node from the corresponding relation between a preset computing node and the plurality of message queue services according to the identifier of the target computing node.
20. The apparatus of claim 16, further comprising:
a processing module, configured to send a second request message to the middleware node, where the second request message is used to obtain a computing service deployed in the target computing node;
and receiving the identification of the computing service deployed in the target computing node, which is sent by the middleware node.
21. A message processing apparatus applied to a middleware node in a message processing system, the message processing system further comprising a control node and a plurality of computing nodes, the middleware node having a plurality of message queue services deployed therein, the apparatus comprising:
a first receiving module, configured to receive, through a target message queue service in the multiple message queue services, a message to be sent that is sent by the control node; wherein the target message queue service is determined from the plurality of message queue services based on a target computing node of the plurality of computing nodes for receiving the message to be sent;
and the forwarding module is used for forwarding the message to be sent to the target computing node through the target message queue service.
22. The apparatus of claim 21, further comprising:
a first processing module, configured to receive a service determination message sent by the control node and including an identifier of the target computing node, before the message to be sent by the control node is received through a target message queue service in the plurality of message queue services;
determining a message queue service corresponding to the target computing node from the corresponding relation between a preset computing node and the plurality of message queue services as a target message queue service;
and sending the identification of the target message queue service to the control node.
23. The apparatus of claim 21, further comprising:
the second processing module is used for receiving a first request message which is sent by the control node and used for determining a computing node which is updated in the message processing system;
and sending the identification of the updated computing node and the identification of the corresponding message queue service in the message processing system to the control node.
24. The apparatus of claim 21, further comprising:
a second receiving module, configured to receive, before receiving, through a target message queue service of the multiple message queue services, a message to be sent by the control node, an identifier of the target message queue service uploaded by the target computing node and an identifier of a computing service deployed in the target computing node;
and recording the corresponding relation between the target computing node and the target message queue service and the computing service deployed in the target computing node.
25. The apparatus of claim 24, further comprising:
a sending module, configured to send, after receiving the identifier of the target message queue service uploaded by the target computing node and the identifier of the computing service deployed in the target computing node, the identifier of the computing service deployed in the target computing node to the control node when receiving a second request message sent by the control node and used to acquire the computing service deployed in the target computing node.
26. The apparatus of claim 24, further comprising:
and the determining module is used for determining that the target computing node cannot provide the computing service when the distance between the last time the heartbeat message sent by the target computing node through the computing service is received and the time the heartbeat message sent by the target computing node through the computing service is not received again after the identifier of the target message queue service uploaded by the target computing node and the identifier of the computing service deployed in the target computing node are received.
27. A message processing apparatus applied to a target computing node in a message processing system, the message processing system further comprising a control node and a middleware node, the middleware node having a plurality of message queue services deployed therein, the apparatus comprising:
a receiving module, configured to receive a message to be sent, which is sent by the middleware node through a target message queue service in the multiple message queue services, where the target message queue service is determined from the multiple message queue services based on the target computing node;
and the processing module is used for executing the operation corresponding to the message to be sent.
28. The apparatus of claim 27, further comprising:
an upload module, configured to upload, to the middleware node, an identifier of a target message queue service and an identifier of a computing service deployed in the target computing node before the receiving of a message to be sent, where the message to be sent is sent by the middleware node through the target message queue service in the multiple message queue services.
29. The apparatus of claim 28, further comprising:
and the sending module is used for sending the corresponding heartbeat message to the middleware node through the computing service according to a preset period.
30. An electronic device comprising a memory and a processor;
the memory is used for storing a computer program;
the processor, when executing the program stored in the memory, implementing the method steps of any of claims 1-5, or 6-11, or 12-14.
31. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 5, or 6 to 11, or 12 to 14.
CN202010460497.0A 2020-05-27 2020-05-27 Message processing method, device and system, electronic equipment and readable storage medium Active CN111629054B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010460497.0A CN111629054B (en) 2020-05-27 2020-05-27 Message processing method, device and system, electronic equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010460497.0A CN111629054B (en) 2020-05-27 2020-05-27 Message processing method, device and system, electronic equipment and readable storage medium

Publications (2)

Publication Number Publication Date
CN111629054A true CN111629054A (en) 2020-09-04
CN111629054B CN111629054B (en) 2022-06-03

Family

ID=72273085

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010460497.0A Active CN111629054B (en) 2020-05-27 2020-05-27 Message processing method, device and system, electronic equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN111629054B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112217740A (en) * 2020-10-23 2021-01-12 北京邮电大学 Request processing method and device based on edge computing network

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090172395A1 (en) * 2007-12-31 2009-07-02 International Business Machines Corporation System and Method for Service Virtualization Using a MQ Proxy Network
WO2013049399A1 (en) * 2011-09-30 2013-04-04 Oracle International Corporation System and method for providing and managing message queues for multinode applications in a middleware machine environment
CN104468330A (en) * 2014-12-03 2015-03-25 北京国双科技有限公司 Data processing method and device of distributed information queue
CN106230896A (en) * 2016-07-18 2016-12-14 深圳国泰安教育技术股份有限公司 A kind of information push method, Apparatus and system
CN106656760A (en) * 2016-12-28 2017-05-10 广州赛意信息科技股份有限公司 Message passing method and system based on message queue
US10091215B1 (en) * 2014-09-09 2018-10-02 Amazon Technologies, Inc. Client isolation in a distributed queue
CN109688235A (en) * 2019-03-18 2019-04-26 北京金山云网络技术有限公司 Virtual network method for processing business, device and system, controller, storage medium
CN109905457A (en) * 2019-01-09 2019-06-18 广州视源电子科技股份有限公司 Master-slave server data synchronization method and device, computer equipment and storage medium
WO2019218763A1 (en) * 2018-05-17 2019-11-21 华为技术有限公司 Communication method, system and apparatus
US10579449B1 (en) * 2018-11-02 2020-03-03 Dell Products, L.P. Message queue architectures framework converter

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090172395A1 (en) * 2007-12-31 2009-07-02 International Business Machines Corporation System and Method for Service Virtualization Using a MQ Proxy Network
WO2013049399A1 (en) * 2011-09-30 2013-04-04 Oracle International Corporation System and method for providing and managing message queues for multinode applications in a middleware machine environment
US20130086183A1 (en) * 2011-09-30 2013-04-04 Oracle International Corporation System and method for providing message queues for multinode applications in a middleware machine environment
US10091215B1 (en) * 2014-09-09 2018-10-02 Amazon Technologies, Inc. Client isolation in a distributed queue
CN104468330A (en) * 2014-12-03 2015-03-25 北京国双科技有限公司 Data processing method and device of distributed information queue
CN106230896A (en) * 2016-07-18 2016-12-14 深圳国泰安教育技术股份有限公司 A kind of information push method, Apparatus and system
CN106656760A (en) * 2016-12-28 2017-05-10 广州赛意信息科技股份有限公司 Message passing method and system based on message queue
WO2019218763A1 (en) * 2018-05-17 2019-11-21 华为技术有限公司 Communication method, system and apparatus
US10579449B1 (en) * 2018-11-02 2020-03-03 Dell Products, L.P. Message queue architectures framework converter
CN109905457A (en) * 2019-01-09 2019-06-18 广州视源电子科技股份有限公司 Master-slave server data synchronization method and device, computer equipment and storage medium
CN109688235A (en) * 2019-03-18 2019-04-26 北京金山云网络技术有限公司 Virtual network method for processing business, device and system, controller, storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
梁碧泉等: "基于中间件技术的Twitter系统研究与实现", 《微计算机信息》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112217740A (en) * 2020-10-23 2021-01-12 北京邮电大学 Request processing method and device based on edge computing network
CN112217740B (en) * 2020-10-23 2022-04-05 北京邮电大学 Request processing method and device based on edge computing network

Also Published As

Publication number Publication date
CN111629054B (en) 2022-06-03

Similar Documents

Publication Publication Date Title
CN109688235B (en) Virtual network method for processing business, device and system, controller, storage medium
CN108696581B (en) Distributed information caching method and device, computer equipment and storage medium
US11689606B2 (en) Communication method, system and apparatus
US10270648B2 (en) Configuration information management method, device, network element management system and storage medium
US9207988B2 (en) Method, system, and device for managing server hardware resources in a cloud scheduling environment
KR101871383B1 (en) Method and system for using a recursive event listener on a node in hierarchical data structure
US10848366B2 (en) Network function management method, management unit, and system
CN109618174B (en) Live broadcast data transmission method, device, system and storage medium
US10425475B2 (en) Distributed data management
US20210392200A1 (en) Systems and methods for remote network topology discovery
CN109391548B (en) Table entry migration method and device and network communication system
JP2023504469A (en) NODE MANAGEMENT METHOD, APPARATUS, DEVICE, STORAGE MEDIUM AND SYSTEM
WO2019062634A1 (en) Communication method and apparatus
CN114244810A (en) Virtual IP management method, device, electronic equipment and storage medium
CN111385255B (en) Asynchronous call implementation method and device, server and server cluster
CN111629054B (en) Message processing method, device and system, electronic equipment and readable storage medium
CN109189403B (en) Operating system OS batch installation method and device and network equipment
CN111488163B (en) Firmware updating method and device, electronic equipment and storage medium
CN108628864B (en) Data access method and data management device
CN111182014B (en) Data synchronization method and device
CN114070889B (en) Configuration method, traffic forwarding device, storage medium, and program product
CN110768834B (en) Method, system, device and medium for notifying upgrading result of virtual machine configuration
CN108718285B (en) Flow control method and device of cloud computing cluster and server
CN113037797A (en) Data processing method and device
CN110958182B (en) Communication method and related equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant