WO2021078294A1

WO2021078294A1 - Service coordination method and apparatus for distributed storage system, and electronic device

Info

Publication number: WO2021078294A1
Application number: PCT/CN2020/123516
Authority: WO
Inventors: 黎海兵
Original assignee: 北京金山云网络技术有限公司; 北京金山云科技有限公司
Priority date: 2019-10-25
Filing date: 2020-10-26
Publication date: 2021-04-29
Also published as: CN112714143A

Abstract

The present application relates to a service coordination method and apparatus for a distributed storage system, and an electronic device. The method comprises: sending a query request to a service coordination device to obtain a query result, wherein the query result represents whether a plurality of control servers comprise a master control server; and determining, according to the query result, whether to send a master control server selecting instruction to another control server, wherein the master control server selecting instruction is used for determining a master control server from the plurality of control servers.

Description

Service coordination method, device and electronic equipment of distributed storage system

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on October 25, 2019, the application number is 201911024570.3, and the invention title is "Service Coordination Method, Apparatus and Electronic Equipment of Distributed Storage System", all of which are approved The reference is incorporated in this application.

Technical field

This application relates to the field of distributed storage technology, and more specifically, to a service coordination method of a distributed storage system, a service coordination device of a distributed storage system, an electronic device, and a distributed storage system.

Background technique

Distributed storage is a storage solution that distributes data to multiple independent devices. The distributed network storage system adopts an expandable system structure and utilizes multiple storage servers to share the storage load. It not only improves the reliability, availability, and access efficiency of the system, it is also easy to expand.

In a distributed storage system, a dedicated control server usually coordinates the storage of data on multiple data servers. Metadata used to describe data attributes is stored in the control server, which can realize functions such as storage location records, historical data records, and resource search. In order to improve the reliability of the system, the number of control servers is usually multiple, and the main control server provides control services, and the other control servers serve as backups.

The distributed application coordination service (Zookeeper) can be used to coordinate the operation of multiple control servers, such as notifying multiple control servers to perform master selection operations. However, existing coordination schemes are prone to unowned, dual-master, etc., which affect the stability of the distributed storage system.

Summary of the invention

One purpose of this application is to provide a new technical solution for service coordination of a distributed storage system.

According to the first aspect of the present application, there is provided a service coordination method for a distributed storage system. The distributed storage system includes a service coordination device and a plurality of control servers. The method is implemented by any of the control servers. The method includes: sending a query request to the service coordination device to obtain a query result, the query result indicating whether the multiple control servers include a main control server; and determining whether to send to other control servers according to the query result Sending a master selection instruction, where the master selection instruction is used to determine a master control server from the plurality of control servers.

In an embodiment, the sending a query request to the service coordination device to obtain a query result, the query result characterizing whether a main control server is included in the plurality of control servers, includes: using a preset first At a time interval, sending a query request to the service coordination device; receiving a query result sent from the service coordination device in response to the query request, the query result indicating whether the multiple control servers include a main control server; Wherein, the first time interval is less than a preset session timeout duration of the service coordination device.

In one embodiment, the query result is whether the service coordination device has recorded the identification of the main control server.

In one embodiment, the method further includes: when the control server is the master control server, periodically sending a connection request to the service coordination device; if the service coordination device is not received within a set time window In response to the connection request, the service provided as the main control server is stopped.

In one embodiment, when the control server is the main control server, periodically sending a connection request to the service coordination device includes: sending a connection request to the service coordination device at a preset second time interval Sending the connection request; wherein the second time interval is less than a preset session timeout duration of the service coordination device.

In an embodiment, the set time window is less than the set session timeout duration of the service coordination device.

In an embodiment, the determining whether to send a master selection instruction to other control servers according to the query result, the master selection instruction being used to determine a master control server from the plurality of control servers includes: When the query result indicates that the main control server is not included in the plurality of control servers, a master selection instruction is sent to other control servers to determine a main control server from the plurality of control servers.

In an embodiment, the method further includes: after determining a main control server from the plurality of control servers, sending the determined identification of the main control server to the service coordination device.

According to a second aspect of the present application, there is provided a service coordination method for a distributed storage system. The distributed storage system includes a service coordination device and a plurality of control servers that implement the method described in the first aspect of the present application. Implemented by the service coordination device, the method includes: receiving a query request sent by the control server; in response to the query request, obtaining a query result, the query result indicating whether the multiple control servers contain a master Control server; sending the query result to the control server.

In one embodiment, the query result is whether the server coordination device has recorded the identification of the main control server.

In an embodiment, the method further includes: receiving a connection request periodically sent by a main control server of the plurality of control servers; and sending a response message for the connection request to the main control server.

In an embodiment, the method further includes: receiving the determined identification of the main control server sent by the control server; and recording the identification of the main control server.

In an embodiment, the service coordination device provides coordination services based on a distributed application coordination service (Zookeeper).

According to a third aspect of the present application, there is provided a service coordination device for a distributed storage system. The distributed storage system includes a service coordination device and a plurality of control servers. The device is applied to any of the control servers and includes: The query module is configured to send a query request to the service coordination device to obtain a query result, and the query result represents whether a main control server is included in the plurality of control servers; the judgment module is configured to determine according to the query result Whether to send a master selection instruction to other control servers, where the master selection instruction is used to determine a master control server from the multiple control servers.

In one embodiment, when the query module sends a query request to the service coordination device to obtain a query result, and the query result indicates whether a main control server is included in the multiple control servers, the query module is set to: At a preset first time interval, a query request is sent to the service coordination device; a query result sent from the service coordination device in response to the query request is received, and the query result represents whether the multiple control servers include There is a main control server; wherein, the first time interval is less than a preset session timeout duration of the service coordination device.

In one embodiment, the device further includes a connection detection module, the connection detection module is configured to: when the control server is the main control server, periodically send a connection request to the service coordination device; In the window, if the response of the service coordination device to the connection request is not received, the service provided as the main control server is stopped.

In one embodiment, when the connection detection module periodically sends a connection request to the service coordination device when the control server is the main control server, it is set to: send a connection request to the service coordination device at a preset second time interval. The service coordination device sends the connection request; wherein, the second time interval is less than a preset session timeout duration of the service coordination device.

In one embodiment, when the judgment module determines whether to send a master selection instruction to other control servers according to the query result, it is set to: when the query result indicates that the plurality of control servers does not contain a master When the server is controlled, a master selection instruction is sent to the other control servers to determine a master control server from the multiple control servers.

In an embodiment, the device further includes an identification sending module, the identification sending module is configured to: after determining a master control server from the plurality of control servers, send the determined master to the service coordination device The ID of the control server.

According to a fourth aspect of the present application, there is provided a service coordination device for a distributed storage system, the distributed storage system including a service coordination device and a plurality of control servers that implement the method described in the first aspect of the present application, the device Applied to the service coordination device, it includes: a first receiving module configured to receive a query request sent by the control server; a result obtaining module configured to obtain a query result in response to the query request, and the query result represents the query result. Whether the multiple control servers include a main control server; the first sending module is configured to send the query result to the control server.

In an embodiment, the device further includes a second receiving module and a second sending module: the second receiving module is configured to receive a connection request periodically sent by a main control server among the plurality of control servers; The second sending module is configured to send a response message for the connection request to the main control server.

In one embodiment, the device further includes a third receiving module and a recording module: the third receiving module is configured to receive the determined identification of the main control server sent by the control server; the recording module is configured to record The identifier of the main control server.

According to a fifth aspect of the present application, there is provided an electronic device including a processor and a memory, the memory storing machine executable instructions that can be executed by the processor, and the processor executing the machine executable instructions In order to realize the service coordination method of the distributed storage system described in the first aspect or the second aspect of the present application.

According to the sixth aspect of the present application, there is provided a distributed storage system, including a user agent server, multiple storage servers, multiple control servers that implement the method described in the first aspect of the present application, and implement the second aspect of the present application. The service coordination device of the method, wherein the control server is in communication connection with the user agent server, the plurality of storage servers, and the service coordination device respectively.

In one embodiment of this embodiment, the control server actively inquires whether the main control server is included in the multiple control servers, and determines whether to send the master selection instruction to other control servers according to the query result, which can avoid the situation that the system has no master and improve the system The stability.

Through the following detailed description of exemplary embodiments of the present application with reference to the accompanying drawings, other features and advantages of the present application will become clear.

Description of the drawings

The drawings incorporated in the specification and constituting a part of the specification illustrate the embodiments of the present application, and together with the description are used to explain the principle of the present application.

FIG. 1 shows a schematic diagram of the hardware configuration of a distributed storage system that can be used to implement the embodiments of the present application.

Figure 2 shows a schematic structural diagram of a server that can be used to implement the embodiments of the present application.

Fig. 3 shows a flowchart of a service coordination method of a distributed storage system according to an embodiment of the present application.

Fig. 4 shows a flow chart of a specific example of the implementation of the service coordination method of the distributed storage system according to the embodiment of the present application.

Detailed ways

Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that unless specifically stated otherwise, the relative arrangement, numerical expressions and numerical values of the components and steps set forth in these embodiments do not limit the scope of the application.

The following description of at least one exemplary embodiment is actually only illustrative, and in no way serves as any restriction on the application and its application or use.

The techniques, methods, and equipment known to those of ordinary skill in the relevant fields may not be discussed in detail, but where appropriate, the techniques, methods, and equipment should be regarded as part of the specification.

In all examples shown and discussed herein, any specific value should be interpreted as merely exemplary, rather than as a limitation. Therefore, other examples of the exemplary embodiment may have different values.

It should be noted that similar reference numerals and letters indicate similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further discussed in subsequent drawings.

Figure 1 shows a schematic structural diagram of a distributed storage system that can be used to implement embodiments of the present application.

As shown in FIG. 1, the distributed storage system 100 includes a user agent server 1000, a storage server 2000, a control server 3000, and a service coordination device 4000. Among them, the number of storage servers 2000 and control servers 3000 are both multiple (two or more).

The storage server 2000 is set to store target data.

The user proxy server 1000 is configured to receive a data read and write request for target data sent by the user terminal, and forward the data read and write request to the control server 3000.

The control server 3000 is configured to query the storage server 2000 corresponding to the target data from the metadata stored by itself, and return the identification information of the storage server 2000 to the user agent server 1000. The user agent server 1000 interacts with the corresponding storage server 2000 according to the identification information to complete the read and write operations on the target data.

The service coordination device 4000 is configured to coordinate the operation of multiple control servers 3000, such as assigning an identity to the control server 3000, notifying the control server 3000 to elect a master control server, and so on. The service coordination device 4000 is, for example, an electronic device installed with distributed application coordination software.

It should be noted that in some embodiments, the distributed application coordination service can be arranged in multiple control servers 3000. In this case, the multiple control servers 3000 can implement their own services based on the distributed application coordination service. Coordination, no additional service coordination equipment 4000 is needed.

The user agent server 1000, the storage server 2000, the control server 3000, and the service coordination device 4000 may communicate with each other through a wired network or a wireless network. In the case that the distributed application coordination service is arranged in multiple control servers, the control server and the service coordination device are actually communications between different processes in the same device.

The user agent server 1000, the storage server 2000, the control server 3000, and the service coordination device 4000 all have the hardware configuration of the server 1100 as shown in FIG. 2. As shown in FIG. 2, the server 1100 may include a processor 1110, a memory 1120, an interface device 1130, a communication device 1140, a display device 1150, and an input device 1160. The processor 1110 may be, for example, a central processing unit CPU or the like. The memory 1120 includes, for example, ROM (Read Only Memory), RAM (Random Access Memory), nonvolatile memory such as a hard disk, and the like. The interface device 1130 includes, for example, a USB interface, a serial interface, and the like. The communication device 1140 can perform wired or wireless communication, for example. The display device 1150 is, for example, a liquid crystal display. The input device 1160 may include, for example, a touch screen, a keyboard, and the like.

In the embodiment applied to this specification, the memory 1120 of the server 1100 is configured to store instructions, which are used to control the processor 1110 to operate to support the implementation of the service coordination method according to any embodiment of this specification. Technicians can design instructions according to the scheme disclosed in this specification. How the instruction controls the processor to operate is well known in the art, so it will not be described in detail here.

Those skilled in the art should understand that although multiple devices of the server 1100 are shown in FIG. 2, the server 1100 in the embodiment of this specification may only involve some of the devices, for example, only the processor 1110, the memory 1120, and the Communication device 1140.

The file batch comparison system 1000 shown in FIG. 1 is only for explanatory purposes, and is by no means intended to limit this specification, its application or purpose.

This embodiment provides a service coordination method for a distributed storage system. The method is implemented by, for example, any control server 3000 in FIG. 1. As shown in Figure 3, the method includes the following steps S1100-S1200:

Step S1100: Send a query request to the service coordination device to obtain a query result. The query result represents whether a main control server is included in the multiple control servers.

In this embodiment, the distributed storage system includes multiple control servers. One main control server is selected from multiple control servers through elections, etc., and the main control server provides control services, and other control servers serve as backups.

In an example, the control server sends a registration request to the service coordination device during the initial startup phase. In response to the registration request, the service coordination device assigns a unique identity to each control server according to preset rules.

In this embodiment, the service coordination device coordinates the master selection process and records the identification of the master control server. In this step, the query request is sent to the server coordination device. Illustratively, the service coordination device may be inquiring of the current multiple control servers, which one has the master control server identifier and the status of the master control server. Furthermore, it can be determined that the system state of the current distributed storage system has a main control server, or does not have a main control server, or has two main control servers. In this embodiment, the system state of the distributed storage system may include: a plurality of control servers include the system state of the main control server (hereinafter referred to as the main state, the main state includes, for example, one main control server, or two main control servers). The control server) and multiple control servers do not include the system state of the main control server (hereinafter referred to as the lack of main state).

In this embodiment, the control server actively sends a query request to the service coordination device to obtain the query result. The query result indicates whether the main control server is included in the multiple control servers.

In one embodiment, step S1100 further includes: sending a query request to the service coordination device at a preset first time interval; receiving a query result sent from the service coordination device in response to the query request, and the query result represents a plurality of control servers Whether a main control server is included; wherein, the first time interval is less than the preset session timeout duration of the service coordination device.

In this embodiment, a long connection is maintained between the control server and the service coordination device. Within the preset session timeout period, if the service coordination device receives a message (such as a heartbeat packet) sent by the control server that it is in an active state, The service coordination device judges that the connection is in a normal state, and continues to monitor the connection state between the two.

In this embodiment, the control server periodically queries the current system status at a preset first time interval. The first time interval is less than the session timeout duration set by the service coordination device, which is beneficial to avoid session expiration.

In one embodiment, the query result is whether the service coordination device records the identification of the main control server. The identification of the main control server is, for example, the IP or other identification of the main control server, or the unique identification assigned by the service coordination device (for example, assign a specific character string as the identification, or add a character string to the IP address of the main control server) As an identity, etc.).

In one embodiment, the process of the control server inquiring whether the current system state is the missing master state includes: requesting the service coordination device to provide the current system state; and determining the current system state according to the current system state provided by the service coordination device in response to the request. In one example, the service coordination device records that the current system is in a master state or an unowned state, and the identity of the current master control server in the master state. After the control server sends a request to provide the current system state to the service coordination device, it determines whether the current system is in the active state or the unmaintained state according to the received information returned by the service coordination device that the current system is in the active state or the unactive state.

Step S1200: Determine whether to send a master selection instruction to other control servers according to the query result. The master selection instruction is used to determine a master control server from a plurality of control servers.

In one embodiment, when the query result indicates that the main control server is not included in the plurality of control servers, the control server sends a master selection instruction to other control servers to determine a main control server from the plurality of control servers.

In this embodiment, the control server actively sends the master selection instruction when the current system state queried is the master lack state, thereby initiating the master selection operation of co-electing the master control server with other control servers, without waiting for notification from the service coordination device Then initiate the master election operation.

In this embodiment, when the system is running normally, control servers other than the main control server are in a non-election state, and may only communicate with the service coordination device, without communicating with other control servers. In the case that the current system state that is queried is the master-less state, the control server other than the master control server enters the election state, communicates with other control servers, and initiates the master election operation.

In this embodiment, the process of selecting the master is, for example: each control server sends a vote and receives votes from other control servers; processes and counts votes according to preset election rules; updates its own status according to the election results, for example, Update its own status as master control server or non-master (slave) control server.

In one embodiment, in the election phase, multiple control servers vote according to the principle that the one with the smallest identity is elected to select the main control server.

After the master selection is completed, multiple control servers can only communicate with the service coordination device, without mutual communication. In the case that the distributed application coordination service is arranged in multiple control servers, the communication between the control server and the service coordination device communication is manifested as the communication between the process corresponding to the control service and the process corresponding to the coordination service. In the service coordination method of the distributed storage system provided in this embodiment, the control server actively inquires whether the main control server is included in the multiple control servers, and determines whether to send the master selection instruction to other control servers according to the query result, which is beneficial to avoid system failure. The case of the Lord. For example, in a scenario, the current main control server crashes and the service coordination device clears the main control server's identity, but due to reasons such as network connection failure, other control servers cannot be notified to re-elect the main control server. In this case, According to the method provided in this embodiment, other control servers can actively initiate the master selection based on the queried system status, thereby avoiding the system having no master status.

In an embodiment, the service coordination method of the distributed storage system further includes: when the control server is the main control server, periodically sending a connection request to the service coordination device; if within the set time window, the service coordination device does not receive In response to the connection request, the service provided as the main control server is stopped.

In this embodiment, for the current main control server of the system, the main control server actively connects with the service coordination device, for example, actively sends a request to obtain the connection status, and judges whether the connection is successful according to whether the service coordination device returns a corresponding message . If all connections within the set time window fail, then the main control server actively stops the service provided as the main control server, that is, withdraws from the node position of the main control server. In this way, it is helpful to avoid the dual-master state of the system.

For example, in a scenario, the current main control server of the system can work normally, but the communication connection with the service coordination device is interrupted. The service coordination device clears the recorded identity of the main control server and notifies other control servers to restart Initiate the election of the master. After re-election of the master, there will be two master control servers in the system. In this case, according to the service coordination method provided in this embodiment, because the original main control server cannot successfully connect with the service coordination device, it will actively withdraw from the position of the master node, thereby avoiding the dual-master state of the system.

In one embodiment, the process of the main control server actively connecting to the service coordination device includes: actively connecting to the service coordination device at a preset second time interval, where the second time interval is less than the session timeout duration set by the service coordination device .

In this embodiment, the main control server actively connects to the service coordination device at a preset second time interval. The second time interval is less than the session timeout duration set by the service coordination device, which is beneficial to avoid the situation that the session between the main control server and the service coordination device expires.

In an embodiment, the above-mentioned set time window is also smaller than the session timeout duration set by the service coordination device.

In an embodiment, the service coordination method of the distributed storage system further includes: after determining a master control server from the plurality of control servers, sending the determined identification of the master control server to the service coordination device. The identifier of the main control server is, for example, the IP or other identifiers of the main control server, such as a unique identifier assigned by the service coordination device. In this way, it is beneficial for the service coordination device to obtain the identification of the re-selected main control server in time, thereby maintaining the normal operation of the distributed storage system.

This embodiment also provides another service coordination method for a distributed storage system. The method is implemented by, for example, the service coordination device 4000 in FIG. 1, or when the distributed application coordination service is arranged in multiple control servers, Implemented by multiple control servers. The method includes the following steps: receiving a query request sent by a control server; in response to the query request, obtaining a query result, the query result indicating whether a main control server is included in a plurality of control servers; and sending the query result to the control server.

In one embodiment, the query result is whether the server coordination device records the identification of the main control server. The identifier of the main control server is, for example, the IP or other identifiers of the main control server, such as a unique identifier assigned by the service coordination device.

In an embodiment, the service coordination method of the distributed storage system further includes: receiving a connection request periodically sent by a main control server among the multiple control servers; and sending a response message for the connection request to the main control server.

In this embodiment, the process of the service coordination device regularly acquiring the survival status of the main control server is, for example: the service coordination device receives a message about its own active status periodically sent by the master control server, and judges the master control server when the message is obtained. Is alive.

In an embodiment, the service coordination method of the distributed storage system further includes: receiving a connection request periodically sent by the main control server among the multiple control servers; receiving the determined identification of the main control server sent by the control server; recording the main control server The ID of the server. In this way, it is beneficial for the service coordination device to obtain the identification of the re-selected main control server in time, thereby maintaining the normal operation of the distributed storage system.

In one embodiment, the service coordination device is a service coordination device that provides coordination services based on a distributed application coordination service (Zookeeper). Distributed Application Coordination Service (Zookeeper) is a distributed, open source distributed application coordination service. It is the manager of the cluster and monitors the status of each node in the cluster to perform the next reasonable operation according to the feedback submitted by the node. . Based on the distributed application coordination service (Zookeeper), the service coordination device can effectively manage a cluster composed of multiple control servers, and coordinate multiple control servers to provide external control services.

FIG. 4 shows a specific example of the implementation of the service coordination method of the distributed storage system provided by this embodiment. As shown in Figure 4, in the initial startup phase of multiple control servers, each control server sends a registration request to the service coordination device, that is, step S101 is executed. In response to the registration request sent by the control server, the service coordination device allocates a globally unique identity to each control server, that is, step S102 is executed. A plurality of control servers are elected according to the identities assigned by the control servers, and the main control server is selected according to the principle of the least identity being elected. The main control server provides the control server externally, and other control servers serve as backups, that is, step S103 is executed. During the operation of the system, the main control server actively connects to the service coordination device periodically, and the time interval of the regular connection is less than the session timeout time set by the service coordination device, that is, step S104a is executed. In addition, the slave control server also actively queries the service coordination device for the system status periodically, and the time interval of the regular query is less than the session timeout time set by the service coordination device, that is, step S104b is executed. In this example, it is assumed that the main control server can provide services normally but the communication with the service coordination device is disconnected during the operation of the system. In this case, the service coordination device cannot obtain the survival status reported by the main control server. The record of the main control server is cleared, and the system becomes the main lack state, that is, step S105 is executed. After that, the slave control server knows that the current state of the system is the lack of master status by periodically querying the system status. On this basis, it sends a master selection instruction to other control servers, actively initiates the re-election operation, and selects a new master control server, namely Step S106 and step S107 are executed. The original master control server fails to perform master control connections with the service coordination device within the set time window, and on this basis, actively exits the master node position, that is, steps S108 and S109 are executed.

In this example, even if the service coordination device fails to notify the slave control server to re-elect the master, the slave control server actively initiates the master re-election based on the inquiry that the system is in a master-deficient state, which is beneficial to avoid the situation that the system is not master. In addition, the original main control server actively retreats from the main node position when the connection with the service coordination device fails, which avoids the simultaneous existence of the new main control server and the original main control server, which is beneficial to avoid the situation of dual system masters.

This embodiment provides a service coordination device for a distributed storage system. The distributed storage system includes a service coordination device and a plurality of control servers. The device is applied to any control server and includes a query module and a judgment module.

The query module is configured to send a query request to the service coordination device to obtain a query result, and the query result represents whether a main control server is included in a plurality of control servers.

The judgment module is configured to determine whether to send a master selection instruction to other control servers according to the query result, and the master selection instruction is used to determine a master control server from a plurality of control servers.

In one embodiment, when the query module sends a query request to the service coordination device to obtain the query result, the query result indicates whether the main control server is included in the multiple control servers, and the query module is set to: at a preset first time interval, Send a query request to the service coordination device; receive the query result sent from the service coordination device in response to the query request, and the query result represents whether a main control server is included in the multiple control servers; wherein, the first time interval is less than the preset of the service coordination device The session timeout duration of.

In one embodiment, the query result is whether the service coordination device records the identification of the main control server.

In one embodiment, the device further includes a connection detection module, and the connection detection module is configured to: when the control server is the main control server, periodically send a connection request to the service coordination device; if the service is not received within the set time window Coordinating the device's response to the connection request will stop the service provided as the main control server.

In one embodiment, when the connection detection module sends a connection request to the service coordination device regularly when the control server is the main control server, it is set to: send the connection request to the service coordination device at a preset second time interval ; Wherein, the second time interval is less than the preset session timeout duration of the service coordination device.

In an embodiment, the set time window is smaller than the session timeout duration set by the service coordination device.

In one embodiment, when the judging module determines whether to send the master selection instruction to other control servers according to the query result, it is configured to send the selection to other control servers when the query result indicates that the master control server is not included in the plurality of control servers. The main command is used to determine a main control server from a plurality of control servers.

In an embodiment, the device further includes an identification sending module, and the identification sending module is configured to send the determined identification of the master control server to the service coordination device after determining a master control server from the plurality of control servers.

This embodiment also provides a service coordination device for a distributed storage system. The distributed storage system includes a service coordination device and a plurality of control servers implementing the methods described in the method embodiments. The device is applied to the service coordination device and includes: The first receiving module, the result obtaining module and the first sending module.

The first receiving module is configured to receive the query request sent by the control server.

The result obtaining module is configured to obtain the query result in response to the query request, and the query result represents whether the main control server is included in the plurality of control servers.

The first sending module is configured to send the query result to the control server.

In one embodiment, the query result is whether the server coordination device records the identification of the main control server.

In an embodiment, the device further includes a second receiving module and a second sending module: the second receiving module is configured to receive connection requests periodically sent by the main control server among the plurality of control servers; the second sending module is configured to send the connection request to the main control server. The control server sends a response message for the connection request.

In an embodiment, the device further includes a third receiving module and a recording module: the third receiving module is set to receive the determined identification of the main control server sent by the control server; the recording module is set to record the identification of the main control server.

In one embodiment, the service coordination device provides coordination services based on a distributed application coordination service (Zookeeper).

This embodiment provides an electronic device that includes a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor. The processor executes the machine-executable instructions to implement the distributed storage system described in the method embodiments of the present application. Service coordination method.

This embodiment provides a distributed storage system, including a user agent server, multiple storage servers, multiple control servers that implement the first method described in the method embodiment of this application, and the second method described in the method embodiment of this application. The service coordination device of the method, wherein the control server is respectively connected to the user agent server, the multiple storage servers in communication connection, and the service coordination device communication connection.

<Machine-readable storage medium embodiment>

This embodiment provides a machine-readable storage medium. The machine-readable storage medium stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions cause the processor to implement the method embodiments of the present application. Describe the service coordination method of the distributed storage system.

This application can be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium loaded with computer-readable program instructions for enabling a processor to implement various aspects of the present application.

The computer-readable storage medium may be a tangible device that can hold and store instructions used by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) Or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanical encoding device, such as a printer with instructions stored thereon The protruding structure in the hole card or the groove, and any suitable combination of the above. The computer-readable storage medium used here is not interpreted as the instantaneous signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (for example, light pulses through fiber optic cables), or through wires Transmission of electrical signals.

The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing/processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network, and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device .

The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, status setting data, or in one or more programming languages. Source code or object code written in any combination. Programming languages include object-oriented programming languages-such as Smalltalk, C++, etc., and conventional procedural programming languages-such as "C" language or similar programming languages. Computer-readable program instructions can be executed entirely on the user's computer, partly on the user's computer, executed as a stand-alone software package, partly on the user's computer and partly executed on a remote computer, or entirely on the remote computer or server carried out. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to access the Internet connection). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), can be customized by using the status information of the computer-readable program instructions. The computer-readable program instructions are executed to realize various aspects of the present application.

Here, various aspects of the present application are described with reference to the flowcharts and/or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each block of the flowcharts and/or block diagrams, and combinations of blocks in the flowcharts and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine that makes these instructions when executed by the processor of the computer or other programmable data processing device , A device that implements the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams is produced. It is also possible to store these computer-readable program instructions in a computer-readable storage medium. These instructions make computers, programmable data processing apparatuses, and/or other devices work in a specific manner. Thus, the computer-readable medium storing the instructions includes An article of manufacture, which includes instructions for implementing various aspects of the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

It is also possible to load computer-readable program instructions on a computer, other programmable data processing device, or other equipment, so that a series of operation steps are executed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , So that the instructions executed on the computer, other programmable data processing apparatus, or other equipment realize the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

The flowcharts and block diagrams in the accompanying drawings show the possible implementation architecture, functions, and operations of the system, method, and computer program product according to multiple embodiments of the present application. In this regard, each block in the flowchart or block diagram can represent a module, program segment, or part of an instruction, and the module, program segment, or part of an instruction contains one or more executables for implementing the specified logical functions. instruction. In some alternative implementations, the functions marked in the block may also occur in a different order than the order marked in the drawings. For example, two consecutive blocks can actually be executed in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions Or it can be realized by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that realization by hardware, realization by software, and realization by a combination of software and hardware are all equivalent.

The embodiments of the present application have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Without departing from the scope and spirit of the described embodiments, many modifications and changes are obvious to those of ordinary skill in the art. The choice of terms used herein is intended to best explain the principles, practical applications, or technical improvements in the market of the various embodiments, or to enable other ordinary skilled in the art to understand the various embodiments disclosed herein. The scope of the application is defined by the appended claims.

Industrial applicability

In related technologies, a distributed application coordination service (Zookeeper) is used to coordinate the operation of multiple control servers, for example, multiple control servers are notified to perform a master selection operation. However, existing coordination schemes are prone to unowned, dual-master, etc., which affect the stability of the distributed storage system.

In view of the problems in related technologies, in the embodiment of the present application, the control server actively inquires whether the main control server is included in the multiple control servers, and determines whether to send a master selection instruction to other control servers according to the query result, which can avoid the situation that the system has no master , Improve the stability of the system.

Claims

A service coordination method for a distributed storage system. The distributed storage system includes a service coordination device and a plurality of control servers. The method is implemented by any of the control servers, and the method includes:

Sending a query request to the service coordination device to obtain a query result, the query result indicating whether the multiple control servers include a main control server;

Determine whether to send a master selection instruction to other control servers according to the query result, where the master selection instruction is set to determine a master control server from the multiple control servers.
The method according to claim 1, wherein the sending a query request to the service coordination device to obtain a query result, the query result indicating whether a main control server is included in the plurality of control servers, comprises:

Sending a query request to the service coordination device at a preset first time interval;

Receiving a query result sent from the service coordination device in response to the query request, the query result indicating whether the multiple control servers include a main control server;

Wherein, the first time interval is less than a preset session timeout duration of the service coordination device.
The method according to claim 2, wherein the query result is whether the service coordination device has recorded the identification of the main control server.
The method according to any one of claims 1 to 3, wherein the method further comprises:

When the control server is the master control server, periodically sending a connection request to the service coordination device;

If within a set time window, the service coordination device does not receive a response to the connection request, then stop serving as the main control server.
The method according to claim 4, wherein, when the control server is the main control server, periodically sending a connection request to the service coordination device includes:

Sending the connection request to the service coordination device at a preset second time interval;

Wherein, the second time interval is less than a preset session timeout duration of the service coordination device.
The method according to claim 4 or 5, wherein the set time window is less than the set session timeout duration of the service coordination device.
The method according to any one of claims 1 to 6, wherein the determining whether to send a master selection instruction to other control servers according to the query result, and the master selection instruction is set to slave the plurality of control servers. The server determines a master control server including:

When the query result indicates that no master control server is included in the multiple control servers, a master selection instruction is sent to other control servers to determine a master control server from the multiple control servers.
The method according to claim 7, wherein the method further comprises:

After determining a main control server from the multiple control servers, send the determined main control server identification to the service coordination device.
A service coordination method for a distributed storage system, the distributed storage system comprising a service coordination device and a plurality of control servers implementing the method described in any one of claims 1-6, and the method is controlled by the service coordination device Implementation, the method includes:

Receiving a query request sent by the control server;

In response to the query request, obtaining a query result, where the query result represents whether a main control server is included in the plurality of control servers;

Sending the query result to the control server.
The method according to claim 9, wherein the query result is whether the server coordination device has recorded the identification of the main control server.
The method according to claim 9 or 10, wherein the method further comprises:

Receiving a connection request periodically sent by a main control server among the multiple control servers;

Sending a response message for the connection request to the main control server.
The method according to any one of claims 9 to 11, wherein the method further comprises:

Receiving the determined identification of the main control server sent by the control server;

Record the identification of the main control server.
A service coordination device for a distributed storage system. The distributed storage system includes a service coordination device and a plurality of control servers. The device is applied to any of the control servers and includes:

A query module, configured to send a query request to the service coordination device to obtain a query result, and the query result represents whether a main control server is included in the plurality of control servers;

The judgment module is configured to determine whether to send a master selection instruction to the other control servers according to the query result, and the master selection instruction is used to determine a master control server from the multiple control servers.
A service coordination device for a distributed storage system, the distributed storage system comprising a service coordination device and a plurality of control servers implementing the method of any one of claims 1-6, and the device is applied to the service coordination Equipment, including:

The first receiving module is configured to receive the query request sent by the control server;

The result obtaining module is configured to obtain a query result in response to the query request, and the query result represents whether a main control server is included in the plurality of control servers;

The first sending module is configured to send the query result to the control server.
An electronic device comprising a processor and a memory, the memory storing machine executable instructions that can be executed by the processor, and the processor executing the machine executable instructions to implement any one of claims 1 to 13 The service coordination method of the distributed storage system described in the item.
A distributed storage system, comprising a user agent server, multiple storage servers, multiple control servers implementing the method described in any one of claims 1-6, and a plurality of control servers implementing the method described in any one of claims 9-13 The service coordination device, wherein the control server is respectively in communication connection with the user agent server, the plurality of storage servers, and the service coordination device is in communication connection.