CN113225362A - Server cluster system and implementation method thereof - Google Patents
Server cluster system and implementation method thereof Download PDFInfo
- Publication number
- CN113225362A CN113225362A CN202010081707.5A CN202010081707A CN113225362A CN 113225362 A CN113225362 A CN 113225362A CN 202010081707 A CN202010081707 A CN 202010081707A CN 113225362 A CN113225362 A CN 113225362A
- Authority
- CN
- China
- Prior art keywords
- layer cluster
- information
- cluster
- computing
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 32
- 239000012634 fragment Substances 0.000 claims abstract description 93
- 238000013467 fragmentation Methods 0.000 claims abstract description 49
- 238000006062 fragmentation reaction Methods 0.000 claims abstract description 49
- 239000003795 chemical substances by application Substances 0.000 claims abstract description 44
- 230000005012 migration Effects 0.000 claims description 21
- 238000013508 migration Methods 0.000 claims description 21
- 239000000126 substance Substances 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 10
- 238000012545 processing Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
The invention discloses a server cluster system and an implementation method of the server cluster system, and relates to the technical field of computers. The system of the method comprises the following steps: the system comprises an agent layer cluster, a management layer cluster, a computing layer cluster and a storage layer cluster; the agent layer cluster is used for receiving request information, acquiring fragmentation information corresponding to the request information from the management layer cluster according to the request information, and sending the fragmentation information to the computing layer cluster; the storage layer cluster is used for storing document data information; and the computing layer cluster is used for computing according to the fragment information and determining data request result information corresponding to the request information from the storage layer cluster. The implementation method can break through the ES server architecture in the prior art, and a platform server cluster system is established, so that resources can be used in a larger mode, the system can be better in load balance, and the system is more stable.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a server cluster system and an implementation method of the server cluster system.
Background
The ElasticSearch is a distributed, high-expansion and high-real-time search server, which is called an ES server for short and can search documents. In large companies, multiple clusters of ES servers are often used simultaneously, and data does not intercommunicate between the server clusters.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art:
because a plurality of ES server clusters are used and data among the server clusters are not intercommunicated, the clusters cannot share resources and the resources cannot be used more optimally, and the problem of large load difference among the clusters often occurs.
Disclosure of Invention
In view of this, embodiments of the present invention provide a server cluster system and a method for implementing the server cluster system, which can break through an ES server architecture in the prior art, and establish a platform server cluster system, so that resources can be used in a larger scale, and the system can be better load balanced, thereby making the system more stable.
To achieve the above object, according to an aspect of an embodiment of the present invention, a server cluster system is provided.
The server cluster system of the embodiment of the invention comprises: the system comprises an agent layer cluster, a management layer cluster, a computing layer cluster and a storage layer cluster; wherein the content of the first and second substances,
the agent layer cluster is used for receiving request information, acquiring fragment information corresponding to the request information from the management layer cluster according to the request information, and sending the fragment information to the computing layer cluster;
the storage layer cluster is used for storing document data information;
and the computing layer cluster is used for computing according to the fragment information and determining data request result information corresponding to the request information from the storage layer cluster.
Optionally, the proxy layer cluster includes a plurality of proxy nodes; the management layer cluster comprises a plurality of management nodes; the computing layer cluster comprises a plurality of computing nodes; the storage tier cluster includes a plurality of storage nodes.
Optionally, the storage node includes a fragmentation storage unit; the document data is divided into at least one fragment data and stored in the fragment storage unit; wherein, a fragment data is stored in a fragment storage unit; at least one fragment data is stored in one fragment storage unit.
Optionally, the acquiring, by the proxy layer cluster, the fragmentation message corresponding to the request information from the management layer cluster according to the request information includes:
determining a target proxy node according to the load condition of the proxy layer cluster;
the target agent node determines a target management node from the management layer cluster according to the request information; and determining the fragmentation message according to the target management node.
Optionally, with document data corresponding to the request information as a target document, the fragmentation information at least includes: index information of each fragment data in the target document, wherein the index information stores the corresponding relation between a management node and a computing node; distribution information of each fragment data in the target document in a fragment storage unit, wherein the distribution information stores the corresponding relation between a computing node and a storage node;
the computing layer cluster is configured to perform computing according to the fragmentation information, and determine data request result information corresponding to the request information from the storage layer cluster, where the computing layer cluster includes:
determining a target computing node from the computing layer cluster according to the index information;
and the target computing node performs routing computation according to the distribution information, determines a target storage node where the target document is located from the storage layer cluster, and determines the data request result information from the target storage node.
Optionally, after determining the data request result information from the storage tier cluster, the computing tier cluster further includes: returning the data request result information to the proxy layer cluster;
the proxy layer cluster is further configured to: and merging the received data request result information.
Optionally, when the system is upgraded, the method includes:
writing new updated computing nodes and copying old computing nodes before updating based on the agent layer cluster to determine an updated computing layer cluster; and updating the fragment information after the updated computing layer cluster is established.
Optionally, when the system is expanded, the method includes:
based on the proxy layer cluster, writing new computing nodes after capacity expansion and copying old computing nodes before capacity expansion to determine the computing layer cluster after capacity expansion; and updating the fragmentation information after confirming that the expanded computing layer cluster is established.
Optionally, when the system expands, the method further includes:
for the agent layer cluster, adding a new agent node for receiving request information and/or data request result information; and/or the presence of a gas in the gas,
for the management layer cluster, adding a new management node for managing and updating the fragment information; and/or the presence of a gas in the gas,
and for the storage layer cluster, adding a new storage node for storing document data information.
Optionally, the storage tier cluster is further used for data migration, including:
copying data in the old storage node before migration to the new storage node after migration by using the fragmentation storage unit with the access amount lower than a preset threshold value in the storage node; and updating the fragment information after confirming that the data migration is completed.
According to another aspect of the embodiments of the present invention, a method for implementing a server cluster system is provided.
The implementation method of the server cluster system in the embodiment of the invention comprises the following steps: the system comprises an agent layer cluster, a management layer cluster, a computing layer cluster and a storage layer cluster; the method comprises the following steps:
the agent layer cluster receives request information, acquires fragment information corresponding to the request information from the management layer cluster according to the request information, and sends the fragment information to the computing layer cluster;
and the computing layer cluster performs computing according to the fragment information, and determines data request result information corresponding to the request information from the storage layer cluster storing the document data information.
Optionally, the proxy layer cluster includes a plurality of proxy nodes; the management layer cluster comprises a plurality of management nodes; the computing layer cluster comprises a plurality of computing nodes; the storage tier cluster includes a plurality of storage nodes.
Optionally, the storage node includes a fragmentation storage unit; the document data is divided into at least one fragment data and stored in the fragment storage unit; wherein, a fragment data is stored in a fragment storage unit; at least one fragment data is stored in one fragment storage unit.
Optionally, the acquiring, by the proxy layer cluster, the fragmentation message corresponding to the request information from the management layer cluster according to the request information includes:
determining a target proxy node according to the load condition of the proxy layer cluster;
the target agent node determines a target management node from the management layer cluster according to the request information; and determining the fragmentation message according to the target management node.
Optionally, with document data corresponding to the request information as a target document, the fragmentation information at least includes: index information of each fragment data in the target document, wherein the index information stores the corresponding relation between a management node and a computing node; distribution information of each fragment data in the target document in a fragment storage unit, wherein the distribution information stores the corresponding relation between a computing node and a storage node;
the computing layer cluster performs computing according to the fragmentation information, and determines data request result information corresponding to the request information from the storage layer cluster, including:
determining a target computing node from the computing layer cluster according to the index information;
and the target computing node performs routing computation according to the distribution information, determines a target storage node where the target document is located from the storage layer cluster, and determines the data request result information from the target storage node.
Optionally, after determining the data request result information from the storage tier cluster, the computing tier cluster further includes:
returning the data request result information to the proxy layer cluster;
and the proxy layer cluster performs merging processing on the received data request result information.
Optionally, when the system is upgraded, the method includes:
writing new updated computing nodes and copying old computing nodes before updating based on the agent layer cluster to determine an updated computing layer cluster; and updating the fragment information after the updated computing layer cluster is established.
Optionally, when the system is expanded, the method includes:
based on the proxy layer cluster, writing new computing nodes after capacity expansion and copying old computing nodes before capacity expansion to determine the computing layer cluster after capacity expansion; and updating the fragmentation information after confirming that the expanded computing layer cluster is established.
Optionally, when the system expands, the method further includes:
for the agent layer cluster, adding a new agent node for receiving request information and/or data request result information; and/or the presence of a gas in the gas,
for the management layer cluster, adding a new management node for managing and updating the fragment information; and/or the presence of a gas in the gas,
and for the storage layer cluster, adding a new storage node for storing document data information.
Optionally, the implementation method further includes performing data migration by using the storage tier cluster, including:
copying data in the old storage node before migration to the new storage node after migration by using the fragmentation storage unit with the access amount lower than a preset threshold value in the storage node; and updating the fragment information after confirming that the data migration is completed.
One embodiment of the above invention has the following advantages or benefits: the server cluster system comprises an agent layer cluster, a management layer cluster, a computing layer cluster and a storage layer cluster, wherein the agent layer cluster faces a client and can provide a stable receiving platform for a request from the client; therefore, the technical problems that a plurality of clusters cannot share resources and the load difference among the clusters is large in the prior art are solved, and the technical effects that the resources can be used in a larger mode, the system can be load balanced better and the system is more stable are achieved by establishing a platform server cluster system.
Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
FIG. 1 is a schematic diagram of clusters of a server cluster system according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of shard management in a server cluster system according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an architecture of a server cluster system according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of the main steps of an implementation method of a server cluster system according to an embodiment of the present invention;
Detailed Description
Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a schematic diagram of clusters of a server cluster system according to an embodiment of the present invention, and as shown in fig. 1, the server cluster system according to the embodiment of the present invention includes: the system comprises an agent layer cluster 101, a management layer cluster 102, a computing layer cluster 103 and a storage layer cluster 104; wherein the content of the first and second substances,
the agent layer cluster 101 is configured to receive request information, obtain fragmentation information corresponding to the request information from the management layer cluster 102 according to the request information, and send the fragmentation information to the computation layer cluster;
the storage tier cluster 104 is used for storing document data information;
the computation layer cluster 103 is configured to perform computation according to the fragmentation information, and determine data request result information corresponding to the request information from the storage layer cluster 104.
The request message may be issued by a client machine; the agent layer cluster 101 is arranged facing to the client and can provide a stable receiving platform for the request from the client;
the management layer cluster 102 may be used to load-balance manage each other cluster in the system;
the computation layer cluster 103 and the storage layer cluster 104 are two separate parts, and the computation function and the storage function are separated, so that the computation layer cluster 103 can be used for computation more intensively, and the computation capability of the system is stronger;
the storage tier cluster 104 may be used to store all document data information for access, and may enable storage of the document data to be more stable and the document data to be more conveniently managed.
According to the server cluster system, a platform server cluster system can be established through the arrangement, so that resources can be used in a larger scale, the system can be better balanced in load, and the technical effect of enabling the system to be more stable is achieved.
In some embodiments, the proxy layer cluster 101 comprises a plurality of proxy nodes; the management layer cluster 102 comprises a plurality of management nodes; the computing layer cluster 103 comprises a plurality of computing nodes; the storage tier cluster 104 includes a plurality of storage nodes.
In the server cluster system provided by the embodiment of the invention, each cluster is mutually associated and is a high-availability cluster consisting of a plurality of nodes;
in the prior art, each cluster is isolated from each other, and each cluster has only one master node, which is similar to a management node in the present invention; in the present invention, a plurality of management nodes in a management layer cluster can be managed in a unified manner, so that the whole server cluster system can be managed in a unified manner.
In some embodiments, the storage nodes comprise a sharded storage unit; the document data is divided into at least one fragment data and stored in the fragment storage unit; wherein, a fragment data is stored in a fragment storage unit; at least one fragment data is stored in one fragment storage unit.
The storage nodes in the storage tier cluster 104 may be storage media with storage functions, such as floppy disks and hard disks;
the document data can be stably stored in the storage layer cluster, and the storage layer cluster comprises storage nodes, so that the system is easy to expand and reduce the volume, and is suitable for document data of various magnitudes; the storage node includes a fragmentation storage unit, and the document data may be divided into at least one fragment data, which may be stored in the fragmentation storage unit in the storage node.
In some embodiments, the acquiring, by the proxy layer cluster 101, the fragmentation message corresponding to the request information from the management layer cluster 102 according to the request information includes:
determining a target agent node according to the load condition of the agent layer cluster 101;
the target agent node determines a target management node from the management layer cluster 102 according to the request information; and determining the fragmentation message according to the target management node.
The request information can be sent by a client, after the client sends the request information to the proxy layer cluster, the load condition information of the current proxy layer cluster can be obtained, and then the proxy node for processing the request information can be determined according to the load condition information to serve as a target proxy node;
and taking the document data corresponding to the request information as a target document, wherein the request information may include type information of the target document, and a target management node may be determined in the management layer cluster according to the type information, and necessary information, namely fragment information, for processing the request information in subsequent steps exists in the target management node.
In some embodiments, the fragmentation information includes at least, with document data corresponding to the request information as a target document: index information of each fragment data in the target document, wherein the index information stores the corresponding relation between a management node and a computing node; distribution information of each fragment data in the target document in a fragment storage unit, wherein the distribution information stores the corresponding relation between a computing node and a storage node;
the computation layer cluster 103 is configured to perform computation according to the fragmentation information, and determine data request result information corresponding to the request information from the storage layer cluster 104, where the data request result information includes:
determining a target computing node from the computing layer cluster 103 according to the index information;
and the target computing node performs routing computation according to the distribution information, determines a target storage node where the target document is located from the storage layer cluster 104, and determines the data request result information from the target storage node.
The fragment information may be determined when the document data is written into the storage layer cluster, and the fragment information may also have a corresponding relationship with the type information of the document data;
the index information of each fragment data in the target document can be regarded as the corresponding relation between a management node and a computing node, and the distribution information of each fragment data in the target document in a fragment storage unit can be regarded as the corresponding relation between the computing node and a storage node;
in some embodiments, a management node may manage at least one computing node; one management node may correspondingly manage at least one fragment storage unit, and the fragment storage unit managed by one management node may not exist in one storage node.
Fig. 2 is a schematic structural diagram of shard management in a server cluster system according to an embodiment of the present invention; as shown in fig. 2, includes: a management node 201, a first storage node 202, a second storage node 203, a third storage node 204; wherein the content of the first and second substances,
the management node 201 manages: the storage system comprises a fragmentation storage unit 1-2 in a first storage node 202, a fragmentation storage unit 2-2 in a second storage node 203 and a fragmentation storage unit 3-2 in a third storage node 204.
In some embodiments, the compute-layer cluster 103, after determining the data request result information from the storage-layer cluster 104, further comprises: returning the data request result information to the proxy layer cluster 101;
the proxy layer cluster 101 is further configured to: and merging the received data request result information.
The target proxy node in the proxy layer cluster 101 may perform merging processing on the received data request result information.
In some embodiments, when the system is upgraded, the method comprises:
writing new computing nodes after upgrading and copying old computing nodes before upgrading based on the agent layer cluster 101 to determine an upgraded computing layer cluster; and after the updated computing layer cluster is established, the fragmentation information is updated in the management layer cluster 102.
Writing in a new calculation node after upgrading and copying an old calculation node before upgrading, namely upgrading the system by adopting a double-writing mechanism, so that the upgrading can be completed in a transparent manner and without perception of a user, and the user experience is improved.
In some embodiments, when the system is expanded, the method comprises:
based on the agent layer cluster 101, writing new computing nodes after capacity expansion and copying old computing nodes before capacity expansion to determine the computing layer cluster after capacity expansion; and after confirming that the expanded computing layer cluster is established, updating the fragmentation information in the management layer cluster 102.
Writing in new computing nodes after capacity expansion and copying old computing nodes before capacity expansion, namely, adopting a double-write mechanism to expand the capacity of the system, so that the purposes of being transparent to users and upgrading under the condition that the users do not sense are achieved, and the user experience is improved.
In some embodiments, when the system is expanded, the method further comprises:
for the agent layer cluster, adding a new agent node for receiving request information and/or data request result information; and/or the presence of a gas in the gas,
for the management layer cluster, adding a new management node for managing and updating the fragment information; and/or the presence of a gas in the gas,
and for the storage layer cluster, adding a new storage node for storing document data information.
In some embodiments, the storage tier cluster is further used for data migration, including:
copying data in the old storage node before migration to the new storage node after migration by using the fragmentation storage unit with the access amount lower than a preset threshold value in the storage node; and after confirming that the data migration is completed, the fragmentation information is updated in the management layer cluster 102.
In some embodiments, when the storage medium needs to be replaced, data migration may be performed, such as: data can be migrated from the ssd hard disk to the mechanical hard disk to save cost.
Fig. 3 is a schematic architecture diagram of a server cluster system according to an embodiment of the present invention, as shown in fig. 3, including: a client cluster 301, an agent layer cluster 302, a management layer cluster 303, a computing layer cluster 304, and a storage layer cluster 305; wherein the content of the first and second substances,
the client cluster 301 may be composed of a client 1, a client 2, a client 3, … …, and a client n, which may send request information to the proxy layer cluster 302;
after receiving the request information, the agent layer cluster 302 may obtain the fragmentation information from the management layer cluster 303, and then determine a request result corresponding to the request information from the storage layer cluster 305 by using the computation layer cluster 304 according to the fragmentation information;
the proxy layer cluster 302 may perform merging processing on the request result and return the merged result to the client cluster 301.
When the server cluster system of the present invention is upgraded, and/or expanded, and/or migrated, there may be corresponding changes in the management layer cluster 303.
Fig. 4 is a schematic diagram of main steps of an implementation method of a server cluster system according to an embodiment of the present invention, and as shown in fig. 4, the main steps of the implementation method of the server cluster system according to the embodiment of the present invention may include:
step S401: the agent layer cluster 101 receives request information, acquires fragment information corresponding to the request information from the management layer cluster 102 according to the request information, and sends the fragment information to the computing layer cluster;
step S402: the computing layer cluster 103 performs computing according to the fragmentation information, and determines data request result information corresponding to the request information from the storage layer cluster 104 storing document data information.
The request message may be issued by a client machine; the agent layer cluster is arranged facing to the client and can provide a stable receiving platform for the request from the client;
the management layer cluster can be used for managing other clusters in the system in a load balancing manner;
the computing layer cluster and the storage layer cluster are two separated parts, and the computing function and the storage function are separated, so that the computing layer cluster can be used for computing more intensely, and further the computing capability of the system is stronger;
the storage layer cluster can be used for storing all document data information for access, and can enable the storage of the document data to be more stable and the document data to be more conveniently managed.
According to the implementation method of the server cluster system, a platform server cluster system can be established through the arrangement, so that resources can be used in a larger scale, the system can be better balanced in load, and the technical effect of enabling the system to be more stable is achieved.
In some embodiments, a plurality of proxy nodes are included in the proxy layer cluster; the management layer cluster comprises a plurality of management nodes; the computing layer cluster comprises a plurality of computing nodes; the storage tier cluster includes a plurality of storage nodes.
In the server cluster system provided by the embodiment of the invention, each cluster is mutually associated and is a high-availability cluster consisting of a plurality of nodes;
in the prior art, each cluster is isolated from each other, and each cluster has only one master node, which is similar to a management node in the present invention; in the present invention, a plurality of management nodes in a management layer cluster can be managed in a unified manner, so that the whole server cluster system can be managed in a unified manner.
In some embodiments, the storage nodes comprise a sharded storage unit; the document data is divided into at least one fragment data and stored in the fragment storage unit; wherein, a fragment data is stored in a fragment storage unit; at least one fragment data is stored in one fragment storage unit.
The storage nodes in the storage layer cluster can be storage media with a storage function, such as floppy disks and hard disks;
the document data can be stably stored in the storage layer cluster, and the storage layer cluster comprises storage nodes, so that the system is easy to expand and reduce the volume, and is suitable for document data of various magnitudes; the storage node includes a fragmentation storage unit, and the document data may be divided into at least one fragment data, which may be stored in the fragmentation storage unit in the storage node.
In some embodiments, the obtaining, by the proxy layer cluster according to the request information, a fragmentation message corresponding to the request information from the management layer cluster includes:
determining a target proxy node according to the load condition of the proxy layer cluster;
the target agent node determines a target management node from the management layer cluster according to the request information; and determining the fragmentation message according to the target management node.
The request information can be sent by a client, after the client sends the request information to the proxy layer cluster, the load condition information of the current proxy layer cluster can be obtained, and then the proxy node for processing the request information can be determined according to the load condition information to serve as a target proxy node;
and taking the document data corresponding to the request information as a target document, wherein the request information may include type information of the target document, and a target management node may be determined in the management layer cluster according to the type information, and necessary information, namely fragment information, for processing the request information in subsequent steps exists in the target management node.
In some embodiments, the fragmentation information includes at least, with document data corresponding to the request information as a target document: index information of each fragment data in the target document, wherein the index information stores the corresponding relation between a management node and a computing node; distribution information of each fragment data in the target document in a fragment storage unit, wherein the distribution information stores the corresponding relation between a computing node and a storage node;
the computing layer cluster performs computing according to the fragmentation information, and determines data request result information corresponding to the request information from the storage layer cluster, including:
determining a target computing node from the computing layer cluster according to the index information;
and the target computing node performs routing computation according to the distribution information, determines a target storage node where the target document is located from the storage layer cluster, and determines the data request result information from the target storage node.
The fragment information may be determined when the document data is written into the storage layer cluster, and the fragment information may also have a corresponding relationship with the type information of the document data;
the index information of each fragment data in the target document can be regarded as the corresponding relation between a management node and a computing node, and the distribution information of each fragment data in the target document in a fragment storage unit can be regarded as the corresponding relation between the computing node and a storage node;
in some embodiments, a management node may manage at least one computing node; one management node may correspondingly manage at least one fragment storage unit, and the fragment storage unit managed by one management node may not exist in one storage node.
In some embodiments, the computing-layer cluster, after determining the data request result information from the storage-layer cluster, further comprises:
returning the data request result information to the proxy layer cluster;
and the proxy layer cluster performs merging processing on the received data request result information.
The target proxy node in the proxy layer cluster 101 may perform merging processing on the received data request result information.
In some embodiments, when the system is upgraded, the method comprises:
writing new updated computing nodes and copying old computing nodes before updating based on the agent layer cluster to determine an updated computing layer cluster; and updating the fragment information after the updated computing layer cluster is established.
Writing in a new calculation node after upgrading and copying an old calculation node before upgrading, namely upgrading the system by adopting a double-writing mechanism, so that the upgrading can be completed in a transparent manner and without perception of a user, and the user experience is improved.
In some embodiments, when the system is expanded, the method comprises:
based on the proxy layer cluster, writing new computing nodes after capacity expansion and copying old computing nodes before capacity expansion to determine the computing layer cluster after capacity expansion; and updating the fragmentation information after confirming that the expanded computing layer cluster is established.
Writing in new computing nodes after capacity expansion and copying old computing nodes before capacity expansion, namely, adopting a double-write mechanism to expand the capacity of the system, so that the purposes of being transparent to users and upgrading under the condition that the users do not sense are achieved, and the user experience is improved.
In some embodiments, when the system is expanded, the method further comprises:
for the agent layer cluster, adding a new agent node for receiving request information and/or data request result information; and/or the presence of a gas in the gas,
for the management layer cluster, adding a new management node for managing and updating the fragment information; and/or the presence of a gas in the gas,
and for the storage layer cluster, adding a new storage node for storing document data information.
In some embodiments, the implementation method further comprises performing data migration using the storage tier cluster, including:
copying data in the old storage node before migration to the new storage node after migration by using the fragmentation storage unit with the access amount lower than a preset threshold value in the storage node; and updating the fragment information after confirming that the data migration is completed.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The cluster described in the embodiments of the present invention may be implemented by software or hardware. The described clusters may also be provided in a processor, which may be described as: a processor includes an agent layer cluster, a management layer cluster, a compute layer cluster, and a storage layer cluster. Where the name of these clusters does not in some cases constitute a limitation of the cluster itself.
According to the technical scheme of the embodiment of the invention, the agent layer cluster faces the client and can provide a stable receiving platform for the request from the client, each other cluster and the fragment information in the system can be managed in a load balancing manner by arranging a plurality of management nodes in the management layer cluster, the computing layer cluster and the storage layer cluster are two separated parts, the computing layer cluster can be only used for computing, so that the computing capability of the system is stronger, the storage layer cluster is used for storing all document data information for access, the document data can be stored more stably, and the document data can be managed more conveniently; therefore, the technical problems that a plurality of clusters cannot share resources and the load difference among the clusters is large in the prior art are solved, and the technical effects that the resources can be used in a larger mode, the system can be load balanced better and the system is more stable are achieved by establishing a platform server cluster system.
The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (11)
1. A server cluster system, the system comprising: the system comprises an agent layer cluster, a management layer cluster, a computing layer cluster and a storage layer cluster; wherein the content of the first and second substances,
the agent layer cluster is used for receiving request information, acquiring fragment information corresponding to the request information from the management layer cluster according to the request information, and sending the fragment information to the computing layer cluster;
the storage layer cluster is used for storing document data information;
and the computing layer cluster is used for computing according to the fragment information and determining data request result information corresponding to the request information from the storage layer cluster.
2. The system of claim 1, comprising:
the proxy layer cluster comprises a plurality of proxy nodes;
the management layer cluster comprises a plurality of management nodes;
the computing layer cluster comprises a plurality of computing nodes;
the storage tier cluster includes a plurality of storage nodes.
3. The system of claim 2, comprising:
the storage nodes comprise fragmentation storage units; the document data is divided into at least one fragment data and stored in the fragment storage unit; wherein, a fragment data is stored in a fragment storage unit; at least one fragment data is stored in one fragment storage unit.
4. The system according to claim 3, wherein the obtaining, by the proxy layer cluster, the fragmentation message corresponding to the request information from the management layer cluster according to the request information comprises:
determining a target proxy node according to the load condition of the proxy layer cluster;
the target agent node determines a target management node from the management layer cluster according to the request information; and determining the fragmentation message according to the target management node.
5. The system of claim 4,
taking the document data corresponding to the request information as a target document, wherein the fragment information at least comprises:
index information of each fragment data in the target document, wherein the index information stores the corresponding relation between a management node and a computing node; distribution information of each fragment data in the target document in a fragment storage unit, wherein the distribution information stores the corresponding relation between a computing node and a storage node;
the computing layer cluster is configured to perform computing according to the fragmentation information, and determine data request result information corresponding to the request information from the storage layer cluster, where the computing layer cluster includes:
determining a target computing node from the computing layer cluster according to the index information;
and the target computing node performs routing computation according to the distribution information, determines a target storage node where the target document is located from the storage layer cluster, and determines the data request result information from the target storage node.
6. The system of claim 1, wherein the compute-layer cluster, after determining the data request result information from the storage-layer cluster, further comprises: returning the data request result information to the proxy layer cluster;
the proxy layer cluster is further configured to: and merging the received data request result information.
7. The system of claims 1-6, when the system is upgraded, comprising:
writing new updated computing nodes and copying old computing nodes before updating based on the agent layer cluster to determine an updated computing layer cluster; and updating the fragment information after the updated computing layer cluster is established.
8. The system of claims 1-6, when the system is expanded, comprising:
based on the proxy layer cluster, writing new computing nodes after capacity expansion and copying old computing nodes before capacity expansion to determine the computing layer cluster after capacity expansion; and updating the fragmentation information after confirming that the expanded computing layer cluster is established.
9. The system of claim 8, when the system is expanded, further comprising:
for the agent layer cluster, adding a new agent node for receiving request information and/or data request result information; and/or the presence of a gas in the gas,
for the management layer cluster, adding a new management node for managing and updating the fragment information; and/or the presence of a gas in the gas,
and for the storage layer cluster, adding a new storage node for storing document data information.
10. The system of claims 1-6, wherein the storage tier cluster is further configured for data migration, comprising:
copying data in the old storage node before migration to the new storage node after migration by using the fragmentation storage unit with the access amount lower than a preset threshold value in the storage node; and updating the fragment information after confirming that the data migration is completed.
11. An implementation method of a server cluster system, wherein the server cluster system includes: the system comprises an agent layer cluster, a management layer cluster, a computing layer cluster and a storage layer cluster; the method comprises the following steps:
the agent layer cluster receives request information, acquires fragment information corresponding to the request information from the management layer cluster according to the request information, and sends the fragment information to the computing layer cluster;
and the computing layer cluster performs computing according to the fragment information, and determines data request result information corresponding to the request information from the storage layer cluster storing the document data information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010081707.5A CN113225362B (en) | 2020-02-06 | 2020-02-06 | Server cluster system and implementation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010081707.5A CN113225362B (en) | 2020-02-06 | 2020-02-06 | Server cluster system and implementation method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113225362A true CN113225362A (en) | 2021-08-06 |
| CN113225362B CN113225362B (en) | 2024-04-05 |
Family
ID=77085546
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010081707.5A Active CN113225362B (en) | 2020-02-06 | 2020-02-06 | Server cluster system and implementation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113225362B (en) |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040249904A1 (en) * | 2001-06-05 | 2004-12-09 | Silicon Graphics, Inc. | Multi-class heterogeneous clients in a clustered filesystem |
| US20110184914A1 (en) * | 2010-01-28 | 2011-07-28 | Jeff Gong | Database Archiving Using Clusters |
| CN102479207A (en) * | 2010-11-29 | 2012-05-30 | 阿里巴巴集团控股有限公司 | Information search method, system and device |
| CN103077245A (en) * | 2013-01-18 | 2013-05-01 | 浪潮电子信息产业股份有限公司 | Method for expanding parallel file system by free hard disk space of cluster computing node |
| CN104320401A (en) * | 2014-10-31 | 2015-01-28 | 北京思特奇信息技术股份有限公司 | Big data storage and access system and method based on distributed file system |
| CN104580503A (en) * | 2015-01-26 | 2015-04-29 | 浪潮电子信息产业股份有限公司 | Efficient dynamic load balancing system and method for processing large-scale data |
| US9697213B1 (en) * | 2013-06-12 | 2017-07-04 | EMC IP Holding Company LLC | Cluster file system comprising object storage server tier and scale-out network attached storage tier |
| CN107872404A (en) * | 2016-09-23 | 2018-04-03 | 中兴通讯股份有限公司 | Business burst processing method, device and software defined network controller |
| US20180336023A1 (en) * | 2017-05-16 | 2018-11-22 | Bank Of America Corporation | Distributed storage framework information server platform architecture |
| CN109033130A (en) * | 2018-06-04 | 2018-12-18 | 温州市图盛科技有限公司 | A kind of block chain electric power data storage system |
| CN109729129A (en) * | 2017-10-31 | 2019-05-07 | 华为技术有限公司 | Configuration modification method, storage cluster and the computer system of storage cluster |
| CN109828960A (en) * | 2018-12-14 | 2019-05-31 | 平安科技（深圳）有限公司 | Log library expansion method, system, computer installation and readable storage medium storing program for executing |
| CN109933631A (en) * | 2019-03-20 | 2019-06-25 | 江苏瑞中数据股份有限公司 | Distributed parallel database system and data processing method based on Infiniband network |
| CN109992196A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视数字技术股份有限公司 | Storage method and device, the storage system of index data |
| CN110018878A (en) * | 2018-01-09 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of distributed system data load method and device |
| CN110427284A (en) * | 2019-07-31 | 2019-11-08 | 中国工商银行股份有限公司 | Data processing method, distributed system, computer system and medium |
-
2020
- 2020-02-06 CN CN202010081707.5A patent/CN113225362B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040249904A1 (en) * | 2001-06-05 | 2004-12-09 | Silicon Graphics, Inc. | Multi-class heterogeneous clients in a clustered filesystem |
| US20110184914A1 (en) * | 2010-01-28 | 2011-07-28 | Jeff Gong | Database Archiving Using Clusters |
| CN102479207A (en) * | 2010-11-29 | 2012-05-30 | 阿里巴巴集团控股有限公司 | Information search method, system and device |
| CN103077245A (en) * | 2013-01-18 | 2013-05-01 | 浪潮电子信息产业股份有限公司 | Method for expanding parallel file system by free hard disk space of cluster computing node |
| US9697213B1 (en) * | 2013-06-12 | 2017-07-04 | EMC IP Holding Company LLC | Cluster file system comprising object storage server tier and scale-out network attached storage tier |
| CN104320401A (en) * | 2014-10-31 | 2015-01-28 | 北京思特奇信息技术股份有限公司 | Big data storage and access system and method based on distributed file system |
| CN104580503A (en) * | 2015-01-26 | 2015-04-29 | 浪潮电子信息产业股份有限公司 | Efficient dynamic load balancing system and method for processing large-scale data |
| CN107872404A (en) * | 2016-09-23 | 2018-04-03 | 中兴通讯股份有限公司 | Business burst processing method, device and software defined network controller |
| US20180336023A1 (en) * | 2017-05-16 | 2018-11-22 | Bank Of America Corporation | Distributed storage framework information server platform architecture |
| CN109729129A (en) * | 2017-10-31 | 2019-05-07 | 华为技术有限公司 | Configuration modification method, storage cluster and the computer system of storage cluster |
| CN109992196A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视数字技术股份有限公司 | Storage method and device, the storage system of index data |
| CN110018878A (en) * | 2018-01-09 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of distributed system data load method and device |
| CN109033130A (en) * | 2018-06-04 | 2018-12-18 | 温州市图盛科技有限公司 | A kind of block chain electric power data storage system |
| CN109828960A (en) * | 2018-12-14 | 2019-05-31 | 平安科技（深圳）有限公司 | Log library expansion method, system, computer installation and readable storage medium storing program for executing |
| CN109933631A (en) * | 2019-03-20 | 2019-06-25 | 江苏瑞中数据股份有限公司 | Distributed parallel database system and data processing method based on Infiniband network |
| CN110427284A (en) * | 2019-07-31 | 2019-11-08 | 中国工商银行股份有限公司 | Data processing method, distributed system, computer system and medium |
Non-Patent Citations (5)
| Title |
|---|
| 安俊秀;: "基于服务器集群的云检索系统的研究与示范", 计算机科学, no. 07 * |
| 王华, 万木春, 彭勤科, 胡保生: "一种集群服务器配置和管理工具", 计算机应用, no. 01 * |
| 董波;沈青;肖德宝;: "云计算集群服务器系统监控方法的研究", 计算机工程与科学, no. 10 * |
| 郭平;李琪;: "基于服务器负载状况分类的负载均衡调度算法", 华中科技大学学报(自然科学版), no. 1 * |
| 黄蓉;俞建新;: "基于智能存储设备的共享存储集群系统研究", 计算机工程与设计, no. 16 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113225362B (en) | 2024-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2784675B1 (en) | Method, device and system for data reconstruction | |
| JP6328432B2 (en) | Gateway device, file server system, and file distribution method | |
| CN102741800B (en) | Delete the storage system copying data | |
| KR101597384B1 (en) | Partition management in a partitioned, scalable, and available structured storage | |
| KR101544480B1 (en) | Distribution storage system having plural proxy servers, distributive management method thereof, and computer-readable recording medium | |
| CN105814544B (en) | System and method for supporting persistent partition recovery in a distributed data grid | |
| US8990243B2 (en) | Determining data location in a distributed data store | |
| US11296940B2 (en) | Centralized configuration data in a distributed file system | |
| CN102708165B (en) | Document handling method in distributed file system and device | |
| CN111212111B (en) | Object storage service management method and electronic equipment | |
| CN107085539B (en) | cloud database system and dynamic cloud database resource adjustment method | |
| US20130218934A1 (en) | Method for directory entries split and merge in distributed file system | |
| US9547706B2 (en) | Using colocation hints to facilitate accessing a distributed data storage system | |
| CN111078121A (en) | Data migration method, system and related components of distributed storage system | |
| US8874626B2 (en) | Tracking files and directories related to unsuccessful change operations | |
| EP3788489B1 (en) | Data replication in a distributed storage system | |
| CN108733311B (en) | Method and apparatus for managing storage system | |
| CN113268472B (en) | Distributed data storage system and method | |
| JP2009259007A (en) | Distributed storage method, distributed storage system and distributed storage device | |
| US10558373B1 (en) | Scalable index store | |
| CN111225003B (en) | NFS node configuration method and device | |
| US11341009B1 (en) | Directing placement of data in cloud storage nodes | |
| US11537619B1 (en) | Replica group modification in a distributed database | |
| CN113225362A (en) | Server cluster system and implementation method thereof | |
| CN116635831A (en) | Data storage method and device and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |