CN115242617A - Big data cluster and operation authority control method and related components thereof - Google Patents
Big data cluster and operation authority control method and related components thereof Download PDFInfo
- Publication number
- CN115242617A CN115242617A CN202210893139.8A CN202210893139A CN115242617A CN 115242617 A CN115242617 A CN 115242617A CN 202210893139 A CN202210893139 A CN 202210893139A CN 115242617 A CN115242617 A CN 115242617A
- Authority
- CN
- China
- Prior art keywords
- node
- management node
- target management
- user
- operation authority
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000006870 function Effects 0.000 claims abstract description 10
- 238000007726 management method Methods 0.000 claims description 281
- 238000004590 computer program Methods 0.000 claims description 12
- 238000013500 data storage Methods 0.000 claims description 8
- 230000001360 synchronised effect Effects 0.000 description 8
- 238000013507 mapping Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0668—Management of faults, events, alarms or notifications using network fault recovery by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/20—Network architectures or network communication protocols for network security for managing network security; network security policies in general
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Storage Device Security (AREA)
Abstract
The application discloses a big data cluster and an operation authority control method and related components thereof, relating to the field of big data clusters, wherein the method comprises the following steps: determining a plurality of operation authority management nodes with operation authority control functions; determining a target management node from all operation authority management nodes; responding to an operation request of a user node through a target management node; when the operation rule of the target management node is updated, synchronizing the operation rule to other operation authority management nodes; when the target management node fails, a new target management node is determined from other operation authority management nodes, so that the new target management node responds to the operation request of the user node. According to the control method, the target management node always exists to respond to the operation request of the user node and provide the authority service, so that the high availability requirement of the user node on the authority service is met, and the high reliability of the link between the user node and the big data cluster is improved.
Description
Technical Field
The invention relates to the field of big data clusters, in particular to a big data cluster and an operation authority control method and related components thereof.
Background
Currently, big data clusters provide convenient cloud data access for users, and are already applied to various industries. In order to ensure the data security in the big data cluster when the User node accesses the big data cluster, an operation authority management strategy is arranged in the big data cluster, the management strategy comprises a User node strategy and a cluster end strategy, the User node strategy is mainly realized by operation authority login software installed on the User node, a front end webUI (Web User Interfaces) interface of the User node receives a login instruction of a User operation authority, and a back end sends a request related to the operation authority to the big data cluster according to the login instruction; the cluster end strategy is realized by a management node installed at a cluster end, the management node is used for operation authority of all big data clusters, and when the management node receives a request of a user node, the management node judges that the request meets the operation authority distribution condition, the management node corresponds to the request of the user node, distributes the operation authority to the user node and provides corresponding authority service.
However, only one management node is in the current management strategy, if the management node fails, the internal authority service cannot be updated, the user node can only operate according to the local authority service content of the server node, at this time, the user node cannot use the authority service which needs to operate for a long time, update or must operate online, and the large data cluster cannot meet the high availability requirement of the authority service of the user node at this time.
Therefore, how to provide a solution to the above technical problems is a problem to be solved by those skilled in the art.
Disclosure of Invention
In view of this, the present invention provides a big data cluster, an operation authority control method thereof, and related components, so as to meet a high availability requirement of a user node for an authority service. The specific scheme is as follows:
an operation authority control method for a big data cluster comprises the following steps:
determining a plurality of operation authority management nodes with an operation authority control function;
determining a target management node from all the operation authority management nodes;
responding to an operation request of a user node through the target management node;
when the operation rule of the target management node is updated, synchronizing the operation rule to other operation authority management nodes;
when the target management node fails, determining a new target management node from other operation authority management nodes so as to respond to the operation request of the user node through the new target management node.
Preferably, when the target management node fails, the process of determining a new target management node from other operation authority management nodes to respond to the operation request of the user node through the new target management node includes:
when the target management node fails, selecting one local operation authority management node with the latest operation rule version from other operation authority management nodes as a new target management node, so as to respond to the operation request of the user node through the new target management node.
Preferably, the step of synchronizing the operation rule to the other operation authority management nodes when the operation rule of the target management node is updated includes:
and when the operation rule of the target management node is updated, synchronizing the operation rule to the local storage units of other operation authority management nodes.
Preferably, the process of responding to the operation request of the user node by the target management node includes:
and adjusting the operation authority of the user node on the big data cluster according to the operation request of the user node through the target management node.
Preferably, after determining a target management node from all the operation right management nodes, the method further includes:
broadcasting the target management node to enable the user node to determine a target position of a sending object of the operation request;
correspondingly, after determining a new target management node from the other operation right management nodes, the method further includes:
broadcasting the new target management node to enable the user node to update the target position.
Preferably, the operation request comprises a first operation request sent by the user node immediately after receiving a user request instruction.
Preferably, the operation request further includes:
and the user node sends the primary operation request and receives the rejection information fed back by the target management node and then sends a secondary operation request.
Correspondingly, the application also discloses an electronic device, including:
a memory for storing a computer program;
a processor for implementing the steps of the operation right control method of the big data cluster as any one of the above when executing the computer program.
Correspondingly, the application also discloses a readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the operation authority control method for a big data cluster as described in any one of the above.
Correspondingly, the present application also discloses a big data cluster system, including:
a plurality of data storage nodes;
the operation authority management nodes are connected with all the data storage nodes;
one or more user nodes;
the electronic device is connected with the user node and the plurality of operation authority management nodes.
The application discloses an operation authority control method for a big data cluster, which comprises the following steps: determining a plurality of operation authority management nodes with operation authority control functions; determining a target management node from all the operation authority management nodes; responding to an operation request of a user node through the target management node; when the operation rule of the target management node is updated, synchronizing the operation rule to other operation authority management nodes; when the target management node fails, determining a new target management node from other operation authority management nodes so as to respond to the operation request of the user node through the new target management node. According to the control method, the operation authority management nodes with synchronous operation rules are arranged, the target management node is determined from the operation authority management nodes, and the target management node always exists to respond to the operation request of the user node and provide authority service, so that the high availability requirement of the user node on the authority service is met, and the high reliability of the link between the user node and the large data cluster is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a flowchart illustrating steps of a method for controlling operation authority of a big data cluster according to an embodiment of the present invention;
FIG. 2 is a structure diagram of a big data cluster system according to an embodiment of the present invention;
FIG. 3 is a structural distribution diagram of a cluster efficient rights management center according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a structure distribution of a user management center according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating a configuration of a rights management center according to an embodiment of the present invention;
fig. 6 is a structural distribution diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Only one management node is arranged in the current management strategy, if the management node fails, the internal authority service cannot be updated, the user node can only operate according to the local authority service content of the server node, at the moment, the user node cannot use the authority service which needs to operate for a long time, update or must operate online, and the large data cluster cannot meet the high availability requirement of the authority service of the user node at the moment.
According to the control method, the operation authority management nodes with synchronous operation rules are arranged, the target management node is determined from the operation authority management nodes, and the target management node always exists to respond to the operation request of the user node and provide authority service, so that the high availability requirement of the user node on the authority service is met, and the high reliability of the link between the user node and the large data cluster is improved.
The embodiment of the invention discloses an operation authority control method of a big data cluster, which is shown in figure 1 and comprises the following steps:
s1: determining a plurality of operation authority management nodes with operation authority control functions;
s2: determining a target management node from all operation authority management nodes;
s3: responding to an operation request of a user node through a target management node;
s4: when the operation rule of the target management node is updated, synchronizing the operation rule to other operation authority management nodes;
s5: when the target management node fails, a new target management node is determined from other operation authority management nodes so as to respond to the operation request of the user node through the new target management node.
It can be understood that, the operation authority control method in this embodiment is applied to a big data cluster system including a big data cluster, where the association relationship of each module can be as shown in fig. 2, where the big data cluster 1 includes a plurality of data storage nodes 10, the management module 2 includes a plurality of operation authority management nodes 20, the user side 3 includes one or more user nodes 30, the operation authority control method in this embodiment is mainly used for managing the operation authority management nodes, usually, one server node 40 may be replaced in the big data cluster to implement steps S1-S5 of the method, to manage and control the actions of all the operation authority management nodes, or an internal rule may be set for each operation authority management node, steps S1-S5 are implemented by all the operation authority management nodes as a whole, the operation authority management nodes communicate with each other and select one target management node according to the internal rule, the target management node responds to an operation request of the user node, and synchronizes the operation rules of all other operation management nodes when the operation rules are updated on the target management node, if it is determined that a current target management node fails in the process of mutual communication, then, each new management node is selected, and the new target management node has the same function as the target management node, and the target management node: responding to the operation request of the user node. Therefore, under the setting, a target management node capable of responding to the user node always exists, and the target management node has high-reliability and high-availability operation rules.
Specifically, when a plurality of operation authority management nodes are determined in step S1, information such as a position number, start time, update time of an operation rule, and the like of each operation authority management node may be generally obtained, and when a target management node is determined in step S2, a target management node may be determined from all the operation authority management nodes according to the information. For example, when all the operation authority management nodes are just started, the operation rules are not stored inside the operation authority management nodes, and the operation authority management node with the earliest starting time is directly used as the target management node. In addition, if the operation authority management node has the capability of storing the operation rule, the target management node can be replaced by the operation authority management node with the latest update time of the internal operation rule, namely the latest version after all the operation authority management nodes are started, so that the service reliability is further improved.
Further, the step S3 is a process of responding to the operation request of the user node by the target management node, and includes:
and adjusting the operation authority of the user node on the big data cluster according to the operation request of the user node through the target management node.
It can be understood that the front end of the user node provides a webUI visual login interface for a user or an administrator, the front end generates a user request instruction after receiving the right user login information input by the user or the administrator, and the rear end of the user node sends an operation request to the target management node according to the user request instruction to obtain the operation right for the large data cluster. Further, the back-end component of the user node may generally include a cluster high-efficiency rights management center, a user management center, a rights management center, and the like, as shown in fig. 3, the cluster high-efficiency rights management center mainly manages resources of the big data cluster, for example, finds a big data component HDFS (Hadoop Distributed File System) "hdp1_ HDFS" through a target management node, manages the big data HDFS component, and manages management contents including service connections corresponding to operations such as editing, deleting, adding, and the like; when HDFS service resources are managed, directories and files which can be checked can be edited, deleted, uploaded and the like, and the operations are established on the basis that users logged in by user nodes have related operation permissions. As shown in fig. 4, the user management center mainly manages users of the cluster node system and users created by the permission platform, and manages user attributes of the users, including information such as user names, user states, user descriptions, user groups, user creation time, and synchronized user time. As shown in fig. 5, the authority management center mainly manages mapping relationships among users, big data component resources, and authorities, and may create, view, delete, and the like, allow a user to perform a certain operation on a certain resource, or disallow a user to perform a certain operation on a certain resource.
It can be understood that, in addition to the above description, the contents of the front end and the back end of the user node may also include other contents added or adjusted according to different actual user requirements or different management types, which is not limited herein and falls within the protection scope of the present embodiment.
It should be noted that, on one user node, the front end is allowed to log in different users, so the operation authority of the user node in this embodiment does not directly correspond to the node address of the user node, but needs to judge whether the logged-in user or administrator is a legal user or a legal administrator in the mapping relationship according to the operation request sent by the current user node, and further allocates the operation authority to the user or administrator currently logged in the user node.
It is understood that the types of the big data clusters in this embodiment include HDFS, hive, hbase, and the like, and the specific operation permissions that can be provided to the user nodes are different according to the types of the big data clusters, for example, when the big data cluster is a distributed file system HDFS, the operation permissions that can be obtained by the user nodes include operations of reading only, editing, deleting, adding, and the like. Certainly, the target management node may analyze an operation range and an operation action of an operation request of the user node according to the internal operation rule, and allocate a related operation authority to the user node, usually, a mapping relationship corresponding to the operation rule is stored in the target management node, a mapping object of the mapping relationship includes a data storage node, a user node, and an operation authority, and the mapping relationship may be created, checked, deleted, and modified by an administrator, based on the mapping relationship or the operation rule, the target management node may allow the user node to perform a certain operation on a certain resource of the big data cluster, and may also prohibit the user node from performing a certain operation on a certain resource of the big data cluster, so that the target management node first performs security verification on the operation request in a process of responding to the operation request of the user node, and then adjusts the operation authority according to a result of the security verification.
Further, step S4 is a process of synchronizing the operation rule to another operation authority management node when the operation rule of the target management node is updated, and the process includes: and when the operation rule of the target management node is updated, synchronizing the operation rule to the local storage units of other operation authority management nodes. And the local storage unit of the operation authority management node is saved, so that double insurance of the memory and the disk is realized, and the reliability of the local operation rule is improved.
Further, the step S5 is a process of determining a new target management node from other operation authority management nodes when the target management node fails, so as to respond to the operation request of the user node through the new target management node, and includes:
when the target management node fails, selecting one operation authority management node with the latest local operation rule version from other operation authority management nodes as a new target management node so as to respond to the operation request of the user node through the new target management node.
It can be understood that, a target management node is determined from a plurality of operation right management nodes, an operation right management node with the latest update time and the latest version of the operation rule is generally selected, if the local operation rule versions of the plurality of operation right management nodes are all the latest, one operation right management node can be selected from the plurality of operation right management nodes as the target management node randomly or according to the principle of maximum or minimum number, and the specific selection mode can be determined according to practice, and is not limited herein.
It can be understood that, for all the operation authority management nodes, the operation authority management node selected as the target management node may be regarded as an active working state, and other operation authority management nodes are regarded as a standby state, and only synchronous update of the operation rule is required, and the operation authority management node is in a low-power consumption state to be wakened without executing other operations.
The application discloses an operation authority control method for a big data cluster, which comprises the following steps: determining a plurality of operation authority management nodes with an operation authority control function; determining a target management node from all the operation authority management nodes; responding to an operation request of a user node through the target management node; when the operation rule of the target management node is updated, synchronizing the operation rule to other operation authority management nodes; when the target management node fails, determining a new target management node from other operation authority management nodes so as to respond to the operation request of the user node through the new target management node. According to the control method, the operation authority management nodes with synchronous operation rules are arranged, the target management node is determined from the operation authority management nodes, and the target management node always exists to respond to the operation request of the user node and provide authority service, so that the high availability requirement of the user node on the authority service is met, and the high reliability of the link between the user node and the large data cluster is improved.
The embodiment of the invention discloses a specific operation authority control method for a big data cluster, and compared with the previous embodiment, the embodiment further explains and optimizes the technical scheme. Specifically, the method comprises the following steps:
after step S2 determines a target management node from all the operation right management nodes, the method further includes:
broadcasting a target management node to enable a user node to determine a target position of a transmission object of an operation request;
correspondingly, after the step S5 determines a new target management node from other operation right management nodes, the method further includes:
and broadcasting the new target management node to enable the user node to update the target position.
It is understood that this action is for the back end of the user node to accurately locate the target management node according to the target location, so that the operation request is accurately sent to the target management node, but not to other operation authority management nodes.
Further, after receiving the right user login information input by the user or the administrator, the current end in the conventional user node does not immediately send the operation request to the target management node, but sends the operation request simultaneously when the heartbeat signal is sent with the target management node conventionally, and the period of the heartbeat signal is generally about 30s, so that even if the user inputs the right user login information, the user node cannot immediately obtain the response of the target management node, and the user node cannot immediately obtain the operation right.
Further, the operation request further includes: and the user node sends a primary operation request and receives rejection information fed back by the target management node, and then sends a secondary operation request.
It can be understood that, in order to further reduce misjudgment caused by unresponsiveness of the operation permission, the secondary operation request can be sent when the primary operation request is rejected, so that the response accuracy and the response accuracy are improved, and the use comfort of the user accessing the large data cluster is improved.
Accordingly, the present application also discloses an electronic device, which is shown in fig. 6 and includes a processor 11 and a memory 12; wherein, the processor 11 implements the following steps when executing the computer program stored in the memory 12:
determining a plurality of operation authority management nodes with an operation authority control function;
determining a target management node from all the operation authority management nodes;
responding to an operation request of a user node through the target management node;
when the operation rule of the target management node is updated, synchronizing the operation rule to other operation authority management nodes;
when the target management node fails, determining a new target management node from other operation authority management nodes so as to respond to the operation request of the user node through the new target management node.
In the embodiment, a plurality of operation authority management nodes with synchronous operation rules are set and a target management node is determined from the operation authority management nodes, and the target management node always exists to respond to an operation request of the user node and provide authority service, so that the high availability requirement of the user node on the authority service is met, and the high reliability of the link between the user node and the big data cluster is improved.
In some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
when the target management node fails, selecting one operation authority management node with the latest local operation rule version from other operation authority management nodes as a new target management node, so as to respond to the operation request of the user node through the new target management node.
In some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
and when the operation rule of the target management node is updated, synchronizing the operation rule to the local storage units of other operation authority management nodes.
In some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
and adjusting the operation authority of the user node on the big data cluster according to the operation request of the user node through the target management node.
In some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
broadcasting the target management node to enable the user node to determine a target position of a sending object of the operation request;
in some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
broadcasting the new target management node to enable the user node to update the target position.
In some specific embodiments, the operation request includes a first operation request issued by the user node upon receiving a user request instruction.
In some specific embodiments, the operation request further includes:
and the user node sends the primary operation request and receives the rejection information fed back by the target management node and then sends a secondary operation request.
Further, the electronic device in this embodiment may further include:
the input interface 13 is configured to obtain a computer program imported from the outside, store the obtained computer program in the memory 12, and also be configured to obtain various instructions and parameters transmitted by an external terminal device, and transmit the instructions and parameters to the processor 11, so that the processor 11 performs corresponding processing by using the instructions and parameters. In this embodiment, the input interface 13 may specifically include, but is not limited to, a USB interface, a serial interface, a voice input interface, a fingerprint input interface, a hard disk reading interface, and the like.
And an output interface 14, configured to output various data generated by the processor 11 to a terminal device connected thereto, so that other terminal devices connected to the output interface 14 can acquire various data generated by the processor 11. In this embodiment, the output interface 14 may specifically include, but is not limited to, a USB interface, a serial interface, and the like.
A communication unit 15 for establishing a telecommunication connection between the electronic device and an external server so that the electronic device can mount the image file to the external server. In this embodiment, the communication unit 15 may specifically include, but is not limited to, a remote communication unit based on a wireless communication technology or a wired communication technology.
And the keyboard 16 is used for acquiring various parameter data or instructions input by a user through real-time key cap knocking.
And the display 17 is used for displaying relevant information of the authority operation control process in real time so that a user can know the current authority operation control situation in time.
The mouse 18 may be used to assist the user in entering data and to simplify the user's operation.
Further, the present application discloses a readable storage medium, where the readable storage medium includes a Random Access Memory (RAM), a Memory, a Read-Only Memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium known in the art. The readable storage medium has stored therein a computer program which, when executed by a processor, performs the steps of:
determining a plurality of operation authority management nodes with operation authority control functions;
determining a target management node from all the operation authority management nodes;
responding to an operation request of a user node through the target management node;
when the operation rule of the target management node is updated, synchronizing the operation rule to other operation authority management nodes;
when the target management node fails, determining a new target management node from other operation authority management nodes so as to respond to the operation request of the user node through the new target management node.
In the embodiment, a plurality of operation authority management nodes with synchronous operation rules are set and a target management node is determined from the operation authority management nodes, and the target management node always exists to respond to an operation request of the user node and provide authority service, so that the high availability requirement of the user node on the authority service is met, and the high reliability of the link between the user node and the big data cluster is improved.
In some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
when the target management node fails, selecting one local operation authority management node with the latest operation rule version from other operation authority management nodes as a new target management node, so as to respond to the operation request of the user node through the new target management node.
In some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
and when the operation rule of the target management node is updated, synchronizing the operation rule to the local storage units of other operation authority management nodes.
In some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
and adjusting the operation authority of the user node on the big data cluster according to the operation request of the user node through the target management node.
In some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
broadcasting the target management node to enable the user node to determine a target position of a sending object of the operation request;
in some specific embodiments, when the processor 11 executes the computer subprogram stored in the memory 12, the following steps may be specifically implemented:
broadcasting the new target management node to enable the user node to update the target position.
In some specific embodiments, the operation request includes a first operation request issued by the user node upon receiving a user request instruction.
In some specific embodiments, the operation request further includes:
and the user node sends the primary operation request and receives the rejection information fed back by the target management node, and then sends a secondary operation request.
Correspondingly, an embodiment of the present application further discloses a big data cluster system, which is shown in fig. 2 and includes:
a plurality of data storage nodes 10;
a plurality of operation authority management nodes 20, each of the operation authority management nodes 20 being connected to all of the data storage nodes 10;
one or more user nodes 30;
an electronic device 40 connected to the user node 30 and a plurality of the operation authority management nodes 20,
besides the above nodes, the big data cluster system may further include an information storage node for storing information data such as cluster resource information, user information, authority information, authentication process information, log information, page display data information, and the like, and the specific content is not limited, so as to facilitate the backtracking inspection during subsequent operation.
In some particular embodiments, the electronic device 40 includes a processor and a memory; wherein the processor, when executing the computer program stored in the memory, implements the steps of:
determining a plurality of operation authority management nodes with operation authority control functions;
determining a target management node from all the operation authority management nodes;
responding to an operation request of a user node through the target management node;
when the operation rule of the target management node is updated, synchronizing the operation rule to other operation authority management nodes;
when the target management node fails, determining a new target management node from other operation authority management nodes so as to respond to the operation request of the user node through the new target management node.
In the embodiment, a plurality of operation authority management nodes with synchronous operation rules are set and a target management node is determined from the operation authority management nodes, and the target management node always exists to respond to an operation request of the user node and provide authority service, so that the high availability requirement of the user node on the authority service is met, and the high reliability of the link between the user node and the big data cluster is improved.
In some specific embodiments, when the processor executes the computer subprogram stored in the memory, the following steps may be specifically implemented:
when the target management node fails, selecting one operation authority management node with the latest local operation rule version from other operation authority management nodes as a new target management node, so as to respond to the operation request of the user node through the new target management node.
In some specific embodiments, when the processor executes the computer subprogram stored in the memory, the following steps may be specifically implemented:
and when the operation rule of the target management node is updated, synchronizing the operation rule to the local storage units of other operation authority management nodes.
In some specific embodiments, when the processor executes the computer subprogram stored in the memory, the following steps may be specifically implemented:
and adjusting the operation authority of the user node on the big data cluster according to the operation request of the user node through the target management node.
In some specific embodiments, when the processor executes the computer subprogram stored in the memory, the following steps may be specifically implemented:
broadcasting the target management node to enable the user node to determine a target position of a transmission object of the operation request;
in some specific embodiments, when the processor executes the computer subprogram stored in the memory, the following steps may be specifically implemented:
broadcasting the new target management node to enable the user node to update the target position.
In some specific embodiments, the operation request includes a first operation request issued by the user node immediately after receiving a user request instruction.
In some specific embodiments, the operation request further includes:
and the user node sends the primary operation request and receives the rejection information fed back by the target management node and then sends a secondary operation request.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
The big data cluster and the operation authority control method and related components thereof provided by the invention are introduced in detail, specific examples are applied in the text to explain the principle and the implementation mode of the invention, and the description of the above embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. An operation authority control method for a big data cluster is characterized by comprising the following steps:
determining a plurality of operation authority management nodes with an operation authority control function;
determining a target management node from all the operation authority management nodes;
responding to an operation request of a user node through the target management node;
when the operation rule of the target management node is updated, synchronizing the operation rule to other operation authority management nodes;
when the target management node fails, determining a new target management node from other operation authority management nodes so as to respond to the operation request of the user node through the new target management node.
2. The operation authority control method according to claim 1, wherein the process of determining a new target management node from other operation authority management nodes to respond to the operation request of the user node by the new target management node when the target management node fails comprises:
when the target management node fails, selecting one local operation authority management node with the latest operation rule version from other operation authority management nodes as a new target management node, so as to respond to the operation request of the user node through the new target management node.
3. The operation authority control method according to claim 1, wherein the process of synchronizing the operation rule to other operation authority management nodes when the operation rule of the target management node is updated includes:
and when the operation rule of the target management node is updated, synchronizing the operation rule to the local storage units of other operation authority management nodes.
4. The operation authority control method according to claim 1, wherein the process of responding to the operation request of the user node by the target management node includes:
and adjusting the operation authority of the user node on the big data cluster according to the operation request of the user node through the target management node.
5. The operation authority control method according to any one of claims 1 to 4, wherein after determining a target management node from all the operation authority management nodes, the method further comprises:
broadcasting the target management node to enable the user node to determine a target position of a sending object of the operation request;
correspondingly, after determining a new target management node from the other operation right management nodes, the method further includes:
broadcasting the new target management node to enable the user node to update the target position.
6. The operation authority control method according to claim 5, wherein the operation request includes a first operation request issued by the user node immediately after receiving a user request instruction.
7. The operation authority control method according to claim 6, wherein the operation request further comprises:
and the user node sends the primary operation request and receives the rejection information fed back by the target management node and then sends a secondary operation request.
8. An electronic device, comprising:
a memory for storing a computer program;
processor for implementing the steps of the method for controlling the operation right of a big data cluster according to any of claims 1 to 7 when executing said computer program.
9. A readable storage medium, characterized in that the readable storage medium has stored thereon a computer program which, when being executed by a processor, realizes the steps of the operation right control method for big data clusters according to any one of claims 1 to 7.
10. A big data cluster system, comprising:
a plurality of data storage nodes;
the operation authority management nodes are connected with all the data storage nodes;
one or more user nodes;
the electronic device according to claim 8, connected to both the user node and the plurality of operation right management nodes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210893139.8A CN115242617A (en) | 2022-07-27 | 2022-07-27 | Big data cluster and operation authority control method and related components thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210893139.8A CN115242617A (en) | 2022-07-27 | 2022-07-27 | Big data cluster and operation authority control method and related components thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115242617A true CN115242617A (en) | 2022-10-25 |
Family
ID=83676557
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210893139.8A Pending CN115242617A (en) | 2022-07-27 | 2022-07-27 | Big data cluster and operation authority control method and related components thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115242617A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20120048126A (en) * | 2010-11-05 | 2012-05-15 | 금오공과대학교 산학협력단 | Master redundancy method in ethernet powerlink |
| CN104679796A (en) * | 2013-12-03 | 2015-06-03 | 方正信息产业控股有限公司 | Selecting method, selecting device and database mirror image cluster node |
| CN104702634A (en) * | 2013-12-04 | 2015-06-10 | 腾讯科技（深圳）有限公司 | Method, device and system for processing data operation request |
| CN110050438A (en) * | 2016-12-12 | 2019-07-23 | 华为技术有限公司 | A kind of right management method, relevant device and system |
| CN113904875A (en) * | 2021-12-06 | 2022-01-07 | 湖南宸瀚信息科技有限责任公司 | Multi-chain fusion authority control system based on block chain |
| CN114039848A (en) * | 2021-09-30 | 2022-02-11 | 济南浪潮数据技术有限公司 | Method, device and equipment for realizing high availability of InCloudInsight management platform |
-
2022
- 2022-07-27 CN CN202210893139.8A patent/CN115242617A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20120048126A (en) * | 2010-11-05 | 2012-05-15 | 금오공과대학교 산학협력단 | Master redundancy method in ethernet powerlink |
| CN104679796A (en) * | 2013-12-03 | 2015-06-03 | 方正信息产业控股有限公司 | Selecting method, selecting device and database mirror image cluster node |
| CN104702634A (en) * | 2013-12-04 | 2015-06-10 | 腾讯科技（深圳）有限公司 | Method, device and system for processing data operation request |
| CN110050438A (en) * | 2016-12-12 | 2019-07-23 | 华为技术有限公司 | A kind of right management method, relevant device and system |
| CN114039848A (en) * | 2021-09-30 | 2022-02-11 | 济南浪潮数据技术有限公司 | Method, device and equipment for realizing high availability of InCloudInsight management platform |
| CN113904875A (en) * | 2021-12-06 | 2022-01-07 | 湖南宸瀚信息科技有限责任公司 | Multi-chain fusion authority control system based on block chain |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110428056B (en) | Systems and methods for decentralized machine learning using blockchain | |
| US8621574B2 (en) | Opaque quarantine and device discovery | |
| CN106936899B (en) | Configuration method of distributed statistical analysis system and distributed statistical analysis system | |
| US7886053B1 (en) | Self-management of access control policy | |
| CN108551399B (en) | Service deployment method, system and related device in cloud environment | |
| CN103180842A (en) | Cloud computing system and data synchronization method therefor | |
| CN112019820B (en) | Interface generation method and device | |
| CN105431816A (en) | Synchronizing device association data among computing devices | |
| CN111400777A (en) | Network storage system, user authentication method, device and equipment | |
| CN112333289A (en) | Reverse proxy access method, device, electronic equipment and storage medium | |
| CN112115203A (en) | Asset management method, device, equipment and storage medium of cloud platform | |
| CN113742601A (en) | Content sharing method and device, computer equipment and storage medium | |
| CN113010498B (en) | Data synchronization method, device, computer equipment and storage medium | |
| US11128622B2 (en) | Method for processing data request and system therefor, access device, and storage device | |
| CN111309796B (en) | Data processing method, device and computer readable storage medium | |
| US10439893B2 (en) | Information sharing system | |
| CN113971191A (en) | Data import method and device and computer readable storage medium | |
| CN115242617A (en) | Big data cluster and operation authority control method and related components thereof | |
| CN112380411B (en) | Sensitive word processing method, device, electronic equipment, system and storage medium | |
| CN115391277A (en) | Method, device, equipment and medium for detecting directory capacity quota | |
| CN114564530A (en) | Database access method, device, equipment and storage medium | |
| CN115269530A (en) | Data synchronization method, electronic device and computer-readable storage medium | |
| CN108733805B (en) | File interaction method, system, computer equipment and storage medium | |
| CA2941864A1 (en) | Information processing system | |
| CN113691575A (en) | Communication method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |