CN112463171A - Client installation method based on big data platform and electronic equipment - Google Patents
Client installation method based on big data platform and electronic equipment Download PDFInfo
- Publication number
- CN112463171A CN112463171A CN202011182908.0A CN202011182908A CN112463171A CN 112463171 A CN112463171 A CN 112463171A CN 202011182908 A CN202011182908 A CN 202011182908A CN 112463171 A CN112463171 A CN 112463171A
- Authority
- CN
- China
- Prior art keywords
- client
- request
- cluster
- installation
- big data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000009434 installation Methods 0.000 title claims abstract description 67
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000012795 verification Methods 0.000 claims abstract description 37
- 230000004044 response Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 6
- 238000004806 packaging method and process Methods 0.000 claims description 5
- 230000006870 function Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 3
- 240000000797 Hibiscus cannabinus Species 0.000 description 2
- 235000002905 Rumex vesicarius Nutrition 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/61—Installation
Abstract
The invention provides a client installation method based on a big data platform, electronic equipment and a storage medium, belongs to the technical field of big data, and solves the technical problems that in the prior art, a big data platform client can only be used in a node in a cluster and has a small use range. The method comprises the following steps: acquiring a request sent by a client; the request head of the request comprises a command type input by a user; obtaining an authentication mode from a metadata center; verifying the request according to the authentication mode; if the verification is successful, sending an installation file to the client according to the request; and if the verification fails, generating verification failure information and sending the verification failure information to the client.
Description
Technical Field
The invention relates to the technical field of big data, in particular to a client installation method and device based on a big data platform, electronic equipment and a storage medium.
Background
In the big data era, more and more companies and units apply big data technology to process massive information to assist the business development. However, the big data components are numerous and interdependent, so the operation and maintenance work is very complicated, and the difficulty of applying big data technology by enterprises is increased. The open source project Ambari promoted by Hortonworks corporation has the functions of cluster automatic installation, centralized management, cluster monitoring, alarming and the like, can excellently complete the management function of a big data platform, and reduces the use threshold of a big data technology. However, the big data platform based on the open-source Ambari has a disadvantage that the downloading function of the component client can only be used on the nodes in the cluster, and in an actual production environment, only an administrator or operation and maintenance personnel can directly operate the servers in the cluster for the stability and data security of the cluster.
Disclosure of Invention
The invention aims to provide a client installation method, a client installation device, electronic equipment and a storage medium based on a big data platform, and solves the technical problem that a client can only be used in a cluster node in the prior art.
In a first aspect, the present invention provides a client installation method based on a big data platform, which is applied to a management node in a cluster, and the method includes the following steps:
acquiring a request sent by a client; the request head of the request comprises a command type input by a user;
obtaining an authentication mode from a metadata center;
verifying the request according to the authentication mode;
if the verification is successful, sending an installation file to the client according to the request;
and if the verification fails, generating verification failure information and sending the verification failure information to the client. ,
further, the command types comprise a download command and an update command;
the step of sending the installation file to the client according to the request specifically includes:
if the command type is updating, acquiring the latest configuration file of the response client in the cluster and transmitting the latest configuration file to the client;
and if the command type is downloading, transmitting the installation package and the latest configuration file of the response client to the client.
Further, the authentication mode includes normal authentication and advanced authentication.
Further, the step of verifying the request according to the authentication manner specifically includes:
if the authentication mode is common authentication, acquiring verification information from the metadata center, and performing matching verification on the user information in the request header and the user information in the metadata center;
and if the authentication mode is high-level authentication, verifying the KDC data center according to the user information and the file parameters in the request header.
Further, the file parameters comprise a principal file parameter and a keytab file parameter.
In a second aspect, the present invention further provides a client installation method based on a big data platform, which is applied to clients outside a cluster, and the method includes the following steps:
acquiring a command input by a user;
analyzing the command type and packaging the command type into a request header of a request;
sending the request information to a management node in the cluster, so that the management node verifies the request according to the authentication mode;
and receiving the installation file or the verification failure information from the management node.
Further, the command includes: client name, cluster address, user information;
the step of sending the request information to the management node in the cluster further comprises:
adjusting an environment variable according to the cluster address;
and confirming the accessed management node according to the adjusted environment variable and the cluster address.
Further, after the step of obtaining the latest configuration file in the cluster and packaging and transmitting the latest configuration file to the client, the method further includes:
acquiring a latest configuration file;
placing the configuration file in a corresponding component client installation directory;
alternatively, the first and second electrodes may be,
acquiring an installation package and a latest configuration file;
and installing the installation package responding to the component client and placing the configuration file in the installation directory of the responding component client.
In a third aspect, the present invention further provides an electronic device, including a memory and a processor, where the memory stores a computer program operable on the processor, and the processor implements the steps of any one of the above methods when executing the computer program.
In a fourth aspect, the invention also provides a computer readable storage medium having stored thereon machine executable instructions which, when invoked and executed by a processor, cause the processor to perform the method of any of the above.
According to the client installation method based on the big data platform, the client outside the cluster firstly acquires an authentication mode from a metadata center after a management node receives request information by sending the request; and verifying, sending an installation package or a configuration update file to the client after verification is passed, and finally realizing installation in the client, so that the current situation that the client can only be used in the cluster node in the current situation is changed, the service efficiency of the client is improved, and the common working efficiency, the stability of the cluster and the data safety are improved.
Accordingly, the electronic device and the computer-readable storage medium provided by the embodiment of the invention also have the technical effects.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart of a client installation method based on a big data platform and applied to a management node in a cluster according to an embodiment of the present invention;
fig. 2 is a flowchart of a client installation method based on a big data platform and applied to a client outside a cluster according to an embodiment of the present invention;
fig. 3 is a detailed flowchart of a client installation method based on a big data platform according to an embodiment of the present invention.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "comprising" and "having," and any variations thereof, as referred to in embodiments of the present invention, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention provides a client installation method based on a big data platform, which is applied to a management node in a cluster, and as shown in figure 1, the method comprises the following steps:
s11: acquiring a request sent by a client; the request head of the request comprises a command type input by a user;
s12: obtaining an authentication mode from a metadata center;
s13: verifying the request according to the authentication mode, if the verification is successful, executing the step S4, otherwise, executing the step S15;
s14: sending an installation file to the client according to the request;
s15: and generating verification failure information and sending the verification failure information to the client.
Correspondingly, an embodiment of the present invention further provides a client installation method based on a big data platform, which is applied to a client outside a cluster, as shown in fig. 2, the method includes the following steps:
s21: acquiring a command input by a user;
s22: analyzing the command type and packaging the command type into a request header of a request;
s23: sending the request information to a management node in the cluster, so that the management node verifies the request according to the authentication mode;
s24: and receiving the installation file or the verification failure information from the management node.
According to the client installation method based on the big data platform, the client outside the cluster firstly acquires an authentication mode from a metadata center after a management node receives request information by sending the request; and verifying, sending an installation package or a configuration update file to the client after verification is passed, and finally realizing installation in the client, so that the current situation that the client can only be used in the cluster node in the current situation is changed, the service efficiency of the client is improved, and the common working efficiency, the stability of the cluster and the data safety are improved.
In one possible embodiment, the command types include a download command and an update command;
the step S14 specifically includes:
s141: judging the request type, if the request type is updating, executing step S142, and if the request type is downloading, executing step S143;
s142: acquiring the latest configuration file of a response client in the cluster and transmitting the latest configuration file to the client;
s143: and transmitting the installation package and the latest configuration file of the response client to the client.
And by judging the request type, the management node sends the corresponding installation file to the client, so that an accurate installation file is provided for the user.
In one possible implementation, the authentication means includes normal authentication and advanced authentication.
In a possible implementation manner, the step S13 specifically includes:
s131: judging the authentication mode, if the authentication mode is normal authentication, executing step S132, if the authentication mode is advanced authentication, executing step S133;
s132: acquiring verification information from a metadata center, and performing matching verification on user information in a request header and user information in the metadata center;
s133: and verifying the KDC data center according to the user information in the request header and the file parameters.
The authentication modes are different, the corresponding authentication standards are also different, and the system can improve the safety of the management node according to the corresponding authentication modes.
In one possible embodiment, the file parameters include a principal file parameter and a keytab file parameter.
The file can provide authentication parameters when the authentication mode is advanced authentication, so that the client side can pass the authentication smoothly.
In one possible embodiment, the command includes: client name, cluster address, user information;
the step S23 is preceded by:
s231: adjusting an environment variable according to the cluster address;
s232: and confirming the accessed management node according to the adjusted environment variable and the cluster address.
According to the adjustment of the environment variable parameters and the cluster addresses, the corresponding environment variables of the component client sides can be automatically switched according to the configuration files of different clusters, and therefore the function that one set of component client sides accesses a plurality of sets of clusters is achieved.
In a possible implementation manner, after the step S142, the method further includes:
s241: acquiring a latest configuration file;
s242: placing the configuration file in a corresponding component client installation directory;
alternatively, the first and second electrodes may be,
s243: acquiring an installation package and a latest configuration file;
s244: and installing the installation package responding to the component client and placing the configuration file in the installation directory of the responding component client.
After receiving the corresponding file, the client installs the corresponding file into the client according to the received file, thereby achieving the purpose of installation at the client.
As shown in fig. 3, a specific implementation of the client installation method based on the big data platform according to the embodiment of the present invention is as follows:
s301: a user inputs a request at a client;
the user can install the component client individually or in batches, or update the configuration of the component client individually or in batches.
S302: the client sends the request and the verification information to a management node in the cluster;
the client analyzes the user command and packages the parameters into a request header, and then sends a download request to the server.
S303: acquiring a verification mode, if the verification mode is a normal verification mode, executing a step S304, and if the verification mode is an advanced verification mode, executing a step S305;
the step is completed by the management node, and the management node firstly accesses the metadata center of the cluster to acquire the authentication mode after receiving the request.
S304: matching the user information in the metadata center according to the user information in the request header, if the user information passes the verification, executing a step S307, otherwise, executing a step S306;
s305: authenticating the KDC in the cluster according to the user information in the request header, if the authentication is passed, executing step S307, otherwise executing step S306;
the steps are verification steps, and subsequent steps can be executed after verification is passed, so that the safety of the system is improved.
S306: sending verification failure information to the client;
after the verification fails, the management node does not respond to the command of the client and only makes error reporting information.
S307: judging the type of the request, if the request is an update S308, executing the step, and if the request is a download S309;
the request types are updating and downloading, the respective transmission files are different, and the management node sends different files to the client according to the request types.
S308: acquiring the latest configuration file of the response client in the cluster, transmitting the latest configuration file to the client, and executing the step S310;
s309: transmitting the installation package and the latest configuration file of the responding client to the client and executing the step S311;
the two steps are the step of sending the installation file to the client.
S310: the client acquires the latest configuration file and executes step S312;
s311: the client acquires the installation package and the latest configuration file, and executes step S313;
after receiving the installation file, the client executes the subsequent steps to install the installation file.
S312: placing the configuration file in a corresponding component client installation directory;
s313: and installing the installation package responding to the component client and placing the configuration file in the installation directory of the responding component client.
The received installation files are different, namely the request types are different, and the installation methods are also different; for the downloaded command, if the client is not installed, the installation package needs to be installed first to configure the update file, and only the configuration update file needs to be installed during updating.
S314: the client receives authentication failure information.
Corresponding to the method, an embodiment of the present invention further provides an electronic device, including a memory and a processor, where the memory stores a computer program operable on the processor, and the electronic device is characterized in that the processor implements the steps of the method when executing the computer program.
In accordance with the above method, embodiments of the present invention also provide a computer readable storage medium storing machine executable instructions, which when invoked and executed by a processor, cause the processor to perform the steps of the above method.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; and the modifications, changes or substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention. Are intended to be covered by the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A client installation method based on a big data platform is applied to a management node in a cluster, and comprises the following steps:
acquiring a request sent by a client; the request head of the request comprises a command type input by a user;
obtaining an authentication mode from a metadata center;
verifying the request according to the authentication mode;
if the verification is successful, sending an installation file to the client according to the request;
and if the verification fails, generating verification failure information and sending the verification failure information to the client.
2. The client installation method of the big data platform according to claim 1, wherein the command types include a download command and an update command;
the step of sending the installation file to the client according to the request specifically includes:
if the command type is updating, acquiring the latest configuration file of the response client in the cluster and transmitting the latest configuration file to the client;
and if the command type is downloading, transmitting the installation package and the latest configuration file of the response client to the client.
3. The big data platform-based client installation method according to claim 1, wherein the authentication means includes normal authentication and advanced authentication.
4. The big data platform-based client installation method according to claim 3, wherein the step of verifying the request according to the authentication manner specifically comprises:
if the authentication mode is common authentication, acquiring verification information from the metadata center, and performing matching verification on the user information in the request header and the user information in the metadata center;
and if the authentication mode is high-level authentication, verifying the KDC data center according to the user information and the file parameters in the request header.
5. The big-data-platform-based client installation method according to claim 4, wherein the file parameters include a principal file parameter and a keytab file parameter.
6. A client installation method based on a big data platform is applied to clients outside a cluster, and comprises the following steps:
acquiring a command input by a user;
analyzing the command type and packaging the command type into a request header of a request;
sending the request information to a management node in the cluster, so that the management node verifies the request according to the authentication mode;
and receiving the installation file or the verification failure information from the management node.
7. The big data platform-based client installation method according to claim 6, wherein the command comprises: client name, cluster address, user information;
the step of sending the request information to the management node in the cluster further comprises:
adjusting an environment variable according to the cluster address;
and confirming the accessed management node according to the adjusted environment variable and the cluster address.
8. The big data platform-based client installation method according to claim 6, wherein the step of obtaining the response client after the latest configuration file in the cluster and packaging and transmitting to the client further comprises:
acquiring a latest configuration file;
placing the configuration file in a corresponding component client installation directory;
alternatively, the first and second electrodes may be,
acquiring an installation package and a latest configuration file;
and installing the installation package responding to the component client and placing the configuration file in the installation directory of the responding component client.
9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program operable on the processor, and wherein the processor implements the steps of the method of any of claims 1 to 8 when executing the computer program.
10. A computer readable storage medium having stored thereon machine executable instructions which, when invoked and executed by a processor, cause the processor to execute the method of any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011182908.0A CN112463171A (en) | 2020-10-29 | 2020-10-29 | Client installation method based on big data platform and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011182908.0A CN112463171A (en) | 2020-10-29 | 2020-10-29 | Client installation method based on big data platform and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112463171A true CN112463171A (en) | 2021-03-09 |
Family
ID=74834657
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011182908.0A Withdrawn CN112463171A (en) | 2020-10-29 | 2020-10-29 | Client installation method based on big data platform and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112463171A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114443066A (en) * | 2021-12-24 | 2022-05-06 | 苏州浪潮智能科技有限公司 | Client installation method and device for big data cluster and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107025409A (en) * | 2017-06-27 | 2017-08-08 | 中经汇通电子商务有限公司 | A kind of data safety storaging platform |
| US20170353444A1 (en) * | 2016-06-06 | 2017-12-07 | Illumina, Inc. | Tenant-aware distributed application authentication |
| CN107818268A (en) * | 2017-11-15 | 2018-03-20 | 中国联合网络通信集团有限公司 | The access control method and server of big data platform |
| CN110839014A (en) * | 2019-10-12 | 2020-02-25 | 平安科技（深圳）有限公司 | Authentication method, device, computer system and readable storage medium |
-
2020
- 2020-10-29 CN CN202011182908.0A patent/CN112463171A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170353444A1 (en) * | 2016-06-06 | 2017-12-07 | Illumina, Inc. | Tenant-aware distributed application authentication |
| CN107025409A (en) * | 2017-06-27 | 2017-08-08 | 中经汇通电子商务有限公司 | A kind of data safety storaging platform |
| CN107818268A (en) * | 2017-11-15 | 2018-03-20 | 中国联合网络通信集团有限公司 | The access control method and server of big data platform |
| CN110839014A (en) * | 2019-10-12 | 2020-02-25 | 平安科技（深圳）有限公司 | Authentication method, device, computer system and readable storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114443066A (en) * | 2021-12-24 | 2022-05-06 | 苏州浪潮智能科技有限公司 | Client installation method and device for big data cluster and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Nikitin et al. | {CHAINIAC}: Proactive {Software-Update} transparency via collectively signed skipchains and verified builds | |
| US11856106B2 (en) | Secure configuration of a device | |
| JP7322176B2 (en) | Version history management using blockchain | |
| CN109726099B (en) | Application gray level publishing method, device and equipment | |
| EP2550769B1 (en) | System and method for remote maintenance of multiple clients in an electronic network using virtual machines | |
| US11327745B2 (en) | Preventing falsification in version management | |
| CN109791633A (en) | Use the static state and dynamic device profile prestige of machine learning based on cloud | |
| US8099588B2 (en) | Method, system and computer program for configuring firewalls | |
| CN112527912B (en) | Data processing method and device based on block chain network and computer equipment | |
| WO2007054129A1 (en) | A system for maintaining data | |
| CN107294924B (en) | Vulnerability detection method, device and system | |
| CN110990335B (en) | Log archiving method, device, equipment and computer readable storage medium | |
| WO2017124736A1 (en) | Method, device and system for transmitting upgrade abnormality information | |
| CN111176677B (en) | Server system reinforcement updating method and device | |
| CN112463171A (en) | Client installation method based on big data platform and electronic equipment | |
| CN114826660A (en) | Cloud service operation method, electronic device and storage medium | |
| CN111124591A (en) | Mirror image transmission method and device, electronic equipment and storage medium | |
| CN111835504B (en) | Identification code generation method and server | |
| KR101320680B1 (en) | Method and apparatus for integrity check of software | |
| CN111538566A (en) | Mirror image file processing method, device and system, electronic equipment and storage medium | |
| WO2015120756A1 (en) | Method and device for identifying security of application process | |
| US20200364192A1 (en) | Efficient and automatic database patching using elevated privileges | |
| CN114416106B (en) | Method, system, electronic device and storage medium for updating compiling count value | |
| US11765155B1 (en) | Robust and secure updates of certificate pinning software | |
| CN115470472A (en) | Object control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210309 |
|
| WW01 | Invention patent application withdrawn after publication |