CN116339788A - System updating method, device, equipment and storage medium of big data platform - Google Patents
System updating method, device, equipment and storage medium of big data platform Download PDFInfo
- Publication number
- CN116339788A CN116339788A CN202310366081.6A CN202310366081A CN116339788A CN 116339788 A CN116339788 A CN 116339788A CN 202310366081 A CN202310366081 A CN 202310366081A CN 116339788 A CN116339788 A CN 116339788A
- Authority
- CN
- China
- Prior art keywords
- data platform
- big data
- update
- target
- script
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/65—Updates
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/71—Version control; Configuration management
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The embodiment of the application discloses a system updating method of a big data platform, which comprises the following steps: acquiring target information corresponding to configuration parameters to be updated of a big data platform; the target information is updated information of the configuration parameters to be updated; determining a target script corresponding to the target information through a target programming interface; the target programming interface is used for calling scripts of different services in the big data platform; determining an update file package based on a preset update script, target information and a target script; the method comprises the steps that an update script is preset to represent basic processing logic for updating a system of a big data platform; and updating the system of the big data platform based on the update file package. The embodiment of the application also discloses a system updating device, equipment and storage medium of the big data platform.
Description
Technical Field
The present disclosure relates to the field of big data technologies, and in particular, to a method, an apparatus, a device, and a storage medium for updating a system of a big data platform.
Background
At present, a manual processing mode is adopted to upgrade a system of a big data platform; specifically, a developer manually packages information for upgrading a system of a large data platform to obtain an upgrade package, and then manually executes a complex script flow to realize the upgrading of the system of the large data platform. However, the method for manually upgrading the system of the large data platform has the problems of complex operation and long time consumption.
Disclosure of Invention
In order to solve the technical problems, the embodiment of the application expects to provide a system updating method, device, equipment and storage medium of a big data platform, and solves the problems of complicated operation and long time consumption of a method for manually upgrading the system of the big data platform in the related technology.
The technical scheme of the application is realized as follows:
a system update method for a big data platform, the method comprising:
acquiring target information corresponding to configuration parameters to be updated of the big data platform; the target information is updated information of the configuration parameters to be updated;
determining a target script corresponding to the target information through a target programming interface; the target programming interface is used for calling scripts of different services in the big data platform;
determining an update file package based on a preset update script, the target information and the target script; the preset updating script characterizes basic processing logic for updating the system of the big data platform;
and updating the system of the big data platform based on the update file package.
In the above solution, the determining, by the target programming interface, the target script corresponding to the target information includes:
Determining a target service corresponding to the target information;
calling a target script of the target service from scripts corresponding to a plurality of services of the big data platform by adopting a target calling mechanism through the target programming interface; wherein the target call mechanism has the ability to dynamically modify characters in the script.
In the above solution, the determining the update package based on the preset update script, the target information, and the target script includes:
fusion processing is carried out on the target script and the preset updating script, so that a fused script is obtained;
modifying the fused script based on the target information to obtain the execution script;
and packaging the execution script to obtain the updated file package.
In the above solution, the updating the system of the big data platform based on the update file packet includes:
detecting the system environment of the big data platform and determining whether the big data platform meets the updating condition;
under the condition that the big data platform meets the updating condition, backing up the current system configuration file of the big data platform;
And under the condition that the backup is successful, updating the system of the big data platform based on the update file package.
In the above solution, the updating the system of the big data platform based on the update file packet includes:
receiving an update instruction triggered by a user through a user interface of the big data platform;
and starting an update service based on the update instruction to execute the update file package to update the system of the big data platform.
In the above solution, after the update service is started, the method further includes:
detecting the update service and determining whether the update service is abnormal;
setting a service state of the update service as a first state under the condition that the update service is determined to be abnormal;
and setting the service state as a second state under the condition that the update service is not abnormal.
In the above solution, after setting the service state of the update service to the first state, the method further includes:
displaying the first state on the user interface through a target communication mechanism;
receiving a processing instruction aiming at the first state, which is sent by a user through the user interface, through the target communication mechanism;
Executing the last process of the current process in the update service under the condition that the processing instruction represents executing the last operation;
and stopping the updating service and configuring the system of the big data platform based on the system configuration file under the condition that the processing instruction characterizes rollback of the system of the big data platform.
A system updating apparatus for a big data platform, the apparatus comprising:
the acquisition unit is used for acquiring target information corresponding to the configuration parameters to be updated of the big data platform; the target information is updated information of the configuration parameters to be updated;
the processing unit is used for determining a target script corresponding to the target information through a target programming interface; the target programming interface is used for calling scripts of different services in the big data platform;
the processing unit is further used for determining an update file package based on a preset update script, the target information and the target script; the preset updating script characterizes basic processing logic for updating the system of the big data platform;
and the processing unit is also used for updating the system of the big data platform based on the update file package.
A system update apparatus for a large data platform, the apparatus comprising: a processor, a memory, and a communication bus;
the communication bus is used for realizing communication connection between the processor and the memory;
the processor is used for executing the system updating program of the big data platform in the memory so as to realize the steps of the system updating method of the big data platform.
A storage medium storing one or more programs executable by one or more processors to implement the steps of the system update method for a large data platform described above.
The system updating method, device, equipment and storage medium of the big data platform can acquire the target information corresponding to the configuration parameters to be updated of the big data platform, determine the target script corresponding to the target information through the target programming interface, determine the update file package based on the preset update script, the target information and the target script, and update the system of the big data platform based on the update file package; therefore, when the system of the big data platform needs to be updated, only the target information corresponding to the configuration parameters to be updated currently is needed to be determined by a user, the target script corresponding to the target information can be automatically determined, an update file package is obtained based on the target information, the target script and the preset update script, the update of the system of the big data platform is intelligently realized based on the update file package, a developer is not needed to execute a complex script, the operation is simple and convenient, the time consumption is short, the usability is high, and the problems of complex operation and long time consumption in the manual upgrading method of the system of the big data platform in the related art are solved.
Drawings
Fig. 1 is a flow chart of a system updating method of a big data platform according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating another system update method for a big data platform according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating a system update method of another big data platform according to an embodiment of the present application;
fig. 4 is a flowchart of a system updating method of a big data platform according to another embodiment of the present application;
FIG. 5 is a flowchart illustrating a system update method for another big data platform according to another embodiment of the present disclosure;
fig. 6 is a schematic flow chart of refining a flow of an update service in a system update method of a big data platform according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a system updating device of a big data platform according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a system update device of a big data platform according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
It should be appreciated that reference throughout this specification to "an embodiment of the present application" or "the foregoing embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrase "in an embodiment of the present application" or "in the foregoing embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In various embodiments of the present application, the sequence number of each process does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
Without being specifically illustrated, the electronic device may perform any of the steps in the embodiments of the present application, and may be a processor of the electronic device performing the steps. It is further noted that the embodiments of the present application do not limit the order in which the following steps are performed by the electronic device. In addition, the manner in which the data is processed in different embodiments may be the same method or different methods. It should be further noted that any step in the embodiments of the present application may be independently executed by the electronic device, that is, when the electronic device executes any step in the embodiments described below, execution of the other step may not be dependent.
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
The embodiment of the application provides a system updating method of a big data platform, which can be applied to system updating equipment of the big data platform, and is shown by referring to fig. 1, and the method comprises the following steps:
The target information is information after the configuration parameters to be updated are updated.
In the embodiment of the application, the system updating device of the big data platform may be a device where the big data platform is located, and the device may include a user interface, where the user interface is used to interact with a user, so that the user can implement management of updating of the system of the big data platform through the user interface. The configuration parameters to be updated are the configuration parameters to be updated currently of the big data platform, namely the part of information to be modified on the system of the big data platform; the target information is updated information of the configuration parameters to be updated, that is, the current update requirement is to modify the values corresponding to the configuration parameters to be updated into the target information. Generally, the system performance of the large data platform needs to be continuously optimized to improve the system performance of the large data platform. In a possible implementation, the configuration parameter to be updated may be a configuration parameter related to registration, that is, registration change is performed at this time; the registration change may include a change of a database, a change of configuration, a change of Jar package, a change of service, and the like; the change of the database may include a change of a column name, a change of table data, and the like; a change in configuration refers to a change to a configuration for supporting program execution, such as a change to a certain line in a certain configuration file; the changing of the Java archive file (Java Archive File, jar) package refers to changing the Jar package in the current system of the big data platform, for example, the Jar package in the current system of the big data platform can be updated to the latest version; the change of the service refers to the change of the processing logic of the service in the big data platform. For example, if the data in a table needs to be updated, the target information may include a table name, the data in the table that needs to be updated, the updated data, and the like.
In a possible implementation manner, a user may send, through a user interface of the big data platform, target information corresponding to the configuration parameter to be updated, so that the target information may be obtained.
The target programming interface is used for calling scripts of different services in the big data platform.
In the embodiment of the application, the target programming interface can call scripts of different services in the big data platform; in one possible implementation, the target programming interface may be an Ambari application program interface (Ambari Application Programming Interface, ambari API). The target script is a script corresponding to the target information, that is, a script required for modifying the value of the configuration parameter to be updated into the target information; a service refers to a program, routine, or process that performs the system functions of a large data platform.
In one possible implementation, the target script corresponding to the target information may be called from scripts corresponding to multiple services of the big data platform through the Ambari API.
And step 103, determining an update file package based on the preset update script, the target information and the target script.
The preset updating script characterizes basic processing logic for updating a system of the big data platform.
In this embodiment of the present application, the preset update script characterizes basic processing logic for updating the system of the large data platform, in other words, the preset update script is a core flow code preset for implementing updating the system of the large data platform. The update file package is a file package required when updating the big data platform and is used for updating the system of the big data platform; for example, if the target information is to enable upgrades to a system of a large data platform, then the update package herein refers to an upgrade package.
In one possible implementation, the fused script may be obtained based on the target script and a preset update script, and the update package may be obtained based on the fused script and the target information.
And 104, updating the system of the big data platform based on the update file package.
In the embodiment of the present application, if the update package is an update package required for upgrading a system of the large data platform, the system of the large data platform is updated based on the update package, that is, the system of the large data platform is upgraded based on the update package. It should be noted that, updating the system of the large data platform does not only refer to updating the system of the large data platform, but also refers to restoring the system of the large data platform to the system of the previous version, which is not limited in the embodiment of the present application.
According to the system updating method for the big data platform, the preset updating script of the basic processing logic for representing updating the system of the big data platform is preset, so that when the system of the big data platform needs to be updated, only the target information corresponding to the current configuration parameters to be updated is needed to be determined by a user, the target script corresponding to the target information can be automatically determined, an updating file package is obtained based on the target information, the target script and the preset updating script, updating of the system of the big data platform is intelligently achieved based on the updating file package, a developer is not needed to execute complex scripts, operation is simple and convenient, time consumption is short, usability is high, and the problems that operation is complex and time consumption is long in a method for manually updating the system of the big data platform in the related art are solved.
Based on the foregoing embodiments, an embodiment of the present application provides a system updating method for a big data platform, referring to fig. 2, the method includes the following steps:
The target information is information after the configuration parameters to be updated are updated.
In the embodiment of the application, generally, updating the system of the large data platform involves services of multiple system functions, so that a target service which needs to be invoked when updating the system of the large data platform currently needs to be determined according to target information.
In one possible implementation manner, the big data platform includes multiple configuration parameters, and multiple services corresponding to each configuration parameter can be predetermined and stored, so that after the target information is obtained, the target service corresponding to the target information can be determined based on the type of the configuration parameter corresponding to the target information.
The target calling mechanism has the capability of dynamically modifying characters in the script; the target programming interface is used for calling scripts of different services in the big data platform.
In the embodiment of the application, the target calling mechanism has the capability of dynamically modifying the characters in the script, and in one possible implementation manner, the target calling mechanism may be a Python reflection mechanism, that is, a target script that uses Python reflection mechanism to call the target service, and dynamically modifies the characters in the target script. When updating the system of the big data platform, a script needs to be written to update the data in the database, such as an object profile (JavaScript Object Notation, json) structure of the stored workflow, and a corresponding script of a plurality of services needs to be called to write the script to update the data in the database so as to adapt to the latest version of code logic, so that the method is needed.
And 204, the system updating equipment of the big data platform performs fusion processing on the target script and the preset updating script to obtain a fused script.
The preset updating script characterizes processing logic for updating a system of the big data platform.
In the embodiment of the application, the fused script is obtained by fusing the target script and the preset updating script, and the fused script is a code obtained by embedding the target script into the preset updating script, namely, a universal updating code for updating a system of a large data platform and service codes of a plurality of services involved in the updating process are fused and nested, so that function logic of different stages is realized through Upgrade class in uppgrad.
And 205, modifying the fused script by the system updating equipment of the big data platform based on the target information to obtain an execution script.
In the embodiment of the application, the execution script is core code for updating a system of a big data platform. Modifying the fused script based on the target information, namely writing the information to be updated currently into a code through an upper layer input class parameter so as to update the system of the big data platform; for example, the upper layer incoming parameters may include from_version indicating environmental information before upgrade, package_version indicating package version information, and common_utels indicating tool class information.
And 206, the system updating equipment of the big data platform performs packaging processing on the execution script to obtain an updating file package.
In the embodiment of the application, the update failure condition exists when the system of the big data platform is updated based on the update file package, so that the update file package can be obtained by packing the target information and the execution script, and a developer can quickly acquire the updated information at the time and quickly read and locate the reason of the update failure. It should be noted that, steps 201 to 206 are all implemented by the system update device of the big data platform, and the operation of acquiring the update package is intelligently implemented.
In the embodiment of the application, the update condition may include whether the memory and the storage space of the system are enough, whether the system is safe, whether a garbage file exists in the target, and the like; the system environment of the big data platform is detected to ensure the safety and stability of updating.
In the embodiment of the application, the current system configuration file of the big data platform is backed up, so that the system can be quickly restored under the condition that a problem occurs in the upgrading process.
As shown in fig. 3, the overall architecture of the system updating method of the big data platform provided in the embodiment of the present application includes two parts: an update package creation module (studio-update-pack) and an update service module (studio-update-server); the studio-upgrade-pack is used for making an update file package, and comprises core processing logic for determining the update file package and a packaging program for the update file package; the studio-upgrade-server is a running background process and is responsible for executing and scheduling the update package and interacting with the user interface. Specifically, when a developer performs registration change, determining target information corresponding to configuration parameters to be updated of the big data platform, then, after receiving the target information, system updating equipment of the big data platform makes an update file packet based on the target information (namely change information) through a studio-upgrade-pack, uploads the update file packet through the studio-upgrade-server, executes the update file packet, monitors the process of executing the update file packet, and can know the update condition at any time.
As shown in fig. 4, the interaction flow of the system update method of the big data platform provided in the embodiment of the present application includes four stages: preparing an update file package, detecting environment, configuring backup and updating (including updating and rollback); when preparing the update package, the process of making the update package can be displayed on the user interface for the user to check.
The operation of upgrading the system of the big data platform by using the system updating method of the big data platform provided by the embodiment of the application can be that; as shown in fig. 5, in the upgrade preparation stage, determining target information corresponding to configuration parameters to be updated of the big data platform, making an upgrade package based on the target information, displaying the upgrade package on a user interface, and uploading the upgrade package after a user determines to select the upgrade package, wherein the upgrade package can be internally re-uploaded in case of failure in uploading; under the condition that uploading is successful, entering an environment detection stage; in the environment detection stage, the system automatically enters an upgrade maintenance mode to detect the system environment of the big data platform, and the environment can be directly re-detected under the condition that the environment detection fails, or the environment is re-detected after the detection problem is treated; under the condition that the environment detection is successful, entering a backup configuration stage; in the backup configuration stage, the current system configuration file is backed up, and when the backup fails, the backup can be internally re-backed up; under the condition that the backup is successful, entering an upgrading stage; in the upgrading stage, upgrading the system of the big data platform based on the upgrading packet, and under the condition that the upgrading is successful, exiting an upgrading maintenance mode; in case of a problem in the upgrading process, the upgrading can be retried internally; if the system is unreliable, such as network connection failure, component starting failure, etc., the upgrade is retried internally, and if the upgrade package is in problem, the upgrade is stopped, and the upgrade failure is determined; under the condition of failure of upgrading, entering a system rollback stage; in a system rollback stage, rolling back the system based on a system configuration file, and under the condition that the rollback is successful, exiting an upgrade maintenance mode; upon a rollback failure request, the rollback may be internally retried after handling the rollback problem, and in the event that the system configuration file is corrupted, the rollback is aborted, determining that the rollback failed.
Step 209 may be implemented by:
step 209a, the system update device of the big data platform receives an update instruction triggered by the user through the user interface of the big data platform.
In this embodiment of the present application, a message indicating that the update package has been completed is displayed on the user interface, and the user determines whether to continue updating the system of the large data platform, so that step 209b may be performed after receiving an update instruction triggered by the user through the user interface of the large data platform.
In step 209b, the system update device of the big data platform starts an update service based on the update instruction to execute the update package to implement the update of the system of the big data platform.
In the embodiment of the application, the update service is used for executing the update file package so as to update the system of the big data platform.
In other embodiments of the present application, after the update service is started in step 209b, the following steps are further performed:
and step A, detecting the update service by the system update equipment of the big data platform, and determining whether the update service is abnormal or not.
In the embodiment of the application, the update service is detected to determine whether the update service is abnormal, that is, whether the update service operates normally, and the update service is detected to be beneficial to the management of the update process by the user.
After step a, step B or step G may be performed.
And B, under the condition that the update service is determined to be abnormal, setting the service state of the update service as a first state by the system update equipment of the big data platform.
Wherein the first state characterizes an update service suspension.
In the embodiment of the application, the first state represents that the update service is suspended; the update service is suspended, and the update service is characterized as not operating normally, namely the update service is abnormal currently.
In one possible implementation manner, the system environment and the update file package of the big data platform can be analyzed to determine the target reason of the abnormality of the update service; setting the service state of the update service as a first state under the condition that the target reason represents that the update file packet is wrong; and restarting the updating service under the condition that the target reasons represent unreliable systems such as network connection abnormality, component connection abnormality and the like of the big data platform.
And C, displaying the first state and the target reason on a user interface by the system updating equipment of the big data platform through a target communication mechanism.
The target communication mechanism is used for realizing interaction between a user and a background process of the big data platform through a user interface in the process of updating the system of the big data platform.
In the embodiment of the application, the target communication mechanism is used for realizing interaction between a user and a background process of the big data platform through a user interface in the process of updating the system of the big data platform so as to realize fine granularity control of updating service; in one possible implementation, the target communication mechanism may be in a file form, and the target communication mechanism may also be in another inter-process communication manner or an intra-process communication manner, which is not limited in this embodiment of the present application.
In the interactive flow shown in fig. 4, the control granularity of the update flow is four stages of preparing an update file package, detecting environment, configuring backup and updating; if the upgrade fails, the whole upgrade process needs to be re-executed; therefore, in order to further refine the control granularity of the update flow, a communication mode, that is, a target communication mode, needs to be added between the front-end framework and the background process so as to display the service state of the update service on the user interface for the user to check and determine the next operation.
In a possible implementation manner, if the target communication mechanism is in a file form, displaying the first state on the user interface through the target communication mechanism, that is, displaying the first state in a file form, for example, characters or numbers corresponding to each service state of the update service may be preset, for example, 0 indicates that the service state of the update service is normal, 1 indicates that the service state of the update service is suspended, 2 indicates that the system of the large data platform is rolled back, 3 indicates that the previous operation is executed again, and each service state and corresponding numbers of the update service may be stored in a stat description file for the user to view; thus, the service state of the update service can be embodied through numbers; for example, the first state may be embodied in a stat state file, where the file name of the stat state file is stat, and a number corresponding to the service state of the current update service is stored in the file; if the service state of the update service is the first state, the stat status file holds 1 to inform the user that there is an abnormality in the current update service, and the update service is suspended, and the next operation is indicated.
And D, the system updating equipment of the big data platform receives a processing instruction aiming at the first state, which is sent by a user through a user interface, through a target communication mechanism.
In the embodiment of the application, the processing instruction is a processing operation on the first state; the processing instruction may be an instruction to re-execute the last operation or to rollback the system of the large data platform. In one possible implementation, if the user's processing instruction to the first state is to re-execute the previous operation, then number 3 representing the re-execution of the previous operation may be stored in a stat state file and sent to a background process; if the user's processing instruction for the first state is a rollback, then number 2, representing a rollback of the system for the large data platform, may be stored in a stat state file and sent to a background process.
It should be noted that, after step D, step E or step F may be performed.
And E, under the condition that the processing instruction characterizes and executes the last operation, the system updating equipment of the big data platform executes the last process of the current process in the updating service.
In the embodiment of the application, if the background program determines that the processing instruction is to execute the previous operation through the stat status file, then executing the previous process of the current process in the update service.
And F, under the condition that the processing instruction characterizes rollback of the system of the big data platform, stopping updating service by the system updating equipment of the big data platform and configuring the system of the big data platform based on the system configuration file.
In the embodiment of the application, if the background program determines that the processing instruction is to roll back the system of the big data platform through the stat state file, the update service is stopped, the update file is deleted, the system of the big data platform is configured based on the system configuration file, and the system of the big data platform is restored to the state before being updated.
As shown in fig. 6, after the update service is started, the plurality of services corresponding to the update service are traversed, the plurality of services are started, and whether each service is normally operated is checked, in the case that the service is not normally operated, the service state of the update service is set to 1 according to the stat description file, the service state is stored in the stat state file, the stat state file is sent to the user interface, the user determines the next operation, if the user determines to re-execute the previous operation, the number 3 representing the re-execution of the previous operation can be stored in the stat state file and sent to the background process; if the user determines to roll back the system of the large data platform, then number 2, which represents the roll back of the system of the large data platform, may be stored in a stat status file and sent to the background process.
And G, setting the service state as a second state by the system updating equipment of the big data platform under the condition that the updating service is not abnormal.
Wherein the second state characterizes a normal operation of the update service.
In the embodiment of the application, the second state represents that the update service normally operates; the update service operates normally, and the fact that the update service is not abnormal at present is characterized.
It should be noted that, in this embodiment, the descriptions of the same steps and the same content as those in other embodiments may refer to the descriptions in other embodiments, and are not repeated here.
According to the system updating method for the big data platform, the preset updating script of the basic processing logic for representing updating the system of the big data platform is preset, so that when the system of the big data platform needs to be updated, only the target information corresponding to the current configuration parameters to be updated is needed to be determined by a user, the target script corresponding to the target information can be automatically determined, an updating file package is obtained based on the target information, the target script and the preset updating script, updating of the system of the big data platform is intelligently achieved based on the updating file package, a developer is not needed to execute complex scripts, operation is simple and convenient, time consumption is short, usability is high, and the problems that operation is complex and time consumption is long in a method for manually updating the system of the big data platform in the related art are solved.
Based on the foregoing embodiments, the present application provides a system updating device of a large data platform, where the system updating device of a large data platform may be applied to the system updating method of a large data platform provided in the corresponding embodiment of fig. 1 and 2, and referring to fig. 7, the system updating device 3 of a large data platform may include:
acquiring target information corresponding to configuration parameters to be updated of a big data platform; the target information is updated information of the configuration parameters to be updated;
determining a target script corresponding to the target information through a target programming interface; the target programming interface is used for calling scripts of different services in the big data platform;
determining an update file package based on a preset update script, target information and a target script; the method comprises the steps that an update script is preset to represent basic processing logic for updating a system of a big data platform;
and updating the system of the big data platform based on the update file package.
In other embodiments of the present application, the processing unit 32 is specifically configured to perform the following steps:
determining a target service corresponding to the target information;
calling a target script of a target service from scripts corresponding to a plurality of services of a big data platform by a target programming interface through a target calling mechanism; wherein the target call mechanism has the ability to dynamically modify characters in the script.
In other embodiments of the present application, the processing unit 32 is specifically configured to perform the following steps:
carrying out fusion processing on the target script and a preset updating script to obtain a fused script;
modifying the fused script based on the target information to obtain an execution script;
and packaging the target information and the execution script to obtain an updated file package.
In other embodiments of the present application, the processing unit 32 is specifically configured to perform the following steps:
detecting the system environment of the big data platform and determining whether the big data platform meets the updating condition;
under the condition that the big data platform meets the updating condition, the current system configuration file of the big data platform is backed up;
and under the condition that the backup is successful, updating the system of the big data platform based on the update file package.
In other embodiments of the present application, the processing unit 32 is specifically configured to perform the following steps:
receiving an update instruction triggered by a user through a user interface of a big data platform;
and starting an update service based on the update instruction to execute the update file package to update the system of the big data platform.
In other embodiments of the present application, the processing unit 32 is specifically further configured to perform the following steps:
Detecting the update service and determining whether the update service is abnormal;
setting the service state of the update service as a first state under the condition that the update service is determined to be abnormal;
in the case where it is determined that there is no abnormality in the update service, the service state is set to the second state.
In other embodiments of the present application, the processing unit 32 is specifically configured to perform the following steps:
displaying the first state on a user interface through a target communication mechanism;
receiving a processing instruction aiming at a first state, which is sent by a user through a user interface, through a target communication mechanism;
under the condition that the processing instruction represents that the previous operation is re-executed, re-executing the previous process of the current process in the update service;
in the event that the processing instructions characterize rollback of the system of the large data platform, the update service is stopped and the system of the large data platform is configured based on the system configuration file.
It should be noted that, in the system updating method of the big data platform provided by the embodiments corresponding to fig. 1 and 2, specific descriptions of steps executed by each unit may be omitted here.
According to the system updating device for the big data platform, the preset updating script of the basic processing logic for representing the updating of the system of the big data platform is preset, so that when the system of the big data platform needs to be updated, only the target information corresponding to the current configuration parameters to be updated is needed to be determined by a user, the target script corresponding to the target information can be automatically determined, an updating file package is obtained based on the target information, the target script and the preset updating script, the updating of the system of the big data platform is intelligently realized based on the updating file package, a developer is not needed to execute complex scripts, the operation is simple and convenient, the consumed time is short, the usability is high, and the problems that the operation is complex and the consumed time is long in a method for manually updating the system of the big data platform in the related technology are solved.
Based on the foregoing embodiments, the embodiments of the present application provide a system update device of a large data platform, where the system update device of a large data platform may be applied to the system update method of a large data platform provided in the corresponding embodiments of fig. 1 and 2, and referring to fig. 8, the system update device 4 of a large data platform may include: a processor 41, a memory 42 and a communication bus 43, wherein:
a communication bus 43 for enabling a communication connection between the processor 41 and the memory 42;
the processor 41 is configured to execute a system update program of the big data platform in the memory 42 to implement the following steps:
the acquisition unit is used for acquiring target information corresponding to the configuration parameters to be updated of the big data platform; the target information is updated information of the configuration parameters to be updated;
the processing unit is used for determining a target script corresponding to the target information through the target programming interface; the target programming interface is used for calling scripts of different services in the big data platform;
the processing unit is also used for determining an update file package based on a preset update script, target information and a target script; the method comprises the steps that an update script is preset to represent basic processing logic for updating a system of a big data platform;
And the processing unit is also used for updating the system of the big data platform based on the update file package.
In other embodiments of the present application, the processor 41 is configured to execute a target script corresponding to the target information through a target programming interface of a system update program of a big data platform in the memory 42, so as to implement the following steps:
determining a target service corresponding to the target information;
calling a target script of a target service from scripts corresponding to a plurality of services of a big data platform by a target programming interface through a target calling mechanism; wherein the target call mechanism has the ability to dynamically modify characters in the script.
In other embodiments of the present application, the processor 41 is configured to execute a system update program of the big data platform in the memory 42 to determine an update package based on a preset update script, target information, and target script, so as to implement the following steps:
carrying out fusion processing on the target script and a preset updating script to obtain a fused script;
modifying the fused script based on the target information to obtain an execution script;
and packaging the execution script to obtain an updated file package.
In other embodiments of the present application, the processor 41 is configured to execute a system update program of a large data platform in the memory 42 to update a system of the large data platform based on an update file package, so as to implement the following steps:
Detecting the system environment of the big data platform and determining whether the big data platform meets the updating condition;
under the condition that the big data platform meets the updating condition, the current system configuration file of the big data platform is backed up;
and under the condition that the backup is successful, updating the system of the big data platform based on the update file package.
In other embodiments of the present application, the processor 41 is configured to execute a system update program of a large data platform in the memory 42 to update a system of the large data platform based on an update file package, so as to implement the following steps:
receiving an update instruction triggered by a user through a user interface of a big data platform;
and starting an update service based on the update instruction to execute the update file package to update the system of the big data platform.
In other embodiments of the present application, the processor 41 is configured to execute a startup update service of a system update program of a large data platform in the memory 42, and may further implement the following steps:
detecting the update service and determining whether the update service is abnormal;
setting the service state of the update service as a first state under the condition that the update service is determined to be abnormal;
In the case where it is determined that there is no abnormality in the update service, the service state is set to the second state.
In other embodiments of the present application, the service state of the setting update service of the system update program of the large data platform used by the processor 41 to execute in the memory 42 is the first state, and the following steps may be implemented:
displaying the first state on a user interface through a target communication mechanism; the target communication mechanism is used for realizing interaction between the user interface and a background process of the big data platform in the process of updating the system of the big data platform;
receiving a processing instruction aiming at a first state, which is sent by a user through a user interface, through a target communication mechanism;
executing the last process of the current process in the update service under the condition that the processing instruction represents executing the last operation;
in the event that the processing instructions characterize rollback of the system of the large data platform, the update service is stopped and the system of the large data platform is configured based on the system configuration file.
It should be noted that, the specific implementation manner of the steps executed by the processor may refer to the description in the system updating method of the big data platform provided in the embodiment corresponding to fig. 1 and 2, which is not repeated herein.
According to the system updating equipment of the big data platform, the preset updating script of the basic processing logic for representing the updating of the system of the big data platform is preset, so that when the system of the big data platform needs to be updated, only the target information corresponding to the current configuration parameters to be updated is needed to be determined by a user, the target script corresponding to the target information can be automatically determined, an updating file package is obtained based on the target information, the target script and the preset updating script, the updating of the system of the big data platform is intelligently realized based on the updating file package, a developer is not needed to execute complex scripts, the operation is simple and convenient, the consumed time is short, the usability is high, and the problems of complex operation and long consumed time in a method for manually updating the system of the big data platform in the related technology are solved.
Based on the foregoing embodiments, embodiments of the present application provide a storage medium storing one or more programs executable by one or more processors to implement the steps of the system updating method of the big data platform provided in the corresponding embodiments of fig. 1 and 2.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the present application.
Claims (10)
1. A system updating method for a big data platform, the method comprising:
acquiring target information corresponding to configuration parameters to be updated of the big data platform; the target information is updated information of the configuration parameters to be updated;
Determining a target script corresponding to the target information through a target programming interface; the target programming interface is used for calling scripts of different services in the big data platform;
determining an update file package based on a preset update script, the target information and the target script; the preset updating script characterizes basic processing logic for updating the system of the big data platform;
and updating the system of the big data platform based on the update file package.
2. The method according to claim 1, wherein the determining, through a target programming interface, a target script corresponding to the target information includes:
determining a target service corresponding to the target information;
calling a target script of the target service from scripts corresponding to a plurality of services of the big data platform by adopting a target calling mechanism through the target programming interface; wherein the target call mechanism has the ability to dynamically modify characters in the script.
3. The method of claim 1, wherein the determining an update package based on a preset update script, the target information, and the target script comprises:
Fusion processing is carried out on the target script and the preset updating script, so that a fused script is obtained;
modifying the fused script based on the target information to obtain the execution script;
and packaging the execution script to obtain the updated file package.
4. A method according to any one of claims 1 to 3, wherein updating the system of the big data platform based on the update package comprises:
detecting the system environment of the big data platform and determining whether the big data platform meets the updating condition;
under the condition that the big data platform meets the updating condition, backing up the current system configuration file of the big data platform;
and under the condition that the backup is successful, updating the system of the big data platform based on the update file package.
5. The method of claim 4, wherein updating the system of the large data platform based on the update package comprises:
receiving an update instruction triggered by a user through a user interface of the big data platform;
and starting an update service based on the update instruction to execute the update file package to update the system of the big data platform.
6. The method of claim 5, further comprising, after the initiating the update service:
detecting the update service and determining whether the update service is abnormal;
setting a service state of the update service as a first state under the condition that the update service is determined to be abnormal;
and setting the service state as a second state under the condition that the update service is not abnormal.
7. The method of claim 6, wherein after setting the service state of the update service to the first state, further comprising:
displaying the first state on the user interface through a target communication mechanism;
receiving a processing instruction aiming at the first state, which is sent by a user through the user interface, through the target communication mechanism;
executing the last process of the current process in the update service under the condition that the processing instruction represents executing the last operation;
and stopping the updating service and configuring the system of the big data platform based on the system configuration file under the condition that the processing instruction characterizes rollback of the system of the big data platform.
8. A system updating apparatus for a large data platform, the apparatus comprising:
the acquisition unit is used for acquiring target information corresponding to the configuration parameters to be updated of the big data platform; the target information is updated information of the configuration parameters to be updated;
the processing unit is used for determining a target script corresponding to the target information through a target programming interface; the target programming interface is used for calling scripts of different services in the big data platform;
the processing unit is further used for determining an update file package based on a preset update script, the target information and the target script; the preset updating script characterizes basic processing logic for updating the system of the big data platform;
and the processing unit is also used for updating the system of the big data platform based on the update file package.
9. A system update apparatus for a large data platform, the apparatus comprising: a processor, a memory, and a communication bus;
the communication bus is used for realizing communication connection between the processor and the memory;
the processor is configured to execute a system update program of a big data platform in the memory to implement the steps of the system update method of a big data platform according to any of claims 1 to 7.
10. A storage medium storing one or more programs executable by one or more processors to implement the steps of the system update method of a big data platform according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310366081.6A CN116339788A (en) | 2023-03-30 | 2023-03-30 | System updating method, device, equipment and storage medium of big data platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310366081.6A CN116339788A (en) | 2023-03-30 | 2023-03-30 | System updating method, device, equipment and storage medium of big data platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116339788A true CN116339788A (en) | 2023-06-27 |
Family
ID=86889318
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310366081.6A Pending CN116339788A (en) | 2023-03-30 | 2023-03-30 | System updating method, device, equipment and storage medium of big data platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116339788A (en) |
-
2023
- 2023-03-30 CN CN202310366081.6A patent/CN116339788A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1705566A1 (en) | Server system and online software update method | |
| USRE41162E1 (en) | Method for providing scaleable restart and backout of software upgrades for clustered computing | |
| US7908521B2 (en) | Process reflection | |
| US7774636B2 (en) | Method and system for kernel panic recovery | |
| CN106940699B (en) | Synchronous processing method, device, server and system for memory data | |
| US7779302B2 (en) | Automated testing framework for event-driven systems | |
| CN104809045B (en) | Running method and device of monitoring script | |
| JPH0812616B2 (en) | Passive recovery method and system for operating system kernel | |
| US6205561B1 (en) | Tracking and managing failure-susceptible operations in a computer system | |
| CN116339788A (en) | System updating method, device, equipment and storage medium of big data platform | |
| EP4097593A1 (en) | Firmware corruption recovery | |
| CN113296822B (en) | Online upgrading method and system for database system based on dynamic library | |
| CN112416394B (en) | Service upgrading method and device, storage medium and electronic equipment | |
| CN114385504A (en) | Development and debugging method and device for microservice application | |
| JP2000330778A (en) | Method and device for restoration after correction load module replacement | |
| CN114791900A (en) | Operator-based Redis operation and maintenance method, device, system and storage medium | |
| CN114020530A (en) | Automatic factory backup method and system for operating system | |
| CN113656063A (en) | System version replacing method, device, equipment and computer readable medium | |
| CN114115958A (en) | Program starting method and terminal equipment | |
| US9081727B2 (en) | Method, apparatus and computer program for loading files during a boot-up process | |
| CN113515291A (en) | Equipment online upgrading method and device | |
| CN112231231A (en) | Method, system and device for debugging cloud service | |
| CN113094280B (en) | Upgrade method, system, and readable storage medium | |
| CN115454762A (en) | System monitoring and upgrading method, electronic device and computer readable storage medium | |
| JPH08234968A (en) | Program execution management system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |