CN116540942A - Migration method and system of data storage object, electronic equipment and storage medium - Google Patents

Migration method and system of data storage object, electronic equipment and storage medium Download PDF

Info

Publication number
CN116540942A
CN116540942A CN202310513159.2A CN202310513159A CN116540942A CN 116540942 A CN116540942 A CN 116540942A CN 202310513159 A CN202310513159 A CN 202310513159A CN 116540942 A CN116540942 A CN 116540942A
Authority
CN
China
Prior art keywords
migration
storage
script
information
migrated
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310513159.2A
Other languages
Chinese (zh)
Inventor
张骞
邓强
迟爽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202310513159.2A priority Critical patent/CN116540942A/en
Publication of CN116540942A publication Critical patent/CN116540942A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647—Migration mechanisms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/242—Query formulation
    • G06F16/2433—Query languages
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/60—Software deployment
    • G06F8/65—Updates
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/70—Software maintenance or management
    • G06F8/71—Version control; Configuration management
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a migration method, a migration system, electronic equipment and a storage medium of a data storage object, and relates to the technical field of big data or other related fields, wherein the migration method comprises the following steps: under the condition that the storage object to be migrated meets the preset migration condition, responding to a storage migration instruction, and migrating the storage object to be migrated from a source disk to a target storage disk by adopting a migration script; after all objects have completed migration, the source disk is deleted in the source disk volume group by the agent. The invention solves the technical problem that extra replacement resources are needed to be input in the storage migration replacement process in the related technology.

Description

Migration method and system of data storage object, electronic equipment and storage medium
Technical Field
The present invention relates to the field of big data technologies, and in particular, to a migration method, a migration system, an electronic device, and a storage medium for a data storage object.
Background
Currently, a large number of computer systems use centralized storage or distributed storage to store system or application data to achieve better performance, higher availability, greater scalability, etc., but storage devices may age (performance decreases, failure rate increases) beyond a life cycle, and a storage manufacturer may stop supporting (e.g., spare parts are stopped, failure cannot be repaired) old model products, so that storage used by the computer systems needs to be replaced in time, otherwise, serious consequences such as shutdown and even data loss may be caused.
In the related art, there are four general methods for storage migration replacement. Firstly, the data is imported after the environment is rebuilt, namely, a set of replacement environment is set up by arranging new resources, and the data synchronization is carried out by using a backup recovery mode; secondly, the original environment performs data synchronization by building a standby machine, and the method also needs to input extra replacement resources, and needs to run a database on the environment and support the main and standby synchronization; thirdly, after stopping the application, copying the data, namely directly copying the data in the system, wherein in order to avoid the change of the source data in the copying process, the application operation needs to be stopped, and if the data volume is large or the number of files is too large, long application downtime is caused, and external service cannot be realized; the fourth method is to make data synchronization by using the functional characteristics of the storage device, that is, to make data copying by using the data synchronization function of the cross-disk drive commonly provided in the disk drive on the market, and although the method has no influence on the application operation in the copying process, short downtime is required in replacement storage, and in addition, the inter-disk drive synchronization function is generally limited in purchasing additional authorized permissions and supporting brand models of the disk drive, which has a great limitation.
From the above, it can be seen that the storage migration replacement method in the related art generally has the problems of application shutdown and additional resource investment, and meanwhile, the migration process generally needs more manual operation and information verification, and once an operation error or an information error occurs, irreversible serious consequences such as data damage are very easy to cause.
In view of the above problems, no effective solution has been proposed at present.
Disclosure of Invention
The embodiment of the invention provides a migration method, a migration system, electronic equipment and a storage medium of a data storage object, which at least solve the technical problem that extra replacement resources are required to be input in the storage migration replacement process in the related technology.
According to an aspect of the embodiment of the present invention, there is provided a migration method of a data storage object, applied to a pre-deployed agent tool of each target node of an operating system, the migration method including: under the condition that the storage object to be migrated meets the preset migration condition, responding to a storage migration instruction, and migrating the storage object to be migrated from a source disk to a target storage disk by adopting a migration script; and deleting the source disk in the source disk volume group through the agent tool after all the objects are migrated.
Optionally, before checking that the storage object to be migrated meets the preset migration condition, the method further includes: after deploying the agent on any one of the target nodes of the operating system, scanning the operating system by the agent to obtain system version information, storage product information and database information; and sorting the system version information, the storage product information and the database information into system environment information of the operating system, and transmitting the system environment information to an information base of a service management end, wherein the information base of the service management end determines the migration script required in the process of migrating the storage object based on the system environment information.
Optionally, after the system environment information is transmitted to the information base of the service management end, the method further includes: receiving a script version comparison result returned by the information base of the service management end; and under the condition that the script version comparison result indicates that the script version stored in the information base is inconsistent with the script version of the migration script in the agent tool, responding to a script update instruction, and updating the script version of the migration script stored in the agent tool in advance to the latest version.
Optionally, in response to a storage migration instruction, the step of migrating the storage object to be migrated from the source disk to the target storage disk by using a migration script includes: under the condition that the database information indicates that the database uses an automatic storage management function, the target storage disk is constructed as an automatic storage node, and the automatic storage node is added into a preset storage management disk group; and migrating the storage object to be migrated from a source disk to the automatic storage node by adopting the migration script.
Optionally, before checking that the storage object to be migrated meets the preset migration condition, the method includes: receiving a migration condition checking instruction transmitted by a service management end, wherein the migration condition checking instruction is used for checking whether a storage object to be migrated meets the preset migration condition; responding to the migration condition inspection instruction, and calling a preset inspection script; scanning the source disk volume group and the target storage disk in the operating system through the preset checking script to obtain the number of blocks of the historical storage blocks, the block capacity of each historical storage block, the number of blocks of the free storage blocks and the block capacity of each free storage block, which are associated with the storage object to be migrated, in the source disk volume group; comparing the block number of the history storage blocks with the block number of the idle storage blocks to obtain a first comparison result, and comparing the block capacity of the history storage blocks with the block capacity of the idle storage blocks to obtain a second comparison result; and determining that the storage object to be migrated meets a preset migration condition under the condition that the first comparison result indicates that the number of the blocks of the idle storage block is larger than that of the historical storage block and the second comparison result indicates that the block capacity of the idle storage block is larger than that of the historical storage block.
Optionally, in response to a storage migration instruction, the step of migrating the storage object to be migrated from the source disk to the target storage disk by using a migration script includes: in the migration process, grabbing the current migration progress and the migration state according to the preset period duration; and under the condition that the migration state is normal, sending the current migration progress to a service management end in a designated progress form.
Optionally, after grabbing the current migration progress and the migration status according to the preset period duration, the method includes: and under the condition that the migration state is abnormal or interrupted, feeding back failure of the migration task and error report log information to the information base of the service management end.
According to another aspect of the embodiment of the present invention, there is also provided a migration system for a data storage object, including: the user terminal interface is used for receiving at least one migration task, wherein the migration task is used for indicating migration of the storage object to be migrated; the agent tool is deployed in each target node of the operating system, and when the storage object to be migrated is verified to meet the preset migration condition, the agent tool responds to a storage migration instruction and migrates the storage object to be migrated from a source disk to a target storage disk by adopting a migration script; and deleting the source disk in the source disk volume group through the agent tool after all the objects are migrated.
Optionally, the user terminal interface includes: the migration triggering module is used for providing a display page for the user terminal and receiving the migration task triggered by the display page; the result display module displays the migration progress and the migration result of the storage object to be migrated; the migration condition checking module is used for checking the migration conditions in the migration task, displaying the checking result whether the migration conditions are met in the user terminal or not and updating the checking result to the information base of the service management end; and the historical task retrieval module is used for receiving a task query request of the user terminal and retrieving a migration execution log and a migration result of the historical migration task in response to the query request.
Optionally, the migration system of the data storage object further includes a service management end, where the service management end includes: the information base stores system information of all operating systems where the agent tool is deployed, judging results of whether preset migration conditions are met, all scripts and script attributes, migration execution logs of all historical migration tasks and migration results, wherein all scripts comprise: migration script and checking script; and the progress monitoring module records the migration progress and/or the migration result transmitted by the agent tool to the information base, and displays the migration progress and/or the migration result on a display interface of the user terminal.
Optionally, the service management end further includes: the instruction module is used for sending various instructions to the agent tool, wherein the various instructions comprise: storing migration instructions, script updating instructions and migration condition checking instructions.
Optionally, the agent tool includes: the communication module is used for receiving various instructions and forwarding the instructions to the corresponding module according to the instruction types, wherein the corresponding module comprises: the system comprises an information grabbing module, a scheduler module and a script management module; the information grabbing module is used for grabbing system version information, storage product information and database information of an operating system, calling a source disk volume group and a target storage disk in a preset checking script scanning operating system after receiving a migration condition checking instruction transmitted by a service management end, comparing the number of blocks of a history storage block with the number of blocks of an idle storage block, and comparing the block capacity of the history storage block with the block capacity of the idle storage block to determine whether the storage object to be migrated meets preset migration conditions; the script management module stores all scripts and script attributes according to the directory structure and updates the scripts; and the scheduler module is used for calling the migration script after receiving the storage migration instruction, selecting a migration flow according to the system environment information, and scheduling and executing the migration task according to the migration flow.
According to another aspect of the embodiment of the present invention, there is further provided a computer readable storage medium, where the computer readable storage medium includes a stored computer program, and when the computer program runs, the device where the computer readable storage medium is controlled to execute the migration method of any item of data storage object described above.
According to another aspect of the embodiment of the present invention, there is also provided an electronic device, including one or more processors and a memory, where the memory is configured to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement a migration method of any item of data storage object described above.
In the method, a proxy tool which can be deployed in advance through each target node of an operating system responds to a storage migration instruction under the condition that a storage object to be migrated meets a preset migration condition, a migration script is adopted to migrate the storage object to be migrated from a source disk to the target storage disk, and after all objects are migrated, the source disk is deleted in a source disk volume group through the proxy tool.
In the method, the agent tool can be directly deployed at each node of the operating system, and the storage objects in the system are migrated without additional replacement resources, so that the efficiency and the automation degree of storage migration replacement are effectively improved, and the technical problem that additional replacement resources are required to be input in the storage migration replacement process in the related technology is solved.
Meanwhile, in the method, under the condition of continuous application, the corresponding relation of new and old storages can be automatically generated and checked, data migration is initiated, the migration progress is monitored, the old storages are automatically unloaded after the completion, the migration result is notified to operation and maintenance personnel, the automatic migration is completed by using a deployed agent tool, the interference to upper-layer business can be avoided, the application can always serve outside, and the method is suitable for implementing the migration in an environment with high business connectivity requirements.
In the method, the agent tool can complete migration operations such as information grabbing, script updating, condition checking, responding to migration instructions, migration scheduling management, automatic playing of old storage and the like in a full-automatic mode, manual misoperation is avoided, the automation degree is high, and meanwhile, a disk-level data copying mode is adopted, so that the method has more advantages in speed compared with other modes.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiments of the invention and together with the description serve to explain the invention and do not constitute a limitation on the invention. In the drawings:
FIG. 1 is a flow chart of an alternative method of migration of data storage objects according to an embodiment of the invention;
FIG. 2 is a schematic diagram of an alternative data storage object migration system in accordance with an embodiment of the present invention;
FIG. 3 is a schematic diagram of an alternative agent according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of an alternative service manager according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of an alternative user interface according to an embodiment of the invention;
FIG. 6 is a flow chart of an alternative method of online automated migration storage in accordance with an embodiment of the present invention;
FIG. 7 is a schematic diagram of another alternative data storage object migration system in accordance with an embodiment of the present invention;
fig. 8 is a block diagram of a hardware architecture of an electronic device (or mobile device) for a migration method of data storage objects according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
To facilitate an understanding of the invention by those skilled in the art, some terms or nouns involved in the various embodiments of the invention are explained below:
ASM, automatic storage management, automatic storage management, is a tool for managing magnetic disks, can realize striping, mirror image data files, recovery files and the like among a plurality of physical devices, and the files are distributed in all magnetic disks of a magnetic disk group in a balanced way according to distribution units.
Oracle, a relational database management system with a distributed database as a core, has a complete data management function, and can realize distributed processing of data.
SQL structured query language is a structured query language for operating databases, including creating databases, deleting databases, querying records, modifying records, adding fields, etc
ETL, extract transform load, data warehouse technology, describes the process of extracting, converting, and finally loading data from a source to a destination.
MySQL, relational database management system, relational databases store data in different tables, rather than placing all data in one large data warehouse.
It should be noted that, the migration method and system of the data storage object in the present disclosure may be used in the case of migrating the data storage object in the technical field of big data, and may also be used in any field other than the technical field of big data, where the migration method and system of the data storage object in the present disclosure are not limited in application field.
It should be noted that, related information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present disclosure are information and data authorized by a user or sufficiently authorized by each party, and the collection, use and processing of related data need to comply with related laws and regulations and standards of related countries and regions, and be provided with corresponding operation entries for the user to select authorization or rejection. For example, an interface is provided between the system and the relevant user or institution, before acquiring the relevant information, the system needs to send an acquisition request to the user or institution through the interface, and acquire the relevant information after receiving the consent information fed back by the user or institution.
The following embodiments of the present invention are applicable to a variety of systems/applications/devices for migrating data storage objects. According to the invention, the agent tool (also expressed as an agent program) is deployed on the object system to be migrated, and the agent tool can complete migration operations such as information capture, script updating, condition verification, response to migration instructions, migration scheduling management, automatic old storage kicking and the like in a full-automatic manner, so that manual misoperation is avoided, the automation degree is high, and the migration speed is high.
Meanwhile, when the data object migration is realized, the disk-level data copying mode is used, and compared with other modes, the speed is more advantageous.
The migration method and the migration system for the data storage object are simple in architecture, can support various Linux or Unix operating systems and Oracle databases, can automatically generate and verify the corresponding relation of new and old storages under the condition of no stop application, initiate data migration, monitor and display migration progress, automatically unload the old storages after completion and inform operation and maintenance personnel of migration results, and realize online automatic migration storage.
In the migration process of the data storage object by using the migration method, the method does not need to stop application, the mode of completing automatic migration by using the deployment agent tool does not cause interference to upper-layer business, ensures that the application can always perform external service, is suitable for the environment with high business contact requirement to perform migration, can effectively improve the efficiency and the automation degree of storage migration replacement, realizes the continuity of the application to external service in the migration process, and has important significance for units with high business continuity requirements such as finance, securities and the like.
Meanwhile, aiming at a new operating system or storage, the invention can be brought into a compatible range only by compiling, inputting and adding the applicable script and command into an instruction module for management, has strong expandability, can support various operating systems and has wide universality.
The present invention will be described in detail with reference to the following examples.
Example 1
According to an embodiment of the present invention, there is provided an embodiment of a migration method of data storage objects, it should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is illustrated in the flowcharts, in some cases the steps illustrated or described may be performed in an order different from that herein.
FIG. 1 is a flow chart of an alternative method of migration of data storage objects, as shown in FIG. 1, according to an embodiment of the invention, the method comprising the steps of:
step S101, under the condition that the storage object to be migrated is checked to meet the preset migration condition, responding to a storage migration instruction, and adopting a migration script to migrate the storage object to be migrated from a source disk to a target storage disk.
Step S102, deleting the source disk in the source disk volume group through the agent tool after all the objects are migrated.
Through the steps, under the condition that the storage objects to be migrated are checked to meet the preset migration conditions through the agent tool which is deployed in advance by each target node of the operating system, the storage objects to be migrated are migrated from the source disk to the target storage disk by adopting the migration script in response to the storage migration instruction, and after all objects are migrated, the source disk is deleted in the source disk volume group through the agent tool. In the embodiment, the agent tool can be directly deployed at each node of the operating system, and the storage objects in the system are migrated without additional replacement resources, so that the efficiency and the automation degree of storage migration replacement are effectively improved, and the technical problem that the additional replacement resources are required to be input in the storage migration replacement process in the related technology is solved.
Embodiments of the present invention will be described in detail with reference to the following steps.
In the embodiment of the invention, the migration method of the data storage object is applied to the agent tool, so that the agent tool needs to be deployed on the target node of the operating system where the storage object to be migrated is located before starting the migration action.
It should be noted that the agent may be a piece of agent, which is a software-based solution, typically transparent to the user, running in the background and monitoring network traffic, forwarding instructions or requests to other components in the system, which may perform various tasks.
The agent tool is deployed on an operating system where an object to be migrated is located, and comprises a communication module, an information grabbing module, a script management module and a dispatcher module.
The main function of the communication module is to receive the instruction and forward the instruction to other functional modules, and send the system environment information (such as operating system version, used storage brand type, whether or not there is an Oracle database using ASM) and migration progress status obtained by agent tool scanning to the service management end; the information grabbing module has the functions of grabbing system environment information, and scanning the number and capacity of blocks of the new and old storage blocks; the script management module is used for providing and updating related scripts according to received script requirements; the function of the scheduler module is to select proper migration flow to perform scheduling execution according to different requirements, and periodically grasp the migration state and report to the service management end.
When the communication module works, the instruction can be forwarded to the corresponding module according to the instruction type of the following table 1.
Table 1 instruction forwarding module mapping table
The functional modules are matched with each other according to preset logic to jointly complete migration tasks received by agent tools deployed on an operating system.
Optionally, after deploying the agent on any target node of the operating system, scanning the operating system by the agent to obtain system version information, stored product information and database information; and the system version information, the storage product information and the database information are arranged into system environment information of an operating system, and the system environment information is transmitted to an information base of a service management end, wherein the information base of the service management end determines migration scripts required in the process of migrating the storage objects based on the system environment information.
The operating system where the storage object to be migrated according to the embodiment of the present invention is located includes, but is not limited to: linux or Unix operating systems.
It should be noted that there are a variety of operating system version information, and the following list several common operating system version information: 1, windows system versions such as Windows 10, windows 8.1, windows 7, etc.; 2, macOS system versions such as macOS Big Sur, macOS Catalina, macOS Mojave, etc.; 3, linux system versions such as Ubuntu, fedora, debian, etc.; 4, android system versions such as Android 11, android 10, android Pie and the like; 5, iOS/iPadOS system versions such as iOS14/iPad OS14, iOS13/iPad OS13, etc. The present embodiment does not specifically limit which operating system the agent is deployed on.
It should be noted that the storage product information may include brand information of the storage product used by the operating system, for example, kingston, seagate, western Digital, samsung, and the like.
It should be noted that the database information includes, but is not limited to: whether there is an Oracle database using ASM, a database name, a database version number, a table name/collection name, a field name/attribute name, index information (e.g., index type, index field), trigger information (e.g., trigger type, trigger event, executive), definitions of stored procedures and functions, and the like.
After the agent tool is deployed, the system environment information of the operating system of the environment where the agent tool is located is automatically scanned and checked, and the collected information is uploaded and registered into an information base of the service management end.
Optionally, after transmitting the system environment information to the information base of the service management end, the method further includes: receiving a script version comparison result returned by the information base of the service management end; and under the condition that the script version stored in the script version comparison result indication information base is inconsistent with the script version of the migration script in the agent tool, responding to the script updating instruction, and updating the script version of the migration script stored in the agent tool in advance to the latest version.
The information base provides the system nodes of the full quantity of deployed agents and migration related information thereof for the user terminal interface, and selects corresponding related scripts to be compared with the scripts in the script management module according to the environment information of the newly registered agents so as to provide the corresponding related scripts for subsequent processes. And according to the script version comparison result returned from the information base, responding to a script updating instruction, and updating the related low-version scripts in the agent tool to the latest.
It should be noted that, the information stored in the information base of the service management end further includes: information of all operating systems of the agent tool, whether storage migration conditions are satisfied, all scripts and attributes thereof, execution logs of all migration tasks, and result logs are installed.
Step S101, under the condition that the storage object to be migrated is checked to meet the preset migration condition, responding to a storage migration instruction, and adopting a migration script to migrate the storage object to be migrated from a source disk to a target storage disk.
Optionally, in response to the storage migration instruction, the step of migrating the storage object to be migrated from the source disk to the target storage disk by using the migration script includes: under the condition that the database information indicates that the database uses an automatic storage management function, constructing a target storage disk as an automatic storage node, and adding the automatic storage node into a preset storage management disk group; and migrating the storage object to be migrated from the source disk to the automatic storage node by adopting a migration script.
It should be noted that, the script types of the migration script may include, but are not limited to: 1, SQL script, is used for creating database and table, insert data operation; an ETL script for migrating data from one system to another, e.g., an ETL tool can extract data from an Oracle library and load it into a MySQL library; a batch script for executing command line operations and automatically executing a series of tasks, such as Linux shell script, windows batch file, etc.; 4, a data backup and restore script, which often requires the backup and restore of all or part of the data of the current system when upgrading, so as to prevent the occurrence of the loss or error; configuration file modification and migration scripts, these types of migration scripts are required when configuration needs to be changed by deploying new applications, web servers or domain name services, etc.
The user terminal can increase, update and delete various scripts in the information base and update versions thereof according to requirements to realize the purpose of optimizing migration. For a new operating system or storage, a new type directory can be added in the information base, and related scripts and commands can be added to obtain the support for storage migration.
Optionally, before checking that the storage object to be migrated meets a preset migration condition, a pre-check needs to be performed on the migration condition that whether migration can be performed, including: receiving a migration condition checking instruction transmitted by a service management end, wherein the migration condition checking instruction is used for checking whether a storage object to be migrated meets a preset migration condition or not; responding to a migration condition inspection instruction, and calling a preset inspection script; scanning a source disk volume group and a target storage disk in an operating system through a preset checking script to obtain the number of blocks of historical storage blocks, the block capacity of each historical storage block, the number of blocks of idle storage blocks in the target storage disk and the block capacity of each idle storage block, wherein the historical storage blocks are associated with storage objects to be migrated in the source disk volume group; comparing the block number of the historical storage blocks with the block number of the idle storage blocks to obtain a first comparison result, and comparing the block capacity of the historical storage blocks with the block capacity of the idle storage blocks to obtain a second comparison result; and determining that the storage object to be migrated meets the preset migration condition under the condition that the first comparison result indicates that the number of the blocks of the idle storage blocks is larger than that of the historical storage blocks and the second comparison result indicates that the block capacity of the idle storage blocks is larger than that of the historical storage blocks.
It should be noted that, a volume group refers to a logical unit formed by a plurality of disks or storage units, which can improve capacity and performance of a file system, and implement load balancing by distributing data over a plurality of physical devices, which are typically managed by a controller and can be used to access a part or all of the disks contained therein.
The source disk volume group of this embodiment includes all source disks to which each of the storage objects to be migrated belongs.
In the process of checking the migration condition, a user terminal can select one or more objects on a page to trigger the migration condition check, a service management end splits a check instruction into sub-instructions aiming at a single object, and forwards the sub-instructions to agent programs on each target node through a message bus; after each agent receives the inspection instruction, the information grabbing module of the agent invokes the relevant inspection script to execute inspection; judging whether the migration condition is met according to the migration condition checking result, if not, summarizing the non-met items into an information base and displaying the non-met items to a user through a user terminal interface; and if so, allowing triggering to execute the subsequent migration operation.
It should be noted that, the storage migration instruction in this embodiment may be triggered by the user terminal, where the user terminal selects one or more objects meeting the migration condition on the page to trigger the storage migration operation, and the service management end splits the storage migration instruction/migration start instruction into sub-instructions for a single object, and forwards the sub-instructions to the agent tools on each target node through the message bus. And after receiving the storage migration instruction/migration starting instruction, each agent tool calls the related migration script to execute storage migration.
Optionally, in response to the storage migration instruction, the step of migrating the storage object to be migrated from the source disk to the target storage disk by using the migration script includes: in the migration process, grabbing the current migration progress and the migration state according to the preset period duration; and under the condition that the migration state is normal, the current migration progress is sent to the service management end in a designated progress form.
In the migration process, the agent tool periodically captures the current migration progress and then sends the current migration progress to the service management end in a designated progress form, wherein the designated progress form comprises, but is not limited to: the percentage form, the graphic form and the table form are displayed to a user through a user terminal interface.
Optionally, after grabbing the current migration progress and the migration status according to the preset period duration, the method includes: and under the condition that the migration state is abnormal or interrupted, feeding back failure of the migration task and error report log information to an information base of the service management end.
Aiming at the storage migration process, if abnormal conditions such as migration interruption occur, task failure and error report log information are fed back to a service management end input information base and are displayed to a user through a user terminal interface. If the migration is successful, the migration result and the log of the whole migration process are fed back to the service management end-in information base and are displayed to the user through the user terminal interface.
Optionally, for the migration result, a visual interface can be displayed, so that the user can visually see the execution results of all tasks and related logs or errors, and simultaneously support the user to review the historical migration log recorded in the information base, and summarize and analyze the experience of success or failure of the previous migration.
Step S102, deleting the source disk in the source disk volume group through the agent tool after all the objects are migrated.
Through the embodiment, the agent tool can be deployed on the object system to be migrated, and the agent tool can complete migration operations such as information grabbing, script updating, condition checking, responding to migration instructions, migration scheduling management, automatic old storage kicking and the like in a full-automatic mode, so that manual misoperation is avoided, the automation degree is high, and the migration speed is high.
The following detailed description is directed to alternative embodiments.
The embodiment of the invention provides a method for supporting automatic online migration of various storages used by Linux, unix operating systems and Oracle databases by deploying an agent program (corresponding to the agent tool) on a migration object system.
FIG. 2 is a schematic diagram of an alternative migration system for data storage objects, according to an embodiment of the present invention, as shown in FIG. 2, the migration system comprising: agent 201 (schematically illustrated in fig. 2 as 2011, 2012..201 n), service manager 202, message bus 203, user interface 204.
It should be noted that, the agent is deployed on the operating system where the object to be migrated is located; the service management end is responsible for managing all agent programs, acquiring registration information thereof, issuing various instructions to the agent programs, managing update instruction scripts and the like; the message bus is responsible for forwarding instructions and messages between the service management end and the agent program, has different queues to support large-scale deployment of the agent program and forwarding of instruction messages, and does not cause communication blockage.
FIG. 3 is a schematic diagram of an alternative agent deployed on an operating system node where an object to be migrated is located, as shown in FIG. 3, according to an embodiment of the present invention, the agent comprising: a communication module 301, an information capture module 302, a script management module 303 and a scheduler module 304.
The communication module 301 includes: 1, receiving an instruction sent by the message bus 203, forwarding the instruction to different modules according to the instruction type, and 2, sending the local environment information and the migration progress state acquired by the information grabbing module to the message bus 203.
It should be noted that, according to the instruction type of the instruction sent by the message bus, the instruction is forwarded to different modules, specifically, according to different functional contents pointed by the instruction, the instruction is forwarded to the module capable of implementing the function.
For example, the communication module receives the instruction 1, recognizes that the instruction type is an instruction for checking environment information, and the function is to check version information of an operating system deployed by the agent program, a type of a storage brand used, whether to use an asam Oracle database, and the module for implementing the above function is an information capturing module, so after receiving the instruction, the communication module 301 forwards the instruction to the information capturing module to implement the function.
Similar instructions also include:
the instruction 2 is a checking instruction before migration, and the function is to check whether a migration precondition is met or not, wherein the migration precondition comprises the number of blocks stored newly and old, the block capacity and the like, and the communication module forwards the instruction 2 to the information grabbing module to realize the function;
the instruction 3 is of a migration starting instruction type, and the function is to call a script to start storage migration work and report migration progress regularly, and the communication module forwards the instruction 3 to the scheduler module to realize the function;
and the instruction 4 is of a script updating instruction type, the function is to update script content, and the communication module forwards the instruction 4 to the script management module to realize the function.
The information capturing module 302 has main functions including: 1, capturing version information of an operating system, a used storage brand type and an Oracle database (function of an instruction 1) with or without ASM as registration information/system environment information, and reporting the registration information/system environment information to a service management end through a message bus; and 2, after receiving a pre-migration checking instruction (corresponding to the instruction 2) sent by the message bus, scanning the number of blocks, the size capacity of each block, the number and the size of ASM discs and the like which are identified in the system, comparing the pre-migration conditions, sending the result whether the result meets the migration conditions to the message bus, and forwarding the result to the service management end by the message bus.
Script management module 303, functions including: 1, storing migration scripts and attributes thereof required by all supported operating systems, multipath software, databases and the like of different types according to a directory structure, providing related scripts according to operation requirements of an information grabbing module and a scheduler module, 2, receiving script updating instructions forwarded by a communication module, and adding, deleting and modifying the scripts according to requirements of the script updating instructions.
The scheduler module 304, the main functions include: 1, after receiving a storage migration instruction, calling a related script to trigger a storage migration action, and selecting a proper migration flow to schedule and execute step by step according to the combination of different types of operating systems, storage brands and databases; and 2, periodically grabbing the current migration state, sending the current migration state to the message bus in a percentage form, forwarding and reporting to the service management end, and forming a final result and reporting to the service management end through the message bus when migration is completed or abnormal interruption occurs.
Fig. 4 is a schematic diagram of an alternative service management end according to an embodiment of the present invention, as shown in fig. 4, the service management end includes: a communication module 401, an information base 402, a progress monitoring module 403 and an instruction module 404.
The communication module 401 includes: 1, receiving registration information/system environment information, a check result before migration, a migration progress, a migration result and the like sent by a message bus; and 2, sending various instructions to the message bus.
Information repository 402, functions include: 1, storing all system information of an installed agent program, and judging whether a storage migration item is satisfied; 2, storing all scripts and attributes thereof; and 3, storing execution and result logs of all migration tasks.
Progress monitoring module 403, functions including: 1, recording migration progress/results sent by an agent program into an information base, and further displaying the migration progress/results on a visual interface of a user interface; and 2, displaying the in-transit or history migration task logs/results which are called from the information base by the user terminal on a visual interface of the user interface.
The instruction module 404 is used for sending various instructions to the agent program to realize different functions.
FIG. 5 is a schematic illustration of an alternative user interface, as shown in FIG. 5, according to an embodiment of the invention, comprising: a migration condition checking module 501, a migration triggering module 502, a progress showing module 503 and a historical task retrieval module 504.
The migration condition checking module 501 has the main function of supporting the task of checking the migration preconditions, and the background displays the checked results of meeting the conditions to the user and updates the results to the information base of the service management end.
The migration triggering module 502 has a main function of providing pages for users so as to trigger one or more migration tasks, and after the tasks are triggered, the tasks jump to the result display module.
The result display module 503 has the main function of displaying the execution result after the on-road migration task is completed, and if the result fails, displaying the related error reporting information.
The historical task retrieval module 504 has the main function of supporting user queries and retrieving historical storage migration task logs/results.
FIG. 6 is a flowchart of an alternative method of online automated migration storage according to an embodiment of the present invention, as shown in FIG. 6, the method steps comprising:
step S601, an agent program is installed.
Step S602, checking the environment information. The environment information includes: the operating system version of the environment, the type of the mounted storage brand, whether there is an Oracle database in ASM mode, etc., and the step S603 is performed after the inspection is completed.
Step S603, reading and writing the information base. And uploading the collected information to an information base of the service management end.
Step S604, script version comparison. And comparing the version of the migration script with that of the script in the script management module of the agent program, and if the comparison result shows that the version is not matched, turning to step S612 to update the version of the script.
Step S605, migration condition checking. The user selects one or more objects on the display interface to trigger a migration condition inspection instruction, the service management end splits the inspection instruction into sub-instructions aiming at single objects, the sub-instructions are forwarded to agent programs on all target nodes through a message bus, and after receiving the inspection instruction, each agent program invokes a migration script to execute inspection by an information capture module.
Step S606, judging whether the migration condition is satisfied. If the migration condition is not satisfied, the step S603 is shifted to, and the non-conforming item summary written information library is displayed to the user terminal through the user interface, and if the migration condition is satisfied, the step S607 is shifted to.
In step S607, storage migration is triggered. The user selects one or more storage objects meeting migration conditions on the display interface to trigger a storage migration instruction, the service management end splits the migration instruction into sub-instructions aiming at a single object, the sub-instructions are forwarded to agent programs on all target nodes through a message bus, and after receiving a migration starting instruction, each agent program invokes a migration script to execute storage migration through a scheduler module.
In step S608, the migration progress is fed back periodically. In the migration process, the dispatcher module of the agent program periodically captures the current migration progress, and the capturing is shifted to step S603, where the progress information is written into the information base.
Step S609, judging whether the migration is successful. If the migration is unsuccessful, the step S603 is shifted to, the task failure and the error report log information are fed back to the service management side input information base, and if the migration is successful, the step S610 is shifted to.
Step S610, returning the result and the log and warehousing. And collecting the results and the migration logs of the agent program which is successfully migrated, and transferring to step S603, and writing the results and the logs into the information base.
Step S611, visual presentation. And displaying the related content in the information base on a user terminal interface.
Step S612, updating the script. After the update is completed, the process goes to step S603, and the related information of the new script is written into the information base.
Through the implementation mode, the storage of the mount on the running system of the dynamic scanning can be realized; calculating whether the migration condition is met or not, and if not, giving a prompt; if yes, after operation and maintenance personnel confirm to start migration, scanning the volume group, checking whether an Oracle database exists, building a migration target disk as an ASM node, adding the ASM disk group for data migration, and periodically inquiring the migration progress by an agent program and feeding back to a server for display in the whole migration process.
The following describes in detail another embodiment.
Example two
FIG. 7 is a schematic diagram of an alternative migration system for data storage objects, as shown in FIG. 7, according to an embodiment of the present invention, the migration system may include: a user terminal interface 71, a service manager 72, a broker (731, 732, …, 73n are illustrated in fig. 7), wherein,
the user terminal interface 71 receives at least one migration task, where the migration task is used to instruct migration of the storage object to be migrated.
The agent tool 73 is deployed in each target node of the operating system, and responds to the storage migration instruction to migrate the storage object to be migrated from the source disk to the target storage disk by adopting the migration script under the condition that the storage object to be migrated is verified to meet the preset migration condition; after all objects have completed migration, the source disk is deleted in the source disk volume group by the agent.
In the migration system, the user terminal interface 71 receives the migration task, and when it is checked that the storage object to be migrated meets the preset migration condition, the agent 73, which is pre-deployed by each target node of the operating system, responds to the storage migration instruction, and adopts the migration script to migrate the storage object to be migrated from the source disk to the target storage disk, and after all the objects are migrated, the agent deletes the source disk in the source disk volume group. In the embodiment, the agent tool can be directly deployed at each node of the operating system, and the storage objects in the system are migrated without additional replacement resources, so that the efficiency and the automation degree of storage migration replacement are effectively improved, and the technical problem that the additional replacement resources are required to be input in the storage migration replacement process in the related technology is solved.
In the embodiment, the agent tool can be deployed on the object system to be migrated, and the agent tool can complete migration operations such as information grabbing, script updating, condition checking, responding to migration instructions, migration scheduling management, automatic old storage kicking and the like in a full-automatic mode, so that manual misoperation is avoided, the automation degree is high, and the migration speed is high.
Meanwhile, the disk-level data copying mode is used in the embodiment, so that the speed is more advantageous than other modes.
Optionally, the user terminal interface includes: the migration triggering module is used for providing a display page for the user terminal and receiving a migration task triggered by the display page; the result display module displays migration progress and migration result of the storage object to be migrated; the migration condition checking module is used for checking the migration conditions in the migration task, displaying the checking result whether the migration conditions are met in the user terminal or not and updating the checking result to the information base of the service management end; the historical task retrieval module receives a task query request of the user terminal, and retrieves a migration execution log and a migration result of the historical migration task in response to the query request.
Optionally, the migration system of the data storage object further includes a service management end, where the service management end includes: the information base stores system information of all operating systems of deployed agent tools, judging results of whether preset migration conditions are met, all scripts and script attributes, migration execution logs of all historical migration tasks and migration results, wherein all scripts comprise: migration script and checking script; and the progress monitoring module records the migration progress and/or migration result transmitted by the agent tool to the information base, and displays the migration progress and/or migration result on a display interface of the user terminal.
As shown in fig. 7, the service manager 72 is connected to the user terminal interface and the agent, respectively.
Optionally, the service management end further includes: the instruction module is used for sending various instructions to the agent tool, wherein the various instructions comprise: storing migration instructions, script updating instructions and migration condition checking instructions.
Optionally, the agent tool includes: the communication module is used for receiving various instructions and forwarding the instructions to the corresponding module according to the instruction types, wherein the corresponding module comprises: the system comprises an information grabbing module, a scheduler module and a script management module; the information grabbing module is used for grabbing system version information, storage product information and database information of the operating system, calling a source disk volume group and a target storage disk in the preset checking script scanning operating system after receiving a migration condition checking instruction transmitted by the service management end, comparing the number of blocks of the historical storage blocks with the number of blocks of the idle storage blocks, and comparing the block capacity of the historical storage blocks with the block capacity of the idle storage blocks to determine whether a storage object to be migrated meets preset migration conditions or not; the script management module stores all scripts and script attributes according to the directory structure and updates the scripts; and the scheduler module is used for calling the migration script after receiving the storage migration instruction, selecting a migration flow according to the system environment information, and scheduling and executing the migration task according to the migration flow.
The migration system may further include a processor and a memory, where the user terminal interface 71, the service manager 72, the agents 731, 732, …, 73n, etc. are stored as program units, and the processor executes the program units stored in the memory to implement corresponding functions.
The processor includes a kernel, and the kernel fetches a corresponding program unit from the memory. The kernel can set one or more than one kernel, responds to a storage migration instruction by adjusting kernel parameters, adopts a migration script to migrate the storage object to be migrated from the source disk to the target storage disk, and deletes the source disk in the source disk volume group through the agent tool after all the objects are migrated.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM), which includes at least one memory chip.
The present application also provides a computer program product adapted to perform, when executed on a data processing device, a program initialized with the method steps of: under the condition that the storage object to be migrated meets the preset migration condition, responding to a storage migration instruction, and migrating the storage object to be migrated from a source disk to a target storage disk by adopting a migration script; after all objects have completed migration, the source disk is deleted in the source disk volume group by the agent.
According to another aspect of the embodiment of the present invention, there is also provided a computer readable storage medium, where the computer readable storage medium includes a stored computer program, and when the computer program runs, the device on which the computer readable storage medium is located is controlled to execute the migration method of the data storage object.
According to another aspect of the embodiment of the present invention, there is also provided an electronic device, including one or more processors and a memory, where the memory is configured to store one or more programs, and the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the above-mentioned migration method of a data storage object.
Fig. 8 is a block diagram of a hardware architecture of an electronic device (or mobile device) for a migration method of data storage objects according to an embodiment of the present invention. As shown in fig. 8, the electronic device may include one or more processors 802 (shown in fig. 8 as 802a, 802b, … …,802 n) (the processor 802 may include, but is not limited to, a microprocessor MCU, a programmable logic device FPGA, etc.) a memory 804 for storing data. In addition, the method may further include: a display, an input/output interface (I/O interface), a Universal Serial Bus (USB) port (which may be included as one of the ports of the I/O interface), a network interface, a keyboard, a power supply, and/or a camera. It will be appreciated by those of ordinary skill in the art that the configuration shown in fig. 8 is merely illustrative and is not intended to limit the configuration of the electronic device described above. For example, the electronic device may also include more or fewer components than shown in FIG. 8, or have a different configuration than shown in FIG. 8.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present invention, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology content may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, for example, may be a logic function division, and may be implemented in another manner, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.

Claims (14)

1. The migration method of the data storage object is characterized by being applied to a pre-deployed agent tool of each target node of an operating system, and comprises the following steps:
under the condition that the storage object to be migrated meets the preset migration condition, responding to a storage migration instruction, and migrating the storage object to be migrated from a source disk to a target storage disk by adopting a migration script;
and deleting the source disk in the source disk volume group through the agent tool after all the objects are migrated.
2. The migration method according to claim 1, further comprising, before verifying that the storage object to be migrated satisfies a preset migration condition:
after deploying the agent on any one of the target nodes of the operating system, scanning the operating system by the agent to obtain system version information, storage product information and database information;
And sorting the system version information, the storage product information and the database information into system environment information of the operating system, and transmitting the system environment information to an information base of a service management end, wherein the information base of the service management end determines the migration script required in the process of migrating the storage object based on the system environment information.
3. The migration method according to claim 2, further comprising, after transmitting the system environment information to an information base of a service manager:
receiving a script version comparison result returned by the information base of the service management end;
and under the condition that the script version comparison result indicates that the script version stored in the information base is inconsistent with the script version of the migration script in the agent tool, responding to a script update instruction, and updating the script version of the migration script stored in the agent tool in advance to the latest version.
4. The migration method according to claim 2, wherein the step of migrating the storage object to be migrated from the source storage disk to the target storage disk using a migration script in response to a storage migration instruction comprises:
Under the condition that the database information indicates that the database uses an automatic storage management function, the target storage disk is constructed as an automatic storage node, and the automatic storage node is added into a preset storage management disk group;
and migrating the storage object to be migrated from a source disk to the automatic storage node by adopting the migration script.
5. The migration method according to claim 1, comprising, before verifying that the storage object to be migrated satisfies a preset migration condition:
receiving a migration condition checking instruction transmitted by a service management end, wherein the migration condition checking instruction is used for checking whether a storage object to be migrated meets the preset migration condition;
responding to the migration condition inspection instruction, and calling a preset inspection script;
scanning the source disk volume group and the target storage disk in the operating system through the preset checking script to obtain the number of blocks of the historical storage blocks, the block capacity of each historical storage block, the number of blocks of the free storage blocks and the block capacity of each free storage block, which are associated with the storage object to be migrated, in the source disk volume group;
comparing the block number of the history storage blocks with the block number of the idle storage blocks to obtain a first comparison result, and comparing the block capacity of the history storage blocks with the block capacity of the idle storage blocks to obtain a second comparison result;
And determining that the storage object to be migrated meets a preset migration condition under the condition that the first comparison result indicates that the number of the blocks of the idle storage block is larger than that of the historical storage block and the second comparison result indicates that the block capacity of the idle storage block is larger than that of the historical storage block.
6. The migration method of claim 1, wherein the step of migrating the storage object to be migrated from the source storage disk to the target storage disk using a migration script in response to a storage migration instruction comprises:
in the migration process, grabbing the current migration progress and the migration state according to the preset period duration;
and under the condition that the migration state is normal, sending the current migration progress to a service management end in a designated progress form.
7. The migration method according to claim 6, wherein after grabbing the current migration progress and the migration status according to a preset period duration, the method comprises:
and under the condition that the migration state is abnormal or interrupted, feeding back failure of the migration task and error report log information to the information base of the service management end.
8. A migration system for data storage objects, comprising:
The user terminal interface is used for receiving at least one migration task, wherein the migration task is used for indicating migration of the storage object to be migrated;
the agent tool is deployed in each target node of the operating system, and when the storage object to be migrated is verified to meet the preset migration condition, the agent tool responds to a storage migration instruction and migrates the storage object to be migrated from a source disk to a target storage disk by adopting a migration script; and deleting the source disk in the source disk volume group through the agent tool after all the objects are migrated.
9. The migration system of claim 8, wherein the user terminal interface comprises:
the migration triggering module is used for providing a display page for the user terminal and receiving the migration task triggered by the display page;
the result display module displays the migration progress and the migration result of the storage object to be migrated;
the migration condition checking module is used for checking the migration conditions in the migration task, displaying the checking result whether the migration conditions are met in the user terminal or not and updating the checking result to the information base of the service management end;
and the historical task retrieval module is used for receiving a task query request of the user terminal and retrieving a migration execution log and a migration result of the historical migration task in response to the query request.
10. The migration system of claim 8, wherein the migration system of data storage objects further comprises a service manager, the service manager comprising:
the information base stores system information of all operating systems where the agent tool is deployed, judging results of whether preset migration conditions are met, all scripts and script attributes, migration execution logs of all historical migration tasks and migration results, wherein all scripts comprise: migration script and checking script;
and the progress monitoring module records the migration progress and/or the migration result transmitted by the agent tool to the information base, and displays the migration progress and/or the migration result on a display interface of the user terminal.
11. The migration system of claim 10, wherein the service manager further comprises:
the instruction module is used for sending various instructions to the agent tool, wherein the various instructions comprise: storing migration instructions, script updating instructions and migration condition checking instructions.
12. The migration system of claim 8, wherein the agent comprises:
the communication module is used for receiving various instructions and forwarding the instructions to the corresponding module according to the instruction types, wherein the corresponding module comprises: the system comprises an information grabbing module, a scheduler module and a script management module;
The information grabbing module is used for grabbing system version information of the operating system, storing product information and database information; after receiving a migration condition checking instruction transmitted by a service management end, calling a preset checking script to scan a source disk volume group and a target storage disk in an operating system, comparing the number of blocks of a history storage block with the number of blocks of an idle storage block, and comparing the block capacity of the history storage block with the block capacity of the idle storage block to determine whether the storage object to be migrated meets a preset migration condition;
the script management module stores all scripts and script attributes according to the directory structure and updates the scripts;
and the scheduler module is used for calling the migration script after receiving the storage migration instruction, selecting a migration flow according to the system environment information, and scheduling and executing the migration task according to the migration flow.
13. A computer readable storage medium, characterized in that the computer readable storage medium comprises a stored computer program, wherein the computer program, when run, controls a device in which the computer readable storage medium is located to perform the migration method of the data storage object according to any one of claims 1 to 7.
14. An electronic device comprising one or more processors and a memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of migrating a data storage object of any of claims 1-7.
CN202310513159.2A 2023-05-08 2023-05-08 Migration method and system of data storage object, electronic equipment and storage medium Pending CN116540942A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310513159.2A CN116540942A (en) 2023-05-08 2023-05-08 Migration method and system of data storage object, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310513159.2A CN116540942A (en) 2023-05-08 2023-05-08 Migration method and system of data storage object, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116540942A true CN116540942A (en) 2023-08-04

Family

ID=87444814

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310513159.2A Pending CN116540942A (en) 2023-05-08 2023-05-08 Migration method and system of data storage object, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116540942A (en)

Similar Documents

Publication Publication Date Title
US10248671B2 (en) Dynamic migration script management
CN109032824B (en) Database verification method, database verification device, computer equipment and storage medium
CN107122355B (en) Data migration system and method
CN1959717B (en) System and method for preprocessing mass remote sensing data collection driven by order form
EP3428811A1 (en) Database interface agent for a tenant-based upgrade system
CN105359147B (en) Online database migration
US11422987B2 (en) State record system for data migration
CN107122361B (en) Data migration system and method
CN102999400A (en) Data backup method and device of cloud storage system
CN110019469B (en) Distributed database data processing method and device, storage medium and electronic device
CN110795420A (en) Automatic MySQL database backup method based on infrastructure
CN108710684B (en) ETL task data source switching method, system, computer equipment and storage medium
US10033796B2 (en) SAAS network-based backup system
CN110019138B (en) Automatic transfer table space migration method and system based on Zabbix
CN110209653B (en) HBase data migration method and device
CN109086216B (en) Automatic test system
CN112199356B (en) Fault processing method, device, server and storage medium
JP2020057416A (en) Method and device for processing data blocks in distributed database
CN110063042A (en) A kind of response method and its terminal of database failure
CN110620798A (en) Control method, system, equipment and storage medium for FTP connection
US7281165B2 (en) System and method for performing product tests utilizing a single storage device
CN116540942A (en) Migration method and system of data storage object, electronic equipment and storage medium
US20230066698A1 (en) Compute instance warmup operations
US11544166B1 (en) Data recovery validation test
EP3082050A1 (en) Mass data fusion storage method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination