CN113485981B - Data migration method, device, computer equipment and storage medium - Google Patents
Data migration method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113485981B CN113485981B CN202110924125.3A CN202110924125A CN113485981B CN 113485981 B CN113485981 B CN 113485981B CN 202110924125 A CN202110924125 A CN 202110924125A CN 113485981 B CN113485981 B CN 113485981B
- Authority
- CN
- China
- Prior art keywords
- interface
- storage
- processing logic
- segment
- writing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 345
- 238000013508 migration Methods 0.000 title claims abstract description 64
- 230000005012 migration Effects 0.000 title claims abstract description 64
- 238000012545 processing Methods 0.000 claims abstract description 181
- 238000012217 deletion Methods 0.000 claims description 10
- 230000037430 deletion Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 6
- 230000001960 triggered effect Effects 0.000 claims description 4
- 230000008859 change Effects 0.000 abstract description 4
- 238000012423 maintenance Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data migration method, a data migration device, computer equipment and a storage medium, wherein the method comprises the following steps: acquiring storage service switching information, and determining an operator according to the storage service switching information; and processing the storage service switching information according to the operation interface library corresponding to the operator to finish data migration corresponding to the storage service switching information. According to the embodiment of the invention, the storage difference among different storage service operators is shielded through the operation interface library, the operation and maintenance personnel do not need to change the upper-layer business program, the influence of storage service migration on the upper-layer business program can be reduced, and the migration efficiency of storage data can be improved.
Description
Technical Field
Embodiments of the present invention relate to the field of data storage technologies, and in particular, to a data migration method, a data migration device, a computer device, and a storage medium.
Background
Data storage is an important component of current software development, and the support of data storage is often not separated in the software development process. The common storage service is used by using a software development tool set (Software Development Kit, SDK) provided by each manufacturer, and the SDKs provided by different manufacturers can be generated based on different development languages and development logic. In cloud storage service users often migrate storage services from one manufacturer to another according to service needs, and because the storage services supported by each manufacturer are different, the upper-layer service program needs to be modified according to the storage services of the new manufacturer. The upper business program is often huge in scale, so that migration of storage service is greatly influenced, and even a user has to abandon replacement of the storage service. In the field of cloud storage service, a data migration method is urgently needed at present, storage service differences among different manufacturers are shielded, the influence of storage service migration on an upper-layer business program is reduced, and storage data migration efficiency is improved.
Disclosure of Invention
The invention provides a data migration method, a data migration device, computer equipment and a storage medium, so as to realize storage service migration across manufacturers, reduce the influence of data migration on an upper-layer service program and improve the data migration efficiency.
In a first aspect, an embodiment of the present invention provides a data migration method, where the method includes:
acquiring storage service switching information, and determining an operator according to the storage service switching information;
And processing the storage server switching information according to the operation interface library corresponding to the operator to finish data migration corresponding to the storage service switching information.
In a second aspect, an embodiment of the present invention further provides a data migration apparatus, where the apparatus includes:
the information acquisition module is used for acquiring storage service switching information and determining an operator according to the storage service switching information;
And the migration execution module is used for processing the storage server switching information according to the operation interface library corresponding to the operator so as to complete data migration corresponding to the storage service switching information.
In a third aspect, an embodiment of the present invention provides a computer apparatus, including:
one or more processors;
A memory for storing one or more programs,
The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the data migration method as described in any one of the embodiments of the present invention.
In a fourth aspect, embodiments of the present invention further provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a data migration method according to any of the embodiments of the present invention.
According to the embodiment of the invention, the data migration corresponding to the storage service switching information is realized according to the operation interface library corresponding to the operator by receiving the storage service switching information and determining the operator corresponding to the storage service switching information, and the storage difference among different storage service operators is shielded according to the operation interface library, so that an operation and maintenance person does not need to change an upper-layer service program, the influence of the storage service migration on the upper-layer service program can be reduced, and the migration efficiency of storage data can be improved.
Drawings
FIG. 1 is a flow chart of a data migration method according to an embodiment of the present invention;
FIG. 2 is a flowchart of another data migration method according to an embodiment of the present invention;
Fig. 3 is a schematic structural diagram of a data migration apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer device according to an embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings, and furthermore, embodiments of the present invention and features in the embodiments may be combined with each other without conflict.
Example 1
Fig. 1 is a flowchart of a data migration method provided by the embodiment of the present invention, where the embodiment of the present invention is applicable to a case of switching storage services between different operators in a cloud storage case, and the method may be performed by a data migration device, where the device may be implemented in a hardware and/or software manner, and referring to fig. 1, the method provided by the embodiment of the present invention specifically includes the following steps:
step 110, obtaining storage service switching information, and determining an operator according to the storage service switching information.
The storage service switching information may be information for controlling switching of a storage service, where the storage service may be switched from one storage service to another storage service, and operators of the storage service before and after switching may be the same or different, and the storage service switching information may include information such as operators and data identifiers before and after switching of the storage service. The storage service switching information may be input by a user or automatically triggered by a preset program. The operators may be vendors that provide storage services, the operators may use unique identification numbers or names to identify, and an operator may have one or more storage services.
In the embodiment of the invention, the storage service switching information which is automatically triggered or sent by the user can be received, the storage service switching information can be sent to the remote server by the user client, and the operator corresponding to the storage service switching information can be determined, for example, the storage service switching information can comprise operators respectively belonging to the storage service before and after switching, or the format of the storage service switching information can implicitly indicate the operator.
And 120, processing the storage service switching information according to an operation interface library corresponding to the operator to finish data migration corresponding to the storage service switching information.
The operation interface library may be an interface library for performing storage service switching, the operation interface library may include one or more interfaces related to storage service switching, the number of operation interface libraries may be multiple, each operation interface library may correspond to different operators, the roles of the interfaces included in the operation interface libraries of the different operators may be the same, for example, operations such as adding, deleting, modifying and checking storage data may be implemented, and it may be understood that the interface libraries corresponding to each operator may be generated according to respective development standards.
Specifically, an operation interface library which is downloaded or edited in advance can be searched according to an operator, and one or more interfaces in the operation interface library can be called to realize data migration corresponding to storage service switching information. For example, the stored data may be acquired according to a read operation interface of the operator before the migration, and the data may be migrated to the target storage space for storage according to a write operation interface of the operator after the migration.
According to the embodiment of the invention, the data migration corresponding to the storage service switching information is realized according to the operation interface library corresponding to the operator by receiving the storage service switching information and determining the operator corresponding to the storage service switching information, and the storage difference among different storage service operators is shielded according to the operation interface library, so that an operation and maintenance person does not need to change an upper-layer service program, the influence of the storage service migration on the upper-layer service program can be reduced, and the migration efficiency of storage data can be improved.
Further, on the basis of the embodiment of the application, the operation interface library at least includes a storage operation processing interface and a storage service processing interface, where the storage service processing interface instantiates the storage operation interface.
In the embodiment of the invention, the operation interface library corresponding to each operator at least comprises a storage operation processing interface and a storage service processing interface, wherein the storage operation processing interface can be used for realizing a data interface of data operation, the data interface can be realized in a software and/or hardware mode, and the storage operation interface can comprise a method for operating the data. The storage service processing interface may be a data interface operating on a storage service object, where objects of different storage services may be processed, for example, a storage service of a user or a storage service of a vendor, where one or more methods may be included in the storage service interface, where the data of the service object may be operated by instantiating the storage operation interface. The storage operation processing interface and the storage service processing interface in the operation interface library can expose a unified interface to the service layer, and a user realizes data migration by calling the interfaces in the operation interface library without paying attention to specific processing logic in the interfaces in different manufacturers, so that the processing logic difference of the storage services of different operators in the data migration process can be shielded, and the use difficulty of the user is reduced.
Further, on the basis of the above embodiment of the present invention, the storage operation processing interface includes at least one of the following methods:
The processing logic of the operation output method is used for formatting and outputting attribute information of the storage operation processing interface;
An operation creation method, the processing logic of which is used for receiving the given path and creating an object for the stored data of the given path;
an operation deletion method, the processing logic of which is used for receiving a given path and deleting the object of the given path;
An operation list method, wherein the processing logic of the operation list method is used for receiving a given path and acquiring an information list of an object of the given path;
An operation metadata method, wherein processing logic of the operation metadata method is used for returning metadata of the storage operation processing interface;
an operation reading method, wherein processing logic of the operation reading method is used for reading the content of the object of the given path;
an operation start method, processing logic of the operation start method being configured to obtain metadata of an object of a given path;
the write method is operated, and processing logic of the write method is used to write data to an object of a given path.
In the embodiment of the present invention, the storage operation processing interface may include an operation output method, an operation creation method, an operation deletion method, an operation list method, an operation metadata method, an operation reading method, an operation starting method, an operation writing method, and the like, where the storage operation processing interface may be implemented based on a manner of G o language, a Python language, a Java language, and the like, the operation output method may operate attribute information output by the storage operation processing interface, for example, may define attribute information such as an output format, an output type, and the like of the interface, the operation creation method may be used to receive a given path, and the given path may be a parameter transmitted by an upper layer service program, may be a logical storage path or a physical storage path of storage data, and the operation creation method may generate an object according to the given path, and the object may operate on the storage data. The deletion method is operated, and the given path can be received, and the object stored in the given path can be deleted. The operation list method may be to receive a given path and generate an information list according to objects in the given path, and the information list may include all objects for data operation under the given path. The metadata method of operation can return metadata of the storage operation processing interface. The operation reading method may be to acquire contents in the object according to a given path, and the contents may be the stored data to be operated. The operation start method may acquire metadata of an object of a given path. The operation writing method may be to receive data to be stored and write the data to be stored into an object of a given path, and it may be understood that the given path may be a default storage path preset by a developer, in addition to parameters transmitted by an upper layer service program.
Further, on the basis of the above embodiment of the present invention, the storage service processing interface includes at least one of the following methods:
The processing logic of the service output method is used for formatting and outputting the attribute information of the storage service processing interface;
a service creation method, wherein processing logic of the service creation method is used for creating an instance of the storage operation processing interface;
a service deleting method, wherein the processing logic of the service transmitting method is used for deleting the instance of the storage operation processing interface;
A service acquisition method, the processing logic of which is used for at least one instance of the storage operation processing interface;
The service list method, the processing logic of which is used to obtain a list of all instances of the storage operation processing interface.
Specifically, the storage service processing interface may include a service creation method, a service deletion method, a service acquisition method and a service list method, where the storage service processing interface may be developed using different development languages, and the service creation method may create an instance of a storage operation processing interface type, where the instance may be used to implement a processing operation of data, the processing logic of the service transmission method is used to delete the instance of the storage operation processing interface, the processing logic of the service acquisition method is used to at least one instance of the storage operation processing interface, and the processing logic of the service list method is used to acquire a list of all instances of the storage operation processing interface.
Furthermore, on the basis of the embodiment of the invention, the storage operation processing interface and/or the storage service processing interface further comprises a context control method, and the context control method is used for receiving and storing the context information transmitted by the application layer.
In the embodiment of the present invention, the method in each interface in the operation interface library may include a context control method, which may be used to receive and store context information when the application layer transmission parameters are received, for example, the operation deletion method in which the operation processing interface is stored may generate a deletion context control method, which may receive context information when the application layer transmission parameters are received.
Further, on the basis of the above embodiment of the present invention, the operation interface library further includes:
The system comprises an additional write interface, a processing logic and a writing operation method, wherein the additional write interface comprises a submitting method, a creating method and a writing operation method, the processing logic of the submitting method is used for submitting and completing additional writing operation, the processing logic of the creating method is used for creating an additional writing object, and the writing operation method is used for carrying out additional writing operation on the appointed object;
The block storage interface comprises a block merging method, a block creation method, a block list method and a block writing method, wherein the processing logic of the block merging method is used for merging at least two storage blocks into one object, the processing logic of the block creation method is used for creating the object of one storage block, the processing logic of the block list method is used for acquiring a list of all the storage blocks of a given object, and the processing logic of the block writing method is used for writing data into the designated storage block;
The server copy interface comprises a copy method, and processing logic of the copy method is used for carrying out server copy on a given object;
a directory operations interface comprising a target creation method, processing logic of the target creation method for creating a directory object of a given type;
The system comprises a grabber interface, a processing logic and a control unit, wherein the grabber interface comprises a grabbing method, and the processing logic of the grabbing method is used for acquiring data according to a designated uniform resource identifier and storing the data to a designated path;
The mobile operation interface comprises a mobile method, and processing logic of the mobile method is used for acquiring a specified object and performing server mobile operation on the specified object;
The system comprises a segment uploading interface, a segment opening method, a segment list method and a segment writing method, wherein the segment uploading interface comprises an operation completion method, a segment opening method, a segment list method and a segment writing method, processing logic of the operation completion method is used for completing segment operation to generate a corresponding segment object, processing logic of the segment opening method is used for opening segment uploading operation, processing logic of the segment list method is used for acquiring all segment lists of a specified segment object, and the segment writing method is used for writing data into the specified segment;
A page operation interface including a page creation method and a page writing method, wherein processing logic of the page operation method is used for creating a specified type of page object, and processing logic of the page writing method is used for writing data into a specified page;
And the link operation interface comprises a link read operation, wherein the processing logic of the link read operation is used for acquiring the link of the object of the given path.
Specifically, in order to realize unique data operation during storage service switching, the operation interface library of each operator may further be provided with one or more of an additional write interface, a block storage interface, a server copy interface, a directory operation interface, a grabber interface, a mobile operation interface, a segment uploading interface, a page operation interface, and a link operation interface.
The additional write interface may be composed of a commit method, a create method and a write operation method, where the commit method is used to commit and complete the additional write operation, the create method is used to create an additional write object, and the write operation method is used to perform the additional write operation on the specified object.
The block storage interface may be composed of a block merging method for merging a plurality of storage blocks into one object, a block creation method for creating an object of one storage block, a block list method for generating an information list of all storage blocks corresponding to a given object, and a block writing method for acquiring data and writing to a designated storage block.
The server copy interface includes a copy method for receiving a given object and making a server copy for the given object. The directory operation interface comprises a target creation method, wherein the target creation method is used for creating a directory object of a given type; the grabber interface comprises a grabbing method, wherein the grabbing method is used for acquiring data according to the appointed uniform resource identifier and storing the data to the appointed path; the mobile operation interface comprises a mobile method, and the mobile method can acquire the specified object and carry out server mobile operation on the specified object.
The segment uploading interface can be used for processing data segment uploading, and specifically comprises an operation completion method, a segment opening method, a segment list method and a segment writing method, wherein the operation completion method can be used for completing segment uploading operation to obtain corresponding objects, the segment opening method can be used for opening segment uploading operation, the segment list method can be used for obtaining all segment information lists of self-defined segment objects, and the segment writing method can be used for writing data into specified segments.
The page operation interface may be used for data-related random write operations, and the page operation interface includes a page creation method, which may be used to create a specified type of page object, and a page writing method, which may receive data and write the data to a specified data page.
The connection operation may process links in the object, and specifically includes a link reading method that may read links included in the object of a given path.
Fig. 2 is a flowchart of another data migration method provided by the embodiment of the present invention, where the embodiment of the present invention is embodied on the basis of the above embodiment of the present invention, and referring to fig. 2, the method provided by the embodiment of the present invention specifically includes the following steps:
Step 210, obtaining storage service switching information, and determining an operator according to the storage service switching information.
Step 220, the storage service switching information is processed according to the operation interface library corresponding to the operator so as to complete the data migration corresponding to the storage service switching information.
Step 230, obtaining the interface updating information, and updating the operation interface library corresponding to the operator according to the interface updating information.
The interface update information may be used to update information of processing logic of the interface, may be a code file edited by a developer or a storage address of the code file, and may further include information of an original interface to be replaced, for example, the interface update information may include one or more information of an operator, an operation interface library, an interface name, and a method name that need to be updated.
In the embodiment of the invention, the interface updating information input by the user can be received, the interface operation library of one or more operators can be updated according to the information, and the interfaces included in the interface operation library or the method in the interfaces in the operation interface library can be updated. It can be understood that the operation interface library can be designed for a user, the operation interface library can be expanded according to the actual situation of the user, and the compatibility of the storage service data migration is realized by updating the operation interface library.
In an exemplary implementation manner, the operation interface library in the embodiment of the present invention may be an interface library designed based on GO language, and may be designed for different services and related basic operations stored, and the operation interface library may include Storager interfaces for managing specific basic operations related to storage, where the interfaces define the following methods:
string method for formatting relevant information of the output Storager;
The Create method for creating an Object from a given path;
delete method to Delete an Object from a given path;
list method for obtaining corresponding Object List according to given path;
Metadata method for returning Storager Metadata;
read method for reading the content of an Object of a given path;
stat method for obtaining metadata of objects of a given path;
write method for writing data to Object of a given path.
Also included in the operation interface library may be Serbicer interfaces that manage multiple Storager interfaces from a service perspective, which define the following methods:
string method for formatting relevant information of the output Servicer;
The Create method for creating a new Storager instance;
delete method to Delete one Storager instance;
Get method to Get one available Storager instance from Servicer;
list method for retrieving all Storager lists from Servicer.
Further, the operation interface library may further include Appender interfaces that support append write operations and define the following methods:
CommitAppend method to commit and complete the append write operation process;
CREATEAPPEND method to create an appendable Object;
WRITEAPPEND method to append write operations to specified objects.
Further, the operation interface library may further include a Blocker interface for implementing a block storage related operation, and the defined method includes:
CombineBlock method for grouping blocks into one Object;
CreateBlock method to create a block Object;
ListBlock method to obtain a list of all blocks belonging to a certain Object;
WriteBlock method for writing data to a block.
Further, the operation interface library may further include a loader interface, where the loader interface supports a server copy operation, and the defined method includes:
Copy method for making a server Copy of an Object.
Further, the operation interface library may further include Direr interfaces, direr interfaces are interfaces for operating on the directory, and CREATEDIR methods are defined for creating an Object of a type directory.
Further, the operation interface library may further include Fetcher interfaces supporting data acquisition via a uniform resource location system (Uniform Resource Locator, URL), defining:
The Fetch method for retrieving data from a specified URL and storing the data in a specified path.
Further, the operation interface library may further include a river interface, which may support mobile operation of the server, and defines:
The Move method is used for performing a server side moving operation on an Object.
Further, the operation interface library may further include Multiparter interfaces, which may be interfaces supporting operations related to segment upload, and define:
CompleteMultipart method to complete the segment upload operation to obtain the corresponding Object;
CreateMultipart method to initiate a segment upload operation;
ListMultipart method to get all segment lists of some segment upload Object;
WriteMultipart method for writing data to a segment.
Further, the operation interface library may further include Pager, which may be an interface supporting page-related random write operations, defining:
CREATEPAGE method for creating an Object of a page type;
WRITEPAGE method for writing data to a page.
Further, the operation interface library may further include Reacher interfaces that support a link operation to obtain a certain available Object, defining:
the Reach method is used to obtain links that can access a given path Object.
In each interface, in addition to the above-mentioned methods, each method also automatically generates a corresponding XXXWithContext method (such as DeleteWithContext method), so that the upper layer application can conveniently enter a corresponding Context to perform Context control.
Where an Object is a minimum Object element abstraction that is uniformly defined, such as a file in a file system (FILE SYSTEM, FS) service, an Object in a cloud storage service, etc., we can all consider an Object.
Fig. 3 is a schematic structural diagram of a data migration device provided by an embodiment of the present invention, which can execute the data migration method provided by any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. The apparatus may be implemented by software and/or hardware, and specifically includes: an information acquisition module 301 and a migration execution module 302.
The information obtaining module 301 is configured to obtain storage service switching information, and determine an operator according to the storage service switching information.
And the migration execution module 302 is configured to process the storage service switching information according to an operation interface library corresponding to the operator to complete data migration corresponding to the storage service switching information.
According to the embodiment of the invention, the information acquisition module is used for receiving the storage service switching information, determining the operator corresponding to the storage service switching information, the migration execution module is used for realizing data migration corresponding to the storage service switching information according to the operation interface library corresponding to the operator, shielding the storage difference among different storage service operators according to the operation interface library, and an operation and maintenance person does not need to change an upper-layer service program, so that the influence of the storage service migration on the upper-layer service program can be reduced, and the migration efficiency of storage data can be improved.
Further, on the basis of the above embodiment of the present invention, the operation interface library in the device at least includes: a storage operation processing interface and a storage service processing interface, wherein the storage service processing interface instantiates the storage operation interface.
Further, on the basis of the above embodiment of the present invention, the storing the operation processing interface in the device includes at least one of the following methods:
The processing logic of the operation output method is used for formatting and outputting the attribute information of the storage operation processing interface;
An operation creation method, the processing logic of the operation creation method being configured to receive a given path and create an object for stored data of the given path;
an operation deletion method, the processing logic of which is used for receiving a given path and deleting the object of the given path;
an operation list method, wherein the processing logic of the operation list method is used for receiving a given path and acquiring an information list of an object of the given path;
An operation metadata method, wherein processing logic of the operation metadata method is used for returning metadata of the storage operation processing interface;
An operational read method, processing logic of the operational read method for reading content of an object of a given path;
An operation start method, processing logic of the operation start method being configured to obtain metadata of an object of a given path;
a write method is operated, the processing logic of which is used to write data to an object of a given path.
Further, on the basis of the above embodiment of the present invention, storing the service processing interface in the device includes at least one of the following methods:
The processing logic of the service output method is used for formatting and outputting the attribute information of the storage service processing interface;
a service creation method, wherein processing logic of the service creation method is used for creating an instance of the storage operation processing interface;
a service deleting method, wherein the processing logic of the service transmitting method is used for deleting the instance of the storage operation processing interface;
A service acquisition method, the processing logic of which is used for at least one instance of the storage operation processing interface;
The service list method, the processing logic of which is used to obtain a list of all instances of the storage operation processing interface.
Furthermore, on the basis of the embodiment of the invention, the storage operation processing interface and/or the storage service processing interface in the device further comprises a context control method, and the context control method is used for receiving and storing the context information transmitted by the application layer.
Further, on the basis of the above embodiment of the present invention, the operation interface library in the device further includes:
The system comprises an additional write interface, a processing logic and a writing operation method, wherein the additional write interface comprises a submitting method, a creating method and a writing operation method, the processing logic of the submitting method is used for submitting and completing additional writing operation, the processing logic of the creating method is used for creating an additional writing object, and the writing operation method is used for carrying out additional writing operation on the appointed object;
The block storage interface comprises a block merging method, a block creation method, a block list method and a block writing method, wherein the processing logic of the block merging method is used for merging at least two storage blocks into one object, the processing logic of the block creation method is used for creating the object of one storage block, the processing logic of the block list method is used for acquiring a list of all the storage blocks of a given object, and the processing logic of the block writing method is used for writing data into the designated storage block;
The server copy interface comprises a copy method, and processing logic of the copy method is used for carrying out server copy on a given object;
a directory operations interface comprising a target creation method, processing logic of the target creation method for creating a directory object of a given type;
The system comprises a grabber interface, a processing logic and a control unit, wherein the grabber interface comprises a grabbing method, and the processing logic of the grabbing method is used for acquiring data according to a designated uniform resource identifier and storing the data to a designated path;
The mobile operation interface comprises a mobile method, and processing logic of the mobile method is used for acquiring a specified object and performing server mobile operation on the specified object;
The system comprises a segment uploading interface, a segment opening method, a segment list method and a segment writing method, wherein the segment uploading interface comprises an operation completion method, a segment opening method, a segment list method and a segment writing method, processing logic of the operation completion method is used for completing segment operation to generate a corresponding segment object, processing logic of the segment opening method is used for opening segment uploading operation, processing logic of the segment list method is used for acquiring all segment lists of a specified segment object, and the segment writing method is used for writing data into the specified segment;
A page operation interface including a page creation method and a page writing method, wherein processing logic of the page operation method is used for creating a specified type of page object, and processing logic of the page writing method is used for writing data into a specified page;
And the link operation interface comprises a link read operation, wherein the processing logic of the link read operation is used for acquiring the link of the object of the given path.
Further, on the basis of the above embodiment of the present invention, the apparatus further includes:
And the interface updating module is used for acquiring interface updating information and updating the operation interface library corresponding to the operator according to the interface updating information.
Fig. 4 is a schematic structural diagram of a computer device provided by an embodiment of the present invention, and fig. 4 shows a block diagram of a computer device 312 suitable for implementing an embodiment of the present invention. The computer device 312 shown in fig. 4 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention. Device 312 is a computing device for the update functionality of a typical intelligent robot map.
As shown in FIG. 4, computer device 312 is in the form of a general purpose computing device. Components of computer device 312 may include, but are not limited to: one or more processors 316, a storage device 328, and a bus 318 that connects the different system components (including the storage device 328 and the processor 316).
Bus 318 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include industry standard architecture (Industry Standard Architecture, ISA) bus, micro channel architecture (Micro Channel Architecture, MCA) bus, enhanced ISA bus, video electronics standards association (Video Electronics Standards Association, VESA) local bus, and peripheral component interconnect (PERIPHERAL COMPONENT INTERCONNECT, PCI) bus.
Computer device 312 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer device 312 and includes both volatile and nonvolatile media, removable and non-removable media.
Storage 328 may include computer system-readable media in the form of volatile memory, such as random access memory (Random Access Memory, RAM) 330 and/or cache memory 332. The computer device 312 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 334 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, commonly referred to as a "hard disk drive"). Although not shown in fig. 4, a disk drive for reading from and writing to a removable nonvolatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from and writing to a removable nonvolatile optical disk (e.g., a Compact Disc-Read Only Memory (CD-ROM), digital versatile Disc (Digital Video Disc-Read Only Memory, DVD-ROM), or other optical media) may be provided. In such cases, each drive may be coupled to bus 318 through one or more data medium interfaces. Storage 328 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
Programs 336 having a set (at least one) of program modules 326 may be stored, for example, in storage 328, such program modules 326 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 326 generally perform the functions and/or methods in the described embodiments of the invention.
The computer device 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, camera, display 324, etc.), one or more devices that enable a user to interact with the computer device 312, and/or any devices (e.g., network card, modem, etc.) that enable the computer device 312 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 322. Moreover, the computer device 312 may also communicate with one or more networks such as a local area network (Local Area Network, LAN), a wide area network Wide Area Network, a WAN, and/or a public network such as the internet via the network adapter 320. As shown, network adapter 320 communicates with other modules of computer device 312 via bus 318. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with computer device 312, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, disk array (Redundant Arrays of INDEPENDENT DISKS, RAID) systems, tape drives, data backup storage systems, and the like.
The processor 316 executes programs stored in the storage 328 to perform various functional applications and data processing, such as implementing the data migration methods provided by the above-described embodiments of the present invention.
The embodiment of the invention provides a computer readable storage medium, and a computer program is stored on the computer readable storage medium, and when the program is executed by a processing device, the program realizes the data migration method as in the embodiment of the invention. The computer readable medium of the present invention described above may be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be embodied in the computer device; or may exist alone without being assembled into the computer device.
The computer readable medium carries one or more programs which, when executed by the computer device, cause the computer device to: acquiring storage service switching information, and determining an operator according to the storage service switching information; and processing the storage service switching information according to the operation interface library corresponding to the operator to finish data migration corresponding to the storage service switching information.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (10)
1. A method of data migration, the method comprising:
Acquiring storage service switching information, and determining an operator according to the storage service switching information; the storage service switching information is information for controlling switching of storage service, the storage service switching information comprises operators before and after storage service switching and data identification information, and the storage service switching information is input by a user or automatically triggered by a preset program;
processing the storage service switching information according to an operation interface library corresponding to the operator to complete data migration corresponding to the storage service switching information;
Wherein, the operation interface library comprises:
The system comprises an additional write interface, a processing logic and a writing operation method, wherein the additional write interface comprises a submitting method, a creating method and a writing operation method, the processing logic of the submitting method is used for submitting and completing additional writing operation, the processing logic of the creating method is used for creating an additional writing object, and the writing operation method is used for carrying out additional writing operation on the appointed object;
the block storage interface comprises a block merging method, a block creation method, a block list method and a block writing method, wherein the processing logic of the block merging method is used for merging at least two storage blocks into one object, the processing logic of the block creation method is used for creating the object of one storage block, the processing logic of the block list method is used for acquiring a list of all the storage blocks of a given object, and the processing logic of the block writing method is used for writing data into a specified storage block;
The method comprises a segment uploading interface, wherein the segment uploading interface comprises an operation completion method, a segment opening method, a segment list method and a segment writing method, processing logic of the operation completion method is used for completing segment operation to generate a corresponding segment object, processing logic of the segment opening method is used for opening segment uploading operation, processing logic of the segment list method is used for acquiring all segment lists of a specified segment object, and the segment writing method is used for writing data into the specified segment.
2. The method of claim 1, wherein the operation interface library further comprises: the system comprises a storage operation processing interface and a storage service processing interface, wherein the storage service processing interface instantiates the storage operation processing interface.
3. The method of claim 2, wherein the storage operation processing interface comprises at least one of:
The processing logic of the operation output method is used for formatting and outputting the attribute information of the storage operation processing interface;
An operation creation method, the processing logic of the operation creation method being configured to receive a given path and create an object for stored data of the given path;
an operation deletion method, the processing logic of which is used for receiving a given path and deleting the object of the given path;
an operation list method, wherein the processing logic of the operation list method is used for receiving a given path and acquiring an information list of an object of the given path;
An operation metadata method, wherein processing logic of the operation metadata method is used for returning metadata of the storage operation processing interface;
An operational read method, processing logic of the operational read method for reading content of an object of a given path;
An operation start method, processing logic of the operation start method being configured to obtain metadata of an object of a given path;
a write method is operated, the processing logic of which is used to write data to an object of a given path.
4. The method of claim 3, wherein the storage service processing interface comprises at least one of:
The processing logic of the service output method is used for formatting and outputting the attribute information of the storage service processing interface;
a service creation method, wherein processing logic of the service creation method is used for creating an instance of the storage operation processing interface;
A service deletion method, wherein the processing logic of the service deletion method is used for deleting the instance of the storage operation processing interface;
A service acquisition method, the processing logic of which is used for at least one instance of the storage operation processing interface;
The service list method, the processing logic of which is used to obtain a list of all instances of the storage operation processing interface.
5. The method according to claim 3 or 4, wherein the storage operation processing interface and/or the storage service processing interface further comprises a context control method for receiving and saving context information transmitted by an application layer.
6. The method of claim 2, wherein the operation interface library further comprises:
The server copy interface comprises a copy method, and processing logic of the copy method is used for carrying out server copy on a given object;
a directory operations interface comprising a target creation method, processing logic of the target creation method for creating a directory object of a given type;
The system comprises a grabber interface, a processing logic and a control unit, wherein the grabber interface comprises a grabbing method, and the processing logic of the grabbing method is used for acquiring data according to a designated uniform resource identifier and storing the data to a designated path;
The mobile operation interface comprises a mobile method, and processing logic of the mobile method is used for acquiring a specified object and performing server mobile operation on the specified object;
a page operation interface including a page creation method and a page writing method, wherein processing logic of the page creation method is used for creating a specified type of page object, and processing logic of the page writing method is used for writing data into a specified page;
And the link operation interface comprises a link read operation, wherein the processing logic of the link read operation is used for acquiring the link of the object of the given path.
7. The method as recited in claim 1, further comprising:
and acquiring interface updating information, and updating an operation interface library corresponding to the operator according to the interface updating information.
8. A data migration apparatus, the apparatus comprising:
The information acquisition module is used for acquiring storage service switching information and determining an operator according to the storage service switching information; the storage service switching information is information for controlling switching of storage service, the storage service switching information comprises operators before and after storage service switching and data identification information, and the storage service switching information is input by a user or automatically triggered by a preset program;
the migration execution module is used for processing the storage service switching information according to the operation interface library corresponding to the operator so as to complete data migration corresponding to the storage service switching information;
Wherein, the operation interface library comprises:
The system comprises an additional write interface, a processing logic and a writing operation method, wherein the additional write interface comprises a submitting method, a creating method and a writing operation method, the processing logic of the submitting method is used for submitting and completing additional writing operation, the processing logic of the creating method is used for creating an additional writing object, and the writing operation method is used for carrying out additional writing operation on the appointed object;
the block storage interface comprises a block merging method, a block creation method, a block list method and a block writing method, wherein the processing logic of the block merging method is used for merging at least two storage blocks into one object, the processing logic of the block creation method is used for creating the object of one storage block, the processing logic of the block list method is used for acquiring a list of all the storage blocks of a given object, and the processing logic of the block writing method is used for writing data into a specified storage block;
The method comprises a segment uploading interface, wherein the segment uploading interface comprises an operation completion method, a segment opening method, a segment list method and a segment writing method, processing logic of the operation completion method is used for completing segment operation to generate a corresponding segment object, processing logic of the segment opening method is used for opening segment uploading operation, processing logic of the segment list method is used for acquiring all segment lists of a specified segment object, and the segment writing method is used for writing data into the specified segment.
9. A computer device, the computer device comprising:
one or more processors;
A memory for storing one or more programs,
The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the data migration method of any of claims 1-7.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the data migration method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110924125.3A CN113485981B (en) | 2021-08-12 | 2021-08-12 | Data migration method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110924125.3A CN113485981B (en) | 2021-08-12 | 2021-08-12 | Data migration method, device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113485981A CN113485981A (en) | 2021-10-08 |
| CN113485981B true CN113485981B (en) | 2024-06-21 |
Family
ID=77945078
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110924125.3A Active CN113485981B (en) | 2021-08-12 | 2021-08-12 | Data migration method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113485981B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112190951A (en) * | 2020-10-28 | 2021-01-08 | 网易（杭州）网络有限公司 | Operation data migration method, device, equipment and storage medium |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009043030A (en) * | 2007-08-09 | 2009-02-26 | Hitachi Ltd | Storage system |
| JP6520448B2 (en) * | 2015-06-18 | 2019-05-29 | 富士通株式会社 | INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING DEVICE, AND INFORMATION PROCESSING DEVICE CONTROL METHOD |
| US10083199B1 (en) * | 2016-05-23 | 2018-09-25 | Sprint Communications Company L.P. | Data migration in active data store |
| CN108268501B (en) * | 2016-12-30 | 2020-09-18 | 中国移动通信集团北京有限公司 | Service processing method and device in online data migration process |
| CN109067823A (en) * | 2018-06-11 | 2018-12-21 | 中国平安人寿保险股份有限公司 | A kind of data migration method, device, computer equipment and storage medium |
| US11010258B2 (en) * | 2018-11-27 | 2021-05-18 | Commvault Systems, Inc. | Generating backup copies through interoperability between components of a data storage management system and appliances for data storage and deduplication |
| CN110175211B (en) * | 2019-05-05 | 2021-10-19 | 中国银行股份有限公司 | Data synchronization method and device |
| CN110580246B (en) * | 2019-07-30 | 2023-10-20 | 平安科技（深圳）有限公司 | Method, device, computer equipment and storage medium for migrating data |
| CN111736945B (en) * | 2019-08-07 | 2024-05-17 | 北京京东尚科信息技术有限公司 | Virtual machine thermomigration method, device, equipment and medium based on intelligent network card |
| US10965752B1 (en) * | 2019-09-13 | 2021-03-30 | Google Llc | Live migration of clusters in containerized environments |
| JP7344739B2 (en) * | 2019-10-03 | 2023-09-14 | 株式会社くすりの窓口 | Data migration system and relay server |
| CN113127413B (en) * | 2021-05-12 | 2024-03-01 | 北京红山信息科技研究院有限公司 | Operator data processing method, device, server and storage medium |
-
2021
- 2021-08-12 CN CN202110924125.3A patent/CN113485981B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112190951A (en) * | 2020-10-28 | 2021-01-08 | 网易（杭州）网络有限公司 | Operation data migration method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113485981A (en) | 2021-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109634598B (en) | Page display method, device, equipment and storage medium | |
| US10146671B2 (en) | Testing of software upgrade | |
| US10083092B2 (en) | Block level backup of virtual machines for file name level based file search and restoration | |
| US10585760B2 (en) | File name level based file search and restoration from block level backups of virtual machines | |
| US10055302B2 (en) | Performing a closure merge operation | |
| US11461110B2 (en) | Systems and methods for automated and distributed configuration of computing devices | |
| US9495410B1 (en) | File creation through virtual containers | |
| CN109923835B (en) | Local and off-site communications | |
| US9274719B2 (en) | Snapshot management in hierarchical storage infrastructure | |
| CN112965761B (en) | Data processing method, system, electronic equipment and storage medium | |
| CN112947992B (en) | Code version management method and device | |
| WO2020123923A1 (en) | Automated testing for metadata-driven custom applications | |
| WO2023160327A1 (en) | Container image management | |
| US11132502B2 (en) | Atom-based sensible synchronization for information indexing | |
| CN113485981B (en) | Data migration method, device, computer equipment and storage medium | |
| CN114090124A (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN112835609B (en) | Method and device for modifying download address of dependent packet | |
| CN113806327A (en) | Database design method and device and related equipment | |
| CN112947846B (en) | Batch processing task execution method and device of object storage system and electronic equipment | |
| CN110377326B (en) | Installation package generation method, installation package generation device, development device and computer readable medium | |
| CN116931894A (en) | Configuration method, device, equipment and medium for field uniqueness | |
| CN118192897A (en) | Data storage system, method and device | |
| CN114036321A (en) | Request processing method and device, electronic equipment and computer readable medium | |
| CN113760349A (en) | Mirror image upgrading method and device | |
| CN114281786A (en) | File processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 100000 Unit 501A, Floor 5, 101, Building 1, Yard 5, Laiguangying West Road, Chaoyang District, Beijing Applicant after: Beijing Qingyun Science and Technology Co.,Ltd. Address before: 100020 601, 6 floor, 16 building, No. 36 Chuang Yuan Road, Chaoyang District, Beijing. Applicant before: Beijing Qingyun Science and Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |