CN113485981A - Data migration method and device, computer equipment and storage medium - Google Patents
Data migration method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113485981A CN113485981A CN202110924125.3A CN202110924125A CN113485981A CN 113485981 A CN113485981 A CN 113485981A CN 202110924125 A CN202110924125 A CN 202110924125A CN 113485981 A CN113485981 A CN 113485981A
- Authority
- CN
- China
- Prior art keywords
- interface
- storage
- processing logic
- processing
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 320
- 238000013508 migration Methods 0.000 title claims abstract description 64
- 230000005012 migration Effects 0.000 title claims abstract description 64
- 238000012545 processing Methods 0.000 claims abstract description 179
- 238000012217 deletion Methods 0.000 claims description 12
- 230000037430 deletion Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000000977 initiatory effect Effects 0.000 claims description 4
- 230000008859 change Effects 0.000 abstract description 4
- 238000012423 maintenance Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 238000013500 data storage Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
Abstract
The invention discloses a data migration method, a data migration device, computer equipment and a storage medium, wherein the method comprises the following steps: acquiring storage service switching information, and determining an operator according to the storage service switching information; and processing the storage service switching information according to the operation interface library corresponding to the operator to complete data migration corresponding to the storage service switching information. According to the embodiment of the invention, the storage difference between different storage service operators is shielded through the operation interface library, operation and maintenance personnel do not need to change the upper-layer service program, the influence of storage service migration on the upper-layer service program can be reduced, and the migration efficiency of the storage data can be improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of data storage, in particular to a data migration method, a data migration device, computer equipment and a storage medium.
Background
Data storage is an important component of current software development, and the support of the data storage is often not separated in the software development process. The common storage service is used by using Software Development Kit (SDK) provided by various vendors, and the SDKs provided by different vendors can be generated based on different Development languages and Development logics. However, a user of the cloud storage service often migrates the storage service from one manufacturer to another according to business needs, and because the storage services supported by the manufacturers are different, the upper-layer business program needs to be modified according to the storage service of a new manufacturer. The scale of the upper-layer service program is often huge, which greatly affects the migration of the storage service, and even causes the user to abandon the replacement of the storage service. In the field of cloud storage services, a data migration method is urgently needed at present, so that storage service differences among different manufacturers are shielded, the influence of storage service migration on an upper-layer service program is reduced, and the storage data migration efficiency is improved.
Disclosure of Invention
The invention provides a data migration method, a data migration device, computer equipment and a storage medium, which are used for realizing cross-manufacturer storage service migration, reducing the influence of data migration on an upper-layer service program and improving the data migration efficiency.
In a first aspect, an embodiment of the present invention provides a data migration method, where the method includes:
acquiring storage service switching information, and determining an operator according to the storage service switching information;
and processing the storage server switching information according to the operation interface library corresponding to the operator to complete data migration corresponding to the storage service switching information.
In a second aspect, an embodiment of the present invention further provides a data migration apparatus, where the apparatus includes:
the information acquisition module is used for acquiring storage service switching information and determining an operator according to the storage service switching information;
and the migration execution module is used for processing the storage server switching information according to the operation interface library corresponding to the operator so as to complete data migration corresponding to the storage service switching information.
In a third aspect, an embodiment of the present invention provides a computer device, where the computer device includes:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a data migration method as in any one of the embodiments of the invention.
In a fourth aspect, the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the data migration method according to any one of the embodiments of the present invention.
According to the embodiment of the invention, the storage service switching information is received, the operator corresponding to the storage service switching information is determined, the data migration corresponding to the storage service switching information is realized according to the operation interface library corresponding to the operator, the storage difference between different storage service operators is shielded according to the operation interface library, operation and maintenance personnel do not need to change the upper-layer service program, the influence of the storage service migration on the upper-layer service program can be reduced, and the migration efficiency of the storage data can be improved.
Drawings
FIG. 1 is a flow chart of a data migration method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another data migration method provided by an embodiment of the invention;
FIG. 3 is a schematic structural diagram of a data migration apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer device according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be noted that, for convenience of description, only a part of the structures related to the present invention, not all of the structures, are shown in the drawings, and furthermore, embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
Example one
Fig. 1 is a flowchart of a data migration method provided in an embodiment of the present invention, where this embodiment is applicable to a storage service switching situation between different operators in a cloud storage situation, and the method may be executed by a data migration apparatus, where the apparatus may be implemented in a hardware and/or software manner, and referring to fig. 1, the method provided in an embodiment of the present invention specifically includes the following steps:
and step 110, acquiring the storage service switching information, and determining an operator according to the storage service switching information.
The storage service switching information may be information for controlling switching of the storage service, the storage service may be switched from one storage service to another storage service, operators of the storage service before and after switching may be the same or different, and the storage service switching information may include the operators and data identifiers before and after switching of the storage service. Storing the service switching information may be input by a user or automatically triggered by a preset program. An operator may be a vendor that provides storage services, an operator may be identified using a unique identification number or name, and an operator may have one or more storage services.
In the embodiment of the present invention, storage service switching information that is automatically triggered or sent by a user may be received, where the storage service switching information may be sent to a remote server by a user client, and an operator corresponding to the storage service switching information may be determined, for example, the storage service switching information may include operators to which the storage service respectively belongs before and after switching, or a format of the storage service switching information may implicitly indicate an operator.
And step 120, processing the storage service switching information according to the operation interface library corresponding to the operator to complete data migration corresponding to the storage service switching information.
The operation interface library may be an interface library for switching storage services, the operation interface library may include one or more interfaces related to switching storage services, the number of the operation interface libraries may be multiple, each operation interface library may correspond to a different operator, the functions of the interfaces included in the operation interface libraries of the different operators may be the same, for example, operations such as adding, deleting, modifying, and checking stored data may be implemented, and it may be understood that the interface libraries corresponding to each operator may be generated according to respective development standards.
Specifically, the operation interface library downloaded or edited in advance may be searched according to an operator, and one or more interfaces in the operation interface library may be called to implement data migration corresponding to the storage service switching information. For example, the stored data may be acquired according to the acquisition of the read operation interface of the operator before the migration, and the data may be migrated to the target storage space for storage according to the write operation interface of the operator after the migration.
According to the embodiment of the invention, the storage service switching information is received, the operator corresponding to the storage service switching information is determined, the data migration corresponding to the storage service switching information is realized according to the operation interface library corresponding to the operator, the storage difference between different storage service operators is shielded according to the operation interface library, operation and maintenance personnel do not need to change the upper-layer service program, the influence of the storage service migration on the upper-layer service program can be reduced, and the migration efficiency of the storage data can be improved.
Further, on the basis of the embodiment of the above application, the operation interface library at least includes a storage operation processing interface and a storage service processing interface, where the storage service processing interface instantiates the storage operation interface.
In the embodiment of the present invention, the operation interface library corresponding to each operator at least includes a storage operation processing interface and a storage service processing interface, where the storage operation processing interface may be a data interface for implementing data operation, the data interface may be implemented in a software and/or hardware manner, and the storage operation interface may include a method for operating data. The storage service processing interface may be a data interface for operating on a storage service object, objects of different storage services may be processed in the storage service processing interface, for example, a storage service of a certain user or a storage service of a certain vendor, and one or more methods may be included in the storage service interface, where data of the service object may be operated by instantiating the storage service processing interface. The storage operation processing interface and the storage service processing interface in the operation interface library can expose a uniform interface to the service layer, and a user can realize data migration by calling the interfaces in the operation interface library without concerning specific processing logic inside the interfaces in different manufacturers, so that the processing logic difference of the storage service of different operators in the data migration process can be shielded, and the use difficulty of the user is reduced.
Further, on the basis of the above embodiment of the present invention, the storage operation processing interface includes at least one of the following methods:
the processing logic of the operation output method is used for formatting and outputting the attribute information of the storage operation processing interface;
an operation creation method, processing logic of the operation creation method being adapted to receive a given path and create an object for stored data of the given path;
an operation deletion method, wherein the processing logic of the operation deletion method is used for receiving the given path and deleting the object of the given path;
an operation list method, wherein the processing logic of the operation list method is used for receiving a given path and acquiring an information list of an object of the given path;
an operation metadata method, processing logic of the operation metadata method to return metadata of the storage operation processing interface;
the processing logic of the read method is used for reading the content of the object of the given path;
an operation start method, processing logic of the operation start method for obtaining metadata of an object of a given path;
operating a write method, the processing logic of the write method is used to write data to an object of a given path.
In the embodiment of the present invention, the storage operation processing interface may include an operation output method, an operation creation method, an operation deletion method, an operation list method, an operation metadata method, an operation read method, an operation start method, an operation write method, and the like, the storage operation processing interface may be implemented based on G o language, Python language, Java language, etc., and the operation output method may operate on the attribute information output by the storage operation processing interface, for example, attribute information of an output format, an output type, etc. of the interface may be defined, an operation creation method may be used to receive a given path, the given path may be a parameter transmitted by an upper layer service program, and may be a logical storage path or a physical storage path for storing data, and the operation creation method may generate an object according to the given path, and the object may perform an operation on the stored data. The deletion method is operated, a given path can be received, and the objects stored in the given path are deleted according to the given path. The operation list method may be to receive a given path and generate an information list according to the objects in the given path, where the information list may include all the objects for data operation under the given path. An operation metadata method that may return metadata for a store operation processing interface. The operation reading method may be to acquire the content in the object according to a given path, and the content may be the operated storage data. The operation start method may acquire metadata of an object of a given path. The operation writing method may be to receive the data to be stored and write the data to be stored into the object of the given path, and it is understood that the given path may be a default storage path preset by a developer in addition to the parameter transmitted by the upper service program.
Further, on the basis of the above embodiment of the present invention, the storage service processing interface includes at least one of the following methods:
the processing logic of the service output method is used for formatting and outputting the attribute information of the storage service processing interface;
a service creation method, processing logic of the service creation method to create an instance of the storage operation processing interface;
a service deletion method, wherein the processing logic of the service transmission method is used for deleting the instance of the storage operation processing interface;
a service acquisition method, processing logic of the service acquisition method being for an instance of at least one of the storage operation processing interfaces;
a service list method, processing logic of the service list method to obtain a list of all instances of a storage operation processing interface.
Specifically, the storage service processing interface may include a service creation method, a service deletion method, a service acquirer, and a service list method, and the storage service processing interface may be developed using different development languages, where the service creation method may create an instance of a storage operation processing interface type, which may be used to implement a processing operation of data, a processing logic of the service transmission method is used to delete an instance of the storage operation processing interface, a processing logic of the service acquisition method is used to at least one instance of the storage operation processing interface, and a processing logic of the service list method is used to acquire a list of all instances of the storage operation processing interface.
Further, on the basis of the above embodiment of the present invention, the storage operation processing interface and/or the storage service processing interface further includes a context control method, and the context control method is configured to receive and save context information transmitted by the application layer.
In the embodiment of the present invention, the method in each interface in the operation interface library may include a context control method, and the method may be used to receive and store context information when the application layer transmission parameter is received, for example, the operation deletion method in the storage operation processing interface may generate a deletion context control method, and may receive context information when the application layer transmission parameter is received.
Further, on the basis of the above embodiment of the present invention, the operation interface library further includes:
the system comprises an additional writing interface, a data processing unit and a data processing unit, wherein the additional writing interface comprises a submission method, a creation method and a writing operation method, the processing logic of the submission method is used for submitting and completing additional writing operation, the processing logic of the creation method is used for creating an additional writing object, and the writing operation method is used for performing additional writing operation on a specified object;
the system comprises a block storage interface, a data processing interface and a data processing interface, wherein the block storage interface comprises a block merging method, a block creating method, a block list method and a block writing method, processing logic of the block merging method is used for merging at least two storage blocks into one object, processing logic of the block creating method is used for creating the object of one storage block, processing logic of the block list method is used for obtaining a list of all storage blocks of a given object, the block writing method and processing logic of the block writing method are used for writing data into a specified storage block;
a server side copy interface, the server side copy interface comprising a copy method, processing logic of the copy method being used to perform server side copy for a given object;
a directory operations interface comprising a target creation method, processing logic of the target creation method to create a directory object of a given type;
the interface comprises a grabber interface, wherein the grabber interface comprises a grabbing method, and the processing logic of the grabbing method is used for acquiring data according to the appointed uniform resource identifier and storing the data to an appointed path;
the mobile operation interface comprises a mobile method, and processing logic of the mobile method is used for acquiring a specified object and performing server-side mobile operation on the specified object;
the system comprises a segment uploading interface, a segment loading interface and a segment loading interface, wherein the segment uploading interface comprises an operation completion method, a segment starting method, a segment list method and a segment writing method, processing logic of the operation completion method is used for completing segment operation to generate a corresponding segment object, processing logic of the segment starting method is used for starting segment uploading operation, processing logic of the segment list method is used for acquiring all segment lists of specified segment objects, and the segment writing method is used for writing data into specified segments;
the page operation interface comprises a page creation method and a page writing method, wherein the processing logic of the page operation method is used for creating a page object of a specified type, and the processing logic of the page writing method is used for writing data into a specified page;
a link operation interface comprising a link read operation, wherein processing logic of the link read operation is to obtain a link of an object of a given path.
Specifically, in order to implement unique data operation when the storage service is switched, the operation interface library of each operator may further include one or more of an additional write interface, a block storage interface, a server copy interface, a directory operation interface, a fetcher interface, a mobile operation interface, a segment upload interface, a page operation interface, and a link operation interface.
The additional write interface can be composed of a submission method, a creation method and a write operation method, wherein the submission method is used for submitting and completing the additional write operation, the creation method is used for creating an additional write object, and the write operation method is used for performing the additional write operation on the specified object.
The block storage interface may be composed of a block merging method for merging a plurality of storage blocks into one object, a block creation method for creating an object of one storage block, a block list method for generating an information list of all storage blocks corresponding to a given object, and a block writing method for acquiring data and writing to a specified storage block.
The server-side copy interface includes a copy method for receiving a given object and making a server-side copy of the given object. A directory operation interface including a target creation method for creating a directory object of a given type; the grabber interface comprises a grabbing method, and the grabbing method is used for acquiring data according to the appointed uniform resource identifier and storing the data to an appointed path; the mobile operation interface comprises a mobile method, and the mobile method can acquire the specified object and carry out server-side mobile operation on the specified object.
The segment uploading interface can be used for processing data segment uploading, and specifically comprises an operation completion method, a segment opening method, a segment list method and a segment writing method, wherein the operation completion method can be used for completing segment uploading operation to obtain a corresponding object, the segment opening method can be used for opening segment uploading operation, the segment list method can be used for obtaining all segment information lists of a specified segment object, and the segment writing method can be used for writing data into a specified segment.
The page operation interface may be used for data and related random write operations, and includes a page creation method that may be used to create a specified type of page object and a page write method that may receive data and write the data to a specified data page.
The join operation may process links in the object, and specifically includes a link reading method that may read links included in the object of the given path.
Fig. 2 is a flowchart of another data migration method provided in an embodiment of the present invention, the embodiment of the present invention is embodied on the basis of the above embodiment of the present invention, and referring to fig. 2, the method provided in the embodiment of the present invention specifically includes the following steps:
And step 230, acquiring interface updating information, and updating an operation interface library corresponding to the operator according to the interface updating information.
The interface update information may be used to update information of processing logic of the interface, may be a code file edited by a developer or a storage address of the code file, and may further include information of an original interface to be replaced, for example, the interface update information may include one or more of information of an operator, an operation interface library, an interface name, and a method name that needs to be updated.
In the embodiment of the present invention, interface update information input by a user may be received, interface operation libraries of one or more operators may be updated according to the information, interfaces included in the interface operation libraries may be updated, or methods in interfaces in the interface operation libraries may be operated. It can be understood that the operation interface library may be designed for a user, and the operation interface library may be expanded according to an actual situation of the user, and the compatibility of the storage service data migration is realized by updating the operation interface library.
In an exemplary embodiment, the operation interface library in the embodiment of the present invention may be an interface library designed based on the GO language, an interface may be designed for different services and related basic operations of storage, a Storager interface may be included in the operation interface library, the interface is used to manage specific storage-related basic operations, and the interface defines the following method:
string method for formatting the relevant information of output Storager;
create method for creating an Object from a given path;
delete method, for deleting an Object according to a given path;
a List method for obtaining a corresponding Object List according to a given path;
metadata method for returning Metadata of Storager;
read method for reading the contents of an Object of a given path;
stat method for obtaining metadata of objects of a given path;
write method for writing data to an Object of a given path.
The operation interface library can also comprise a Servicer interface which manages a plurality of Storager interfaces from the service perspective, and the interface defines the following method:
string method for formatting the relevant information of the output service;
create method, used to Create a new Storager instance;
delete method, for deleting one Storager instance;
get method, used for getting an available Storager instance from the Servicer;
list method, used to get all Storager lists from the Server.
Further, the operation interface library may further include an appendix interface, which supports the additional write operation and defines the following method:
a CommitAppend method for committing and completing the append write operation process;
CreateAppend method for creating an additionally writable Object;
the WriteAppend method for performing an append write operation to a specified Object.
Further, the operation interface library may further include a Blocker interface for implementing operations related to block storage, and the defined method includes:
CombineBlock method, for grouping blocks into an Object;
CreateBlock method, used to create a block Object;
ListBlock method, used to get all block lists belonging to a certain Object;
the WriteBlock method, which is used to write data into a block.
Further, the operation interface library may further include a Copier interface, the Copier interface supports the server-side copy operation, and the defined method includes:
copy method, for performing a server-side Copy operation on an Object.
Further, the operation interface library may further include a Direr interface, which is an interface for operating on the directory, and defines a CreateDir method for creating an Object of type directory.
Further, the operation interface library may further include a Fetcher interface, which supports obtaining data through a Uniform Resource Locator (URL), and defines:
fetch method to get data from specified URL and store to specified path.
Further, the operation interface library may further include a Mover interface, which may support a server mobile operation, and defines:
move method, used to make one Object perform server side Move operation.
Further, the operation interface library may further include a Multiparter interface, which may be an interface supporting segment upload related operations, and defines:
CompleteMultipart method for completing segment upload operations to obtain corresponding objects;
a CreateMultipart method for starting a segment upload operation;
a ListMultipart method, which is used to obtain all the segment lists of some segment uploading Object;
the WriteMultipart method, which is used to write data into a certain segment.
Further, the operation interface library may further include Pager, which may be an interface supporting page-related random write operations, and defines:
CreatePage method for creating an Object of a page type;
the WritePage method is used to write data into a certain page.
Further, the operation interface library may further include a reader interface, which supports a link operation of obtaining an available Object, and defines:
reach method to get a link that can access a given path Object.
In each interface, besides the above-mentioned methods, each method also automatically generates a corresponding xxxxwthcontext method (e.g., DeleteWithContext method), so that the upper layer application can conveniently transfer the corresponding Context to perform Context control.
Here, an Object is a smallest Object unit abstraction defined in a unified manner, such as a File in a File System (FS) service, an Object in a cloud storage service, and the like, which can be regarded as an Object.
Fig. 3 is a schematic structural diagram of a data migration apparatus provided in an embodiment of the present invention, which is capable of executing a data migration method provided in any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. The device can be implemented by software and/or hardware, and specifically comprises: an information acquisition module 301 and a migration execution module 302.
An information obtaining module 301, configured to obtain storage service switching information, and determine an operator according to the storage service switching information.
A migration executing module 302, configured to process the storage service switching information according to the operation interface library corresponding to the operator, so as to complete data migration corresponding to the storage service switching information.
According to the embodiment of the invention, the information acquisition module is used for receiving the storage service switching information and determining the operator corresponding to the storage service switching information, the migration execution module is used for realizing the data migration corresponding to the storage service switching information according to the operation interface library corresponding to the operator, the storage difference between different storage service operators is shielded according to the operation interface library, operation and maintenance personnel do not need to change an upper-layer service program, the influence of the storage service migration on the upper-layer service program can be reduced, and the migration efficiency of the stored data can be improved.
Further, on the basis of the above embodiment of the invention, the operation interface library in the device at least includes: a storage operation processing interface and a storage service processing interface, wherein the storage service processing interface instantiates the storage operation interface.
Further, on the basis of the above embodiment of the present invention, the storing operation processing interface in the apparatus includes at least one of the following methods:
an operation output method, wherein the processing logic of the operation output method is used for formatting and outputting the attribute information of the storage operation processing interface;
an operation creation method, processing logic of the operation creation method to receive a given path and create an object for stored data of the given path;
an operation deletion method, processing logic of which is to receive a given path and delete an object of the given path;
an operation list method, processing logic of which is used to receive a given path and obtain an information list of objects of the given path;
an operation metadata method, processing logic of the operation metadata method to return metadata of the storage operation processing interface;
an operation reading method, wherein the processing logic of the operation reading method is used for reading the content of the object of the given path;
an operation initiation method, processing logic of the operation initiation method to obtain metadata for an object of a given path;
a write method is operated, the processing logic of which is used to write data to an object of a given path.
Further, on the basis of the above embodiment of the present invention, the storing of the service processing interface in the apparatus includes at least one of the following methods:
the processing logic of the service output method is used for formatting and outputting the attribute information of the storage service processing interface;
a service creation method, processing logic of the service creation method to create an instance of the storage operation processing interface;
a service deletion method, wherein the processing logic of the service transmission method is used for deleting the instance of the storage operation processing interface;
a service acquisition method, processing logic of the service acquisition method being for an instance of at least one of the storage operation processing interfaces;
a service list method, processing logic of the service list method to obtain a list of all instances of a storage operation processing interface.
Further, on the basis of the above embodiment of the present invention, the storage operation processing interface and/or the storage service processing interface in the apparatus further includes a context control method, and the context control method is configured to receive and save context information transmitted by an application layer.
Further, on the basis of the above embodiment of the present invention, the operation interface library in the apparatus further includes:
the system comprises an additional writing interface, a data processing unit and a data processing unit, wherein the additional writing interface comprises a submission method, a creation method and a writing operation method, the processing logic of the submission method is used for submitting and completing additional writing operation, the processing logic of the creation method is used for creating an additional writing object, and the writing operation method is used for performing additional writing operation on a specified object;
the system comprises a block storage interface, a data processing interface and a data processing interface, wherein the block storage interface comprises a block merging method, a block creating method, a block list method and a block writing method, processing logic of the block merging method is used for merging at least two storage blocks into one object, processing logic of the block creating method is used for creating the object of one storage block, processing logic of the block list method is used for obtaining a list of all storage blocks of a given object, the block writing method and processing logic of the block writing method are used for writing data into a specified storage block;
a server side copy interface, the server side copy interface comprising a copy method, processing logic of the copy method being used to perform server side copy for a given object;
a directory operations interface comprising a target creation method, processing logic of the target creation method to create a directory object of a given type;
the interface comprises a grabber interface, wherein the grabber interface comprises a grabbing method, and the processing logic of the grabbing method is used for acquiring data according to the appointed uniform resource identifier and storing the data to an appointed path;
the mobile operation interface comprises a mobile method, and processing logic of the mobile method is used for acquiring a specified object and performing server-side mobile operation on the specified object;
the system comprises a segment uploading interface, a segment loading interface and a segment loading interface, wherein the segment uploading interface comprises an operation completion method, a segment starting method, a segment list method and a segment writing method, processing logic of the operation completion method is used for completing segment operation to generate a corresponding segment object, processing logic of the segment starting method is used for starting segment uploading operation, processing logic of the segment list method is used for acquiring all segment lists of specified segment objects, and the segment writing method is used for writing data into specified segments;
the page operation interface comprises a page creation method and a page writing method, wherein the processing logic of the page operation method is used for creating a page object of a specified type, and the processing logic of the page writing method is used for writing data into a specified page;
a link operation interface comprising a link read operation, wherein processing logic of the link read operation is to obtain a link of an object of a given path.
Further, on the basis of the above embodiment of the invention, the apparatus further includes:
and the interface updating module is used for acquiring interface updating information and updating the operation interface library corresponding to the operator according to the interface updating information.
Fig. 4 is a schematic structural diagram of a computer device according to an embodiment of the present invention, and fig. 4 is a block diagram of a computer device 312 suitable for implementing an embodiment of the present invention. The computer device 312 shown in FIG. 4 is only an example and should not bring any limitations to the functionality or scope of use of embodiments of the present invention. The device 312 is a computing device for update functionality of a typical intelligent robot map.
As shown in FIG. 4, computer device 312 is in the form of a general purpose computing device. The components of computer device 312 may include, but are not limited to: one or more processors 316, a storage device 328, and a bus 318 that couples the various system components including the storage device 328 and the processors 316.
The computer device 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, camera, display 324, etc.), with one or more devices that enable a user to interact with the computer device 312, and/or with any devices (e.g., network card, modem, etc.) that enable the computer device 312 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 322. Also, computer device 312 may communicate with one or more networks (e.g., a Local Area Network (LAN), Wide Area Network (WAN), etc.) and/or a public Network, such as the internet, via Network adapter 320. As shown, network adapter 320 communicates with the other modules of computer device 312 via bus 318. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the computer device 312, including but not limited to: microcode, device drivers, Redundant processing units, external disk drive Arrays, disk array (RAID) systems, tape drives, and data backup storage systems, to name a few.
Embodiments of the present invention provide a computer-readable storage medium on which a computer program is stored, where the computer program, when executed by a processing apparatus, implements a data migration method as in the embodiments of the present invention. The computer readable medium of the present invention described above may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the computer device; or may exist separately and not be incorporated into the computer device.
The computer readable medium carries one or more programs which, when executed by the computing device, cause the computing device to: acquiring storage service switching information, and determining an operator according to the storage service switching information; and processing the storage service switching information according to the operation interface library corresponding to the operator to complete data migration corresponding to the storage service switching information.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A method of data migration, the method comprising:
acquiring storage service switching information, and determining an operator according to the storage service switching information;
and processing the storage service switching information according to the operation interface library corresponding to the operator to complete data migration corresponding to the storage service switching information.
2. The method of claim 1, wherein the operation interface library comprises at least: a storage operation processing interface and a storage service processing interface, wherein the storage service processing interface instantiates the storage operation interface.
3. The method of claim 2, wherein the storage operation processing interface comprises at least one of:
an operation output method, wherein the processing logic of the operation output method is used for formatting and outputting the attribute information of the storage operation processing interface;
an operation creation method, processing logic of the operation creation method to receive a given path and create an object for stored data of the given path;
an operation deletion method, processing logic of which is to receive a given path and delete an object of the given path;
an operation list method, processing logic of which is used to receive a given path and obtain an information list of objects of the given path;
an operation metadata method, processing logic of the operation metadata method to return metadata of the storage operation processing interface;
an operation reading method, wherein the processing logic of the operation reading method is used for reading the content of the object of the given path;
an operation initiation method, processing logic of the operation initiation method to obtain metadata for an object of a given path;
a write method is operated, the processing logic of which is used to write data to an object of a given path.
4. The method of claim 3, wherein the storage service processing interface comprises at least one of:
the processing logic of the service output method is used for formatting and outputting the attribute information of the storage service processing interface;
a service creation method, processing logic of the service creation method to create an instance of the storage operation processing interface;
a service deletion method, wherein the processing logic of the service transmission method is used for deleting the instance of the storage operation processing interface;
a service acquisition method, processing logic of the service acquisition method being for an instance of at least one of the storage operation processing interfaces;
a service list method, processing logic of the service list method to obtain a list of all instances of a storage operation processing interface.
5. The method according to claim 3 or 4, wherein the storage operation processing interface and/or the storage service processing interface further comprises a context control method for receiving and saving context information transferred by an application layer.
6. The method of claim 2, wherein the operation interface library further comprises:
the system comprises an additional writing interface, a data processing unit and a data processing unit, wherein the additional writing interface comprises a submission method, a creation method and a writing operation method, the processing logic of the submission method is used for submitting and completing additional writing operation, the processing logic of the creation method is used for creating an additional writing object, and the writing operation method is used for performing additional writing operation on a specified object;
the system comprises a block storage interface, a data processing interface and a data processing interface, wherein the block storage interface comprises a block merging method, a block creating method, a block list method and a block writing method, processing logic of the block merging method is used for merging at least two storage blocks into one object, processing logic of the block creating method is used for creating the object of one storage block, processing logic of the block list method is used for obtaining a list of all storage blocks of a given object, the block writing method and processing logic of the block writing method are used for writing data into a specified storage block;
a server side copy interface, the server side copy interface comprising a copy method, processing logic of the copy method being used to perform server side copy for a given object;
a directory operations interface comprising a target creation method, processing logic of the target creation method to create a directory object of a given type;
the interface comprises a grabber interface, wherein the grabber interface comprises a grabbing method, and the processing logic of the grabbing method is used for acquiring data according to the appointed uniform resource identifier and storing the data to an appointed path;
the mobile operation interface comprises a mobile method, and processing logic of the mobile method is used for acquiring a specified object and performing server-side mobile operation on the specified object;
the system comprises a segment uploading interface, a segment loading interface and a segment loading interface, wherein the segment uploading interface comprises an operation completion method, a segment starting method, a segment list method and a segment writing method, processing logic of the operation completion method is used for completing segment operation to generate a corresponding segment object, processing logic of the segment starting method is used for starting segment uploading operation, processing logic of the segment list method is used for acquiring all segment lists of specified segment objects, and the segment writing method is used for writing data into specified segments;
the page operation interface comprises a page creation method and a page writing method, wherein the processing logic of the page operation method is used for creating a page object of a specified type, and the processing logic of the page writing method is used for writing data into a specified page;
a link operation interface comprising a link read operation, wherein processing logic of the link read operation is to obtain a link of an object of a given path.
7. The method of claim 1, further comprising:
and acquiring interface updating information, and updating an operation interface library corresponding to the operator according to the interface updating information.
8. An apparatus for data migration, the apparatus comprising:
the information acquisition module is used for acquiring storage service switching information and determining an operator according to the storage service switching information;
and the migration execution module is used for processing the storage service switching information according to the operation interface library corresponding to the operator so as to complete data migration corresponding to the storage service switching information.
9. A computer device, characterized in that the computer device comprises:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the data migration method of any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the data migration method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110924125.3A CN113485981A (en) | 2021-08-12 | 2021-08-12 | Data migration method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110924125.3A CN113485981A (en) | 2021-08-12 | 2021-08-12 | Data migration method and device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113485981A true CN113485981A (en) | 2021-10-08 |
Family
ID=77945078
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110924125.3A Pending CN113485981A (en) | 2021-08-12 | 2021-08-12 | Data migration method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113485981A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160371151A1 (en) * | 2015-06-18 | 2016-12-22 | Fujitsu Limited | Information processing system, information processing apparatus, and information processing apparatus control method |
| CN108268501A (en) * | 2016-12-30 | 2018-07-10 | 中国移动通信集团北京有限公司 | Method for processing business and device in a kind of online data transition process |
| US10083199B1 (en) * | 2016-05-23 | 2018-09-25 | Sprint Communications Company L.P. | Data migration in active data store |
| CN109067823A (en) * | 2018-06-11 | 2018-12-21 | 中国平安人寿保险股份有限公司 | A kind of data migration method, device, computer equipment and storage medium |
| US20200167240A1 (en) * | 2018-11-27 | 2020-05-28 | Commvault Systems, Inc. | Generating backup copies through interoperability between components of a data storage management system and appliances for data storage and deduplication |
| CN111736945A (en) * | 2019-08-07 | 2020-10-02 | 北京京东尚科信息技术有限公司 | Virtual machine thermal migration method, device, equipment and medium based on intelligent network card |
| CN112099918A (en) * | 2019-09-13 | 2020-12-18 | 谷歌有限责任公司 | Live migration of clusters in containerized environments |
| CN112190951A (en) * | 2020-10-28 | 2021-01-08 | 网易（杭州）网络有限公司 | Operation data migration method, device, equipment and storage medium |
-
2021
- 2021-08-12 CN CN202110924125.3A patent/CN113485981A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160371151A1 (en) * | 2015-06-18 | 2016-12-22 | Fujitsu Limited | Information processing system, information processing apparatus, and information processing apparatus control method |
| US10083199B1 (en) * | 2016-05-23 | 2018-09-25 | Sprint Communications Company L.P. | Data migration in active data store |
| CN108268501A (en) * | 2016-12-30 | 2018-07-10 | 中国移动通信集团北京有限公司 | Method for processing business and device in a kind of online data transition process |
| CN109067823A (en) * | 2018-06-11 | 2018-12-21 | 中国平安人寿保险股份有限公司 | A kind of data migration method, device, computer equipment and storage medium |
| US20200167240A1 (en) * | 2018-11-27 | 2020-05-28 | Commvault Systems, Inc. | Generating backup copies through interoperability between components of a data storage management system and appliances for data storage and deduplication |
| CN111736945A (en) * | 2019-08-07 | 2020-10-02 | 北京京东尚科信息技术有限公司 | Virtual machine thermal migration method, device, equipment and medium based on intelligent network card |
| CN112099918A (en) * | 2019-09-13 | 2020-12-18 | 谷歌有限责任公司 | Live migration of clusters in containerized environments |
| CN112190951A (en) * | 2020-10-28 | 2021-01-08 | 网易（杭州）网络有限公司 | Operation data migration method, device, equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 肖迪: "计算机云存储的数据迁移研究", 《网络安全技术与应用》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109634598B (en) | Page display method, device, equipment and storage medium | |
| US10216815B2 (en) | Shipping of data through ETL stages | |
| US10146671B2 (en) | Testing of software upgrade | |
| US10877846B2 (en) | Performing a closure merge operation | |
| CN106909597B (en) | Database migration method and device | |
| CN112965761B (en) | Data processing method, system, electronic equipment and storage medium | |
| CN115757400A (en) | Data table processing method and device, electronic equipment and computer readable medium | |
| CN111857720A (en) | Method and device for generating user interface state information, electronic equipment and medium | |
| US8589454B2 (en) | Computer data file merging based on file metadata | |
| US9703848B2 (en) | Caching linked queries for optimized compliance management | |
| CN113971037A (en) | Application processing method and device, electronic equipment and storage medium | |
| CN109614383B (en) | Data copying method and device, electronic equipment and storage medium | |
| CN113485981A (en) | Data migration method and device, computer equipment and storage medium | |
| CN116049142A (en) | Data processing method, device, electronic equipment and storage medium | |
| CN114090124A (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN114265846A (en) | Data operation method and device, electronic equipment and storage medium | |
| CN112988583A (en) | Method and device for testing syntax compatibility of database | |
| CN113806327A (en) | Database design method and device and related equipment | |
| CN110377326B (en) | Installation package generation method, installation package generation device, development device and computer readable medium | |
| US11010151B2 (en) | Software patch ordering | |
| CN116931894A (en) | Configuration method, device, equipment and medium for field uniqueness | |
| CN113326231A (en) | Picture resource processing method and device | |
| CN117648117A (en) | Code branch management method, system, electronic equipment and storage medium | |
| CN112905164A (en) | Project code processing method and device | |
| CN111857879A (en) | Data processing method and device, electronic equipment and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 100000 Unit 501A, Floor 5, 101, Building 1, Yard 5, Laiguangying West Road, Chaoyang District, Beijing Applicant after: Beijing Qingyun Science and Technology Co.,Ltd. Address before: 100020 601, 6 floor, 16 building, No. 36 Chuang Yuan Road, Chaoyang District, Beijing. Applicant before: Beijing Qingyun Science and Technology Co.,Ltd. |
|
| CB02 | Change of applicant information |