CN113542282A - Cross-computing center file transmission method, device, equipment and storage medium - Google Patents
Cross-computing center file transmission method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113542282A CN113542282A CN202110809524.5A CN202110809524A CN113542282A CN 113542282 A CN113542282 A CN 113542282A CN 202110809524 A CN202110809524 A CN 202110809524A CN 113542282 A CN113542282 A CN 113542282A
- Authority
- CN
- China
- Prior art keywords
- file
- transmitted
- computing center
- task
- control agent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0807—Network architectures or network communication protocols for network security for authentication of entities using tickets, e.g. Kerberos
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Abstract
The embodiment of the invention discloses a method, a device, equipment and a storage medium for transmitting a cross-computing center file. The method comprises the following steps: acquiring a task to be transmitted of a file; the task to be transmitted of the file comprises information of the file to be transmitted, information of a source computing center and information of a target computing center; according to the task to be transmitted, the file to be transmitted is transmitted to the target computing center from the source computing center; wherein, data intercommunication is realized between any two computing centers through a data link. By the technical scheme of the embodiment of the invention, the user can conveniently realize data migration in a plurality of different-place computing environments, the working efficiency is improved, and the management cost of a computing center is saved.
Description
Technical Field
The embodiment of the invention relates to a data transmission technology, in particular to a method, a device, equipment and a storage medium for transmitting a cross-computing center file.
Background
With the combination of cloud computing and conventional high-performance computers, a user can connect to the high-performance computers of a plurality of computing centers via the internet and can select an environment suitable for the user's own program or an environment with free resources to run a job. However, when a user uses a plurality of high-performance computer environments and uses the same computing program, it is necessary to migrate an input data file of the program or a result file generated by an operation from one environment to another environment.
In the prior art, data migration is mainly completed in two ways: 1. a user needs to copy data to a hard disk, then sends the data to another environment, and can use the data after a series of operations such as inserting the hard disk, mounting, setting authority and the like, and the data can be used only after the operations of inserting the hard disk, mounting and setting the authority, and the data can be used only by the intervention of an administrator; 2. the user downloads the data file to a personal computer via the internet and then transfers the data file to another environment.
As described above, if the first method is used, the small files need to be downloaded and uploaded by themselves or transferred and transmitted by a hard disk, and the process is too complicated; if the second method is used, it is almost impossible to transmit large files due to the limitations of the hard disk capacity of the personal computer and the problem of network stability, and two-step transmission is required. Therefore, the data migration completion mode not only reduces the working efficiency and is higher in implementation cost, but also is not convenient for users to use.
Disclosure of Invention
The embodiment of the invention provides a method, a device, equipment and a storage medium for transmitting a file across a computing center, so as to improve the rapidity of the file across the computing center.
In a first aspect, an embodiment of the present invention provides a method for transferring a file across a compute farm, including:
acquiring a task to be transmitted of a file; the task to be transmitted of the file comprises information of the file to be transmitted, information of a source computing center and information of a target computing center;
according to the task to be transmitted, the file to be transmitted is transmitted to the target computing center from the source computing center; wherein, data intercommunication is realized between any two computing centers through a data link.
Optionally, transmitting the file to be transmitted from the source computing center to the target computing center according to the task to be transmitted of the file includes:
generating a file transmission instruction according to the task to be transmitted of the file, and sending the file transmission instruction to a control agent service of the source computing center or the target computing center;
and transmitting the file to be transmitted from the source computing center to the target computing center through the control agent service according to the file transmission instruction.
In the technical scheme, the cross-computing center transmission of the files is realized through the control agent service deployed in each computing center according to the file transmission instruction, so that the transmission of the files across the computing centers is simple and convenient, and the management cost of the computing centers is lower.
Optionally, the transmitting the file to be transmitted from the source computing center to the target computing center according to the file transmission instruction by the control agent service includes:
transmitting the file to be transmitted from the source computing center to the target computing center through the control agent service according to the file transmission instruction based on a file management service; wherein each computing center is deployed with a file management service.
In the technical scheme, the control agent service and the file management service are deployed in each computing center, so that the control agent service can conveniently acquire the file related to the file transmission instruction when the file is transmitted across the computing centers.
Optionally, when the file to be transmitted is transmitted from the source computing center to the target computing center according to the file transmission instruction through the control agent service, the method further includes:
and reporting the current task state of the task to be transmitted of the file through the control agent service.
According to the technical scheme, the state monitoring of the cross-computing-center transmission of the file corresponding to the task to be transmitted is realized, and convenience is provided for a user to check the current state of the task in real time.
Optionally, when the current task state of the task to be transmitted in the file is reported through the control agent service, the method further includes:
responding to a file transmission control request, generating a file transmission control instruction corresponding to the file transmission control request, and sending the file transmission control instruction to the control agent service;
and managing the execution of the task of the file to be transmitted according to the file transmission control instruction through the control agent service.
According to the technical scheme, the management and control of the transmission of the file corresponding to the task to be transmitted across the computing center can be realized during the execution of the task to be transmitted.
Optionally, before obtaining the task to be transmitted, the method further includes:
and responding to a file transmission request, and generating a task to be transmitted of the file corresponding to the file transmission request based on file management services of the source computing center and the target computing center.
According to the technical scheme, the task to be transmitted of the file is generated based on the file management service deployed in the computing center, so that the file in the computing center is convenient to manage, and convenience is provided for a user to perform related operations when the file is transmitted across the computing center.
Optionally, before obtaining the task to be transmitted, the method further includes:
the authentication of an access user who initiates the task to be transmitted of the file is completed by combining a file management system; wherein the file management system is a management system corresponding to the file management service.
According to the technical scheme, the access user is authenticated, so that the file transmission safety is ensured, and the malicious file transmission operation of an illegal user is avoided.
In a second aspect, an embodiment of the present invention further provides a device for transferring a file across a computing center, where the device includes:
the task acquisition module is used for acquiring a task to be transmitted of a file; the task to be transmitted of the file comprises information of the file to be transmitted, information of a source computing center and information of a target computing center;
the file transmission module is used for transmitting the file to be transmitted to the target computing center from the source computing center according to the task to be transmitted of the file; wherein, data intercommunication is realized between any two computing centers through a data link.
In a third aspect, an embodiment of the present invention further provides a computer device, where the computer device includes:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a method according to any one of the embodiments of the invention.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the method according to any embodiment of the present invention.
According to the technical scheme of the embodiment of the invention, the file to be transmitted required by the user is transmitted to the target computing center from the source computing center, so that the user can conveniently realize data migration in a plurality of different-place computing environments, the working efficiency is improved, and the management cost of the computing center is saved.
Drawings
FIG. 1 is a flowchart of a cross-compute farm file transfer method according to a first embodiment of the present invention;
FIG. 2 is a schematic diagram of a cross-computing-center platform interconnection architecture according to an embodiment of the present invention;
FIG. 3 is a flowchart of a cross-compute farm file transfer method according to a second embodiment of the present invention;
FIG. 4 is a diagram illustrating a state change of a cross-compute farm file transfer task according to a second embodiment of the present invention;
FIG. 5 is a flowchart of a cross-compute farm file transfer method according to a third embodiment of the present invention;
fig. 6 is a schematic diagram illustrating an authentication process of an access user according to a third embodiment of the present invention;
FIG. 7 is a schematic structural diagram of a cross-computing center file transfer apparatus according to a fourth embodiment of the present invention;
fig. 8 is a schematic structural diagram of a computer device in the fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a cross-computing center file transfer method according to an embodiment of the present invention, where the embodiment is applicable to a data migration situation in multiple remote computing environments, and the method may be executed by a cross-computing center file transfer apparatus, where the apparatus may be implemented in a hardware and/or software manner, and may be generally integrated in a computer device, and specifically includes the following steps:
and S110, acquiring a task of the file to be transmitted.
The task to be transmitted of the file comprises information of the file to be transmitted, information of a source computing center and information of a target computing center.
The task of the file to be transmitted refers to a task for instructing the file to be transmitted to transmit among the computing centers, for example, a task for transmitting the target file from the computing center a to the computing center B. The present embodiment does not limit this.
A source computing center, which may also be referred to as a source cluster, refers to a computing center or cluster in which a file that a user wants to copy or download is located. The information of the source computing center refers to relevant information for uniquely describing the source computing center, for example, a network address or an identity of the source computing center, and the present embodiment does not limit this.
The target computing center, which may also be referred to as a target cluster, refers to a computing center or a cluster in which a user wants to copy or download a file of a source computing center and then store the file of the source computing center. The information of the target computing center refers to relevant information for uniquely describing the target computing center, for example, a network address or an identity of the target computing center, and the present embodiment does not limit this.
And S120, transmitting the file to be transmitted from the source computing center to the target computing center according to the task to be transmitted of the file.
After the task to be transmitted of the file is obtained, the task to be transmitted of the file is analyzed, the related file to be transmitted, the source computing center and the target computing center are obtained, and then the operation that the file to be transmitted is transmitted from the source computing center to the target computing center is controlled and executed.
In the embodiment, data intercommunication is realized between any two computing centers through a data link.
Referring to a platform interconnection architecture across computing centers as shown in fig. 2, multiple computing centers are interconnected together through the internet (or local area network). The control center is connected with each computing center based on the control link, and data intercommunication is realized between any two computing centers through the data link. The control center can send a control instruction to any one of the computing centers based on the control link to realize the operation of transmitting the file to be transmitted between the related computing centers.
Specifically, after the control center obtains the task to be transmitted of the file, the control center analyzes the task to be transmitted of the file, generates a control instruction corresponding to the task to be transmitted of the file according to an analysis result, and then sends the control instruction to a related computing center, so that the computing center completes the cross-computing center transmission of the file based on the data link.
Optionally, the platform across the computing center may provide an access interface (such as a browser interface) for a user, receive a file transmission requirement submitted by the user, and generate a corresponding task to be transmitted for the file based on the file transmission requirement.
According to the technical scheme of the embodiment of the invention, the file to be transmitted required by the user is transmitted to the target computing center from the source computing center, so that the user can conveniently realize data migration in a plurality of different-place computing environments, the working efficiency is improved, and the management cost of the computing center is saved.
Example two
Fig. 3 is a flowchart of a cross-computing center file transfer method according to a second embodiment of the present invention. The embodiment is refined based on the above embodiment, wherein the transmitting the file to be transmitted from the source computing center to the target computing center may specifically be: generating a file transmission instruction according to the task to be transmitted of the file, and sending the file transmission instruction to a control agent service of the source computing center or the target computing center; and transmitting the file to be transmitted from the source computing center to the target computing center through the control agent service according to the file transmission instruction.
As shown in fig. 3, the method comprises the following specific steps:
and S210, acquiring a task to be transmitted of the file.
S220, generating a file transmission instruction according to the task to be transmitted of the file, and sending the file transmission instruction to a control agent service of the source computing center or the target computing center.
The file transfer instruction refers to an instruction for instructing to perform a file transfer operation. The file transmission instruction may be generated by the control center according to a task to be transmitted of the file, and may be generally sent to the relevant computing center through a control link.
In this embodiment, a control agent service is deployed in each computing center for performing relevant operations according to instructions sent by the control center.
The file transmission instruction can be sent to the control agent service of the source computing center and can also be sent to the control agent service of the target computing center. According to the different identity roles of the computing center where the control agent service is located in the task to be transmitted of the file, the file transmission instructions can also not be completely the same.
And S230, transmitting the file to be transmitted from the source computing center to the target computing center through the control agent service according to the file transmission instruction.
The control agent service (whether the control agent service of the source computing center or the control agent service of the target computing center) which receives the file transmission instruction executes the operation of transmitting the file to be transmitted from the source computing center to the target computing center.
If the file transmission instruction is sent to the control agent service of the source computing center, the control agent service of the source computing center sends the file to be transmitted to a target computing center corresponding to the file transmission instruction according to the file information to be transmitted analyzed from the file transmission instruction; if the file transmission instruction is sent to the control agent service of the target computing center, the control agent service of the target computing center pulls the file to be transmitted from the source computing center corresponding to the file transmission instruction according to the file information to be transmitted analyzed from the file transmission instruction.
Optionally, when the file to be transmitted is transmitted from the source computing center to the target computing center according to the file transmission instruction through the control agent service, the method further includes:
and reporting the current task state of the task to be transmitted of the file through the control agent service.
The current task state refers to a current state of the execution of the task to be transmitted, and may be, for example, a state in which the task is in preparation, in transmission, completed, cleared, interrupted, cancelled, and suspended. In the task preparation, the size and the network bandwidth of a file in a source computing center are estimated, the quota size and the authority of a target computing center are judged, and a folder is packaged; the task transmission refers to executing a transmission stage, and transmitting files integrally or in a slicing manner; the task is completed, namely the file is decompressed to a target computing center, the authority is processed, and the integrity and the correctness of the file are verified; the task is cleared, namely the cleaning work of the temporary file is finished after the file transmission is finished; the task is interrupted to indicate that when the transmission is overtime or an error is reported in the transmission process, the task is automatically changed into an interruption state, and if the continuous transmission is realized through an automatic retry mechanism, the state is changed into the transmission process; the task is cancelled, namely the user actively cancels the transmission task; task suspended means that the user has actively suspended the transmission task.
The control agent service monitors the current task state of the task to be transmitted of the file and reports the current task state of the task to be transmitted of the file to the control center. The control center can display or store the current task state of the file to-be-transmitted task reported by the control agent service through an interface, so that a user can conveniently check the execution condition of the file to-be-transmitted task.
According to the technical scheme, the state monitoring of the cross-computing center transmission of the file corresponding to the task to be transmitted is realized, and convenience is provided for a user to check the current state of the task in real time.
Optionally, when the current task state of the task to be transmitted in the file is reported through the control agent service, the method further includes:
responding to a file transmission control request, generating a file transmission control instruction corresponding to the file transmission control request, and sending the file transmission control instruction to the control agent service; and managing the execution of the task of the file to be transmitted according to the file transmission control instruction through the control agent service.
The file transfer control request refers to a request initiated by a user for performing relevant control on the execution of a file transfer task, for example, a request for canceling the file transfer task, a request for interrupting the file transfer task, or a request for suspending the file transfer task, which is not limited in this embodiment. The file transfer control instruction refers to an instruction for performing relevant control on file transfer, and corresponds to a file transfer control request initiated by a user.
Switching the current task state of the task to be transmitted by the file is shown in fig. 4. The switching of the current task state can be realized based on various file transmission control requests initiated by a user.
Specifically, if a user initiates a request for canceling a file transmission task, the control center generates a file transmission control instruction for canceling the file transmission task, and if the control instruction for canceling the file transmission task is sent to the control agent service of the source computing center, the control agent service of the source computing center cancels the operation of sending a file to the target computing center or rejects the file pulling operation of the target computing center; if the control instruction for canceling the file transmission task is sent to the control agent service of the target computing center, the target computing center cancels the operation of pulling the file from the source computing center.
According to the technical scheme, the management and control of the transmission of the file corresponding to the task to be transmitted across the computing center can be realized during the execution of the task to be transmitted.
For those parts of this embodiment that are not explained in detail, reference is made to the aforementioned embodiments, which are not repeated herein.
According to the technical scheme of the embodiment of the invention, the cross-computing center transmission of the files is realized through the control agent service deployed in each computing center according to the file transmission instruction, so that the cross-computing center transmission of the files is simple and convenient, and the management cost of the computing center is lower.
EXAMPLE III
Fig. 5 is a flowchart of a cross-computing center file transfer method according to a third embodiment of the present invention. The embodiment is refined based on the above embodiment, wherein the step of transmitting the file to be transmitted from the source computing center to the target computing center for refinement through the control agent service according to the file transmission instruction may specifically be that: transmitting the file to be transmitted from the source computing center to the target computing center through the control agent service according to the file transmission instruction based on a file management service; wherein each computing center is deployed with a file management service.
As shown in fig. 5, the method includes the following specific steps:
s310, acquiring a task of the file to be transmitted.
S320, generating a file transmission instruction according to the task to be transmitted of the file, and sending the file transmission instruction to a control agent service of the source computing center or the target computing center.
S330, transmitting the file to be transmitted from the source computing center to the target computing center through the control agent service according to the file transmission instruction based on a file management service.
In this embodiment, each of the computing centers is also deployed with a file management service in addition to a control agent service.
The file management service provides a file access interface for the computing center, and can realize functions of file control, file list acquisition, file uploading, file downloading, file preview and editing.
Specifically, when the file management service executes file uploading, the file management service may be implemented by: the front end divides the front end large files based on the webUploader and uploads the files one by one; and merging the fragments by the background, and renaming the temporary file to the related operation of the specified directory.
When file downloading (the essence of file downloading is the reverse operation of fragment uploading) is performed, the file management service can be implemented by the following operations: receiving a file downloading request through a front end, wherein a request header carries Range header information to mark a data segment required by the request; the back end judges the information segment required to be acquired by the request by extracting the response header information, intercepts the data at the specified position from the file, and returns the data to the front end, if the Range request header does not exist or the Range does not have a value, the data is downloaded from the beginning (namely, ordinary downloading).
The file preview function can be realized by downloading files and a front-end preview component; the file editing function can be realized through a front-end editing component and an uploading function.
Specifically, the explanation is given by taking an example of sending a file transmission control instruction to a target computing center to realize the transmission of a file across computing centers. After the control center obtains the task to be transmitted of the file, a file transmission instruction is generated according to the task to be transmitted of the file, and the file transmission instruction is sent to a control agent service of a target computing center corresponding to the task to be transmitted of the file. The control agent service of the target computing center can obtain the relevant information of the source computing center and the file to be transmitted based on the file downloading instruction analysis, namely, the operation of pulling the file to be transmitted in the source computing center can be executed according to the relevant information of the source computing center and the file to be transmitted, wherein when the target computing center executes the file pulling operation, the target computing center can obtain the relevant file based on the file management service in the source computing center so as to successfully complete the file pulling operation.
Optionally, before obtaining the task to be transmitted, the method further includes:
and responding to a file transmission request, and generating a task to be transmitted of the file corresponding to the file transmission request based on file management services of the source computing center and the target computing center.
A file transfer request refers to a request initiated by a user on demand to instruct a file to be transferred across a computing center. The file transmission request at least carries information of a file to be transmitted, information of a source computing center, information of a target computing center and the like. And generating a task to be transmitted of the file corresponding to the file transmission request according to the file transmission request.
Specifically, a file to-be-transmitted task corresponding to the file transmission request may be generated based on file management services of the source computing center and the target computing center.
The functions of file control and file list acquisition can be realized through a file management service deployed in the computing center. The user may perform related operations based on a file management service deployed by the computing center to initiate the file transfer request.
When the file management service implements file control, basic operations such as deletion, copy, movement, renaming, and the like of a file in a file system can be implemented through an Application Programming Interface (API) related to a file under an NIO (New Input Output, New property) package.
When the file management service acquires the file list, the file list under the specified directory can be acquired through the control center API, the file list with the specified length is intercepted in a streaming mode, and the detailed POSIX (Portable Operating System Interface) attribute and the extended attribute of the files in the file list are acquired and packaged.
After a file transmission request initiated by a user is received, the file transmission request is analyzed to obtain related information of file cross-center transmission, and further related information related to a task of the file to be transmitted, such as a source storage address and a target storage address of the file to be transmitted, can be determined based on a file management service deployed in a computing center.
According to the technical scheme, the task to be transmitted of the file is generated based on the file management service deployed in the computing center, so that the file in the computing center is convenient to manage, and convenience is provided for a user to perform related operations when the file is transmitted across the computing center.
As an optional implementation manner, before obtaining the file to be transmitted, the method may further include: the authentication of an access user who initiates the task to be transmitted of the file is completed by combining a file management system; wherein the file management system is a management system corresponding to the file management service.
In this embodiment, the authentication may be that the control center combines with the file management system to authenticate the access user, that is, the control center across the computing center platform and the file management system together authenticate the access user. The platform crossing the computing center can realize the authentication, resource management, computing center and account management of the user, and a unified WEB access interface.
Referring to fig. 6, the specific authentication process may be as follows:
1) a user accesses a control center crossing a computing center platform through a browser to enter a file management system;
2) the control center generates an authentication token and redirects the authentication token to an authentication interface of the file management system;
3) the browser interface is redirected to an authentication interface of the file management system;
4) the file management system initiates an authentication request to the control center through an authentication token when a user accesses the file management system;
5) the control center returns the information of the authenticated user corresponding to the computing center according to the authenticated user information and the account information;
6) the file management system judges the information of the access user according to the information of the authenticated user, when the information of the access user is in accordance with the information (such as user information and account information) of the authenticated user, the authentication of the access user is passed, the file management system releases the access of the user, otherwise, the authentication of the access user is not passed, and the file management system refuses the access of the user.
According to the technical scheme, the access user is authenticated, so that the file transmission safety is ensured, and the malicious file transmission operation of an illegal user is avoided.
For those parts of this embodiment that are not explained in detail, reference is made to the aforementioned embodiments, which are not repeated herein.
In the technical scheme of this embodiment, in addition to the control agent service, a file management service is also deployed in each computing center, so that the control agent service can conveniently acquire files related to file transmission instructions when the control agent service realizes the transmission of the files across the computing centers.
Example four
Fig. 7 is a schematic structural diagram of a cross-computing center file transmission apparatus according to a fourth embodiment of the present invention, which can execute the cross-computing center file transmission method related in the foregoing embodiments. The device may be implemented in software and/or hardware, and as shown in fig. 7, the device for transferring files across a computing center specifically includes: a task acquisition module 410 and a file transmission module 420.
The task obtaining module 410 is configured to obtain a task to be transmitted by a file; the task to be transmitted of the file comprises information of the file to be transmitted, information of a source computing center and information of a target computing center;
the file transmission module 420 is configured to transmit the file to be transmitted from the source computing center to the target computing center according to the task to be transmitted; wherein, data intercommunication is realized between any two computing centers through a data link.
According to the technical scheme of the embodiment of the invention, the file to be transmitted required by the user is transmitted to the target computing center from the source computing center, so that the user can conveniently realize data migration in a plurality of different-place computing environments, the working efficiency is improved, and the management cost of the computing center is saved.
Optionally, the file transmission module 420 includes a file transmission instruction sending unit and a file transmission unit to be transmitted;
the file transmission instruction sending unit is used for generating a file transmission instruction according to the task to be transmitted of the file and sending the file transmission instruction to a control agent service of the source computing center or the target computing center;
and the file transmission unit to be transmitted is used for transmitting the file to be transmitted from the source computing center to the target computing center through the control agent service according to the file transmission instruction.
Optionally, the file transmission unit to be transmitted may be specifically configured to transmit, by the control agent service, the file to be transmitted from the source computing center to the target computing center based on a file management service according to the file transmission instruction; wherein each computing center is deployed with a file management service.
Optionally, the file transmission unit to be transmitted further includes:
and the current task state reporting subunit is used for reporting the current task state of the task to be transmitted of the file through the control agent service.
Optionally, the current task state reporting subunit is specifically configured to respond to a file transmission control request, generate a file transmission control instruction corresponding to the file transmission control request, and send the file transmission control instruction to the control agent service;
and managing the execution of the task of the file to be transmitted according to the file transmission control instruction through the control agent service.
Optionally, the cross-computing center file transmission apparatus further includes a file transmission request response module, and specifically, the file transmission request response module may be configured to respond to a file transmission request before obtaining a task to be transmitted of a file, and generate the task to be transmitted of the file corresponding to the file transmission request based on file management services of the source computing center and the target computing center.
Optionally, the cross-computing center file transmission device further includes a user authentication module, which is specifically configured to complete authentication of an access user who initiates a task to be transmitted of a file in combination with a file management system before the task to be transmitted of the file is acquired; wherein the file management system is a management system corresponding to the file management service.
The cross-computing center file transmission device provided by the embodiment of the invention can execute the cross-computing center file transmission method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
EXAMPLE five
Fig. 8 is a schematic structural diagram of a computer apparatus according to a fifth embodiment of the present invention, as shown in fig. 8, the computer apparatus includes a processor 510, a memory 520, an input device 530, and an output device 540; the number of the processors 510 in the computer device may be one or more, and one processor 510 is taken as an example in fig. 8; the processor 510, the memory 520, the input device 530 and the output device 540 in the computer apparatus may be connected by a bus or other means, and the connection by the bus is exemplified in fig. 8.
The memory 520 may be used as a computer-readable storage medium for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the cross-computing center file transmission method in the embodiment of the present invention (for example, the task acquisition module 410 and the file transmission module 420 in the cross-computing center file transmission apparatus). The processor 510 executes various functional applications and data processing of the computer device by executing software programs, instructions and modules stored in the memory 520, namely, implements the cross-compute farm file transfer method described above.
The memory 520 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 520 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 520 may further include memory located remotely from processor 510, which may be connected to a computer device through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 530 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer apparatus. The output device 540 may include a display device such as a display screen.
EXAMPLE six
An embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a method for file transfer across computing centers, the method including:
acquiring a task to be transmitted of a file; the task to be transmitted of the file comprises information of the file to be transmitted, information of a source computing center and information of a target computing center;
according to the task to be transmitted, the file to be transmitted is transmitted to the target computing center from the source computing center; wherein, data intercommunication is realized between any two computing centers through a data link.
Of course, the storage medium containing the computer-executable instructions provided by the embodiments of the present invention is not limited to the method operations described above, and may also perform related operations in the cross-computing center file transmission method provided by any embodiments of the present invention.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It should be noted that, in the above embodiment of the file transmission device across the computing center, the included units and modules are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A method for file transfer across computing centers is characterized by comprising the following steps:
acquiring a task to be transmitted of a file; the task to be transmitted of the file comprises information of the file to be transmitted, information of a source computing center and information of a target computing center;
according to the task to be transmitted, the file to be transmitted is transmitted to the target computing center from the source computing center; wherein, data intercommunication is realized between any two computing centers through a data link.
2. The method of claim 1, wherein transmitting the file to be transmitted from the source computing center to the target computing center according to the task of the file to be transmitted comprises:
generating a file transmission instruction according to the task to be transmitted of the file, and sending the file transmission instruction to a control agent service of the source computing center or the target computing center;
and transmitting the file to be transmitted from the source computing center to the target computing center through the control agent service according to the file transmission instruction.
3. The method of claim 2, wherein transmitting the file to be transmitted from the source computing center to the target computing center according to the file transmission instruction through the control agent service comprises:
transmitting the file to be transmitted from the source computing center to the target computing center through the control agent service according to the file transmission instruction based on a file management service; wherein each computing center is deployed with a file management service.
4. The method according to claim 2, wherein when the file to be transmitted is transmitted from the source computing center to the target computing center by the control agent service according to the file transmission instruction, the method further comprises:
and reporting the current task state of the task to be transmitted of the file through the control agent service.
5. The method of claim 4, wherein when reporting the current task status of the task to be transmitted of the file through the control agent service, further comprising:
responding to a file transmission control request, generating a file transmission control instruction corresponding to the file transmission control request, and sending the file transmission control instruction to the control agent service;
and managing the execution of the task of the file to be transmitted according to the file transmission control instruction through the control agent service.
6. The method of claim 3, before obtaining the task for which the file is to be transmitted, further comprising:
and responding to a file transmission request, and generating a task to be transmitted of the file corresponding to the file transmission request based on file management services of the source computing center and the target computing center.
7. The method of claim 3, before obtaining the task for which the file is to be transmitted, further comprising:
the authentication of an access user who initiates the task to be transmitted of the file is completed by combining a file management system; wherein the file management system is a management system corresponding to the file management service.
8. A cross-compute farm file transfer apparatus, comprising:
the task acquisition module is used for acquiring a task to be transmitted of a file; the task to be transmitted of the file comprises information of the file to be transmitted, information of a source computing center and information of a target computing center;
the file transmission module is used for transmitting the file to be transmitted to the target computing center from the source computing center according to the task to be transmitted of the file; wherein, data intercommunication is realized between any two computing centers through a data link.
9. A computer device, characterized in that the computer device comprises:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110809524.5A CN113542282A (en) | 2021-07-15 | 2021-07-15 | Cross-computing center file transmission method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110809524.5A CN113542282A (en) | 2021-07-15 | 2021-07-15 | Cross-computing center file transmission method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113542282A true CN113542282A (en) | 2021-10-22 |
Family
ID=78128566
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110809524.5A Pending CN113542282A (en) | 2021-07-15 | 2021-07-15 | Cross-computing center file transmission method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113542282A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115102946A (en) * | 2022-06-16 | 2022-09-23 | 平安银行股份有限公司 | Configuration method and system based on file transmission |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109309734A (en) * | 2018-11-27 | 2019-02-05 | 北京百度网讯科技有限公司 | It is used for transmission the method and device of data |
| CN110099104A (en) * | 2019-04-12 | 2019-08-06 | 平安科技（深圳）有限公司 | Document transmission method, system and storage medium |
| CN112468511A (en) * | 2020-12-11 | 2021-03-09 | 建信金融科技有限责任公司 | File transmission method and device |
| CN112714198A (en) * | 2021-03-29 | 2021-04-27 | 北京宇信科技集团股份有限公司 | File transmission method and system of ESB system |
| CN112866325A (en) * | 2019-11-28 | 2021-05-28 | 北京金山云网络技术有限公司 | Resource file transmission method and device, upper layer in CDN and edge node |
-
2021
- 2021-07-15 CN CN202110809524.5A patent/CN113542282A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109309734A (en) * | 2018-11-27 | 2019-02-05 | 北京百度网讯科技有限公司 | It is used for transmission the method and device of data |
| CN110099104A (en) * | 2019-04-12 | 2019-08-06 | 平安科技（深圳）有限公司 | Document transmission method, system and storage medium |
| CN112866325A (en) * | 2019-11-28 | 2021-05-28 | 北京金山云网络技术有限公司 | Resource file transmission method and device, upper layer in CDN and edge node |
| CN112468511A (en) * | 2020-12-11 | 2021-03-09 | 建信金融科技有限责任公司 | File transmission method and device |
| CN112714198A (en) * | 2021-03-29 | 2021-04-27 | 北京宇信科技集团股份有限公司 | File transmission method and system of ESB system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115102946A (en) * | 2022-06-16 | 2022-09-23 | 平安银行股份有限公司 | Configuration method and system based on file transmission |
| CN115102946B (en) * | 2022-06-16 | 2023-10-24 | 平安银行股份有限公司 | Configuration method and system based on file transmission |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| USRE47384E1 (en) | Generating link information to access a file stored in a storage area associated with user identification information | |
| WO2020029388A1 (en) | File transmission method, system, computer device and storage medium | |
| US9398084B2 (en) | Information processing system | |
| CN104219316A (en) | Method and device for processing call request in distributed system | |
| US20170134495A1 (en) | Method and apparatus for sharing collaboratively edited document | |
| CN108028833A (en) | A kind of method, system and the relevant device of NAS data accesses | |
| US11281511B2 (en) | Predictive microservice systems and methods | |
| JP2004086895A (en) | System and method for enabling components on arbitrary networks to communicate | |
| CN109547524B (en) | User behavior storage method, device, equipment and storage medium based on Internet of things | |
| JP2013504806A (en) | Method, apparatus and system for file transfer based on file directory | |
| JP4233328B2 (en) | File download method and system using peer-to-peer technology | |
| CN109561054B (en) | Data transmission method, controller and access device | |
| US20150127837A1 (en) | Relay apparatus and data transfer method | |
| CN109361762A (en) | A kind of document transmission method, apparatus and system | |
| US10367894B2 (en) | Information processing apparatus, method for controlling the same, non-transitory computer-readable storage medium, and information processing system | |
| CN106941522B (en) | Lightweight distributed computing platform and data processing method thereof | |
| CN114296953A (en) | Multi-cloud heterogeneous system and task processing method | |
| CN113542282A (en) | Cross-computing center file transmission method, device, equipment and storage medium | |
| CN110460668A (en) | A kind of file uploading method, device, computer equipment and storage medium | |
| CN110166487B (en) | Local area network equipment information transmission method, main equipment, storage medium and intelligent equipment | |
| CN108810070B (en) | Resource sharing method and device, intelligent equipment and storage medium | |
| JP2006018430A (en) | Information processor, network system, program, data structure and storage medium | |
| CN114095280B (en) | Cloud platform server communication channel construction method, communication method, device and server | |
| CN109871288A (en) | Execute method, apparatus, equipment and the medium of android system order | |
| CN116743728B (en) | Application operation and maintenance method, system, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |