CN110703980A - File transmission method and device - Google Patents
File transmission method and device Download PDFInfo
- Publication number
- CN110703980A CN110703980A CN201810745872.9A CN201810745872A CN110703980A CN 110703980 A CN110703980 A CN 110703980A CN 201810745872 A CN201810745872 A CN 201810745872A CN 110703980 A CN110703980 A CN 110703980A
- Authority
- CN
- China
- Prior art keywords
- file
- node server
- target
- cloud storage
- storage device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 230000005540 biological transmission Effects 0.000 title claims abstract description 47
- 230000004044 response Effects 0.000 claims description 60
- 238000012545 processing Methods 0.000 claims description 19
- 238000010586 diagram Methods 0.000 description 21
- 238000004590 computer program Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 9
- 238000007726 management method Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0643—Management of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a file transmission method and device. The method comprises the following steps: for any node server in the node server cluster, the node server may generate corresponding meta information according to the received upload file, and then send the upload file and the meta information to the cloud storage device, so that the cloud storage device stores the meta information. Therefore, on one hand, a plurality of client devices in the client cluster can simultaneously send the uploaded files to the node server cluster, so that the aim of quickly transmitting the files can be fulfilled, and the file transmission rate is improved; on the other hand, after receiving the file sent by the client device, each node server can synchronously store the file to the same storage position in the cloud storage device, so that a user can directly manage the file through the cloud storage device, and the user can conveniently perform centralized management on the file.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a file transmission method and apparatus.
Background
With the rapid development of internet technology, the amount of network information data is also getting larger and larger, and the requirement of enterprises for storing mass data becomes more important. The traditional file storage system has the problems of limited disk space, insufficient processing capacity and the like, and cannot meet the storage requirement of a large capacity of a user.
At present, an existing solution is to upload files to be stored by a user to a plurality of node servers in a distributed manner, so as to meet the storage requirement of the user for a large capacity. For example, if a user needs to upload 1TB files, 500GB of the files may be stored in node server a and another 500GB of files may be stored in node server B by using a distributed method. However, since the files are distributed in different node servers, when a user manages the files, a part of the files stored in the node server a and a part of the files stored in the node server B need to be managed at the same time, and thus, the requirement of centralized management by the user cannot be met.
The other solution is to adopt a centralized cloud storage service to upload files to be stored by a user to a cloud storage device in a centralized manner. However, although this method can meet the requirement of the user for centralized management of the files, the uploading rate that the cloud storage device can provide is limited, and therefore, the requirement of the user for uploading the files at high concurrency and high speed cannot be met under the condition that the data size of the files is excessively large.
Based on this, there is a need for a file transmission method, which is used to solve the problem in the prior art that quick uploading and centralized management cannot be considered in the file transmission process.
Disclosure of Invention
The embodiment of the invention provides a file transmission method and device, and aims to solve the technical problem that distributed storage of data in the prior art cannot meet the requirement of centralized management of users.
The embodiment of the invention provides a file uploading method, which is applied to a distributed storage system, wherein the distributed storage system comprises a cloud storage device, a node server cluster and a client cluster; the node server cluster comprises a plurality of node servers, and the client cluster comprises a plurality of client devices; the method comprises the following steps:
aiming at any node server in the node server cluster, the node server receives an upload file sent by any client device in the client cluster; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
the node server generates meta information of the uploaded file, wherein the meta information comprises a data main body to which the uploaded file belongs;
the node server sends the uploaded file and the meta information to the cloud storage device, so that the cloud storage device determines a target storage area according to the meta information and stores the meta information and the uploaded file in the target storage area; and each uploading file in the uploading file set is stored in the target storage area.
Therefore, for services with large data volume and transmission delay requirements, on one hand, a plurality of client devices in a client cluster can simultaneously send the uploaded file set of the same data main body to a node server cluster, and a plurality of node servers in the node server cluster all provide available bandwidth to receive the uploaded file set sent by the client cluster, so that the aim of rapidly transmitting files can be achieved, and the file transmission rate is improved; on the other hand, in order to ensure that data of the service is convenient and fast to manage in the later period, each node server can synchronously store the uploaded files of the same data main body in the cloud storage device after receiving the uploaded files sent by the client device. The analysis shows that the data uploading service which can meet the transmission delay requirement can be provided for the same data main body, and the requirement of centralized storage can be met.
In a possible implementation manner, the sending, by the node server, the upload file and the meta information to the cloud storage device includes:
the node server sends a synchronization request to the cloud storage device, wherein the synchronization request comprises the meta information;
after receiving a response message of the synchronization request returned by the cloud storage device, the node server sends the upload file to the cloud storage device; the response information is sent after the cloud storage device determines to receive the meta information after storing the meta information.
Therefore, the node server can send the meta information to the cloud storage device, and the meta information is smaller in data volume compared with the uploaded file, so that the meta information can be rapidly transmitted to the cloud storage device, and the uploaded file is transmitted under the condition of enough bandwidth, and the file transmission efficiency is improved.
In a possible implementation manner, after the node server sends the upload file and the meta information to the cloud storage device, the method further includes:
and the node server deletes the uploaded file and the meta information. Therefore, the storage burden of the node server can be reduced, and the problem that the content of the file stored in the cloud storage device and the content of the file stored in the node server are repeated is avoided.
The embodiment of the invention provides a file downloading method, which is applied to a distributed storage system, wherein the distributed storage system comprises cloud storage equipment, a node server cluster and a client cluster; the node server cluster comprises a plurality of node servers, and the client cluster comprises a plurality of client devices; the method comprises the following steps:
for any client device in the client cluster, the client device sends a download request to the cloud storage device, wherein the download request comprises a target file identifier;
the client device receives a response message of the downloading request sent by the cloud storage device, and acquires the target file from a target node server according to the position information of the target node server included in the response message;
and the position information of the target node server is determined according to the corresponding relation between the file identifier and the position information of the node server after the cloud storage equipment determines that the target file corresponding to the target file identifier is not stored.
Therefore, when the client device downloads the target file, if the file is not synchronously stored in the cloud storage device, the client device can still download the target file from the corresponding node server, so that the situation that the target file cannot be downloaded by the client device in the file synchronization process or the file is not synchronized is avoided.
In one possible implementation, the method further includes:
and the client device receives a target file sent by the cloud storage device, wherein the target file is a file stored in the cloud storage device and corresponding to the target file identifier.
Therefore, when the client device downloads the target file, if the file is synchronously stored in the cloud storage device, the client device can directly acquire the target file.
The embodiment of the invention provides a file uploading method, which is applied to a distributed storage system, wherein the distributed storage system comprises a cloud storage device, a node server cluster and a client cluster; the node server cluster comprises a plurality of node servers, and the client cluster comprises a plurality of client devices; the method comprises the following steps:
the cloud storage equipment receives an uploaded file sent by any node server in the node server cluster and meta information of the uploaded file; the meta information comprises a data main body to which the uploading file belongs; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
the cloud storage equipment determines a target storage area of the uploaded file according to the meta information and a preset corresponding relation between a data entity and the storage area; the target storage area is used for storing each uploading file in the uploading file set;
and the cloud storage equipment stores the uploaded file and the meta information to the target storage area.
Therefore, on one hand, a plurality of client devices in the client cluster can simultaneously send the uploaded files to the node server cluster, so that the aim of quickly transmitting the files can be fulfilled, and the file transmission rate is improved; on the other hand, after receiving the file sent by the client device, each node server can synchronously store the file in the cloud storage device, and compared with the mode that the files sent by a plurality of client devices are stored in a plurality of node servers in a distributed manner in the prior art, the file management method and the system in the embodiment of the invention have the advantage that the user can directly manage the file in the cloud storage device, so that the user can conveniently manage the file in a centralized manner.
In a possible implementation manner, the receiving, by the cloud storage device, an upload file sent by any node server in the node server cluster and meta information of the upload file include:
the cloud storage device receives a synchronization request sent by the node server, wherein the synchronization request comprises the meta information;
after determining that the available transmission bandwidth exists, the cloud storage device returns a response message of the synchronization request to the node server, wherein the response message is used for indicating the node server to send the upload file to the cloud storage device;
and the cloud storage equipment receives the uploaded file sent by the node server.
Therefore, the node server can send the meta information to the cloud storage device, and the meta information is smaller in data volume compared with the uploaded file, so that the meta information can be rapidly transmitted to the cloud storage device, and the uploaded file is transmitted under the condition of enough bandwidth, and the file transmission efficiency is improved.
In one possible implementation, the method further includes:
the cloud storage device receives a downloading request sent by any client device in the client cluster, wherein the downloading request comprises a target file identifier;
if the cloud storage equipment determines that the target file corresponding to the target file identifier is not stored, determining the position information of the target node server according to the corresponding relation between the file identifier and the position information of the node server; the corresponding relation is determined according to the meta information;
the cloud storage device sends a response message of the downloading request to the client, the response message comprises the position information of the target node server, and the response message is used for indicating the client device to acquire the target file from the target node server according to the position information of the target node server.
Therefore, when the client device downloads the target file, if the file is not synchronously stored in the cloud storage device, the client device can still download the target file from the corresponding node server, so that the situation that the target file cannot be downloaded by the client device in the file synchronization process or the file is not synchronized is avoided.
In one possible implementation, the method further includes:
and if the cloud storage equipment determines that the target file corresponding to the target file identifier is stored, sending the target file to the client.
Therefore, when the client device downloads the target file, if the file is synchronously stored in the cloud storage device, the client device can directly acquire the target file.
An embodiment of the present invention provides a server, where the server includes:
the receiving and sending unit is used for receiving the uploading file sent by any client device in the client cluster; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
the processing unit is used for generating meta information of the uploaded file, and the meta information comprises a data main body to which the uploaded file belongs;
the receiving and sending unit is configured to send the upload file and the meta information to the cloud storage device, so that the cloud storage device determines a target storage area according to the meta information, and stores the meta information and the upload file in the target storage area; and each uploading file in the uploading file set is stored in the target storage area.
In a possible implementation manner, the transceiver unit is specifically configured to:
sending a synchronization request to the cloud storage device, the synchronization request including the meta information; after receiving a response message of the synchronization request returned by the cloud storage device, sending the upload file to the cloud storage device; the response information is sent when the cloud storage device determines that available transmission bandwidth exists.
In one possible implementation, the processing unit is further configured to:
and deleting the uploaded file and the meta information.
An embodiment of the present invention provides a client device, where the client device includes:
a sending unit, configured to send a download request to the cloud storage device, where the download request includes a target file identifier;
a receiving unit, configured to receive a response message of the download request sent by the cloud storage device, and obtain the target file from a target node server according to location information of the target node server included in the response message;
the position information of the target node server is determined according to the corresponding relation between the file identifier and the position information of the node server after the cloud storage equipment determines that the target file corresponding to the target file identifier is not stored; the correspondence is determined from the meta-information.
In one possible implementation manner, the receiving unit is further configured to:
and receiving a target file sent by the cloud storage equipment, wherein the target file is a file stored in the cloud storage equipment and corresponding to the target file identifier.
An embodiment of the present invention provides a cloud storage device, where the cloud storage device includes:
the receiving and sending unit is used for receiving an uploading file sent by any node server in the node server cluster and meta information of the uploading file; the meta information comprises a data main body to which the uploading file belongs; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
the processing unit is used for determining a target storage area of the uploaded file according to the meta information and a preset corresponding relation between a data entity and the storage area; the target storage area is used for storing each uploading file in the uploading file set; and storing the uploaded file and the meta information to the target storage area.
In a possible implementation manner, the transceiver unit is specifically configured to:
receiving a synchronization request sent by the node server, wherein the synchronization request comprises the meta information; after determining that the available transmission bandwidth exists, returning a response message of the synchronization request to the node server, wherein the response message is used for indicating the node server to send the uploaded file to the cloud storage device; and receiving the uploading file sent by the node server.
In a possible implementation manner, the transceiver unit is further configured to:
receiving a downloading request sent by any client device in the client cluster, wherein the downloading request comprises a target file identifier;
the processing unit is further to:
if the target file corresponding to the target file identifier is determined not to be stored, determining the position information of the target node server according to the corresponding relation between the file identifier and the position information of the node server; the corresponding relation is determined according to the meta information;
the receiving and sending unit is further configured to send a response message of the download request to the client, where the response message includes location information of the target node server, and the response message is used to instruct the client device to acquire the target file from the target node server according to the location information of the target node server.
In a possible implementation manner, the transceiver unit is further configured to:
and if the target file corresponding to the target file identifier is determined to be stored, sending the target file to the client.
The embodiment of the present application further provides an apparatus, which has a function of implementing the file transmission method described above. This function may be implemented by hardware executing corresponding software, and in one possible design, the apparatus includes: a processor, a transceiver, a memory; the memory is used for storing computer execution instructions, the transceiver is used for realizing the communication between the device and other communication entities, the processor and the memory are connected through the bus, and when the device runs, the processor executes the computer execution instructions stored in the memory so as to enable the device to execute the file transmission method described above.
An embodiment of the present invention further provides a computer storage medium, where a software program is stored, and when the software program is read and executed by one or more processors, the software program implements the file transmission method described in the foregoing various possible implementation manners.
Embodiments of the present invention further provide a computer program product containing instructions, which when run on a computer, cause the computer to execute the file transfer method described in the foregoing various possible implementations.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that are required to be used in the description of the embodiments will be briefly described below.
FIG. 1 is a diagram illustrating a system architecture suitable for use with an embodiment of the present invention;
fig. 2 is a schematic flow chart corresponding to a file transmission method according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of a method for uploading a file by a client device according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of another system architecture according to an embodiment of the present invention;
fig. 5 is a schematic flowchart corresponding to a method for synchronizing files by a node server according to an embodiment of the present invention;
fig. 6 is a schematic flowchart illustrating another file transmission method according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an overall process involved in a second embodiment of the present invention;
FIG. 8 is a block diagram of a server according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a client device according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of a cloud storage device according to an embodiment of the present invention.
Detailed Description
The present application will be described in detail below with reference to the accompanying drawings, and the specific operation methods in the method embodiments can also be applied to the apparatus embodiments.
Fig. 1 exemplarily shows a system architecture schematic diagram applicable to an embodiment of the present invention, and as shown in fig. 1, a system architecture 100 applicable to an embodiment of the present invention includes a cloud storage device 101, a node server cluster 102, and a client cluster 103. Wherein the system 100 may be a distributed storage system; the node server cluster 102 may include a plurality of node servers, such as node server 1021, node server 1022, and node server 1023 shown in fig. 1; client cluster 103 may also include a plurality of client devices, such as client device 1031, client device 1032, and client device 1033 shown in fig. 1.
It should be noted that the client device in the present application may be various types of devices, for example, a notebook computer, a smart phone, a tablet computer, a smart television, and the like, and is not limited specifically.
The first embodiment is as follows:
based on the system architecture shown in fig. 1, fig. 2 exemplarily shows a flow diagram corresponding to a file transmission method provided by the embodiment of the present invention, and specifically includes the following steps:
step 201, a node server receives an upload file sent by any client device in a client cluster; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body.
Step 202, the node server generates meta-information of the uploaded file, where the meta-information includes a data body to which the uploaded file belongs.
And step 203, the node server sends the uploaded file and the meta information to the cloud storage device.
Step 204, the cloud storage device receives an upload file sent by the node server and meta information of the upload file.
Step 205, the cloud storage device determines a target storage area of the uploaded file according to the meta information and a preset corresponding relationship between the data entity and the storage area.
In step 206, the cloud storage device stores the uploaded file and the meta information in the target storage area.
It should be noted that, the above steps 201 to 203 may be performed by any node server in the node server cluster 102 shown in fig. 1, for example, may be performed by the node server 1021 shown in fig. 1; the above steps 204 to 206 may be performed by the cloud storage device 101 shown in fig. 1.
Therefore, for services with large data volume and transmission delay requirements, on one hand, a plurality of client devices in a client cluster can simultaneously send the uploaded file set of the same data main body to a node server cluster, and a plurality of node servers in the node server cluster all provide available bandwidth to receive the uploaded file set sent by the client cluster, so that the aim of rapidly transmitting files can be achieved, and the file transmission rate is improved; on the other hand, in order to ensure that data of the service is convenient and fast to manage in the later period, each node server can synchronously store the uploaded files of the same data main body in the cloud storage device after receiving the uploaded files sent by the client device. The analysis shows that the data uploading service which can meet the transmission delay requirement can be provided for the same data main body, and the requirement of centralized storage can be met.
Specifically, before performing step 201, the communication relationship between the client and the node server includes multiple types, for example, the node server may receive an upload file sent by any client device in the client cluster, and in an example, the node server may receive an upload file sent by client device 1031 shown in fig. 1, may also receive an upload file sent by client device 1032, and may also receive an upload file sent by client device 1033.
In another example, the node server may also receive upload files sent by specified ones of client devices 1031, 1032, and 1033 shown in fig. 1. For example, the client device may send an upload file to a designated node server according to its own location information. For example, as shown in fig. 3, a flowchart of a method for determining a node server corresponding to an uploaded file by a client device according to an embodiment of the present invention is provided, where the method may be executed by the client device 1031 shown in fig. 1, and includes the following steps:
The location information of the client device may refer to an IP address of the client device, or may also refer to a geographic location of the client device. As shown in table 1, is an example of location information of a client device. As can be seen from the content shown in table 1, each client device has a corresponding geographic location, and taking the client device 1 shown in table 1 as an example, the IP address corresponding to the client device 1 is: 222.64.232.189, the corresponding geographic locations are: the location information of other client devices in the shanghai minkou area may be specifically referenced to a table and will not be described in detail herein.
Table 1: example of location information for a client device
| Client device changes | IP address | Geographic location |
| Client device 1 | 222.64.232.189 | Shanghai city Mining district |
| Client device 2 | 220.155.1.196 | Hai lake district of Beijing City |
| Client device 3 | 112.10.39.255 | Hangzhou city xiaoshan region |
| Client device 4 | 221.226.140.255 | Basalt district of Nanjing City |
| Client device 5 | 218.82.20.255 | Quiet area of Shanghai City |
In the embodiment of the present invention, the DNS server may be configured to provide a corresponding node server for any client device in the client cluster. As shown in fig. 4, another system architecture schematic diagram provided for the embodiment of the present invention, the system architecture 100 includes a cloud storage device 101, a node server cluster 102, a client cluster 103, and a DNS server 104. The DNS server 104 is connected to the client cluster 103 and the node server cluster 102, so that the DNS server 104 can determine a corresponding node server (e.g., node server 1021) from the node server cluster 102 according to location information of any client device (e.g., client device 1031) in the client cluster 103, and further enable the client device 1031 to communicate with the node server 1021.
For example, taking the client device 1 shown in table 1 as an example, if the location information corresponding to the client device is a shanghai minkou area, the DNS server may screen out a node server having the location information that is the shanghai minkou area from the node server cluster, and use the node server as the node server corresponding to the client device 1.
In step 304, the client device receives a response message of the upload request sent by the DNS server.
And 305, the client device sends the uploading file to the target node server according to the position information of the target node server.
It should be noted that the method described in step 301 to step 305 is only an example, and in other possible examples, a person skilled in the art may also determine the target node server according to experience and practical situations, for example, the target node server may be determined according to load information of the node servers in the node server cluster, which is not limited specifically.
In step 201, for a client cluster, all files uploaded by the client cluster may be regarded as an upload file set, a file uploaded by each client in the client cluster is a file in the upload file set, and each file in the upload file set corresponds to the same data body.
The data body may refer to a type corresponding to each file, such as a company type, an industry type, and the like, and may be determined by those skilled in the art according to actual situations. For example, if the upload file 1 is a file of company a, the data entity corresponding to the upload file 1 may be company a; if the uploaded file 2 is a file in the B domain, the data entity corresponding to the uploaded file 2 may be the B domain.
In step 202, the meta information is generated according to the uploaded file, and the meta information may include a data body to which the uploaded file belongs, an identifier of the uploaded file, and location information of the node server, which is not limited specifically.
In a specific implementation process, the node server can directly take a data main body to which the uploaded file belongs, an uploaded file identifier and position information of the node server as meta information; or, the node server may encrypt the data body to which the uploaded file belongs, the identifier of the uploaded file, and the location information of the node server, and use the encrypted information as the meta information, which is not limited specifically.
In step 203, the node server may directly send the uploaded file and the meta information together to the cloud storage device; or, the node server may also send the meta information to the cloud storage device first, and then send the uploaded file to the cloud storage device; the node server may also send the uploaded file to the cloud storage device within a set time after receiving the uploaded file. Specifically, as shown in fig. 5, a flowchart corresponding to a method for synchronizing a file by a node server according to an embodiment of the present invention includes the following steps:
In step 503, after determining that the available transmission bandwidth exists, the cloud storage device returns a response message of the synchronization request to the node server.
Before returning a response message of the synchronization request to the node server, the cloud storage device may further determine whether an available transmission bandwidth exists, and return a response message to the node server under the condition that the available transmission bandwidth is determined to exist, so that the rate of sending the uploaded file to the cloud storage device by the node server can be increased.
In step 504, after receiving the response message of the synchronization request, the node server sends an upload file to the cloud storage device.
Therefore, the node server can send the meta information to the cloud storage device, and the meta information is smaller in data volume compared with the uploaded file, so that the meta information can be rapidly transmitted to the cloud storage device, and the uploaded file is transmitted under the condition of enough bandwidth, and the file transmission efficiency is improved.
After step 204 is executed, the node server may also delete the uploaded file and the meta information, so that the storage burden of the node server can be reduced, and the problem of duplicate file contents stored in the cloud storage device and the node server is avoided.
Example two:
based on the system architecture shown in fig. 1, fig. 6 exemplarily shows a flow diagram corresponding to another file transmission method provided by the embodiment of the present invention, which specifically includes the following steps:
In step 602, the cloud storage device receives a download request sent by a client device.
In step 604, the cloud storage device sends a response message of the download request to the client, where the response message includes location information of the target node server.
It should be noted that the above steps 601 and 605 may be performed by any client device in the client cluster 103 shown in fig. 1, for example, may be performed by the client device 1031 shown in fig. 1; the above steps 602 to 604 may be performed by the cloud storage device 101 shown in fig. 1.
Therefore, when the client device downloads the target file, if the file is not synchronously stored in the cloud storage device, the client device can still download the target file from the corresponding node server, so that the situation that the target file cannot be downloaded by the client device in the file synchronization process or the file is not synchronized is avoided.
Specifically, in step 603 and step 604, if the cloud storage device determines that the target file corresponding to the target file identifier is stored, the cloud storage device may directly send the target file to the client, so that when the client downloads the target file, if the file is already synchronously stored in the cloud storage device, the client may directly obtain the target file.
In other possible embodiments, the cloud storage device may not store any information related to the target file identifier, that is, if there is no target file corresponding to the target file identifier or no node server corresponding to the target file identifier in the cloud storage device, information that the file does not exist may be returned to the client device.
In a specific implementation process, the client can be set to be directly connected with the cloud storage device when the downloading function is started; when the cloud storage device determines that the target file is not stored, the cloud storage device may also determine, by the management server, location information of a target node server corresponding to the target file.
In order to describe the above file transmission method more clearly, the flow involved in the second embodiment of the present invention is generally described below with reference to fig. 7. As shown in fig. 7, the following steps may be included:
In step 702, the cloud storage device receives a download request sent by a client device.
In step 704, the cloud storage device sends the target file to the client.
In step 707, the cloud storage device determines location information of the target node server.
In step 708, the cloud storage device sends a response message of the download request to the client, where the response message includes the location information of the target node server.
Step 709, the client device receives a response message of the download request sent by the cloud storage device, and obtains the target file from the target node server according to the location information of the target node server included in the response message.
In step 710, the cloud storage device returns information that the file does not exist to the client device.
It should be noted that the step numbers are only exemplary representations of execution flows, and the sequence of each step is not specifically limited in this application. For example, in the above step 703 and step 706, the cloud storage device may also determine whether there is a target node server corresponding to the target file identifier according to the correspondence between the file identifier and the location information of the node server, and then determine whether the target file corresponding to the target file identifier is stored according to the target file identifier, which is not limited specifically.
Example three:
based on the same inventive concept, fig. 8 exemplarily shows a schematic structural diagram of a server provided by the embodiment of the present invention, and as shown in fig. 8, the server 800 includes a transceiver unit 801 and a processing unit 802.
A transceiving unit 801, configured to receive an upload file sent by any client device in the client cluster; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
a processing unit 802, configured to generate meta information of the uploaded file, where the meta information includes a data main body to which the uploaded file belongs;
the transceiver unit 801 is configured to send the uploaded file and the meta information to the cloud storage device, so that the cloud storage device determines a target storage area according to the meta information, and stores the meta information and the uploaded file in the target storage area; and each uploading file in the uploading file set is stored in the target storage area.
In a possible implementation manner, the transceiver unit 801 is specifically configured to:
sending a synchronization request to the cloud storage device, the synchronization request including the meta information; after receiving a response message of the synchronization request returned by the cloud storage device, sending the upload file to the cloud storage device; the response information is sent when the cloud storage device determines that available transmission bandwidth exists.
In one possible implementation manner, the processing unit 802 is further configured to:
and deleting the uploaded file and the meta information.
Example four:
based on the same inventive concept, fig. 9 exemplarily shows a schematic structural diagram of a client device provided by the embodiment of the present invention, and as shown in fig. 9, the client device 900 includes a sending unit 901 and a receiving unit 902.
A sending unit 901, configured to send a download request to the cloud storage device, where the download request includes a target file identifier;
a receiving unit 902, configured to receive a response message of the download request sent by the cloud storage device, and obtain the target file from the target node server according to location information of the target node server included in the response message;
the position information of the target node server is determined according to the corresponding relation between the file identifier and the position information of the node server after the cloud storage equipment determines that the target file corresponding to the target file identifier is not stored; the correspondence is determined from the meta-information.
In a possible implementation manner, the receiving unit 902 is further configured to:
and receiving a target file sent by the cloud storage equipment, wherein the target file is a file stored in the cloud storage equipment and corresponding to the target file identifier.
Example five:
based on the same inventive concept, fig. 10 exemplarily shows a schematic structural diagram of a cloud storage device provided by an embodiment of the present invention, and as shown in fig. 10, the cloud storage device 1000 includes a transceiver unit 1001 and a processing unit 1002.
A transceiver 1001, configured to receive an upload file sent by any node server in the node server cluster and meta information of the upload file; the meta information comprises a data main body to which the uploading file belongs; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
the processing unit 1002 is configured to determine a target storage area of the uploaded file according to the meta information and a preset correspondence between a data entity and the storage area; the target storage area is used for storing each uploading file in the uploading file set; and storing the uploaded file and the meta information to the target storage area.
In a possible implementation manner, the transceiver unit 1001 is specifically configured to:
receiving a synchronization request sent by the node server, wherein the synchronization request comprises the meta information; after determining that the available transmission bandwidth exists, returning a response message of the synchronization request to the node server, wherein the response message is used for indicating the node server to send the uploaded file to the cloud storage device; and receiving the uploading file sent by the node server.
In a possible implementation manner, the transceiver 1001 is further configured to:
receiving a downloading request sent by any client device in the client cluster, wherein the downloading request comprises a target file identifier;
the processing unit 1002 is further configured to:
if the target file corresponding to the target file identifier is determined not to be stored, determining the position information of the target node server according to the corresponding relation between the file identifier and the position information of the node server; the corresponding relation is determined according to the meta information;
the transceiving unit 1001 is further configured to send a response message of the download request to the client, where the response message includes location information of the target node server, and the response message is used to instruct the client device to acquire the target file from the target node server according to the location information of the target node server.
In a possible implementation manner, the transceiver 1001 is further configured to:
and if the target file corresponding to the target file identifier is determined to be stored, sending the target file to the client.
The embodiment of the present application further provides an apparatus, which has a function of implementing the file transmission method described above. This function may be implemented by hardware executing corresponding software, and in one possible design, the apparatus includes: a processor, a transceiver, a memory; the memory is used for storing computer execution instructions, the transceiver is used for realizing the communication between the device and other communication entities, the processor and the memory are connected through the bus, and when the device runs, the processor executes the computer execution instructions stored in the memory so as to enable the device to execute the file transmission method described above.
An embodiment of the present invention further provides a computer storage medium, where a software program is stored, and when the software program is read and executed by one or more processors, the software program implements the file transmission method described in the foregoing various possible implementation manners.
Embodiments of the present invention further provide a computer program product containing instructions, which when run on a computer, cause the computer to execute the file transfer method described in the foregoing various possible implementations.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Based on the content described above, the node server cluster included in the system applicable in the embodiment of the present invention has a plurality of node servers, so that a plurality of client devices in the client cluster can simultaneously send the uploaded file set of the same data body to the node server cluster, and all the node servers in the node server cluster can provide available bandwidth to receive the uploaded file set sent by the client cluster, thereby achieving the purpose of fast file transmission and improving the file transmission rate; furthermore, after receiving the file sent by the client device, any node server can synchronously store the file to the same storage position in the cloud storage device, so that a user can directly manage the file through the cloud storage device, and the user can conveniently manage the file in a centralized manner. Therefore, by adopting the method for providing the data, the uploading service which can meet the requirement of transmission delay can be provided for the large-capacity data, and the large-capacity data can be stored in a centralized manner, so that the requirement of centralized management on the large-capacity data is met. The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (20)
1. The file transmission method is applied to a distributed storage system, wherein the distributed storage system comprises cloud storage equipment, a node server cluster and a client cluster; the node server cluster comprises a plurality of node servers, and the client cluster comprises a plurality of client devices; the method comprises the following steps:
aiming at any node server in the node server cluster, the node server receives an upload file sent by any client device in the client cluster; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
the node server generates meta information of the uploaded file, wherein the meta information comprises a data main body to which the uploaded file belongs;
the node server sends the uploaded file and the meta information to the cloud storage device, so that the cloud storage device determines a target storage area according to the meta information and stores the meta information and the uploaded file in the target storage area; and each uploading file in the uploading file set is stored in the target storage area.
2. The method of claim 1, wherein the node server sends the upload file and the meta information to the cloud storage device, and wherein the sending comprises:
the node server sends a synchronization request to the cloud storage device, wherein the synchronization request comprises the meta information;
after receiving a response message of the synchronization request returned by the cloud storage device, the node server sends the upload file to the cloud storage device; the response information is sent when the cloud storage device determines that available transmission bandwidth exists.
3. The method according to claim 1 or 2, wherein after the node server sends the upload file and the meta information to the cloud storage device, the method further comprises:
and the node server deletes the uploaded file and the meta information.
4. The file transmission method is applied to a distributed storage system, wherein the distributed storage system comprises cloud storage equipment, a node server cluster and a client cluster; the node server cluster comprises a plurality of node servers, and the client cluster comprises a plurality of client devices; the method comprises the following steps:
for any client device in the client cluster, the client device sends a download request to the cloud storage device, wherein the download request comprises a target file identifier;
the client device receives a response message of the downloading request sent by the cloud storage device, and acquires the target file from a target node server according to the position information of the target node server included in the response message;
the position information of the target node server is determined according to the corresponding relation between the file identifier and the position information of the node server after the cloud storage equipment determines that the target file corresponding to the target file identifier is not stored; the correspondence is determined from the meta-information.
5. The method of claim 4, further comprising:
and the client device receives a target file sent by the cloud storage device, wherein the target file is a file stored in the cloud storage device and corresponding to the target file identifier.
6. The file transmission method is applied to a distributed storage system, wherein the distributed storage system comprises cloud storage equipment, a node server cluster and a client cluster; the node server cluster comprises a plurality of node servers, and the client cluster comprises a plurality of client devices; the method comprises the following steps:
the cloud storage equipment receives an uploaded file sent by any node server in the node server cluster and meta information of the uploaded file; the meta information comprises a data main body to which the uploading file belongs; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
the cloud storage equipment determines a target storage area of the uploaded file according to the meta information and a preset corresponding relation between a data entity and the storage area; the target storage area is used for storing each uploading file in the uploading file set;
and the cloud storage equipment stores the uploaded file and the meta information to the target storage area.
7. The method according to claim 6, wherein the receiving, by the cloud storage device, the uploaded file sent by any node server in the node server cluster and the meta information of the uploaded file comprises:
the cloud storage device receives a synchronization request sent by the node server, wherein the synchronization request comprises the meta information;
after determining that the available transmission bandwidth exists, the cloud storage device returns a response message of the synchronization request to the node server, wherein the response message is used for indicating the node server to send the upload file to the cloud storage device;
and the cloud storage equipment receives the uploaded file sent by the node server.
8. The method of claim 6, further comprising:
the cloud storage device receives a downloading request sent by any client device in the client cluster, wherein the downloading request comprises a target file identifier;
if the cloud storage equipment determines that the target file corresponding to the target file identifier is not stored, determining the position information of the target node server according to the corresponding relation between the file identifier and the position information of the node server; the corresponding relation is determined according to the meta information;
the cloud storage device sends a response message of the downloading request to the client, the response message comprises the position information of the target node server, and the response message is used for indicating the client device to acquire the target file from the target node server according to the position information of the target node server.
9. The method of claim 8, further comprising:
and if the cloud storage equipment determines that the target file corresponding to the target file identifier is stored, sending the target file to the client.
10. A server, characterized in that the server comprises:
the receiving and sending unit is used for receiving the uploading file sent by any client device in the client cluster; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
the processing unit is used for generating meta information of the uploaded file, and the meta information comprises a data main body to which the uploaded file belongs;
the receiving and sending unit is configured to send the upload file and the meta information to the cloud storage device, so that the cloud storage device determines a target storage area according to the meta information, and stores the meta information and the upload file in the target storage area; and each uploading file in the uploading file set is stored in the target storage area.
11. The server according to claim 10, wherein the transceiver unit is specifically configured to:
sending a synchronization request to the cloud storage device, the synchronization request including the meta information; after receiving a response message of the synchronization request returned by the cloud storage device, sending the upload file to the cloud storage device; the response information is sent when the cloud storage device determines that available transmission bandwidth exists.
12. The server according to claim 10 or 11, wherein the processing unit is further configured to:
and deleting the uploaded file and the meta information.
13. A client device, the client device comprising:
a sending unit, configured to send a download request to the cloud storage device, where the download request includes a target file identifier;
a receiving unit, configured to receive a response message of the download request sent by the cloud storage device, and obtain the target file from a target node server according to location information of the target node server included in the response message;
the position information of the target node server is determined according to the corresponding relation between the file identifier and the position information of the node server after the cloud storage equipment determines that the target file corresponding to the target file identifier is not stored; the correspondence is determined from the meta-information.
14. The client device of claim 13, wherein the receiving unit is further configured to:
and receiving a target file sent by the cloud storage equipment, wherein the target file is a file stored in the cloud storage equipment and corresponding to the target file identifier.
15. A cloud storage device, the cloud storage device comprising:
the receiving and sending unit is used for receiving an uploading file sent by any node server in the node server cluster and meta information of the uploading file; the meta information comprises a data main body to which the uploading file belongs; the uploaded files are files in an uploaded file set sent by the client cluster, and each file in the uploaded file set corresponds to the same data main body;
the processing unit is used for determining a target storage area of the uploaded file according to the meta information and a preset corresponding relation between a data entity and the storage area; the target storage area is used for storing each uploading file in the uploading file set; and storing the uploaded file and the meta information to the target storage area.
16. The cloud storage device of claim 15, wherein the transceiver unit is specifically configured to:
receiving a synchronization request sent by the node server, wherein the synchronization request comprises the meta information; after determining that the available transmission bandwidth exists, returning a response message of the synchronization request to the node server, wherein the response message is used for indicating the node server to send the uploaded file to the cloud storage device; and receiving the uploading file sent by the node server.
17. The cloud storage device of claim 15, wherein the transceiving unit is further configured to:
receiving a downloading request sent by any client device in the client cluster, wherein the downloading request comprises a target file identifier;
the processing unit is further to:
if the target file corresponding to the target file identifier is determined not to be stored, determining the position information of the target node server according to the corresponding relation between the file identifier and the position information of the node server; the corresponding relation is determined according to the meta information;
the receiving and sending unit is further configured to send a response message of the download request to the client, where the response message includes location information of the target node server, and the response message is used to instruct the client device to acquire the target file from the target node server according to the location information of the target node server.
18. The cloud storage device of claim 17, wherein the transceiving unit is further configured to:
and if the target file corresponding to the target file identifier is determined to be stored, sending the target file to the client.
19. A computer-readable storage medium, characterized in that the storage medium stores instructions that, when executed on a computer, cause the computer to carry out performing the method of any one of claims 1 to 3, or the method of claim 4 or 5, or the method of any one of claims 6 to 9.
20. A computer device, comprising:
a memory for storing program instructions;
a processor for calling program instructions stored in said memory to execute the method of any one of the claims in accordance with the obtained program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810745872.9A CN110703980B (en) | 2018-07-09 | 2018-07-09 | File transmission method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810745872.9A CN110703980B (en) | 2018-07-09 | 2018-07-09 | File transmission method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110703980A true CN110703980A (en) | 2020-01-17 |
| CN110703980B CN110703980B (en) | 2024-03-22 |
Family
ID=69192909
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810745872.9A Active CN110703980B (en) | 2018-07-09 | 2018-07-09 | File transmission method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110703980B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111291009A (en) * | 2020-03-25 | 2020-06-16 | 上海飞旗网络技术股份有限公司 | File block storage method and device |
| CN111478951A (en) * | 2020-03-26 | 2020-07-31 | 深圳市鸿合创新信息技术有限责任公司 | File issuing method and device |
| CN111723062A (en) * | 2020-06-28 | 2020-09-29 | 天津联想协同科技有限公司 | File synchronization method, device and storage medium |
| CN112328174A (en) * | 2020-10-29 | 2021-02-05 | 北京京东尚科信息技术有限公司 | Data pushing method, device, system and medium for cloud computing platform |
| CN112328560A (en) * | 2020-11-25 | 2021-02-05 | 北京无线电测量研究所 | File scheduling method and system |
| CN112671918A (en) * | 2020-12-29 | 2021-04-16 | 平安普惠企业管理有限公司 | Binary-based distributed data downloading method, device, equipment and medium |
| CN113810454A (en) * | 2021-01-15 | 2021-12-17 | 北京沃东天骏信息技术有限公司 | File transmission method and device, electronic equipment and storage medium |
| CN114124981A (en) * | 2021-11-19 | 2022-03-01 | 天翼数字生活科技有限公司 | Cloud storage data direct transmission management method, cloud transmission management platform and system |
| CN114338694A (en) * | 2022-03-04 | 2022-04-12 | 广州鹏捷科技股份有限公司 | One-stop cloud data center server scheduling method and system |
| CN114374683A (en) * | 2021-12-20 | 2022-04-19 | 上海金仕达软件科技有限公司 | Archive file management method and system and computer readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102420854A (en) * | 2011-11-14 | 2012-04-18 | 西安电子科技大学 | Distributed file system facing to cloud storage |
| CN105025106A (en) * | 2015-07-28 | 2015-11-04 | 焦点科技股份有限公司 | Breakpoint resuming method based on segmentation and meta-information |
| CN105812391A (en) * | 2016-05-16 | 2016-07-27 | 广州鼎鼎信息科技有限公司 | Safe cloud storage system |
-
2018
- 2018-07-09 CN CN201810745872.9A patent/CN110703980B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102420854A (en) * | 2011-11-14 | 2012-04-18 | 西安电子科技大学 | Distributed file system facing to cloud storage |
| CN105025106A (en) * | 2015-07-28 | 2015-11-04 | 焦点科技股份有限公司 | Breakpoint resuming method based on segmentation and meta-information |
| CN105812391A (en) * | 2016-05-16 | 2016-07-27 | 广州鼎鼎信息科技有限公司 | Safe cloud storage system |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111291009B (en) * | 2020-03-25 | 2023-05-09 | 上海飞旗网络技术股份有限公司 | File block storage method and device |
| CN111291009A (en) * | 2020-03-25 | 2020-06-16 | 上海飞旗网络技术股份有限公司 | File block storage method and device |
| CN111478951A (en) * | 2020-03-26 | 2020-07-31 | 深圳市鸿合创新信息技术有限责任公司 | File issuing method and device |
| CN111478951B (en) * | 2020-03-26 | 2023-08-08 | 深圳市鸿合创新信息技术有限责任公司 | File issuing method and device |
| CN111723062A (en) * | 2020-06-28 | 2020-09-29 | 天津联想协同科技有限公司 | File synchronization method, device and storage medium |
| CN112328174A (en) * | 2020-10-29 | 2021-02-05 | 北京京东尚科信息技术有限公司 | Data pushing method, device, system and medium for cloud computing platform |
| CN112328560A (en) * | 2020-11-25 | 2021-02-05 | 北京无线电测量研究所 | File scheduling method and system |
| CN112671918A (en) * | 2020-12-29 | 2021-04-16 | 平安普惠企业管理有限公司 | Binary-based distributed data downloading method, device, equipment and medium |
| CN112671918B (en) * | 2020-12-29 | 2024-03-05 | 平安普惠企业管理有限公司 | Binary system-based distributed data downloading method, device, equipment and medium |
| CN113810454A (en) * | 2021-01-15 | 2021-12-17 | 北京沃东天骏信息技术有限公司 | File transmission method and device, electronic equipment and storage medium |
| CN114124981A (en) * | 2021-11-19 | 2022-03-01 | 天翼数字生活科技有限公司 | Cloud storage data direct transmission management method, cloud transmission management platform and system |
| CN114124981B (en) * | 2021-11-19 | 2024-04-12 | 天翼视联科技有限公司 | Cloud storage data direct transmission management method, cloud transmission management platform and system |
| CN114374683A (en) * | 2021-12-20 | 2022-04-19 | 上海金仕达软件科技有限公司 | Archive file management method and system and computer readable storage medium |
| CN114338694B (en) * | 2022-03-04 | 2022-05-31 | 广州鹏捷科技股份有限公司 | One-stop cloud data center server scheduling method and system |
| CN114338694A (en) * | 2022-03-04 | 2022-04-12 | 广州鹏捷科技股份有限公司 | One-stop cloud data center server scheduling method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110703980B (en) | 2024-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110703980B (en) | File transmission method and device | |
| EP2721504B1 (en) | File processing method, system and server-clustered system for cloud storage | |
| CN102355426B (en) | Method for transmitting off-line file and system | |
| TWI431978B (en) | Methods, devices and systems for obtaining resources | |
| CN108023953B (en) | High-availability implementation method and device for FTP service | |
| CN111447248A (en) | File transmission method and device | |
| CN108173774B (en) | Client upgrading method and system | |
| US10116740B2 (en) | Peer-to-peer network prioritizing propagation of objects through the network | |
| CN111124589B (en) | Service discovery system, method, device and equipment | |
| US9900167B2 (en) | Document sharing method, system, and device | |
| CN110727727B (en) | Statistical method and device for database | |
| TW201405324A (en) | Cloud storage system and data storage and sharing method based on the system | |
| CN110324406B (en) | Method for acquiring business data and cloud service system | |
| CN110557284A (en) | data aggregation method and device based on client gateway | |
| CN102420857A (en) | Operation instruction transmission and processing methods, transmission and cache servers and storage system | |
| CN109873839A (en) | Method, server and the distributed system of data access | |
| CN103369002B (en) | A kind of method and system of resource downloading | |
| CN105978936A (en) | CDN server and data caching method thereof | |
| CN109150936A (en) | The sharing method and device of session object Session in a kind of distributed type assemblies | |
| CN109325056A (en) | A kind of big data processing method and processing device, communication equipment | |
| JP2023547256A (en) | Data download methods, devices, and computer equipment | |
| CN104125294A (en) | Method and system for big data safety management | |
| CN109873855A (en) | A kind of resource acquiring method and system based on block chain network | |
| CN109618187B (en) | Video data acquisition method and device | |
| CN110581784B (en) | Node health check method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |