WO2020147403A1

WO2020147403A1 - Cloud storage based file processing method, system and computer device

Info

Publication number: WO2020147403A1
Application number: PCT/CN2019/117772
Authority: WO
Inventors: 刘嘉; 田甜
Original assignee: 平安科技（深圳）有限公司
Priority date: 2019-01-16
Filing date: 2019-11-13
Publication date: 2020-07-23
Also published as: CN109951514B; CN109951514A

Abstract

Provided by the embodiments of the present application is a cloud storage based file processing method, comprising: sending a file upload request to a WEB server; receiving a file ID returned by a server cluster by means of the WEB server; slicing the new file, and assigning a slice number to each slice file; computing a slice ID of each slice file according to the file data, file ID and slice number of each slice file, the slice ID being used to identify a unique correspondence between the slice file and the new file to be uploaded; and uploading a slice file data package to the WEB server so as to send the slice data of each slice file in the slice file data package by means of the WEB server to a corresponding service terminal in the server cluster for storage. Employing the embodiments of the present application avoids the waste of resources and inconsistency between files to be uploaded and slice files by means of an improved slice data upload technique, thus effectively ensuring the correctness of uploaded data.

Description

File processing method, system and computer equipment based on cloud storage

This application affirms the priority of the Chinese patent application filed on January 16, 2019 with the application number 201910040715. 2, titled "Cloud storage-based file processing method, system and computer equipment". The entire content of the Chinese patent application is for reference The method is incorporated in this application.

Technical field

The embodiments of the present application relate to the field of computer data processing, and in particular, to a file processing method, system, computer device, and non-volatile computer-readable storage medium based on cloud storage.

Background technique

Cloud storage refers to the collection of a large number of different types of storage devices in the network through application software through functions such as cluster applications, grid technology or distributed file systems to achieve collaborative work and provide data storage and business access functions together. That is, when the core of cloud computing system operation and processing is the storage and management of large amounts of data, the cloud computing system needs to be equipped with a large number of storage devices. At this time, the cloud computing system is transformed into a cloud storage system, so the cloud storage system is a A cloud computing system with data storage and management as the core. This storage system is composed of multiple storage devices, which work together through cluster functions, distributed file systems or similar grid computing functions, and provide users with certain types of storage services and access through certain application software or application interfaces. service. .

The inventor found that the existing cloud storage solutions are generally based on uploading the entire file or uploading based on slice data, and both have certain technical defects: (1) Based on the entire file upload, it is easy to cause waste of resources, for example, when a user uploads a After a larger file, if only a small part of the file is modified, the entire file still needs to be retransmitted; (2) Uploading based on slice data may easily cause upload failures due to misoperation, for example, if manual or system Misoperation confuses the correspondence between different files to be uploaded and slice files, and there may be a problem that the new file to be uploaded is inconsistent with the slice file.

Summary of the invention

In view of this, the purpose of the embodiments of the present application is to provide a file processing method, system, computer device, and non-volatile computer-readable storage medium based on cloud storage to solve the technical problems of resource waste and upload failure in the prior art.

In order to achieve the foregoing objective, an embodiment of the present application provides a file processing method based on cloud storage, which includes the following steps:

Sending a file upload request to the WEB server, where the file upload request is used to request to upload a new file to the server cluster;

Receiving a file ID returned by the server cluster via the WEB server, where the file ID is generated by the server cluster for the new file;

Slice the new file, and assign a slice serial number to each slice file;

Calculate the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file, where the slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded;

Encapsulating a slice file data package, the slice file data package including a file ID, a slice ID of each slice file, a slice serial number of each slice file, and slice data of each slice file; and

Upload the slice file data package to the WEB server to send slice data of each slice file in the slice file data package to the corresponding service terminal in the server cluster for storage through the WEB server , Wherein the server cluster is used to store the corresponding relationship between the file ID, the slice ID of each slice file, and the slice serial number of each slice file.

In order to achieve the foregoing objectives, the embodiments of the present application also provide a file processing system based on cloud storage, including:

The sending module is used to send a file upload request to the WEB server, where the file upload request is used to request to upload a new file to the server cluster;

A receiving module, configured to receive a file ID returned by the server cluster via the WEB server, where the file ID is generated by the server cluster for the new file;

The slicing module is used to slice the new file and assign a slice serial number to each slice file;

The calculation module is configured to calculate the slice ID of each slice file according to the file data, file ID, and slice sequence number of each slice file, where the slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded;

The encapsulation module is used to encapsulate the slice file data package, the slice file data package including the file ID, the slice ID of each slice file, the slice serial number of each slice file, and the slice data of each slice file; and

The file upload module is configured to upload the slice file data package to the WEB server, so that the slice data of each slice file in the slice file data package is sent to the corresponding server cluster in the server cluster through the WEB server The server cluster is used to store the corresponding relationship between the file ID, the slice ID of each slice file, and the slice serial number of each slice file.

In order to achieve the foregoing objective, an embodiment of the present application also provides a computer device, the computer device including a memory, a processor, and computer-readable instructions stored on the memory and running on the processor, the When the computer-readable instructions are executed by the processor, the following steps are implemented:

Slice the new file, and assign a slice serial number to each slice file;

In order to achieve the foregoing objective, embodiments of the present application also provide a non-volatile computer-readable storage medium, in which computer-readable instructions are stored, and the computer-readable instructions may Is executed by at least one processor, so that the at least one processor executes the following steps:

Slice the new file, and assign a slice serial number to each slice file;

The WEB server is configured to receive a file upload request sent by a computer device, where the file upload request is used to request to upload a new file to the server cluster, and return to the computer device the file ID generated by the server cluster for the new file;

The computer device is used for slicing the new file and assigning a slice number to each slice file; for calculating the slice ID of each slice file according to the file data, file ID, and slice number of each slice file, The slice ID is used to identify the unique corresponding relationship between the slice file and the new file to be uploaded; and used to upload the slice file data package to the WEB server, and the slice file data package contains the file ID and each slice The slice ID of the file, the slice serial number of each slice file, and the slice data of each slice file;

The WEB server is also used to send slice data of each slice file in the slice file data package to the server cluster;

The server cluster is configured to store the slice data of each slice file on the corresponding service terminal, wherein the server cluster saves the file ID, the slice ID of each slice file, and the slice serial number of each slice file The corresponding relationship.

In the cloud storage-based file processing method, system, computer device, and non-volatile computer-readable storage medium provided by the embodiments of the application, the slice ID of each slice file is calculated based on "file data, file The combination of ID and slice serial number, each slice ID can guarantee the unique corresponding relationship between the slice ID, the slice file, and the new file to be uploaded, even if the different files to be uploaded are connected to different files due to human or system error. If the corresponding relationship between the slice files is confused, the new file to be uploaded will not be inconsistent with the slice file.

It can be seen that, because the embodiment of the present application adopts the improved slice data upload technology, it avoids resource waste caused by repeated upload of the entire file, and also avoids the problem of inconsistency between the file to be uploaded and the slice file, and effectively guarantees the correctness of uploaded data.

BRIEF DESCRIPTION

FIG. 1 is a diagram of the operating environment of Embodiment 1 of the file processing method based on cloud storage in this application.

2 is a schematic flowchart of Embodiment 1 of a file processing method based on cloud storage in this application.

3 is a schematic flowchart of the file receiving step in Embodiment 1 of the file processing method based on cloud storage of this application.

4 is a schematic flowchart of Embodiment 3 of a file processing method based on cloud storage in this application.

FIG. 5 is a schematic flowchart of the file receiving step in Embodiment 3 of the file processing method based on cloud storage of this application.

FIG. 6 is a schematic diagram of program modules of Embodiment 4 of a file processing system based on cloud storage in this application.

FIG. 7 is a schematic diagram of the hardware structure of the fifth embodiment of the computer equipment of this application.

detailed description

In order to make the purpose, technical solutions and advantages of the present application more clear, the following describes the present application in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

It should be noted that the descriptions related to "first", "second", etc. in this application are only for descriptive purposes, and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. . Thus, the features defined as "first" and "second" may include at least one of the features either explicitly or implicitly. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of those skilled in the art to achieve. When the combination of technical solutions conflicts with each other or cannot be realized, it should be considered that the combination of such technical solutions does not exist , Nor within the scope of protection required by this application.

Figure 1 shows a diagram of the operating environment of an embodiment of this application. The file processing system 1000 includes multiple execution entities, and the multiple execution entities include:

The computer equipment 2 can be any type of equipment with Internet access function. For example, Personal Digital Assistant (PDA), smart phones, notebook computers, netbooks, personal computers and other similar devices;

WEB server 4, used to communicate with computer equipment 2;

Server cluster 6, server cluster 6 further includes at least one service cluster integration end (Service Manager), each cluster service integration end can be connected to several service distribution ends (Service Master), and each service distribution end can be connected to several service terminals ( Service Worker), the service terminal is used to store 2 data files uploaded by computer equipment.

The following will exemplify the file processing method in the first embodiment based on the file processing system 1000 (including multiple execution entities such as the computer device 2, the WEB server 4, and the server cluster 6).

Example one

Referring to FIG. 2, it shows a flow chart of the steps of the file processing method in the first embodiment of the present application. It can be understood that the flowchart in this method embodiment is not used to limit the order of execution of the steps. details as follows.

In step S100, the computer device 2 sends a file upload request to the WEB server 4.

The file upload request is used to request to upload a new file to the server cluster 6.

In step S102, the WEB server 4 forwards the file upload request to the server cluster 6.

Step S104, the file ID generated by the server cluster 6 for the new file.

Step S106, the server cluster 6 sends the document ID to the WEB server 4.

In step S108, the WEB server 4 forwards the file ID to the computer device 2.

In step S110, the computer device 2 slices the new file, and assigns a slice serial number to each slice file.

Exemplarily, the slice serial number of each slice file can be numbers 1, 2, 3, etc., or letters can be A, B, C, etc., or other numbers, other letters, or other types of characters or text, etc., Used to indicate the order relationship between each slice file.

In step S112, the computer device 2 calculates the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file. The slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded.

In an exemplary embodiment, the step S112 includes:

Step S112A1, the computer device 2 concatenates the file data, the file ID and the slice serial number corresponding to each slice file into a string;

In step S112A2, the computer device 2 calculates the slice ID of each slice file through a hash algorithm according to the character string corresponding to each slice.

It should be noted that the order of the three in the string can be adjusted as needed. For example, it can be adjusted to the file data of each slice file, the slice serial number and file ID of each slice file, or it can be adjusted to the file ID, each The slice number of each slice file, the file data of each slice file, and other sequences.

The hash algorithm can be MD5 (Message Digest Algorithm), SHA (Secure Hash Algorithm), MAC (Message Authentication Code), CRC (Cyclic Redundancy Check), etc. The specific calculation process can be: file data for each slice file The string composed of the file ID and the slice serial number of each slice file performs digest operation of the hash function to obtain the digest operation result, and the digest operation result is used as the slice ID of each slice file. That is, the slice ID of each slice file=Hash function (file data of each slice file, file ID, slice serial number of each slice file), because the Hash function is a prior art, it will not be described in detail.

In an exemplary embodiment, the step S112 includes:

In step S112B1, the computer device 2 calculates the slice initial value of each slice file through a hash algorithm according to the file data of each slice file;

In step S112B2, the computer device 2 calculates the slice ID of each slice file through a hash algorithm according to the initial slice value, file ID and slice serial number corresponding to each slice.

For example, the slice initial value of each slice file=MD5 function (file data of each slice file), the slice ID of each slice file=SHA function (the slice initial value of each slice file, file ID, each The slice sequence number of the slice file), because the MD5 function and the Hash function are existing technologies, they will not be described in detail.

In step S114, the computer device 2 uploads the slice file data package to the WEB server 4.

The slice file data packet includes a file ID, a slice ID of each slice file, a slice serial number of each slice file, and slice data of each slice file.

In step S116, the WEB server 4 sends the slice data of each slice file in the slice file data package to the server cluster 6.

Step S118, the server cluster 6 stores the slice data of each slice file on the corresponding service terminal. The server cluster 6 is used to store the corresponding relationship between the file ID, the slice ID of each slice file, and the slice serial number of each slice file.

In step S120, the server cluster 6 returns the notification message of the storage completion to the WEB server 4.

In step S122, the notification message of the WEB server 4 is forwarded to the computer device 2.

In an exemplary embodiment, as shown in FIG. 3, the file processing method may further include a file downloading step S124. details as follows.

Step S124A, the computer device sends a file download request to the WEB server 4, and the file download request includes the file ID of the file that the computer device 2 requests to download;

Step S124B, the WEB server 4 sends the file download request to the server cluster 6;

Step S124C, the server cluster 6 sends to the WEB server 4 the address of the service terminal that stores each slice file of the file corresponding to the file ID;

In step S124D, the WEB server 4 obtains each slice file from the corresponding service terminal according to the address of the service terminal, where each slice file includes a file ID, a slice ID of each slice file, and a slice serial number of each slice file. , The slice data of each slice file;

Step S124E, the WEB server 4 transmits each slice file to the computer device respectively;

In step S124F, the computer device composes the received slice file into the file requested to be downloaded according to the slice serial number in each slice file.

It can be understood that: (1) The calculation of the slice ID of each slice file in this embodiment is based on the combination of "file data, file ID, and slice serial number of each slice file", and each slice ID can guarantee the slice The unique correspondence between ID, the slice file, and the new file to be uploaded. Even if the correspondence between the different files to be uploaded and the slice file is confused due to human or system error, the new file to be uploaded and the slice file will not appear. The problem of inconsistency; (2) When the computer device 2 needs to download a file, the WEB server 4 in this embodiment will first transmit each slice file to the computer device 2, and the computer device will then according to the slice serial number in each slice file , Composing the received slice file into the file requested to download, so that "sending the file in slices" can optimize the utilization of network bandwidth, and the transmission performance is more optimized.

Example 2

Continuing to refer to FIG. 1, this embodiment is used to exemplarily describe the file processing system 1000.

The file processing system 1000 includes a computer device 2, a WEB server 4, and a server cluster 6.

The WEB server 4 is used to receive a file upload request sent by the computer device 2, and the file upload request is used to request to upload a new file to the server cluster 6 and return to the computer device 4 the file ID generated by the server cluster 6 for the new file .

The computer device 2 is used to slice the new file and assign a slice number to each slice file; it is used to calculate the slice ID of each slice file according to the file data, file ID, and slice number of each slice file. The slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded; and used to upload the slice file data package to the WEB server. The slice file data package contains the file ID and the slice of each slice file. ID, slice serial number of each slice file, slice data of each slice file.

In an exemplary embodiment, calculating the slice ID of each slice file according to the file data, file ID, and slice sequence number of each slice file, further includes: the computer device 2 converts the file data, file ID, and file ID corresponding to each slice file. The slice serial numbers are concatenated into character strings; the computer device 2 calculates the slice ID of each slice file through a hash algorithm according to the character string corresponding to each slice.

In another exemplary embodiment, calculating the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file further includes: the computer device 2 uses the file data of each slice file to disperse The column algorithm calculates the slice initial value of each slice file; the computer device 2 calculates the slice ID of each slice file through the hash algorithm according to the slice initial value, file ID and slice serial number corresponding to each slice.

The WEB server 4 is also used to send the slice data of each slice file in the slice file data package to the server cluster 6.

The server cluster 6 is used to store the slice data of each slice file on the corresponding service terminal, where the server cluster saves the file ID, the slice ID of each slice file, and the slice serial number of each slice file. Correspondence.

In an exemplary embodiment:

The computer device 2 is also used to send a file download request to the WEB server 4, and the file download request includes the file ID of the file that the computer device 2 requests to download;

The WEB server 4 is also used to send the file download request to the server cluster 6;

The server cluster 6 is also used to send the address of the service terminal storing each slice file of the file corresponding to the file ID to the WEB server 4;

The WEB server 4 is also used to obtain each slice file from the corresponding service terminal according to the address of the service terminal, where each slice file includes a file ID, a slice ID of each slice file, and a slice of each slice file. Serial number, slice data of each slice file;

The WEB server 4 is also used to separately transmit each slice file to the computer equipment;

The computer device 2 is also used to compose the received slice file into the file requested to be downloaded according to the slice serial number in each slice file.

The following will exemplify the file processing method in the third embodiment with the computer device 2 as the execution subject.

Example three

Referring to FIG. 4, it shows a flowchart of the steps of the file processing method in the third embodiment of the present application. It can be understood that the flowchart in this method embodiment is not used to limit the order of execution of the steps. details as follows.

Step S200: Send a file upload request to the WEB server, where the file upload request is used to request to upload a new file to the server cluster.

Step S202: Receive a file ID returned by the server cluster via the WEB server, where the file ID is generated by the server cluster for the new file.

Step S204, slice the new file, and assign a slice serial number to each slice file.

Step S206: Calculate the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file, where the slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded.

In an exemplary embodiment, the step S206 includes:

Step S206A1, concatenate the file data, file ID and slice serial number corresponding to each slice file into a string;

Step S206A2: According to the character string corresponding to each slice, the slice ID of each slice file is calculated through a hash algorithm.

The hash algorithm can be MD5 (Message Digest Algorithm), SHA (Secure Hash Algorithm), MAC (Message Authentication Code), CRC (Cyclic Redundancy Check), etc. The specific calculation process can be: file data for each slice file The string consisting of the file ID, and the slice serial number of each slice file executes the digest operation of the Hash function to obtain the digest operation result, which is used as the slice ID of each slice file. That is, the slice ID of each slice file=Hash function (file data of each slice file, file ID, slice serial number of each slice file), because the Hash function is a prior art, it will not be described in detail.

In an exemplary embodiment, the step S206 includes:

Step S206B1, according to the file data of each slice file, calculate the slice initial value of each slice file through a hash algorithm;

In step S206B2, the slice ID of each slice file is calculated through a hash algorithm according to the initial value of the slice corresponding to each slice, the file ID, and the slice serial number.

Step S208: Encapsulate the slice file data package, the slice file data package including the file ID, the slice ID of each slice file, the slice serial number of each slice file, and the slice data of each slice file.

Step S210: Upload the slice file data package to the WEB server, so that the slice data of each slice file in the slice file data package is sent to the corresponding service terminal in the server cluster for storage through the WEB server, where: The server cluster is used to store the corresponding relationship between the file ID, the slice ID of each slice file, and the slice serial number of each slice file.

In an exemplary embodiment, as shown in FIG. 5, the file processing method may further include a file downloading step S212. details as follows.

Step S212A, sending a file download request to the WEB server, where the file download request includes the file ID of the computer device requesting to download the file;

Step S212B: Receive each slice file obtained by the WEB server from the service terminal corresponding to the server cluster based on the file download request, where each slice file includes a file ID, a slice ID of each slice file, and a slice ID of each slice file. Slice serial number, slice data of each slice file;

Step S212C, according to the slice serial number in each slice file, compose the received slice file into the file requested to be downloaded.

Example 4

Please continue to refer to FIG. 6, which shows a schematic diagram of the program modules of the fourth embodiment of the cloud storage-based file processing system of the present application.

It should be noted that the file processing system 1000 shown in FIG. 1 is an external architecture system composed of multiple execution entities. The file processing system 20 described in this embodiment is a software collection composed of one or more program modules.

In this embodiment, the cloud storage-based file processing system 20 may include or be divided into one or more program modules, and the one or more program modules are stored in a storage medium and executed by one or more processors. , In order to complete this application and realize the above-mentioned file processing method based on cloud storage. The program module referred to in the embodiments of the present application refers to a series of computer-readable instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment:

The sending module 200 is configured to send a file upload request to the WEB server, and the file upload request is used to request to upload a new file to the server cluster.

The receiving module 202 is configured to receive a file ID returned by the server cluster via the WEB server, where the file ID is generated by the server cluster for the new file.

The slicing module 204 is used to slice the new file and assign a slice serial number to each slice file.

The calculation module 206 is configured to calculate the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file, and the slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded.

In an exemplary embodiment, the calculation module 206 is further configured to concatenate the file data, file ID, and slice serial number corresponding to each slice file into a string, and use a hash algorithm according to the string corresponding to each slice Calculate the slice ID of each slice file.

In an exemplary embodiment, the calculation module 206 is further configured to calculate the initial slice value of each slice file through a hash algorithm according to the file data of each slice file; and according to the slice initial value and file corresponding to each slice ID and slice serial number, the slice ID of each slice file is calculated through a hash algorithm.

The encapsulation module 208 is configured to encapsulate a slice file data packet, which contains a file ID, a slice ID of each slice file, a slice serial number of each slice file, and slice data of each slice file.

The file upload module 210 is configured to upload the slice file data package to a WEB server, so as to send the slice data of each slice file in the slice file data package to the corresponding server cluster through the WEB server. The server cluster is used to store the corresponding relationship between the file ID, the slice ID of each slice file, and the slice serial number of each slice file.

In an exemplary embodiment, it further includes a file receiving module 212, configured to: send a file download request to the WEB server, where the file download request includes the file ID of the computer device requesting to download the file; and receive the WEB The server obtains each slice file from the service terminal corresponding to the server cluster based on the file download request, where each slice file includes a file ID, a slice ID of each slice file, a slice serial number of each slice file, The slice data of each slice file; according to the slice serial number in each slice file, the received slice file is composed of the file requested to be downloaded.

Example 5

Refer to FIG. 7, which is a schematic diagram of the hardware architecture of the computer device according to the fifth embodiment of the present application. In this embodiment, the computer device 2 is a device that can automatically perform numerical calculation and/or information processing according to pre-set or stored instructions. The computer device 2 may be a Personal Digital Assistant (PDA), a smart phone, a notebook computer, a netbook, a personal computer, and other similar devices. As shown in the figure, the computer device 2 at least includes, but is not limited to, a memory 21, a processor 22, a network interface 23, and a file processing system 20 based on cloud storage that can communicate with each other through a system bus. among them:

In this embodiment, the memory 21 includes at least one type of non-volatile computer-readable storage medium. The readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), Random access memory (RAM), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk Wait. In some embodiments, the memory 21 may be an internal storage unit of the computer device 2, for example, the hard disk or memory of the computer device 2. In other embodiments, the memory 21 may also be an external storage device of the computer device 2, for example, a plug-in hard disk, a smart media card (SMC), and a secure digital (Secure Digital, SD) card, flash card (Flash Card), etc. Of course, the memory 21 may also include both the internal storage unit of the computer device 2 and its external storage device. In this embodiment, the memory 21 is generally used to store the operating system and various application software installed in the computer device 2, for example, the program code of the file processing system 20 based on cloud storage in the fourth embodiment. In addition, the memory 21 can also be used to temporarily store various types of data that have been output or will be output.

The processor 22 may be a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, a microprocessor, or other data processing chips in some embodiments. The processor 22 is generally used to control the overall operation of the computer device 2. In this embodiment, the processor 22 is used to run the program code or process data stored in the memory 21, for example, to run the file processing system 20 based on cloud storage, so as to implement the file processing method based on cloud storage in the third embodiment.

The network interface 23 may include a wireless network interface or a wired network interface, and the network interface 23 is generally used to establish a communication connection between the computer device 2 and other electronic devices. For example, the network interface 23 is used to connect the computer device 2 with an external terminal through a network, and establish a data transmission channel and a communication connection between the computer device 2 and the external terminal. The network may be an intranet, the Internet, a global system of mobile communication (GSM), a wideband code division multiple access (WCDMA), a 4G network, and a 5G Network, Bluetooth (Bluetooth), Wi-Fi and other wireless or wired networks.

It should be pointed out that FIG. 7 only shows the computer device 2 with components 20-23, but it should be understood that it is not required to implement all the components shown, and more or fewer components may be implemented instead.

In this embodiment, the cloud storage-based file processing system 20 stored in the memory 21 may also be divided into one or more program modules, and the one or more program modules are stored in the memory 21, and It is executed by one or more processors (the processor 22 in this embodiment) to complete the application.

For example, FIG. 6 shows a schematic diagram of program modules in the fourth embodiment of the cloud storage-based file processing system 20. In this embodiment, the cloud storage-based file processing system 20 can be divided into a sending module 200 and a receiving module. Module 202, slicing module 204, calculation module 206, packaging module 208, file uploading module 210, and file receiving module 212. Among them, the program module referred to in this application refers to a series of computer-readable instruction segments that can complete specific functions, and is more suitable than a program to describe the execution process of the cloud storage-based file processing system 20 in the computer device 2. . The specific functions of the program modules 200-212 have been described in detail in the fourth embodiment, and will not be repeated here.

Example Six

This embodiment also provides a non-volatile computer-readable storage medium, such as flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory ( SRAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Programmable Read Only Memory (PROM), Magnetic Memory, Disk, Optical Disk, Server, App Store, etc., which are stored on There are computer-readable instructions, and the corresponding functions are realized when the program is executed by the processor. The non-volatile computer-readable storage medium of this embodiment is used to store the cloud storage-based file processing system 20, and the processor executes the following steps:

Slice the new file, and assign a slice serial number to each slice file;

The sequence numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods in the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware, but in many cases the former is better Implementation.

The above are only the preferred embodiments of the present application and do not limit the scope of the patent of the present application. Any equivalent structure or equivalent process transformation made by the description and drawings of this application, or directly or indirectly used in other related technical fields The same reason is included in the patent protection scope of this application.

Claims

A file processing method based on cloud storage, applied to a computer device, the method including:

Sending a file upload request to the WEB server, where the file upload request is used to request to upload a new file to the server cluster;

Receiving a file ID returned by the server cluster via the WEB server, where the file ID is generated by the server cluster for the new file;

Slice the new file, and assign a slice serial number to each slice file;

Calculate the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file, where the slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded;

Encapsulating a slice file data package, the slice file data package including a file ID, a slice ID of each slice file, a slice serial number of each slice file, and slice data of each slice file; and

Upload the slice file data package to the WEB server to send slice data of each slice file in the slice file data package to the corresponding service terminal in the server cluster for storage through the WEB server , Wherein the server cluster is used to store the corresponding relationship between the file ID, the slice ID of each slice file, and the slice serial number of each slice file.
According to the cloud storage-based file processing method of claim 1, the step of calculating the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file includes:

Concatenate the file data, file ID and slice serial number corresponding to each slice file into a string, and

According to the character string corresponding to each slice, the slice ID of each slice file is calculated through a hash algorithm.
According to the cloud storage-based file processing method of claim 1, the step of calculating the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file includes:

According to the file data of each slice file, calculate the slice initial value of each slice file through a hashing algorithm; and

According to the initial value of each slice, the file ID, and the slice serial number, the slice ID of each slice file is calculated through a hash algorithm.
According to the file processing method based on cloud storage of claim 1, when a computer device needs to download a file, the method includes the following steps:

Sending a file download request to the WEB server, where the file download request includes the file ID of the file requested by the computer device to download;

Receive each slice file obtained by the WEB server from the service terminal corresponding to the server cluster based on the file download request, where each slice file includes a file ID, a slice ID of each slice file, and each slice file The slice number and slice data of each slice file;

According to the slice serial number in each slice file, the received slice file is composed of the file requested to be downloaded.
A file processing system based on cloud storage, applied to computer equipment, the system including:

The sending module is used to send a file upload request to the WEB server, where the file upload request is used to request to upload a new file to the server cluster;

A receiving module, configured to receive a file ID returned by the server cluster via the WEB server, where the file ID is generated by the server cluster for the new file;

The slicing module is used to slice the new file and assign a slice serial number to each slice file;

The calculation module is configured to calculate the slice ID of each slice file according to the file data, file ID, and slice sequence number of each slice file, where the slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded;

The encapsulation module is used to encapsulate the slice file data package, the slice file data package including the file ID, the slice ID of each slice file, the slice serial number of each slice file, and the slice data of each slice file; and

The file upload module is configured to upload the slice file data package to the WEB server, so as to send slice data of each slice file in the slice file data package to the server cluster through the WEB server It is stored on the corresponding service terminal, where the server cluster is used to store the corresponding relationship between the file ID, the slice ID of each slice file, and the slice serial number of each slice file.
According to the file processing system according to claim 5, the calculation module is further configured to:

Concatenate the file data, file ID and slice serial number corresponding to each slice file into a string, and

According to the character string corresponding to each slice, the slice ID of each slice file is calculated through a hash algorithm.
According to the file processing system according to claim 5, the calculation module is further configured to:

According to the file data of each slice file, calculate the slice initial value of each slice file through a hashing algorithm; and

According to the initial value of each slice, the file ID, and the slice serial number, the slice ID of each slice file is calculated through a hash algorithm.
The file processing system according to claim 5, further comprising a download module for:

Sending a file download request to the WEB server, where the file download request includes the file ID of the file requested by the computer device to download;

Receive each slice file obtained by the WEB server from the service terminal corresponding to the server cluster based on the file download request, where each slice file includes a file ID, a slice ID of each slice file, and each slice file The slice number and slice data of each slice file;

According to the slice serial number in each slice file, the received slice file is composed of the file requested to be downloaded.
A computer device that includes a memory, a processor, and computer-readable instructions stored on the memory and capable of running on the processor. The computer-readable instructions implement the following steps when executed by the processor :

Sending a file upload request to the WEB server, where the file upload request is used to request to upload a new file to the server cluster;

Receiving a file ID returned by the server cluster via the WEB server, where the file ID is generated by the server cluster for the new file;

Slice the new file, and assign a slice serial number to each slice file;

Calculate the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file, where the slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded;

Encapsulating a slice file data package, the slice file data package including a file ID, a slice ID of each slice file, a slice serial number of each slice file, and slice data of each slice file; and

Upload the slice file data package to the WEB server to send slice data of each slice file in the slice file data package to the corresponding service terminal in the server cluster for storage through the WEB server , Wherein the server cluster is used to store the corresponding relationship between the file ID, the slice ID of each slice file, and the slice serial number of each slice file.
The computer device according to claim 9, wherein the step of calculating the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file comprises:

Concatenate the file data, file ID and slice serial number corresponding to each slice file into a string, and

According to the character string corresponding to each slice, the slice ID of each slice file is calculated through a hash algorithm.
The computer device according to claim 9, wherein the step of calculating the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file comprises:

According to the file data of each slice file, calculate the slice initial value of each slice file through a hashing algorithm; and

According to the initial value of each slice, the file ID, and the slice serial number, the slice ID of each slice file is calculated through a hash algorithm.
According to the computer device of claim 9, when the computer device needs to download a file, the method includes the following steps:

Sending a file download request to the WEB server, where the file download request includes the file ID of the file requested by the computer device to download;

Receive each slice file obtained by the WEB server from the service terminal corresponding to the server cluster based on the file download request, where each slice file includes a file ID, a slice ID of each slice file, and each slice file The slice number and slice data of each slice file;

According to the slice serial number in each slice file, the received slice file is composed of the file requested to be downloaded.
A non-volatile computer-readable storage medium in which computer-readable instructions are stored, and the computer-readable instructions can be executed by at least one processor to cause the At least one processor performs the following steps:

Sending a file upload request to the WEB server, where the file upload request is used to request to upload a new file to the server cluster;

Receiving a file ID returned by the server cluster via the WEB server, where the file ID is generated by the server cluster for the new file;

Slice the new file, and assign a slice serial number to each slice file;

Calculate the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file, where the slice ID is used to identify the unique correspondence between the slice file and the new file to be uploaded;

Encapsulating a slice file data package, the slice file data package including a file ID, a slice ID of each slice file, a slice serial number of each slice file, and slice data of each slice file; and

Upload the slice file data package to the WEB server to send slice data of each slice file in the slice file data package to the corresponding service terminal in the server cluster for storage through the WEB server , Wherein the server cluster is used to store the corresponding relationship between the file ID, the slice ID of each slice file, and the slice serial number of each slice file.
According to the non-volatile computer-readable storage medium of claim 13, the step of calculating the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file comprises:

Concatenate the file data, file ID and slice serial number corresponding to each slice file into a string, and

According to the character string corresponding to each slice, the slice ID of each slice file is calculated through a hash algorithm.
According to the non-volatile computer-readable storage medium of claim 13, the step of calculating the slice ID of each slice file according to the file data, file ID, and slice serial number of each slice file comprises:

According to the file data of each slice file, calculate the slice initial value of each slice file through a hashing algorithm; and

According to the initial value of each slice, the file ID, and the slice serial number, the slice ID of each slice file is calculated through a hash algorithm.
According to the non-volatile computer readable storage medium of claim 13, when the computer device needs to download a file, the at least one processor executes the following steps:

Sending a file download request to the WEB server, where the file download request includes the file ID of the file requested by the computer device to download;

Receive each slice file obtained by the WEB server from the service terminal corresponding to the server cluster based on the file download request, where each slice file includes a file ID, a slice ID of each slice file, and each slice file The slice number and slice data of each slice file;

According to the slice serial number in each slice file, the received slice file is composed of the file requested to be downloaded.
A file processing system based on cloud storage, the system comprising:

The WEB server is configured to receive a file upload request sent by a computer device, where the file upload request is used to request to upload a new file to the server cluster, and return to the computer device the file ID generated by the server cluster for the new file;

The computer device is used for slicing the new file and assigning a slice number to each slice file; for calculating the slice ID of each slice file according to the file data, file ID, and slice number of each slice file, The slice ID is used to identify the unique corresponding relationship between the slice file and the new file to be uploaded; and used to upload the slice file data package to the WEB server, and the slice file data package contains the file ID and each slice The slice ID of the file, the slice serial number of each slice file, and the slice data of each slice file;

The WEB server is also used to send slice data of each slice file in the slice file data package to the server cluster;

The server cluster is configured to store the slice data of each slice file on the corresponding service terminal, wherein the server cluster saves the file ID, the slice ID of each slice file, and the slice serial number of each slice file The corresponding relationship.
According to the file processing system based on cloud storage according to claim 17, the computer device is further used for:

The file data, the file ID, and the slice serial number corresponding to each slice file are concatenated into a string; and the slice ID of each slice file is calculated by a hash algorithm according to the string corresponding to each slice.
According to the file processing system based on cloud storage according to claim 17, the computer device is further used for:

According to the file data of each slice file, the initial value of each slice file is calculated by a hash algorithm; and according to the initial value of each slice, the file ID and the slice serial number, the hash algorithm is used to calculate the initial value of each slice file. Slice ID.
The file processing system based on cloud storage according to claim 17:

The computer device is further configured to send a file download request to the WEB server, and the file download request includes the file ID of the file that the computer device requests to download;

The WEB server is also used to send the file download request to the server cluster;

The server cluster is further configured to send the address of the service terminal storing each slice file of the file corresponding to the file ID to the WEB server;

The WEB server is further configured to obtain each slice file from the corresponding service terminal according to the address of the service terminal, where each slice file includes a file ID, a slice ID of each slice file, and a slice file of each slice file. Slice serial number, slice data of each slice file;

The WEB server is also used to transmit each slice file to the computer device;

The computer device is further configured to compose the received slice file into the file requested to be downloaded according to the slice serial number in each slice file.