CN108810055A - A kind of big document transmission method and device - Google Patents
A kind of big document transmission method and device Download PDFInfo
- Publication number
- CN108810055A CN108810055A CN201710309041.2A CN201710309041A CN108810055A CN 108810055 A CN108810055 A CN 108810055A CN 201710309041 A CN201710309041 A CN 201710309041A CN 108810055 A CN108810055 A CN 108810055A
- Authority
- CN
- China
- Prior art keywords
- file destination
- slicing files
- file
- client
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
- H04L67/5651—Reducing the amount or size of exchanged application data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5682—Policies or rules for updating, deleting or replacing the stored data
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of big document transmission methods and device, the method to include：Step 1, sequencing information and size information of all slicing files and slicing files of server storage file destination in file destination；The composite signal of the file destination is generated during receiving slicing files or after having stored all slicing files of file destination according to the sequencing information of each slicing files, size information and storage address；Step 2, the server is provided the data content of each slicing files according to the composite signal of the file destination to client by sequence of each slicing files in file destination after client receives the download request for the file destination to the client.The step of present invention saves the file synthesis for expending treating capacity, improves the treatment effeciency of server, while reducing the storage redundancy of server.
Description
Technical field
The present invention relates to internet data processing technology field more particularly to a kind of big document transmission methods and device.
Background technology
In existing file upload procedure, when the larger file destination of client upload capacity, big file is switched to small
File is identified each small documents, and concurrent is uploaded to server by each small documents.Specifically process includes：Client
It holds to server and sends initialization requests, the fileinfo (including capacity) of this file, server are carried in this initialization requests
After receiving this initialization requests, initialization procedure is carried out according to fileinfo, initialization procedure includes according to this file
File prepares storage region to capacity thus.Server returns to initialization success response after initialization procedure, to client.
After client receives initialization success response, the request for uploading slicing files is sent to server and uploads fragment text to server
Part, client can send synthesis request to server after uploading slicing files process and be opened after server receives synthesis request
Begin to carry out whole Piece file mergence according to the slicing files having received, after having received all slicing files, server is closed
Whole file after and is it is also assumed that be the file destination after reconstruct.This file destination of server storage is receiving above-mentioned visitor
After family end or other clients are asked for the download of this file destination, this stored file destination is sent to download and is asked
The client asked.
In the above-mentioned methods, client can also be sent to server during uploading slicing files for one or
The removal request of more than one slicing files after server receives this removal request, deletes stored slicing files, if
Synthesis request was received before this, can also suspend synthetic operation, and the corresponding fragment text uploaded again is being received from client
After part, it is further continued for carrying out synthetic operation.
In the method, for server when big file to be treated is more, building-up process more expends the processing of server
Ability, especially in the case where occupation proportion is larger in the ratio of All Files for big file.So needing to further increase clothes
The treatment effeciency of business device, saves the process resource of server.
Invention content
In order to solve the above technical problem, the present invention provides a kind of big document transmission method and devices.
Big document transmission method provided by the invention, including：
Step 1, sequence letter of all slicing files and slicing files of server storage file destination in file destination
Breath and size information；According to each point during receiving slicing files or after having stored all slicing files of file destination
Sequencing information, size information and the storage address of piece file generate the composite signal of the file destination；
Step 2, the server is after client receives the download request for the file destination, according to the mesh
The composite signal for marking file provides each fragment by sequence of each slicing files in file destination to client to the client
The data content of file.
Above-mentioned big document transmission method also has the characteristics that：
Further include before each slicing files of the server storage file destination：The server is received from client to be divided
Piece file determines the file destination belonging to slicing files and the row in the file destination according to the mark of slicing files
Sequence.
Above-mentioned big document transmission method also has the characteristics that：
Further include in the step 1：The server backs up the slicing files received, is generating the target
File composite signal success after, delete each slicing files of stored file destination, using each slicing files of backup as
Each slicing files after storage delete each slicing files of backup after generating the composite signal failure of the file destination.
Above-mentioned big document transmission method also has the characteristics that：
Further include before each slicing files of the server storage file destination：The server receives mesh from client
File is marked, after judging that the size of the file destination is more than preset value, the file destination is divided into multiple slicing files.
Above-mentioned big document transmission method also has the characteristics that：
The preset value is determined according to the size average value of stored file.
Big file transfer means provided by the invention are applied to server, including：
Memory module, the slicing files for storing file destination；
Composite signal generation module is used for during receiving slicing files or is storing all points of file destination
The synthesis that the file destination is generated according to the sequencing information of each slicing files, size information and storage address after piece file is believed
Breath；
Request receiving module is downloaded, for receiving the download request for the file destination from client；
Transmission module, for pressing each slicing files in file destination to client according to the composite signal of the file destination
In sequence the data contents of each slicing files is provided to the client.
Above-mentioned big file transfer means also have the characteristics that：
This device further includes file reception module, for receiving slicing files from client, according to the mark of slicing files
Determine the file destination belonging to slicing files and the sequence in the file destination.
Above-mentioned big file transfer means also have the characteristics that：
Described device further includes backup management module；
The backup management module is for backing up the slicing files received, in the conjunction for generating the file destination
At information success after, delete each slicing files of stored file destination, using each slicing files of backup as store after
Each slicing files delete each slicing files of backup after generating the composite signal failure of the file destination.
Above-mentioned big file transfer means also have the characteristics that：
Described device further includes judgment module；
The receiving module is additionally operable to receive file destination from client；
The judgment module is used in the receiving module after client receives file destination, judges the target text
When the size of part is more than preset value, the file destination is divided into multiple slicing files.
Above-mentioned big file transfer means also have the characteristics that：
The preset value is determined according to the size average value of stored file.
The step of present invention saves the file synthesis for expending treating capacity, improves the treatment effeciency of server, subtracts simultaneously
The storage redundancy of server is lacked.
Description of the drawings
The attached drawing for constituting the part of the present invention is used to provide further understanding of the present invention, schematic reality of the invention
Example and its explanation are applied for explaining the present invention, is not constituted improper limitations of the present invention.In the accompanying drawings：
Fig. 1 is the flow chart of big document transmission method in embodiment；
Fig. 2 is the structure chart of big file transfer means in embodiment.
Specific implementation mode
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
The every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.It needs
Illustrate, in the absence of conflict, the features in the embodiments and the embodiments of the present application mutually can be combined arbitrarily.
Fig. 1 is the flow chart of big document transmission method in embodiment；The method includes：
Step 1, sequence letter of all slicing files and slicing files of server storage file destination in file destination
Breath and size information；According to each point during receiving slicing files or after having stored all slicing files of file destination
Sequencing information, size information and the storage address of piece file generate the composite signal of file destination；
Step 2, server is after client receives the download request for downloading object file, according to file destination
In the data that composite signal provides each slicing files by sequence of each slicing files in file destination to client to client
Hold.
Wherein, after the slicing files of server storage file destination, each slicing files are recorded in special storage region
Sequencing information.Sequencing information can be the sequencing information of number formula, such as a certain file destination is divided into 5 slicing files, mesh
Mark file is identified as ABC, by tandem relationship be 5 slicing files be identified as ABC-1, ABC-2, ABC-3, ABC-4,
ABC-5, wherein first character section is the mark of file destination in slicing files mark, and second field is current slice file
Sequence in file destination.
This method save expend treating capacity file synthesis the step of, according to by each slicing files in file destination
It sorts and the data content of each slicing files is provided to client, client is made to remain to download to complete text by the sequencing of file
Part, improves the treatment effeciency of server, while reducing server and slicing files and whole file are stored and made
At storage redundancy.
The mode that server receives file from client in step 1 is one kind in following manner：
Mode one, each slicing files for storing file destination further include before：Server receives file destination from client
Each slicing files.Server receives slicing files from client, is determined belonging to slicing files according to the mark of slicing files
File destination and the sequence in the file destination.When multiple client shares the same file destination, different clients
End can upload the different fragments in same file destination.
Mode two further includes before each slicing files of server storage file destination：Server receives mesh from client
File is marked, after judging that the size of file destination is more than preset value, file destination is divided into multiple slicing files.The preset range is also
Can be determined according to the size average value of the stored file of server, be carried out according to the difference of the file of server storage
It corrects in real time.
Correspond to aforesaid way one in step 1, server is during receiving slicing files according to the text of slicing files
Part information and storage address generate the composite signal of file destination
Correspond to aforesaid way two, server basis after having stored all slicing files of file destination in step 1
The fileinfo and storage address of slicing files generate the composite signal of file destination.
As can be seen from the above description, this method can support the client with different function, client to be drawn with file
When point function, the server in this method can use aforesaid way to obtain slicing files from client, client without
When file partition functionality, the server in this method can automatically divide the complete file received.
Further include in step 1：Server backs up the slicing files received, in the synthesis letter for generating file destination
After ceasing successfully, each slicing files of stored file destination are deleted, using each slicing files of backup as each point after storage
Piece file deletes each slicing files of backup after generating the composite signal failure of file destination.The method can prevent from closing
When failed at information, send the client of slicing files or other client requirements are deleted and certain uploaded successful fragment text
The case where composite signal caused by part fails, effectively prevent the execution mistake of server, ensures the Shandong of server process flow
Stick.
Fig. 2 is the structure chart of big file transfer means in embodiment, this device is applied to server, including memory module,
Composite signal generation module downloads request receiving module, transmission module.
Memory module is used to store the slicing files of file destination；
Composite signal generation module is used for during receiving slicing files or is storing all points of file destination
The synthesis that the file destination is generated according to the sequencing information of the amount of capacity of each slicing files and storage address after piece file is believed
Breath；
Request receiving module is downloaded to be used to receive the download request for file destination from client；
Transmission module, for pressing each slicing files in file destination to client according to the composite signal of the file destination
In sequence the data contents of each slicing files is provided to the client.
This device further includes file reception module, and the mode that this module receives file from client is one in following manner
Kind：
One, slicing files are received from client, the file destination belonging to slicing files is determined according to the mark of slicing files
And the sequence in the file destination；
Two, the present apparatus further includes judgment module；Receiving module is used to receive file destination from client；Judgment module is used for
It, will when judging that the size of the file destination is more than preset value in the receiving module after client receives file destination
File destination is divided into multiple slicing files.
Corresponding with the above method, the present apparatus further includes backup management module；Backup management module is used for receiving
Slicing files are backed up, and after generating the composite signal success of the file destination, delete each of stored file destination
Slicing files, using each slicing files of backup as each slicing files after storage, in the synthesis letter for generating the file destination
After breath failure, each slicing files of backup are deleted.
To sum up, the step of present invention saves the file synthesis for expending treating capacity, improves the treatment effeciency of server, together
When reduce the storage redundancy of server.
Descriptions above can combine implementation individually or in various ways, and these variants all exist
Within protection scope of the present invention.
One of ordinary skill in the art will appreciate that all or part of step in the above method can be instructed by program
Related hardware is completed, and described program can be stored in computer readable storage medium, such as read-only memory, disk or CD
Deng.Optionally, all or part of step of above-described embodiment can also be realized using one or more integrated circuits, accordingly
Ground, the form that hardware may be used in each module/unit in above-described embodiment are realized, the shape of software function module can also be used
Formula is realized.The present invention is not limited to the combinations of the hardware and software of any particular form.
It should be noted that herein, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that article or equipment including a series of elements include not only those elements, but also includes not having
There is the other element being expressly recited, or further includes for this article or the intrinsic element of equipment.Do not limiting more
In the case of system, the element that is limited by sentence " including ... ", it is not excluded that including the element article or equipment in
There is also other identical elements.
The above examples are only used to illustrate the technical scheme of the present invention and are not limiting, reference only to preferred embodiment to this hair
It is bright to be described in detail.It will be understood by those of ordinary skill in the art that can modify to technical scheme of the present invention
Or equivalent replacement should all cover the claim model in the present invention without departing from the spirit of the technical scheme of the invention and range
In enclosing.
Claims (10)
1. a kind of big document transmission method, which is characterized in that including：
Step 1, sequencing information of all slicing files and slicing files of server storage file destination in file destination and
Size information；According to each fragment text during receiving slicing files or after having stored all slicing files of file destination
Sequencing information, size information and the storage address of part generate the composite signal of the file destination；
Step 2, the server is after client receives the download request for the file destination, according to target text
The composite signal of part provides each slicing files by sequence of each slicing files in file destination to client to the client
Data content.
2. big document transmission method as described in claim 1, which is characterized in that
Further include before each slicing files of the server storage file destination：The server receives fragment text from client
Part determines the file destination belonging to slicing files and the sequence in the file destination according to the mark of slicing files.
3. big document transmission method as claimed in claim 2, which is characterized in that
Further include in the step 1：The server backs up the slicing files received, is generating the file destination
Composite signal success after, delete each slicing files of stored file destination, using each slicing files of backup as store
Each slicing files afterwards delete each slicing files of backup after generating the composite signal failure of the file destination.
4. big document transmission method as described in claim 1, which is characterized in that
Further include before each slicing files of the server storage file destination：The server receives target text from client
The file destination is divided into multiple slicing files by part after judging that the size of the file destination is more than preset value.
5. big document transmission method as claimed in claim 4, which is characterized in that the preset value is according to stored file
Size average value determines.
6. a kind of big file transfer means are applied to server, which is characterized in that including：
Memory module, the slicing files for storing file destination；
Composite signal generation module is used for during receiving slicing files or is storing all fragment texts of file destination
The composite signal of the file destination is generated after part according to the sequencing information of each slicing files, size information and storage address；
Request receiving module is downloaded, for receiving the download request for the file destination from client；
Transmission module, for pressing each slicing files in file destination to client according to the composite signal of the file destination
It sorts and the data content of each slicing files is provided to the client.
7. big file transfer means as claimed in claim 6, which is characterized in that
This device further includes file reception module, for receiving slicing files from client, is determined according to the mark of slicing files
File destination belonging to slicing files and the sequence in the file destination.
8. big file transfer means as claimed in claim 7, which is characterized in that
Described device further includes backup management module；
The backup management module is for backing up the slicing files received, in the synthesis letter for generating the file destination
After ceasing successfully, each slicing files of stored file destination are deleted, using each slicing files of backup as each point after storage
Piece file deletes each slicing files of backup after generating the composite signal failure of the file destination.
9. big file transfer means as claimed in claim 6, which is characterized in that
Described device further includes judgment module；
The receiving module is additionally operable to receive file destination from client；
The judgment module is used in the receiving module after client receives file destination, judges the file destination
When size is more than preset value, the file destination is divided into multiple slicing files.
10. big file transfer means as claimed in claim 9, which is characterized in that
The preset value is determined according to the size average value of stored file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710309041.2A CN108810055B (en) | 2017-05-04 | 2017-05-04 | Large file transmission method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710309041.2A CN108810055B (en) | 2017-05-04 | 2017-05-04 | Large file transmission method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108810055A true CN108810055A (en) | 2018-11-13 |
| CN108810055B CN108810055B (en) | 2022-03-29 |
Family
ID=64054724
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710309041.2A Active CN108810055B (en) | 2017-05-04 | 2017-05-04 | Large file transmission method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108810055B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113034194A (en) * | 2021-04-02 | 2021-06-25 | 深圳市英特飞电子有限公司 | Intelligent lamp pole advertisement management method and device, computer equipment and storage medium |
| WO2021146896A1 (en) * | 2020-01-21 | 2021-07-29 | 华为技术有限公司 | File sharing method, apparatus and system |
| CN114039971A (en) * | 2021-11-11 | 2022-02-11 | 北京神舟航天软件技术股份有限公司 | Large file concurrent transmission method based on file flow in BS mode |
| CN114301900A (en) * | 2021-12-27 | 2022-04-08 | 中国电信股份有限公司 | File transmission method and device and electronic equipment |
| CN114915622A (en) * | 2022-05-31 | 2022-08-16 | 广东三维睿新科技有限公司 | HTTP-based file transmission method for web side |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101030873A (en) * | 2007-02-15 | 2007-09-05 | 深圳市迅雷网络技术有限公司 | Method and system for downloading data |
| US20130138736A1 (en) * | 2011-11-25 | 2013-05-30 | Industrial Technology Research Institute | Multimedia file sharing method and system thereof |
| CN105100146A (en) * | 2014-05-07 | 2015-11-25 | 腾讯科技（深圳）有限公司 | Data storage method, device and system |
| CN105472035A (en) * | 2016-01-04 | 2016-04-06 | 百度在线网络技术（北京）有限公司 | File transmission method and device |
-
2017
- 2017-05-04 CN CN201710309041.2A patent/CN108810055B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101030873A (en) * | 2007-02-15 | 2007-09-05 | 深圳市迅雷网络技术有限公司 | Method and system for downloading data |
| US20130138736A1 (en) * | 2011-11-25 | 2013-05-30 | Industrial Technology Research Institute | Multimedia file sharing method and system thereof |
| CN105100146A (en) * | 2014-05-07 | 2015-11-25 | 腾讯科技（深圳）有限公司 | Data storage method, device and system |
| CN105472035A (en) * | 2016-01-04 | 2016-04-06 | 百度在线网络技术（北京）有限公司 | File transmission method and device |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021146896A1 (en) * | 2020-01-21 | 2021-07-29 | 华为技术有限公司 | File sharing method, apparatus and system |
| CN115004665A (en) * | 2020-01-21 | 2022-09-02 | 华为技术有限公司 | File sharing method, device and system |
| CN115004665B (en) * | 2020-01-21 | 2024-04-09 | 华为技术有限公司 | File sharing method, device and system |
| CN113034194A (en) * | 2021-04-02 | 2021-06-25 | 深圳市英特飞电子有限公司 | Intelligent lamp pole advertisement management method and device, computer equipment and storage medium |
| CN113034194B (en) * | 2021-04-02 | 2024-05-17 | 深圳市英特飞电子有限公司 | Intelligent lamp post advertisement management method, intelligent lamp post advertisement management device, computer equipment and storage medium |
| CN114039971A (en) * | 2021-11-11 | 2022-02-11 | 北京神舟航天软件技术股份有限公司 | Large file concurrent transmission method based on file flow in BS mode |
| CN114301900A (en) * | 2021-12-27 | 2022-04-08 | 中国电信股份有限公司 | File transmission method and device and electronic equipment |
| CN114915622A (en) * | 2022-05-31 | 2022-08-16 | 广东三维睿新科技有限公司 | HTTP-based file transmission method for web side |
| CN114915622B (en) * | 2022-05-31 | 2024-01-30 | 广东三维睿新科技有限公司 | File transmission method based on http for web terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108810055B (en) | 2022-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108810055A (en) | A kind of big document transmission method and device | |
| CN102999398B (en) | Method, system and device for user system recovery | |
| DE60209737T2 (en) | METHOD AND APPARATUS FOR THE WIDE-OUT DISTRIBUTION OF ELECTRONIC CONTENTS IN THE PEER-TO-PEER VERSION | |
| CN111182067B (en) | Data writing method and device based on interplanetary file system IPFS | |
| CN108170768A (en) | database synchronization method, device and readable medium | |
| US8244679B1 (en) | Systems and methods for using single-instance-storage information to reclaim storage space occupied by archived data elements | |
| CN104378423B (en) | Metadata cluster distributed memory system and reading, the method for write-in storage data | |
| US20110131293A1 (en) | Data delivery apparatus and data delivery method | |
| JP5477660B2 (en) | Net boot thin client system, computer, thin client implementation method, and thin client program | |
| JP2020509490A (en) | Sequential storage of data in zones in a distributed storage network | |
| CN103634361B (en) | The method and apparatus for downloading file | |
| CN107850983B (en) | Computer system, storage device and data management method | |
| CN111001162A (en) | Game skin changing method and device, storage medium and processor | |
| EP1643365A3 (en) | Computer system | |
| CN105204964B (en) | Data back up method and device based on cloud disk | |
| CN110531933B (en) | Data processing method and server | |
| CN103327085A (en) | Distributed data processing method, data center and distributed data system | |
| CN114185484A (en) | Method, device, equipment and medium for clustering document storage | |
| CN103237063B (en) | Cloud storage method, cloud control server, cloud storage server and system | |
| CN113051102B (en) | File backup method, device, system, storage medium and computer equipment | |
| US9348828B1 (en) | System and method of enhanced backup and recovery configuration | |
| CN104967660A (en) | Network performance improving method oriented to multi-cloud architecture | |
| CN105847363A (en) | Method and system used for cross-region file sharing | |
| CN107168642B (en) | Data storage method and system | |
| CN106991020A (en) | Effective processing of the file system object backed up to image level |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 550003 Building No. 12 in the Southern Park of Gui'an High-end Equipment Industrial Park, Guizhou Province Applicant after: Guizhou Baishan cloud Polytron Technologies Inc Address before: 100015 5 floor, block E, 201 IT tower, electronic city, 10 Jiuxianqiao Road, Chaoyang District, Beijing. Applicant before: Guizhou white cloud Technology Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |