CN111245949A - File filing and transmission method, device and equipment - Google Patents
File filing and transmission method, device and equipment Download PDFInfo
- Publication number
- CN111245949A CN111245949A CN202010062629.4A CN202010062629A CN111245949A CN 111245949 A CN111245949 A CN 111245949A CN 202010062629 A CN202010062629 A CN 202010062629A CN 111245949 A CN111245949 A CN 111245949A
- Authority
- CN
- China
- Prior art keywords
- file
- target
- server
- target file
- transmitting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a file filing and transmitting method, device and equipment, and relates to the technical field of file management. The method and the system can slice the target file to obtain the file slice corresponding to the target file by acquiring the target file, and transmit the file slice corresponding to the target file to the server according to the preset transmission speed, so that the preset transmission speed can be adjusted according to the transaction bandwidth occupation condition of a bank outlet when the file is transmitted in a time-sharing manner, and the flow control of the file filing transmission is realized by controlling the slice transmission speed. Compared with the prior art, the method can realize the function of controlling certain uploading or downloading under the application on the level of smaller granularity.
Description
Technical Field
The invention relates to the technical field of file management, in particular to a file archiving and transmitting method, device and equipment.
Background
Under the current big data era, all walks use big data technology, and each website of banks has a large amount of unstructured files to upload to big data centralized platform simultaneously every day. However, the bandwidth of the bank network is small, and important transactions need to interact with a head office or other branch systems at night or in the daytime, so that the network speed needs to be controlled for uploading and downloading large files, such as audio and video, image compression packets and the like, and other more important transactions of the network cannot be influenced.
In the prior art, flow control based on a source address, a destination address, a source port, a destination port and a protocol class is generally realized through hardware such as a router, a switch and the like, so as to solve the problem of how to control network speed and ensure that other more important transactions of a network point are not influenced.
However, the above conventional flow control techniques are all based on a hardware level. If the flow control is performed only by a hardware device such as a switch or a router, there is a problem that the control granularity is too large. For example, if the network speed is controlled by the switch, all applications passing through the switch are controlled, so that all applications are limited in speed, and a function of controlling one of the applications to upload or download cannot be implemented at a smaller granularity level.
Disclosure of Invention
The invention provides a file archiving and transmitting method, a device and equipment, which can control the flow of file transmission and archiving of bank outlets.
In a first aspect, an embodiment of the present invention provides a file archiving and transmitting method, where the method is applied to a client, and the client is connected with a server, and the method includes: acquiring a target file; slicing the target file to obtain a file slice corresponding to the target file; and transmitting the file slice corresponding to the target file to a server according to a preset transmission speed.
Optionally, before the file slice is transmitted to the server at the preset transmission speed, the method further includes: reading the file information of the target file; calculating and acquiring a check value of the target file by adopting a preset algorithm according to the file information; initiating a file query request to a server according to the check value and the file information, wherein the file query request is used for requesting to query whether a breakpoint continuous transmission file exists in a cache directory generated by the check value in the server; receiving a file query result returned by the server according to the file query request; correspondingly, the transmitting the file slice corresponding to the target file to the server according to the preset transmission speed includes: and transmitting the file slice corresponding to the target file to a server according to the file query result and the preset transmission speed.
Optionally, the transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed includes: and if the file query result indicates that no breakpoint continuous transmission file exists, transmitting the file slice corresponding to the target file to a server.
Optionally, the transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed further includes: and if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is larger than the size of the actual file, deleting the cached file and retransmitting the file slice corresponding to the target file to the server.
Optionally, the transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed further includes: if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is smaller than the size of the actual file, positioning the breakpoint according to the size of the cached file; and continuously transmitting the residual file slices corresponding to the target file to a server according to the breakpoint position.
Optionally, the transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed further includes: if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is equal to the size of the actual file, judging whether the check value of the cached file is consistent with the check value of the target file; and if the target file is inconsistent with the target file, deleting the cached file, and retransmitting the file slice corresponding to the target file to the server.
In a second aspect, an embodiment of the present invention further provides a file archiving and transmitting method, where the method is applied to a server, and the server is connected with a client, and the method includes: receiving a file slice corresponding to a target file transmitted by a client according to a preset transmission speed; combining to obtain the target file according to the file slice corresponding to the target file; and archiving the target file to a big data cluster.
In a third aspect, an embodiment of the present invention provides a file archiving and transmitting apparatus, where the apparatus is applied to a client, and the client is connected to a server, and the apparatus includes: the acquisition module is used for acquiring a target file; the slicing module is used for slicing the target file to obtain a file slice corresponding to the target file; and the transmission module is used for transmitting the file slice corresponding to the target file to the server according to a preset transmission speed.
Optionally, the apparatus further comprises: the device comprises a reading module, a calculating module, a query module and a first receiving module; the transmission module is used for transmitting the file slice to a server side according to a preset transmission speed, and the reading module is used for reading the file information of the target file; the calculation module is used for calculating and acquiring a check value of the target file by adopting a preset algorithm according to the file information; the query module is used for initiating a file query request to a server according to the check value and the file information, wherein the file query request is used for requesting to query whether a breakpoint continuous transmission file exists in a cache directory generated by the check value in the server; the first receiving module is used for receiving a file query result returned by the server according to the file query request; correspondingly, the transmission module is specifically configured to transmit the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed.
Optionally, the transmission module is specifically configured to transmit the file slice corresponding to the target file to the server if the file query result indicates that no breakpoint resume file exists.
Optionally, the transmission module is further specifically configured to delete the cached file and retransmit the file slice corresponding to the target file to the server if the file query result indicates that the file is continuously transmitted at the breakpoint and the cached file size is larger than the actual file size.
Optionally, the transmission module is specifically configured to, if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is smaller than the size of the actual file, locate the position of the breakpoint according to the size of the cached file; and continuously transmitting the residual file slices corresponding to the target file to a server according to the breakpoint position.
Optionally, the transmission module is specifically configured to determine whether a check value of the cached file is consistent with a check value of the target file if the file query result indicates that the file is continuously transmitted at the breakpoint and the cached file size is equal to the actual file size; and if the target file is inconsistent with the target file, deleting the cached file, and retransmitting the file slice corresponding to the target file to the server.
In a fourth aspect, an embodiment of the present invention further provides a file archiving and transmitting device, where the device is applied to a server, and the server is connected to a client, and the device includes: the receiving module is used for receiving a file slice corresponding to a target file transmitted by a client according to a preset transmission speed; the combination module is used for combining to obtain the target file according to the file slice corresponding to the target file; and the archiving module is used for archiving the target file to the big data cluster.
In a fifth aspect, an embodiment of the present invention provides a file archiving transmission device, including: a processor, a storage medium and a bus, wherein the storage medium stores machine readable instructions executable by the processor, when the file archiving transmission device is operated, the processor and the storage medium communicate through the bus, and the processor executes the machine readable instructions to execute the file archiving transmission method according to the first aspect or the second aspect.
In a sixth aspect, an embodiment of the present invention further provides a storage medium, where the storage medium stores a computer program, and the computer program is executed by a processor to perform the file archiving transmission method according to the first aspect or the second aspect.
The invention has the beneficial effects that:
according to the embodiment of the invention, the target file can be obtained and sliced to obtain the file slice corresponding to the target file, and the file slice corresponding to the target file is transmitted to the server side according to the preset transmission speed, so that the preset transmission speed can be adjusted according to the transaction bandwidth occupation condition of a bank outlet when the file of the bank outlet is transmitted in a time-sharing manner, and the flow control of the file filing transmission is realized by controlling the slice transmission speed. Compared with the prior art, the method can realize the function of controlling certain uploading or downloading under the application on the level of smaller granularity.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a schematic flow chart illustrating a file archiving and transmitting method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a file slice provided by an embodiment of the invention;
FIG. 3 is a schematic flow chart illustrating a file archiving and transmitting method according to an embodiment of the present invention;
FIG. 4 is a schematic flow chart illustrating a file archiving and transmitting method according to an embodiment of the present invention;
FIG. 5 is a schematic flow chart illustrating a file archiving and transmitting method according to an embodiment of the present invention;
FIG. 6 is a schematic structural diagram of a file archiving and transmitting device according to an embodiment of the present invention;
FIG. 7 is a schematic structural diagram of a file archiving and transmitting device according to an embodiment of the present invention;
FIG. 8 is a schematic structural diagram of a file archiving and transmitting device according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a file archiving and transmitting device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. It should also be noted that the descriptions of "first", "second", "third", etc. are used in the present invention only to distinguish functions, and are not intended to represent relative importance.
The embodiment of the invention provides a file archiving and transmitting method which can control the flow of file transmission and archiving of bank outlets. The execution subject of the file archiving and transmitting method may be a server or a computer, or may also be one or more processors in the server or the computer, and the present invention is not limited thereto. The file archiving and transmitting method can be applied to a client, and the client is connected with a server. The client can be a computer, a mobile phone and other equipment of a bank outlet, and the server can be a server of the bank outlet.
Fig. 1 is a schematic flowchart illustrating a file archiving and transmitting method according to an embodiment of the present invention.
As shown in fig. 1, the file archiving and transmitting method may include:
s101, acquiring a target file.
The target file can be a data file to be transmitted in a bank outlet.
And S102, slicing the target file to obtain a file slice corresponding to the target file.
Fig. 2 shows a file slice diagram provided by an embodiment of the present invention.
As shown in fig. 2, if the size of the target file is 1 megabyte (M), the target file may be sliced with a size of 128 kilobytes (K) per slice.
And S103, transmitting the file slice corresponding to the target file to a server according to a preset transmission speed.
The preset transmission speed may be N slices per second, and N may be a number of 1, 2, 3, 5, etc., which is not limited by the present invention. The specific size of the preset transmission speed can be adjusted according to the network transmission requirement.
As shown in fig. 2, if 2 slices are set to be transmitted in one second, after 2 slices are transmitted in 0.2s, uploading is not continued, and at this time, the transmission is idle, and other banking outlets can initiate archiving. That is, by controlling the preset transmission speed, the flow control can be performed on the file transmission filing in the bank outlets.
Optionally, the slice size may also be set, and by elastically setting the file slice size and the file transmission speed, it may be beneficial for each node to reasonably allocate and utilize resources according to its own facilities and services.
In this way, the embodiment of the present invention may obtain the target file, slice the target file to obtain the file slice corresponding to the target file, and transmit the file slice corresponding to the target file to the server according to the preset transmission speed, so that when the file is transmitted in a time-sharing manner at a bank outlet, the preset transmission speed may be adjusted according to the occupation condition of the transaction bandwidth at the outlet, thereby controlling the flow rate of the file filing transmission by controlling the slice transmission speed. Compared with the prior art, the method can realize the function of controlling certain uploading or downloading under the application on the level of smaller granularity.
Fig. 3 is another schematic flow chart of the file archiving and transmitting method according to the embodiment of the present invention.
Optionally, as shown in fig. 3, before the file slice is transmitted to the server according to the preset transmission speed, the file archiving and transmitting method may further include:
s301, reading the file information of the target file.
The file information may include file name, file size, file content, and the like.
And S302, calculating and acquiring the check value of the target file by adopting a preset algorithm according to the file information.
For example, the preset Algorithm may be a Message Digest Algorithm (Message Digest Algorithm MD5), and MD5 calculation is performed on the file name and the file content, so as to obtain an MD5 value as the check value.
S303, initiating a file query request to a server according to the check value and the file information.
The file query request may be used to request to query whether a breakpoint resume file exists in the cache directory generated by the check value in the server.
For example, the server may check whether a file exists in the server cache directory generated by the MD5 value of the file name according to the file name and the file size, and return the result to the client.
S304, receiving a file query result returned by the server according to the file query request.
Correspondingly, the transmitting the file slice corresponding to the target file to the server according to the preset transmission speed may include: and transmitting the file slice corresponding to the target file to a server according to the file query result and the preset transmission speed.
Optionally, the step of transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed may specifically include: and if the file query result indicates that no breakpoint continuous transmission file exists, transmitting the file slice corresponding to the target file to a server.
Optionally, the step of transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed may further include: and if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is larger than the size of the actual file, deleting the cached file and retransmitting the file slice corresponding to the target file to the server.
Optionally, the step of transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed may further include: if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is smaller than the size of the actual file, positioning the breakpoint according to the size of the cached file; and continuously transmitting the residual file slices corresponding to the target file to a server according to the breakpoint position.
Optionally, the step of transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed may further include: if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is equal to the size of the actual file, judging whether the check value of the cached file is consistent with the check value of the target file; and if the target file is inconsistent with the target file, deleting the cached file, and retransmitting the file slice corresponding to the target file to the server.
The embodiment of the invention also provides a file archiving and transmitting method, which is applied to the server side, and the server side is connected with the client side.
Fig. 4 is a schematic flowchart illustrating a file archiving and transmitting method according to an embodiment of the present invention.
As shown in fig. 4, the file archiving and transmitting method may include:
s401, receiving a file slice corresponding to a target file transmitted by a client according to a preset transmission speed.
S402, combining to obtain the target file according to the file slice corresponding to the target file.
Optionally, each file slice has a corresponding slice identifier (e.g., ID), and after the file slice reaches the server, the server may continuously combine all the slice identifiers together according to the slice identifiers to form the target file.
And S403, archiving the target file to a big data cluster.
For example, the big data cluster can be a Hadoop, the server side directly combines file slices after receiving the file slices, and after the file slices are completely received, the server side can also verify the integrity of the target file based on the check value, and then calls an interface of the Hadoop to file the file to the Hadoop.
The following describes a file archiving and transmitting method provided in the embodiment of the present invention in a specific implementation manner:
fig. 5 is a schematic flowchart illustrating a file archiving and transmitting method according to an embodiment of the present invention.
As shown in fig. 5, the file archiving and transmitting method may specifically be as follows:
1) the client reads the file information, MD5 calculation is carried out on the file name and the file content, the MD5 value and the file metadata information are sent to the server side to carry out a first request, whether a file to be continuously transmitted exists in a server cache directory generated by the MD5 value of the file name or not is checked according to the file name and the file size, and the result is returned to the client.
2) And the client receives the first request result, if the breakpoint continuous transmission file does not exist, the file content is sent to the server according to the specified file slice size and the file transmission speed according to the step 3).
3) Adding the file fragments into the files of the server cache directory, wherein in the adding process, according to a specified file transmission speed value such as 10kb/s, if 900ms does not reach 1s when the transmission of the byte stream of 10kb is finished, the adding fragments are required to continue to upload after 100ms reaches 1 s.
4) And the client receives the first request result and determines that the breakpoint continuously-transmitted file exists, if the size of the existing file in the cache is larger than that of the actual file, the cache file is deleted, and the file is re-fragmented and uploaded according to the step 3).
5) And (3) the client receives the first request result and judges that the file is continuously transmitted at the breakpoint, the size of the existing file in the cache is smaller than that of the actual file, the size of the file is returned to the client, the position of the breakpoint is positioned according to the size of the file, and the rest file content is uploaded according to the fragments obtained in the step 3).
6) And if the client receives the first request result that the breakpoint continuous transmission file exists, and the size of the existing file in the cache is equal to that of the actual file, checking whether the MD5 value of the content of the existing file is consistent with the MD5 value of the content of the file transmitted by the client, and deleting and re-uploading the file if the MD5 value of the content of the existing file is not consistent with the MD5 value of the content of the file transmitted by the client.
7) And after all the files are uploaded to the service cache addresses, checking the MD5 value of the file content, and if the files are consistent, uploading the files to the big data cluster.
Based on the file archiving and transmitting method in the foregoing method embodiment, an embodiment of the present invention further provides a file archiving and transmitting device, where the device is applied to a client, and the client is connected with a server.
Fig. 6 is a schematic structural diagram of a file archiving and transmitting device according to an embodiment of the present invention.
As shown in fig. 6, the file filing and transmitting apparatus may include: an obtaining module 10, configured to obtain a target file; the slicing module 20 is configured to slice the target file to obtain a file slice corresponding to the target file; and the transmission module 30 is configured to transmit the file slice corresponding to the target file to the server according to a preset transmission speed.
Fig. 7 is a schematic structural diagram of a file archiving and transmitting device according to an embodiment of the present invention.
Optionally, as shown in fig. 7, the file filing and transmitting device may further include: a reading module 40, a calculating module 50, a querying module 60, and a first receiving module 70; the reading module 40 is configured to read file information of the target file before the transmission module 30 transmits the file slice to the server according to a preset transmission speed; the calculation module 50 is configured to calculate and obtain a check value of the target file by using a preset algorithm according to the file information; the query module 60 is configured to initiate a file query request to a server according to the check value and the file information, where the file query request is used to request to query whether a breakpoint resume file exists in a cache directory generated by the check value in the server; a first receiving module 70, configured to receive a file query result returned by the server according to the file query request; correspondingly, the transmission module 30 is specifically configured to transmit the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed.
Optionally, the transmission module 30 is specifically configured to transmit the file slice corresponding to the target file to the server if the file query result indicates that there is no breakpoint resume file.
Optionally, the transmission module 30 is further specifically configured to delete the cached file and retransmit the file slice corresponding to the target file to the server if the file query result indicates that the file is continuously transmitted at the breakpoint and the cached file size is larger than the actual file size.
Optionally, the transmission module 30 is further specifically configured to, if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is smaller than the size of the actual file, locate the position of the breakpoint according to the size of the cached file; and continuously transmitting the residual file slices corresponding to the target file to a server according to the breakpoint position.
Optionally, the transmission module 30 is further specifically configured to determine whether the check value of the cached file is consistent with the check value of the target file if the file query result indicates that the file is continuously transmitted at the breakpoint and the cached file size is equal to the actual file size; and if the target file is inconsistent with the target file, deleting the cached file, and retransmitting the file slice corresponding to the target file to the server.
Based on the file archiving and transmitting method in the foregoing method embodiment, an embodiment of the present invention further provides a file archiving and transmitting device, where the device is applied to a server, and the server is connected with a client.
Fig. 8 is a schematic structural diagram of a file archiving and transmitting device according to an embodiment of the present invention.
As shown in fig. 8, the file filing and transmitting apparatus may include: the receiving module 110 is configured to receive a file slice corresponding to a target file transmitted by a client at a preset transmission speed; the combination module 120 is configured to combine the file slices corresponding to the target file to obtain the target file; an archiving module 130 configured to archive the target file to a big data cluster.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the apparatus described above may refer to the corresponding process of the method in the foregoing method embodiment, and is not described in detail herein.
The file archiving and transmitting device provided in the embodiment of the present invention corresponds to the file archiving and transmitting method described in the foregoing method embodiment, and therefore the file archiving and transmitting device described in the device embodiment has all the beneficial effects of the file archiving and transmitting method described in the foregoing method embodiment, and details are not repeated here.
The embodiment of the present invention further provides a file archiving and transmitting device, where the file archiving and transmitting device may be a server or a computer, and fig. 9 shows a schematic structural diagram of the file archiving and transmitting device provided in the embodiment of the present invention.
As shown in fig. 9, the file filing transmission apparatus may include: the storage medium 200 stores machine readable instructions executable by the processor 100, the processor 100 communicates with the storage medium 200 via the bus when the filing transmission apparatus is operated, and the processor 100 executes the machine readable instructions to perform the filing transmission method according to any of the method embodiments described above. The specific implementation and technical effects are similar, and are not described herein again.
For ease of illustration, only one processor is described in the above-described document filing transmission apparatus. However, it should be noted that the archive transmission device of the present invention may also include a plurality of processors, and thus the steps performed by one processor described in the present invention may also be performed by a plurality of processors in combination or individually. For example, the processor of the archive transmission device executes steps a and B, it will be understood that steps a and B may be executed by two different processors together or may be executed in a single processor. For example, a first processor performs step a and a second processor performs step B, or the first processor and the second processor perform steps a and B together, etc.
In some embodiments, a processor may include one or more processing cores (e.g., a single-core processor (S) or a multi-core processor (S)). Merely by way of example, a Processor may include a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), an Application Specific Instruction Set Processor (ASIP), a Graphics Processing Unit (GPU), a Physical Processing Unit (PPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a microcontroller Unit, a Reduced Instruction Set computer (Reduced Instruction Set computer), a microprocessor, or the like, or any combination thereof.
An embodiment of the present invention further provides a storage medium, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the method for archiving and transmitting files described in any of the foregoing method embodiments is executed. The specific implementation and technical effects are similar, and are not described herein again.
Alternatively, the storage medium may be a U disk, a removable hard disk, a ROM, a RAM, a magnetic or optical disk, or the like.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A file archiving and transmitting method is applied to a client, the client is connected with a server, and the method comprises the following steps:
acquiring a target file;
slicing the target file to obtain a file slice corresponding to the target file;
and transmitting the file slice corresponding to the target file to a server according to a preset transmission speed.
2. The method according to claim 1, wherein before transmitting the file slice to the server at the preset transmission speed, the method further comprises:
reading the file information of the target file;
calculating and acquiring a check value of the target file by adopting a preset algorithm according to the file information;
initiating a file query request to a server according to the check value and the file information, wherein the file query request is used for requesting to query whether a breakpoint continuous transmission file exists in a cache directory generated by the check value in the server;
receiving a file query result returned by the server according to the file query request;
correspondingly, the transmitting the file slice corresponding to the target file to the server according to the preset transmission speed includes:
and transmitting the file slice corresponding to the target file to a server according to the file query result and the preset transmission speed.
3. The method according to claim 2, wherein the transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed comprises:
and if the file query result indicates that no breakpoint continuous transmission file exists, transmitting the file slice corresponding to the target file to a server.
4. The method according to claim 3, wherein the transmitting the file slice corresponding to the target file to the server according to the file query result and the preset transmission speed further comprises:
and if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is larger than the size of the actual file, deleting the cached file and retransmitting the file slice corresponding to the target file to the server.
5. The method according to claim 4, wherein the transmitting the file slice corresponding to the target file to a server according to the file query result and a preset transmission speed further comprises:
if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is smaller than the size of the actual file, positioning the breakpoint according to the size of the cached file;
and continuously transmitting the residual file slices corresponding to the target file to a server according to the breakpoint position.
6. The method according to claim 5, wherein the transmitting the file slice corresponding to the target file to a server according to the file query result and a preset transmission speed further comprises:
if the file query result indicates that the file is continuously transmitted at the breakpoint and the size of the cached file is equal to the size of the actual file, judging whether the check value of the cached file is consistent with the check value of the target file;
and if the target file is inconsistent with the target file, deleting the cached file, and retransmitting the file slice corresponding to the target file to the server.
7. A file archiving and transmitting method is applied to a server, the server is connected with a client, and the method comprises the following steps:
receiving a file slice corresponding to a target file transmitted by a client according to a preset transmission speed;
combining to obtain the target file according to the file slice corresponding to the target file;
and archiving the target file to a big data cluster.
8. A file filing and transmitting device is applied to a client side, the client side is connected with a server side, and the device comprises:
the acquisition module is used for acquiring a target file;
the slicing module is used for slicing the target file to obtain a file slice corresponding to the target file;
and the transmission module is used for transmitting the file slice corresponding to the target file to the server according to a preset transmission speed.
9. A file archiving and transmitting device is characterized in that the device is applied to a server side, the server side is connected with a client side, and the device comprises:
the receiving module is used for receiving a file slice corresponding to a target file transmitted by a client according to a preset transmission speed;
the combination module is used for combining to obtain the target file according to the file slice corresponding to the target file;
and the archiving module is used for archiving the target file to the big data cluster.
10. A file archiving transmission device, comprising: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating via the bus when the archive transmission device is operating, the processor executing the machine-readable instructions to perform the archive transmission method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010062629.4A CN111245949A (en) | 2020-01-19 | 2020-01-19 | File filing and transmission method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010062629.4A CN111245949A (en) | 2020-01-19 | 2020-01-19 | File filing and transmission method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111245949A true CN111245949A (en) | 2020-06-05 |
Family
ID=70876531
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010062629.4A Pending CN111245949A (en) | 2020-01-19 | 2020-01-19 | File filing and transmission method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111245949A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112199052A (en) * | 2020-11-04 | 2021-01-08 | 江苏特思达电子科技股份有限公司 | File downloading method and device and computer equipment |
| CN114520807A (en) * | 2022-02-24 | 2022-05-20 | 深圳壹账通智能科技有限公司 | File uploading and downloading method and device, computer equipment and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102710630A (en) * | 2012-05-29 | 2012-10-03 | 新华网股份有限公司 | Cloud upload and download method and system of multi-threaded slice |
| CN102801690A (en) * | 2011-05-25 | 2012-11-28 | 华为技术有限公司 | Stream media processing method, distribution server, client and system |
| CN103973421A (en) * | 2013-02-06 | 2014-08-06 | 腾讯科技（深圳）有限公司 | File transmitting method and device |
| CN104022852A (en) * | 2014-06-25 | 2014-09-03 | 北京奇艺世纪科技有限公司 | Document transmission method and device |
| CN104185216A (en) * | 2013-05-28 | 2014-12-03 | 腾讯科技（深圳）有限公司 | File transferring method and apparatus |
| CN106302589A (en) * | 2015-05-27 | 2017-01-04 | 腾讯科技（深圳）有限公司 | Document transmission method and terminal |
| CN108401012A (en) * | 2018-01-31 | 2018-08-14 | 山东汇贸电子口岸有限公司 | A kind of document breakpoint transmission method |
| CN108881461A (en) * | 2018-07-02 | 2018-11-23 | 深圳市茁壮网络股份有限公司 | A kind of data transmission method, apparatus and system |
| CN109831506A (en) * | 2019-01-31 | 2019-05-31 | 百度在线网络技术（北京）有限公司 | File uploading method, device, terminal, server and readable storage medium storing program for executing |
| CN110011952A (en) * | 2018-01-05 | 2019-07-12 | 中国移动通信有限公司研究院 | A kind of method, service cluster and the client of data transmission |
| CN110213623A (en) * | 2019-06-03 | 2019-09-06 | 上海哔哩哔哩科技有限公司 | Video method for uploading, video upload device and computer readable storage medium |
-
2020
- 2020-01-19 CN CN202010062629.4A patent/CN111245949A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102801690A (en) * | 2011-05-25 | 2012-11-28 | 华为技术有限公司 | Stream media processing method, distribution server, client and system |
| CN102710630A (en) * | 2012-05-29 | 2012-10-03 | 新华网股份有限公司 | Cloud upload and download method and system of multi-threaded slice |
| CN103973421A (en) * | 2013-02-06 | 2014-08-06 | 腾讯科技（深圳）有限公司 | File transmitting method and device |
| CN104185216A (en) * | 2013-05-28 | 2014-12-03 | 腾讯科技（深圳）有限公司 | File transferring method and apparatus |
| CN104022852A (en) * | 2014-06-25 | 2014-09-03 | 北京奇艺世纪科技有限公司 | Document transmission method and device |
| CN106302589A (en) * | 2015-05-27 | 2017-01-04 | 腾讯科技（深圳）有限公司 | Document transmission method and terminal |
| CN110011952A (en) * | 2018-01-05 | 2019-07-12 | 中国移动通信有限公司研究院 | A kind of method, service cluster and the client of data transmission |
| CN108401012A (en) * | 2018-01-31 | 2018-08-14 | 山东汇贸电子口岸有限公司 | A kind of document breakpoint transmission method |
| CN108881461A (en) * | 2018-07-02 | 2018-11-23 | 深圳市茁壮网络股份有限公司 | A kind of data transmission method, apparatus and system |
| CN109831506A (en) * | 2019-01-31 | 2019-05-31 | 百度在线网络技术（北京）有限公司 | File uploading method, device, terminal, server and readable storage medium storing program for executing |
| CN110213623A (en) * | 2019-06-03 | 2019-09-06 | 上海哔哩哔哩科技有限公司 | Video method for uploading, video upload device and computer readable storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112199052A (en) * | 2020-11-04 | 2021-01-08 | 江苏特思达电子科技股份有限公司 | File downloading method and device and computer equipment |
| CN114520807A (en) * | 2022-02-24 | 2022-05-20 | 深圳壹账通智能科技有限公司 | File uploading and downloading method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108924250B (en) | Service request processing method and device based on block chain and computer equipment | |
| US20150237113A1 (en) | Method and system for file transmission | |
| CN111200657B (en) | Method for managing resource state information and resource downloading system | |
| EP2704398A1 (en) | A method for content change notification in a cloud storage system, a corresponding cloud broker and cloud agent | |
| US20210160319A1 (en) | Data Sending Method and Apparatus, and Data Receiving Method and Apparatus | |
| US20170185615A1 (en) | Data processing method and device | |
| TW201301053A (en) | File processing method, system and server-clustered system for cloud storage | |
| JP4205323B2 (en) | Distribution system, distribution server and distribution method, distribution program | |
| US9075722B2 (en) | Clustered and highly-available wide-area write-through file system cache | |
| WO2020147403A1 (en) | Cloud storage based file processing method, system and computer device | |
| US20170153909A1 (en) | Methods and Devices for Acquiring Data Using Virtual Machine and Host Machine | |
| CN110572422A (en) | Data downloading method and device | |
| CN113411404A (en) | File downloading method, device, server and storage medium | |
| CN111245949A (en) | File filing and transmission method, device and equipment | |
| CN111491037A (en) | Communication method with object storage server through SFTP data stream | |
| CN112632008A (en) | Data fragment transmission method and device and computer equipment | |
| CN115694699A (en) | Time delay parameter acquisition method and device, electronic equipment and storage medium | |
| CN110798495A (en) | Method and server for end-to-end message push in cluster architecture mode | |
| CN112688905B (en) | Data transmission method, device, client, server and storage medium | |
| CN113900990A (en) | File fragment storage method, device, equipment and storage medium | |
| CN113194330A (en) | Fragmented multi-cloud video resource management method and system | |
| CN113032820A (en) | File storage method, access method, device, equipment and storage medium | |
| CN110677497A (en) | Network medium distribution method and device | |
| CN114765606B (en) | Container mirror image transmission method, device, equipment and storage medium | |
| CN114172945B (en) | Method and equipment for realizing full duplex instant messaging through simulation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200605 |
|
| RJ01 | Rejection of invention patent application after publication |