CN111343225A - File processing method and device - Google Patents
File processing method and device Download PDFInfo
- Publication number
- CN111343225A CN111343225A CN201811558054.4A CN201811558054A CN111343225A CN 111343225 A CN111343225 A CN 111343225A CN 201811558054 A CN201811558054 A CN 201811558054A CN 111343225 A CN111343225 A CN 111343225A
- Authority
- CN
- China
- Prior art keywords
- file
- fragments
- complete
- source database
- acquisition request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title abstract description 9
- 239000012634 fragment Substances 0.000 claims abstract description 147
- 238000000034 method Methods 0.000 claims abstract description 41
- 230000005540 biological transmission Effects 0.000 claims abstract description 36
- 238000013467 fragmentation Methods 0.000 claims description 69
- 238000006062 fragmentation reaction Methods 0.000 claims description 69
- 238000010586 diagram Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 239000002699 waste material Substances 0.000 description 3
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
- H04L67/1078—Resource delivery mechanisms
- H04L67/108—Resource delivery mechanisms characterised by resources being split in blocks or fragments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a file processing method, a file processing device, electronic equipment and a computer readable storage medium. The method comprises the following steps: dividing a complete file acquired from a source database into a plurality of fragments, and storing each fragment; receiving an acquisition request of a complete or partial appointed file sent by a front-end server; and returning all fragments of the designated file stored locally or fragments of the designated file corresponding to the acquisition request to the front-end server according to the acquisition request. By the technical scheme, no matter the front-end server receives the acquisition request of the complete file or the acquisition request of the partial file, the storage server only returns the corresponding complete file or the partial file, transmission resources are not occupied, the transmission resources are reasonably used, the corresponding speed of the request is ensured, and the user experience is improved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a file processing method, a file processing device, electronic equipment and a computer readable storage medium.
Background
When the front-end server receives the file acquisition request, the corresponding file is acquired from the storage server storing the file. In the prior art, a file stored in a storage server is a complete file acquired from a source database, and when the storage server returns the file to a front-end server, the complete file is returned, but if the front-end server receives a request for acquiring a part of the file, the return of the complete file occupies transmission resources, which causes waste of the transmission resources, affects the response speed of the request, and further affects user experience.
Disclosure of Invention
In view of the above, the present invention has been made to provide a file processing method, apparatus, electronic device, and computer-readable storage medium that overcome or at least partially solve the above-mentioned problems.
According to an aspect of the present invention, there is provided a file processing method, wherein the method includes:
dividing a complete file acquired from a source database into a plurality of fragments, and storing each fragment;
receiving an acquisition request of a complete or partial appointed file sent by a front-end server;
and returning all fragments of the designated file stored locally or the fragments of the designated file corresponding to the acquisition request to the front-end server according to the acquisition request.
Optionally, the dividing the complete file obtained from the source database into a plurality of fragments includes:
when acquiring a complete file from a source database, dividing the acquired complete file into a plurality of fragments;
and/or the presence of a gas in the gas,
and judging whether the fragmentation condition is met, if so, dividing the complete file which is acquired from the source database and is stored locally into a plurality of fragments.
Optionally, the determining whether the fragmentation condition is satisfied includes:
judging whether the occupancy rate of the transmission resources of the front-end server reaches a preset upper limit value or not, and if so, determining that the fragmentation condition is met;
and/or the presence of a gas in the gas,
judging whether the number of the received acquisition requests of the part of the designated files sent by the front-end server reaches a preset threshold value or not, and if so, determining that the fragmentation condition is met.
Optionally, the dividing the complete file obtained from the source database into a plurality of fragments includes:
and dividing the complete file acquired from the source database into a plurality of fragments according to a preset granularity.
Optionally, the preset granularity is determined according to one or more of the following factors:
the size of the file obtained from the source database;
the size of the local storage space.
Optionally, dividing the complete file acquired from the source database into a plurality of fragments according to the preset granularity includes:
setting a preset period;
re-determining the preset granularity according to a preset period;
and dividing the complete file acquired from the source database into a plurality of fragments according to the redetermined preset granularity.
Optionally, the re-determining the preset granularity according to the preset period includes:
when a preset period is reached, counting the part with the maximum acquisition times of the specified file according to the acquisition request of the complete or partial specified file in the period, taking the part as a fragment of the specified file, and determining the preset granularity according to the size of the part of the file.
Optionally, after receiving the request for obtaining the complete or partial specified file sent by the front-end server, the method further includes:
judging whether a specified file is stored locally, and if not, sending an acquisition request of the specified file to a source database;
receiving a specified file returned by a source database;
and dividing the received designated file into a plurality of fragments and storing each fragment.
Optionally, the receiving an acquisition request of the complete specified file sent by the front-end server includes:
receiving an acquisition request which is sent by a front-end server and used for respectively acquiring each fragment of a designated file; the obtaining requests for respectively obtaining the fragments of the designated file are generated by the front-end server according to the obtaining requests of the complete designated file sent by the client.
According to another aspect of the present invention, there is provided a document processing apparatus, wherein the apparatus includes:
the fragmentation unit is suitable for dividing the complete file acquired from the source database into a plurality of fragments and storing each fragment;
the receiving unit is suitable for receiving an acquisition request of a complete or partial appointed file sent by a front-end server;
and the sending unit is suitable for returning all fragments of the specified file stored locally or the fragments of the specified file corresponding to the acquisition request to the front-end server according to the acquisition request.
Alternatively,
the fragmentation unit is suitable for dividing the acquired complete file into a plurality of fragments when the complete file is acquired from the source database; and/or judging whether the fragmentation condition is met, if so, dividing the complete file which is acquired from the source database and is stored locally into a plurality of fragments.
Alternatively,
the fragmentation unit is suitable for judging whether the occupancy rate of the transmission resource with the front-end server reaches a preset upper limit value or not, and if so, determining that the fragmentation condition is met; and/or judging whether the number of the received acquisition requests of the part of the designated files sent by the front-end server reaches a preset threshold value or not, and if so, determining that the fragmentation condition is met.
Alternatively,
the fragmentation unit is suitable for dividing the complete file acquired from the source database into a plurality of fragments according to a preset granularity.
Optionally, the preset granularity is determined according to one or more of the following factors:
the size of the file obtained from the source database;
the size of the local storage space.
Alternatively,
the slicing unit is suitable for setting a preset period; re-determining the preset granularity according to a preset period; and dividing the complete file acquired from the source database into a plurality of fragments according to the redetermined preset granularity.
Alternatively,
the fragmentation unit is suitable for counting the part with the maximum acquisition frequency of the specified file according to the acquisition request of the complete or partial specified file in the preset period when the preset period is reached, taking the part as a fragmentation of the specified file, and determining the preset granularity according to the size of the part of the file.
Optionally, after the receiving unit receives an acquisition request of a complete or partial specified file sent by a front-end server, the apparatus further includes:
the judging unit is suitable for judging whether the specified file is stored locally or not, and if not, sending an acquisition request of the specified file to the source database; receiving a specified file returned by a source database; and dividing the received designated file into a plurality of fragments and storing each fragment.
Alternatively,
the receiving unit is suitable for receiving the acquisition requests which are sent by the front-end server and used for respectively acquiring the fragments of the designated file; the obtaining requests for respectively obtaining the fragments of the designated file are generated by the front-end server according to the obtaining requests of the complete designated file sent by the client.
According to still another aspect of the present invention, there is provided an electronic apparatus, wherein the electronic apparatus includes:
a processor; and the number of the first and second groups,
a memory arranged to store computer executable instructions that, when executed, cause the processor to perform a method according to the foregoing.
According to yet another aspect of the present invention, there is provided a computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement the aforementioned method.
According to the technical scheme of the invention, the complete file acquired from the source database is divided into a plurality of fragments, and each fragment is stored; receiving an acquisition request of a complete or partial appointed file sent by a front-end server; and returning all fragments of the designated file stored locally or fragments of the designated file corresponding to the acquisition request to the front-end server according to the acquisition request. By the technical scheme, no matter the front-end server receives the acquisition request of the complete file or the acquisition request of the partial file, the storage server only returns the corresponding complete file or the partial file, transmission resources are not occupied, the transmission resources are reasonably used, the corresponding speed of the request is ensured, and the user experience is improved.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 shows a schematic flow diagram of a file processing method according to one embodiment of the invention;
FIG. 2 is a schematic configuration diagram showing a document processing apparatus according to an embodiment of the present invention;
FIG. 3 shows a schematic structural diagram of an electronic device according to one embodiment of the invention;
fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Fig. 1 shows a flowchart illustrating a file processing method according to an embodiment of the present invention. As shown in fig. 1, the method includes:
step S110, dividing the complete file obtained from the source database into a plurality of fragments, and storing each fragment.
The file in the storage server is generally acquired from a source database, the file in the source database is a complete file, and when the storage server acquires the complete file, the file is fragmented and stored. Fragmentation is the division of a file into small fragments. For example, a 10 mega (M) file is sliced, 0-2M as slice 1, 2M-4M as slice 2, 4M-6M as slice 3, 6M-8M as slice 4, and 8M-10M as slice 5, that is, the slice 1, slice 2, slice 3, slice 4, and slice 5 are combined to obtain a complete 10M file.
Step S120, receiving an acquisition request of a complete or partial designated file sent by the front-end server.
Step S130, according to the obtaining request, returning all the fragments of the designated file stored locally or the fragments of the designated file corresponding to the obtaining request to the front-end server.
When an acquisition request sent by the front-end server is received, the corresponding fragment of the designated file is returned to the front-end server according to the acquisition request, for example, on the basis of the above example, if the acquisition request is to acquire a complete file, all of the fragment 1, the fragment 2, the fragment 3, the fragment 4 and the fragment 5 are returned; if the acquisition request is to acquire a 4M-6M portion of the specified file, slice 3 of the specified file is returned.
Therefore, according to the embodiment, no matter the front-end server receives the acquisition request of the complete file or the acquisition request of the partial file, the storage server only returns the corresponding complete file or the partial file, transmission resources are not occupied, the transmission resources are reasonably used, the corresponding speed of the request is ensured, and the user experience is improved.
Preferably, the method shown in fig. 1 is applicable to a Content Delivery Network (CDN).
In an embodiment of the present invention, the dividing the complete file obtained from the source database into a plurality of fragments in step S110 of the method shown in fig. 1 includes: when acquiring a complete file from a source database, dividing the acquired complete file into a plurality of fragments; and/or judging whether the fragmentation condition is met, if so, dividing the complete file which is acquired from the source database and is stored locally into a plurality of fragments.
In a specific embodiment of the present invention, the time for fragmenting may be when the complete file is acquired from the source database, or when a fragmentation condition is satisfied, the complete file is fragmented. Or, after the complete file is acquired from the source database and fragmented, if the fragmentation condition is satisfied, the fragmented file is re-fragmented.
Specifically, the above determining whether the slicing condition is satisfied includes: judging whether the occupancy rate of the transmission resources of the front-end server reaches a preset upper limit value or not, and if so, determining that the fragmentation condition is met; and/or judging whether the number of the received acquisition requests of the part of the designated files sent by the front-end server reaches a preset threshold value or not, and if so, determining that the fragmentation condition is met.
In the foregoing description, if the specified file returned by the storage server is a complete file, but if the specified file is a request for a partial specified file, the transmission resource will be wasted. In view of that, if the occupancy rate of the transmission resource is small, the transmission of the complete file does not bring about a serious influence, and if the occupancy rate of the transmission resource is large, the transmission of the designated file for the acquisition request needs to be performed, therefore, in this embodiment, an upper limit value of the occupancy rate of the transmission resource is preset, for example, 80%, and when the upper limit value reaches the preset upper limit value, the complete file is fragmented.
If the acquisition requests are all requests for acquiring the complete file, the complete file must be returned, fragmentation processing is not needed at this time, if only a small number of requests for partial files are in the acquisition requests, too much waste of transmission resources is not caused, and fragmentation processing may not be performed at this time. Only when the number of the acquisition requests of the part of the designated files reaches a certain amount, if fragmentation is not performed, transmission resources are greatly wasted, so in this embodiment, a threshold is preset, and when the number of the acquisition requests of the part of the designated files reaches the preset threshold, fragmentation is performed on the complete file.
In an embodiment of the present invention, the dividing the complete file obtained from the source database into a plurality of fragments in step S110 of the method shown in fig. 1 includes: and dividing the complete file acquired from the source database into a plurality of fragments according to a preset granularity.
Here, when the complete file is fragmented, the fragments are fragmented according to a preset granularity, for example, 2M, and when the complete file is fragmented, each fragment includes 2M. For example, a 10 mega (M) file is sliced, 0-2M as slice 1, 2M-4M as slice 2, 4M-6M as slice 3, 6M-8M as slice 4, and 8M-10M as slice 5.
Specifically, the preset granularity is determined according to one or more of the following factors: the size of the file obtained from the source database; the size of the local storage space.
The preset granularity may be affected by the size of the file and the size of the local storage space. For example, the file is 9M, and if it is desired to ensure that the size of each fragment is consistent, but the preset granularity is 2M, it cannot be ensured that the size of each fragment is consistent, and the preset granularity may be set to 3M. In addition, the storage space generally has a minimum storage unit, which is not possible if the preset granularity is smaller than the minimum storage unit. For example, if the minimum memory location is 2M, the predetermined granularity is greater than or equal to 2M.
Further, the dividing the complete file obtained from the source database into a plurality of fragments according to the preset granularity includes: setting a preset period; re-determining the preset granularity according to a preset period; and dividing the complete file acquired from the source database into a plurality of fragments according to the redetermined preset granularity.
The preset granularity is not fixed, i.e. a period is set, e.g. every week, and the preset granularity is re-determined so as to optimize the fragmentation of the complete file.
Specifically, the above re-determining the preset granularity according to the preset period includes: when a preset period is reached, counting the part with the maximum acquisition times of the specified file according to the acquisition request of the complete or partial specified file in the period, taking the part as a fragment of the specified file, and determining the preset granularity according to the size of the part of the file.
In this embodiment, the designated file may be re-fragmented according to the hot part of the designated file, for example, after the designated file is fragmented, 0-2M is obtained as fragment 1, 2M-4M is obtained as fragment 2, 4M-6M is obtained as fragment 3, 6M-8M is obtained as fragment 4, and 8M-10M is obtained as fragment 5, but it is determined after statistics that the number of times of obtaining the 1M-4M part of the file is the largest, then the designated file may be re-fragmented, the 1M-4M part is taken as one fragment, it is determined that the preset granularity is 3M, and the final fragmentation result is: 0M-1M as slice 1, 1M-4M as slice 2, 4M-7M as slice 3, and 7M-10M as slice 4.
In an embodiment of the present invention, after receiving the request for obtaining the complete or partial specified file sent by the front-end server in step S120, the method shown in fig. 1 further includes: judging whether a specified file is stored locally, and if not, sending an acquisition request of the specified file to a source database; receiving a specified file returned by a source database; and dividing the received designated file into a plurality of fragments and storing each fragment.
If the received request for acquiring the specified file is a first request for acquiring the specified file, and the specified file may not be stored in the storage server, the request for acquiring the specified file needs to be returned to the source, that is, the request for acquiring the specified file is sent to the source database, after the source database returns the specified file, the received specified file is divided into a plurality of fragments, each fragment is stored, and the corresponding fragment is returned to the front-end server according to the request for acquiring.
It should be noted that, here, the fragmentation of the received specified file is also applicable to the fragmentation processing in the foregoing embodiments.
In an embodiment of the present invention, the receiving, in step S120 of the method shown in fig. 1, the request for obtaining the complete specified file sent by the front-end server includes: receiving an acquisition request which is sent by a front-end server and used for respectively acquiring each fragment of a designated file; the acquisition requests for respectively acquiring the fragments of the designated file are generated by the front-end server according to the acquisition requests of the complete designated file sent by the client.
Consider if the storage server shards a specified file. Each fragment is stored as an independent file, and if the front-end server directly sends an acquisition request to the storage server after receiving the acquisition request of the complete specified file, the storage server cannot acquire the complete file. At this time, the front-end server needs to generate an acquisition request for each segment of the designated file according to the segment condition, and the segment acquires each segment of the storage server. For example, after the designated file is sliced, slice 1, slice 2, slice 3, slice 4, and slice 5 are obtained. The front-end server generates an acquisition request for segment 1, an acquisition request for segment 2, an acquisition request for segment 3, an acquisition request for segment 4, and an acquisition request for segment 5 according to the acquisition request of the completely specified file, and sends the 5 requests to the storage server, and the storage server respectively returns the files of segments 1 to 5 according to the requests.
Fig. 2 is a schematic structural diagram of a file processing apparatus according to an embodiment of the present invention, and illustrates the present embodiment from the storage server side. As shown in fig. 2, the document processing apparatus 200 includes:
the fragmentation unit 210 is adapted to divide the complete file obtained from the source database into a plurality of fragments, and store each fragment.
The file in the storage server is generally acquired from a source database, the file in the source database is a complete file, and when the storage server acquires the complete file, the file is fragmented and stored. Fragmentation is the division of a file into small fragments. For example, a 10 mega (M) file is sliced, 0-2M as slice 1, 2M-4M as slice 2, 4M-6M as slice 3, 6M-8M as slice 4, and 8M-10M as slice 5, that is, the slice 1, slice 2, slice 3, slice 4, and slice 5 are combined to obtain a complete 10M file.
The receiving unit 220 is adapted to receive an acquisition request of a complete or partial specified file sent by the front-end server.
The sending unit 230 is adapted to return all the fragments of the designated file stored locally or the fragments of the designated file corresponding to the acquisition request to the front-end server according to the acquisition request.
When an acquisition request sent by the front-end server is received, the corresponding fragment of the designated file is returned to the front-end server according to the acquisition request, for example, on the basis of the above example, if the acquisition request is to acquire a complete file, all of the fragment 1, the fragment 2, the fragment 3, the fragment 4 and the fragment 5 are returned; if the acquisition request is to acquire a 4M-6M portion of the specified file, slice 3 of the specified file is returned.
Therefore, according to the embodiment, no matter the front-end server receives the acquisition request of the complete file or the acquisition request of the partial file, the storage server only returns the corresponding complete file or the partial file, transmission resources are not occupied, the transmission resources are reasonably used, the corresponding speed of the request is ensured, and the user experience is improved.
In an embodiment of the present invention, the fragmentation unit 210 shown in fig. 2 is adapted to, when acquiring a complete file from a source database, divide the acquired complete file into a plurality of fragments; and/or judging whether the fragmentation condition is met, if so, dividing the complete file which is acquired from the source database and is stored locally into a plurality of fragments.
In a specific embodiment of the present invention, the time for fragmenting may be when the complete file is acquired from the source database, or when a fragmentation condition is satisfied, the complete file is fragmented. Or, after the complete file is acquired from the source database and fragmented, if the fragmentation condition is satisfied, the fragmented file is re-fragmented.
Specifically, the fragmentation unit 210 is adapted to determine whether an occupancy rate of a transmission resource with a front-end server reaches a preset upper limit value, and if yes, it is determined that a fragmentation condition is satisfied; and/or judging whether the number of the received acquisition requests of the part of the designated files sent by the front-end server reaches a preset threshold value or not, and if so, determining that the fragmentation condition is met.
In the foregoing description, if the specified file returned by the storage server is a complete file, but if the specified file is a request for a partial specified file, the transmission resource will be wasted. In view of that, if the occupancy rate of the transmission resource is small, the transmission of the complete file does not bring about a serious influence, and if the occupancy rate of the transmission resource is large, the transmission of the designated file for the acquisition request needs to be performed, therefore, in this embodiment, an upper limit value of the occupancy rate of the transmission resource is preset, for example, 80%, and when the upper limit value reaches the preset upper limit value, the complete file is fragmented.
If the acquisition requests are all requests for acquiring the complete file, the complete file must be returned, fragmentation processing is not needed at this time, if only a small number of requests for partial files are in the acquisition requests, too much waste of transmission resources is not caused, and fragmentation processing may not be performed at this time. Only when the number of the acquisition requests of the part of the designated files reaches a certain amount, if fragmentation is not performed, transmission resources are greatly wasted, so in this embodiment, a threshold is preset, and when the number of the acquisition requests of the part of the designated files reaches the preset threshold, fragmentation is performed on the complete file.
In an embodiment of the present invention, the fragmentation unit 210 shown in fig. 2 is adapted to divide the complete file obtained from the source database into a plurality of fragments according to a preset granularity.
Here, when the complete file is fragmented, the fragments are fragmented according to a preset granularity, for example, 2M, and when the complete file is fragmented, each fragment includes 2M. For example, a 10 mega (M) file is sliced, 0-2M as slice 1, 2M-4M as slice 2, 4M-6M as slice 3, 6M-8M as slice 4, and 8M-10M as slice 5.
Specifically, the preset granularity is determined according to one or more of the following factors: the size of the file obtained from the source database; the size of the local storage space.
The preset granularity may be affected by the size of the file and the size of the local storage space. For example, the file is 9M, and if it is desired to ensure that the size of each fragment is consistent, but the preset granularity is 2M, it cannot be ensured that the size of each fragment is consistent, and the preset granularity may be set to 3M. In addition, the storage space generally has a minimum storage unit, which is not possible if the preset granularity is smaller than the minimum storage unit. For example, if the minimum memory location is 2M, the predetermined granularity is greater than or equal to 2M.
Further, the slicing unit 210 is adapted to set a preset period; re-determining the preset granularity according to a preset period; and dividing the complete file acquired from the source database into a plurality of fragments according to the redetermined preset granularity.
The preset granularity is not fixed, i.e. a period is set, e.g. every week, and the preset granularity is re-determined so as to optimize the fragmentation of the complete file.
Specifically, the above-mentioned fragmentation unit 210 is adapted to, when a preset period is reached, count a portion with the largest number of times of acquiring the specified file according to an acquisition request of a complete or partial specified file in the period, use the portion as a fragment of the specified file, and determine a preset granularity according to a size of the portion of the file.
In this embodiment, the designated file may be re-fragmented according to the hot part of the designated file, for example, after the designated file is fragmented, 0-2M is obtained as fragment 1, 2M-4M is obtained as fragment 2, 4M-6M is obtained as fragment 3, 6M-8M is obtained as fragment 4, and 8M-10M is obtained as fragment 5, but it is determined after statistics that the number of times of obtaining the 1M-4M part of the file is the largest, then the designated file may be re-fragmented, the 1M-4M part is taken as one fragment, it is determined that the preset granularity is 3M, and the final fragmentation result is: 0M-1M as slice 1, 1M-4M as slice 2, 4M-7M as slice 3, and 7M-10M as slice 4.
In an embodiment of the present invention, after the receiving unit 220 shown in fig. 2 receives the request for obtaining the complete or partial specified file sent by the front-end server, the apparatus shown in fig. 2 further includes:
the judging unit is suitable for judging whether the specified file is stored locally or not, and if not, sending an acquisition request of the specified file to the source database; receiving a specified file returned by a source database; and dividing the received designated file into a plurality of fragments and storing each fragment.
If the received request for acquiring the specified file is a first request for acquiring the specified file, and the specified file may not be stored in the storage server, the request for acquiring the specified file needs to be returned to the source, that is, the request for acquiring the specified file is sent to the source database, after the source database returns the specified file, the received specified file is divided into a plurality of fragments, each fragment is stored, and the corresponding fragment is returned to the front-end server according to the request for acquiring.
It should be noted that, here, the fragmentation of the received specified file is also applicable to the fragmentation processing in the foregoing embodiments.
In an embodiment of the present invention, the receiving unit 220 shown in fig. 2 is adapted to receive an obtaining request sent by a front-end server to respectively obtain segments of a specified file; the acquisition requests for respectively acquiring the fragments of the designated file are generated by the front-end server according to the acquisition requests of the complete designated file sent by the client.
Consider if the storage server shards a specified file. Each fragment is stored as an independent file, and if the front-end server directly sends an acquisition request to the storage server after receiving the acquisition request of the complete specified file, the storage server cannot acquire the complete file. At this time, the front-end server needs to generate an acquisition request for each segment of the designated file according to the segment condition, and the segment acquires each segment of the storage server. For example, after the designated file is sliced, slice 1, slice 2, slice 3, slice 4, and slice 5 are obtained. The front-end server generates an acquisition request for segment 1, an acquisition request for segment 2, an acquisition request for segment 3, an acquisition request for segment 4, and an acquisition request for segment 5 according to the acquisition request of the completely specified file, and sends the 5 requests to the storage server, and the storage server respectively returns the files of segments 1 to 5 according to the requests.
In summary, according to the technical solution of the present invention, the complete file obtained from the source database is divided into a plurality of segments, and each segment is stored; receiving an acquisition request of a complete or partial appointed file sent by a front-end server; and returning all fragments of the designated file stored locally or fragments of the designated file corresponding to the acquisition request to the front-end server according to the acquisition request. By the technical scheme, no matter the front-end server receives the acquisition request of the complete file or the acquisition request of the partial file, the storage server only returns the corresponding complete file or the partial file, transmission resources are not occupied, the transmission resources are reasonably used, the corresponding speed of the request is ensured, and the user experience is improved.
It should be noted that:
the algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose devices may be used with the teachings herein. The required structure for constructing such a device will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It will be appreciated by those skilled in the art that microprocessors or Digital Signal Processors (DSPs) may be used in practice to implement some or all of the functionality of some or all of the file processing apparatus, electronic devices and computer readable storage media according to embodiments of the invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
For example, fig. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the invention. The electronic device 300 conventionally comprises a processor 310 and a memory 320 arranged to store computer-executable instructions (program code). The memory 320 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Memory 320 has storage space 330 for storing program code 340 for performing the method steps shown in fig. 1 and in any of the embodiments. For example, the storage space 330 for the program code may comprise respective program codes 340 for implementing respective steps in the above method. The program code can be read from or written to one or more computer program products. These computer program products comprise a program code carrier such as a hard disk, a Compact Disc (CD), a memory card or a floppy disk. Such a computer program product is generally a computer-readable storage medium 400 such as described in fig. 4. The computer-readable storage medium 400 may have memory segments, memory spaces, etc. arranged similarly to the memory 320 in the electronic device of fig. 3. The program code may be compressed, for example, in a suitable form. In general, the memory unit stores a program code 410 for performing the steps of the method according to the invention, i.e. a program code readable by a processor such as 310, which program code, when executed by an electronic device, causes the electronic device to perform the individual steps of the method described above.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, third, etc. does not indicate any ordering. These words may be interpreted as names.
The embodiment of the invention discloses A1 and a file processing method, wherein the method comprises the following steps:
dividing a complete file acquired from a source database into a plurality of fragments, and storing each fragment;
receiving an acquisition request of a complete or partial appointed file sent by a front-end server;
and returning all fragments of the designated file stored locally or the fragments of the designated file corresponding to the acquisition request to the front-end server according to the acquisition request.
A2, the method as in A1, wherein the dividing the complete file obtained from the source database into pieces comprises:
when acquiring a complete file from a source database, dividing the acquired complete file into a plurality of fragments;
and/or the presence of a gas in the gas,
and judging whether the fragmentation condition is met, if so, dividing the complete file which is acquired from the source database and is stored locally into a plurality of fragments.
A3, the method of A2, wherein the judging whether the slicing condition is met includes:
judging whether the occupancy rate of the transmission resources of the front-end server reaches a preset upper limit value or not, and if so, determining that the fragmentation condition is met;
and/or the presence of a gas in the gas,
judging whether the number of the received acquisition requests of the part of the designated files sent by the front-end server reaches a preset threshold value or not, and if so, determining that the fragmentation condition is met.
A4, the method as in A1, wherein the dividing the complete file obtained from the source database into pieces comprises:
and dividing the complete file acquired from the source database into a plurality of fragments according to a preset granularity.
A5, the method as in A4, wherein the preset granularity is determined according to one or more of the following factors:
the size of the file obtained from the source database;
the size of the local storage space.
A6, the method as in a4, wherein the dividing the complete file obtained from the source database into a plurality of pieces according to the preset granularity includes:
setting a preset period;
re-determining the preset granularity according to a preset period;
and dividing the complete file acquired from the source database into a plurality of fragments according to the redetermined preset granularity.
A7, the method as in a6, wherein the re-determining the preset granularity according to the preset period comprises:
when a preset period is reached, counting the part with the maximum acquisition times of the specified file according to the acquisition request of the complete or partial specified file in the period, taking the part as a fragment of the specified file, and determining the preset granularity according to the size of the part of the file.
A8, the method as in a1, wherein after receiving the request for obtaining the complete or partial designated file sent by the front-end server, the method further comprises:
judging whether a specified file is stored locally, and if not, sending an acquisition request of the specified file to a source database;
receiving a specified file returned by a source database;
and dividing the received designated file into a plurality of fragments and storing each fragment.
A9, the method as in A1, wherein the receiving the request for obtaining the complete specified file sent by the front-end server comprises:
receiving an acquisition request which is sent by a front-end server and used for respectively acquiring each fragment of a designated file; the obtaining requests for respectively obtaining the fragments of the designated file are generated by the front-end server according to the obtaining requests of the complete designated file sent by the client.
The embodiment of the invention also discloses B10 and a file processing device, wherein the device comprises:
the fragmentation unit is suitable for dividing the complete file acquired from the source database into a plurality of fragments and storing each fragment;
the receiving unit is suitable for receiving an acquisition request of a complete or partial appointed file sent by a front-end server;
and the sending unit is suitable for returning all fragments of the specified file stored locally or the fragments of the specified file corresponding to the acquisition request to the front-end server according to the acquisition request.
B11, the device of B10, wherein,
the fragmentation unit is suitable for dividing the acquired complete file into a plurality of fragments when the complete file is acquired from the source database; and/or judging whether the fragmentation condition is met, if so, dividing the complete file which is acquired from the source database and is stored locally into a plurality of fragments.
B12, the device of B11, wherein,
the fragmentation unit is suitable for judging whether the occupancy rate of the transmission resource with the front-end server reaches a preset upper limit value or not, and if so, determining that the fragmentation condition is met; and/or judging whether the number of the received acquisition requests of the part of the designated files sent by the front-end server reaches a preset threshold value or not, and if so, determining that the fragmentation condition is met.
B13, the device of B10, wherein,
the fragmentation unit is suitable for dividing the complete file acquired from the source database into a plurality of fragments according to a preset granularity.
B14, the apparatus of B13, wherein the preset granularity is determined according to one or more of the following factors:
the size of the file obtained from the source database;
the size of the local storage space.
B15, the device of B13, wherein,
the slicing unit is suitable for setting a preset period; re-determining the preset granularity according to a preset period; and dividing the complete file acquired from the source database into a plurality of fragments according to the redetermined preset granularity.
B16, the device of B15, wherein,
the fragmentation unit is suitable for counting the part with the maximum acquisition frequency of the specified file according to the acquisition request of the complete or partial specified file in the preset period when the preset period is reached, taking the part as a fragmentation of the specified file, and determining the preset granularity according to the size of the part of the file.
B17, the apparatus according to B10, wherein after the receiving unit receives the request for acquiring the complete or partial designated file sent by the front-end server, the apparatus further comprises:
the judging unit is suitable for judging whether the specified file is stored locally or not, and if not, sending an acquisition request of the specified file to the source database; receiving a specified file returned by a source database; and dividing the received designated file into a plurality of fragments and storing each fragment.
B18, the device of B10, wherein,
the receiving unit is suitable for receiving the acquisition requests which are sent by the front-end server and used for respectively acquiring the fragments of the designated file; the obtaining requests for respectively obtaining the fragments of the designated file are generated by the front-end server according to the obtaining requests of the complete designated file sent by the client.
The embodiment of the invention also discloses C19 and electronic equipment, wherein the electronic equipment comprises:
a processor; and the number of the first and second groups,
a memory arranged to store computer executable instructions that, when executed, cause the processor to perform a method according to any one of a 1-a 9.
Embodiments of the invention also disclose D20, a computer readable storage medium, wherein the computer readable storage medium stores one or more programs that, when executed by a processor, implement the method of any of a 1-a 9.
Claims (10)
1. A method of file processing, wherein the method comprises:
dividing a complete file acquired from a source database into a plurality of fragments, and storing each fragment;
receiving an acquisition request of a complete or partial appointed file sent by a front-end server;
and returning all fragments of the designated file stored locally or the fragments of the designated file corresponding to the acquisition request to the front-end server according to the acquisition request.
2. The method of claim 1, wherein the dividing the complete file obtained from the source database into the plurality of segments comprises:
when acquiring a complete file from a source database, dividing the acquired complete file into a plurality of fragments;
and/or the presence of a gas in the gas,
and judging whether the fragmentation condition is met, if so, dividing the complete file which is acquired from the source database and is stored locally into a plurality of fragments.
3. The method of claim 2, wherein the determining whether a fragmentation condition is satisfied comprises:
judging whether the occupancy rate of the transmission resources of the front-end server reaches a preset upper limit value or not, and if so, determining that the fragmentation condition is met;
and/or the presence of a gas in the gas,
judging whether the number of the received acquisition requests of the part of the designated files sent by the front-end server reaches a preset threshold value or not, and if so, determining that the fragmentation condition is met.
4. The method of claim 1, wherein the dividing the complete file obtained from the source database into the plurality of segments comprises:
and dividing the complete file acquired from the source database into a plurality of fragments according to a preset granularity.
5. A document processing apparatus, wherein the apparatus comprises:
the fragmentation unit is suitable for dividing the complete file acquired from the source database into a plurality of fragments and storing each fragment;
the receiving unit is suitable for receiving an acquisition request of a complete or partial appointed file sent by a front-end server;
and the sending unit is suitable for returning all fragments of the specified file stored locally or the fragments of the specified file corresponding to the acquisition request to the front-end server according to the acquisition request.
6. The apparatus of claim 5, wherein,
the fragmentation unit is suitable for dividing the acquired complete file into a plurality of fragments when the complete file is acquired from the source database; and/or judging whether the fragmentation condition is met, if so, dividing the complete file which is acquired from the source database and is stored locally into a plurality of fragments.
7. The apparatus of claim 6, wherein,
the fragmentation unit is suitable for judging whether the occupancy rate of the transmission resource with the front-end server reaches a preset upper limit value or not, and if so, determining that the fragmentation condition is met; and/or judging whether the number of the received acquisition requests of the part of the designated files sent by the front-end server reaches a preset threshold value or not, and if so, determining that the fragmentation condition is met.
8. The apparatus of claim 5, wherein,
the fragmentation unit is suitable for dividing the complete file acquired from the source database into a plurality of fragments according to a preset granularity.
9. An electronic device, wherein the electronic device comprises:
a processor; and the number of the first and second groups,
a memory arranged to store computer executable instructions that, when executed, cause the processor to perform the method of any one of claims 1 to 4.
10. A computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement the method of any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811558054.4A CN111343225B (en) | 2018-12-19 | 2018-12-19 | File processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811558054.4A CN111343225B (en) | 2018-12-19 | 2018-12-19 | File processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111343225A true CN111343225A (en) | 2020-06-26 |
| CN111343225B CN111343225B (en) | 2024-04-09 |
Family
ID=71186808
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811558054.4A Active CN111343225B (en) | 2018-12-19 | 2018-12-19 | File processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111343225B (en) |
Citations (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0214313A2 (en) * | 1984-08-22 | 1987-03-18 | Hitachi, Ltd. | Method and apparatus for data merging/sorting |
| CN1710857A (en) * | 2004-06-18 | 2005-12-21 | 千橡寰宇科技发展（北京）有限公司 | Method and method for realizing document accelerated download |
| CN1925403A (en) * | 2005-09-02 | 2007-03-07 | 腾讯科技（深圳）有限公司 | Network communication system and method realizing file downloading |
| CN101030873A (en) * | 2007-02-15 | 2007-09-05 | 深圳市迅雷网络技术有限公司 | Method and system for downloading data |
| CN101141627A (en) * | 2007-10-23 | 2008-03-12 | 深圳市迅雷网络技术有限公司 | Storage system and method of stream media file |
| CN101198016A (en) * | 2007-12-05 | 2008-06-11 | 中兴通讯股份有限公司 | Contents issuance and storage method for interactive individual television media paying system |
| CN101316232A (en) * | 2008-07-09 | 2008-12-03 | 南京邮电大学 | Fragmentation and reassembly method based on network protocol version six |
| CN101420603A (en) * | 2008-09-05 | 2009-04-29 | 中兴通讯股份有限公司 | Method for implementing media distribution, positioning by segmented memory and stream media system thereof |
| CN101420457A (en) * | 2008-12-03 | 2009-04-29 | 腾讯科技（深圳）有限公司 | Method, apparatus for downloading data fragmentation by peer, and peer therefor |
| CN101478556A (en) * | 2007-12-31 | 2009-07-08 | 突触计算机系统（上海）有限公司 | Method and apparatus for downloading peer-to-peer transmitted data slice |
| CN101520793A (en) * | 2008-12-30 | 2009-09-02 | 深圳市同洲电子股份有限公司 | Method and system for storing and reading stream media file and stream media server |
| CN101534322A (en) * | 2009-04-13 | 2009-09-16 | 腾讯科技（深圳）有限公司 | File upload system and file upload method |
| CN101534204A (en) * | 2008-03-10 | 2009-09-16 | 中国网通集团宽带业务应用国家工程实验室有限公司 | Streaming media information distribution system and method thereof and user end |
| CN101741730A (en) * | 2009-12-02 | 2010-06-16 | 成都市华为赛门铁克科技有限公司 | Method and equipment for downloading file and method and system for providing file downloading service |
| CN102238434A (en) * | 2011-07-22 | 2011-11-09 | 中兴通讯股份有限公司 | Method and system for segmenting internet protocol television (IPTV) stream media file virtually |
| CN103608785A (en) * | 2013-06-21 | 2014-02-26 | 华为技术有限公司 | Method for reading file, storage device and reading system |
| CN103986976A (en) * | 2014-06-05 | 2014-08-13 | 北京赛维安讯科技发展有限公司 | Content delivery network (CDN)-based transmission system and method |
| CN104349176A (en) * | 2013-07-30 | 2015-02-11 | 中国电信股份有限公司 | Self-adaptive stream media system, downloading method and stream media server, user terminal |
| CN104935648A (en) * | 2015-06-03 | 2015-09-23 | 北京快网科技有限公司 | High-cost-performance CDN system, and file pre-push and fragment buffer memory methods |
| CN105025391A (en) * | 2014-04-30 | 2015-11-04 | 腾讯科技（深圳）有限公司 | Video playing method and apparatus |
| CN106412137A (en) * | 2016-12-20 | 2017-02-15 | 北京并行科技股份有限公司 | File downloading system and file downloading method |
| CN106527981A (en) * | 2016-10-31 | 2017-03-22 | 华中科技大学 | Configuration-based data fragmentation method for adaptive distributed storage system |
| CN106559677A (en) * | 2015-09-30 | 2017-04-05 | 华为技术有限公司 | The method and device of terminal, caching server and acquisition video slicing |
| CN107562757A (en) * | 2016-07-01 | 2018-01-09 | 阿里巴巴集团控股有限公司 | Inquiry, access method based on distributed file system, apparatus and system |
| CN107690093A (en) * | 2016-08-03 | 2018-02-13 | 杭州海康威视数字技术股份有限公司 | A kind of video broadcasting method and device |
| CN108111555A (en) * | 2016-11-25 | 2018-06-01 | 阿里巴巴集团控股有限公司 | For controlling the method and system of installation kit downloading process |
| CN108664803A (en) * | 2018-04-04 | 2018-10-16 | 中国电子科技集团公司第三十研究所 | A kind of document content fine granularity access control system based on password |
| CN108712454A (en) * | 2018-02-13 | 2018-10-26 | 阿里巴巴集团控股有限公司 | A kind of document handling method, device and equipment |
-
2018
- 2018-12-19 CN CN201811558054.4A patent/CN111343225B/en active Active
Patent Citations (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0214313A2 (en) * | 1984-08-22 | 1987-03-18 | Hitachi, Ltd. | Method and apparatus for data merging/sorting |
| CN1710857A (en) * | 2004-06-18 | 2005-12-21 | 千橡寰宇科技发展（北京）有限公司 | Method and method for realizing document accelerated download |
| CN1925403A (en) * | 2005-09-02 | 2007-03-07 | 腾讯科技（深圳）有限公司 | Network communication system and method realizing file downloading |
| CN101030873A (en) * | 2007-02-15 | 2007-09-05 | 深圳市迅雷网络技术有限公司 | Method and system for downloading data |
| CN101141627A (en) * | 2007-10-23 | 2008-03-12 | 深圳市迅雷网络技术有限公司 | Storage system and method of stream media file |
| CN101198016A (en) * | 2007-12-05 | 2008-06-11 | 中兴通讯股份有限公司 | Contents issuance and storage method for interactive individual television media paying system |
| CN101478556A (en) * | 2007-12-31 | 2009-07-08 | 突触计算机系统（上海）有限公司 | Method and apparatus for downloading peer-to-peer transmitted data slice |
| CN101534204A (en) * | 2008-03-10 | 2009-09-16 | 中国网通集团宽带业务应用国家工程实验室有限公司 | Streaming media information distribution system and method thereof and user end |
| CN101316232A (en) * | 2008-07-09 | 2008-12-03 | 南京邮电大学 | Fragmentation and reassembly method based on network protocol version six |
| CN101420603A (en) * | 2008-09-05 | 2009-04-29 | 中兴通讯股份有限公司 | Method for implementing media distribution, positioning by segmented memory and stream media system thereof |
| CN101420457A (en) * | 2008-12-03 | 2009-04-29 | 腾讯科技（深圳）有限公司 | Method, apparatus for downloading data fragmentation by peer, and peer therefor |
| CN101520793A (en) * | 2008-12-30 | 2009-09-02 | 深圳市同洲电子股份有限公司 | Method and system for storing and reading stream media file and stream media server |
| CN101534322A (en) * | 2009-04-13 | 2009-09-16 | 腾讯科技（深圳）有限公司 | File upload system and file upload method |
| CN101741730A (en) * | 2009-12-02 | 2010-06-16 | 成都市华为赛门铁克科技有限公司 | Method and equipment for downloading file and method and system for providing file downloading service |
| CN102238434A (en) * | 2011-07-22 | 2011-11-09 | 中兴通讯股份有限公司 | Method and system for segmenting internet protocol television (IPTV) stream media file virtually |
| CN103608785A (en) * | 2013-06-21 | 2014-02-26 | 华为技术有限公司 | Method for reading file, storage device and reading system |
| CN104349176A (en) * | 2013-07-30 | 2015-02-11 | 中国电信股份有限公司 | Self-adaptive stream media system, downloading method and stream media server, user terminal |
| CN105025391A (en) * | 2014-04-30 | 2015-11-04 | 腾讯科技（深圳）有限公司 | Video playing method and apparatus |
| CN103986976A (en) * | 2014-06-05 | 2014-08-13 | 北京赛维安讯科技发展有限公司 | Content delivery network (CDN)-based transmission system and method |
| CN104935648A (en) * | 2015-06-03 | 2015-09-23 | 北京快网科技有限公司 | High-cost-performance CDN system, and file pre-push and fragment buffer memory methods |
| CN106559677A (en) * | 2015-09-30 | 2017-04-05 | 华为技术有限公司 | The method and device of terminal, caching server and acquisition video slicing |
| CN107562757A (en) * | 2016-07-01 | 2018-01-09 | 阿里巴巴集团控股有限公司 | Inquiry, access method based on distributed file system, apparatus and system |
| CN107690093A (en) * | 2016-08-03 | 2018-02-13 | 杭州海康威视数字技术股份有限公司 | A kind of video broadcasting method and device |
| CN106527981A (en) * | 2016-10-31 | 2017-03-22 | 华中科技大学 | Configuration-based data fragmentation method for adaptive distributed storage system |
| CN108111555A (en) * | 2016-11-25 | 2018-06-01 | 阿里巴巴集团控股有限公司 | For controlling the method and system of installation kit downloading process |
| CN106412137A (en) * | 2016-12-20 | 2017-02-15 | 北京并行科技股份有限公司 | File downloading system and file downloading method |
| CN108712454A (en) * | 2018-02-13 | 2018-10-26 | 阿里巴巴集团控股有限公司 | A kind of document handling method, device and equipment |
| CN108664803A (en) * | 2018-04-04 | 2018-10-16 | 中国电子科技集团公司第三十研究所 | A kind of document content fine granularity access control system based on password |
Non-Patent Citations (4)
| Title |
|---|
| LEYKUN BIRHANU: "Native XML Document Fragmentation Model", 《2010 SIXTH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY AND INTERNET BASED SYSTEMS》 * |
| 姚云潇: "基于REST服务的文件分片保存方法及其实现", 《武汉工程大学学报》 * |
| 张洪;路松峰;赵友桥;胥永康;胡和平;: "数据安全存储的分片策略模型研究", 计算机工程与应用, no. 18 * |
| 李昕;屈喜龙;: "基于Open edX的慕课教学资源存储优化", 黄山学院学报, no. 03 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111343225B (en) | 2024-04-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108345642B (en) | Method, storage medium and server for crawling website data by proxy IP | |
| CN110046137B (en) | System and method for grouping and storing data streams into cloud storage files | |
| WO2019056721A1 (en) | Information pushing method, electronic device and computer storage medium | |
| CN110781372B (en) | Method and device for optimizing website, computer equipment and storage medium | |
| CN106570025B (en) | Data filtering method and device | |
| KR20180125009A (en) | Data caching method and apparatus | |
| CN108009147B (en) | Electronic book cover generation method, electronic device and computer storage medium | |
| CN109359060B (en) | Data extraction method, device, computing equipment and computer storage medium | |
| CN109977135A (en) | A kind of data query method, apparatus and server | |
| CN105630650A (en) | Log processing method, device and system | |
| CN113411404A (en) | File downloading method, device, server and storage medium | |
| CN110708360A (en) | Information processing method and system and electronic equipment | |
| CN106570060B (en) | Random extraction method and device for data in information flow | |
| CN107256233B (en) | Data storage method and device | |
| CN108897858B (en) | Distributed cluster index fragmentation evaluation method and device and electronic equipment | |
| CN107329832B (en) | Data receiving method and device | |
| CN111343225B (en) | File processing method and device | |
| CN112148972A (en) | Method and device for screening information to be recommended | |
| CN112528125A (en) | Method and device for avoiding content repeated recommendation, electronic equipment and storage medium | |
| CN106817592B (en) | Method and device for recommending and scheduling home page | |
| CN113609226A (en) | Data export method and device, computer equipment and storage medium | |
| CN109344119B (en) | File merging processing method and device, computing equipment and computer storage medium | |
| CN111367868A (en) | Method and device for processing file acquisition request | |
| CN109889608B (en) | Dynamic resource loading method and device, electronic equipment and storage medium | |
| CN109388500B (en) | Processing method and system based on wireless Measurement Report (MR) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240314 Address after: 300450 No. 9-3-401, No. 39, Gaoxin 6th Road, Binhai Science Park, Binhai New Area, Tianjin Applicant after: 3600 Technology Group Co.,Ltd. Country or region after: China Address before: 100088 room 112, block D, 28 new street, new street, Xicheng District, Beijing (Desheng Park) Applicant before: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Country or region before: China |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |