CN116781685B - Method for uploading large files of browser - Google Patents
Method for uploading large files of browser Download PDFInfo
- Publication number
- CN116781685B CN116781685B CN202310754670.1A CN202310754670A CN116781685B CN 116781685 B CN116781685 B CN 116781685B CN 202310754670 A CN202310754670 A CN 202310754670A CN 116781685 B CN116781685 B CN 116781685B
- Authority
- CN
- China
- Prior art keywords
- file
- uploaded
- uploading
- fragments
- file fragments
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 239000012634 fragment Substances 0.000 claims abstract description 371
- 238000004364 calculation method Methods 0.000 claims abstract description 46
- 230000005540 biological transmission Effects 0.000 claims abstract description 34
- 238000012545 processing Methods 0.000 claims abstract description 31
- 238000007689 inspection Methods 0.000 claims abstract description 17
- 238000013467 fragmentation Methods 0.000 claims abstract description 4
- 238000006062 fragmentation reaction Methods 0.000 claims abstract description 4
- 238000012544 monitoring process Methods 0.000 claims description 66
- 238000004458 analytical method Methods 0.000 claims description 52
- 238000012795 verification Methods 0.000 claims description 40
- 238000007781 pre-processing Methods 0.000 claims description 13
- 238000004140 cleaning Methods 0.000 claims description 9
- JEIPFZHSYJVQDO-UHFFFAOYSA-N iron(III) oxide Inorganic materials O=[Fe]O[Fe]=O JEIPFZHSYJVQDO-UHFFFAOYSA-N 0.000 claims description 6
- 230000003139 buffering effect Effects 0.000 claims description 2
- 238000007599 discharging Methods 0.000 claims 1
- 230000000153 supplemental effect Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/12—Applying verification of the received information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
- H04L67/1078—Resource delivery mechanisms
- H04L67/108—Resource delivery mechanisms characterised by resources being split in blocks or fragments
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to the technical field of digital information transmission, and provides a method for uploading a large file of a browser, which comprises the following steps: determining a file to be uploaded; MD5 calculation is carried out on the file to be uploaded, and the overall MD5 value of the file is obtained; uploading the file to be uploaded to a server of a browser, and checking according to the overall MD5 value of the file to obtain an overall checking result; performing fragmentation processing on the file to be uploaded according to the overall inspection result to obtain fragments of the file to be uploaded; MD5 calculation is carried out on the file fragments to be uploaded to obtain a file fragment MD5 value; uploading the file fragments to be uploaded to a server of a browser; and receiving the uploaded file fragments to be uploaded in a server of the browser to obtain uploaded file fragments, and combining the uploaded file fragments with the MD5 value of the file fragments to obtain the uploaded file to be uploaded. The invention can realize the efficient uploading of files with different sizes.
Description
Technical Field
The invention relates to the technical field of digital information transmission, in particular to a method for uploading a large file of a browser.
Background
Web browsers are applications that people use daily to retrieve, display and transfer Web information resources, and with the rapid development of the internet, web browsers have become the most used application, not only an internet access portal, but also an access hub for user services, assets, and information.
The invention provides a large file uploading method of a browser, which is used as a transmission client to transmit file data to a transmission server, at present, when uploading files to a server of the browser, the file can be successfully uploaded aiming at smaller files, and the problem that the transmission efficiency is low or the uploading process cannot be carried out on larger files is usually solved, so that the user experience is affected.
Disclosure of Invention
The invention aims to provide a method for uploading a large file of a browser, which aims to solve the problems in the background technology.
In order to achieve the above purpose, the present invention provides the following technical solutions: a method for uploading a large file of a browser comprises the following steps:
Determining a file to be uploaded;
MD5 calculation is carried out on the file to be uploaded, and the overall MD5 value of the file is obtained;
uploading the file to be uploaded to a server of a browser, and checking according to the overall MD5 value of the file to obtain an overall checking result;
performing fragmentation processing on the file to be uploaded according to the overall inspection result to obtain fragments of the file to be uploaded;
MD5 calculation is carried out on the file fragments to be uploaded to obtain a file fragment MD5 value;
uploading the file fragments to be uploaded to a server of a browser;
and receiving the uploaded file fragments to be uploaded in a server of the browser to obtain uploaded file fragments, and combining the uploaded file fragments with the MD5 value of the file fragments to obtain the uploaded file to be uploaded.
Further, when MD5 calculation is performed on the file to be uploaded and MD5 calculation is performed on the file to be uploaded in a slicing mode, the fast MD5 algorithm based on wasm implementation is adopted for calculation, and after the MD5 algorithm is compiled into a language in a wasm environment by using a rust language, MD5 calculation is performed on the file to be uploaded or the file to be uploaded in a slicing mode.
Further, the calculation is performed by adopting a fast MD5 algorithm based on wasm realization, which comprises the following steps:
The file to be uploaded or the file fragments to be uploaded are respectively processed with the lengths, and are filled to the multiple of 64 to obtain filling processing data
Initializing the intermediate results of the register storage calculation, namely initializing 4 32-bit register storage calculation intermediate results;
grouping the filling processing data by taking 512 bits as a unit to obtain grouping data, and carrying out iteration and data updating of a register on the grouping data to obtain updated register data;
and splicing the updated register data in sequence to form a 128-bit message digest, and obtaining the MD5 value of the file to be uploaded or the file fragment to be uploaded.
Further, when the file to be uploaded is subjected to slicing processing according to the overall inspection result, if the overall inspection result is that the file to be uploaded exists in the browser server, the file to be uploaded is successfully uploaded, and if the overall inspection result is that the file to be uploaded does not exist in the browser server, the file to be uploaded is failed to upload, at the moment, the file to be uploaded is subjected to slicing processing, the target slice size is preset, and the file to be uploaded is divided into a plurality of file slices to be uploaded according to the target slice size.
Further, when uploading the file fragments to be uploaded, establishing uploading records for each file fragment to be uploaded in a server of the browser, when uploading the file fragments to be uploaded, receiving the uploaded file fragments to be uploaded to obtain uploading file fragments, forming uploading records for the uploading file fragments in the server of the browser, temporarily caching the received file fragments to be uploaded, and caching the uploading file fragments into a pre-allocated fixed disk space.
Further, query is conducted on the fixed disk space before uploading the file fragments to be uploaded, fixed disk space size monitoring information is obtained, whether space cleaning is needed is analyzed according to the fixed disk space size monitoring information, when space cleaning is needed, time analysis is conducted on cache information in the fixed disk space, the cache information is cleaned according to time sequence, meanwhile, the received file fragments to be uploaded are cached in the fixed disk space by adopting a page replacement algorithm, and in the fixed disk space, when the uploaded file fragments to be uploaded are obtained according to the temporarily cached uploading file fragments, the corresponding cached uploading file fragments in the fixed disk space are cleaned.
Further, when uploading the file fragments to be uploaded, acquiring file uploading condition information, obtaining file monitoring information, analyzing and judging whether uploading interruption occurs in the uploading process of the file to be uploaded according to the file monitoring information, when whether uploading interruption occurs in the uploading process of the file to be uploaded, determining successful uploading file fragments to be uploaded and unsuccessful uploading file fragments to be uploaded according to MD5 value analysis, locking uploading interruption positions, restarting uploading the file fragments to be uploaded with uploading interruption when reestablishing long uploading connection, and continuing uploading the file fragments to be uploaded which are not uploaded.
Further, combining the uploaded file fragments with the MD5 value of the file fragment is performed after all the file fragments to be uploaded of the file to be uploaded are uploaded, and when combining, the method includes: according to the uploading record, calling the uploading file fragments in the fixed disk space; verifying the called uploading file fragments by using the MD5 value to obtain a verification result; combining the called uploading file fragments according to the verification result, combining the uploading file fragments together when the verification result is passing, replacing by adopting a blank general fragment when the verification result is not passing, obtaining a combined initial file, carrying out feature analysis on the blank general fragment combined with the adjacent uploading file fragments in the combined initial file, obtaining the edge features of the adjacent uploading file fragments, analyzing the features of the blank general fragment according to the edge features of the adjacent uploading file fragments, tracing the corresponding file fragments to be uploaded according to the uploading file fragments which are not passing the verification result, carrying out uploading and verification again according to the traced file fragments to be uploaded until the verification result passes, obtaining a supplementary uploading file fragment, carrying out feature analysis on the supplementary uploading file fragments, obtaining the features of the supplementary uploading file fragments, carrying out feature matching on the blank general fragment in the combined initial file according to the features of the supplementary uploading file fragments, and carrying out feature matching on the blank general file according to the feature matching result, thus obtaining the uploaded file to be uploaded.
Further, the method for uploading the large browser file further comprises the following steps: monitoring and analyzing;
the monitoring and analyzing includes: monitoring a file to be uploaded or a process of uploading the file to be uploaded in a slicing way, and obtaining monitoring information; analyzing the size of the file to be uploaded or the fragments of the file to be uploaded according to the monitoring information, and determining the size range of the file uploaded by the server of the browser by combining the whole verification result to obtain a monitoring analysis result;
setting monitoring time when the monitoring analysis result is obtained, determining the monitoring analysis result in the set monitoring time, and carrying out preliminary judgment on the file to be uploaded by utilizing the monitoring analysis result after determining the file to be uploaded to obtain a preliminary judgment result, and uploading according to the preliminary judgment result.
Further, when uploading the file fragments to be uploaded, the file fragments to be uploaded are discharged according to the sequence, and the file fragments to be uploaded are sequentially transmitted and uploaded, including:
carrying out transmission pretreatment on the file fragments to be uploaded, obtaining parameter information of the file fragments to be uploaded, selecting an uploading link according to the parameter information in a matching way, and determining uploading configuration parameters;
uploading the file fragments to be uploaded according to the uploading configuration parameters, and recording the uploading consumed time of the file fragments to be uploaded;
And adjusting a transmission preprocessing scheme by utilizing the file fragment uploading consumed time to be uploaded, carrying out transmission preprocessing on the remaining file fragments to be uploaded in advance by combining the file fragment uploading consumed time to be uploaded with the transmission preprocessing consumed time, and entering an uploading waiting queue.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
FIG. 1 is a schematic diagram illustrating steps of a method for uploading a large file of a browser according to the present invention;
FIG. 2 is a schematic diagram illustrating steps of MD5 calculation in a method for uploading a large file of a browser according to the present invention;
Fig. 3 is a schematic partial flow chart of a step seven in the method for uploading a large file of a browser according to the present invention.
Detailed Description
The preferred embodiments of the present invention will be described below with reference to the accompanying drawings, it being understood that the preferred embodiments described herein are for illustration and explanation of the present invention only, and are not intended to limit the present invention.
As shown in fig. 1, an embodiment of the present invention provides a method for uploading a large file of a browser, including:
step one, determining a file to be uploaded;
secondly, MD5 calculation is carried out on the file to be uploaded, and the overall MD5 value of the file is obtained;
uploading the file to be uploaded to a server of a browser, and checking according to the overall MD5 value of the file to obtain an overall checking result;
fourth, slicing the file to be uploaded according to the overall inspection result to obtain file slices to be uploaded;
fifthly, performing MD5 calculation on the file fragments to be uploaded to obtain a file fragment MD5 value;
step six, uploading the file fragments to be uploaded to a server of the browser;
and step seven, receiving the uploaded file fragments to be uploaded in a server of the browser to obtain uploaded file fragments, and combining the uploaded file fragments with the MD5 value of the file fragments to obtain the uploaded file to be uploaded.
According to the technical scheme, the method for uploading the large file of the browser is improved, when the file is uploaded to the browser, the file to be uploaded is determined firstly, and then MD5 integral calculation is carried out on the file to be uploaded by adopting an MD5 algorithm, so that the integral MD5 value of the file is obtained; uploading a file to be uploaded, and checking according to the overall MD5 value of the file to obtain an overall checking result; if the overall verification result is that the file to be uploaded exists in the server, uploading the file to be uploaded successfully, and if the overall verification result is that the file to be uploaded does not exist in the server, performing slicing processing on the file to be uploaded at the same time to obtain file slices to be uploaded; then, carrying out MD5 calculation on the file fragments to be uploaded to obtain a file fragment MD5 value, and uploading the file fragment MD5 value; and receiving the file fragments to be uploaded in the server to obtain file fragments to be uploaded, combining the file fragments to be uploaded with the MD5 value parts of the file fragments to obtain the file to be uploaded after uploading, and finishing uploading of the file to be uploaded.
According to the technical scheme, the large file is uploaded to the browser server, uploading can be achieved no matter the large file or the small file, the whole file is uploaded, the fragmentation processing is carried out only when uploading cannot be successful, the large file which cannot be successfully uploaded can be fragmented and uploaded timely, the efficiency of uploading the large file is improved, the user experience is improved, the MD5 calculation can be carried out on the whole file to be uploaded or the file fragments to be uploaded for checking the file to be uploaded and the file fragments to be uploaded received by the browser server, accordingly uploading integrity and uploading success or not are determined, in addition, after the uploading file fragments to be uploaded are received, the file fragments to be uploaded are restored in the browser server through merging the uploading file fragments, and accordingly the whole existence of the file to be uploaded in the browser server is ensured.
In one embodiment provided by the invention, when MD5 calculation is performed on the file to be uploaded and MD5 calculation is performed on the file to be uploaded in a slicing way, the fast MD5 algorithm realized based on wasm is adopted for calculation, and after the MD5 algorithm is compiled into the language in the wasm environment by using the rust language, the MD5 calculation is performed on the file to be uploaded or the file to be uploaded in a slicing way.
According to the technical scheme, when MD5 calculation is carried out on the file to be uploaded and MD5 calculation is carried out on the file to be uploaded, both the MD5 algorithm is adopted, when MD5 calculation is carried out on the file to be uploaded and MD5 calculation is carried out on the file to be uploaded, the Rust language is utilized to convert the MD5 algorithm, the MD5 algorithm is compiled into a program language under a wasm (WebAssemblem virtual instruction set architecture) environment, and then the MD5 algorithm based on wasm is adopted to carry out the MD5 calculation in the uploading process of the large file of the browser.
According to the technical scheme, the MD5 algorithm is converted by the rust language aiming at the MD5 algorithm, so that the MD5 algorithm has a better safety environment, the safety of files to be uploaded or file fragments to be uploaded in the uploading process of the large files of the browser is further ensured, the rust can solve the problems of high concurrency and high safety systems, the method is suitable for large scenes, the boundary capable of keeping the integrity of the large system can be created and maintained, and the MD5 algorithm is compiled into a program language under the environment of a wasm (WebAssemblem virtual instruction set architecture) so that the MD5 algorithm can be used for writing codes in a time-non-Java programming language in the uploading process of the large files of the browser and can be operated on the browser.
As shown in fig. 2, in one embodiment provided by the present invention, the calculation performed by using the fast MD5 algorithm implemented based on wasm includes:
a1, respectively carrying out length processing on the file to be uploaded or the file fragments to be uploaded, and filling the file to be uploaded or the file fragments to be uploaded to the multiple of 64 to obtain filling processing data;
a2, initializing the intermediate results of the register storage calculation, and initializing 4 32-bit register storage calculation intermediate results;
a3, grouping filling processing data by taking 512 bits as a unit to obtain grouping data, and carrying out iteration and data updating of a register on the grouping data to obtain updated register data;
and A4, splicing the updated register data in sequence to form a 128-bit message digest, and obtaining the MD5 value of the file to be uploaded or the file fragment to be uploaded.
The technical scheme is that a fast MD5 algorithm realized based on wasm is adopted for calculation, when MD5 calculation is carried out on a file to be uploaded, length processing is firstly carried out on the file to be uploaded, the file to be uploaded is filled to be a multiple of 64, filling processing data are obtained, then initialization processing is carried out on intermediate results of register storage calculation, and 4 intermediate results of register storage calculation of 32 bits are initialized; grouping the filling processing data by taking 512 bits as a unit to obtain grouping data, and carrying out iteration and data updating of a register on the grouping data to obtain updated register data; and finally, splicing the updated register data in sequence to form a 128-bit message abstract, and obtaining the MD5 value of the file to be uploaded. The same is true when MD5 calculation is performed on the file fragments to be uploaded, firstly, length processing is performed on the file fragments to be uploaded, the file fragments to be uploaded are filled to multiples of 64 to obtain filling processing data, then initialization processing is performed on intermediate results of register storage calculation, and 4 intermediate results of register storage calculation with 32 bits are initialized; grouping the filling processing data by taking 512 bits as a unit to obtain grouping data, and carrying out iteration and data updating of a register on the grouping data to obtain updated register data; and finally, splicing the updated register data in sequence to form a 128-bit message digest, and obtaining the MD5 value of the file fragment to be uploaded.
According to the technical scheme, the security of the file to be uploaded or the file fragments to be uploaded in the uploading process can be improved through MD5 calculation, and verification basis can be provided for uploading the file to be uploaded to a server of a browser, so that whether the uploading file received in the server of the browser is completed or not can be verified, the uploading success is further ensured, in addition, the MD5 value is the only certificate of the file to be uploaded or the file fragments to be uploaded, and the existence of the file to be uploaded or the integrity of the file fragments to be uploaded can be effectively determined.
In one embodiment provided by the invention, when the file to be uploaded is fragmented according to the overall inspection result, the file to be uploaded is successfully uploaded when the overall inspection result is that the file to be uploaded exists in the browser server, and the file to be uploaded is failed to upload when the overall inspection result is that the file to be uploaded does not exist in the browser server, at the moment, the file to be uploaded is fragmented, a target slice size is preset, and the file to be uploaded is fragmented into a plurality of files to be uploaded according to the target slice size.
According to the technical scheme, when the file to be uploaded is subjected to slicing processing according to the overall inspection result, if the overall inspection result is that the file to be uploaded exists in the browser server, the server of the browser is successfully uploaded by the file to be uploaded, uploading of the file to be uploaded is completed at the moment, if the overall inspection result is that the file to be uploaded does not exist in the browser server, the server of the browser is failed in uploading of the file to be uploaded, at the moment, slicing processing is performed on the file to be uploaded, the target slice size is preset, and the file to be uploaded is divided into a plurality of slices according to the target slice size, so that a plurality of file slices to be uploaded are obtained. When the file to be uploaded is divided into a plurality of fragments according to the target slice size, if the size of the file to be uploaded is just a multiple of the target slice size, the file to be uploaded is divided into fragments of the file to be uploaded with equal size according to the average cutting of the target slice size, and if the size of the file to be uploaded is not a multiple of the target slice size, the file to be uploaded is divided according to the target slice size from the beginning, and the rest part with the insufficient target slice size is independently used as the last fragment of the file to be uploaded.
According to the technical scheme, when the file to be uploaded is subjected to the slicing processing according to the overall inspection result, if the file to be uploaded can be directly successfully uploaded when the file to be uploaded is successfully uploaded, the slicing processing is performed only when the file to be uploaded is failed to be uploaded, so that the file to be uploaded is successfully uploaded when the file to be uploaded is large and cannot be uploaded integrally, and the remaining part with the size smaller than the target slice is independently used as the last file slice to be uploaded, the file to be uploaded can be uploaded orderly in a plurality of slices to be uploaded, the occurrence of uploading disorder is avoided, the uploading error is effectively reduced, the uploading effectiveness is ensured, and the uploading efficiency is further ensured.
In one embodiment provided by the invention, when uploading a file fragment to be uploaded, uploading records are established for each file fragment to be uploaded in a server of a browser, when uploading the file fragment to be uploaded, the uploaded file fragment to be uploaded is received, uploading records are formed for the uploaded file fragment in the server of the browser, then temporary caching is carried out on the received file fragment to be uploaded, and the uploaded file fragment is cached in a pre-allocated fixed disk space.
When uploading the file fragments to be uploaded, uploading records are established for each file fragment to be uploaded in a server of the browser, when each file fragment to be uploaded uploads the server of the browser, uploading records are established for the file fragments to be uploaded in the server of the browser, uploading records are formed for uploading conditions of the file fragments to be uploaded and receiving conditions in the server of the browser, temporary caching is carried out for the received uploading file fragments in the server of the browser, a fixed disk space for temporary caching is divided in advance in the server of the browser, and the received uploading file fragments are cached in the pre-allocated fixed disk space.
Further, when uploading the file fragments to be uploaded, a logic link is adopted for transmission, a plurality of sub-links are included in the logic link, when the file fragments to be uploaded are transmitted and uploaded, whether the sub-links have faults or not is analyzed, when the sub-links do not have faults, one sub-link is selected as a target sub-link according to the file fragments to be uploaded, then the size of the file fragments to be uploaded and the bandwidth of the target sub-link are analyzed, if the size of the file fragments to be uploaded is larger than the bandwidth of the target sub-link, the expansion is carried out in the logic link based on the target sub-link, the expansion link is obtained, and if the size of the file fragments to be uploaded is smaller than the bandwidth of the target sub-link, the file fragments to be uploaded are directly uploaded by using the target sub-link; when the sub-link has a fault, selecting a target number of sub-links in the sub-links with no fault of the logical link as target sub-links according to the file fragments to be uploaded, and uploading the file fragments to be uploaded by using the target sub-links, wherein the target number is smaller than the total number of the sub-links minus the number of the fault sub-links.
According to the technical scheme, the uploading records are formed for the uploading file fragments in the server of the browser, so that the overall uploading records of the uploading file fragments corresponding to the uploading file fragments can be obtained in the browser, management of the uploading file fragments in the server of the browser is facilitated, a fixed disk space for temporary buffering is divided in advance in the server of the browser, a place for temporarily storing the uploading file fragments is reserved in the server of the browser, and unified processing is conducted after all the uploading file fragments are received in the server of the browser, so that the uploading file after complete uploading of the uploading file is obtained. In addition, when uploading the file fragments to be uploaded, a logic link is adopted to transmit, so that abnormal conditions such as transmission blockage and loss can be avoided while uploading the file fragments to be uploaded, stability of the transmission link is ensured, a plurality of sub-links are included in the logic link, uploading of the file fragments to be uploaded can be completed by adopting other non-fault sub-links even if the sub-links have faults, uploading reliability is ensured, when the size of the file fragments to be uploaded is larger than the bandwidth of a target sub-link, timeliness of the file fragments to be uploaded can be ensured by expanding in the logic link based on the target sub-links, overlong waiting time is avoided, waste caused by surplus resources can be avoided while uploading of the file fragments to be uploaded is ensured within preset time, and in addition, when the sub-links have faults, uploading of the file fragments to be uploaded can be ensured by selecting the sub-links with target number in the sub-links without faults of the logic link as target sub-links, and the remaining sub-links can still be uploaded when the sub-links have faults again.
In one embodiment provided by the invention, query is carried out on a fixed disk space before uploading a file fragment to be uploaded, fixed disk space size monitoring information is obtained, whether space cleaning is needed is analyzed according to the fixed disk space size monitoring information, when space cleaning is needed, time analysis is carried out on cache information in the fixed disk space, a page replacement algorithm is adopted according to time sequence to clean the cache information, meanwhile, the received file fragment to be uploaded is cached in the fixed disk space, and in the fixed disk space, when the uploaded file fragment to be uploaded is obtained according to the temporarily cached uploading file fragment, the corresponding cached uploading file fragment in the fixed disk space is cleaned.
According to the technical scheme, the fixed disk space is monitored, the fixed disk space size monitoring information is obtained, when the file to be uploaded is uploaded in the form of the file fragments to be uploaded, the size of the fixed disk space is inquired, the fixed disk space size monitoring information is called, whether the fixed disk space can temporarily cache the file fragments to be uploaded or not is analyzed according to the fixed disk space size monitoring information, whether space cleaning is needed or not is determined, if space cleaning is not needed, the file fragments to be uploaded are uploaded, the received file fragments to be uploaded are directly temporarily cached in the fixed disk space, if space cleaning is needed, time analysis is performed on the cache information in the fixed disk space, the information to be cleaned is determined according to the time sequence, and after uploading the file fragments to be uploaded, the received file fragments to be uploaded are temporarily cached in the fixed disk space by combining the information to be cleaned. Particularly, in the fixed disk space, if the uploaded file to be uploaded is obtained according to the temporarily cached uploading file fragments, the corresponding cached uploading file fragments in the fixed disk space are cleared.
According to the technical scheme, whether the fixed disk space can be used for temporarily caching the file fragments to be uploaded can be clearly judged by inquiring the fixed disk space, so that the integrity of the received file fragments to be uploaded is ensured, the file fragments to be uploaded can be conveniently and quickly fetched and combined in the fixed disk space when the file fragments to be uploaded are combined, meanwhile, the cache information is cleared by adopting a page replacement algorithm according to the time sequence in the fixed disk space, the cache information is subjected to time analysis to enable the information with longer temporary cache time in the fixed disk space to be cleared preferentially, the temporary cache information corresponding to the file fragments to be uploaded which are stopped to be uploaded for a long time is cleared as required, and the space is reserved for the information which needs to be temporarily cached, so that the normal use is avoided. In addition, after the uploaded file to be uploaded is obtained according to the temporarily cached uploaded file fragments, the space can be timely made for the fixed disk space by clearing the uploaded file fragments corresponding to the caches in the fixed disk space, and convenience is provided for using the fixed disk space.
In one embodiment provided by the invention, when uploading is carried out on the file fragments to be uploaded, file uploading condition information is obtained, file monitoring information is obtained, whether uploading interruption occurs in the uploading process of the file to be uploaded is judged according to file monitoring information analysis, when uploading interruption occurs in the uploading process of the file to be uploaded, successful uploading of the file fragments to be uploaded and unsuccessful uploading of the file fragments to be uploaded are determined according to MD5 value analysis, uploading interruption positions are locked, uploading is restarted when long uploading connection is reestablished on the file fragments to be uploaded with uploading interruption, and uploading is continued on the file fragments to be uploaded which are not uploaded.
According to the technical scheme, when uploading is conducted on the file fragments to be uploaded, uploading monitoring is conducted on the file fragments to be uploaded, uploading process of the file fragments to be uploaded is monitored, file uploading condition information is obtained, file monitoring information of the file fragments to be uploaded is obtained, whether uploading interruption occurs in the file uploading process is judged according to file monitoring information analysis, if uploading interruption occurs in the file uploading process to be uploaded, successful uploading file fragments to be uploaded and unsuccessful uploading file fragments to be uploaded are determined according to MD5 value analysis, uploading interruption positions are locked, uploading is restarted when long uploading connection is reestablished on the file fragments to be uploaded, and uploading is continued on the file fragments to be uploaded behind the file fragments to be uploaded with uploading interruption until uploading of all the file fragments to be uploaded is completed.
According to the technical scheme, the file to be uploaded and the file to be uploaded which are successfully uploaded and the file to be uploaded which are unsuccessfully uploaded can be uploaded when the uploading process of the file to be uploaded is interrupted, so that the file to be uploaded which is interrupted is traced back, uploading can be carried out again when the uploading process is reconnected, the problem of uploading the file in a server of a browser is avoided, and meanwhile, the phenomenon that the normal merging process is influenced only when the subsequent merging process is discovered is avoided.
As shown in fig. 3, in one embodiment of the present invention, merging the uploaded file fragments with the file fragment MD5 value is performed after all the file fragments to be uploaded of the file to be uploaded are completely uploaded, and when merging, the method includes: according to the uploading record, calling the uploading file fragments in the fixed disk space; verifying the called uploading file fragments by using the MD5 value to obtain a verification result; combining the called uploading file fragments according to the verification result, combining the uploading file fragments together when the verification result is passing, replacing by adopting a blank general fragment when the verification result is not passing, obtaining a combined initial file, carrying out feature analysis on the blank general fragment combined with the adjacent uploading file fragments in the combined initial file, obtaining the edge features of the adjacent uploading file fragments, analyzing the features of the blank general fragment according to the edge features of the adjacent uploading file fragments, tracing the corresponding file fragments to be uploaded according to the uploading file fragments which are not passing the verification result, carrying out uploading and verification again according to the traced file fragments to be uploaded until the verification result passes, obtaining a supplementary uploading file fragment, carrying out feature analysis on the supplementary uploading file fragments, obtaining the features of the supplementary uploading file fragments, carrying out feature matching on the blank general fragment in the combined initial file according to the features of the supplementary uploading file fragments, and carrying out feature matching on the blank general file according to the feature matching result, thus obtaining the uploaded file to be uploaded.
According to the technical scheme, when the uploaded file fragments are combined with the file fragment MD5 value, whether all the file fragments to be uploaded of the file to be uploaded are completely uploaded is analyzed and judged, when all the file fragments to be uploaded of the file to be uploaded are completely uploaded, the obtained uploaded file fragments are combined, and when the obtained uploaded file fragments are combined, firstly, the uploaded file fragments are called in a fixed disk space according to uploading records; then, verifying the called uploading file fragments by utilizing the MD5 value, calling a server side MD5 library to calculate a file MD5 and comparing the file MD5 with the file MD5 transmitted by the front end to obtain a verification result; combining the retrieved uploading file fragments according to the verification result, if the verification result is passing, combining the uploading file fragments together, if the verification result is not passing, adopting a blank universal fragment to replace uploading file fragments which are not passing by the verification result, so as to obtain a combined initial file, wherein the blank universal file fragments are blank files with the same size as the uploading file fragments, at the moment, in the combined initial file, combining the blank universal fragments with adjacent uploading file fragments for feature analysis, if the position of the blank universal fragments is in the middle of the combined initial file, performing right edge feature analysis on the left adjacent uploading file fragments and performing left edge feature analysis on the right adjacent uploading file fragments, obtaining the edge features of the adjacent uploading file fragments, then determining the features of the blank universal fragments according to the edge features of the adjacent uploading file fragments, if the position of the blank universal fragments is in the endpoint position of the combined initial file, performing right edge feature analysis on the left adjacent uploading file fragments or performing left edge feature analysis on the right adjacent uploading file fragments, performing tracing back-up feature analysis on the adjacent uploading fragments until the corresponding edge fragments are not verified, obtaining the corresponding uploading file fragments, and obtaining the supplemental feature files according to the supplemental feature analysis result after the supplemental feature analysis is completed, and carrying out feature matching on the blank universal fragments in the combined initial file according to the fragment features of the supplementary uploading file, and carrying out blank universal file replacement on the supplementary uploading file successfully matched with the corresponding blank universal file according to the feature matching result to obtain the uploaded file to be uploaded.
When the server side MD5 library is called to calculate the file MD5 and compare the file MD5 with the file MD5 transmitted by the front end, a verification result is obtained through the following formula:
in the above formula, U represents a judgment value; w represents a first weight coefficient, p represents a second weight coefficient, q represents a third weight coefficient, wherein the value of the first weight coefficient w is larger than that of the second weight coefficient p and the third weight coefficient q, and the second weight coefficient p and the third weight coefficient q are generally equal; c represents a metering function; a represents an information data set of a server-side MD5 value; b represents an information data set of the MD5 value of the file transmitted by the front end; d represents a verification result, when d=t, it represents passing verification, and when d=f, it represents failing verification; mu represents a judgment threshold value, and the value is 1.
According to the technical scheme, the uploaded file to be uploaded can be directly obtained at one time by merging after all the file fragments to be uploaded of the file to be uploaded are uploaded, so that the continuous merging occupation performance is avoided, and the uploading of the file fragments to be uploaded is influenced. When merging, the integrity of the uploaded file fragments is ensured by verifying the called uploaded file fragments by using the MD5 value, meanwhile, the integrity of the uploaded file fragments after merging is ensured, when verification fails, the traced file fragments to be uploaded are uploaded and verified again until verification passes, the correctness of the uploaded file to be uploaded is further ensured, in addition, when merging, the blank universal fragments are adopted to replace the uploading file fragments which do not pass verification, the merging is ensured, and the feature is endowed for the blank universal fragments in combination with the adjacent uploading file fragments, so that the position of the complementary uploading file fragments can be accurately found when the complementary uploading file fragments are obtained, the replacement error when a plurality of blank universal fragments appear in the merging initial file is avoided, the accuracy of the replacement of the blank universal file is improved, and the accuracy of the uploaded file to be uploaded after uploading is ensured.
In one embodiment of the present invention, the method for uploading a large file of a browser further includes: monitoring and analyzing;
the monitoring and analyzing includes: monitoring a file to be uploaded or a process of uploading the file to be uploaded in a slicing way, and obtaining monitoring information; analyzing the size of the file to be uploaded or the fragments of the file to be uploaded according to the monitoring information, and determining the size range of the file uploaded by the server of the browser by combining the whole verification result to obtain a monitoring analysis result;
setting monitoring time when the monitoring analysis result is obtained, determining the monitoring analysis result in the set monitoring time, and carrying out preliminary judgment on the file to be uploaded by utilizing the monitoring analysis result after determining the file to be uploaded to obtain a preliminary judgment result, and uploading according to the preliminary judgment result.
The method for uploading the large browser file in the technical scheme further comprises the following steps: monitoring and analyzing; when monitoring analysis is carried out, monitoring is carried out aiming at the uploading process of the large file of the browser, the process of uploading the file to be uploaded or the process of uploading the file to be uploaded in a slicing way is monitored, and monitoring information is obtained, wherein the monitoring information comprises: the size of the file to be uploaded or the size of the file fragments to be uploaded and the information attribute of the file to be uploaded or the information attribute of the file fragments to be uploaded are obtained; analyzing the size of the file to be uploaded or the fragments of the file to be uploaded according to the monitoring information, and determining which files can be successfully uploaded in the uploading process of the large file of the browser, how large files can be successfully uploaded and the like by combining the whole verification result, so that the size range of the file uploaded by the server of the browser is determined, and the monitoring analysis result is obtained; and setting monitoring time when the monitoring analysis result is obtained, determining the monitoring analysis result in the set monitoring time, and carrying out preliminary judgment on the file to be uploaded by utilizing the monitoring analysis result after determining the file to be uploaded to obtain a preliminary judgment result, and uploading according to the preliminary judgment result.
According to the technical scheme, the size range of the file uploaded by the server of the browser can be clearly determined through monitoring and analysis, so that the corresponding uploading method can be directly adopted through preliminary judgment on the file to be uploaded when the large file is uploaded, further the file uploading efficiency is improved, and the browser can be successfully uploaded in a short time.
In one embodiment provided by the invention, when uploading the file fragments to be uploaded, the file fragments to be uploaded are discharged according to a sequence, and the file fragments to be uploaded are sequentially transmitted and uploaded, including:
carrying out transmission pretreatment on the file fragments to be uploaded, obtaining parameter information of the file fragments to be uploaded, selecting an uploading link according to the parameter information in a matching way, and determining uploading configuration parameters;
uploading the file fragments to be uploaded according to the uploading configuration parameters, and recording the uploading consumed time of the file fragments to be uploaded;
and adjusting a transmission preprocessing scheme by utilizing the file fragment uploading consumed time to be uploaded, carrying out transmission preprocessing on the remaining file fragments to be uploaded in advance by combining the file fragment uploading consumed time to be uploaded with the transmission preprocessing consumed time, and entering an uploading waiting queue.
According to the technical scheme, when uploading the file fragments to be uploaded, the file fragments to be uploaded are discharged according to the sequence, and the file fragments to be uploaded are sequentially transmitted and uploaded, and the method comprises the following specific steps of:
firstly, carrying out transmission pretreatment on the file fragments to be uploaded, obtaining parameter information of the file fragments to be uploaded, selecting an uploading link according to the parameter information in a matching way, and determining uploading configuration parameters; then uploading the file fragments to be uploaded according to the uploading configuration parameters, and recording the uploading consumption time of the file fragments to be uploaded; and then, adjusting a transmission preprocessing scheme by utilizing the file fragment uploading consumption time to be uploaded, carrying out transmission preprocessing on the rest file fragments to be uploaded in advance by combining the file fragment uploading consumption time to be uploaded with the transmission preprocessing consumption time, and entering an uploading waiting queue. When the remaining file fragments to be uploaded are subjected to transmission pretreatment in advance by combining the consumed time of the file fragments to be uploaded with the consumed time of the transmission pretreatment, the pretreatment reminding is carried out on the file fragments to be uploaded through the following steps:
firstly, carrying out preliminary analysis and judgment on the file fragments to be uploaded according to the following formula:
In the above formula, E i Representing the preliminary analysis judgment value, X of the ith file fragment to be uploaded i Representing the size of the ith file fragment to be uploaded, Q represents the unit time consumption of transmission pretreatment for the file fragment to be uploaded, Z i-n Representing the i-N-th file fragment uploading time consumption to be uploaded, Y represents the file fragment uploading interval to be uploaded, N i Representing the number of file fragments to be uploaded in front of the ith file fragment to be uploaded in the uploading waiting queue;
then according to the preliminary analysis judgment value E of the ith file fragment to be uploaded i Analysis is performed when n takes different values, lock E i When the value of n is less than or equal to 0, determining that the corresponding file fragment to be uploaded is the L-th file fragment to be uploaded at the moment;
then determining a pretreatment reminding time judgment value through the following formula:
in the above formula, M i Indicating the pretreatment reminding time judgment value of the ith file fragment to be uploaded, Z L The method comprises the steps of representing the consumed time of fragment uploading of an L-th file to be uploaded;
and finally, uploading and monitoring the ith file fragment to be uploaded according to the pretreatment reminding time judgment value of the ith file fragment to be uploaded, and carrying out pretreatment reminding on the ith file fragment to be uploaded when the uploading progress of the ith file fragment to be uploaded reaches the pretreatment reminding time judgment value of the ith file fragment to be uploaded.
According to the technical scheme, each file fragment to be uploaded can be uploaded better when uploading is carried out through transmission pretreatment, the situation that data is lost or lost and the like in the uploading process is avoided, statistics on time is carried out in the file fragment uploading process to be uploaded, adjustment of the transmission pretreatment scheme is carried out under the condition that the file fragment uploading to be uploaded is not affected, and the rest file fragments to be uploaded can be uploaded orderly through adjustment of the transmission pretreatment scheme, so that waiting time of the file fragments to be uploaded in a queue is effectively reduced, and meanwhile validity of uploading can be guaranteed. In addition, the file fragments to be uploaded are timely preprocessed by preprocessing and reminding the file fragments to be uploaded, so that the file fragments to be uploaded are continuously uploaded and output, the uploading efficiency is improved, and meanwhile, the continuity of uploading the file fragments to be uploaded is determined.
It will be appreciated by those skilled in the art that the first and second aspects of the present invention refer only to different phases of application.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (9)
1. The method for uploading the large browser file is characterized by comprising the following steps of:
determining a file to be uploaded;
MD5 calculation is carried out on the file to be uploaded, and the overall MD5 value of the file is obtained;
uploading the file to be uploaded to a server of a browser, and checking according to the overall MD5 value of the file to obtain an overall checking result;
performing fragmentation processing on the file to be uploaded according to the overall inspection result to obtain fragments of the file to be uploaded;
MD5 calculation is carried out on the file fragments to be uploaded to obtain a file fragment MD5 value;
uploading the file fragments to be uploaded to a server of a browser; when uploading the file fragments to be uploaded, discharging the file fragments to be uploaded according to a sequence, and sequentially carrying out transmission processing and uploading on the file fragments to be uploaded, wherein the method comprises the following steps: carrying out transmission pretreatment on the file fragments to be uploaded, obtaining parameter information of the file fragments to be uploaded, selecting an uploading link according to the parameter information in a matching way, and determining uploading configuration parameters; uploading the file fragments to be uploaded according to the uploading configuration parameters, and recording the uploading consumed time of the file fragments to be uploaded; adjusting a transmission preprocessing scheme by using the file fragment uploading consumed time to be uploaded, carrying out transmission preprocessing on the remaining file fragments to be uploaded in advance by combining the file fragment uploading consumed time to be uploaded with the transmission preprocessing consumed time, and entering an uploading waiting queue; when the remaining file fragments to be uploaded are subjected to transmission pretreatment in advance by combining the consumed time of the file fragments to be uploaded with the consumed time of the transmission pretreatment, the file fragments to be uploaded are subjected to pretreatment reminding through the following steps:
Firstly, carrying out preliminary analysis and judgment on the file fragments to be uploaded according to the following formula:
in the above formula, E i Representing the preliminary analysis judgment value, X of the ith file fragment to be uploaded i Representing the size of the ith file fragment to be uploaded, Q represents the unit time consumption of transmission pretreatment for the file fragment to be uploaded, Z i-n Representing the i-N-th file fragment uploading time consumption to be uploaded, Y represents the file fragment uploading interval to be uploaded, N i Representing the ith in the upload wait queueThe number of file fragments to be uploaded in front of the file fragments to be uploaded;
then according to the preliminary analysis judgment value E of the ith file fragment to be uploaded i Analysis is performed when n takes different values, lock E i When the value of n is less than or equal to 0, determining that the corresponding file fragment to be uploaded is the L-th file fragment to be uploaded at the moment;
then determining a pretreatment reminding time judgment value through the following formula:
in the above formula, M i Indicating the pretreatment reminding time judgment value of the ith file fragment to be uploaded, Z L The method comprises the steps of representing the consumed time of fragment uploading of an L-th file to be uploaded;
finally, uploading and monitoring the ith to-be-uploaded file fragment according to the pretreatment reminding time judgment value of the ith to-be-uploaded file fragment, and carrying out pretreatment reminding on the ith to-be-uploaded file fragment when the uploading progress of the ith to-be-uploaded file fragment reaches the pretreatment reminding time judgment value of the ith to-be-uploaded file fragment;
And receiving the uploaded file fragments to be uploaded in a server of the browser to obtain uploaded file fragments, and combining the uploaded file fragments with the MD5 value of the file fragments to obtain the uploaded file to be uploaded.
2. The method for uploading the large browser file according to claim 1, wherein the method is characterized in that when the MD5 calculation is performed on the file to be uploaded and the MD5 calculation is performed on the file to be uploaded in a slicing mode, the rapid MD5 algorithm based on the wasm implementation is adopted for calculation, and the MD5 algorithm is compiled into a language in a wasm environment by using a rust language and then the MD5 calculation is performed on the file to be uploaded or the file to be uploaded in a slicing mode.
3. The method for uploading a large file of a browser according to claim 2, wherein the calculation is performed by using a fast MD5 algorithm implemented based on wasm, comprising:
respectively carrying out length processing on the file to be uploaded or the file fragments to be uploaded, and filling the file to be uploaded or the file fragments to be uploaded to the multiple of 64 to obtain filling processing data;
initializing the intermediate results of the register storage calculation, namely initializing 4 32-bit register storage calculation intermediate results;
grouping the filling processing data by taking 512 bits as a unit to obtain grouping data, and carrying out iteration and data updating of a register on the grouping data to obtain updated register data;
And splicing the updated register data in sequence to form a 128-bit message digest, and obtaining the MD5 value of the file to be uploaded or the file fragment to be uploaded.
4. The method for uploading the large file of the browser according to claim 1, wherein when the file to be uploaded is subjected to slicing processing according to the overall inspection result, the file to be uploaded is successfully uploaded when the overall inspection result is that the file to be uploaded exists in the browser server, and the file to be uploaded is failed to upload when the overall inspection result is that the file to be uploaded does not exist in the browser server, the file to be uploaded is subjected to slicing processing at the moment, a target slice size is preset, and the file to be uploaded is sliced into a plurality of files to be uploaded according to the target slice size.
5. The method for uploading large files of a browser according to claim 1, wherein when uploading the file fragments to be uploaded, uploading records are established for each file fragment to be uploaded in a server of the browser, when uploading the file fragments to be uploaded, the uploaded file fragments to be uploaded are received, uploading records are formed for the uploaded file fragments in the server of the browser, then temporary buffering is carried out on the received file fragments to be uploaded, and the uploaded file fragments are buffered in a pre-allocated fixed disk space.
6. The method for uploading large files of a browser according to claim 5, wherein the method is characterized in that before uploading the file fragments to be uploaded, the fixed disk space is queried to obtain the fixed disk space size monitoring information, whether space cleaning is needed is analyzed according to the fixed disk space size monitoring information, when space cleaning is needed, time analysis is conducted on cache information in the fixed disk space, the cache information is cleaned according to a time sequence, meanwhile, the received file fragments to be uploaded are cached in the fixed disk space by adopting a page replacement algorithm, and in the fixed disk space, after the uploaded file fragments to be uploaded are obtained according to the temporarily cached uploading file fragments, the corresponding cached uploading file fragments in the fixed disk space are cleaned.
7. The method for uploading large files of a browser according to claim 5, wherein when uploading is carried out on the file fragments to be uploaded, file uploading condition information is obtained, file monitoring information is obtained, whether uploading interruption occurs in the uploading process of the file to be uploaded is judged according to file monitoring information analysis, when uploading interruption occurs in the uploading process of the file to be uploaded, successful uploading of the file fragments to be uploaded and unsuccessful uploading of the file fragments to be uploaded are determined according to MD5 value analysis, uploading interruption positions are locked, uploading is restarted when long uploading connection is reestablished on the file fragments to be uploaded with uploading interruption, and uploading is continued on the file fragments to be uploaded which are not uploaded.
8. The method for uploading a large file by a browser according to claim 6, wherein merging the uploaded file fragments with the MD5 value of the file fragment is performed after all the file fragments to be uploaded of the file to be uploaded are completely uploaded, and when merging, the method comprises: according to the uploading record, calling the uploading file fragments in the fixed disk space; verifying the called uploading file fragments by using the MD5 value to obtain a verification result; combining the called uploading file fragments according to the verification result, combining the uploading file fragments together when the verification result is passing, replacing by adopting a blank general fragment when the verification result is not passing, obtaining a combined initial file, carrying out feature analysis on the blank general fragment combined with the adjacent uploading file fragments in the combined initial file, obtaining the edge features of the adjacent uploading file fragments, analyzing the features of the blank general fragment according to the edge features of the adjacent uploading file fragments, tracing the corresponding file fragments to be uploaded according to the uploading file fragments which are not passing the verification result, carrying out uploading and verification again according to the traced file fragments to be uploaded until the verification result passes, obtaining a supplementary uploading file fragment, carrying out feature analysis on the supplementary uploading file fragments, obtaining the features of the supplementary uploading file fragments, carrying out feature matching on the blank general fragment in the combined initial file according to the features of the supplementary uploading file fragments, and carrying out feature matching on the blank general file according to the feature matching result, thus obtaining the uploaded file to be uploaded.
9. The method for uploading a large file of a browser according to claim 1, wherein the method for uploading a large file of a browser further comprises: monitoring and analyzing;
the monitoring and analyzing includes: monitoring a file to be uploaded or a process of uploading the file to be uploaded in a slicing way, and obtaining monitoring information; analyzing the size of the file to be uploaded or the fragments of the file to be uploaded according to the monitoring information, and determining the size range of the file uploaded by the server of the browser by combining the whole verification result to obtain a monitoring analysis result;
setting monitoring time when the monitoring analysis result is obtained, determining the monitoring analysis result in the set monitoring time, and carrying out preliminary judgment on the file to be uploaded by utilizing the monitoring analysis result after determining the file to be uploaded to obtain a preliminary judgment result, and uploading according to the preliminary judgment result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310754670.1A CN116781685B (en) | 2023-06-25 | 2023-06-25 | Method for uploading large files of browser |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310754670.1A CN116781685B (en) | 2023-06-25 | 2023-06-25 | Method for uploading large files of browser |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116781685A CN116781685A (en) | 2023-09-19 |
| CN116781685B true CN116781685B (en) | 2024-02-13 |
Family
ID=87990920
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310754670.1A Active CN116781685B (en) | 2023-06-25 | 2023-06-25 | Method for uploading large files of browser |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116781685B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105635324A (en) * | 2016-03-17 | 2016-06-01 | 新浪网技术(中国)有限公司 | Big file uploading and continuous uploading method and device for browser or server |
| CN109361754A (en) * | 2018-11-05 | 2019-02-19 | 中国广核电力股份有限公司 | A kind of document transmission method and device based on browser |
| CN113938269A (en) * | 2021-12-15 | 2022-01-14 | 亿次网联(杭州)科技有限公司 | File fragment uploading verification method and system |
| CN114338646A (en) * | 2021-11-29 | 2022-04-12 | 王建冬 | File interactive transmission method, device, equipment and storage medium |
| CN114615258A (en) * | 2022-03-28 | 2022-06-10 | 重庆长安汽车股份有限公司 | Method and device for uploading large files to file server in fragmented manner |
| CN115766696A (en) * | 2021-09-03 | 2023-03-07 | 北京国双科技有限公司 | File uploading method and device, electronic equipment and storage medium |
| CN116112484A (en) * | 2023-03-07 | 2023-05-12 | 芜湖雄狮汽车科技有限公司 | File fragment uploading method and device, vehicle and storage medium |
| CN116233111A (en) * | 2022-12-27 | 2023-06-06 | 浪潮云信息技术股份公司 | Minio-based large file uploading method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102014113430A1 (en) * | 2014-09-17 | 2016-03-17 | Bundesdruckerei Gmbh | Distributed data storage using authorization tokens |
-
2023
- 2023-06-25 CN CN202310754670.1A patent/CN116781685B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105635324A (en) * | 2016-03-17 | 2016-06-01 | 新浪网技术(中国)有限公司 | Big file uploading and continuous uploading method and device for browser or server |
| CN109361754A (en) * | 2018-11-05 | 2019-02-19 | 中国广核电力股份有限公司 | A kind of document transmission method and device based on browser |
| CN115766696A (en) * | 2021-09-03 | 2023-03-07 | 北京国双科技有限公司 | File uploading method and device, electronic equipment and storage medium |
| CN114338646A (en) * | 2021-11-29 | 2022-04-12 | 王建冬 | File interactive transmission method, device, equipment and storage medium |
| CN113938269A (en) * | 2021-12-15 | 2022-01-14 | 亿次网联(杭州)科技有限公司 | File fragment uploading verification method and system |
| CN114615258A (en) * | 2022-03-28 | 2022-06-10 | 重庆长安汽车股份有限公司 | Method and device for uploading large files to file server in fragmented manner |
| CN116233111A (en) * | 2022-12-27 | 2023-06-06 | 浪潮云信息技术股份公司 | Minio-based large file uploading method |
| CN116112484A (en) * | 2023-03-07 | 2023-05-12 | 芜湖雄狮汽车科技有限公司 | File fragment uploading method and device, vehicle and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| "Secure data deduplication mechanism based on Rabin CDC and MD5 in cloud computing environment";Himshai Kambo;《 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology 》;全文 * |
| "一种基于HDFS的高性能文件存储与管理系统";张兴斌;《中国优秀硕士学位论文全文数据库 信息科技辑》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116781685A (en) | 2023-09-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7681076B1 (en) | Method and an apparatus to perform fast log replay | |
| CN108255647B (en) | High-speed data backup method under samba server cluster | |
| US7499954B2 (en) | Consistent reintegration of a failed primary instance | |
| US8381039B1 (en) | Storage of mass data for monitoring | |
| US8775377B1 (en) | Efficient data backup with change tracking | |
| CN109981659B (en) | Network resource prefetching method and system based on data deduplication technology | |
| CN106407224A (en) | Method and device for file compaction in KV (Key-Value)-Store system | |
| US6754842B2 (en) | Facilitating a restart operation within a data processing system | |
| CN112835743A (en) | Distributed account book data storage optimization method and device, electronic equipment and medium | |
| CN114615258A (en) | Method and device for uploading large files to file server in fragmented manner | |
| US20070192384A1 (en) | Computer implemented method for automatically managing stored checkpoint data | |
| CN116781685B (en) | Method for uploading large files of browser | |
| CN105242979A (en) | Backward recovery error tolerance method with forward recovery feature | |
| CN111694806A (en) | Transaction log caching method, device, equipment and storage medium | |
| CN106776153B (en) | Job control method and server | |
| CN108984338B (en) | Offline optimal cache replacement device and method for data recovery of duplicate removal backup system | |
| CN112000623A (en) | Metadata access method and device and computer readable storage medium | |
| CN114625805B (en) | Return test configuration method, device, equipment and medium | |
| CN105162891A (en) | Data storage method based on IP network | |
| US20210409264A1 (en) | Adaptive time window-based log message deduplication | |
| CN114138526A (en) | Mixed data updating method and storage system for erasure codes of memory key values | |
| CN112087501B (en) | Transmission method and system for maintaining data consistency | |
| US20210117096A1 (en) | Method, device and computer program product for backuping data | |
| CN114461730A (en) | Adaptive block data compression method based on remainder system | |
| CN111966635A (en) | Method and device for improving file detection speed of distributed storage file system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |