CN104618371A - Data downloading method, device and system - Google Patents
Data downloading method, device and system Download PDFInfo
- Publication number
- CN104618371A CN104618371A CN201510052223.7A CN201510052223A CN104618371A CN 104618371 A CN104618371 A CN 104618371A CN 201510052223 A CN201510052223 A CN 201510052223A CN 104618371 A CN104618371 A CN 104618371A
- Authority
- CN
- China
- Prior art keywords
- data
- client
- transmission rate
- download
- uncompressed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/563—Data redirection of data network streams
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application provides a data downloading method, a data downloading device and a data downloading system. The data downloading method includes: when receiving a downloading task from a client side, collecting performance data of the client side; confirming a compression coefficient of data to be downloaded by the client side when the data is transmitted to the client side according to the performance data; confirming transmission rate of compressed data and transmission rate of uncompressed data when the data to be downloaded is transmitted to the client side according to the confirmed compression coefficient; transmitting the compressed data obtained by compressing a part of the data to be downloaded and the uncompressed data in the data to be downloaded, which is not compressed, to the client side according to the transmission rate of the compressed data and the transmission rate of the uncompressed data, which are confirmed, and enabling the client side to decompress and restore the compressed data in the data received by the client side. According to the data downloading method, the data downloading device and the data downloading system, the compressed data obtained by compressing the part of the data to be downloaded and the uncompressed data are transmitted to the client side in parallel, the client side decompresses the compressed data, and therefore idle resources on the client side are effectively used, and downloading efficiency is improved.
Description
Technical field
The application relates to field of data transmission, particularly relates to a kind of data download method, Apparatus and system.
Background technology
Be generally that source file burst is stored in service end from document storage server downloading data, when client-requested is downloaded, download one by one.In existing download system, download total flow almost consistent with file size, and downloading rate depends on the network bandwidth and server bearing capacity completely, if do not consider the carrying bottleneck of server, so downloading rate is just only determined by the network bandwidth one metavariable, existing transmission plan cannot judge that client allows the performance of carrying and provides rational transmission means rationally and effectively, not often that other the Internets taking whole bandwidth contributions user are experienced, the routine office work taking a large amount of CPU impact user is exactly experienced, and result in the waste of client ample resources.
Therefore, tissue utilizes the multi dimensional resource of client rationally and effectively, and realizing more excellent download transmission means is current problem demanding prompt solution.
Summary of the invention
The main purpose of the application is to provide a kind of data download method, Apparatus and system, to solve the performance carrying out cannot judging rationally and effectively when data are downloaded client permission carrying that prior art exists, causes the problem that client ample resources is wasted.
For solving the problem, the embodiment of the present application provides a kind of data download method, comprising: when receiving the downloading task from client, gathers the performance data of described client; According to described performance data, determine the compressed coefficient of the data will downloaded to client described in described client transmissions, when the described compressed coefficient is the data will downloaded to described client transmissions, transmission rate proportion in overall transmission rate of packed data; According to the compressed coefficient determined, determine the transmission rate of packed data and the transmission rate of uncompressed data during the data to downloading described in described client transmissions; According to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, by described client, decompress(ion) reduction is carried out to the packed data in the data received.
Wherein, the performance data of described client comprises: the CPU usage of described client, internal memory remaining space, disk read-write speed and current network bandwidth.
Wherein, according to described performance data, before the step of compressed coefficient when determining the data will downloaded to client described in described client transmissions, also comprise: according to described performance data, determine whether that the data will downloaded described client carry out compression transmission.
Wherein, according to described performance data, determine whether that the data will downloaded described client carry out compression transmission, comprise: if the ratio of the peak transfer rate of the current transmission rate of described client and current network exceedes predetermined ratio, and the current CPU usage of described client is less than predetermined threshold, then determine to carry out compression transmission to the described data that will download.
Wherein, according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, comprise: according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, by described packed data and described uncompressed data respectively by different data transmission channels to described client transmissions.
The embodiment of the present application also provides a kind of data download apparatus, comprising: data acquisition module, for when receiving the downloading task from client, gathers the performance data of described client; First determination module, for according to described performance data, determine the compressed coefficient of the data will downloaded to client described in described client transmissions, when the described compressed coefficient is the data will downloaded to described client transmissions, transmission rate proportion in overall transmission rate of packed data; Second determination module, for according to the compressed coefficient determined, determines the transmission rate of packed data and the transmission rate of uncompressed data during the data to downloading described in described client transmissions; Data transmission module, for according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, by described client, decompress(ion) reduction is carried out to the packed data in the data received.
Wherein, the performance data of described client comprises: the CPU usage of described client, internal memory remaining space, disk read-write speed and current network bandwidth.
Wherein, also comprise: the 3rd determination module, for according to described performance data, determine whether that the data will downloaded described client carry out compression transmission.
Wherein, described 3rd determination module, be further used for: if the ratio of the peak transfer rate of the current transmission rate of described client and current network exceedes predetermined ratio, and the current CPU usage of described client is less than predetermined threshold, then determine to carry out compression transmission to the described data that will download.
Wherein, described data transmission module, is further used for: according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, by described packed data and described uncompressed data respectively by different data transmission channels to described client transmissions.
The embodiment of the present application also provides a kind of data downloading system, comprising: server and client side, described server, for when receiving the downloading task from client, gathers the performance data of described client; According to described performance data, determine the compressed coefficient of the data will downloaded to client described in described client transmissions; According to the compressed coefficient determined, determine the transmission rate of packed data and the transmission rate of uncompressed data during the data to downloading described in described client transmissions; According to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, wherein, the described compressed coefficient for during to the data will downloaded described in described client transmissions, transmission rate proportion in overall transmission rate of packed data; Described client, for issuing downloading task to described server, receive the described packed data of described server transmission and uncompressed data, decompress(ion) reduction is carried out to the packed data received, and the data obtained by decompress(ion) and the uncompressed data that receive are carried out merging and are obtained the described data that will download.
According to the technical scheme of the application, by Real-time Collection client-side performance data, when client has a large amount of management in idle time resource, partial data in the data will download client adopts the mode of compression and unpressed data parallel to be transferred to client, to reduce delivery flow rate, and utilize idle process resource to carry out decompress(ion) reduction to packed data by client, the decompression processing of packed data is distributed to client carry out, effectively make use of the slack resources of client, and improve download efficiency.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide further understanding of the present application, and form a application's part, the schematic description and description of the application, for explaining the application, does not form the improper restriction to the application.In the accompanying drawings:
Fig. 1 is the flow chart of the data download method that the embodiment of the present application one provides;
Fig. 2 is the flow chart of the data download method that the embodiment of the present application two provides;
Fig. 3 is the structured flowchart of the data download apparatus that the embodiment of the present application three provides;
Fig. 4 is the structured flowchart of the data download apparatus that the embodiment of the present application four provides; And
Fig. 5 is the structured flowchart of the data downloading system that the embodiment of the present application five provides.
Embodiment
The main thought of the application is, when the bandwidth of client downloads data reaches bottleneck, and when there is a large amount of management in idle time resource in client, client is transferred to after being compressed by partial data in the data that will download client, utilize idle resource to carry out decompress(ion) reduction to packed data by client, thus the decompression processing of packed data is distributed to client carries out, to adapt to network bandwidth bottleneck, and effectively utilize the slack resources of client, complete transfer of data faster.
Drawings and Examples will be coordinated below to describe the execution mode of the application in detail, by this to the application how application technology means solve technical problem and the implementation procedure reaching technology effect can fully understand and implement according to this.
As employed some vocabulary to censure specific components in the middle of specification and claim.Those skilled in the art should understand, and hardware manufacturer may call same assembly with different noun.This specification and claims are not used as with the difference of title the mode distinguishing assembly, but are used as the criterion of differentiation with assembly difference functionally." comprising " as mentioned in the middle of specification and claim is in the whole text an open language, therefore should be construed to " comprise but be not limited to "." roughly " refer to that in receivable error range, those skilled in the art can solve the technical problem within the scope of certain error, reach described technique effect substantially.In addition, " couple " word and comprise directly any and indirectly electric property coupling means at this.Therefore, if describe a first device in literary composition to be coupled to one second device, then represent described first device and directly can be electrically coupled to described second device, or be indirectly electrically coupled to described second device by other devices or the means that couple.Specification subsequent descriptions is implement the better embodiment of the application, and right described description is for the purpose of the rule that the application is described, and is not used to the scope limiting the application.The protection range of the application is when being as the criterion depending on the claims person of defining.Also it should be noted that, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the commodity of a series of key element or system not only comprises those key elements, but also comprise other key elements clearly do not listed, or also comprise by this commodity or the intrinsic key element of system.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within the commodity or system comprising described key element and also there is other identical element.
embodiment one
Fig. 1 is the flow chart of the data download method according to the embodiment of the present application one, and as shown in Figure 1, the method at least can comprise:
Step S101, when receiving the downloading task from client, gathers the performance data of described client.
Specifically, when receiving the downloading task that client issues, the performance data that server end can initiate to gather client connects, the performance data that Real-time Collection client is current.Wherein, the performance data of described client can comprise: the CPU usage of described client, internal memory remaining space, disk read-write speed and current network bandwidth.
Step S102, according to described performance data, determines the compressed coefficient of the data will downloaded to client described in described client transmissions.
Specifically, during client downloads data, although the wide download of filled band may be there is, the situation of many process resources but client is still left unused, such as, client leaves unused a large amount of CPU not by situation about using, or client disk read-write speed is far beyond the situation of downloading rate, therefore, partial data in data client will be able to downloaded carries out the backward client transmissions of compression process, idle process resource decompress(ion) is utilized to reduce by client, can according to the CPU usage of client, disk read-write speed, client network bandwidth etc. to determine to client transmissions the compressed coefficient during data that this will download.
Wherein, the described compressed coefficient can for during to the data will downloaded described in described client transmissions, transmission rate proportion in overall transmission rate of packed data, namely, during to the data will downloaded described in client transmissions, the bandwidth that transmitted data compressing uses is proportion in client total bandwidth, wherein, described overall transmission rate can for the transmission rate to these data that will download of this client transmissions determined according to the peak transfer rate of this client place network, such as, it can be the peak transfer rate of this client place network, or the maximum download rate that client can reach in current network.
Step S103, according to the compressed coefficient determined, determines the transmission rate of packed data and the transmission rate of uncompressed data during the data to downloading described in described client transmissions.
Particularly, if the compressed coefficient is u, the transmission rate (overall transmission rate) of the data will downloaded to this client transmissions determined is T, and the transmission rate to this client transmissions packed data is t1, transmission rate to the uncompressed data of this client transmissions is t2, then
T＝t1+t2 (1)
t1＝T*u (2)
Such as, network total bandwidth is 6MB/s, a part of network bandwidth can be reserved, determine that overall transmission rate is T=5MB/s, suppose to determine that the compressed coefficient is u=60%, then can determine that the transmission rate (bandwidth taken) to this client transmissions packed data is t1=3MB/s, the transmission rate (bandwidth taken) transmitting uncompressed data is t2=2MB/s.
Step S104, according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, by described client, decompress(ion) reduction is carried out to the packed data in the data received.
Particularly, get a part of data in the data will be able to downloaded at this at random to carry out compressing the packed data processing and obtain, according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, the packed data obtained and the uncompressed data processed without compression are processed respectively to the compression of this client transmissions, by this client, decompress(ion) reduction is carried out to the packed data in the data received, this client can utilize idle process resource, such as CPU, internal memory, hard disks etc. carry out decompress(ion) to the packed data in the data received, be reduced to original data (compressing data before treatment), the original data obtained by decompress(ion) again and the uncompressed data received carry out merging the data obtaining client and will download.So, the decompression processing of packed data has been distributed to client and has carried out, improve message transmission rate during download, and efficiently utilized the slack resources of client.
Wherein, when compression process is carried out to the partial data in the data that will download, partial data can be got at random, compression algorithm general is at present adopted to carry out compression process, suppose that the compression ratio of adopted compression algorithm is c, then adopt compression transmission means transmission speed compared with original transmission means to promote in theory:
△P＝t1/c-t1 (3)
Such as, determine that overall transmission rate is T=5MB/s, the compressed coefficient is u=60%, to the transmission rate t1=3MB/s of this client transmissions packed data, transmit the transmission rate t2=2MB/s of uncompressed data, suppose that the compression ratio of used compression algorithm is for c=75%, then transmission speed can promote 1MB/s compared with original transmission means.
embodiment two
Fig. 2 is the flow chart of the data download method according to the embodiment of the present application two, and the method can be applied in server, and as shown in Figure 2, the method at least can comprise:
Step S201, receives the downloading task from client.
When client is selected to download some data, user end to server issues downloading task, and server receives the downloading task from client.
Step S202, gathers the performance data of described client.
Wherein, the performance data of described client can comprise: the CPU usage of described client, internal memory remaining space, disk read-write speed and current network bandwidth.When receiving the downloading task that client issues, the performance data that server can initiate to gather client connects, and gathers the above-mentioned performance data of client in real time or periodically.
Step S203, according to described performance data, determines whether that the data will downloaded described client carry out compression transmission.
Particularly, according to the performance data such as internal memory remaining space, read or write speed, current CPU usage of this client gathered and the current transmission rate of client or downloading rate, can determine whether that the data will downloaded described client are carried out compression and transmitted.That is, judge whether this client exists idle process resource, can meet requirement packed data being carried out to decompression processing, thus determine whether that the data will downloaded this client carry out compression transmission.
If (that is the ratio of the transmission rate that described client is current or downloading rate and current network peak transfer rate exceed predetermined ratio, shared by these client current transmission data or downloading data, bandwidth proportion in the network bandwidth exceedes predetermined ratio, such as, the situation of the wide download of client filled band), and the current CPU usage of described client is less than predetermined threshold, then determine to carry out compression transmission to the described data that will download.
Alternatively, if according to the performance data of this client gathered, determine that client exists idle process resource, requirement packed data being carried out to decompression processing can be met, then can also send prompting message to described client, to point out client current being applicable to carry out compression transmission, select whether compression is carried out to the data that will download by the user of client and transmit, if user selects to carry out compression transmission, then determine to carry out compression transmission to the described data that will download.Such as, according to the client-side performance data collected, obtain that client is current a large amount of idle CPU, then the mode of compression transmission can be adopted under can pointing out client present case to download.
If determine that the data will downloaded described client carry out compression transmission, then next carry out step S204.If determine not carry out compression transmission to the described data that will download, then step S207 can be carried out.
Step S204, if determine to carry out compression transmission to the described data that will download, then according to described performance data, determines the compressed coefficient during data to downloading described in described client transmissions.
Wherein, the described compressed coefficient can for during to the data will downloaded described in described client transmissions, transmission rate proportion in overall transmission rate of packed data, namely, during to the data will downloaded described in client transmissions, the bandwidth that transmitted data compressing uses is proportion in client total bandwidth, and wherein, described overall transmission rate can for the transmission rate to these data that will download of this client transmissions determined according to the peak transfer rate of this client place network.Compressed coefficient when can to determine to client transmissions according to the CPU usage of client, disk read-write speed, client network bandwidth etc. the data that this will download.
Step S205, according to the compressed coefficient determined, determines the transmission rate of packed data and the transmission rate of uncompressed data during the data to downloading described in described client transmissions.
Particularly, the described compressed coefficient can for during to the data will downloaded described in described client transmissions, transmission rate proportion in overall transmission rate of packed data, then can according to this compressed coefficient, determine the transmission rate of transmitted data compressing and the transmission rate of the uncompressed data of transmission respectively, thus process the packed data that obtains and unpressed data to described client transmissions according to the transmission rate determined by carrying out compressing respectively.
Step S206, according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, by described client, decompress(ion) reduction is carried out to the packed data in the data received.
Specifically, compression algorithm general at present can be adopted to carry out compression process to the partial data in these data that will download and to obtain packed data, and according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, in the packed data obtained to described client transmissions and the described data that will download, do not carry out the uncompressed data compressing process.Client receives this packed data and unpressed data, idle process resource can be utilized to carry out decompress(ion) to the packed data in the data received, be reduced to original data (compressing data before treatment), and the data obtained by decompress(ion) carry out merging the data obtaining this client and will download with the uncompressed data received.
More specifically, can according to the transmission rate of the transmission rate of the packed data determined and uncompressed data, by described packed data and described uncompressed data respectively by different data transmission channels to described client transmissions, thus by different data transmission channels respectively with the transmission rate of the transmission rate of the packed data determined and uncompressed data concurrently to this packed data of client transmissions and uncompressed data, be convenient to client by two data transmission channels receiving compressed data and uncompressed data respectively, identify the packed data received, thus client utilizes idle process resource that the packed data received by packed data transmission channel is carried out decompress(ion) reduction, obtain original data, the original data obtained by decompress(ion) again and the uncompressed data received merge, obtain the data that client will be downloaded.
Step S207, if determine not carry out compression transmission, then directly to the data will downloaded described in described client transmissions to the described data that will download.
Such as, when the network bandwidth taken of client transmissions data is enough large, that is, the current CPU disposal ability, disk read-write speed etc. of client adapts with current transmission speed, not idle process resource can utilize, then be not suitable for carrying out compression transmission to the data that client will be downloaded, can directly to these data that will download of this client transmissions.
Owing to gathering in real time or periodically the performance data of client, therefore, the compressed coefficient is also real-time or periodically variable along with the change of client-side performance data, therefore, according to the process to these data that will download of client transmissions that step S202 ~ S207 carries out, be actually according to client-side performance data, in real time the data transmission procedure of adjustment transmission policy.
Such as, the overall transmission rate determined is T=5MB/s, determining the current compressed coefficient according to the client-side performance data of Real-time Collection is u=60%, then can determine to the transmission rate of this client transmissions packed data be t1=3MB/s, the transmission rate transmitting uncompressed data is t2=2MB/s, subsequent time, user due to client has carried out other operation, the CPU usage of client is caused to increase or the situation such as free memory space minimizing, then also can change according to the determined compressed coefficient of client current performance data, suppose that the compressed coefficient becomes u=50%, the transmission rate then redefined to this client transmissions packed data according to the current compressed coefficient is t1=2.5MB/s, the transmission rate transmitting uncompressed data is t2=2.5MB/s, and with the transmission rate of the transmitted data compressing redefined and the transmission rate transmitting uncompressed data, to this client transmissions packed data and uncompressed data.And spent a period of time, the resource of client more be make use of, and according to the performance data collected, judges that client current state can not meet the demand of packed data being carried out to decompression processing, then can also adjust transmission policy, does not carry out compression transmission.Therefore, the process of the data that the downloading task issued according to client will be downloaded to client transmissions, can perform the process of step S202 ~ S207 for circulation.
embodiment three
Fig. 3 is the structured flowchart of the data download apparatus according to the embodiment of the present application three, and as shown in Figure 3, this device can comprise:
Data acquisition module 301, for when receiving the downloading task that client issues, gathers the performance data of described client.
Wherein, the performance data of described client comprises: the CPU usage of described client, internal memory remaining space, disk read-write speed and current network bandwidth.
First determination module 302, for according to described performance data, determine the compressed coefficient during data will downloaded to client described in described client transmissions, when the described compressed coefficient is the data will downloaded to described client transmissions, transmission rate proportion in overall transmission rate of packed data.
Second determination module 303, for according to the compressed coefficient determined, determines the transmission rate of packed data and the transmission rate of uncompressed data during the data to downloading described in described client transmissions.
Data transmission module 304, for according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, by described client, decompress(ion) reduction is carried out to the packed data in the data received, the packed data decompress(ion) received is reduced to original data (compressing data before treatment) by described client, again the original data obtained and the uncompressed data received are merged, obtain the data that this client will be downloaded.
embodiment four
Fig. 4 is the structured flowchart of the data download apparatus according to the embodiment of the present application four, and according to the embodiment of the present application four, on the basis of embodiment three, data download apparatus can also comprise:
3rd determination module 305, for according to described performance data, determines whether that the data will downloaded described client carry out compression transmission.
Described 3rd determination module 305 can be further used for: if the ratio of the peak transfer rate of the current transmission rate of described client and current network exceedes predetermined ratio, and the current CPU usage of described client is less than predetermined threshold, then determine to carry out compression transmission to the described data that will download.
Alternatively, in the data download apparatus of the application, described data transmission module 304 can be further used for: according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, by described packed data and described uncompressed data respectively by different data transmission channels to described client transmissions, thus by different data transmission channels respectively with the transmission rate of the transmission rate of the packed data determined and uncompressed data concurrently to client transmissions packed data and uncompressed data, be convenient to client by two data transmission channels receiving compressed data and uncompressed data respectively, and identify the packed data received.
embodiment five
Fig. 5 is the structured flowchart of the data downloading system according to the embodiment of the present application five, and as shown in Figure 5, this data downloading system can comprise: server 510 and client 520.
Server 510, for when receiving the downloading task from client 520, gathers the performance data of described client; According to described performance data, determine compressed coefficient when transmitting to client 520 data that described client will download; According to the compressed coefficient determined, the transmission rate of packed data and the transmission rate of uncompressed data when determining to transmit the described data that will download to client 520; According to the transmission rate of the packed data determined and the transmission rate of uncompressed data, transmit to client 520 and the partial data in the described data that will download is carried out compressing the uncompressed data processing in the packed data that obtains and the described data that will download and do not carry out compressing process, wherein, the described compressed coefficient is when transmitting the described data that will download to client 520, transmission rate proportion in overall transmission rate of packed data.
Client 520, for issuing downloading task to server 510, the described packed data that reception server 510 transmits and uncompressed data, decompress(ion) reduction is carried out to the packed data received, and the data obtained by decompress(ion) and the uncompressed data that receive are carried out merging and are obtained the described data that will download.
Particularly, this client 520 receive server transmission described packed data and described uncompressed data after, idle process resource can be utilized, such as CPU, internal memory, hard disk etc. carry out decompress(ion) to the packed data in the data received, be reduced to original data (compressing data before treatment), after data receiver completes, the more original data obtained by decompress(ion) merge with the uncompressed data received, and obtain the data that this client will be downloaded.
So, the decompression processing of packed data has been distributed to client and has carried out, not only increased message transmission rate, and efficiently utilized the slack resources of client.
Device described in the embodiment of the present application three, four, five and the architectural feature of system and the operating procedure of preceding method corresponding, weak point with reference to the aforementioned description to method flow, can repeat no longer one by one.
In sum, according to the technical scheme of the application, by Real-time Collection client-side performance data, when client has a large amount of management in idle time resource, partial data in the data will download client adopts the mode of compression and unpressed data parallel to mix and is transferred to client, and utilize idle process resource to carry out decompress(ion) reduction to packed data by client, the decompression processing of packed data is distributed to client carry out, both the slack resources of client had been efficiently utilized, additionally reduce data transfer throughput, improve download efficiency.
Above-mentioned explanation illustrate and describes some preferred embodiments of the application, but as previously mentioned, be to be understood that the application is not limited to the form disclosed by this paper, should not regard the eliminating to other embodiments as, and can be used for other combinations various, amendment and environment, and can in invention contemplated scope described herein, changed by the technology of above-mentioned instruction or association area or knowledge.And the change that those skilled in the art carry out and change do not depart from the spirit and scope of the application, then all should in the protection range of the application's claims.
Claims (11)
1. a data download method, is characterized in that, comprising:
When receiving the downloading task from client, gather the performance data of described client;
According to described performance data, determine the compressed coefficient of the data will downloaded to client described in described client transmissions, when the described compressed coefficient is the data will downloaded to described client transmissions, transmission rate proportion in overall transmission rate of packed data;
According to the compressed coefficient determined, determine the transmission rate of packed data and the transmission rate of uncompressed data during the data to downloading described in described client transmissions;
According to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, by described client, decompress(ion) reduction is carried out to the packed data in the data received.
2. method according to claim 1, is characterized in that, the performance data of described client comprises: the CPU usage of described client, internal memory remaining space, disk read-write speed and current network bandwidth.
3. method according to claim 1, is characterized in that, according to described performance data, before the step of compressed coefficient when determining the data will downloaded to client described in described client transmissions, also comprises:
According to described performance data, determine whether that the data will downloaded described client carry out compression transmission.
4. method according to claim 3, is characterized in that, according to described performance data, determines whether that the data will downloaded described client carry out compression transmission, comprising:
If the ratio of the peak transfer rate of the transmission rate that described client is current and current network exceedes predetermined ratio, and the current CPU usage of described client is less than predetermined threshold, then determine to carry out compression transmission to the described data that will download.
5. method according to claim 1, it is characterized in that, according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and processes the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, comprising:
According to the transmission rate of the packed data determined and the transmission rate of uncompressed data, by described packed data and described uncompressed data respectively by different data transmission channels to described client transmissions.
6. a data download apparatus, is characterized in that, comprising:
Data acquisition module, for when receiving the downloading task from client, gathers the performance data of described client;
First determination module, for according to described performance data, determine the compressed coefficient of the data will downloaded to client described in described client transmissions, when the described compressed coefficient is the data will downloaded to described client transmissions, transmission rate proportion in overall transmission rate of packed data;
Second determination module, for according to the compressed coefficient determined, determines the transmission rate of packed data and the transmission rate of uncompressed data during the data to downloading described in described client transmissions;
Data transmission module, for according to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, by described client, decompress(ion) reduction is carried out to the packed data in the data received.
7. device according to claim 6, is characterized in that, the performance data of described client comprises: the CPU usage of described client, internal memory remaining space, disk read-write speed and current network bandwidth.
8. device according to claim 6, is characterized in that, also comprises:
3rd determination module, for according to described performance data, determines whether that the data will downloaded described client carry out compression transmission.
9. device according to claim 8, is characterized in that, described 3rd determination module, is further used for:
If the ratio of the peak transfer rate of the transmission rate that described client is current and current network exceedes predetermined ratio, and the current CPU usage of described client is less than predetermined threshold, then determine to carry out compression transmission to the described data that will download.
10. device according to claim 6, is characterized in that, described data transmission module, is further used for:
According to the transmission rate of the packed data determined and the transmission rate of uncompressed data, by described packed data and described uncompressed data respectively by different data transmission channels to described client transmissions.
11. 1 kinds of data downloading systems, is characterized in that, comprising: server and client side,
Described server, for when receiving the downloading task from client, gathers the performance data of described client; According to described performance data, determine the compressed coefficient of the data will downloaded to client described in described client transmissions; According to the compressed coefficient determined, determine the transmission rate of packed data and the transmission rate of uncompressed data during the data to downloading described in described client transmissions; According to the transmission rate of the packed data determined and the transmission rate of uncompressed data, to described client transmissions, compression is carried out to the partial data in the described data that will download and process the uncompressed data not carrying out compressing process in the packed data and the described data that will download obtained, wherein, the described compressed coefficient for during to the data will downloaded described in described client transmissions, transmission rate proportion in overall transmission rate of packed data;
Described client, for issuing downloading task to described server, receive the described packed data of described server transmission and uncompressed data, decompress(ion) reduction is carried out to the packed data received, and the data obtained by decompress(ion) and the uncompressed data that receive are carried out merging and are obtained the described data that will download.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510052223.7A CN104618371A (en) | 2015-01-30 | 2015-01-30 | Data downloading method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510052223.7A CN104618371A (en) | 2015-01-30 | 2015-01-30 | Data downloading method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104618371A true CN104618371A (en) | 2015-05-13 |
Family
ID=53152646
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510052223.7A Pending CN104618371A (en) | 2015-01-30 | 2015-01-30 | Data downloading method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104618371A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045873A (en) * | 2015-07-17 | 2015-11-11 | 深圳市腾讯计算机系统有限公司 | Data file pushing method, apparatus and system |
| CN105068875A (en) * | 2015-08-12 | 2015-11-18 | 浪潮(北京)电子信息产业有限公司 | Intelligence data processing method and apparatus |
| CN109753849A (en) * | 2017-11-03 | 2019-05-14 | 杭州海康威视数字技术股份有限公司 | The method and apparatus for handling video analytic tasks |
| CN110266814A (en) * | 2019-07-09 | 2019-09-20 | 联想(北京)有限公司 | Transmission method and transmitting device |
| CN110601872A (en) * | 2019-08-06 | 2019-12-20 | 联想(北京)有限公司 | Transmission method and device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7299300B2 (en) * | 2004-02-10 | 2007-11-20 | Oracle International Corporation | System and method for dynamically selecting a level of compression for data to be transmitted |
| CN101212311A (en) * | 2006-12-31 | 2008-07-02 | 中国科学院声学研究所 | Cross-network downloading service quality assurance method |
| CN101420670A (en) * | 2008-05-30 | 2009-04-29 | 北京天腾时空信息科技有限公司 | Method and device for terminal content adaptation |
| CN102571820A (en) * | 2012-02-21 | 2012-07-11 | 华为技术有限公司 | Method used for transmitting data, compression server and terminal |
| CN103778258A (en) * | 2014-02-27 | 2014-05-07 | 华为技术有限公司 | Method for sending and receiving data of database, client terminal and server |
-
2015
- 2015-01-30 CN CN201510052223.7A patent/CN104618371A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7299300B2 (en) * | 2004-02-10 | 2007-11-20 | Oracle International Corporation | System and method for dynamically selecting a level of compression for data to be transmitted |
| CN101212311A (en) * | 2006-12-31 | 2008-07-02 | 中国科学院声学研究所 | Cross-network downloading service quality assurance method |
| CN101420670A (en) * | 2008-05-30 | 2009-04-29 | 北京天腾时空信息科技有限公司 | Method and device for terminal content adaptation |
| CN102571820A (en) * | 2012-02-21 | 2012-07-11 | 华为技术有限公司 | Method used for transmitting data, compression server and terminal |
| CN103778258A (en) * | 2014-02-27 | 2014-05-07 | 华为技术有限公司 | Method for sending and receiving data of database, client terminal and server |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045873A (en) * | 2015-07-17 | 2015-11-11 | 深圳市腾讯计算机系统有限公司 | Data file pushing method, apparatus and system |
| CN105068875A (en) * | 2015-08-12 | 2015-11-18 | 浪潮(北京)电子信息产业有限公司 | Intelligence data processing method and apparatus |
| CN109753849A (en) * | 2017-11-03 | 2019-05-14 | 杭州海康威视数字技术股份有限公司 | The method and apparatus for handling video analytic tasks |
| CN110266814A (en) * | 2019-07-09 | 2019-09-20 | 联想(北京)有限公司 | Transmission method and transmitting device |
| CN110601872A (en) * | 2019-08-06 | 2019-12-20 | 联想(北京)有限公司 | Transmission method and device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104618371A (en) | Data downloading method, device and system | |
| CN101453478B (en) | Integrity checking method in document transmission | |
| CN110995513B (en) | Data sending and receiving method in Internet of things system, internet of things equipment and platform | |
| WO2006074064A3 (en) | Method and apparatus for managing data object size in a multi-user environment | |
| WO2006091269A3 (en) | Tool for optimizing system performance and methods relating to same | |
| US20150304441A1 (en) | Data transfer device and data transfer system using adaptive compression algorithm | |
| CN101699822A (en) | File uploading method and device, and mass storage system | |
| CN112615899A (en) | Large file transmission method, device and system | |
| US20170264526A1 (en) | Information collecting apparatus, information analyzing apparatus, and information transferring method based on different internet of things platforms | |
| CN102571820A (en) | Method used for transmitting data, compression server and terminal | |
| Musser et al. | Throughput analysis of an asynchronous code division multiple access (CDMA) system | |
| CN110659151A (en) | Data verification method and device and storage medium | |
| CN103095824A (en) | File uploading control method and system | |
| CN103731476A (en) | Method and device for improving information push speed | |
| CN103068052B (en) | Dynamic resource allocation method, system and Portal server | |
| CN102882960A (en) | Method and device for transmitting resource files | |
| CN102118361A (en) | Method and device for controlling data transmission based on network protocol | |
| CN104123244A (en) | USB redirection system and method | |
| CN104426942A (en) | File uploading method and system | |
| CN104994141A (en) | Cooperative storage system relieving storing and computing pressures of cloud server | |
| CN104038307A (en) | Data stream transmission system and method | |
| CN113630442B (en) | Data transmission method, device and system | |
| CN111881086B (en) | Big data storage method, query method, electronic device and storage medium | |
| CN107179955A (en) | Equipment blocking method and its terminal based on Android containers | |
| CN110266814B (en) | Transmission method and transmission device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20190104 |
|
| AD01 | Patent right deemed abandoned |