CN105376270B - Method, device and system for improving uploading efficiency - Google Patents
Method, device and system for improving uploading efficiency Download PDFInfo
- Publication number
- CN105376270B CN105376270B CN201410392527.3A CN201410392527A CN105376270B CN 105376270 B CN105376270 B CN 105376270B CN 201410392527 A CN201410392527 A CN 201410392527A CN 105376270 B CN105376270 B CN 105376270B
- Authority
- CN
- China
- Prior art keywords
- uploading
- client
- data
- wireless access
- scheduling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention discloses a method, a device and a system for improving uploading efficiency, and belongs to the field of communication. The method is applied to the wireless access equipment in the local area network, and the client in the local area network accesses the Internet through the wireless access equipment, and the method comprises the following steps: intercepting a request of a client for uploading data to a cloud storage server; caching data uploaded by a client locally; sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; and uploading the locally cached data to a cloud storage server according to the scheduling command. The device includes: the device comprises an interception module, a cache module, a service module and an uploading module. The system comprises: the system comprises a client and a wireless access device which are positioned in a local area network and an asynchronous uploading scheduling server which is positioned at a network side. The invention effectively utilizes the uplink bandwidth to reduce resource waste, improves the uploading efficiency and improves the user experience.
Description
Technical Field
The present invention relates to the field of communications, and in particular, to a method, an apparatus, and a system for improving upload efficiency.
Background
With the rapid development of cloud computing and the internet, network-connected clients such as computers, smart phones, tablet computers and the like have exploded growth in enterprises and homes. A large amount of information and resources are generated by a client and uploaded to a cloud storage server through a network, more and more users become network content generators, and the requirement of the users on uploading bandwidth is increased.
At present, the common way for a client to upload a file to a cloud storage server is as follows: FTP (File transfer protocol) mode and Web page mode. In the FTP mode, the client is provided with FTP software which realizes the uploading of files through a built-in FTP protocol. In the Web page mode, the file is uploaded using HTTP (hypertext transfer Protocol).
However, in the current network environment, the downlink bandwidth is generally higher, the uplink bandwidth is generally lower, and the maximum uplink speed is only one eighth of the uplink bandwidth. Therefore, the upload speed of any of the above upload methods is very limited due to the limitation of the network bandwidth, resulting in low upload efficiency. For example, it takes a long time to upload a large-capacity file, and the user not only needs to wait for the file for a long time, but also has a limited use of other network services due to a large amount of upload bandwidth occupied by the upload process, which seriously affects the user experience.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method, an apparatus, and a system for improving upload efficiency, so as to improve upload efficiency. The technical scheme is as follows:
in one aspect, a method for improving uploading efficiency is provided, and is applied to a wireless access device in a local area network, where a client in the local area network accesses the internet through the wireless access device, and the method includes:
intercepting a request of the client for uploading data to a cloud storage server;
caching the data uploaded by the client locally;
sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment;
and uploading the locally cached data to the cloud storage server according to the scheduling command.
On the other hand, an apparatus for improving uploading efficiency is provided, and is applied to a wireless access device in a local area network, where a client in the local area network accesses the internet through the wireless access device, and the apparatus includes:
the acquisition module is used for acquiring a request of the client for uploading data to the cloud storage server;
the cache module is used for caching the data uploaded by the client locally;
the service module is used for sending the request to an asynchronous uploading scheduling server and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment;
and the uploading module is used for uploading the locally cached data to the cloud storage server according to the scheduling command.
In another aspect, a system for improving uploading efficiency is provided, including: the system comprises a client and a wireless access device which are positioned in a local area network, and an asynchronous uploading scheduling server which is positioned at a network side, wherein the client is accessed to the internet through the wireless access device;
the client is used for: sending a request for uploading data and the data to a cloud storage server through the wireless access equipment;
the wireless access device is configured to: intercepting a request of the client for uploading data to the cloud storage server; caching the data uploaded by the client locally; sending the request to the asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; uploading the locally cached data to the cloud storage server according to the scheduling command;
the asynchronous upload scheduling server is configured to: and receiving the request sent by the wireless access equipment, and returning a scheduling command to the wireless access equipment according to the uplink bandwidth use condition of the wireless access equipment.
The technical scheme provided by the embodiment of the invention has the following beneficial effects: intercepting a request of a client for uploading data to a cloud storage server through wireless access equipment in a local area network; caching the data uploaded by the client locally; sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; uploading the locally cached data to the cloud storage server according to the scheduling command; the uploading data of the client is transmitted to the wireless access equipment in the local area network, the transmission speed is high, the occupation of the client on network resources is reduced, the uploading data is cached by the wireless access equipment and then uploaded to the cloud storage server according to the scheduling of the uplink bandwidth use condition according to the asynchronous uploading scheduling server, the uplink bandwidth can be effectively utilized, the resource waste is reduced, the intelligent scheduling is realized, the uploading time of the client is greatly shortened, the uploading efficiency is remarkably improved, the power consumption of the client is saved, and the user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of a method for improving upload efficiency according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for improving upload efficiency according to another embodiment of the present invention;
fig. 3 is a structural diagram of an apparatus for improving uploading efficiency according to another embodiment of the present invention;
fig. 4 is a structural diagram of an apparatus for improving uploading efficiency according to another embodiment of the present invention;
fig. 5 is a block diagram of a wireless access device according to another embodiment of the present invention;
fig. 6 is a diagram illustrating a system for improving uploading efficiency according to another embodiment of the present invention;
fig. 7 is a system configuration diagram for improving the uploading efficiency according to another embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Referring to fig. 1, an embodiment of the present invention provides a method for improving upload efficiency, where the method is applied to a wireless access device in a local area network, and a client in the local area network accesses the internet through the wireless access device, where the method includes:
101: and intercepting a request of the client for uploading data to the cloud storage server.
The local area network may be an enterprise local area network or a home local area network. The clients in the local area network all access the internet through the wireless access device, the number of the clients can be one or more, and the data stream of any client passes through the wireless access device.
In this embodiment, the wireless access device has an independent operating system, such as a Linux system, and the like, can install various applications, can implement functions of controlling bandwidth, number of online users, browsing web pages, online time, and the like, has a USB sharing function, can perform intelligent management on the client, and generally has an internal or external storage device, preferably, an intelligent wireless router, and the like, which is not specifically limited in this embodiment. The wireless access equipment is also provided with a wireless transmitting and receiving device which is used for wireless coverage function so as to provide internet access service for the client. In addition, the wireless access device may also provide a setting portal for setting and managing the wireless access device, and so on, which will not be described herein too much.
The client may be any type of client with wireless communication capabilities, including but not limited to: computers, laptops, PDAs (palmtop), smart phones, tablets, etc.
The cloud storage server is located on the network side and used for storing data.
102: and caching the data uploaded by the client locally.
In this embodiment, the data form uploaded by the client is not limited, and may be pictures, videos, various files, and the like. Generally, when the volume of the uploaded data is large, the client performs fragmentation on the uploaded data and then uploads the data, and meanwhile, the client also generates verification information for each fragmented data, so that the wireless access device can verify whether the uploaded data is correct or not according to the verification information.
The wireless access device in this embodiment has a buffer space, and the size of the buffer space is not limited. Preferably, the cache space is as large as possible, so as to cache data uploaded by the client, especially video files with large capacity and the like. The cache space may be an internal memory, or an external memory, and the like, which is not specifically limited in this embodiment.
Because the client and the wireless access device are positioned in the same local area network, the speed of receiving and caching the uploaded data from the client is high, and the efficiency is high.
103: and sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment.
The asynchronous uploading scheduling server is positioned at a network side, can communicate with a plurality of wireless access devices, is mainly responsible for monitoring the uplink bandwidth use condition of each wireless access device and asynchronously schedules the uploading task of each wireless access device according to the uplink bandwidth use condition.
The asynchronous scheduling is for the client, and means that the uploading task of the client does not need to be uploaded immediately after reaching the wireless access device, and the asynchronous uploading scheduling server determines the uploading time according to the uplink bandwidth use condition of the wireless access device. Therefore, the uploading operation on the client application layer has a certain time difference with the uploading operation actually performed by the wireless access device, and this uploading mode is called asynchronous scheduling.
104: and uploading the locally cached data to the cloud storage server according to the scheduling command.
In this embodiment, optionally, the receiving the scheduling command returned by the asynchronous upload scheduling server according to the uplink bandwidth usage of the wireless access device may include:
and receiving a scheduling command returned by the asynchronous uploading scheduling server after determining that the uplink bandwidth utilization rate of the wireless access equipment is lower than a preset threshold value.
In this embodiment, optionally, the intercepting a request that the client uploads data to the cloud storage server may include:
acquiring a request sent by a client to a network side;
and filtering out a request of the client for uploading data to the cloud storage server from the obtained requests according to a command corresponding to the uploading protocol.
In this embodiment, optionally, the method may further include:
and in the process of uploading the data, the uploaded progress and state information are sent to the asynchronous uploading scheduling server for the client to inquire.
In this embodiment, optionally, the locally cached data is fragment data uploaded by the client, and the method may further include:
checking the fragment data before caching; or, the fragment data is verified before the fragment data is uploaded to the cloud storage server.
In this embodiment, optionally, the method may further include:
and if the local cache space is full or a specified period arrives, deleting the data with the earliest cache time or the data with the lowest access frequency after caching in the cache space.
In the method provided by the embodiment, a request for uploading data to a cloud storage server by a client is intercepted by a wireless access device in a local area network; caching the data uploaded by the client locally; sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; uploading the locally cached data to the cloud storage server according to the scheduling command; the uploading data of the client is transmitted to the wireless access equipment in the local area network, the transmission speed is high, the occupation of the client on network resources is reduced, the uploading data is cached by the wireless access equipment and then uploaded to the cloud storage server according to the scheduling of the uplink bandwidth use condition according to the asynchronous uploading scheduling server, the uplink bandwidth can be effectively utilized, the resource waste is reduced, the intelligent scheduling is realized, the uploading time of the client is greatly shortened, the uploading efficiency is remarkably improved, the power consumption of the client is saved, and the user experience is improved.
Referring to fig. 2, another embodiment of the present invention provides a method for improving upload efficiency, where the method is applied to a wireless access device in a local area network, and a client in the local area network accesses the internet through the wireless access device, and the method includes:
201: and acquiring a request sent by the client to the network side.
The request may be various requests, such as a download request, a request for browsing a web page, a request for uploading a video file, a request for sending an email, and the like. When the request is a request for uploading data to the cloud storage server by the client, the request may include various information, such as an address of the cloud storage server, an uploaded file name, a storage path, a file size, and the like.
202: and filtering out a request of the client for uploading data to the cloud storage server from the intercepted request according to a command corresponding to the uploading protocol.
In this embodiment, the two steps may be implemented by using a deep packet inspection technology. The deep packet inspection technology is to control a service flow according to a combination condition configured by a network. For example, the combination condition may be set as: a post command under HTTP or an upload command under FTP, which intercepts a request and uploaded data when one of them is included in the request of the client.
Take the wireless access device with Linux system as an example. The system kernel has a Network filter architecture, some detection points HOOK are placed at several positions of the whole Network flow, and some processing functions such as packet filtering, NAT (Network Address Translation), user-defined functions and the like are registered at each detection point for processing. The network filtering architecture provides an abstract, generalized framework that defines a set of hook functions for each network protocol (IPv4, IPv6, etc.) that are invoked when a datagram flows through a specified key point of the protocol stack. At each specified key point, acquiring a passed network Packet (Packet) by using a corresponding hook function, comparing the passed network Packet (Packet) with a corresponding rule chain, and determining the operation on the network Packet according to a comparison result: directly putting the network packet back to a protocol stack without processing the network packet, and continuing to submit the network packet to an upper layer; or, the modified data is put back to the protocol stack; or, drop the network packet, and so on. Wherein the modifying may include caching the network packet locally, etc. Through the process, the corresponding processing function is defined according to the uploading protocol, so that the uploading request can be intercepted and captured.
203: and caching the data uploaded by the client locally.
In this embodiment, preferably, the method may further include the following steps:
and if the local cache space is full or a specified period arrives, deleting the data with the earliest cache time or the data with the lowest access frequency after caching in the cache space.
In this embodiment, to save resources and avoid waste, data may be deleted when the local cache space is full, or may be deleted according to a specified period, so as to prevent that new data cannot be cached due to insufficient cache space, or that invalid data occupies the cache space for a long time, which results in resource waste. The access frequency refers to the frequency of accessing the data cached on the wireless access device by the client. When the data is cached on the wireless access device, the client may access the data at any time, and the access may be one time or multiple times, where the number of accesses determines the access frequency, which is not described herein too much.
204: and sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server after determining that the uplink bandwidth utilization rate of the wireless access equipment is lower than a preset threshold value.
In this embodiment, the asynchronous upload scheduling server may monitor an uplink bandwidth usage of the wireless access device, and may calculate an uplink bandwidth usage of the wireless access device according to the monitored uplink bandwidth usage. When the uplink bandwidth utilization rate is lower than a preset threshold value, the wireless access device can be considered to be in an idle state at the moment, and therefore, a scheduling command can be sent to trigger the wireless access device to execute an uploading operation; when the uplink bandwidth utilization rate is not lower than the preset threshold, the wireless access device may be considered to be in a non-idle state at this time, and therefore, the scheduling command is not sent to the wireless access device. The preset threshold may be set to a specific value, such as 10%, 20%, or 30%, as needed, which is not specifically limited in this embodiment.
For example, if the uplink bandwidth utilization calculated by the asynchronous upload scheduling server is 15% and the preset threshold is 20%, it may be determined that the current wireless access device is in an idle state, and therefore, the upload may be performed.
Because the wireless access equipment has the characteristic of being always on line, the idle state of the wireless access equipment can be mastered by monitoring the asynchronous uploading scheduling server, so that the idle state of the wireless access equipment can be fully utilized to execute the uploading operation, the quick uploading can be realized, the uploading efficiency is improved, and the idle uplink bandwidth and the resource waste are effectively reduced.
205: and uploading the locally cached data to the cloud storage server according to the scheduling command.
In this embodiment, optionally, the locally cached data is fragment data uploaded by the client, and the method may further include:
checking the fragment data before caching; or, the fragment data is verified before the fragment data is uploaded to the cloud storage server. When checking before caching, the data is cached after checking is successful; when the data is verified before being uploaded, the data is successfully verified and then uploaded, and therefore the accuracy of the data is guaranteed.
Specifically, the data can be uploaded to the cloud storage server through the uploading interface server. The upload interface server is usually deployed in multiple points to provide upload services in a near-access manner. In addition, the upload interface server may also provide a service of breakpoint continuous transmission, or a service of data verification, and the like, which is not specifically limited in this embodiment. When the uploaded data is verified by the uploading interface server, if the verification is successful, the data is sent to the cloud storage server; and if the verification fails, refusing to upload the data. If the wireless access device has checked the data, the upload interface server may omit the checking step and directly upload the data. And the uploading interface server can also feed back the uploaded result information to the asynchronous uploading scheduling server during uploading so as to facilitate the asynchronous uploading server to record.
During the uploading process, if the client accesses the data being uploaded, the wireless access device can read the data from the cache and return the data to the client.
Generally, after receiving data uploaded by a client, a cloud storage server keeps a copy of the data, where the copy may be one or more copies, so as to ensure the security of the data and facilitate other clients to download the data from the cloud storage server.
206: and in the process of uploading the data, the uploaded progress and state information are sent to the asynchronous uploading scheduling server for the client to inquire.
In this embodiment, when the asynchronous upload scheduling server fails to upload, the asynchronous upload scheduling server may also use a retry principle of binary rollback to control re-upload, which is not described herein. In addition, the asynchronous uploading scheduling server can store the uploading progress and state information after receiving the uploading progress and state information sent by the wireless access equipment, and when the client sends a query request to the asynchronous uploading scheduling server, the client can return the stored uploading progress and state information to the client, so that the client can know the uploading condition in time conveniently.
In this embodiment, the asynchronous upload scheduling server may further send log information such as the upload speed and the upload result to the statistics server, and the statistics server may perform relevant data statistical analysis and the like according to the received information, which is not described herein again.
In this embodiment, the data stored in the cloud storage server may also be downloaded by the client. Specifically, the client can download data from the cloud storage server through the download interface server and other network access interfaces. The download interface server is usually deployed in multiple points, and the client can use the download interface server with the minimum time delay as an access server on the principle of near access.
In the method provided by the embodiment, a request sent by a client to a network side is intercepted by a wireless access device in a local area network; filtering out a request of the client for uploading data to a cloud storage server from the intercepted request according to a command corresponding to an uploading protocol; caching the data uploaded by the client locally; sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server after determining that the uplink bandwidth utilization rate of the wireless access equipment is lower than a preset threshold value; uploading the locally cached data to the cloud storage server according to the scheduling command; the uploading data of the client is transmitted to the wireless access equipment in the local area network, the transmission speed is high, the occupation of the client on network resources is reduced, the uploading data is cached by the wireless access equipment and then uploaded to the cloud storage server according to the scheduling of the uplink bandwidth use condition according to the asynchronous uploading scheduling server, the uplink bandwidth can be effectively utilized, the resource waste is reduced, the intelligent scheduling is realized, the uploading time of the client is greatly shortened, the uploading efficiency is remarkably improved, the power consumption of the client is saved, and the user experience is improved. In addition, in the process of uploading the data, the uploaded progress and state information are sent to the asynchronous uploading scheduling server, so that the client can check the uploaded progress and state information at any time, and the asynchronous uploading scheduling server is convenient and flexible to use.
Referring to fig. 3, another embodiment of the present invention provides an apparatus for improving upload efficiency, where the apparatus is applied to a wireless access device in a local area network, and a client in the local area network accesses the internet through the wireless access device, and the apparatus includes:
an intercepting module 301, configured to intercept a request for the client to upload data to the cloud storage server;
a cache module 302, configured to cache the data uploaded by the client locally;
a service module 303, configured to send the request to an asynchronous upload scheduling server, and receive a scheduling command returned by the asynchronous upload scheduling server according to the uplink bandwidth usage of the wireless access device;
an uploading module 304, configured to upload the locally cached data to the cloud storage server according to the scheduling command.
In this embodiment, optionally, the service module 303 may include:
a sending unit, configured to send the request to an asynchronous upload scheduling server;
and the receiving unit is used for receiving a scheduling command returned by the asynchronous uploading scheduling server after the uplink bandwidth utilization rate of the wireless access equipment is determined to be lower than a preset threshold value.
In this embodiment, optionally, the interception module 301 may include:
the acquisition unit is used for acquiring a request sent by a client to a network side;
and the filtering unit is used for filtering out the request of the client for uploading data to the cloud storage server from the acquired requests according to the command corresponding to the uploading protocol.
In this embodiment, optionally, the service module 303 is further configured to:
and in the process of uploading the data, the uploaded progress and state information are sent to the asynchronous uploading scheduling server for the client to inquire.
Referring to fig. 4, in this embodiment, optionally, the data cached by the caching module 302 is fragmented data uploaded by the client, and the apparatus may further include:
a checking module 305, configured to check the fragmented data before caching; or, the fragment data is verified before the fragment data is uploaded to the cloud storage server.
Referring to fig. 4, in the present embodiment, optionally, the apparatus may further include:
a deleting module 306, configured to delete the data with the earliest caching time or the data with the lowest access frequency after caching in the local cache space if the local cache space is full or a specified period arrives.
The device provided in this embodiment may perform the method provided in any of the above method embodiments, and the detailed process is described in the method embodiments and is not described herein again. The above apparatus may be located in a wireless access device.
In the apparatus provided in this embodiment, a request for uploading data to a cloud storage server from a client is intercepted by a wireless access device in a local area network; caching the data uploaded by the client locally; sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; uploading the locally cached data to the cloud storage server according to the scheduling command; the uploading data of the client is transmitted to the wireless access equipment in the local area network, the transmission speed is high, the occupation of the client on network resources is reduced, the uploading data is cached by the wireless access equipment and then uploaded to the cloud storage server according to the scheduling of the uplink bandwidth use condition according to the asynchronous uploading scheduling server, the uplink bandwidth can be effectively utilized, the resource waste is reduced, the intelligent scheduling is realized, the uploading time of the client is greatly shortened, the uploading efficiency is remarkably improved, the power consumption of the client is saved, and the user experience is improved.
Another embodiment of the present invention provides a wireless access device, which can be used to perform the method for improving the uploading efficiency provided in the foregoing embodiments. Referring to fig. 5, the wireless access device 1900 may vary widely in configuration or performance and may include one or more Central Processing Units (CPUs) 1922 (e.g., one or more processors) and memory 1932, one or more storage media 1930 (e.g., one or more mass storage devices) storing applications 1942 or data 1944. Memory 1932 and storage medium 1930 can be, among other things, transient or persistent storage. The program stored in storage medium 1930 may include one or more modules (not shown), each of which may include a sequence of instructions for operating on the wireless access device. Still further, the central processor 1922 may be configured to communicate with the storage medium 1930 to perform a series of instruction operations in the storage medium 1930 on the wireless access device 1900.
The wireless access device 1900 may also include one or more power supplies 1926, one or more wired or wireless network interfaces 1950, one or more input-output interfaces 1958, and/or one or more operating systems 1941, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
In particular in the present embodiment, execution of the one or more programs by one or more processors includes instructions for:
intercepting a request of a client for uploading data to a cloud storage server;
caching the data uploaded by the client locally;
sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment;
uploading the locally cached data to the cloud storage server according to the scheduling command;
the client and the wireless access device are located in the same local area network, and the client is accessed to the internet through the wireless access device.
Optionally, the receiving the scheduling command returned by the asynchronous upload scheduling server according to the uplink bandwidth usage of the wireless access device includes:
and receiving a scheduling command returned by the asynchronous uploading scheduling server after determining that the uplink bandwidth utilization rate of the wireless access equipment is lower than a preset threshold value.
Optionally, the intercepting a request that the client uploads data to the cloud storage server includes:
acquiring a request sent by a client to a network side;
and filtering the request of the client for uploading data to the cloud storage server from the acquired requests according to the command corresponding to the uploading protocol.
Optionally, the method further includes:
and in the process of uploading the data, sending the uploaded progress and state information to the asynchronous uploading scheduling server for the client to inquire.
Optionally, the locally cached data is fragmented data uploaded by the client, and the method further includes:
checking the fragment data before caching; or verifying the fragment data before uploading the fragment data to the cloud storage server.
Optionally, the method further includes:
and if the local cache space is full or a specified period arrives, deleting the data with the earliest cache time or the data with the lowest access frequency after caching in the cache space.
In the wireless access device provided by this embodiment, a request for uploading data to a cloud storage server from a client is intercepted by the wireless access device in a local area network; caching the data uploaded by the client locally; sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; uploading the locally cached data to the cloud storage server according to the scheduling command; the uploading data of the client is transmitted to the wireless access equipment in the local area network, the transmission speed is high, the occupation of the client on network resources is reduced, the uploading data is cached by the wireless access equipment and then uploaded to the cloud storage server according to the scheduling of the uplink bandwidth use condition according to the asynchronous uploading scheduling server, the uplink bandwidth can be effectively utilized, the resource waste is reduced, the intelligent scheduling is realized, the uploading time of the client is greatly shortened, the uploading efficiency is remarkably improved, the power consumption of the client is saved, and the user experience is improved.
An embodiment of the present invention provides a non-volatile readable storage medium, where one or more modules (programs) are stored in the storage medium, and when the one or more modules are applied in a wireless access device, the instructions (instructions) may cause the wireless access device to perform the following steps:
intercepting a request of a client for uploading data to a cloud storage server;
caching the data uploaded by the client locally;
sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment;
uploading the locally cached data to the cloud storage server according to the scheduling command;
the client and the wireless access device are located in the same local area network, and the client is accessed to the internet through the wireless access device.
Optionally, the receiving the scheduling command returned by the asynchronous upload scheduling server according to the uplink bandwidth usage of the wireless access device includes:
and receiving a scheduling command returned by the asynchronous uploading scheduling server after determining that the uplink bandwidth utilization rate of the wireless access equipment is lower than a preset threshold value.
Optionally, the intercepting a request that the client uploads data to the cloud storage server includes:
acquiring a request sent by a client to a network side;
and filtering the request of the client for uploading data to the cloud storage server from the acquired requests according to the command corresponding to the uploading protocol.
Optionally, the wireless access device may further execute the following steps:
and in the process of uploading the data, sending the uploaded progress and state information to the asynchronous uploading scheduling server for the client to inquire.
Optionally, the locally cached data is fragmented data uploaded by the client, and the method further includes:
checking the fragment data before caching; or verifying the fragment data before uploading the fragment data to the cloud storage server.
Optionally, the wireless access device may further execute the following steps:
and if the local cache space is full or a specified period arrives, deleting the data with the earliest cache time or the data with the lowest access frequency after caching in the cache space.
In the nonvolatile readable storage medium provided by this embodiment, a request for uploading data to a cloud storage server by a client is intercepted by a wireless access device in a local area network; caching the data uploaded by the client locally; sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; uploading the locally cached data to the cloud storage server according to the scheduling command; the uploading data of the client is transmitted to the wireless access equipment in the local area network, the transmission speed is high, the occupation of the client on network resources is reduced, the uploading data is cached by the wireless access equipment and then uploaded to the cloud storage server according to the scheduling of the uplink bandwidth use condition according to the asynchronous uploading scheduling server, the uplink bandwidth can be effectively utilized, the resource waste is reduced, the intelligent scheduling is realized, the uploading time of the client is greatly shortened, the uploading efficiency is remarkably improved, the power consumption of the client is saved, and the user experience is improved.
Referring to fig. 6, another embodiment of the present invention further provides a system for improving uploading efficiency, including: a client 601 and a wireless access device 602 located in a local area network, and an asynchronous upload scheduling server 603 located on a network side, wherein the client 601 accesses the internet through the wireless access device 602;
the client 601 is configured to: sending a request for uploading data and the data to a cloud storage server through the wireless access equipment;
the wireless access device 602 is configured to: intercepting a request of the client for uploading data to the cloud storage server; caching the data uploaded by the client locally; sending the request to the asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; uploading the locally cached data to the cloud storage server according to the scheduling command;
the asynchronous upload scheduling server 603 is configured to: and receiving the request sent by the wireless access equipment, and returning a scheduling command to the wireless access equipment according to the uplink bandwidth use condition of the wireless access equipment.
In this embodiment, optionally, the asynchronous upload scheduling server 603 may include:
a receiving module, configured to receive the request sent by the wireless access device;
and the scheduling module is used for returning a scheduling command to the wireless access equipment after determining that the uplink bandwidth utilization rate of the wireless access equipment is lower than a preset threshold value.
In this embodiment, optionally, the wireless access device 602 is further configured to: in the process of uploading the data, the uploaded progress and state information are sent to the asynchronous uploading scheduling server;
the asynchronous upload scheduling server 603 is further configured to: and receiving the uploading progress and state information sent by the wireless access equipment, and sending the uploading progress and state information to the client when the client sends a query request.
Referring to fig. 7, a schematic diagram of a system for improving upload efficiency according to another embodiment of the present invention is shown. The client 701 and the wireless access device 702 are located in the same local area network, and a plurality of clients 701 may access the internet through the wireless access devices 702. When the client 701 sends a request for uploading data, the wireless access device 702 intercepts the request and forwards the request to the asynchronous upload scheduling server 703, and at the same time, caches the uploaded data locally. After receiving the request, the asynchronous upload scheduling server 703 sends a scheduling command to the wireless access device 702 according to the uplink bandwidth usage of the wireless access device 702. After receiving the scheduling command, the wireless access device 702 uploads the cached data to the cloud storage server 705 through the upload interface server 704 for storage, thereby completing the upload process. In addition, the asynchronous upload scheduling server 703 may also send information such as the upload progress and result to the statistics server 706, so that the statistics server 706 performs corresponding analysis and statistics. The data stored by the cloud storage server 705 can also be provided to other clients for downloading. The client 709 may be a client in another lan, or may be a client located in the same lan as the client 701. When the client 709 accesses the network through the other network access interface 708, the data can be downloaded from the cloud storage server 705 through the download interface server 707, thereby completing the download process.
In the system provided by this embodiment, a request for uploading data to the cloud storage server from the client is intercepted by the wireless access device in the local area network; caching the data uploaded by the client locally; sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; uploading the locally cached data to the cloud storage server according to the scheduling command; the uploading data of the client is transmitted to the wireless access equipment in the local area network, the transmission speed is high, the occupation of the client on network resources is reduced, the uploading data is cached by the wireless access equipment and then uploaded to the cloud storage server according to the scheduling of the uplink bandwidth use condition according to the asynchronous uploading scheduling server, the uplink bandwidth can be effectively utilized, the resource waste is reduced, the intelligent scheduling is realized, the uploading time of the client is greatly shortened, the uploading efficiency is remarkably improved, the power consumption of the client is saved, and the user experience is improved.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a non-volatile readable storage medium, which may be a read-only memory, a magnetic or optical disk, or the like.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (8)
1. A method for improving uploading efficiency is applied to a wireless access device in a local area network, and a client in the local area network accesses the Internet through the wireless access device, and the method comprises the following steps:
acquiring a request sent by the client to a network side by adopting a deep packet inspection technology;
filtering a request of the client for uploading data to a cloud storage server from the obtained request by adopting a deep packet inspection technology according to a command corresponding to an uploading protocol;
caching the data uploaded by the client locally;
sending the request to an asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server after determining that the uplink bandwidth utilization rate of the wireless access equipment is lower than a preset threshold value;
uploading the locally cached data to the cloud storage server according to the scheduling command;
and in the process of uploading the data, sending the uploaded progress and state information to the asynchronous uploading scheduling server so that the asynchronous uploading scheduling server stores the uploaded progress and state information, and returning the stored uploaded progress and state information to the client when the client sends a query request.
2. The method according to claim 1, wherein the locally cached data is fragmented data uploaded by the client, and the method further comprises:
checking the fragment data before caching; or verifying the fragment data before uploading the fragment data to the cloud storage server.
3. The method of claim 1, further comprising:
and if the local cache space is full or a specified period arrives, deleting the data with the earliest cache time or the data with the lowest access frequency after caching in the cache space.
4. An apparatus for improving uploading efficiency, the apparatus being applied to a wireless access device in a local area network, a client in the local area network accessing the internet through the wireless access device, the apparatus comprising:
the intercepting module comprises an acquiring unit and a filtering unit;
the acquiring unit is used for acquiring a request sent by a client to a network side by adopting a deep packet inspection technology;
the filtering unit is used for filtering a request of the client for uploading data to the cloud storage server from the request acquired by the acquiring unit according to a command corresponding to an uploading protocol by adopting a deep packet inspection technology;
the cache module is used for caching the data uploaded by the client locally;
the service module comprises a sending unit and a receiving unit;
the sending unit is used for sending the request to an asynchronous uploading scheduling server;
the receiving unit is configured to receive a scheduling command returned by the asynchronous upload scheduling server after determining that the uplink bandwidth utilization of the wireless access device is lower than a preset threshold;
the uploading module is used for uploading the locally cached data to the cloud storage server according to the scheduling command;
the service module is further configured to send the uploaded progress and state information to the asynchronous uploading scheduling server in the process of uploading the data, so that the asynchronous uploading scheduling server stores the uploaded progress and state information, and when the client sends a query request, the stored uploaded progress and state information is returned to the client.
5. The apparatus according to claim 4, wherein the data cached by the caching module is fragmented data uploaded by the client, and the apparatus further comprises:
the checking module is used for checking the fragment data before caching; or verifying the fragment data before uploading the fragment data to the cloud storage server.
6. The apparatus of claim 4, further comprising:
and the deleting module is used for deleting the data with the earliest caching time or the data with the lowest access frequency after caching in the cache space if the local cache space is full or a specified period arrives.
7. A system for improving upload efficiency, comprising: the system comprises a client and a wireless access device which are positioned in a local area network, and an asynchronous uploading scheduling server which is positioned at a network side, wherein the client is accessed to the internet through the wireless access device;
the client is used for: sending a request for uploading data and the data to a cloud storage server through the wireless access equipment;
the wireless access device is configured to: acquiring a request sent by the client to a network side by adopting a deep packet inspection technology; filtering a request of the client for uploading data to a cloud storage server from the obtained request by adopting a deep packet inspection technology according to a command corresponding to an uploading protocol; sending the request to the asynchronous uploading scheduling server, and receiving a scheduling command returned by the asynchronous uploading scheduling server according to the uplink bandwidth use condition of the wireless access equipment; uploading the locally cached data to the cloud storage server according to the scheduling command;
the asynchronous uploading scheduling server comprises a receiving module and a scheduling module;
the receiving module is configured to receive the request sent by the wireless access device;
the scheduling module is used for returning a scheduling command to the wireless access equipment after determining that the uplink bandwidth utilization rate of the wireless access equipment is lower than a preset threshold value;
the wireless access equipment is also used for sending the uploaded progress and state information to the asynchronous uploading scheduling server in the process of uploading the data;
the asynchronous uploading scheduling server is further configured to receive the uploading progress and state information sent by the wireless access device, store the uploading progress and state information, and send the stored uploading progress and state information to the client when the client sends the query request.
8. A terminal, characterized in that the terminal comprises one or more central processing units and a memory, the memory stores one or more programs, and the programs are loaded and executed by the processors to realize the operations executed by the method for improving uploading efficiency according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410392527.3A CN105376270B (en) | 2014-08-11 | 2014-08-11 | Method, device and system for improving uploading efficiency |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410392527.3A CN105376270B (en) | 2014-08-11 | 2014-08-11 | Method, device and system for improving uploading efficiency |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105376270A CN105376270A (en) | 2016-03-02 |
| CN105376270B true CN105376270B (en) | 2020-04-24 |
Family
ID=55378074
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410392527.3A Active CN105376270B (en) | 2014-08-11 | 2014-08-11 | Method, device and system for improving uploading efficiency |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105376270B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105975484A (en) * | 2016-04-25 | 2016-09-28 | 乐视控股（北京）有限公司 | File management method and apparatus |
| CN105978984A (en) * | 2016-05-30 | 2016-09-28 | 北京小米移动软件有限公司 | Method and device used for synchronizing images |
| CN108228384A (en) * | 2016-12-22 | 2018-06-29 | 北京奇虎科技有限公司 | A kind of method and apparatus of backup enterprise terminal data |
| CN107517308A (en) * | 2017-08-07 | 2017-12-26 | 惠州Tcl移动通信有限公司 | Application program for mobile terminal abnormal detection method, storage device and mobile terminal |
| CN107517261A (en) * | 2017-08-31 | 2017-12-26 | 深圳市中兴物联科技有限公司 | Gateway, server, method, apparatus, storage medium and Internet of things system |
| CN107454621A (en) * | 2017-09-13 | 2017-12-08 | 凌云天博光电科技股份有限公司 | A kind of management system of lan device |
| CN107895255A (en) * | 2017-11-02 | 2018-04-10 | 成都金川田农机制造有限公司 | Science and technology item declares tracking system |
| CN109714415B (en) * | 2018-12-26 | 2021-09-21 | 北京小米移动软件有限公司 | Data processing method and device |
| CN110933138A (en) * | 2019-10-31 | 2020-03-27 | 北京浪潮数据技术有限公司 | Mirror image uploading method, device, equipment and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101014161A (en) * | 2005-11-03 | 2007-08-08 | 乐金电子(中国)研究开发中心有限公司 | Method for uploading multimedia message and mobile communication terminal, multimedia messaging service proxy relay, mobile communication system therefor |
| KR20110037008A (en) * | 2009-10-05 | 2011-04-13 | 엘지이노텍 주식회사 | Wireless router for files sharing |
| CN103095605A (en) * | 2013-01-25 | 2013-05-08 | 电子科技大学 | Data transmission method and system capable of fusing router in mobile internet of things |
| CN202940973U (en) * | 2012-07-26 | 2013-05-15 | 深圳市乙辰科技发展有限公司 | Wireless router |
| CN103582185A (en) * | 2012-07-26 | 2014-02-12 | 深圳市乙辰科技发展有限公司 | Wireless router |
| CN103944972A (en) * | 2014-04-02 | 2014-07-23 | 深圳市中博科创信息技术有限公司 | Method and gateway for uploading and downloading data |
-
2014
- 2014-08-11 CN CN201410392527.3A patent/CN105376270B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101014161A (en) * | 2005-11-03 | 2007-08-08 | 乐金电子(中国)研究开发中心有限公司 | Method for uploading multimedia message and mobile communication terminal, multimedia messaging service proxy relay, mobile communication system therefor |
| KR20110037008A (en) * | 2009-10-05 | 2011-04-13 | 엘지이노텍 주식회사 | Wireless router for files sharing |
| CN202940973U (en) * | 2012-07-26 | 2013-05-15 | 深圳市乙辰科技发展有限公司 | Wireless router |
| CN103582185A (en) * | 2012-07-26 | 2014-02-12 | 深圳市乙辰科技发展有限公司 | Wireless router |
| CN103095605A (en) * | 2013-01-25 | 2013-05-08 | 电子科技大学 | Data transmission method and system capable of fusing router in mobile internet of things |
| CN103944972A (en) * | 2014-04-02 | 2014-07-23 | 深圳市中博科创信息技术有限公司 | Method and gateway for uploading and downloading data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105376270A (en) | 2016-03-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105376270B (en) | Method, device and system for improving uploading efficiency | |
| US10725826B1 (en) | Serializing duration-limited task executions in an on demand code execution system | |
| US10445140B1 (en) | Serializing duration-limited task executions in an on demand code execution system | |
| US9516091B2 (en) | Web page script management | |
| US8984058B2 (en) | Pre-fetching remote resources | |
| GB2500327B (en) | Optimization of resource polling intervals to satisfy mobile device requests | |
| CN113010818B (en) | Access current limiting method, device, electronic equipment and storage medium | |
| KR101227769B1 (en) | Mobile network background traffic data management with optimized polling intervals | |
| CA2798523C (en) | Aligning data transfer to optimize connections established for transmission over a wireless network | |
| KR102292471B1 (en) | Dynamic cache allocation and network management | |
| JP2016533594A (en) | WEB PAGE ACCESS METHOD, WEB PAGE ACCESS DEVICE, ROUTER, PROGRAM, AND RECORDING MEDIUM | |
| US10404603B2 (en) | System and method of providing increased data optimization based on traffic priority on connection | |
| WO2014011216A1 (en) | Dynamic bandwidth adjustment for browsing or streaming activity in a wireless network based on prediction of user behavior when interacting with mobile applications | |
| US10599529B2 (en) | Instantiating data queues for management of remote data stores | |
| CN107491320A (en) | Loading method and device based on mixed mode Mobile solution | |
| CN106027595A (en) | Access log processing method and system for CDN node | |
| US20150026325A1 (en) | Notification normalization | |
| US20170153909A1 (en) | Methods and Devices for Acquiring Data Using Virtual Machine and Host Machine | |
| US11233823B1 (en) | Efficient implementation of honeypot devices to detect wide-scale network attacks | |
| Hou et al. | Understanding I/O performance behaviors of cloud storage from a client’s perspective | |
| EP3369238B1 (en) | Method, apparatus, computer-readable medium and computer program product for cloud file processing | |
| US9307025B1 (en) | Optimized file creation in WAN-optimized storage | |
| US11397711B1 (en) | Proxy-based database scaling | |
| US9342460B2 (en) | I/O write request handling in a storage system | |
| Li et al. | Characterizing service providers traffic of mobile internet services in cellular data network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |