CN115150385A

CN115150385A - Data processing method, device, system, terminal and server

Info

Publication number: CN115150385A
Application number: CN202110352803.3A
Authority: CN
Inventors: 李强; 韩丹
Original assignee: Xian Novastar Electronic Technology Co Ltd
Current assignee: Xian Novastar Electronic Technology Co Ltd
Priority date: 2021-03-31
Filing date: 2021-03-31
Publication date: 2022-10-04

Abstract

The invention discloses a data processing method, a device, a system, a terminal and a server. Wherein, the method comprises the following steps: determining the size of data to be downloaded; sending a downloading request to a remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value, wherein the downloading request is used for requesting the remote server to perform compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet; the first compressed data packet is downloaded from the remote server. The invention solves the technical problem of low downloading efficiency when the data to be downloaded is downloaded in the related technology.

Description

Data processing method, device, system, terminal and server

Technical Field

The present invention relates to the field of data processing, and in particular, to a data processing method, apparatus, system, terminal, and server.

Background

At present, data downloading in various systems and web pages has been applied more, and most of them adopt direct local downloading of selected data, for example, data selected in batches can be directly downloaded locally from different systems and web pages. However, when the above-mentioned direct local downloading method is used to download batch data, when there are more selected data and data are larger, more local resources will be occupied, and problems such as stuttering and long time delay will occur in the downloading process, thus resulting in lower downloading efficiency.

In view of the above problems, no effective solution has been proposed.

Disclosure of Invention

The embodiment of the invention provides a data processing method, a device, a system, a terminal and a server, which are used for at least solving the technical problem of low downloading efficiency when data to be downloaded is downloaded in the related technology.

According to an aspect of the embodiments of the present invention, there is also provided a data processing method, including: determining the size of data to be downloaded; sending a downloading request to a remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value, wherein the downloading request is used for requesting the remote server to perform compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet; downloading the first compressed data packet from the remote server.

Optionally, the method further comprises: and under the condition that the size of the data to be downloaded is smaller than the preset threshold value, compressing and downloading the data to be downloaded through local client equipment according to a file directory structure to obtain a second compressed data packet.

Optionally, compressing and downloading the data to be downloaded by the local client device according to the file directory structure to obtain a second compressed data packet, including: selecting a file included in a first folder in the data to be downloaded through local client equipment, and acquiring a first upper-lower level relation between the files; simulating a first file directory structure of the first folder according to the first upper-lower level relation; and compressing and downloading the files included in the first folder and the first file directory structure together to obtain the second compressed data packet.

Optionally, downloading the first compressed data packet from the remote server includes: receiving a storage address of the first compressed data packet sent by the remote server; and downloading the first compressed data packet from the remote server according to the storage address.

Optionally, after downloading the first compressed data packet from the remote server, the method further includes: and sending a deletion notification message to the remote server, wherein the deletion notification message is used for notifying the remote server to delete the first compressed data packet.

According to another aspect of the embodiments of the present invention, there is also provided a data processing method, including: receiving a downloading request; responding to the downloading request, and performing compression downloading on data to be downloaded according to a file directory structure to obtain a first compression data packet, wherein the size of the data to be downloaded is larger than or equal to a preset threshold value; sending a download notification to the client device, wherein, the download notification is used for notifying the client device to download the first compressed data packet.

Optionally, compressing and downloading the data to be downloaded according to the file directory structure to obtain a first compressed data packet, including: selecting a file included in a second folder in the data to be downloaded, and acquiring a second upper-lower level relation between the files; simulating a second file directory structure of the second folder according to the second superior-inferior relation; and compressing and downloading the files included in the second folder and the second file directory structure together to obtain the first compressed data packet.

Optionally, the download notification carries a storage address of the first compressed data packet, where the storage address is used for the client device to download the first compressed data packet.

Optionally, after sending the download notification to the client device, the method further includes: receiving a deletion notification message sent by the client device; and deleting the first compressed data packet according to the deletion notification message.

According to another aspect of the embodiments of the present invention, there is also provided a data processing method, including: the method comprises the steps that local client equipment determines the size of data to be downloaded and sends a downloading request to a remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value; the remote server responds to the downloading request, carries out compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet, and sends a downloading notification to the local client device; the local client device receives the download notification and downloads the first compressed data packet from the remote server.

According to still another aspect of the embodiments of the present invention, there is also provided a data processing apparatus including: the first determining module is used for determining the size of the data to be downloaded; the device comprises a first sending module, a second sending module and a third sending module, wherein the first sending module is used for sending a downloading request to a remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value, and the downloading request is used for requesting the remote server to perform compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet; and the first downloading module is used for downloading the first compressed data packet from the remote server.

According to still another aspect of the embodiments of the present invention, there is also provided a data processing apparatus including: the first receiving module is used for receiving a downloading request; the second downloading module is used for responding to the downloading request, and performing compression downloading on data to be downloaded according to a file directory structure to obtain a first compression data packet, wherein the size of the data to be downloaded is larger than or equal to a preset threshold value; and the second sending module is used for sending a downloading notification to the client device, wherein the downloading notification is used for notifying the client device to download the first compressed data packet.

According to still another aspect of the embodiments of the present invention, there is provided a data processing system including: the system comprises local client equipment and a remote server, wherein the local client equipment is used for determining the size of data to be downloaded and sending a downloading request to the remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value; the remote server is used for responding to the downloading request, performing compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet, and sending a downloading notification to the local client device; the local client device is further configured to receive the download notification and download the first compressed data packet from the remote server.

According to another aspect of the embodiments of the present invention, there is also provided a terminal, including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement the data processing method of any one of claims 1 to 4.

According to still another aspect of the embodiments of the present invention, there is also provided a server, including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement the data processing method of any of claims 5 to 7.

According to yet another aspect of embodiments of the present invention, there is also provided a computer-readable storage medium, in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform the data processing method according to any one of the above.

According to yet another aspect of the embodiments of the present invention, there is also provided a computer program product, including a computer program, characterized in that the computer program realizes any of the above data processing methods when executed by a processor.

In the embodiment of the invention, by judging the size of the data to be downloaded, when the size is larger than or equal to the preset threshold value, the remote server is adopted to compress and download, and then the compressed packet is downloaded from the remote server. The problem that the downloading efficiency is influenced by overlarge consumption of local client resources when the downloaded data is large is effectively solved, so that the effects of saving the local resources and improving the downloading efficiency are achieved. In addition, the downloaded compressed package comprises a file directory structure, so that the integrity of file information is ensured, and the data downloading experience of a user is effectively improved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention and do not constitute a limitation of the invention. In the drawings:

FIG. 1 is a flow chart of a first data processing method according to embodiment 1 of the present invention;

FIG. 2 is a flowchart of a second data processing method according to embodiment 1 of the present invention;

FIG. 3 is a flowchart of a third data processing method according to embodiment 1 of the present invention

FIG. 4 is a flow diagram of a method of web local client data processing in accordance with an alternative embodiment of the present invention;

fig. 5 is a block diagram of a first configuration of a data processing apparatus according to embodiment 2 of the present invention;

FIG. 6 is a block diagram showing a second data processing apparatus according to embodiment 3 of the present invention;

FIG. 7 is a block diagram of a data processing system according to embodiment 4 of the present invention

FIG. 8 is a block diagram illustrating the structure of a terminal according to one exemplary embodiment;

fig. 9 is a block diagram illustrating a configuration of a server according to an example embodiment.

Detailed Description

In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

First, some terms or terms appearing in the description of the embodiments of the present application are applicable to the following explanations:

world Wide Web (simply "Web"): the global wide area network, also known as the world wide web, is a hypertext and HTTP based, global, dynamically interactive, cross-platform, distributed graphical information system. The network service is built on the Internet, provides a graphical and easily-accessible visual interface for a browser to search and browse information on the Internet, and documents and hyperlinks organize information nodes on the Internet into a mutually-associated mesh structure.

JavaScript (abbreviated as "JS"): is a lightweight, interpreted or just-in-time programming language with function precedence. Although it is named as a scripting language for developing Web pages, it is also used in many non-browser environments, javaScript is based on prototypical programming, multi-modal dynamic scripting languages, and supports object-oriented, imperative, and declarative (e.g., functional programming) styles.

WebAssembly (abbreviated as "Wasm"): is a binary instruction format for stack-based virtual machines, wasm is designed as a portable compilation target for programming languages that support deploying client and server applications on the web.

Chrome (also known as Chrome Google "): the web browser developed by Google corporation is based on other open source software, including web toolkit (abbreviated as "WebKit"), and aims to improve stability, speed and security and create a simple and efficient user interface.

V8: open source high performance JavaScript and a Web Assembly engine in Google are written by using c + + language. Js for Chrome and node, etc.

Js: the JavaScript running environment constructed based on the V8 JavaScript engine is used for conveniently building network application which is high in response speed and easy to expand.

B, blob: js constructor method name, object represents a class file object of the immutable, original data. Its data can be read in text or binary format.

Example 1

In accordance with an embodiment of the present invention, there is provided a method embodiment of data processing, it being noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than here.

Fig. 1 is a flowchart of a first data processing method according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:

step S102, determining the size of data to be downloaded;

step S104, when the size of the data to be downloaded is larger than or equal to a preset threshold value, a downloading request is sent to a remote server, wherein the downloading request is used for requesting the remote server to perform compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet;

step S106, downloading the first compressed data packet from the remote server.

Through the steps, the local client device compresses and downloads the data to be downloaded by adopting the remote server when the size of the data to be downloaded is larger than or equal to the preset threshold value, and then downloads the compressed packet from the remote server. The problem that when the download data is large, the resource consumption of local client equipment is too large, and the download efficiency is affected is effectively solved, so that the effects of saving the local resource and improving the download efficiency are achieved. In addition, the downloaded compressed package comprises a file directory structure, so that the integrity of file information is ensured, and the data downloading experience of a user is effectively improved.

As an optional embodiment, before determining the size of the data to be downloaded, selecting data is included, where the selected data may include a plurality of sub-data of different types, and the sub-data includes at least one of: text, documents, tables, presentations, folders, audio, pictures. For example, when the data is end-of-year report data, then the selected data types may include multiple types of files for presentations, audio, documents, and so on. During downloading, files of various different types can be simultaneously compressed into one compression package, so that the requirements of users are met, and convenience is brought to data extraction operations of the users.

As an alternative embodiment, the size of the data to be downloaded is determined by accumulating the storage capacity occupied by the selected data, and the storage units of the data in the computer are generally represented by bit, B, KB, MB, GB, TB, etc., and all the selected data in this application can be represented by the above units. If there are different units of data in the selected data, the conversion may be performed according to the conversion relationship between the storage units, and in the case of binary data, 1b =8bit, 1kb =1024b, 1mb =1024kb, 1gb =1024mb, 1tb =1024gb, and so on, for example, the selected data is two texts, the a text size is 512kb, and the b file size is 3MB, the selected data size is 3.5MB. The data among different units are converted, so that various data using different capacity storage units can be added conveniently, and the size of the data to be downloaded can be clear and directly known.

As an alternative embodiment, the predetermined threshold may be specific to the terminal. For example, when the predetermined threshold is determined, the configured predetermined threshold is different when the configuration of the terminal is different and the network performance is different. The predetermined threshold is not absolute, and may be set higher, for example, if the terminal is located at a position where the network is unobstructed and the network speed is fast.

As an alternative embodiment, the data to be downloaded is compressed and downloaded according to the file directory structure, wherein the name of the compressed package may be named by the file directory structure, for example, the a subfolders a and b in the a folder are selected as the data to be downloaded, and the name of the compressed package may be the a folder/a and b. In the downloaded compressed package, a picture with a file directory structure can be generated, for example, a plurality of folders are selected from a browsing webpage for downloading, the browsing webpage is intercepted, the picture comprises the website of the browsing webpage, and the directory structure of the file can be clearly seen through the plurality of selected folders. The data to be downloaded is compressed and downloaded according to the file directory structure, so that a user can quickly and accurately find the original data information of the compressed packet according to the directory structure, and when the data in the compressed packet has the problems of damage, loss or omission and the like, the user can find the original data according to the directory structure and then select the required data to execute the downloading operation. The problem that original data information cannot be found due to file damage, file loss or file omission is avoided, and the safety of downloaded data and the integrity of information are improved.

As an optional embodiment, when the size of the data to be downloaded is smaller than the predetermined threshold, the data to be downloaded is compressed and downloaded by the local client device according to the file directory structure, so as to obtain the second compressed data packet. When the data to be downloaded is small, the local client can directly download the data without starting a remote server. The balance between the performance of the local client and the file downloading speed is reasonably carried out, the downloading efficiency is further improved by selecting a proper downloading mode, and the maximization of the file downloading efficiency is ensured.

As an optional embodiment, when the local client device performs compression downloading on the data to be downloaded according to the file directory structure to obtain the second compressed data packet, various methods may be adopted, for example, the following methods may be adopted: selecting a file included in a first folder in data to be downloaded through local client equipment, and acquiring a first up-and-down level relation between the files; then, simulating a first file directory structure of the first folder according to the first superior-inferior relation; and then compressing and downloading the files included in the first folder and the first file directory structure together to obtain a second compressed data packet. The files included in the first folder may be files belonging to a plurality of hierarchies, and the number of files included in each hierarchy may also be a plurality. Therefore, the first upper-lower level relationship between the files refers to the nesting relationship between the files, and can be represented as a tree structure relationship. According to the first upper-lower level relation, a first file directory structure of the first folder can be simulated. When the data to be downloaded is downloaded, the files included in the first folder and the first file directory structure of the first folder are compressed and then downloaded, and a second compressed data packet is obtained.

As an optional embodiment, when the data to be downloaded includes both the first folder and the independent file, that is, there is a case where the first folder and the independent file are downloaded in a mixed manner, and for this case, when the data to be downloaded is compressed and downloaded, an appropriate manner may be flexibly selected for processing. For example, the files included in the first folder and the first file directory structure corresponding to the first folder, as well as other independent files, may be compressed together to obtain a second compressed data packet. For another example, the files included in the first folder and the first file directory structure corresponding to the first folder may be compressed to obtain a compressed packet, and then the obtained compressed packet and other independent files may be compressed to obtain the second compressed data packet. The two modes can be flexibly selected according to the specific situation of the data to be downloaded.

As an alternative embodiment, a storage address of a first compressed data packet sent by a remote server is received; and downloading the first compressed data packet from the remote server according to the storage address. The remote server has good data processing capacity and can react in time, so that the file downloading efficiency is improved, and the problems of file downloading pause, long time delay and the like are solved. The first compressed data packet is downloaded directly according to the storage address for storing the first compressed data packet, and the method is simple and convenient and enables data downloading to be more efficient.

As an alternative embodiment, a deletion notification message is sent to the remote server, where the deletion notification message is used to notify the remote server to delete the first compressed data packet. After the local client finishes downloading the first compressed data packet from the remote server, the first compressed data packet stored by the remote server is deleted, so that the maintenance of the first compressed data packet by the remote server is reduced, redundant file residues are avoided, the resources of the remote server are saved, the operating pressure of the remote server is reduced, the remote server can be used for processing other data, and the data processing capacity of the remote server is improved.

Fig. 2 is a flowchart of a second data processing method according to embodiment 1 of the present invention, and as shown in fig. 2, the method includes the following steps:

step S202, receiving a downloading request;

step S204, responding to the downloading request, and performing compression downloading on the data to be downloaded according to the file directory structure to obtain a first compression data packet, wherein the size of the data to be downloaded is larger than or equal to a preset threshold value;

step S206, sending a downloading notification to the client device, wherein the downloading notification is used for notifying the client device to download the first compressed data packet.

Through the steps, the remote server responds to the downloading request by receiving the downloading request, performs compression downloading on the data to be downloaded according to the file directory structure to obtain a first compression data packet, and provides the first compression data packet for the client device to download. And when the size is larger than or equal to the preset threshold value, compressing and downloading by adopting the remote server, and providing the compressed package for the client equipment by the remote server for downloading. The problem that the downloading efficiency is influenced by overlarge consumption of local client resources when the downloaded data is large is effectively solved, so that the effects of saving the local resources and improving the downloading efficiency are achieved. In addition, the downloaded compressed package comprises a file directory structure, so that the integrity of file information is ensured, and the data downloading experience of a user is effectively improved.

As an optional embodiment, when the data to be downloaded is compressed and downloaded according to the file directory structure to obtain the first compressed data packet, a plurality of ways may also be adopted. For example, the following may be employed: selecting a file included in a second folder in the data to be downloaded, and acquiring a second superior-inferior relation between the files; simulating a second file directory structure of the second folder according to the second upper-lower level relation; and compressing and downloading the files included in the second folder and the second file directory structure together to obtain a first compressed data packet. The files included in the second folder may be files belonging to a plurality of hierarchies, and the number of files included in each hierarchy may also be a plurality. Therefore, the second upper-lower level relationship between the files refers to the nesting relationship between the files, and can be represented as a tree structure relationship. According to the second upper-lower level relation, a second file directory structure of the second folder can be simulated. And when the data to be downloaded is downloaded, compressing the files contained in the second folder and the second file directory structure of the second folder together, and then downloading the compressed files to obtain a first compressed data packet.

As an alternative embodiment, when the data to be downloaded includes both the second folder and the independent file, that is, there is a case where the second folder and the independent file are downloaded in a mixed manner, and for this case, when the data to be downloaded is compressed and downloaded, an appropriate manner may be flexibly selected for processing. For example, the files included in the second folder and the two file directory structures corresponding to the second folder, as well as other independent files, may be compressed together to obtain a first compressed data packet. For another example, the first compressed data packet may be obtained by compressing the file included in the second folder and the second file directory structure corresponding to the second folder to obtain a compressed packet, and then compressing the obtained compressed packet and other independent files. The two modes can be flexibly selected according to the specific situation of the data to be downloaded.

As an alternative embodiment, a deletion notification message sent by a client device is received; and deleting the first compressed data packet according to the deletion notification message. And the compressed data packet in the remote client is deleted immediately, so that the waste of resources on the remote server is reduced, the operating pressure is reduced, the redundant data packet residue is avoided, and the data processing capacity is ensured.

As an optional embodiment, the download notification carries a storage address of the first compressed data packet, and the storage address is used for the client device to download the first compressed data packet. The user is informed of the completion of the compression and downloading operation of the data to be downloaded through the downloading notification, and the user can know that the compressed file is generated at the first time, so that the use experience of the user is improved.

Fig. 3 is a flowchart of a third data processing method according to embodiment 1 of the present invention, as shown in fig. 3, the method includes the following steps:

step S302, the local client device determines the size of the data to be downloaded, and sends a downloading request to the remote server when the size of the data to be downloaded is larger than or equal to a preset threshold value;

step S304, the remote server responds to the downloading request, performs compression downloading on the data to be downloaded according to the file directory structure to obtain a first compression data packet, and sends a downloading notification to the local client device;

in step S306, the local client device receives the download notification and downloads the first compressed data packet from the remote server.

Through the steps, the local client device sends a downloading request to the remote server under the condition that the size of the data to be downloaded is larger than or equal to the preset threshold value, the remote server responds to the downloading request, the data to be downloaded is compressed and downloaded according to the file directory structure to obtain a first compressed data packet, and the first compressed data packet is provided for the client device to be downloaded. And when the size is larger than or equal to the preset threshold value, compressing and downloading by adopting the remote server, and providing the compressed package for the client equipment by the remote server for downloading. The problem that the downloading efficiency is influenced by overlarge consumption of local client resources when the downloaded data is large is effectively solved, so that the effects of saving the local resources and improving the downloading efficiency are achieved. In addition, the downloaded compressed package comprises a file directory structure, so that the integrity of file information is ensured, and the data downloading experience of a user is effectively improved.

Based on the above embodiments and alternative embodiments, an alternative implementation is provided.

In the optional implementation manner, a flow chart of a data processing method of a web local client is provided, and fig. 4 is a flow chart of a data processing method of a web local client according to the optional implementation manner of the present invention, as shown in fig. 4, in the method, for example, a web local client and a remote server are cloud servers, it should be noted that the cloud servers execute data processing operations based on a V8 engine of Google and a platform node. Through network performance evaluation, the web data processing method in this optional embodiment selects 20M as a predetermined threshold for determining the size of the data, but the predetermined threshold is not limited to 20M. This alternative embodiment is explained below.

S1, a web local client request end receives a file or a folder to be downloaded;

s2, determining the size of a file or a folder to be downloaded;

s3, if the size of the file or the folder to be downloaded is larger than or equal to 20M, executing the following operation;

1, sending a file downloading notification to a cloud server, and starting a node.js service;

2, compressing the data to be downloaded into a file in a zip format according to a file directory structure in a blob binary mode, and downloading the file in the zip format;

3, after the text zip format file is downloaded, sending a download address to the web local client;

4, the web local client receives the download address and executes the file download operation;

5, after the file is downloaded, sending a notice of deleting the cloud compressed file to the cloud server, and starting a node.js service;

and 6, scanning the downloaded file by the cloud server, and executing file deletion operation.

And S4, if the size of the data to be downloaded is smaller than 20M, executing the following operation.

1, a web local client starts a node.js service;

and 2, compressing the data to be downloaded into a file in a zip format according to the file directory structure in a blob binary mode, and downloading the file in the zip format.

Through the above alternative embodiment, at least the following advantages can be achieved:

(1) The small file set directly generates a zip-format file locally, and quickly processes the downloading operation of the file;

(2) The large file set is compressed in a remote processing mode to generate a zip-format file, so that high energy consumption and waiting of a local client are reduced, and the file downloading efficiency is improved;

(3) And a zip file package is generated to keep the directory structure and the hierarchy of the original file and the folder, so that the integrity of the file and the folder is ensured.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.

Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method according to the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

Example 2

According to an embodiment of the present invention, there is further provided an apparatus for implementing the first data processing method, and fig. 5 is a block diagram of a first data processing apparatus according to an embodiment of the present invention, and as shown in fig. 5, the apparatus includes: a first determining module 502, a first transmitting module 504 and a first downloading module 506, which will be described in detail below.

A first determining module 502, configured to determine a size of data to be downloaded; a first sending module 504, connected to the first determining module 502, configured to send a download request to the remote server when the size of the data to be downloaded is greater than or equal to a predetermined threshold, where the download request is used to request the remote server to perform compressed downloading on the data to be downloaded according to the file directory structure, so as to obtain a first compressed data packet; a first downloading module 506, connected to the first sending module 504, for downloading the first compressed data packet from the remote server.

It should be noted that the first determining module 502, the first sending module 504 and the first downloading module 506 correspond to steps S102 to S106 in the first data processing method of the embodiment, and a plurality of modules are the same as the corresponding steps in the implementation example and the application scenario, but are not limited to the disclosure in the above embodiment 1.

As an optional embodiment, the first downloading module 506 is further configured to, under the condition that the size of the data to be downloaded is smaller than the predetermined threshold, perform compression downloading on the data to be downloaded by the local client device according to a file directory structure, so as to obtain a second compressed data packet.

As an alternative embodiment, the first downloading module 506 includes: the device comprises a first selection unit, a first simulation unit and a first downloading unit, wherein the first selection unit is used for selecting files included in a first folder in the data to be downloaded through local client equipment and acquiring a first upper-lower level relation between the files; the first simulation unit is connected to the first selection unit and used for simulating a first file directory structure of the first folder according to the first superior-inferior relation; and the first downloading unit is connected to the first selecting unit and the first simulating unit and is used for compressing and downloading the files contained in the first folder and the first file directory structure together to obtain the second compressed data packet.

As an alternative embodiment, the first downloading module 506 includes: the first receiving unit is used for receiving the storage address of the first compressed data packet sent by the remote server; the second downloading unit is connected to the first receiving unit and used for downloading the first compressed data packet from the remote server according to the storage address.

As an alternative embodiment, the first data processing apparatus further includes: a third sending module, configured to send a deletion notification message to the remote server after downloading the first compressed data packet from the remote server, where the deletion notification message is used to notify the remote server to delete the first compressed data packet.

Example 3

According to an embodiment of the present invention, there is further provided an apparatus for implementing the second data processing method, where fig. 6 is a block diagram of a second data processing apparatus according to an embodiment of the present invention, and as shown in fig. 6, the apparatus includes: a first receiving module 602, a second downloading module 604 and a second sending module 606, which will be described in detail below.

A first receiving module 602, configured to receive a download request; a second downloading module 604, connected to the first receiving module 602, configured to respond to the downloading request, and perform compression downloading on the data to be downloaded according to the file directory structure to obtain a first compressed data packet, where the size of the data to be downloaded is greater than or equal to a predetermined threshold; a second sending module 606, connected to the second downloading module 604, configured to send a downloading notification to the client device, where the downloading notification is used to notify the client device to download the first compressed data packet.

It should be noted here that the first receiving module 602, the second downloading module 604 and the second sending module 606 correspond to steps S202 to S206 in the second data processing method of the embodiment, and a plurality of modules are the same as the corresponding steps in the implementation example and the application scenario, but are not limited to the disclosure in embodiment 1.

As an optional embodiment, the second downloading module includes a second selecting unit, a second simulating unit and a third downloading unit, where the second selecting unit is configured to select a file included in a second folder in the data to be downloaded, and obtain a second upper-lower level relationship between the file and the file; the second simulation unit is connected to the second selection unit and used for simulating a second file directory structure of the second folder according to the second superior-inferior relation; and the third downloading unit is connected to the second selecting unit and the second simulating unit and is used for compressing and downloading the files contained in the second folder and the second file directory structure together to obtain the first compressed data packet.

As an optional embodiment, the download notification carries a storage address of the first compressed data packet, where the storage address is used for the client device to download the first compressed data packet.

As an alternative embodiment, the data processing apparatus further comprises: a second receiving module, configured to receive a deletion notification message sent by the client device after sending the download notification to the client device; and deleting the first compressed data packet according to the deletion notification message.

Example 4

According to an embodiment of the present invention, there is further provided a system for implementing the third data processing method, and fig. 7 is a block diagram of a structure of a data processing system according to an embodiment of the present invention, as shown in fig. 7, the system includes: a local client device 702 and a remote server 704, the system of which is described in detail below.

The local client device 702 is configured to determine the size of the data to be downloaded, and send a download request to the remote server when the size of the data to be downloaded is greater than or equal to a predetermined threshold; a remote server 704, which is in communication with the local client device 702 and is configured to respond to the download request, perform compression and download on data to be downloaded according to the file directory structure to obtain a first compressed data packet, and send a download notification to the local client device; the local client device 702 is further configured to receive the download notification and download the first compressed data packet from the remote server.

It should be noted here that the local client device 702 and the remote server 704 correspond to steps S302 to S306 in the second data processing method of the embodiment, and the local client device 702 and the remote server 704 are the same as the corresponding steps in the implementation example and the application scenario, but are not limited to the disclosure in the above embodiment 1.

Example 5

The embodiment of the invention can provide a terminal which can be any computer terminal device in a computer terminal group. Optionally, in this embodiment, the terminal may also be a terminal device such as a mobile terminal.

Optionally, in this embodiment, the terminal may be located in at least one network device of a plurality of network devices of a computer network.

Alternatively, fig. 8 is a block diagram illustrating a structure of a terminal according to an exemplary embodiment. As shown in fig. 8, the terminal may include: one or more (only one shown) processors 81, a memory 82 for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the data processing method of any of the above.

The memory may be configured to store software programs and modules, such as program instructions/modules corresponding to the data processing method and apparatus in the embodiments of the present invention, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory, so as to implement the data processing method. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the computer terminal through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The processor can call the information and application program stored in the memory through the transmission device to execute the following steps: determining the size of data to be downloaded; under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value, sending a downloading request to a remote server, wherein the downloading request is used for requesting the remote server to perform compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet; the first compressed data packet is downloaded from the remote server.

Optionally, the processor may further execute the program code of the following steps: and under the condition that the size of the data to be downloaded is smaller than a preset threshold value, compressing and downloading the data to be downloaded through the local client equipment according to the file directory structure to obtain a second compressed data packet.

Optionally, the processor may further execute the program code of the following steps: compressing and downloading the data to be downloaded through the local client device according to the file directory structure to obtain a second compressed data packet, wherein the second compressed data packet comprises: selecting a file included in a first folder in data to be downloaded through local client equipment, and acquiring a first upper-lower level relation between the files; simulating a first file directory structure of the first folder according to the first upper-lower level relation; and compressing and downloading the files included in the first folder and the first file directory structure together to obtain a second compressed data packet.

Optionally, the processor may further execute the program code of the following steps: downloading a first compressed data packet from a remote server, comprising: receiving a storage address of a first compressed data packet sent by a remote server; and downloading the first compressed data packet from the remote server according to the storage address.

Optionally, the processor may further execute the program code of the following steps: after downloading the first compressed data packet from the remote server, the method further comprises: and sending a deletion notification message to the remote server, wherein the deletion notification message is used for notifying the remote server to delete the first compressed data packet.

An embodiment of the present invention may provide a server, and fig. 9 is a block diagram illustrating a structure of a server according to an exemplary embodiment. As shown in fig. 9, the server 90 may include: one or more (only one shown) memory 92 for storing processing components 91, executable instructions, a power supply component 93 for supplying power, a network interface 94 for implementing communication with an external network, and an I/O input/output interface 95 for data transmission with the outside; wherein the processing component 91 is configured to execute instructions to implement the data processing method of any of the above.

The memory may be configured to store software programs and modules, such as program instructions/modules corresponding to the data processing method and apparatus in the embodiments of the present invention, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory, so as to implement the data processing method. The memory may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the computer terminal through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The processing component can call the information and the application program stored in the memory through the transmission device to execute the following steps: receiving a downloading request; responding to the downloading request, and performing compression downloading on data to be downloaded according to the file directory structure to obtain a first compression data packet, wherein the size of the data to be downloaded is larger than or equal to a preset threshold value; and sending a downloading notification to the client device, wherein the downloading notification is used for notifying the client device to download the first compressed data packet.

Optionally, the processing component may further execute program codes of the following steps: compressing and downloading data to be downloaded according to the file directory structure to obtain a first compressed data packet, wherein the method comprises the following steps: selecting a file included in a second folder in the data to be downloaded, and acquiring a second superior-subordinate relation between the files; simulating a second file directory structure of the second folder according to the second upper-lower level relation; and compressing and downloading the files included in the second folder and the second file directory structure together to obtain a first compressed data packet.

Optionally, the processing component may further execute program codes of the following steps: the download notification carries a storage address of the first compressed data packet, and the storage address is used for the client device to download the first compressed data packet.

Optionally, the processing component may further execute the following steps: after sending the download notification to the client device, the method further comprises: receiving a deletion notification message sent by client equipment; and deleting the first compressed data packet according to the deletion notification message.

It can be understood by those skilled in the art that the structures shown in fig. 8 and fig. 9 are only schematic, for example, the terminal may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 8 and 9 do not limit the structure of the electronic device. For example, it may also include more or fewer components (e.g., network interfaces, display devices, etc.) than shown in fig. 8, 9, or have a different configuration than shown in fig. 8, 9.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, read-Only memories (ROMs), random Access Memories (RAMs), magnetic or optical disks, and the like.

Example 6

In an exemplary embodiment, there is also provided a computer-readable storage medium including instructions that, when executed by a processor of a terminal, enable the terminal to perform the data processing method of any one of the above. Alternatively, the computer readable storage medium may be a non-transitory computer readable storage medium, for example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Alternatively, in this embodiment, the computer-readable storage medium may be used to store the program code executed by the data processing method provided in the above-described embodiment.

Optionally, in this embodiment, the computer-readable storage medium may be located in any one of a group of computer terminals in a computer network, or in any one of a group of mobile terminals.

Optionally, in this embodiment, a computer-readable storage medium is configured to store program code for performing the steps of: determining the size of data to be downloaded; sending a downloading request to a remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value, wherein the downloading request is used for requesting the remote server to perform compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet; the first compressed data packet is downloaded from the remote server.

Optionally, in this embodiment, a computer-readable storage medium is configured to store program code for performing the steps of: and under the condition that the size of the data to be downloaded is smaller than a preset threshold value, compressing and downloading the data to be downloaded through the local client equipment according to the file directory structure to obtain a second compressed data packet.

Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: compressing and downloading the data to be downloaded through the local client device according to the file directory structure to obtain a second compressed data packet, wherein the method comprises the following steps: selecting a file included in a first folder in data to be downloaded through local client equipment, and acquiring a first upper-lower level relation between the files; simulating a first file directory structure of the first folder according to the first upper-lower level relation; and compressing and downloading the files included in the first folder and the first file directory structure together to obtain a second compressed data packet.

Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: downloading a first compressed data packet from a remote server, comprising: receiving a storage address of a first compressed data packet sent by a remote server; and downloading the first compressed data packet from the remote server according to the storage address.

Optionally, in this embodiment, a computer-readable storage medium is configured to store program code for performing the steps of: after downloading the first compressed data packet from the remote server, the method further comprises: and sending a deletion notification message to the remote server, wherein the deletion notification message is used for notifying the remote server to delete the first compressed data packet.

Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: receiving a downloading request; responding to the downloading request, and performing compression downloading on data to be downloaded according to the file directory structure to obtain a first compression data packet, wherein the size of the data to be downloaded is larger than or equal to a preset threshold value; and sending a downloading notification to the client device, wherein the downloading notification is used for notifying the client device to download the first compressed data packet.

Optionally, in this embodiment, the computer readable storage medium is further configured to store program code for performing the following steps: compressing and downloading data to be downloaded according to the file directory structure to obtain a first compressed data packet, wherein the method comprises the following steps: selecting a file included in a second folder in the data to be downloaded, and acquiring a second upper-lower level relation between the files; simulating a second file directory structure of the second folder according to the second upper-lower level relation; and compressing and downloading the files included in the second folder and the second file directory structure together to obtain a first compressed data packet.

Optionally, in this embodiment, the computer readable storage medium is further configured to store program code for performing the following steps: the download notification carries a storage address of the first compressed data packet, and the storage address is used for the client device to download the first compressed data packet.

Optionally, in this embodiment, the computer readable storage medium is further configured to store program code for performing the following steps: after sending the download notification to the client device, the method further comprises: receiving a deletion notification message sent by client equipment; and deleting the first compressed data packet according to the deletion notification message.

Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: the method comprises the steps that local client equipment determines the size of data to be downloaded and sends a downloading request to a remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value; the remote server responds to the downloading request, performs compression downloading on data to be downloaded according to the file directory structure to obtain a first compression data packet, and sends a downloading notification to the local client device; the local client device receives the download notification and downloads the first compressed data packet from the remote server.

In an exemplary embodiment, a computer program product is also provided, in which a computer program, when executed by a processor of an electronic device, enables the electronic device to perform the data processing method of any of the above.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed technical content can be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and amendments can be made without departing from the principle of the present invention, and these modifications and amendments should also be considered as the protection scope of the present invention.

Claims

1. A data processing method, comprising:

determining the size of data to be downloaded;

sending a downloading request to a remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value, wherein the downloading request is used for requesting the remote server to perform compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet;

downloading the first compressed data packet from the remote server.

2. The method of claim 1, further comprising:

and under the condition that the size of the data to be downloaded is smaller than the preset threshold value, compressing and downloading the data to be downloaded through local client equipment according to a file directory structure to obtain a second compressed data packet.

3. The method of claim 2, wherein compressing and downloading the data to be downloaded by the local client device according to the file directory structure to obtain a second compressed data packet comprises:

selecting a file included in a first folder in the data to be downloaded through local client equipment, and acquiring a first upper-lower level relation between the files;

simulating a first file directory structure of the first folder according to the first upper-lower level relation;

and compressing and downloading the files included in the first folder and the first file directory structure together to obtain the second compressed data packet.

4. The method of claim 1, wherein downloading the first compressed data packet from the remote server comprises:

receiving a storage address of the first compressed data packet sent by the remote server;

and downloading the first compressed data packet from the remote server according to the storage address.

5. The method according to any one of claims 1 to 4, further comprising, after downloading the first compressed data packet from the remote server:

and sending a deletion notification message to the remote server, wherein the deletion notification message is used for notifying the remote server to delete the first compressed data packet.

6. A method of data processing, comprising:

receiving a downloading request;

responding to the downloading request, and performing compression downloading on data to be downloaded according to a file directory structure to obtain a first compression data packet, wherein the size of the data to be downloaded is larger than or equal to a preset threshold value;

and sending a downloading notification to a client device, wherein the downloading notification is used for notifying the client device to download the first compressed data packet.

7. The method of claim 6, wherein compressing and downloading the data to be downloaded according to the file directory structure to obtain a first compressed data package, comprises:

selecting a file included in a second folder in the data to be downloaded, and determining a second superior-inferior relation between the files;

simulating a second file directory structure of the second folder according to the second superior-inferior relation;

and compressing and downloading the files included in the second folder and the second file directory structure together to obtain the first compressed data packet.

8. The method according to claim 6, wherein the download notification carries a storage address of the first compressed data packet, and the storage address is used for the client device to download the first compressed data packet.

9. The method of any of claims 6 to 8, further comprising, after sending the download notification to the client device:

receiving a deletion notification message sent by the client device;

and deleting the first compressed data packet according to the deletion notification message.

10. A data processing method, comprising:

the method comprises the steps that local client equipment determines the size of data to be downloaded and sends a downloading request to a remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value;

the remote server responds to the downloading request, carries out compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet, and sends a downloading notification to the local client device;

the local client device receives the download notification and downloads the first compressed data packet from the remote server.

11. A data processing apparatus, comprising:

the first determining module is used for determining the size of the data to be downloaded;

the device comprises a first sending module, a first receiving module and a second sending module, wherein the first sending module is used for sending a downloading request to a remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value, and the downloading request is used for requesting the remote server to perform compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet;

and the first downloading module is used for downloading the first compressed data packet from the remote server.

12. A data processing apparatus, comprising:

the first receiving module is used for receiving a downloading request;

the second downloading module is used for responding to the downloading request and performing compression downloading on the data to be downloaded according to the file directory structure to obtain a first compression data packet, wherein the size of the data to be downloaded is larger than or equal to a preset threshold value;

and a second sending module, configured to send a download notification to the client device, where the download notification is used to notify the client device to download the first compressed data packet.

13. A data processing system, comprising: a local client device and a remote server, wherein,

the local client device is used for determining the size of the data to be downloaded and sending a downloading request to the remote server under the condition that the size of the data to be downloaded is larger than or equal to a preset threshold value;

the remote server is used for responding to the downloading request, performing compression downloading on the data to be downloaded according to a file directory structure to obtain a first compression data packet, and sending a downloading notification to the local client device;

the local client device is further configured to receive the download notification and download the first compressed data packet from the remote server.

14. A terminal, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the data processing method of any one of claims 1 to 5.

15. A server, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the data processing method of any one of claims 6 to 9.

16. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the data processing method of any of claims 1 to 10.

17. A computer program product comprising a computer program, characterized in that the computer program realizes the data processing method of any one of claims 1 to 10 when executed by a processor.