WO2016127656A1

WO2016127656A1 - Data caching method and device for net disk client

Info

Publication number: WO2016127656A1
Application number: PCT/CN2015/091136
Authority: WO
Inventors: 罗圣美; 王志勇; 段翰聪
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-02-10
Filing date: 2015-09-29
Publication date: 2016-08-18
Also published as: CN105988721A

Abstract

A data caching method and device for a net disk client, which relate to the technical field of communications, so as to solve the problem in the related art that it fails to most effectively provide a caching service to a user by using a limited cache space. The method comprises: caching a part of cloud data, the use frequency of which is higher a preset threshold in a preset time period, into a virtual magnetic disk in a form of a mirror file, and presenting all file metadata of the cloud data to a user by means of the virtual magnetic disk, the file metadata being data for describing the cloud data; if a file accessed by the user is cached in the virtual magnetic disk, accessing the file by means of the virtual magnetic disk; and if the file accessed by the user is not cached in the virtual magnetic disk, downloading the file from the cloud according to the file metadata of the cloud data.

Description

Data cache method and device for network disk client

Technical field

This document relates to, but is not limited to, the field of communication technologies, and in particular, to a data cache method and apparatus for a network disk client.

Background technique

With the development of cloud computing, cloud storage has become more and more popular as an emerging storage strategy, and has also received the attention of major Internet companies. The cloud storage system connects and integrates distributed and different storage resources, and provides users with unified storage services through technologies such as network transmission, distributed computing, and cluster services. Compared with traditional storage, cloud storage has high security, low cost and high scalability, which has become the future development trend of the storage field. Storage service providers are shifting from providing a single storage product to providing storage services. A network disk is a form of service provision for related cloud storage. At present, the most popular network disk systems on the market are: Dropbox, Jinshan Express, Baidu Cloud Disk, etc.

As a window that interacts directly with users, the network disk client is an indispensable part of the network disk system. The cache policy of the network disk client directly affects the user experience of using the network disk. At present, the cache of the network disk client is mainly divided into two types: no cache and full cache. Among them, in the no-cache scheme, all operations of the user on the network disk are implemented by a browser or a client accessing a specific webpage. The advantages of this method are simple implementation, unified access interface, and network disk access across platforms and devices without modifying the client itself. At the same time, the resource consumption of the client is small, but because there is no local cache of network resources, access to network resources. When you need to manually download from the cloud, the user experience is not high. The full cache is generally implemented by using a virtual disk. That is, a virtual disk is used as the access point of the network disk, so that the user accesses the network storage device (the network disk) and the access mode to the local storage device (local disk) are unified. The user can access the network disk just like a local disk. Jinshan Express, DropBox and other network disks are all network disk clients implemented by virtual disk. However, this implementation relies on the local file system and cannot implement file metadata management that is transparent to the user. Because the file metadata cannot be managed autonomously, the network disk client currently implemented by the virtual disk is fully cached, that is, the network resources are all cached locally, and the storage capacity is closely related to the local storage resource, so The large limit the size of the content stored by the user on the cloud disk.

There is no effective solution in the related art for how to enable the network disk client to utilize the limited cache space to provide the cache service to the user most effectively.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The embodiment of the invention provides a data caching method and device for a network disk client, which is used to solve the technical problem of avoiding the use of a limited buffer space in the related art to most effectively provide a cache service for a user.

In one aspect, an embodiment of the present invention provides a data caching method for a network disk client, including:

Portaging, in the cloud data, a portion of the cloud data that is used by the preset time period to be higher than the preset threshold is cached in the virtual disk in the form of an image file, and the file metadata of the cloud data is presented to the user through the virtual disk, where The file metadata is data describing the cloud data; if the file accessed by the user is cached in the virtual disk, the file is accessed through the virtual disk; if the file accessed by the user is not cached in the virtual disk, according to The file metadata of the cloud data is downloaded from the cloud.

Optionally, the method further includes deleting, in the case that the remaining cache space of the virtual disk is less than a preset cache threshold, the file that is accessed by the preset time period is deleted from the virtual disk, and the remaining cache is deleted. The space is greater than or equal to the preset cache threshold.

Optionally, if the file accessed by the user is cached in the virtual disk, accessing the file by using the virtual disk includes: if the file accessed by the user is cached in the virtual disk, the virtual disk drive will be The access request for the file is redirected to the image file.

Optionally, the method further includes reconfiguring the virtual disk according to a virtual disk configuration instruction of the user.

Optionally, the reconfiguring the virtual disk according to the virtual disk configuration instruction of the user includes: providing a virtual disk configuration interface to the user, and receiving, by the configuration interface, the user to reset the drive letter name and the cache space of the virtual disk. An instruction of size and cache threshold; unloading the virtual magnetic Disk, and reconfigure the virtual disk according to parameters in the virtual disk configuration interface; remount the reconfigured virtual disk.

On the other hand, the embodiment of the present invention further provides a data cache device of a network disk client, comprising: a cache unit, configured to cache a portion of the cloud data in which the preset time period is used in a frequency higher than a preset threshold as an image file. And displaying, by the virtual disk, all file metadata of the cloud data to the user by using the virtual disk, wherein the file metadata is data describing the cloud data; and the access unit is configured to: if the file accessed by the user Cached in the virtual disk, accessing the file through the virtual disk; if the file accessed by the user is not cached in the virtual disk, downloading the file from the cloud according to file metadata of the cloud data.

Optionally, the device further includes: a deleting unit, configured to delete, from the virtual disk, a file that is accessed at least by a preset time period, if a remaining cache space of the virtual disk is less than a preset cache threshold. Until the remaining cache space is greater than or equal to the preset cache threshold.

Optionally, the access unit is configured to redirect the access request of the file to the image file by the virtual disk driver if the file accessed by the user is cached in the virtual disk.

Optionally, the device further includes a configuration unit configured to reconfigure the virtual disk according to a virtual disk configuration instruction of the user.

Optionally, the configuration unit is configured to: provide a virtual disk configuration interface to the user, and receive, by using the configuration interface, an instruction for the user to reset the drive letter name, the cache space size, and the cache threshold of the virtual disk; Describe the virtual disk and reconfigure the virtual disk according to parameters in the virtual disk configuration interface; remount the reconfigured virtual disk.

The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the above method.

The data caching method and device of the network disk client provided by the embodiment of the present invention caches a portion of the cloud data whose preset time period frequency is higher than a preset threshold in an image file in a virtual disk, and uses the virtual disk to The user presents all the file metadata of the cloud data, and complete description of the real file data through the file metadata. Even if some file data itself is not cached locally, the user can know the name, directory, size and other information of all the files. Just like all the text The pieces are all local and the user experience is good. When the user accesses the file, if the file accessed by the user is cached in the virtual disk, the file is accessed through the virtual disk; if the file accessed by the user is not cached in the virtual disk, the file according to the cloud data Metadata, downloading the file from the cloud, because the local cache is the most commonly used data in the preset time period, thereby making full use of the limited local cache resources, providing users with a high-quality cache service, greatly improving the user experience.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

FIG. 1 is a flowchart of a data caching method of a network disk client according to an embodiment of the present invention;

2 is a schematic diagram of an implementation principle of a virtual disk based cache in an embodiment of the present invention;

3 is a schematic diagram of a principle for implementing file filter driver cache elimination in an embodiment of the present invention;

4 is a flowchart of a data caching method of a network disk client in a file uploading operation according to an embodiment of the present invention;

FIG. 5 is a flowchart of a data caching method of a web client when a file download operation is performed in an embodiment of the present invention; FIG.

FIG. 6 is a schematic structural diagram of a data cache device of a network disk client according to an embodiment of the present invention.

Embodiments of the invention

The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

As shown in FIG. 1 , an embodiment of the present invention provides a data caching method for a network disk client, including:

S11. The part of the cloud data that is used in the preset time period is higher than the preset threshold, and is cached on the virtual disk in the form of an image file, and the virtual disk is used to present the cloud data stored in the virtual disk to the user. All file metadata, wherein the file metadata is data describing the cloud data;

S12, if the file accessed by the user is cached in the virtual disk, accessing the file through the virtual disk; if the file accessed by the user is not cached in the virtual disk, according to file metadata of the cloud data, The file is downloaded in the cloud.

The data caching method of the network disk client provided by the embodiment of the present invention caches a portion of the cloud data in a preset time period with a frequency higher than a preset threshold in an image file in a virtual disk, and provides the user to the virtual disk through the virtual disk. Presenting all the file metadata of the cloud data, and completely describing the real file data through the file metadata. Even if some file data itself is not in the virtual disk, the user can know the name, directory, size and other information of all the files, as if All files are local and the user experience is good. When the user accesses the file, if the file accessed by the user is cached in the virtual disk, the file is accessed through the virtual disk; if the file accessed by the user is not cached in the virtual disk, the file according to the cloud data Metadata, downloading the file from the cloud, because the virtual disk stores the most commonly used data within a preset time period, thereby fully utilizing the limited local cache resources, providing users with a high-quality cache service, greatly improving the user experience.

Optionally, the implementation principle of the virtual disk based cache can be as shown in FIG. 2 . The virtual disk drive can virtualize a disk (that is, a virtual disk) by means of a driver in the system, and the virtual disk driver manages the data of the virtual disk. For the upper layer, this virtual disk is exactly the same as other disks, and the user can see all the data stored in the network disk. For the lower layer, the virtual disk uses the image file as the actual storage of the cache space. If the file accessed by the user is cached in the virtual disk, an access request for the file may be redirected to the image file by the virtual disk drive. Among them, the image file only stores a cache of part of the actual data that matches its own size, and the virtual disk drive presents the complete file metadata to the user. If the file accessed by the user is not cached in the virtual disk, the file may be downloaded from the cloud according to the file metadata of the cloud data for access.

Optionally, in step S11, the size of the image file cached locally is adapted to the cache space of the virtual disk, and the cached image file is part of the cloud data. In order to facilitate the use of the user, the cached data can be selected from the most commonly used data of the user preset time period, that is, when the preset time period of the file is used higher than the preset frequency, the file is preferentially cached into the local virtual disk. In step S12, by means of the file metadata, the user can see the files of all the files through the virtual disk. Name, directory, size and other information, and access to the corresponding file through virtual disk or cloud download.

It can be understood that since the data cached in the virtual disk is the most commonly used data in the preset time period of the user, the data cached in the virtual disk can be dynamically adjusted and eliminated as the user continuously reads and writes the file. The least used data for the preset time period is cached into the most commonly used data for the new preset time period.

To enable the virtual disk to maintain a certain cache capacity, you can set the default cache threshold for the virtual disk, periodically check the remaining cache space of the virtual disk, or view the remaining cache of the virtual disk before the user performs read and write operations. In the case that the remaining cache space of the virtual disk is less than the preset cache threshold, the file that is accessed at least in the preset time period is deleted from the virtual disk until the remaining cache space is greater than or equal to the preset cache threshold. Optionally, each time the file is accessed, the corresponding access time is recorded, and an LRU (Least Recently Used) algorithm is executed on all the files in the virtual disk, thereby filtering out the minimum file for the preset time period.

Optionally, this filtering operation can be implemented by setting a file system filter driver. As shown in FIG. 3, in this embodiment, the file filtering driver is located above the file system driver of windows. All user read and write requests on the virtual disk will be captured by the I/O Manager running in the kernel state of the Windows system and generate an I/O request package (IRP, I/O requset package), Windows I/O Management. After checking that the attached device object (ie file filter driver) exists, the I/O manager first sends the IRP to the file filter driver, and the file filter driver receives the IRP sent by the I/O manager and passes it through the client's network. The communication layer sends the data to the cloud storage device, and checks whether the virtual disk space is greater than the preset storage threshold. If the space is insufficient, the LRU algorithm is executed to eliminate the cache file that is unused for the preset time period until the local remaining cache is greater than or equal to the pre- Set the storage threshold. The IRP request processed by the file filter driver is sent to the file system driver for file system level logical write operation, and the file system driver sends the I/O request to the destination device. In this embodiment, the destination device is The virtual disk driver performs the actual write operation.

Optionally, the data caching method of the network disk client provided by the embodiment of the present invention may further receive the virtual disk configuration instruction of the user at any time, and reconfigure the virtual disk according to the configuration instruction, thereby implementing customization of the cache space.

For example, in one embodiment of the present invention, when the user needs to change the parameters of the virtual disk, the configuration operation of the virtual disk can be triggered by clicking an interface button or calling a menu. After receiving the user's configuration operation command, the system can respond as follows:

Providing a virtual disk configuration interface to the user, and receiving, by the configuration interface, an instruction for the user to reset the drive letter name, the cache space size, and the cache threshold of the virtual disk;

Unmount the virtual disk and reconfigure the virtual disk according to the parameters in the virtual disk configuration interface.

Remount the reconfigured virtual disk.

In this way, the user can adjust the parameters such as the cache buffer threshold of the virtual disk at any time as needed, thereby further improving the user experience.

The data caching method of the network disk client provided by the embodiment of the present invention is described in detail below.

As shown in Figure 4, when a user adds/modifies a file in a virtual disk to trigger an upload operation, the virtual disk can be cached as follows:

S201, capturing an add/modify file operation;

S202: Send a file content check code to the cloud server to confirm whether the same file exists, and if not, upload the new file content to the cloud server;

S203. Update a file access record table, and put the unique identifier of the file into the end of the table, and the preset time period of the file is accessed;

S204: Verify that the cache space has reached the threshold. If yes, execute the LRU algorithm to eliminate the unused file cache data for the preset time period until the remaining cache space is greater than the threshold.

S205. Write the file to the virtual disk to complete the upload operation.

As shown in Figure 5, when a user accesses a cloud file to trigger a download operation, the virtual disk can be cached as follows:

S301. The user accesses a file in the virtual disk, and if the file has a cache locally, the line is straight. Access.

S302, the file is not cached locally, and the client requests the file data from the cloud. The cloud sends the file content to the client.

S303. Update the file access record table, and put the unique identifier of the file into the end of the table, and the preset time period of the file is accessed.

S304. Verify that the cache space has reached the threshold. If yes, execute the LRU algorithm to eliminate the file cache data that has not been used for the preset time period until the cache space is greater than the threshold.

S305. Write the file to the virtual disk to complete the download operation.

In this embodiment, the file filtering driver is used as a file system monitoring means to monitor file changes in the cache space constructed by the virtual disk driver, thereby ensuring effective use of the limited buffer space.

Correspondingly, as shown in FIG. 6, an embodiment of the present invention further provides a data cache device of a network disk client, including:

The cache unit 41 is configured to cache a portion of the cloud data whose preset time period usage frequency is higher than a preset threshold in a form of an image file on the virtual disk, and present all file elements of the cloud data to the user through the virtual disk. Data, wherein the file metadata is data describing the cloud data;

The access unit 42 is configured to: if the file accessed by the user is cached in the virtual disk, access the file through the virtual disk; if the file accessed by the user is not cached in the virtual disk, according to the cloud data File metadata, download the file from the cloud.

In the data cache device of the network disk client provided by the embodiment of the present invention, the cache unit 41 can cache the portion of the cloud data whose preset time period is used above the preset threshold in the form of an image file on the virtual disk, and pass the virtual The disk presents all the file metadata of the cloud data to the user, and complete description of the real file data through the file metadata. Even if some file data itself is not in the virtual disk, the user can know the name, directory, size, etc. of all the files. Information, as if all files are local, the user experience is good. When the user accesses the file, if the file accessed by the user is cached in the virtual disk, the access unit 42 can access the file through the virtual disk; if the file accessed by the user is not cached in the virtual disk, the access unit 42 The file can be downloaded from the cloud according to the file metadata of the cloud data, due to the virtual disk The most common data is stored in the preset time period, so that the local limited cache resources are fully utilized, and the user is provided with a high-quality cache service, which greatly improves the user experience.

Optionally, the device may further include a deleting unit, configured to delete, from the virtual disk, the file that is accessed at least in the preset time period, if the remaining cache space of the virtual disk is less than a preset cache threshold. The remaining cache space is greater than or equal to the preset cache threshold.

Optionally, the access unit 42 is configured to redirect the access request for the file to the image file by the virtual disk driver if the file accessed by the user is cached in the virtual disk.

Optionally, the apparatus further includes a configuration unit configured to reconfigure the virtual disk according to a virtual disk configuration instruction of the user.

Optionally, the configuration unit is configured to: provide a virtual disk configuration interface to the user, and receive, by the configuration interface, an instruction for the user to reset the drive letter name, the cache space size, and the cache threshold of the virtual disk; and uninstall the virtual Disk, and reconfigure the virtual disk according to parameters in the virtual disk configuration interface; remount the reconfigured virtual disk.

The above is a further detailed description of the present invention in connection with the specific embodiments, and the specific embodiments of the present invention are not limited to the description.

One of ordinary skill in the art will appreciate that all or a portion of the steps of the above-described embodiments can be implemented using a computer program flow, which can be stored in a computer readable storage medium, such as on a corresponding hardware platform (eg, The system, device, device, device, etc. are executed, and when executed, include one or a combination of the steps of the method embodiments.

Alternatively, all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.

The devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.

When each device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. The above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Industrial applicability

The above technical solution realizes that even if the file data itself is not in the virtual disk, the user can know the names, directories, sizes and the like of all the files, as if all the files are local and the user experience is good; in addition, the above technical solutions make full use of the local limited The cache resources provide users with a high-quality cache service, which greatly enhances the user experience.

Claims

A data cache method for a network disk client, comprising:

Portaging, in the cloud data, a portion of the cloud data that is used by the preset time period to be higher than the preset threshold is cached in the virtual disk in the form of an image file, and the file metadata of the cloud data is presented to the user through the virtual disk, where The file metadata is data describing the cloud data;

If the file accessed by the user is cached in the virtual disk, accessing the file through the virtual disk; if the file accessed by the user is not cached in the virtual disk, downloading from the cloud according to file metadata of the cloud data The file.
The method of claim 1 further comprising:

If the remaining cache space of the virtual disk is less than the preset cache threshold, deleting the file with the least time of the preset time period from the virtual disk, until the remaining cache space is greater than or equal to the preset cache threshold. until.
The method of claim 1, wherein if the file accessed by the user is cached in the virtual disk, accessing the file through the virtual disk comprises:

If the file accessed by the user is cached in the virtual disk, an access request for the file is redirected to the image file by the virtual disk drive.
The method of any one of claims 1 to 3, further comprising reconfiguring the virtual disk based on a virtual disk configuration instruction of the user.
The method of claim 4, wherein the reconfiguring the virtual disk according to a virtual disk configuration instruction of the user comprises:

Providing a virtual disk configuration interface to the user, and receiving, by the configuration interface, an instruction for the user to reset the drive letter name, the cache space size, and the cache threshold of the virtual disk;

Unloading the virtual disk and reconfiguring the virtual disk according to parameters in the virtual disk configuration interface;

Remount the reconfigured virtual disk.
A data cache device for a network disk client, comprising:

a cache unit, configured to use a portion of the cloud data in which the preset time period is used above a preset threshold Storing the virtual disk in the form of an image file, and presenting, by the virtual disk, all the file metadata of the cloud data to the user, where the file metadata is data describing the cloud data;

An access unit, configured to: if the file accessed by the user is cached in the virtual disk, access the file through the virtual disk; if the file accessed by the user is not cached in the virtual disk, the file according to the cloud data Metadata, download the file from the cloud.
The apparatus of claim 6 further comprising:

Deleting a unit, configured to delete, from the virtual disk, a file that is accessed at least by a preset time period, if the remaining cache space of the virtual disk is less than a preset cache threshold, until the remaining cache space is greater than or equal to The preset cache threshold is described.
The apparatus according to claim 6, wherein said access unit is configured to redirect an access request for said file to said image through a virtual disk drive if a file accessed by a user is cached in said virtual disk In the file.
The apparatus according to any one of claims 6 to 8, further comprising a configuration unit configured to reconfigure the virtual disk according to a virtual disk configuration instruction of the user.
The apparatus according to claim 9, wherein said configuration unit is configured to:

Providing a virtual disk configuration interface to the user, and receiving, by the configuration interface, an instruction for the user to reset the drive letter name, the cache space size, and the cache threshold of the virtual disk; uninstalling the virtual disk, and following the virtual disk configuration interface The parameter reconfigures the virtual disk; remounts the reconfigured virtual disk.
A computer storage medium having stored therein computer executable instructions for performing the method of any one of claims 1 to 5.