WO2017101576A1

WO2017101576A1 - Data resource storage method and apparatus

Info

Publication number: WO2017101576A1
Application number: PCT/CN2016/101926
Authority: WO
Inventors: 武炳亮
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-12-16
Filing date: 2016-10-12
Publication date: 2017-06-22
Also published as: CN106888381B; CN106888381A

Abstract

Disclosed in the present invention are a data resource storage method and apparatus, for use in resolving the technical problem of poor performance of a CDN system due to improper use of a storage medium of the CDN system. The method comprises: determining whether the number of times of accessing a first data resource stored in a CDN system is greater than or equal to a first popularity threshold; if the number of times of accessing the first data resource is greater than or equal to the first popularity threshold, storing the first data resource into a hard disk in the CDN system; and otherwise, storing the first data resource into a memory of the CDN system.

Description

Data resource storage method and device

Technical field

The present invention relates to the field of communications technologies, and in particular, to a data resource storage method and apparatus.

Background technique

In the context of the development of broadband, communication operators have provided a lot of OTT (Over The Top, which refers to Internet companies crossing operators, developing various video and data service services based on open Internet) video services, and building a capacity large enough for A CDN (Content Delivery Network) system that stores video files.

Due to the large number and capacity of video files, more data may be stored in the CDN system. The performance of the storage medium in the CDN system may vary. For example, in a CDN system, the SSD can be considered as a first-level cache, and its performance is generally better, and the performance of the memory is generally inferior to the performance of the SSD. . For example, some videos are viewed by a large number of users, and this video is stored in the memory, so when the user views the video, the viewing may not be smooth due to memory performance limitations.

It can be seen that the current use of the storage medium of the CDN system is not reasonable enough, and also affects the overall performance of the CDN system.

Summary of the invention

The embodiment of the invention provides a data resource storage method and device for solving the technical problem that the performance of the CDN system is poor due to unreasonable use of the storage medium of the CDN system.

The embodiment of the invention provides a data resource storage method, including:

Determining whether the number of accesses of the first data resource stored in the CDN system is greater than or equal to a first heat threshold;

If the number of accesses of the first data resource is greater than or equal to the first heat threshold, The first data resource is stored in a hard disk in the CDN system; otherwise, the first data resource is stored in a memory of the CDN system.

Optionally, it also includes:

Receiving an access request for the first data resource;

The number of accesses of the first data resource is increased by a first value.

Optional,

Determining whether the number of accesses of the first data resource stored in the CDN system is greater than or equal to the first heat threshold, including:

Determining whether the number of accesses of the first data resource is greater than or equal to a first sub-thermal threshold;

And if the number of times of accessing the first data resource is greater than or equal to the first heat threshold, storing the first data resource in a hard disk in the CDN system, including:

If the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, storing the first data resource in a first-level hard disk in the CDN system; The highest level of hard disk in the CDN system.

Optional,

After determining whether the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, the method further includes:

If the number of accesses of the first data resource is less than the first sub-thermal threshold, determining whether the number of accesses of the first data resource is greater than or equal to a second sub-thermal threshold;

If the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold, storing the first data resource in a second-level hard disk in the CDN system; It is lower than the level of the first-level hard disk.

Optionally, the first data resource is stored in the memory of the CDN system, including:

And if the number of accesses of the first data resource is less than the second sub-thermal threshold, storing the first data resource into the memory.

Optionally, after receiving the access request for the first data resource stored in the CDN system, the method further includes:

Querying whether the first data resource is stored in a storage medium of the CDN system;

If the first data resource is not stored in the storage medium of the CDN system, determining, according to the type of the first data resource, a level of the storage medium in the CDN system corresponding to the first data resource is a primary storage medium; the first level storage medium is a hard disk or a memory in the CDN system;

Obtaining the first data resource from a source station corresponding to the first data resource, and storing the first data resource in the first-level storage medium;

Returning the first data resource through the first level storage medium.

Optionally, the method further includes:

Counting the number of accesses of the M data resources stored in the second-level storage medium of the CDN system to obtain M access times; the second-level storage medium is the first-level hard disk or the second level in the CDN system Hard disk, M is a positive integer;

Determining whether the number of accesses of the M access times is lower than a second heat threshold;

If the first access number of the M access times is lower than the second heat threshold, determining whether there is a third-level storage medium in a level lower than a level of the second-level storage medium in the CDN system; The third level storage medium is a hard disk in the CDN system;

If the third-level storage medium exists, the second data resource of the M data resources corresponding to the first access number is stored in the third-level storage medium; otherwise, from the second level The second data resource is deleted from the storage medium.

The embodiment of the invention provides a data resource storage device, including:

a determining module, configured to determine whether the number of accesses of the first data resource stored in the content distribution network CDN system is greater than or equal to a first heat threshold;

a first operation module, configured to store the first data resource in a hard disk in the CDN system if the number of accesses of the first data resource is greater than or equal to the first heat threshold; otherwise, The first data resource is stored in a memory of the CDN system.

Optionally, the device further includes a receiving module and a second operating module;

The receiving module is configured to receive an access request for the first data resource;

The second operation module is configured to increase a number of accesses of the first data resource by a first value.

Optional,

The determining module is configured to: determine whether the number of accesses of the first data resource is greater than or equal to a first sub-thermal threshold;

The first operation module is configured to: when the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, storing the first data resource in a first-level hard disk in the CDN system The first level hard disk is the highest level hard disk in the CDN system.

Optional,

The determining module is configured to: after determining whether the number of accesses of the first data resource is greater than or equal to a first sub-thermal threshold, if the number of accesses of the first data resource is less than the first sub-thermal threshold, determining Whether the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold;

The first operation module is configured to: when the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold, storing the first data resource in a second-level hard disk in the CDN system The level of the second level hard disk is lower than the level of the first level hard disk.

Optionally, the first operation module is set to:

Optionally, the device further includes:

a query module configured to receive an access to the first data resource at the receiving module After the request, querying whether the first data resource is stored in a storage medium of the CDN system;

Determining, if the first data resource is not stored in the storage medium of the CDN system, determining, according to the type of the first data resource, the storage in the CDN system corresponding to the first data resource The level of the medium is a first level storage medium; the first level storage medium is a hard disk or a memory in the CDN system;

An acquiring module, configured to acquire the first data resource from a source station corresponding to the first data resource, and store the first data resource into the first-level storage medium;

Returning to the module, the setting is to return the first data resource by the first level storage medium.

Optionally, the device further includes:

a statistics module, configured to count the number of accesses of the M data resources stored in the second-level storage medium of the CDN system, to obtain M access times; the second-level storage medium is the first level in the CDN system Hard disk or second-level hard disk, M is a positive integer;

The determining module is further configured to determine, respectively, whether the number of accesses of the M access times is lower than a second heat threshold;

The determining module is further configured to determine, if the first access number of the M access times is lower than the second heat threshold, whether the level of the CDN system is lower than the second-level storage medium a third level storage medium of the level; the third level storage medium is a hard disk in the CDN system;

The first operation module is further configured to: if the third-level storage medium exists, store the second data resource of the M data resources corresponding to the first access times to the third-level storage medium And deleting the second data resource from the second level storage medium.

In the embodiment of the present invention, a computer storage medium is further provided, and the computer storage medium may store an execution instruction for executing the implementation of the data resource storage method in the foregoing embodiment.

One or both of the above technical solutions have at least the following technical effects:

In the embodiment of the present invention, the number of accesses of the data resource may be counted, that is, the data resource is analyzed. The access heat, if the number of accesses of the data resource is greater than the first heat threshold, indicating that the data resource is accessed more times, that is, the data resource is a hotspot resource, then the data resource can be stored in the CDN system. In a hard disk, in a CDN system, the performance of the hard disk is higher than that of the memory. The hotspot resource is stored in the hard disk, which can provide faster access speed for users to access more resources (ie hotspot resources), and ensure the smoothness of viewing as much as possible. To improve the user experience. In this way, the overall performance and utilization of the CDN system is improved by making rational use of various levels of storage media in the CDN system.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

FIG. 1 is a flowchart of a method for storing a data resource according to an embodiment of the present invention;

2 is a schematic diagram of a first structure of a CDN system according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a second structure of a CDN system according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

In the embodiment of the present invention, the CDN system may include a storage medium such as a hard disk and a memory. The hard disk may include multiple types, for example, an SSD (Solid State Drive) or a SATA (Serial Advanced Technology Attachment). Different types of hard drives.

In the CDN system, according to the technical solution of the embodiment of the present invention, the storage medium can be classified according to the performance of the cache, and the level of the cache performance is higher. For example, the cache performance of memory is generally not as good as that of the hard disk. Therefore, memory can be considered as a lower-level storage medium in the CDN system, and the cache performance of different hard disks is different. For example, the cache performance of SSD is generally better than SATA. The cache performance, such as the storage speed of the SSD, is generally higher than the storage speed of the SATA, so the SSD level can be considered higher than the SATA level, and so on.

In the embodiment of the present invention, the data resource can also be understood as a file, data, and the like.

The terms "system" and "network" in the embodiments of the present invention may be used interchangeably. "Multiple" means two or more. "and/or", describing the association relationship of the associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate that there are three cases where A exists separately, A and B exist at the same time, and B exists separately. In addition, the character "/", unless otherwise specified, generally indicates that the contextual object is an "or" relationship.

Preferred embodiments of the embodiments of the present invention are described below with reference to the accompanying drawings.

Referring to FIG. 1, an embodiment of the present invention provides a data resource storage method, and a process of the method is described as follows.

Step 101: Determine whether the number of accesses of the first data resource stored in the CDN system is greater than or equal to a first heat threshold.

Step 102: If the number of accesses of the first data resource is greater than or equal to the first heat threshold, the first data resource is stored in the hard disk in the CDN system; otherwise, the first data resource is stored in the memory of the CDN system.

Optionally, before step 101, the method may further include:

Receiving an access request for the first data resource;

The first value is added to the number of accesses of the first data resource, and the first value is, for example, 1, or may be other values.

The access request for the first data resource may be, for example, a user-initiated request, for example, the first data resource is a video resource, and the user may request to play or download the video resource or the like.

In the embodiment of the present invention, each time a request for one data resource is received, the counted number of accesses of the data resource may be incremented by one. For the heat statistics of the data resources, the statistics can be started from the time after the initialization of the CDN system, or the statistics can be started at any other time point, which is not limited by the present invention.

After the number of accesses of the first data resource is increased by one, it can be determined whether the total number of accesses of the first data resource is greater than or equal to the first heat threshold. If yes, the first data resource can be considered to be accessed more times. A hot data resource, the first data resource can be stored in the hard disk to improve the access speed of the first data resource, and the cache time of the first data resource is extended, and the first data resource is lost. Providing a better experience, and if the total number of accesses of the first data resource is less than the first heat threshold, then the first data resource can be considered to be accessed less frequently, which is a colder data resource, and then the first data can be The resources are placed in the memory, so that more storage space can be hollowed out on the hard disk to store more hot data resources, providing a better experience for most users. The first heat threshold can be set by the user or can be set by the system.

Optional,

Determining whether the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold;

If the number of accesses of the first data resource is greater than or equal to the first heat threshold, storing the first data resource in the hard disk in the CDN system, including:

If the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, the first data resource is stored in the first-level hard disk in the CDN system; the first-level hard disk is the highest-level hard disk in the CDN system.

After the number of accesses of the first data resource is increased by one, it can be determined whether the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, and the first sub-thermal threshold can be stored. The threshold of the first-level hard disk, the first-level hard disk can be the best hard disk in the CDN system, such as SSD, and of course other types of hard disk.

If the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, indicating that the first data resource is a hot resource, the first data resource may be stored in the first-level hard disk, and the first-level hard disk has the best cache performance. Because the first data resource has a large number of accesses, it can provide a better experience for more users.

Optionally, if the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, the query may determine whether the first data resource is stored in the second-level hard disk, and if so, the second-level hard disk may be directly The first data resource is re-stored in the first-level hard disk. If the first data resource is not stored in the second-level hard disk, the first data resource may be requested from the source station where the first data resource is located, and the first data resource may be obtained. The first data resource is stored in the first level hard disk.

Optional,

If the number of accesses of the first data resource is less than the first sub-thermal threshold, determining whether the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold;

If the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold, the first data resource is stored in the second-level hard disk in the CDN system; the level of the second-level hard disk is lower than the level of the first-level hard disk.

If the number of accesses of the first data resource is less than the first sub-thermal threshold, indicating that the first data resource has not reached the heat stored in the first-level hard disk, it may continue to determine whether the number of accesses of the first data resource is greater than or equal to the second. The sub-thermal threshold, the second sub-thermal threshold may be a threshold that can be stored in the second-level hard disk, and the second-level hard disk may be a hard disk with a cache performance lower than that of the first-level hard disk in the CDN system, for example, may be a cache in the CDN system. Performance is second only to the first level hard drive Hard drive. For example, if the first-level hard disk is an SSD, the second-level hard disk can be SATA, and of course other types of hard disks.

In addition, because the cache performance of the second-level hard disk is inferior to that of the first-level hard disk, the second sub-heat threshold is also smaller than the first sub-heat threshold. The threshold of the storage medium such as the first sub-heat threshold and the second sub-heat threshold may be set by the user, or may be set by the system itself, or may be set when the CDN system is shipped, etc., the present invention No restrictions.

If the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold, indicating that the first data resource is a hot data resource, the first data resource may be stored in the second-level hard disk, and the second-level hard disk is cached. The performance is also better, because the number of accesses to the first data resource is also more, which can provide a better experience.

Optionally, if the number of accesses of the first data resource is less than the first sub-thermal threshold and greater than or equal to the second sub-thermal threshold, the first data resource may be requested to be obtained from the source station where the first data resource is located, and the obtained first A data resource is stored in the first level hard disk.

If the number of accesses of the first data resource is less than the second sub-thermal threshold, the first data resource is stored in the memory.

In the embodiment of the present invention, if the number of accesses of the first data resource is also less than the second sub-thermal threshold, it indicates that the first data resource may be a relatively unpopular data resource, and the first data resource is stored to the hard disk without being stored in the hard disk. In memory.

Certainly, all the embodiments of the present invention are based on three levels of storage media (ie, memory and two levels of hard disks) in the CDN system. In practical applications, the CDN system may have multiple types of hard disks. Then, it is equivalent to a hard disk having multiple levels, for example, there may be three levels or four levels of hard disks, etc., according to the solution provided by the embodiment of the present invention, it is possible to sequentially determine whether each level is satisfied for one data resource. It is suitable to determine the threshold of the storage medium, so that it can be determined in which level of the storage medium the data resource is stored. For details, refer to the introduction above, and those skilled in the art naturally know how many levels of storage media are included in the CDN system. , the solution to store data resources into a reasonable storage medium is Within the scope of protection of the present invention.

The foregoing describes that after receiving a request for a data resource by a user, by counting the heat of the data resource, it is determined to which storage medium the data resource should be stored, and after receiving the user's request for a certain data resource. The CDN system should also provide the user with the data resources requested by the user in response to the user's request. This section is described below.

Query whether the first data resource is stored in a storage medium of the CDN system;

If the first data resource is not stored in the storage medium of the CDN system, determining, according to the type of the first data resource, the level of the storage medium in the CDN system corresponding to the first data resource is a first-level storage medium; the first-level storage medium a hard disk or memory in a CDN system;

Acquiring the first data resource from the source station corresponding to the first data resource, and storing the first data resource in the first-level storage medium;

The first data resource is returned through the first level storage medium.

After receiving the access request for the first data resource stored in the CDN system, first look at whether the first data resource has been stored in the storage medium of the CDN system, and if it has been stored, for example, stored in the first-level storage medium, The first data resource can then be returned to the user directly through the first level storage medium. If the first data resource is not stored, the CDN system may determine, according to the type of the first data resource, which level of the storage medium the first data resource should be stored in, for example, a video resource, for example, if the data is a live type service. Resources, which are less demanding on the cache, can be determined to be serviced through the memory, and if it is a data resource corresponding to the service of the on-demand type, it can be determined that the service is performed through a lower level of film review, such as SATA.

If the first data resource is not stored in the storage medium of the CDN system, the CDN system requests the source station where the first data resource is located to obtain the first data resource, and stores the obtained first data resource into the first-level storage medium. The first data resource is returned to the user through the first level storage medium to complete the response to the user's request.

After storing the obtained first data resource to the first level storage medium, or if the first After the data resource is stored in the first level storage medium, after determining that the first data resource is stored in the first storage medium, step 103 may be performed to determine whether to continue storing the first data resource in the first level storage medium. in.

Since the heat statistics of the CDN system are based on the number of accesses to the data resources, the number of accesses is cumulative. When a data resource that is not very hot is accumulated for a long time, the number of accesses may be relatively large, thus forming a pseudo hotspot. . The main purpose of the following is to eliminate such pseudo hotspots.

Optionally, the method further includes:

Counting the number of accesses of M data resources stored in the second-level storage medium of the CDN system, and obtaining M access times; the second-level storage medium is the first-level hard disk or the second-level hard disk in the CDN system, and M is a positive integer ;

Determining whether the number of accesses of the M access times is lower than the second heat threshold;

If the first access number of the M access times is lower than the second heat threshold, determining whether there is a third-level storage medium whose level is lower than the level of the second-level storage medium in the CDN system; the third-level storage medium is a hard disk in a CDN system;

If there is a third-level storage medium, storing the second data resource of the M data resources corresponding to the first access number into the third-level storage medium; otherwise, deleting the second data resource from the second-level storage medium .

The second level storage medium may be any level of hard disk in the CDN system, that is, the pseudo hotspot may be eliminated by performing the above process for each level of the hard disk in the CDN system.

For example, the number of accesses of the M data resources stored in the second-level storage medium may be periodically or periodically counted, and the M data resources may be all data resources stored in the second-level storage medium, or may be second-level storage. The data resources stored in the medium are not limited in the present invention.

Optionally, because the hotspot statistics may last for a long time, the value of the number of accesses may be large, which is convenient for calculation, and is more suitable for the second heat threshold mentioned later, after obtaining M actual access times. For each actual number of M actual visits, A fixed value is subtracted, for example, k (k is a positive integer). If the actual number of accesses of the data resource 1 is n before the subtraction, the number of accesses of the obtained data resource 1 is n-k.

After subtracting k from each of the M actual access times, the number of M accesses obtained as a premise is obtained, and whether there are access times below the second heat threshold can be separately determined.

The second heat threshold may be a threshold that is removed from the second storage medium. For example, if the second storage medium is a first-level hard disk, the first sub-heat threshold is a threshold stored in the first-level hard disk, and the second heat threshold is a threshold removed from the first-level hard disk, the first sub-heat threshold The second heat threshold may be equal to, or the first child heat threshold may be greater than the second heat threshold.

For example, among the M access times, the first access number is lower than the second heat threshold, then the data resource corresponding to the first access number may be considered (for example, referred to as the second data resource, and the second data resource and the first data resource may be the same The data resource, or it may be a different data resource, is a pseudo hotspot. It can be seen whether there is a hard disk in the CDN system whose level is lower than the level of the second storage medium. For example, if the hard disk of the CDN system includes the first-level hard disk and the second-level hard disk, if the second-level storage medium is the first-level hard disk, then the second-level hard disk has a lower level than the first-level hard disk, and if the second-level hard disk is lower than the first-level hard disk, and if the second The level storage medium is a second-level hard disk, so there is no other hard disk in the CDN system that is lower than the second-level hard disk.

If there is a third level storage medium in the CDN system lower than the second level storage medium, then the second data resource can be moved from the second level storage medium to the third level storage medium, and if the CDN system is in the CDN system There is no hard disk lower than the second-level storage medium, and the second data resource can be directly deleted from the second-level storage medium.

The embodiment of the invention implements a method for implementing hierarchical storage of resources in a CDN system, and the access awareness of the user can be improved by using the method, and the faster access speed is provided for the hotspot resource, and the device cost is also considered. To maximize revenue.

Through the foregoing, resource grading storage based on user request can be implemented in the CDN system.

The system and apparatus in the embodiments of the present invention will be described below with reference to the accompanying drawings.

2 is a schematic diagram of the function of a component module for implementing multi-level storage of a CDN system according to the present invention, which includes:

Protocol identification and processing module: The module is responsible for receiving the request protocol packet of the client, parsing the type of the request according to the configured parsing rule, and determining whether it is a content request that needs to be hierarchically cached. For example, through the filtering control of the regular expression, it is parsed out which of the user's requests are requesting the live type data resource, and which are requesting the on-demand type data resources, and then distinguishing the storage policy. For content that needs to be stored hierarchically, the request is forwarded to the storage scheduling module for processing.

Storage scheduling module: responsible for controlling the storage path selection of data resources, and storing the data resources on a specified storage medium. At the same time, it is responsible for the scheduling control of hot and cold sheets (ie, unpopular resources and hotspot resources), transferring hotspot resources to a higher level storage medium, and transferring cold resource scheduling to lower level storage media. At the same time, maintain a list of the contents of all cached data resources in the system for use during scheduling.

The heat statistics module is responsible for counting and maintaining the number of accesses of each data resource, forming the click heat information, and periodically refreshing the heat information, forming the mutual rotation of the hot and cold sheets through the change of the heat information, and notifying the storage scheduling module to perform the hot and cold sheet. Schedule transfer.

Multi-level storage module: Responsible for managing all storage media and providing management functions. When data resources are transferred to storage media, they are responsible for implementing migration and copying of data resources. At the same time, it is responsible for implementing the LRU (Least Recently Used) elimination algorithm, and automatically eliminates the most frequently accessed content when the storage area is full.

The source download module: implements the return source download function of the data resource (that is, the source station request data where the data resource is located), and when the data resource has not been cached, the content is pulled back to the source station through the source download module, and transmitted to the storage module. Save the drop-down data resource.

The CDN system in FIG. 2 includes a multi-level storage module, for example, three-level storage, such as memory, SSD, and SATA.

The user can send a request through a terminal (or a client), for example, a mobile phone, a PC (personal computer), an STB (Set Top Box), and the like shown in FIG. 2, Or it can be other types of devices.

Referring to FIG. 3, based on the same inventive concept, an embodiment of the present invention provides a data resource storage device, which may be, for example, the CDN system itself, or may be a functional module located in a CDN system. The apparatus can include a determination module 301 and a first operational module 302.

The determining module 301 is configured to determine whether the number of accesses of the first data resource stored in the CDN system is greater than or equal to a first heat threshold;

The first operation module 302 is configured to store the first data resource in a hard disk in the CDN system if the number of accesses of the first data resource is greater than or equal to the first heat threshold; otherwise, store the first data resource in the CDN system. In memory.

Optionally, the device may further include a receiving module and a second operating module;

a receiving module, configured to receive an access request for the first data resource;

The second operation module is configured to increase the number of accesses of the first data resource by a first value.

Optional,

The determining module 301 is configured to: determine whether the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold;

The first operation module 302 is configured to: if the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, store the first data resource in the first-level hard disk in the CDN system; the first-level hard disk is in the CDN system The highest level of hard drive.

Optional,

The determining module 301 is configured to: after determining whether the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, if the number of accesses of the first data resource is less than the first sub-thermal threshold, determining whether the number of accesses of the first data resource is greater than Equal to the second sub-thermal threshold;

The first operation module 302 is configured to: if the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold, store the first data resource in the second-level hard disk in the CDN system; the level of the second-level hard disk is lower than The level of the first level of the hard disk.

Optionally, the first operation module 302 is configured to:

Optionally, the device further includes:

a query module, configured to query, after the receiving module receives an access request for the first data resource stored in the CDN system, whether the first data resource is stored in a storage medium of the CDN system;

Determining a module, if the first data resource is not stored in the storage medium of the CDN system, determining, according to the type of the first data resource, a level of the storage medium in the CDN system corresponding to the first data resource as a first level storage medium; The first level storage medium is a hard disk or a memory in the CDN system;

An acquiring module, configured to acquire a first data resource from a source station corresponding to the first data resource, and store the first data resource in the first-level storage medium;

Returning to the module, set to return the first data resource through the first level storage medium.

Optionally, the device further includes:

The statistics module is configured to count the number of accesses of the M data resources stored in the second-level storage medium of the CDN system, and obtain M access times; the second-level storage medium is the first-level hard disk or the second-level hard disk in the CDN system. , M is a positive integer;

The determining module 301 is further configured to determine whether the number of accesses of the M access times is lower than the second heat threshold;

The determining module 301 is further configured to: if the first access number of the M access times is lower than the second heat threshold, determine whether there is a third-level storage medium whose level is lower than the level of the second-level storage medium in the CDN system; The tertiary storage medium is a hard disk in the CDN system;

The first operation module 302 is further configured to: if the third-level storage medium exists, store the second data resource of the M data resources corresponding to the first access number into the third-level storage medium; otherwise, store from the second-level storage medium; The second data resource is deleted from the media.

In the embodiment of the present invention, when receiving an access request for a data resource, the number of accesses of the data resource may be counted, that is, the access heat of the data resource is analyzed, and if the number of accesses of the data resource is greater than the first heat threshold, The data resource is accessed more times, too It is to say that the data resource is a hotspot resource, and then the data resource can be stored in the hard disk of the CDN system. In the CDN system, the performance of the hard disk is higher than the performance of the memory, and the hotspot resource is stored in the hard disk, which can be accessed for the user. More resources (ie hotspot resources) provide faster access speed, try to ensure the smoothness of viewing and improve the user experience. In this way, the overall performance and utilization of the CDN system is improved by making rational use of various levels of storage media in the CDN system.

It will be clearly understood by those skilled in the art that for the convenience and brevity of the description, only the division of each functional unit described above is exemplified. In practical applications, the above function assignment can be completed by different functional units as needed. The internal structure of the device is divided into different functional units to perform all or part of the functions described above. For the specific working process of the system, the device and the unit described above, reference may be made to the corresponding process in the foregoing method embodiments, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit or unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit is implemented as a software functional unit and as a standalone product When sold or used, it can be stored on a computer readable storage medium. Based on such understanding, the technical solution of the present application, in essence or the contribution to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a ROM (Read-Only Memory), a RAM, a magnetic disk, or an optical disk, and the like, which can store program codes.

The above embodiments are only used to describe the technical solutions of the present application in detail, but the description of the above embodiments is only for helping to understand the method and the core idea of the present invention, and should not be construed as limiting the present invention. Those skilled in the art will be able to devise variations or alternatives within the scope of the present invention within the scope of the present invention.

Industrial applicability

The foregoing technical solution provided by the embodiment of the present invention may be applied to a data resource storage process, and may count the number of accesses of the data resource, that is, analyze the access heat of the data resource, and if the number of accesses of the data resource is greater than the first heat threshold, The data resource is accessed more frequently, that is to say, the data resource is a hot resource, and then the data resource can be stored in the hard disk of the CDN system. In the CDN system, the performance of the hard disk is higher than the performance of the memory, and the hot spot is The resources are stored on the hard disk, which can provide faster access speed for users to access more resources (ie, hotspot resources), and ensure the smoothness of viewing as much as possible. In this way, the overall performance and utilization of the CDN system is improved by making rational use of various levels of storage media in the CDN system.

Claims

A data resource storage method includes:

Determining whether the number of accesses of the first data resource stored in the content distribution network CDN system is greater than or equal to a first heat threshold;

If the number of accesses of the first data resource is greater than or equal to the first heat threshold, storing the first data resource into a hard disk in the CDN system; otherwise, storing the first data resource to the In the memory of the CDN system.
The method of claim 1 further comprising:

Receiving an access request for the first data resource;

The number of accesses of the first data resource is increased by a first value.
The method of claim 2, wherein

Determining whether the number of accesses of the first data resource stored in the CDN system is greater than or equal to the first heat threshold, including:

Determining whether the number of accesses of the first data resource is greater than or equal to a first sub-thermal threshold;

And if the number of times of accessing the first data resource is greater than or equal to the first heat threshold, storing the first data resource in a hard disk in the CDN system, including:

If the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, storing the first data resource in a first-level hard disk in the CDN system; The highest level of hard disk in the CDN system.
The method of claim 3, wherein

Determining whether the number of accesses of the first data resource is greater than or equal to the first sub-heat After the threshold, it also includes:

If the number of accesses of the first data resource is less than the first sub-thermal threshold, determining whether the number of accesses of the first data resource is greater than or equal to a second sub-thermal threshold;

And if the number of times of accessing the first data resource is greater than or equal to the first heat threshold, storing the first data resource in a hard disk in the CDN system, including:

If the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold, storing the first data resource in a second-level hard disk in the CDN system; It is lower than the level of the first-level hard disk.
The method of claim 4, wherein otherwise storing the first data resource in a memory of the CDN system comprises:

And if the number of accesses of the first data resource is less than the second sub-thermal threshold, storing the first data resource into the memory.
The method of any of claims 2-5, wherein after receiving the access request for the first data resource, the method further comprises:

Querying whether the first data resource is stored in a storage medium of the CDN system;

If the first data resource is not stored in the storage medium of the CDN system, determining, according to the type of the first data resource, a level of the storage medium in the CDN system corresponding to the first data resource is a primary storage medium; the first level storage medium is a hard disk or a memory in the CDN system;

Obtaining the first data resource from a source station corresponding to the first data resource, and storing the first data resource in the first-level storage medium;

Returning the first data resource through the first level storage medium.
The method of any of claims 1-5, wherein the method further comprises:

Counting the number of accesses of the M data resources stored in the second-level storage medium of the CDN system to obtain M access times; the second-level storage medium is the first-level hard disk or the second level in the CDN system Hard disk, M is a positive integer;

Determining whether the number of accesses of the M access times is lower than a second heat threshold;

If the first access number of the M access times is lower than the second heat threshold, determining whether there is a third-level storage medium in a level lower than a level of the second-level storage medium in the CDN system; The third level storage medium is a hard disk in the CDN system;

If the third-level storage medium exists, the second data resource of the M data resources corresponding to the first access number is stored in the third-level storage medium; otherwise, from the second level The second data resource is deleted from the storage medium.
A data resource storage device includes:

a determining module, configured to determine whether the number of accesses of the first data resource stored in the content distribution network CDN system is greater than or equal to a first heat threshold;

a first operation module, configured to store the first data resource in a hard disk in the CDN system if the number of accesses of the first data resource is greater than or equal to the first heat threshold; otherwise, The first data resource is stored in a memory of the CDN system.
The device of claim 8 wherein said device further comprises a receiving module and a second operating module;

The receiving module is configured to receive an access request for the first data resource;

The second operation module is configured to increase a number of accesses of the first data resource by a first value.
The device according to claim 9, wherein

The determining module is configured to: determine whether the number of accesses of the first data resource is greater than or equal to a first sub-thermal threshold;

The first operation module is configured to: when the number of accesses of the first data resource is greater than or equal to the first sub-thermal threshold, storing the first data resource in a first-level hard disk in the CDN system The first level hard disk is the highest level hard disk in the CDN system.
The device of claim 10, wherein

The determining module is configured to: after determining whether the number of accesses of the first data resource is greater than or equal to a first sub-thermal threshold, if the number of accesses of the first data resource is less than the first sub-thermal threshold, determining Whether the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold;

The second operation module is configured to: when the number of accesses of the first data resource is greater than or equal to the second sub-thermal threshold, storing the first data resource in a second-level hard disk in the CDN system The level of the second level hard disk is lower than the level of the first level hard disk.
The apparatus of claim 11 wherein said first operational module is configured to:

And if the number of accesses of the first data resource is less than the second sub-thermal threshold, storing the first data resource into the memory.
The device of any of claims 9-12, wherein the device further comprises:

a query module, configured to query, after the receiving module receives an access request for the first data resource, whether the first data resource is stored in the CDN system In the storage medium;

Determining, if the first data resource is not stored in the storage medium of the CDN system, determining, according to the type of the first data resource, the storage in the CDN system corresponding to the first data resource The level of the medium is a first level storage medium; the first level storage medium is a hard disk or a memory in the CDN system;

An acquiring module, configured to acquire the first data resource from a source station corresponding to the first data resource, and store the first data resource into the first-level storage medium;

Returning to the module, the setting is to return the first data resource by the first level storage medium.
The device of any of claims 8-12, wherein the device further comprises:

a statistics module, configured to count the number of accesses of the M data resources stored in the second-level storage medium of the CDN system, to obtain M access times; the second-level storage medium is the first level in the CDN system Hard disk or second-level hard disk, M is a positive integer;

The determining module is further configured to determine, respectively, whether the number of accesses of the M access times is lower than a second heat threshold;

The determining module is further configured to determine, if the first access number of the M access times is lower than the second heat threshold, whether the level of the CDN system is lower than the second-level storage medium a third level storage medium of the level; the third level storage medium is a hard disk in the CDN system;

The first operation module is further configured to: if the third-level storage medium exists, store the second data resource of the M data resources corresponding to the first access times to the third-level storage medium And deleting the second data resource from the second level storage medium.