CN105183389A - Level-to-level data management method and device and electronic equipment - Google Patents

Level-to-level data management method and device and electronic equipment Download PDF

Info

Publication number
CN105183389A
CN105183389A CN 201510587108 CN201510587108A CN105183389A CN 105183389 A CN105183389 A CN 105183389A CN 201510587108 CN201510587108 CN 201510587108 CN 201510587108 A CN201510587108 A CN 201510587108A CN 105183389 A CN105183389 A CN 105183389A
Authority
CN
Grant status
Application
Patent type
Prior art keywords
data
storage unit
target
access
frequency
Prior art date
Application number
CN 201510587108
Other languages
Chinese (zh)
Inventor
周琦
Original Assignee
北京金山安全软件有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Abstract

The embodiment of the invention discloses a level-to-level data management method and device and electronic equipment, relates to the technical field of computer application and solves the problem that in the prior art, the overall data storage cost is high. The level-to-level data management method comprises the steps of receiving a data acquisition request sent by a client end, wherein the data acquisition request contains file information of a target datum which the client end requests to acquire; according to the file information of the target datum which the client end requests to acquire, acquiring a data unification mark of the target datum; according to the data unification mark of the target datum, determining a storage unit where the target datum is stored at present, wherein different storage units store data of different access frequency levels; getting the target datum out of the storage unit where the target datum is stored at present, and sending the datum to the client end. The level-to-level data management method and device and the electronic equipment are mainly used for conducting level-to-level management on the data of different access frequency levels.

Description

一种数据分级管理方法、装置及电子设备 A data classification management method, apparatus and an electronic device

技术领域 FIELD

[0001] 本发明涉及计算机应用技术领域,尤其涉及一种数据分级管理方法、装置及电子设备。 [0001] The present invention relates to a computer application technology, and in particular, to a hierarchical data management method, apparatus and an electronic device.

背景技术 Background technique

[0002] 云存储是在云计算概念上延伸和发展出来的一个新的概念,是一种新兴的网络存储技术,是指通过集群应用、网络技术或分布式文件系统等功能,将网络中大量各种不同类型的存储设备通过应用软件集合起来协同工作,共同对外提供数据存储和业务访问功能。 [0002] Cloud storage is a new concept and extending in the cloud developed concept is a new network storage technology, refers to cluster applications, internet or other functions distributed file system, a large number of network a variety of different types of storage devices through a set of software applications to work together to jointly provide external data storage and business access. 目前,云存储已经成为一种基础服务,互联网用户无一不在主动或是被动地使用云存储服务,完成各种数据的备份、恢复、同步、升级等。 At present, cloud storage has become a basic service, Internet users are all in an active or passive use of cloud storage services, to complete a variety of data backup, recovery, synchronization, upgrades and so on.

[0003]目前,对于提供云存储服务的厂商而言,在对数据进行管理时,将所有的数据存储在同一存储单元中,用户请求访问的数据,都从该存储单元中调取。 [0003] Currently, manufacturers provide for cloud storage service, at the time management data, all the data stored in the same storage unit, the user requests access to the data, are retrieved from the storage unit.

[0004] 在实现本发明的过程中,发明人发现现有技术中至少存在如下技术问题: [0004] During the implementation of the present invention, the inventor finds at least the following technical problems in the prior art:

[0005] 不同访问频度级别的数据都存储在同一存储单元中,为了保证所有访问频度级别的数据的响应速度,该存储单元需要根据高访问频度级别的数据进行设置,而用于存储高访问频度级别的数据的存储单元的成本较高,从而使得数据的整体存储成本较高。 [0005] Different levels of access frequency data are stored in the same storage unit, to ensure the response speed for all level of access frequency data, the memory cell needs to be set high-level access frequency data, and for storing higher cost level of the memory cell of the high access frequency data, so that the overall high cost of data storage.

发明内容 SUMMARY

[0006] 有鉴于此,本发明实施例提供的数据分级管理方法及装置,可以解决如何降低数据的整体存储成本的问题。 [0006] In view of this, hierarchical data management method and apparatus provided by the present invention can solve the problem of how to reduce the overall cost of storing data.

[0007] 第一方面,本发明实施例提供一种数据分级管理方法,包括: [0007] In a first aspect, embodiments of the present invention provides a hierarchical data management method, comprising:

[0008] 接收客户端发送的数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件信息; [0008] Data sent by a client request for obtaining said data information file acquisition request includes the client request target data acquired;

[0009] 根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记; [0009] The file information of the client request acquired target data, the target data obtaining uniform marking;

[0010] 根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元,其中,不同的存储单元存储有不同访问频度级别的数据; [0010] The data collectively labeled the target data, the target data storage unit determining the current location, wherein the storage unit stores different frequencies have different levels of data access;

[0011 ] 由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 [0011] The storage unit is currently located by the target data in the retrieval target data is sent to the client.

[0012] 可选的,所述根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元包括: [0012] Optionally, according to the data of the target data collectively labeled, determining a target data memory cell current location comprises:

[0013] 根据所述目标数据的数据统一标记,向状态数据库发送数据查询请求,其中,所述状态数据库记录有数据统一标记与数据所在存储单元的对应关系; [0013] The data collectively labeled the target data, the data transmission state query request to the database, wherein the database records the state of correspondence between the data collectively labeled with the storage unit storing data;

[0014] 接收状态数据库返回的查询结果,所述查询结果显示所述目标数据当前所在的存储单元。 [0014] The reception state database query results returned, the query results are displayed target data of the memory cell is currently located.

[0015] 可选的,所述方法还包括: [0015] Optionally, the method further comprising:

[0016] 定期对各存储单元中的数据进行扫描; [0016] The data in each memory cell periodically to the scanning;

[0017] 若存储单元中的一个或多个数据在预定时间内的访问频度低于当前所在的存储单元设置的访问频度,则将所述一个或多个数据由当前所在的存储单元迀移至访问频度低一级别的存储单元; [0017] If one or more data storage unit access frequency within a predetermined time is less than the current access frequency of the memory cell is located set, then one or more of the data by the storage unit is currently located Gan move to a low access frequency level memory cells;

[0018] 若存储单元中的一个或多个数据在预定时间内的访问频度高于当前所在的存储单元设置的访问频度,则将所述一个或多个数据由当前所在的存储单元迀移至访问频度高一级别的存储单元; [0018] If one or more data storage unit access frequency within a predetermined time is higher than the access frequency of the memory cell current location set, then the one or more data Gan current location by the storage unit move to a high level of memory access unit frequency;

[0019] 对所述状态数据库中数据统一标记与数据所在存储单元的对应关系进行更新。 [0019] corresponding to the state of the data in a relational database with the data collectively labeled storage unit storing update.

[0020] 可选的,所述方法还包括: [0020] Optionally, the method further comprising:

[0021 ] 对新数据的访问频度进行评估,根据评估出的新数据的访问频度所属的访问频度级别,将所述新数据存放至所述所属的访问频度级别对应的存储单元中。 [0021] The access frequency of new data to evaluate, according to a new data access evaluation frequency level access frequency belongs, storing the new data belongs to the access frequency corresponding to the level storage unit .

[0022] 可选的,在所述根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记之前,所述方法还包括: Before [0022] Alternatively, the target file according to the information requested by the client data acquisition, the target data obtaining uniform marking, said method further comprising:

[0023] 查询数据缓存中是否存储有所述目标数据; Whether the target data is stored [0023] query data cache;

[0024] 若所述数据缓存中存储有所述目标数据,则将所述目标数据所在数据缓存的地址发送给所述客户端,以使所述客户端根据所述目标数据所在数据缓存的地址获取所述目标数据。 [0024] If the data stored in the cache data for the target, then the target data resides in the data cache address is sent to the client so that the client data cache where the data according to the destination address acquiring the target data.

[0025] 第二方面,本发明实施例提供一种数据分级管理装置,包括: [0025] a second aspect, embodiments of the present invention provides a hierarchical data management apparatus, comprising:

[0026] 接收单元,用于接收客户端发送的数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件信息; [0026] a receiving unit for receiving data sent by a client request for obtaining said data information file acquisition request includes the client request target data acquired;

[0027] 获取单元,用于根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记; [0027] The acquisition unit for file information according to the target client request to obtain the data, the target data acquiring data unity mark;

[0028] 确定单元,用于根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元; [0028] The determination unit configured to collectively labeled the target data based on the data, determining the target data storage unit is currently located;

[0029] 至少两个存储单元,用于分别存储不同访问频度级别的数据; [0029] at least two memory units for storing different levels of data access frequency, respectively;

[0030] 调取和发送单元,用于由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 [0030] The retrieval and transmission unit, a storage unit is currently located by the target data in the retrieval target data is sent to the client.

[0031] 可选的,所述确定单元包括: [0031] Optionally, the determining unit comprises:

[0032] 发送模块,用于根据所述目标数据的数据统一标记,向状态数据库发送数据查询请求,其中,所述状态数据库记录有数据统一标记与数据所在存储单元的对应关系; [0032] The transmission module, for collectively labeled the target data according to the data, the data transmission state query request to the database, wherein the database records the state of correspondence between the data collectively labeled with the storage unit storing data;

[0033] 接收模块,用于接收状态数据库返回的查询结果,所述查询结果显示所述目标数据当前所在的存储单元。 [0033] The receiving module for receiving the status query results returned by the database, the query results are displayed target data of the memory cell is currently located.

[0034] 可选的,所述装置还包括: [0034] Optionally, the apparatus further comprising:

[0035] 扫描单元,用于定期对各存储单元中的数据进行扫描; [0035] The scanning unit that periodically the data storage unit in each scanning;

[0036] 迀移单元,用于当存储单元中的一个或多个数据在预定时间内的访问频度低于当前所在的存储单元设置的访问频度时,将所述一个或多个数据由当前所在的存储单元迀移至访问频度低一级别的存储单元,以及当存储单元中的一个或多个数据在预定时间内的访问频度高于当前所在的存储单元设置的访问频度时,将所述一个或多个数据由当前所在的存储单元迀移至访问频度高一级别的存储单元; [0036] Gan shift unit, a memory unit for, when one or more data access frequency within a predetermined time is less than the current access frequency of the memory cell is located set, the data generated by one or more the storage unit is currently located Gan low access frequency moves to a level of a storage unit, and when one or more data storage unit access frequency within a predetermined time is higher than the access frequency of the memory cell when the current location is provided , the one or more data storage units is currently located by the move Gan a high access frequency level memory cell;

[0037] 更新单元,用于在所述迀移单元将所述一个或多个数据由当前所在的存储单元迀移至访问频度低一级别或访问频度高一级别的存储单元之后,对所述状态数据库中数据统一标记与数据所在存储单元的对应关系进行更新。 [0037] updating unit, for the Gan the shift unit to move from the one or more data storage unit Gan access frequency is currently located after a low level or a high level of storage access unit frequency, for corresponding relationship between the status data in a database where the data mark and unified storage unit to be updated.

[0038] 可选的,所述装置还包括: [0038] Optionally, the apparatus further comprising:

[0039] 评估单元,用于对新数据的访问频度进行评估,根据评估出的新数据的访问频度所属的访问频度级别,将所述新数据存放至所述所属的访问频度级别对应的存储单元中。 [0039] The evaluation unit for evaluation of the frequency of access to new data, according to the access frequency of a new level of data access evaluation frequency belongs, storing the new data belongs to the access frequency level corresponding to the storage unit.

[0040] 可选的,所述装置还包括: [0040] Optionally, the apparatus further comprising:

[0041] 查询单元,用于查询数据缓存中是否存储有所述目标数据; [0041] querying unit configured to query whether the target data is stored in the data cache;

[0042] 发送单元,用于当所述数据缓存中存储有所述目标数据时,将所述目标数据所在数据缓存的地址发送给所述客户端,以使所述客户端根据所述目标数据所在数据缓存的地址获取所述目标数据; [0042] transmitting means for, when the data stored in the buffer for the target data, to transmit the target data resides in the data cache address to the client, so the client data according to the target where the data cache address acquiring the target data;

[0043] 当所述数据缓存中没有存储所述目标数据时,所述调取和发送单元由所述目标数据当前所在的存储单元中调取目标数据,发送至所述客户端。 [0043] When the data buffer is not stored in the target data, the storage unit and transmitting the retrieved data by the target unit is currently located retrieval target data, is sent to the client.

[0044] 第三方面,本发明实施例还提供了一种电子设备,可以包括: [0044] a third aspect, embodiments of the present invention further provides an electronic device, may include:

[0045] 一个或者多个处理器; [0045] The one or more processors;

[0046] 存储器; [0046] memory;

[0047] —个或者多个模块,所述一个或者多个模块存储在所述存储器中,当被所述一个或者多个处理器执行时进行如下操作: [0047] - one or more modules, the one or more modules stored in the memory, the following operation when the one or more processors to perform:

[0048] 接收客户端发送的数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件信息; [0048] Data sent by the client receives the acquisition request, the data acquisition request message includes a target file data requested by the client acquired;

[0049] 根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记; [0049] The file information of the client request acquired target data, the target data obtaining uniform marking;

[0050] 根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元,其中,不同的存储单元存储有不同访问频度级别的数据; [0050] The data collectively labeled the target data, the target data storage unit determining the current location, wherein the storage unit stores different frequencies have different levels of data access;

[0051 ] 由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 [0051] The storage unit is currently located by the target data in the retrieval target data is sent to the client.

[0052] 第四方面,本发明实施例还提供了一种存储介质,用于存储应用程序,所述应用程序用于执行本发明实施例所提供的一种数据分级管理方法。 [0052] The fourth aspect, embodiments of the present invention further provides a storage medium for storing the application program, the application program for performing one hierarchical data management method provided by the embodiment of the present invention.

[0053] 第五方面,本发明实施例还提供了一种应用程序,用于执行本发明实施例所提供的一种数据分级管理方法。 [0053] a fifth aspect, embodiments of the present invention further provides an application, to perform a hierarchical data management method provided by the embodiment of the present invention.

[0054] 在本发明中,根据客户端请求获取的目标数据的文件信息,获取目标数据的数据统一标记,并据此确定目标数据当前所在的存储单元,其中,不同的存储单元存储有不同访问频度级别的数据,由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 [0054] In the present invention, the target file information request to obtain the client data, to obtain data collectively labeled target data, and accordingly determining the target data storage unit is currently located, wherein the storage unit stores different access different frequency level data, the storage unit is currently located by the target data in the retrieval target data is sent to the client. 与现有技术相比,本发明将不同访问频度级别的数据分别存储在不同的存储单元中,并根据客户端的数据获取请求由该数据当前所在的存储单元中进行数据调取,从而能够在保证不同访问频度级别的数据的响应速度的同时,降低数据的整体存储成本。 Compared with the prior art, the present invention different levels of data access frequency are stored in a different storage unit, the client and the data acquisition request by the data storage unit is currently located in the data retrieval, it is possible in to ensure the response speed of the different levels of access frequency data, while reducing the overall cost of storing data.

附图说明 BRIEF DESCRIPTION

[0055] 为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。 [0055] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, as briefly described in the introduction to the accompanying drawings required for use in describing the embodiments. Apparently, the drawings in the following description are only some of the present invention. embodiments, those of ordinary skill in the art is concerned, without creative efforts, can derive from these drawings other drawings.

[0056] 图1为本发明数据分级管理方法一实施例的流程示意图; [0056] FIG. 1 is a schematic flow embodiment hierarchical data management method of an embodiment of the invention;

[0057]图2为本发明数据分级管理方法另一实施例的流程示意图; [0057] FIG. 2 is a schematic flow diagram illustrating a data example of hierarchical management method according to another embodiment of the invention;

[0058]图3为本发明数据分级管理方法另一实施例的流程示意图; [0058] FIG. 3 is a flow diagram of another embodiment example of hierarchical data management method of the invention;

[0059]图4为本发明数据分级管理方法另一实施例的流程示意图; Example data flow [0059] Figure 4 is another embodiment of the invention hierarchical management method schematic;

[0060] 图5为本发明数据分级管理装置一实施例的结构示意图; [0060] FIG. 5 is a schematic configuration example of a data classification management apparatus embodiment of the present invention;

[0061] 图6为本发明数据分级管理装置另一实施例的结构示意图; [0061] FIG. 6 is a schematic structural diagram of another embodiment of the present invention, a data classification management apparatus;

[0062]图7为本发明数据分级管理装置另一实施例的结构示意图。 [0062] FIG. 7 is a schematic configuration example of a hierarchical data management apparatus to another embodiment of the present invention.

具体实施方式 detailed description

[0063] 下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。 [0063] below in conjunction with the present invention in the accompanying drawings, technical solutions of embodiments of the present invention are clearly and completely described, obviously, the described embodiments are merely part of embodiments of the present invention, but not all embodiments example. 基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例,都属于本发明保护的范围。 Based on the embodiments of the present invention, all other embodiments of ordinary skill in the art without any creative effort shall fall within the scope of the present invention.

[0064] 参看图1,本发明实施例提供一种数据分级管理方法,包括: [0064] Referring to Figure 1, embodiments of the present invention provides a hierarchical data management method, comprising:

[0065] S11、接收客户端发送的数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件信息; [0065] S11, the received data acquisition request sent by the client, the data acquisition request message includes a target file data requested by the client acquired;

[0066] 其中,所述文件信息包括表示所述目标数据的相关信息,可以为文件名、URL (Uniform Resource Locator,统一资源定位器)地址,但不仅限于此。 [0066] wherein the file information includes information related to the target data, which can be a file name, URL (Uniform Resource Locator, Uniform Resource Locator) address, but is not limited to this.

[0067] S12、根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记; [0067] S12, according to the file information acquired by the client request target data, the target data obtaining uniform marking;

[0068] 其中,所述目标数据的数据统一标记由全球统一标记生成器生成,不管所述目标数据的文件信息为文件名、地址,或者是其他标识,该全球统一标记生成器都会根据所述目标数据的文件信息,生成格式统一且唯一标识的数据统一标记。 [0068] wherein, the target data generated by the data collectively labeled GHS marker generator, regardless of whether the target data file name for the file information, address, or other identifier, which are globally consistent marker generator according to the file information of the target data, and generate a unified format that uniquely identifies the data collectively labeled.

[0069] S13、根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元,其中,不同的存储单元存储有不同访问频度级别的数据; [0069] S13, the target data according to the data unity mark, determination of the target data storage unit is currently located, wherein the storage unit stores different frequencies have different levels of data access;

[0070] S14、由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 [0070] S14, the storage unit is currently located by the target data in the retrieval target data is sent to the client.

[0071] 本发明实施例提供的数据分级管理方法,根据客户端请求获取的目标数据的文件信息,获取目标数据的数据统一标记,并据此确定目标数据当前所在的存储单元,其中,不同的存储单元存储有不同访问频度级别的数据,由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 [0071] The hierarchical data management method according to embodiments of the present invention, the target file information request to obtain the client data, the target data acquiring data collectively labeled, and accordingly determining the target data storage unit is currently located, wherein the different the storage unit stores a different level of access frequency data storage unit is currently located by the target data in the retrieval target data is sent to the client. 与现有技术相比,本发明将不同访问频度级别的数据分别存储在不同的存储单元中,并根据客户端的数据获取请求由该数据当前所在的存储单元中进行数据调取,从而能够在保证不同访问频度级别的数据的响应速度的同时,降低数据的整体存储成本。 Compared with the prior art, the present invention different levels of data access frequency are stored in a different storage unit, the client and the data acquisition request by the data storage unit is currently located in the data retrieval, it is possible in to ensure the response speed of the different levels of access frequency data, while reducing the overall cost of storing data.

[0072] 可选地,在本发明数据分级管理方法一实施例中,所述根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元(S13)可包括: [0072] Alternatively, in the hierarchical data management method of the present invention in one embodiment, the data collectively labeled according to the target data, the storage unit is determined (S13) the target data may include current location:

[0073] S131、根据所述目标数据的数据统一标记,向状态数据库发送数据查询请求,其中,所述状态数据库记录有数据统一标记与数据所在存储单元的对应关系。 [0073] S131, the target data according to the data unity mark, transmits data query request to the state database, wherein the database records the state of correspondence between the data collectively labeled with the storage unit storing the data.

[0074] S132、接收状态数据库返回的查询结果,所述查询结果显示所述目标数据当前所在的存储单元。 [0074] S132, the reception state database query results returned, the query results are displayed target data of the memory cell is currently located.

[0075] 其中,状态数据库可以采用表格的形式记录数据统一标记与数据所在存储单元的对应关系,根据目标数据的数据统一标记,状态数据库在所述数据统一标记与数据所在存储单元的对应关系集中,查找所述目标数据对应的存储单元,得到查询结果。 [0075] wherein, in the form of state database tables using correspondence data recording mark and unified storage unit storing data, the data collectively labeled target data, focus state database corresponding relationship between the mark and the unified data storage unit storing data searching the data corresponding to the target memory cell, to obtain the query result.

[0076] 可选地,在本发明数据分级管理方法一实施例中,所述方法还可包括: [0076] Alternatively, in the hierarchical data management method of the present invention in one embodiment, the method further comprising:

[0077] S15、定期对各存储单元中的数据进行扫描。 [0077] S15, the data of each regular memory cell in the scan.

[0078] 具体地,对各存储单元中的每个数据进行扫描,确定每个数据被访问的频度。 [0078] Specifically, for each data storage unit in each scan, to determine the frequency of each data is accessed.

[0079] S16、若存储单元中的一个或多个数据在预定时间内的访问频度低于当前所在的存储单元设置的访问频度,则将所述一个或多个数据由当前所在的存储单元迀移至访问频度低一级别的存储单元。 [0079] S16, the storage unit if one or more data access frequency within a predetermined time is less than the current access frequency of the memory cell is located set, then one or more of the data stored current location Gan access frequency unit to move a lower-level memory cells.

[0080] 其中,所述预定时间由系统预先设定好,若存储单元中的一个或多个数据在预定时间内的访问频度低于当前所在的存储单元设置的访问频度,则访问频度低一级别的存储单元在响应速度上足以满足对该一个或多个数据的存储,因此,将该一个或多个数据由当前所在的存储单元迀移至访问频度低一级别的存储单元,以便降低存储成本。 [0080] wherein said predetermined time is preset by the system, if a plurality of storage unit or data access frequency within a predetermined time is less than the current access frequency of the memory cell is located is provided, the access frequency a low-level memory cells in response speed sufficient to satisfy the one or more data storage, and therefore, the one or more data storage unit Gan to move from the current location of a low access frequency level memory cell in order to reduce storage costs.

[0081 ] S17、若存储单元中的一个或多个数据在预定时间内的访问频度高于当前所在的存储单元设置的访问频度,则将所述一个或多个数据由当前所在的存储单元迀移至访问频度高一级别的存储单元。 [0081] S17, if one or more data storage unit access frequency within a predetermined time is higher than the access frequency of the memory cell current location set, then one or more of the data stored current location Gan access unit moved to a high-level storage unit frequency.

[0082] 其中,若存储单元中的一个或多个数据在预定时间内的访问频度高于当前所在的存储单元设置的访问频度,则该存储单元在响应速度上将不能满足该一个或多个数据的存储,因此,将该一个或多个数据由当前所在的存储单元迀移至访问频度高一级别的存储单元,以便满足该一个或多个数据的响应速度。 [0082] wherein, if one or more data storage unit access frequency within a predetermined frequency of access time than the storage unit is currently located is provided, then the memory cell will not satisfy the response speed or a storing a plurality of data, and therefore, the one or more data storage unit to move from the current location of the access Gan a high frequency level memory cell, so as to satisfy the response speed of the one or more data.

[0083] S18、对所述状态数据库中数据统一标记与数据所在存储单元的对应关系进行更新。 [0083] S18, the corresponding data in a relational database with data of the unified state flag storage unit storing update.

[0084] 可选地,在本发明数据分级管理方法一实施例中,所述方法还可包括: [0084] Alternatively, in the hierarchical data management method of the present invention in one embodiment, the method further comprising:

[0085] S19、对新数据的访问频度进行评估,根据评估出的新数据的访问频度所属的访问频度级别,将所述新数据存放至所述所属的访问频度级别对应的存储单元中。 [0085] S19, the frequency of access to the new data is assessed, according to the access frequency level access assess the frequency of new data belongs, storing the new data belongs to the access frequency corresponding to the level of storage unit.

[0086] 可选地,在本发明数据分级管理方法一实施例中,在所述根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记(S12)之前,所述方法还可包括: [0086] Alternatively, the data in the hierarchical file management method of the present invention according to the target information to the client a request to obtain data embodiment, the target data acquiring data collectively labeled (S12) before, the method may further comprise:

[0087] S20、查询数据缓存中是否存储有所述目标数据; [0087] S20, whether the target data is stored query data cache;

[0088] S21、若所述数据缓存中存储有所述目标数据,则将所述目标数据所在数据缓存的地址发送给所述客户端,以使所述客户端根据所述目标数据所在数据缓存的地址获取所述目标数据; [0088] S21, if the data stored in the cache data for the target, then the target data resides in the data cache address is sent to the client so that the client data cache where the data based on the target address acquiring the target data;

[0089] 若所述数据缓存中没有存储所述目标数据,则执行步骤S12。 [0089] if the data is not stored in the cache of the target data, step S12.

[0090] 其中,数据缓存位于内存中,可以暂时存放数据,但一段时间之后会将存放的数据释放掉;而存储单元位于硬盘中,可以永久性存储数据。 [0090] wherein the data cache in memory may temporarily store data, but the data will be stored after some time freed; and storage unit is a hard disk, the data can be permanently stored. 客户端由数据缓存中调取数据的速度要大于由硬盘中调取数据,因此,首先判断数据缓存中是否存储有目标数据,如果有,则客户端直接从数据缓存中调取,从而可以提高客户端获取数据的速度;如果没有,客户端从硬盘中的存储单元中调取。 Client consists of the speed data in the cache data is retrieved from the hard disk to be larger than the transfer of data and therefore, is first determined whether the target data stored in the data cache, if there is, the client data retrieved directly from the cache, which can improve speed data acquisition client; if not, the client from the hard disk storage unit retrieved.

[0091] 参看图2,本发明实施例提供一种数据分级管理方法。 [0091] Referring to Figure 2, embodiments provide a hierarchical data management method of the present invention. 在本实施例中,可设置有三个存储单元:热数据空间、温数据空间和冷数据空间,其中, In the present embodiment, it may be provided with three storage units: data space heat, cold and warm data space space data, wherein,

[0092] 热数据空间存储有热数据,所述热数据指4小时以内用户一定访问的数据; [0092] Thermal data space data stored heat, the heat data refers to data that the user must 4 hours of access;

[0093] 温数据空间存储有温数据,所述温数据指一周以内用户一定访问的数据; [0093] Temperature data space is stored temperature data, the temperature data refers to data that the user must access within a week;

[0094] 冷数据空间存储有冷数据,所述冷数据指一个月以内用户不一定访问的数据。 [0094] Cold cold storage data space data, the data refers to data that cold is not necessarily accessible to the user within one month.

[0095] 参看图2,所述数据分级管理方法包括: [0095] Referring 2, the hierarchical data management method of FIG comprising:

[0096] 1.1、客户端向数据状态检查器发送数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件名。 [0096] 1.1, the client sends a data acquisition request to the data status checker, the data acquisition request includes the client request target data acquired file name.

[0097] 1.2、数据状态检查器向全球统一标记生成器发出数据状态查询请求,所述数据状态查询请求中包括客户端请求获取的目标数据的ID和文件信息。 [0097] 1.2, check the status data emitted by the data query request to the unified global status flag generator, said data state query request includes the ID information of the client and request to obtain the file object data.

[0098] 1.3、全球统一标记生成器生成数据统一标记,并向状态数据库发送数据查询请求。 [0098] 1.3, unified global mark generator generates a unified data tags send data to the state database queries. 其中,所述状态数据库记录有数据统一标记与数据所在数据空间的对应关系。 Wherein the state database with data marks recorded with uniform space where data correspondence data.

[0099] 其中,全球统一标记生成器接收到数据状态查询请求之后,首先检验客户端请求获取的目标数据的ID和文件信息是否合法,只有当合法时才生成数据统一标记。 After the [0099] where global harmonization mark generator receives the data state inquiry request, first check ID documents and information requested by the client target data is legitimate only when a legitimate generate unified data mark.

[0100] 1.4、状态数据库根据所述数据统一标记,查询出对应的目标数据所在的存储空间,并将查询结果集返回给数据状态检查器,明确目标数据当前所在数据空间。 [0100] 1.4, unified database status flag according to the data memory space corresponding to the query object data is located, where the current data space and the query result set returned to the data status checker clear target data.

[0101] 1.5、数据状态检查器形成数据调用策略,并将数据调度请求发送给数据调度器。 [0101] 1.5, the data forming a data call status checker policy, and transmits a scheduling request data to the data scheduler.

[0102] 其中,所述数据调用策略指示由哪个数据空间调用该目标数据。 [0102] wherein, the target data indicating said policy data call by the call to which the data space.

[0103] 具体地,所述数据调用策略包括:若数据缓存中存储有该目标数据,则优先从数据缓存中调用该目标数据;若数据缓存中没有存储该目标数据,则根据该目标数据的数据统一标记,向状态数据库发送数据查询请求,其中,所述状态数据库记录有数据统一标记与数据所在数据空间的对应关系。 [0103] In particular, the data call policy comprises: if the data in the buffer storing the target data, the priority call to the target data from the data buffer; if the data is not stored in the cache of the target data, based on the target data unified data tag, the data transmission state query request to the database, wherein the database records the state of a unified data tags corresponding relationship with the data located in the data space. 其中,状态数据库可以采用表格的形式记录数据统一标记与数据所在数据空间的对应关系,根据目标数据的数据统一标记,在所述数据统一标记与数据所在数据空间的对应关系集中,查找所述目标数据对应的数据空间,并从该目标数据所在的数据空间中调用该目标数据。 Wherein the state database tables using the recording data in the form of uniform correspondence between data marks location data space, collectively labeled target data according to the correspondence between the data and the flag data where the uniform space data set, to find the target data corresponding to the data space, and call the target data from the data space of the target data is located.

[0104] 1.6.1、若该目标数据存在于数据缓存中,数据调度器将该目标数据所在数据缓存的地址发送给客户端。 [0104] 1.6.1 If the target data exists in the data cache, the data scheduler of the target address of the data buffer where the data sent to the client.

[0105] 1.6.2、客户端根据该目标数据所在数据缓存的链接获取所述数据。 [0105] 1.6.2 client obtains the data according to the data cache where the target data link.

[0106] 进一步地,如图3所示,在步骤1.1至1.5之后,所述数据分级管理方法还可以包括: [0106] Further, as shown in FIG. 3, after the step 1.1 to 1.5, the hierarchical data management method may further comprise:

[0107] 2.1、若数据缓存中没有存储该目标数据,则数据调度器从状态数据库中重新查询该目标数据所在的数据空间。 [0107] 2.1, if the data is not stored in the cache of the target data, the data scheduler re-query the data space where the target data from the state database.

[0108] 具体地,数据调度器根据该目标数据的数据统一标记,向状态数据库发送数据查询请求,其中,所述状态数据库记录有数据统一标记与数据所在数据空间的对应关系。 [0108] Specifically, the data scheduler collectively labeled the target data according to the data, and transmits the data query request to the state database, wherein the database records the state where the data mark and a unified data space correspondence data. 其中,状态数据库可以采用表格的形式记录数据统一标记与数据所在数据空间的对应关系,根据目标数据的数据统一标记,数据调度器在所述数据统一标记与数据所在数据空间的对应关系集中,查找所述目标数据对应的数据空间,并从该目标数据所在的数据空间中调用该目标数据。 Wherein the state database tables using the recording data in the form of uniform correspondence between data marks location data space, collectively labeled target data according to the data, the data in the centralized scheduler corresponding relationship between the data and the flag data where unified data space, to find the data corresponding to the target space, and to invoke the target data from the data space of the target data is located.

[0109] 2.2、如果该数据在热数据空间,则数据调度器从热数据空间读取该数据。 [0109] 2.2, if the data in the data space thermal data, the data is read from scheduler thermal data space.

[0110] 2.3、数据调度器将该数据返回给客户端。 [0110] 2.3, the data scheduler returns the data to the client.

[0111] 进一步地,如图4所示,所述数据分级管理方法还可以包括: [0111] Further, as shown in FIG. 4, the hierarchical data management method may further comprise:

[0112] 3.1、数据调度器定期对热数据空间进行扫描。 [0112] 3.1, the thermal data scheduler periodically scan data space.

[0113] 3.2、若热数据空间中的一个或多个数据在预定时间内没有被访问过,则数据调度器发起指令,将对应数据集从热数据空间迀移到温数据空间。 [0113] 3.2, if a thermal data space or a plurality of data has not been accessed within a predetermined time, the scheduler initiates instruction data, the corresponding data set is moved from the hot temperature data space Gan data space.

[0114] 3.3、数据调度器对状态数据库中数据统一标记与数据所在数据空间的对应关系进行更新。 [0114] 3.3, correspondence between the status of the data scheduler database where data unity mark and space data is updated.

[0115] 进一步地,如图4所示,所述数据分级管理方法还可以包括: [0115] Further, as shown in FIG. 4, the hierarchical data management method may further comprise:

[0116] 4.1、数据调度器定期对温数据空间进行扫描。 [0116] 4.1, temperature data scheduler periodically scan data space.

[0117] 4.2、若温数据空间中的一个或多个数据在预定时间内没有被访问过,则数据调度器发起指令,将对应数据集从温数据空间迀移到冷数据空间。 [0117] 4.2, if the temperature of a data space or a plurality of data has not been accessed within a predetermined time, the scheduler initiates instruction data, the data set corresponding to the temperature data from the cooling space Gan move data space.

[0118] 4.3、数据调度器对状态数据库中数据统一标记与数据所在数据空间的对应关系进行更新。 [0118] 4.3, correspondence between the status of the data scheduler database where data unity mark and space data is updated.

[0119] 进一步地,如图4所示,所述数据分级管理方法还可以包括: [0119] Further, as shown in FIG. 4, the hierarchical data management method may further comprise:

[0120] 5.1、数据调度器定期对冷数据空间中的数据进行校验,保证冷数据空间中的数据可用。 [0120] 5.1, data scheduling data periodically to the cold space verify data to ensure the data in the data space available cold.

[0121 ] 其中,所述对冷数据空间中的数据进行校验具体可以为:对冷数据空间中的数据采用校验算法进行计算,得出校验值,将该校验值与该数据本身对应的校验值进行比较,若二者一致,则表明该数据是可用的;若二者不一致,则表明该数据不可用。 [0121] wherein the cold for the data check data space may be: Cold data space data using checksum algorithm calculated the check value, the check value to the data itself check value corresponding to the comparison, if the two are coincident, it indicates that the data is available; if the two are inconsistent, it indicates that the data is not available. 其中,所述校验算法可以为md5校验、CRC(Cyclic Redundancy Check,循环冗佘校验)等,该数据本身对应的校验值与该数据一起存放于冷数据空间中。 Wherein the check algorithm may be md5 checksum, CRC (Cyclic Redundancy Check, cyclic redundancy check SHE) or the like, the data itself with the check value corresponding to the data stored in the data space together cold.

[0122] 5.2、数据调度器对状态数据库中数据统一标记与数据所在数据空间的对应关系进行更新。 [0122] 5.2, correspondence between the status of the data scheduler database where data unity mark and space data is updated.

[0123] 参看图5,本发明实施例提供一种数据分级管理装置,所述数据分级管理装置包括: [0123] Referring to Figure 5, embodiments of the present invention provides a hierarchical data management apparatus, said management data classification apparatus comprising:

[0124] 接收单元11,用于接收客户端发送的数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件信息; [0124] The receiving unit 11 for receiving data sent by a client request for obtaining said data information file acquisition request includes the client request target data acquired;

[0125] 其中,所述文件信息包括表示所述目标数据的相关信息,可以为文件名、URL地址,但不仅限于此。 [0125] wherein said file information includes the information related to target data, the file name may be, URL address, but not limited thereto.

[0126] 获取单元12,用于根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记; [0126] acquisition unit 12, information for the target file request to obtain the client data, the target data acquiring data unity mark;

[0127] 其中,所述目标数据的数据统一标记由全球统一标记生成器生成,不管所述目标数据的文件信息为文件名、地址,或者是其他标识,该全球统一标记生成器都会根据所述目标数据的文件信息,生成格式统一且唯一标识的数据统一标记。 [0127] wherein, the target data generated by the data collectively labeled GHS marker generator, regardless of whether the target data file name for the file information, address, or other identifier, which are globally consistent marker generator according to the file information of the target data, and generate a unified format that uniquely identifies the data collectively labeled.

[0128] 确定单元13,用于根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元; [0128] determination unit 13 for collectively labeled the target data based on the data, determining the target data storage unit is currently located;

[0129] 至少两个存储单元14,用于分别存储不同访问频度级别的数据; [0129] at least two storage units 14 for storing different levels of data access frequency, respectively;

[0130] 调取和发送单元15,用于由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 [0130] retrieval and transmission unit 15, a storage unit is currently located by the target data in the retrieval target data is sent to the client.

[0131] 本发明实施例提供的数据分级管理装置,根据客户端请求获取的目标数据的文件信息,获取目标数据的数据统一标记,并据此确定数据当前所在的存储单元,其中,不同的存储单元存储有不同访问频度级别的数据,由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 [0131] hierarchical data management apparatus according to an embodiment of the present invention, according to the file information acquired client request target data acquiring data collectively labeled target data, and accordingly determines the data storage unit is currently located, wherein the different storage means stores a different level of access frequency data storage unit is currently located by the target data in the retrieval target data is sent to the client. 与现有技术相比,本发明将不同访问频度级别的数据分别存储在不同的存储单元中,并根据客户端的数据获取请求由该数据当前所在的存储单元中进行数据调取,从而能够在保证不同访问频度级别的数据的响应速度的同时,降低数据的整体存储成本。 Compared with the prior art, the present invention different levels of data access frequency are stored in a different storage unit, the client and the data acquisition request by the data storage unit is currently located in the data retrieval, it is possible in to ensure the response speed of the different levels of access frequency data, while reducing the overall cost of storing data.

[0132] 可选地,在本发明数据分级管理装置一实施例中,所述确定单元13可包括: [0132] Alternatively, the data management apparatus according to the present invention, a hierarchical embodiment, the determination unit 13 may comprise:

[0133] 发送模块131,用于根据所述目标数据的数据统一标记,向状态数据库发送数据查询请求,其中,所述状态数据库记录有数据统一标记与数据所在存储单元的对应关系; [0133] The transmitting module 131, collectively labeled for the target data based on the data, the data transmission state query request to the database, wherein the database records the state of correspondence between the data collectively labeled with the storage unit storing data;

[0134] 接收模块132,用于接收状态数据库返回的查询结果,所述查询结果显示所述目标数据当前所在的存储单元。 [0134] The receiving module 132 for receiving status query results returned by the database, the query results are displayed target data of the memory cell is currently located.

[0135] 其中,状态数据库可以采用表格的形式记录数据统一标记与数据所在存储单元的对应关系,根据目标数据的数据统一标记,状态数据库在所述数据统一标记与数据所在存储单元的对应关系集中,查找所述目标数据对应的存储单元,得到查询结果。 [0135] wherein, in the form of state database tables using correspondence data recording mark and unified storage unit storing data, the data collectively labeled target data, focus state database corresponding relationship between the mark and the unified data storage unit storing data searching the data corresponding to the target memory cell, to obtain the query result.

[0136] 参看图6,可选地,在本发明数据分级管理装置一实施例中,所述数据分级管理装置还可包括: [0136] Referring to Figure 6, alternatively, in a hierarchical data managing apparatus of an embodiment of the present invention, the data management apparatus may further comprise classification:

[0137] 扫描单元16,用于定期对各存储单元中的数据进行扫描; [0137] The scanning unit 16, for periodically storing the data of each scan unit;

[0138] 迀移单元17,用于当存储单元中的一个或多个数据在预定时间内的访问频度低于当前所在的存储单元设置的访问频度时,将所述一个或多个数据由当前所在的存储单元迀移至访问频度低一级别的存储单元,以及当存储单元中的一个或多个数据在预定时间内的访问频度高于当前所在的存储单元设置的访问频度时,将所述一个或多个数据由当前所在的存储单元迀移至访问频度高一级别的存储单元; [0138] Gan shift unit 17, a storage unit for, when one or more data access frequency within a predetermined time is less than the current access frequency of the memory cell is located provided, the one or more data access frequency storage unit Gan to move from one level of the current location of the storage unit, and when one or more data storage unit access frequency within a predetermined time than accesses the storage unit is currently located set frequency when the one or more data storage units is currently located by the move Gan access a high-level storage unit frequency;

[0139] 其中,所述预定时间由系统预先设定好,若存储单元中的一个或多个数据在预定时间内的访问频度低于当前所在的存储单元设置的访问频度,则访问频度低一级别的存储单元在响应速度上足以满足对该一个或多个数据的存储,因此,将该一个或多个数据由当前所在的存储单元迀移至访问频度低一级别的存储单元,以便降低存储成本;若存储单元中的一个或多个数据在预定时间内的访问频度高于当前所在的存储单元设置的访问频度,则该存储单元在响应速度上将不能满足该一个或多个数据的存储,因此,将该一个或多个数据由当前所在的存储单元迀移至访问频度高一级别的存储单元,以便满足该一个或多个数据的响应速度。 [0139] wherein said predetermined time is preset by the system, if a plurality of storage unit or data access frequency within a predetermined time is less than the current access frequency of the memory cell is located is provided, the access frequency a low-level memory cells in response speed sufficient to satisfy the one or more data storage, and therefore, the one or more data storage unit Gan to move from the current location of a low access frequency level memory cell in order to reduce storage costs; if one or more data storage unit access frequency within a predetermined frequency of access time than the storage unit is currently located is provided, then the memory cell will not satisfy the response speed in a or a plurality of data storage, and therefore, the one or more data storage unit to move from the current location of the access Gan a high frequency level memory cell, so as to satisfy the response speed of the one or more data.

[0140] 更新单元18,用于在所述迀移单元17将所述一个或多个数据由当前所在的存储单元迀移至访问频度低一级别或访问频度高一级别的存储单元之后,对所述状态数据库中数据统一标记与数据所在存储单元的对应关系进行更新。 After [0140] updating unit 18, a shift unit 17 in the Gan access frequency of said one or more data storage unit to move from Gan currently located one level or a high level of memory access unit frequency correspondence relational database data collectively labeled with the state data storage unit storing update.

[0141] 参看图6,可选地,在本发明数据分级管理装置一实施例中,所述数据分级管理装置还可包括: [0141] Referring to Figure 6, alternatively, in a hierarchical data managing apparatus of an embodiment of the present invention, the data management apparatus may further comprise classification:

[0142] 评估单元19,用于对新数据的访问频度进行评估,根据评估出的新数据的访问频度所属的访问频度级别,将所述新数据存放至所述所属的访问频度级别对应的存储单元中。 [0142] The evaluation unit 19, is used to evaluate the frequency of access to new data, an evaluation based on the access frequency of new data belongs to the frequency level, storing the new data belongs to the accessing frequency corresponding to the level storage unit.

[0143] 参看图7,可选地,在本发明数据分级管理装置一实施例中,所述数据分级管理装置还可包括: [0143] Referring to Figure 7, alternatively, in a hierarchical data managing apparatus of an embodiment of the present invention, the data management apparatus may further comprise classification:

[0144] 查询单元20,用于查询数据缓存中是否存储有所述目标数据; [0144] query unit 20, whether the target data is stored query data cache;

[0145] 发送单元21,用于当所述数据缓存中存储有所述目标数据时,将所述目标数据所在数据缓存的地址发送给所述客户端,以使所述客户端根据所述目标数据所在数据缓存的地址获取所述目标数据; [0145] 21 transmission unit, when said data buffer is stored in the target data, the target data resides in the data cache address is sent to the client so that the client based on the target where the data cache data address acquiring the target data;

[0146] 当所述数据缓存中没有存储所述目标数据时,所述调取和发送单元15由所述目标数据当前所在的存储单元中调取目标数据,发送至所述客户端。 [0146] When the data buffer is not stored in the target data, the storage unit and transmitting the retrieved target data by the unit 15 is currently located in the retrieval target data is sent to the client.

[0147] 其中,数据缓存位于内存中,可以暂时存放数据,但一段时间之后会将存放的数据释放掉;而存储单元位于硬盘中,可以永久性存储数据。 [0147] wherein the data cache in memory may temporarily store data, but the data will be stored after some time freed; and storage unit is a hard disk, the data can be permanently stored. 客户端由数据缓存中调取数据的速度要大于由硬盘中调取数据,因此,首先判断数据缓存中是否存储有目标数据,如果有,则客户端直接从数据缓存中调取,从而可以提高客户端获取数据的速度;如果没有,客户端从硬盘中的存储单元中调取。 Client consists of the speed data in the cache data is retrieved from the hard disk to be larger than the transfer of data and therefore, is first determined whether the target data stored in the data cache, if there is, the client data retrieved directly from the cache, which can improve speed data acquisition client; if not, the client from the hard disk storage unit retrieved.

[0148] 本发明实施例数据分级管理方法及装置,可以适用于对不同访问频度级别的数据进行分级管理,降低数据的整体存储成本。 Example hierarchical data management method and apparatus according to the [0148] present invention can be applied to different data access frequency level hierarchical management to reduce the overall cost of storing data.

[0149] 本发明实施例还提供了一种电子设备,可以包括: [0149] Embodiments of the present invention further provides an electronic device, may include:

[0150] 一个或者多个处理器; [0150] one or more processors;

[0151] 存储器; [0151] memory;

[0152] —个或者多个模块,所述一个或者多个模块存储在所述存储器中,当被所述一个或者多个处理器执行时进行如下操作: [0152] - one or more modules, the one or more modules stored in the memory, the following operation when the one or more processors to perform:

[0153] 接收客户端发送的数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件信息; [0153] Data sent by the client receives the acquisition request, the data acquisition request message includes a target file data requested by the client acquired;

[0154] 根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记; [0154] The file information of the client request acquired target data, the target data obtaining uniform marking;

[0155] 根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元,其中,不同的存储单元存储有不同访问频度级别的数据; [0155] The data collectively labeled the target data, the target data storage unit determining the current location, wherein the storage unit stores different frequencies have different levels of data access;

[0156] 由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 [0156] The storage unit is currently located by the target data in the retrieval target data is sent to the client.

[0157] 本发明实施例还提供了一种存储介质,用于存储应用程序,所述应用程序用于执行本发明实施例所提供的一种数据分级管理方法。 Example [0157] The present invention further provides a storage medium for storing the application program, the application program for performing one hierarchical data management method provided by the embodiment of the present invention.

[0158] 本发明实施例还提供了一种应用程序,用于执行本发明实施例所提供的一种数据分级管理方法。 Example [0158] The present invention further provides an application, to perform a hierarchical data management method provided by the embodiment of the present invention.

[0159] 在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。 [0159] or represents a logical and / or steps described herein in other ways, for example, may be considered as a sequencing table executable instructions for implementing logical functions in the flowcharts, can be embodied in any computer-readable medium to instruction execution system, apparatus, or device (e.g., computer-based system, processor-containing system, or other system may be performed from instruction fetch apparatus, or device and execute the instructions) using, instruction execution, or a combination of these system, apparatus, or device used. 就本说明书而言,〃计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPR0M或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。 Purposes of this specification, 〃 computer-readable medium "can be any comprising, means store, communicate, propagate, or transport the program for instruction execution system, apparatus, or device, or with the instruction execution system, apparatus, or device and used. more specific examples (a non exhaustive list) of the computer-readable medium comprising: an electrical connection (electronic device) having one or more wires, a portable computer diskette cartridge (magnetic device), a random access memory (RAM), a read only memory (ROM), erasable read-only memory edit (EPR0M or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Further, a computer-readable medium could even be printed thereon the paper or other suitable medium for a program, since the paper or other medium by optical scanning, such as editing followed, if necessary, interpreted, or otherwise processed in a suitable manner for obtaining the program electronically, then storing in a computer memory.

[0160] 应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。 [0160] It should be understood that various portions of the present invention may be implemented in hardware, software, firmware or a combination thereof to achieve. 在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。 In the above-described embodiment, a plurality of steps or methods may be implemented in software or firmware and executed by a suitable system executing instructions stored in a memory with. 例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。 For example, if implemented in hardware, as in another embodiment, the present technique may be any one of the following well-known in the art, or their combination thereof: a logic gate circuit for implementing logic functions upon data signals discrete logic circuits having appropriate combinational logic gate circuit ASIC, a programmable gate array (PGA), a field programmable gate array (FPGA) and the like.

[0161] 本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。 [0161] skilled in the art can understand that ordinary method embodiments that all or part of the steps may be by a program instructing relevant hardware, the program may be stored in a computer-readable storage medium, one of the steps in the implementation of the embodiment of the method includes the program, or combinations thereof.

[0162] 为了描述的方便,描述以上装置是以功能分为各种单元/模块分别描述。 [0162] For convenience of description, the above described apparatus is divided into various functional units / modules described separately. 当然,在实施本发明时可以把各单元/模块的功能在同一个或多个软件和/或硬件中实现。 Of course, each of the functional units / modules implemented in one or more software and / or hardware in the practice of the present invention.

[0163] 通过以上的实施方式的描述可知,本领域的技术人员可以清楚地了解到本发明可借助软件加必需的通用硬件平台的方式来实现。 [0163] By the above described embodiments can be seen, those skilled in the art may clearly understand that the present invention may be implemented by software plus a necessary universal hardware platform. 基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如R0M/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例或者实施例的某些部分所述的方法。 Based on such understanding, the technical solutions of the present invention in essence or the part contributing to the prior art may be embodied in a software product, which computer software product may be stored in a storage medium, such as a R0M / RAM, magnetic disk, , an optical disc, and includes several instructions that enable a computer device (may be a personal computer, a server, or network device) to perform various method embodiments or some parts of the embodiment of the present invention.

[0164] 以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到的变化或替换,都应涵盖在本发明的保护范围之内。 [0164] The above are only specific embodiments of the present invention, but the scope of the present invention is not limited thereto, any skilled in the art in the art within the technical scope of the present invention is disclosed, variations may readily occur to or alternatively, shall fall within the protection scope of the present invention. 因此,本发明的保护范围应该以权利要求的保护范围为准。 Accordingly, the scope of the present invention should be defined by the scope of the claims.

Claims (10)

  1. 1.一种数据分级管理方法,其特征在于,包括: 接收客户端发送的数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件信息; 根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记; 根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元,其中,不同的存储单元存储有不同访问频度级别的数据; 由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 A hierarchical data management method, comprising: receiving data sent by a client request for obtaining said data information file acquisition request includes the target data acquired client request; requesting client according to the file information acquired target data, the target data obtaining uniform marking; collectively labeled the target data according to the data, determining the target data storage unit is currently located, wherein the storage unit stores different access frequency different level of the data; storage unit is currently located by the target data in the retrieval target data is sent to the client.
  2. 2.根据权利要求1所述的数据分级管理方法,其特征在于,所述根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元包括: 根据所述目标数据的数据统一标记,向状态数据库发送数据查询请求,其中,所述状态数据库记录有数据统一标记与数据所在存储单元的对应关系; 接收状态数据库返回的查询结果,所述查询结果显示所述目标数据当前所在的存储单JL ο The hierarchical data management method according to claim 1, wherein the uniform mark according to the data of the target data, the target data determination storage unit is currently located comprising: a unified data according to the target data tag, the transmission data query request to the state database, wherein the database records the state of a unified data mark and a correspondence relationship storage unit storing data; reception state returned by the database query result, the target of the query result display data currently located JL ο storage unit
  3. 3.根据权利要求2所述的数据分级管理方法,其特征在于,所述方法还包括: 定期对各存储单元中的数据进行扫描; 若存储单元中的一个或多个数据在预定时间内的访问频度低于当前所在的存储单元设置的访问频度,则将所述一个或多个数据由当前所在的存储单元迀移至访问频度低一级别的存储单元; 若存储单元中的一个或多个数据在预定时间内的访问频度高于当前所在的存储单元设置的访问频度,则将所述一个或多个数据由当前所在的存储单元迀移至访问频度高一级别的存储单元; 对所述状态数据库中数据统一标记与数据所在存储单元的对应关系进行更新。 The hierarchical data management method according to claim 2, wherein said method further comprises: periodic data in each memory cell is scanned; if one or more data storage units within a predetermined time access frequency lower than the frequency of access to the storage unit currently resides provided, then one or more of the data by the storage unit is currently located Gan low access frequency is moved to a level of a memory cell; if a storage unit one or more data access within a predetermined time is higher than the frequency of access to the storage unit currently resides frequency set, then the one or more data storage unit to move from the current location of the access Gan a high frequency level the storage unit; correspondence relational database with data in the consolidated data of the state flag storage unit storing update.
  4. 4.根据权利要求3所述的数据分级管理方法,其特征在于,所述方法还包括: 对新数据的访问频度进行评估,根据评估出的新数据的访问频度所属的访问频度级另IJ,将所述新数据存放至所述所属的访问频度级别对应的存储单元中。 4. The hierarchical data management method according to claim 3, characterized in that, said method further comprising: assessment of new data access frequency, the frequency of access according to the access level assess the frequency of new data belongs another IJ, the new data is stored to the memory access unit belongs to the frequency corresponding to the level.
  5. 5.根据权利要求1所述的数据分级管理方法,其特征在于,在所述根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记之前,所述方法还包括: 查询数据缓存中是否存储有所述目标数据; 若所述数据缓存中存储有所述目标数据,则将所述目标数据所在数据缓存的地址发送给所述客户端,以使所述客户端根据所述目标数据所在数据缓存的地址获取所述目标数据。 The hierarchical data management method according to claim 1, wherein the file information according to the target client request to obtain the data, the data before acquiring the target data unity mark, the method further comprising: query whether the data in the cache target data is stored; if the data stored in the cache data for the target, where the target data address is sent to the data cache will be the client, so the client end of the target data acquiring data according to the target address where the data cache.
  6. 6.一种数据分级管理装置,其特征在于,包括: 接收单元,用于接收客户端发送的数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件信息; 获取单元,用于根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记; 确定单元,用于根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元; 至少两个存储单元,用于分别存储不同访问频度级别的数据; 调取和发送单元,用于由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 A hierarchical data management apparatus, characterized by comprising: receiving means for receiving the data acquisition request sent by the client, the data file information acquisition request includes the target data requested by the client; obtaining unit, the data information of the target file for the client request to obtain the data, the target data obtaining uniform marking; determining means, for collectively labeled according to the data of the target data, the target data is currently located is determined a storage unit; at least two memory cells for respectively storing different levels of data access frequency; retrieval and transmission unit, a storage unit is currently located by the target data in the retrieval target data transmitted to the the client.
  7. 7.根据权利要求6所述的数据分级管理装置,其特征在于,所述确定单元包括: 发送模块,用于根据所述目标数据的数据统一标记,向状态数据库发送数据查询请求,其中,所述状态数据库记录有数据统一标记与数据所在存储单元的对应关系; 接收模块,用于接收状态数据库返回的查询结果,所述查询结果显示所述目标数据当前所在的存储单元。 7. The hierarchical data management apparatus according to claim 6, wherein said determining unit comprises: a sending module, for collectively labeled according to the data of the target data, transmitting data to the state database query request, wherein the said database records the state of correspondence between the data collectively labeled storage unit storing data; receiving means for receiving a status query results returned by the database, the query results are displayed target data of the memory cell is currently located.
  8. 8.根据权利要求7所述的数据分级管理装置,其特征在于,所述装置还包括: 扫描单元,用于定期对各存储单元中的数据进行扫描; 迀移单元,用于当存储单元中的一个或多个数据在预定时间内的访问频度低于当前所在的存储单元设置的访问频度时,将所述一个或多个数据由当前所在的存储单元迀移至访问频度低一级别的存储单元,以及当存储单元中的一个或多个数据在预定时间内的访问频度高于当前所在的存储单元设置的访问频度时,将所述一个或多个数据由当前所在的存储单元迀移至访问频度高一级别的存储单元; 更新单元,用于在所述迀移单元将所述一个或多个数据由当前所在的存储单元迀移至访问频度低一级别或访问频度高一级别的存储单元之后,对所述状态数据库中数据统一标记与数据所在存储单元的对应关系进行更新。 A data classification management apparatus according to claim 7, wherein said apparatus further comprises: scanning means for periodically storing the data of each scanning unit; Gan shift unit for, when the storage unit when one or more data access frequency within a predetermined time is less than the frequency of access storage unit currently located is provided, the one or more data storage unit to move from the current location Gan access a low frequency level storage unit, and when one or more data storage unit access within a predetermined time is higher than the frequency of access to the memory cell when the current location of the frequency setting, the one or more data from the current location Gan access storage unit to move a high-level storage unit frequency; updating means for shifting the frequency of the access unit the one or more data moved by the storage unit in the Gan Gan currently located one level or after accessing a high frequency level memory cell, the data in the corresponding relational database collectively labeled with the state where the data storage unit is updated.
  9. 9.根据权利要求8所述的数据分级管理装置,其特征在于,所述装置还包括: 评估单元,用于对新数据的访问频度进行评估,根据评估出的新数据的访问频度所属的访问频度级别,将所述新数据存放至所述所属的访问频度级别对应的存储单元中。 A data classification management apparatus according to claim 8, characterized in that said apparatus further comprises: an evaluation unit for evaluation of the frequency of access to new data, according to access frequency relevant to assess the new data the level of access frequency, the new data is stored to the memory access unit belongs to the frequency corresponding to the level.
  10. 10.一种电子设备,其特征在于,包括: 一个或者多个处理器; 存储器; 一个或者多个模块,所述一个或者多个模块存储在所述存储器中,当被所述一个或者多个处理器执行时进行如下操作: 接收客户端发送的数据获取请求,所述数据获取请求中包括所述客户端请求获取的目标数据的文件信息; 根据所述客户端请求获取的目标数据的文件信息,获取所述目标数据的数据统一标记; 根据所述目标数据的数据统一标记,确定所述目标数据当前所在的存储单元,其中,不同的存储单元存储有不同访问频度级别的数据; 由所述目标数据当前所在的存储单元中调取所述目标数据,发送至所述客户端。 An electronic apparatus, characterized by comprising: one or more processors; memory; one or more modules, the one or more modules stored in the memory, when executed by the one or more when the processor to perform: receiving the data acquisition request sent by the client, the data acquisition request message includes a target file data requested by the client acquired; target data according to the client's request to obtain the file information , the target data acquiring data unity mark; collectively labeled according to the data of the target data, the target data determination storage unit is currently located, wherein the storage unit stores different frequencies have different levels of data access; manufactured by the said target data storage unit is currently located in the retrieval target data is sent to the client.
CN 201510587108 2015-09-15 2015-09-15 Level-to-level data management method and device and electronic equipment CN105183389A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201510587108 CN105183389A (en) 2015-09-15 2015-09-15 Level-to-level data management method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201510587108 CN105183389A (en) 2015-09-15 2015-09-15 Level-to-level data management method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN105183389A true true CN105183389A (en) 2015-12-23

Family

ID=54905498

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201510587108 CN105183389A (en) 2015-09-15 2015-09-15 Level-to-level data management method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN105183389A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018019310A1 (en) * 2016-07-27 2018-02-01 中兴通讯股份有限公司 Big data system data backup and recovery methods and devices, and computer storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030139193A1 (en) * 2002-01-29 2003-07-24 Buckley David J. Wireless device hub system and method
CN101034340A (en) * 2003-03-27 2007-09-12 株式会社日立制作所 Date storage method and data storage system
US20080187345A1 (en) * 2007-02-01 2008-08-07 Sharp Kabushiki Kaisha Image history storage method, image history storage system, image history storage program, and recording medium
CN102456004A (en) * 2010-10-18 2012-05-16 金蝶软件(中国)有限公司 Query control method and system of page data
CN104583929A (en) * 2012-10-12 2015-04-29 株式会社日立制作所 Storage apparatus and data management method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030139193A1 (en) * 2002-01-29 2003-07-24 Buckley David J. Wireless device hub system and method
CN101034340A (en) * 2003-03-27 2007-09-12 株式会社日立制作所 Date storage method and data storage system
US20080187345A1 (en) * 2007-02-01 2008-08-07 Sharp Kabushiki Kaisha Image history storage method, image history storage system, image history storage program, and recording medium
CN102456004A (en) * 2010-10-18 2012-05-16 金蝶软件(中国)有限公司 Query control method and system of page data
CN104583929A (en) * 2012-10-12 2015-04-29 株式会社日立制作所 Storage apparatus and data management method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018019310A1 (en) * 2016-07-27 2018-02-01 中兴通讯股份有限公司 Big data system data backup and recovery methods and devices, and computer storage medium

Similar Documents

Publication Publication Date Title
US8447829B1 (en) System and method for controlling access to web services resources
US20070088764A1 (en) Method and apparatus for synchronizing multimedia content with device which supports multi-server environment
US20040068652A1 (en) Access to content addressable data over a network
US7069380B2 (en) File access method in storage-device system, and programs for the file access
US20120265836A1 (en) File sharing system and file sharing method
US20080271130A1 (en) Minimizing client-side inconsistencies in a distributed virtual file system
US20110119444A1 (en) Adaptive caching of data
Peek et al. EnsemBlue: Integrating distributed storage and consumer electronics
US20050240636A1 (en) Storage system storing worm file
US20070061327A1 (en) Providing local access to managed content
US20140081927A1 (en) Data node fencing in a distributed file system
US20060123121A1 (en) System and method for service session management
US20070073831A1 (en) Providing direct access to distributed managed content
US20060101196A1 (en) Content addressed storage device configured to maintain content address mapping
US8260742B2 (en) Data synchronization and consistency across distributed repositories
US7058773B1 (en) System and method for managing data in a distributed system
US20120030313A1 (en) Cloud data persistence engine
CN103150394A (en) Distributed file system metadata management method facing to high-performance calculation
CN101741830A (en) Method, system, client and server for realizing multi-client data synchronization
US20070143340A1 (en) System and method of time-based cache coherency maintenance in user file manager of object-based storage system
CN101645928A (en) Content resource caching method, device and system
JP2005063374A (en) Data management method, data management device, program for the same, and recording medium
CN102694860A (en) Method, equipment and system for data processing of cloud storage
US20110106826A1 (en) Tracking digital assets on a distributed network
CN102137157A (en) Cloud memory system and implementation method thereof

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination