CN111309254A - Data processing method and device, readable medium and electronic equipment - Google Patents
Data processing method and device, readable medium and electronic equipment Download PDFInfo
- Publication number
- CN111309254A CN111309254A CN202010079099.4A CN202010079099A CN111309254A CN 111309254 A CN111309254 A CN 111309254A CN 202010079099 A CN202010079099 A CN 202010079099A CN 111309254 A CN111309254 A CN 111309254A
- Authority
- CN
- China
- Prior art keywords
- data
- storage
- target data
- target
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0635—Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0643—Management of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The disclosure relates to a data processing method, a data processing device, a readable medium and an electronic device. The method comprises the following steps: if a data storage request carrying first target data is received, determining the data type of the first target data, wherein the data type comprises a first type and a second type, and the first type of data has higher heat than the second type of data; if the data type of the first target data is the first type, storing the first target data, and sending the first target data to other storage nodes of the data storage network, so that the other storage nodes store the first target data, wherein the other storage nodes at least comprise a central storage node. Therefore, when the data has higher heat, the data is not only stored in the local edge storage node, but also pushed to the central storage node of the data storage network for storage, and the access response speed when the data is accessed is improved.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a data processing method, an apparatus, a readable medium, and an electronic device.
Background
At present, there are two general data storage methods. One is to transmit data to the center for storage, which occupies central resources, and consumes large cost, and for some data with low access amount, it will cause great waste to the central resources. The other method is to store data to the edge, and if a certain edge node needs to access a resource other than the edge node, data access needs to be realized through the center, so that when the data has higher heat, each edge node needs to access the center, which causes the data processing burden of the center to be increased and the response speed to be poor.
Disclosure of Invention
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
In a first aspect, the present disclosure provides a data processing method applied to an edge storage node of a data storage network, where the data storage network is composed of a central storage node and an edge storage node, the method including:
if a data storage request carrying first target data is received, determining the data type of the first target data, wherein the data type comprises a first type and a second type, and the first type of data has higher heat than the second type of data;
if the data type of the first target data is the first type, storing the first target data, and sending the first target data to other storage nodes of the data storage network, so that the other storage nodes store the first target data, wherein the other storage nodes at least comprise a central storage node.
In a second aspect, the present disclosure provides a data processing method applied to a central storage node of a data storage network, where the data storage network is composed of the central storage node and an edge storage node, the method including:
if a data access request for accessing second target data sent by a target edge storage node is received, determining whether the second target data is stored locally;
if the second target data are locally stored, the second target data are sent to the target edge storage node;
if the second target data is not stored locally, second storage information used for indicating the storage position of the second target data is determined from data storage information, and the second storage information is sent to the target edge storage node, wherein the data storage information is used for indicating the storage position of each data in the data storage network.
In a third aspect, the present disclosure provides a data processing apparatus applied to an edge storage node of a data storage network, where the data storage network is composed of a central storage node and an edge storage node, the apparatus includes:
the data storage device comprises a first determining module, a second determining module and a processing module, wherein the first determining module is used for determining the data type of first target data if a data storage request carrying the first target data is received, the data type comprises a first type and a second type, and the first type of data has higher heat than the second type of data;
the first storage module is configured to store the first target data and send the first target data to other storage nodes of the data storage network if the data type of the first target data is the first type, so that the other storage nodes store the first target data, where the other storage nodes at least include a central storage node.
In a fourth aspect, the present disclosure provides a data processing apparatus applied to a central storage node of a data storage network, where the data storage network is composed of the central storage node and an edge storage node, the apparatus including:
the second determining module is used for determining whether the second target data is locally stored or not if a data access request which is sent by a target edge storage node and used for accessing the second target data is received;
a fourth sending module, configured to send the second target data to the target edge storage node if the second target data is locally stored;
and a fifth sending module, configured to determine, if the second target data is not locally stored, second storage information used for indicating a storage location of the second target data from data storage information, and send the second storage information to the target edge storage node, where the data storage information is used for indicating a storage location of each data in the data storage network.
In a fifth aspect, the present disclosure provides a computer readable medium having stored thereon a computer program which, when executed by a processing apparatus, performs the steps of the method of the first aspect of the present disclosure, or which, when executed by a processing apparatus, performs the steps of the method of the second aspect of the present disclosure.
In a sixth aspect, the present disclosure provides an electronic device comprising:
a storage device having a computer program stored thereon;
processing means for executing the computer program in the storage means to carry out the steps of the method of the first aspect of the disclosure or to carry out the steps of the method of the second aspect of the disclosure.
Through the technical scheme, if a data storage request carrying first target data is received, the data type of the first target data is determined, if the data type of the first target data is the first data type, the first target data is stored, and the first target data is sent to other storage nodes of the data storage network, so that the other storage nodes store the first target data. Wherein the other storage nodes comprise at least a central storage node. Therefore, when the data is uploaded to the edge storage node, the heat degree of the data is judged firstly, and when the uploaded data has higher heat degree, the data is stored in the local edge storage node and is pushed to the central storage node of the data storage network for storage, so that the access response speed of the data when being accessed can be improved.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.
In the drawings:
FIG. 1 is a flow diagram of a data processing method provided in accordance with one embodiment of the present disclosure;
FIG. 2 is an exemplary flowchart of the step of determining the data type of the first target data in the data processing method provided in accordance with the present disclosure;
FIG. 3 is a flow chart of a data processing method provided according to one embodiment of the present disclosure;
FIG. 4 is a block diagram of a data processing apparatus provided in accordance with one embodiment of the present disclosure;
FIG. 5 is a block diagram of a data processing apparatus provided in accordance with one embodiment of the present disclosure;
fig. 6 is a block diagram of an electronic device provided by the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
Fig. 1 is a flowchart of a data processing method provided according to an embodiment of the present disclosure. The method can be applied to the edge storage nodes of the data storage network, and the data processing method provided by the disclosure can be applied to each edge storage node in the data storage network.
The data storage network is composed of a central storage node and edge storage nodes, the central storage node is used as a data storage center of the data storage network, and the edge storage nodes are used as edges of the network and distributed in various places.
As shown in fig. 1, the method may include the following steps.
In step 11, if a data storage request carrying first target data is received, a data type of the first target data is determined.
Wherein the data types include a first type and a second type, and the second type of data has a higher heat than the second type of data. The higher the heat of the data, the more times the data may be accessed. In a more general sense, data belonging to a first type may be understood as hot data, with a higher amount of access in the data storage network, and data belonging to a second type may be understood as cold data, with less access than hot data.
If a data storage request carrying first target data is received, firstly, determining the data type of the first target data to determine whether the first target data to be stored belongs to a first type or a second type.
In step 12, if the data type of the first target data is the first type, the first target data is stored, and the first target data is sent to other storage nodes of the data storage network, so that the other storage nodes store the first target data.
And if the data type of the first target data is the first type, storing the first target data, wherein the storing of the first target data is to store the first target data locally at the edge storage node. And if the data type of the first target data is the first type, it indicates that the first target data to be stored has higher heat, so that the first target data is stored locally, and simultaneously the first target data is sent to other storage nodes of the data storage network, so that the other storage nodes store the first target data. Wherein the other storage nodes comprise at least a central storage node. Therefore, when the first target data has higher heat, the first target data is not only stored locally at the edge storage node receiving the first target data, but also pushed to the central storage node of the data storage network, and the subsequent access response speed for the first target data is improved. In addition, the other storage nodes may also include other edge storage nodes.
Through the technical scheme, if a data storage request carrying first target data is received, the data type of the first target data is determined, if the data type of the first target data is the first data type, the first target data is stored, and the first target data is sent to other storage nodes of the data storage network, so that the other storage nodes store the first target data. Wherein the other storage nodes comprise at least a central storage node. Therefore, when the data is uploaded to the edge storage node, the heat degree of the data is judged firstly, and when the uploaded data has higher heat degree, the data is stored in the local edge storage node and is pushed to the central storage node of the data storage network for storage, so that the access response speed of the data when being accessed can be improved.
In one possible embodiment, the step 11 of determining the data type of the first target data may include the following steps, as shown in fig. 2.
In step 21, a first heat value of the first target data is determined.
The heat value is in positive correlation with the heat of the data, that is, the higher the heat of the data is. And, the heat value may be calculated by at least one of: data title, data tag, data attribute, data size.
The data header is a header corresponding to the data. The data label is a label carried when the data is uploaded. The data attribute is a file type corresponding to the data, such as a video class, an audio class, a picture class, a document class, and the like. The data size is the size of the storage space occupied by the data. Illustratively, if the first target data is a video titled "food a" and has a size of 14M, and the first target data is uploaded with a "food" tag, the data corresponding to the first target data is titled "food a", the corresponding data tag is "food", the corresponding data attribute is "video", and the corresponding data size is "14M".
The following describes a calculation method of the heat value by taking the calculation of the heat value by four items of the data header, the data tag, the data attribute, and the data size as an example. For example, the heat value may be calculated by the following equation:
the heat value (first weight, data title heat) + (second weight, data tag heat) + (third weight, data attribute heat) + (fourth weight, data size heat)
The first weight to the fourth weight may be set according to an empirical value. The data title popularity can be determined by the characters contained in the title, for example, a popularity list can be preset, and the popularity list comprises a plurality of popularity words with high access, and determines how many popularity words are contained in the data title, and determines the percentage of popularity words contained in the data title to all popularity words in the popularity list as the data title popularity. The data tag heat degree can be determined by a preset corresponding relationship between the tags and the heat degree, for example, a corresponding heat degree is preset for each tag, so that the data tag heat degree can be determined according to the data tags. The data attribute heat may be determined by a preset correspondence between the attribute and the heat, for example, a corresponding heat is preset for each attribute, so as to determine the data attribute heat according to the data attribute. The data size heat degree can be determined by a preset correspondence between the size and the heat degree, for example, the data size heat degree can be determined according to the gear to which the data size belongs by dividing the data size into several gears and determining the correspondence between each gear and the heat degree. The foregoing equations may be referred to for calculating the heat value in other combinations of data header, data tag, data attribute, and data size.
Thus, referring to the above manner, the first calorific value of the first target data can be determined.
In step 22, a data type of the first target data is determined based on the first heat value.
Based on the calculated first heat value, the data type of the first target data, i.e., whether the first target data belongs to cold data or hot data, can be determined.
In one possible embodiment, step 22 may comprise the steps of:
determining the rank of the heat value according to the first heat value and a second heat value corresponding to each data stored in the data storage network and the sequence of the heat value from big to small;
if the first heat value is in the top N bits of the heat value rank, determining that the first target data belongs to a first type;
and if the first heat value is not positioned at the top N of the rank of the heat values, determining that the first target data belongs to the second type.
The data stored in the data storage network has the second heat values corresponding to the data, and therefore, according to the second heat values and the first heat values corresponding to the first target data, the heat value ranking corresponding to the first target data can be obtained after the data are sorted from large to small, and the position of the first heat value in the heat value ranking can be determined. The position of the first heat value in the heat value ranking can reflect the heat degree of the first target data, so that if the first heat value is in the top N bits of the heat value ranking, the first target data is higher in heat degree, the first target data can be determined to belong to the first type, and if the first heat value is not in the top N bits of the heat value ranking, the first target data is not high in heat degree, the first target data can be determined to belong to the second type. Where N is a positive integer, which may be determined from empirical values. It should be noted that the first heat value and the second heat value are calculated in the same manner to ensure that the standards of the heat values are uniform.
By adopting the method, the first heat value of the first target data is calculated firstly, and the data type of the first target data is determined in a heat value comparison mode according to the first heat value of the first target data, so that the obtained result is more objective, and the heat condition of the first target data in the whole data storage network can be reflected.
In one possible embodiment, the method provided by the present disclosure further includes:
and if the first target data carries the mark information corresponding to the first type, determining that the first target data belongs to the first type, otherwise, executing the step 21 and the step 22.
Wherein the tag information corresponding to the first type is predefined, and the data with the tag information is automatically defaulted as belonging to the first type. Therefore, if the first target data carries the tag information corresponding to the first type, it can be directly determined that the first target data belongs to the first type. And determining the data type of the first target data in a manner of calculating a heat value under the condition that the first target data does not carry the tag information corresponding to the first type, wherein the manner of determining the data type of the first target data in the manner of calculating the heat value is described in detail above and is not repeated herein.
By adopting the above mode, if the first target data carries the mark information corresponding to the first type, the first target data is directly determined to belong to the first type, the heat value of the first target data does not need to be calculated, and the mode is simple and quick.
In one possible implementation, when the edge storage node sends the first target data to the central storage node, there may be multiple transmission lines, and in this case, the edge storage node may select one transmission line from the multiple transmission lines for transmitting the first target data. The edge storage node can select the transmission line with the least route consumption from a plurality of transmission lines for data transmission.
Illustratively, the routing cost can be calculated by the following equation:
routing consumption-bandwidth cost-network delay/average delay per unit time
Wherein the unit time may be 1 hour.
In a possible implementation, on the basis of the steps shown in fig. 1, the method provided by the present disclosure may further include the following steps:
if the data type of the first target data is a second type, storing the first target data;
and generating first storage information and sending the first storage information to the central storage node. Wherein the first storage information is used for indicating the storage position of the first target data.
If the data type of the first target data is determined to be the second type through step 11, it is determined that the heat of the first target data is not high, and therefore, the first target data may be directly stored locally in the edge storage node. Meanwhile, first storage information can be generated based on the first target data and the storage position of the first target data, and the first storage information is sent to the central storage node so that the central storage node can store the first storage information.
By adopting the mode, if the heat degree of the data uploaded to the edge storage node is not high, the data is only stored in the edge storage node, and the data is not pushed to the central storage node of the data storage network, so that the storage space of the central storage node is saved. Meanwhile, storage information related to the data storage is sent to the central storage node, so that the central storage node can provide an access mode of the data if an access request aiming at the data exists.
In a possible implementation, on the basis of the steps shown in fig. 1, the method provided by the present disclosure may further include the following steps:
if a data access request of a data access party for second target data is received and the second target data is not locally stored, sending the data access request for the second target data to a central storage node to obtain a feedback result of the central storage node;
if the feedback result of the central storage node indicates second storage information of the storage position of the second target data, acquiring the second target data from the edge storage node indicated by the second storage information, and sending the second target data to the data access party;
and if the second target data is locally stored or if the feedback result of the central storage node is the second target data, sending the second target data to the data access party.
If a data access request of a data access party for second target data is received, whether the edge storage node locally stores the second target data is determined, and if the edge storage node locally stores the second target data, the second target data can be directly sent to the target access party.
If it is determined that the edge storage node does not locally store the second target data, it is determined that the edge storage node cannot find the second target data locally, at this time, help can be sought from the central storage node, that is, a data access request for the second target data is sent to the central storage node, so as to obtain a feedback result of the central storage node.
The central storage node may or may not store the second target data, and therefore, the central storage node may return two feedback results. If the central storage node stores second target data, the feedback result is the second target data; if the central storage node does not store the second target data, the feedback result is not the second target data but the storage position of the second target data.
If the feedback result of the central storage node is the second target data, the second target data can be directly sent to the target access party.
If the feedback result of the central storage node indicates second storage information of the storage location of the second target data, the second target data may be obtained from the edge storage node indicated by the second storage information, and the second target data may be sent to the data access party.
By adopting the mode, when a data access request is received, whether the data requested by the data access request exists in the edge storage node is judged firstly, if the data requested by the data access request does not exist in the edge storage node, the central storage node is further requested, and if the data requested by the data access request does not exist in the central storage node, the central storage node returns the storage position of the data requested by the data access request in the data storage network, so that the edge storage node can directly acquire the data requested by the data access request from other edge storage nodes, and the data response speed is improved.
Fig. 3 is a flowchart of a data processing method provided according to an embodiment of the present disclosure. The method can be applied to the central storage node of the data storage network, and the data processing method provided by the disclosure can be applied to each central storage node in the data storage network. As shown in fig. 3, the method may include the following steps.
In step 31, if a data access request for accessing the second target data sent by the target edge storage node is received, it is determined whether the second target data is locally stored.
In step 32, if the second target data is locally stored, the second target data is sent to the target edge storage node.
In step 33, if the second target data is not locally stored, second storage information indicating a storage location of the second target data is determined from the data storage information, and the second storage information is sent to the target edge storage node.
The data storage information is used for indicating the storage position of each data in the data storage network. As described above for the edge storage node, each time data is stored in the data storage network, the central storage node acquires a storage location of the stored data in the data storage network. The central storage node stores the storage location of each data in the data storage network, which is equivalent to the index storing the data.
According to the technical scheme, a data access request sent by the target edge storage node and used for accessing the second target data is received, whether the second target data is locally stored or not is determined, if the second target data is locally stored, the second target data is sent to the target edge storage node, and if the second target data is not locally stored, second storage information used for indicating the storage position of the second target data is determined from the data storage information and sent to the target edge storage node. Therefore, the central storage node can always provide the target edge storage node with information related to the second target data, so that the target edge storage node can quickly acquire the second target data.
In a possible implementation, on the basis of the steps shown in fig. 3, the present disclosure may further include the following steps:
acquiring historical access information of each data stored in a data storage network;
according to historical access information, determining high-heat data with access times ranked at the top M bits;
if third target data which are not stored locally exist in the high-heat data, determining the storage position of the third target data according to the data storage information;
and acquiring the third target data according to the storage position of the third target data, and storing the third target data to the local.
Wherein the historical access information of the data is used for indicating the access times of receiving the data access request aiming at the data.
According to the historical access information, high-heat data with the access times ranked at the top M can be determined. Where M is a positive integer, and M may be determined from empirical values.
These high-heat data have a high access volume and therefore should be stored at a central storage node to cope with the multiple accesses that may occur. Therefore, if third target data which is not stored locally in the central storage node exists in the high-heat data, the third target data can be copied to the central storage node. The adopted mode can be as follows: and determining the storage position of the third target data according to the data storage information, acquiring the third target data according to the storage position of the third target data, and storing the third target data to the local. For example, if the storage location of the third target data is the edge storage node K, the central storage node may obtain the third target data from the edge storage node K and store the third target data into the central storage node.
In this manner, if data is hot and not stored at the central storage node, the central storage node will retrieve such data so that subsequent such data can be accessed with a faster response.
Fig. 4 is a block diagram of a data processing apparatus provided in accordance with one embodiment of the present disclosure. The data storage network is composed of a central storage node and edge storage nodes. As shown in fig. 4, the apparatus 40 may include:
a first determining module 41, configured to determine, if a data storage request carrying first target data is received, a data type of the first target data, where the data type includes a first type and a second type, and the data of the first type has a higher heat degree than the data of the second type;
a first storage module 42, configured to store the first target data and send the first target data to other storage nodes of the data storage network if the data type of the first target data is the first type, so that the other storage nodes store the first target data, where the other storage nodes at least include a central storage node.
Optionally, the first determining module 41 includes:
a first determining sub-module, configured to determine a first heat value of the first target data, where the heat value is in a positive correlation with a heat of the data, and the heat value is calculated by at least one of: data title, data label, data attribute, data size;
and the second determining submodule is used for determining the data type of the first target data according to the first heat value.
Optionally, the first determining sub-module is configured to determine that the first target data belongs to the first type if the first target data carries tag information corresponding to the first type, otherwise, determine a first heat value of the first target data, and determine a data type of the first target data according to the first heat value.
Optionally, the second determining sub-module is configured to determine a rank of the heat value according to the first heat value and a second heat value corresponding to each data stored in the data storage network, in descending order of the heat value; if the first heat value is in the top N bits of the heat value ranking, determining that the first target data belongs to the first type; and if the first heat value is not in the top N bits of the heat value ranking, determining that the first target data belongs to the second type.
Optionally, the apparatus 40 further comprises:
the second storage module is used for storing the first target data if the data type of the first target data is the second type;
the information generation module is used for generating first storage information and sending the first storage information to a central storage node, wherein the first storage information is used for indicating the storage position of the first target data.
Optionally, the apparatus 40 further comprises:
the first sending module is used for sending the data access request aiming at the second target data to a central storage node to obtain a feedback result of the central storage node if the data access request aiming at the second target data by a data access party is received and the second target data is not locally stored;
a second sending module, configured to, if a feedback result of the central storage node indicates second storage information of a storage location of the second target data, obtain the second target data from an edge storage node indicated by the second storage information, and send the second target data to the data access party;
and the third sending module is used for sending the second target data to the data access party if the second target data is locally stored or if the feedback result of the central storage node is the second target data.
Fig. 5 is a block diagram of a data processing apparatus provided in accordance with one embodiment of the present disclosure. The data storage network is composed of central storage nodes and edge storage nodes. As shown in fig. 5, the apparatus 50 includes:
a second determining module 51, configured to determine whether the second target data is stored locally if a data access request for accessing the second target data is received, where the data access request is sent by a target edge storage node;
a fourth sending module 52, configured to send the second target data to the target edge storage node if the second target data is locally stored;
a fifth sending module 53, configured to determine, if the second target data is not locally stored, second storage information used for indicating a storage location of the second target data from data storage information, and send the second storage information to the target edge storage node, where the data storage information is used for indicating a storage location of each data in the data storage network.
Optionally, the apparatus 50 further comprises:
the data access control device comprises a first acquisition module, a second acquisition module and a control module, wherein the first acquisition module is used for acquiring historical access information of each piece of data stored in the data storage network, and the historical access information of the data is used for indicating the access times of receiving a data access request aiming at the data;
the third determining module is used for determining high-heat data with access times ranked at the top M according to the historical access information;
a fourth determining module, configured to determine, if third target data that is not stored locally exists in the high-heat data, a storage location of the third target data according to the data storage information;
and the third storage module is used for acquiring the third target data according to the storage position of the third target data and storing the third target data to the local.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Referring now to FIG. 6, shown is a schematic diagram of an electronic device suitable for use in implementing embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 6, electronic device 600 may include a processing means (e.g., central processing unit, graphics processor, etc.) 601 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage means 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data necessary for the operation of the electronic apparatus 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Generally, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 608 including, for example, tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 illustrates an electronic device 600 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 609, or may be installed from the storage means 608, or may be installed from the ROM 602. The computer program, when executed by the processing device 601, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: if a data storage request carrying first target data is received, determining the data type of the first target data, wherein the data type comprises a first type and a second type, and the first type of data has higher heat than the second type of data; if the data type of the first target data is the first type, storing the first target data, and sending the first target data to other storage nodes of the data storage network, so that the other storage nodes store the first target data, wherein the other storage nodes at least comprise a central storage node.
Alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: if a data access request for accessing second target data sent by a target edge storage node is received, determining whether the second target data is stored locally; if the second target data are locally stored, the second target data are sent to the target edge storage node; if the second target data is not stored locally, second storage information used for indicating the storage position of the second target data is determined from data storage information, and the second storage information is sent to the target edge storage node, wherein the data storage information is used for indicating the storage position of each data in the data storage network.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a module does not in some cases constitute a limitation on the module itself, for example, the first determination module may also be described as a "module that determines the data type of the first target data".
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, there is provided a data processing method applied to an edge storage node of a data storage network, where the data storage network is composed of a central storage node and an edge storage node, the method including:
if a data storage request carrying first target data is received, determining the data type of the first target data, wherein the data type comprises a first type and a second type, and the first type of data has higher heat than the second type of data;
if the data type of the first target data is the first type, storing the first target data, and sending the first target data to other storage nodes of the data storage network, so that the other storage nodes store the first target data, wherein the other storage nodes at least comprise a central storage node.
According to one or more embodiments of the present disclosure, there is provided a data processing method, wherein determining a data type of the first target data includes:
determining a first heat value of the first target data, wherein the heat value is in positive correlation with the heat of data, and the heat value is calculated by at least one of: data title, data label, data attribute, data size;
and determining the data type of the first target data according to the first heat value.
According to one or more embodiments of the present disclosure, there is provided a data processing method, the method further including:
if the first target data carries the mark information corresponding to the first type, determining that the first target data belongs to the first type, otherwise, executing the steps of determining a first heat value of the first target data and determining the data type of the first target data according to the first heat value.
According to one or more embodiments of the present disclosure, there is provided a data processing method, determining a data type of the first target data according to the first heat value, including:
determining a rank of the heat values according to the first heat values and second heat values corresponding to the data stored in the data storage network and the sequence of the heat values from big to small;
if the first heat value is in the top N bits of the heat value ranking, determining that the first target data belongs to the first type;
and if the first heat value is not in the top N bits of the heat value ranking, determining that the first target data belongs to the second type.
According to one or more embodiments of the present disclosure, there is provided a data processing method, the method further including:
if the data type of the first target data is the second type, storing the first target data;
and generating first storage information and sending the first storage information to a central storage node, wherein the first storage information is used for indicating the storage position of the first target data.
According to one or more embodiments of the present disclosure, there is provided a data processing method, the method further including:
if a data access request of a data access party for second target data is received and the second target data is not locally stored, sending the data access request for the second target data to a central storage node to obtain a feedback result of the central storage node;
if the feedback result of the central storage node indicates second storage information of the storage position of the second target data, acquiring the second target data from an edge storage node indicated by the second storage information, and sending the second target data to the data access party;
and if the second target data is locally stored or if the feedback result of the central storage node is the second target data, sending the second target data to the data access party.
According to one or more embodiments of the present disclosure, there is provided a data processing method applied to a central storage node of a data storage network, where the data storage network is composed of the central storage node and edge storage nodes, the method including:
if a data access request for accessing second target data sent by a target edge storage node is received, determining whether the second target data is stored locally;
if the second target data are locally stored, the second target data are sent to the target edge storage node;
if the second target data is not stored locally, second storage information used for indicating the storage position of the second target data is determined from data storage information, and the second storage information is sent to the target edge storage node, wherein the data storage information is used for indicating the storage position of each data in the data storage network.
According to one or more embodiments of the present disclosure, there is provided a data processing method, the method further including:
obtaining historical access information of each data stored in the data storage network, wherein the historical access information of the data is used for indicating the access times of receiving data access requests aiming at the data;
according to the historical access information, determining high-heat data with access times ranked at the top M bits;
if third target data which are not stored locally exist in the high-heat data, determining the storage position of the third target data according to the data storage information;
and acquiring the third target data according to the storage position of the third target data, and storing the third target data to the local.
According to one or more embodiments of the present disclosure, there is provided a data processing apparatus applied to an edge storage node of a data storage network, the data storage network being configured by a central storage node and the edge storage node, the apparatus including:
the data storage device comprises a first determining module, a second determining module and a processing module, wherein the first determining module is used for determining the data type of first target data if a data storage request carrying the first target data is received, the data type comprises a first type and a second type, and the first type of data has higher heat than the second type of data;
the first storage module is configured to store the first target data and send the first target data to other storage nodes of the data storage network if the data type of the first target data is the first type, so that the other storage nodes store the first target data, where the other storage nodes at least include a central storage node.
According to one or more embodiments of the present disclosure, there is provided a data processing apparatus, the first determining module including:
a first determining sub-module, configured to determine a first heat value of the first target data, where the heat value is in a positive correlation with a heat of the data, and the heat value is calculated by at least one of: data title, data label, data attribute, data size;
and the second determining submodule is used for determining the data type of the first target data according to the first heat value.
According to one or more embodiments of the present disclosure, there is provided a data processing apparatus, where the first determining sub-module is configured to determine that the first target data belongs to the first type if the first target data carries tag information corresponding to the first type, otherwise, determine a first heat value of the first target data, and determine a data type of the first target data according to the first heat value.
According to one or more embodiments of the present disclosure, a data processing apparatus is provided, where the second determining sub-module is configured to determine, according to the first heat value and a second heat value corresponding to each data already stored in the data storage network, a heat value ranking according to an order of heat values from large to small; if the first heat value is in the top N bits of the heat value ranking, determining that the first target data belongs to the first type; and if the first heat value is not in the top N bits of the heat value ranking, determining that the first target data belongs to the second type.
According to one or more embodiments of the present disclosure, there is provided a data processing apparatus, the apparatus further including:
the second storage module is used for storing the first target data if the data type of the first target data is the second type;
the information generation module is used for generating first storage information and sending the first storage information to a central storage node, wherein the first storage information is used for indicating the storage position of the first target data.
According to one or more embodiments of the present disclosure, there is provided a data processing apparatus, the apparatus further including:
the first sending module is used for sending the data access request aiming at the second target data to a central storage node to obtain a feedback result of the central storage node if the data access request aiming at the second target data by a data access party is received and the second target data is not locally stored;
a second sending module, configured to, if a feedback result of the central storage node indicates second storage information of a storage location of the second target data, obtain the second target data from an edge storage node indicated by the second storage information, and send the second target data to the data access party;
and the third sending module is used for sending the second target data to the data access party if the second target data is locally stored or if the feedback result of the central storage node is the second target data.
According to one or more embodiments of the present disclosure, there is provided a data processing apparatus applied to a central storage node of a data storage network, the data storage network being composed of the central storage node and edge storage nodes, the apparatus including:
the second determining module is used for determining whether the second target data is locally stored or not if a data access request which is sent by a target edge storage node and used for accessing the second target data is received;
a fourth sending module, configured to send the second target data to the target edge storage node if the second target data is locally stored;
and a fifth sending module, configured to determine, if the second target data is not locally stored, second storage information used for indicating a storage location of the second target data from data storage information, and send the second storage information to the target edge storage node, where the data storage information is used for indicating a storage location of each data in the data storage network.
According to one or more embodiments of the present disclosure, there is provided a data processing apparatus, the apparatus further including:
the data access control device comprises a first acquisition module, a second acquisition module and a control module, wherein the first acquisition module is used for acquiring historical access information of each piece of data stored in the data storage network, and the historical access information of the data is used for indicating the access times of receiving a data access request aiming at the data;
the third determining module is used for determining high-heat data with access times ranked at the top M according to the historical access information;
a fourth determining module, configured to determine, if third target data that is not stored locally exists in the high-heat data, a storage location of the third target data according to the data storage information;
and the third storage module is used for acquiring the third target data according to the storage position of the third target data and storing the third target data to the local.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims. With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Claims (12)
1. A data processing method is applied to an edge storage node of a data storage network, wherein the data storage network is composed of a central storage node and the edge storage node, and the method comprises the following steps:
if a data storage request carrying first target data is received, determining the data type of the first target data, wherein the data type comprises a first type and a second type, and the first type of data has higher heat than the second type of data;
if the data type of the first target data is the first type, storing the first target data, and sending the first target data to other storage nodes of the data storage network, so that the other storage nodes store the first target data, wherein the other storage nodes at least comprise a central storage node.
2. The method of claim 1, wherein the determining the data type of the first target data comprises:
determining a first heat value of the first target data, wherein the heat value is in positive correlation with the heat of data, and the heat value is calculated by at least one of: data title, data label, data attribute, data size;
and determining the data type of the first target data according to the first heat value.
3. The method of claim 2, further comprising:
if the first target data carries the mark information corresponding to the first type, determining that the first target data belongs to the first type, otherwise, executing the steps of determining a first heat value of the first target data and determining the data type of the first target data according to the first heat value.
4. The method of claim 2, wherein determining the data type of the first target data based on the first heat value comprises:
determining a rank of the heat values according to the first heat values and second heat values corresponding to the data stored in the data storage network and the sequence of the heat values from big to small;
if the first heat value is in the top N bits of the heat value ranking, determining that the first target data belongs to the first type;
and if the first heat value is not in the top N bits of the heat value ranking, determining that the first target data belongs to the second type.
5. The method of claim 1, further comprising:
if the data type of the first target data is the second type, storing the first target data;
and generating first storage information and sending the first storage information to a central storage node, wherein the first storage information is used for indicating the storage position of the first target data.
6. The method of claim 1, further comprising:
if a data access request of a data access party for second target data is received and the second target data is not locally stored, sending the data access request for the second target data to a central storage node to obtain a feedback result of the central storage node;
if the feedback result of the central storage node indicates second storage information of the storage position of the second target data, acquiring the second target data from an edge storage node indicated by the second storage information, and sending the second target data to the data access party;
and if the second target data is locally stored or if the feedback result of the central storage node is the second target data, sending the second target data to the data access party.
7. A data processing method is applied to a central storage node of a data storage network, wherein the data storage network is composed of the central storage node and an edge storage node, and the method comprises the following steps:
if a data access request for accessing second target data sent by a target edge storage node is received, determining whether the second target data is stored locally;
if the second target data are locally stored, the second target data are sent to the target edge storage node;
if the second target data is not stored locally, second storage information used for indicating the storage position of the second target data is determined from data storage information, and the second storage information is sent to the target edge storage node, wherein the data storage information is used for indicating the storage position of each data in the data storage network.
8. The method of claim 7, further comprising:
obtaining historical access information of each data stored in the data storage network, wherein the historical access information of the data is used for indicating the access times of receiving data access requests aiming at the data;
according to the historical access information, determining high-heat data with access times ranked at the top M bits;
if third target data which are not stored locally exist in the high-heat data, determining the storage position of the third target data according to the data storage information;
and acquiring the third target data according to the storage position of the third target data, and storing the third target data to the local.
9. A data processing apparatus, applied to an edge storage node of a data storage network, the data storage network being composed of a central storage node and the edge storage node, the apparatus comprising:
the data storage device comprises a first determining module, a second determining module and a processing module, wherein the first determining module is used for determining the data type of first target data if a data storage request carrying the first target data is received, the data type comprises a first type and a second type, and the first type of data has higher heat than the second type of data;
the first storage module is configured to store the first target data and send the first target data to other storage nodes of the data storage network if the data type of the first target data is the first type, so that the other storage nodes store the first target data, where the other storage nodes at least include a central storage node.
10. A data processing apparatus, applied to a central storage node of a data storage network, the data storage network being composed of the central storage node and edge storage nodes, the apparatus comprising:
the second determining module is used for determining whether the second target data is locally stored or not if a data access request which is sent by a target edge storage node and used for accessing the second target data is received;
a fourth sending module, configured to send the second target data to the target edge storage node if the second target data is locally stored;
and a fifth sending module, configured to determine, if the second target data is not locally stored, second storage information used for indicating a storage location of the second target data from data storage information, and send the second storage information to the target edge storage node, where the data storage information is used for indicating a storage location of each data in the data storage network.
11. A computer-readable medium, on which a computer program is stored, which, when being executed by a processing means, carries out the steps of the method of any one of claims 1 to 6, or which, when being executed by a processing means, carries out the steps of the method of claim 7 or 8.
12. An electronic device, comprising:
a storage device having a computer program stored thereon;
processing means for executing the computer program in the storage means to carry out the steps of the method of any one of claims 1 to 6 or to carry out the steps of the method of claim 7 or 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010079099.4A CN111309254A (en) | 2020-02-03 | 2020-02-03 | Data processing method and device, readable medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010079099.4A CN111309254A (en) | 2020-02-03 | 2020-02-03 | Data processing method and device, readable medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111309254A true CN111309254A (en) | 2020-06-19 |
Family
ID=71145681
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010079099.4A Pending CN111309254A (en) | 2020-02-03 | 2020-02-03 | Data processing method and device, readable medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111309254A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111753239A (en) * | 2020-06-23 | 2020-10-09 | 北京奇艺世纪科技有限公司 | Resource distribution method and device, electronic equipment and storage medium |
| WO2022143751A1 (en) * | 2020-12-29 | 2022-07-07 | 华为技术有限公司 | Method for managing storage system, and storage system and computing program product |
| CN115033187A (en) * | 2022-08-10 | 2022-09-09 | 蓝深远望科技股份有限公司 | Big data based analysis management method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101883012A (en) * | 2010-07-09 | 2010-11-10 | 四川长虹电器股份有限公司 | Processing method of storage resource in network edge node |
| CN103747047A (en) * | 2013-12-24 | 2014-04-23 | 乐视网信息技术（北京）股份有限公司 | CDN file storage method, file distribution control center and system thereof |
| CN104580274A (en) * | 2013-10-12 | 2015-04-29 | 中国电信股份有限公司 | Content replacement method, system and node in CDN |
| CN107015884A (en) * | 2016-01-28 | 2017-08-04 | 杭州海康威视数字技术股份有限公司 | A kind of date storage method and device |
| CN109788025A (en) * | 2018-12-12 | 2019-05-21 | 北京世纪互联宽带数据中心有限公司 | Data classification method and its device, electronic equipment, computer-readable medium |
-
2020
- 2020-02-03 CN CN202010079099.4A patent/CN111309254A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101883012A (en) * | 2010-07-09 | 2010-11-10 | 四川长虹电器股份有限公司 | Processing method of storage resource in network edge node |
| CN104580274A (en) * | 2013-10-12 | 2015-04-29 | 中国电信股份有限公司 | Content replacement method, system and node in CDN |
| CN103747047A (en) * | 2013-12-24 | 2014-04-23 | 乐视网信息技术（北京）股份有限公司 | CDN file storage method, file distribution control center and system thereof |
| CN107015884A (en) * | 2016-01-28 | 2017-08-04 | 杭州海康威视数字技术股份有限公司 | A kind of date storage method and device |
| CN109788025A (en) * | 2018-12-12 | 2019-05-21 | 北京世纪互联宽带数据中心有限公司 | Data classification method and its device, electronic equipment, computer-readable medium |
Non-Patent Citations (1)
| Title |
|---|
| 章瑞 等: "《云计算》", 重庆大学出版社, pages: 102 - 103 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111753239A (en) * | 2020-06-23 | 2020-10-09 | 北京奇艺世纪科技有限公司 | Resource distribution method and device, electronic equipment and storage medium |
| CN111753239B (en) * | 2020-06-23 | 2023-09-05 | 北京奇艺世纪科技有限公司 | Resource distribution method and device, electronic equipment and storage medium |
| WO2022143751A1 (en) * | 2020-12-29 | 2022-07-07 | 华为技术有限公司 | Method for managing storage system, and storage system and computing program product |
| CN115033187A (en) * | 2022-08-10 | 2022-09-09 | 蓝深远望科技股份有限公司 | Big data based analysis management method |
| CN115033187B (en) * | 2022-08-10 | 2022-11-08 | 蓝深远望科技股份有限公司 | Big data based analysis management method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111309254A (en) | Data processing method and device, readable medium and electronic equipment | |
| CN110781373B (en) | List updating method and device, readable medium and electronic equipment | |
| CN111400625B (en) | Page processing method and device, electronic equipment and computer readable storage medium | |
| CN112379982B (en) | Task processing method, device, electronic equipment and computer readable storage medium | |
| CN111596991A (en) | Interactive operation execution method and device and electronic equipment | |
| CN111614759B (en) | Resource sharing method and device, electronic equipment and computer readable medium | |
| CN111246228A (en) | Method, device, medium and electronic equipment for updating gift resources of live broadcast room | |
| CN111163324B (en) | Information processing method and device and electronic equipment | |
| CN110825481A (en) | Method and device for displaying page information corresponding to page tag and electronic equipment | |
| CN111262744B (en) | Multimedia information transmitting method, backup server and medium | |
| CN115250295A (en) | Media content processing method, device, equipment and storage medium | |
| CN111262907B (en) | Service instance access method and device and electronic equipment | |
| CN111339452B (en) | Method, terminal, server and system for displaying search result | |
| CN111798251A (en) | Verification method and device of house source data and electronic equipment | |
| CN111241137A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN112084441A (en) | Information retrieval method and device and electronic equipment | |
| CN114428925A (en) | Page rendering method and device, electronic equipment and computer readable medium | |
| CN113240108A (en) | Model training method and device and electronic equipment | |
| CN111597439A (en) | Information processing method and device and electronic equipment | |
| CN113890772A (en) | Information processing method and device and electronic equipment | |
| CN112333462A (en) | Live broadcast room page jumping method, returning device and electronic equipment | |
| CN111625745A (en) | Recommendation method and device, electronic equipment and computer readable medium | |
| CN111782895A (en) | Retrieval processing method and device, readable medium and electronic equipment | |
| CN111680754A (en) | Image classification method and device, electronic equipment and computer-readable storage medium | |
| CN111625707B (en) | Recommendation response method, device, medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |