CN114827256B - Data pre-pushing method, data downloading method and system - Google Patents
Data pre-pushing method, data downloading method and system Download PDFInfo
- Publication number
- CN114827256B CN114827256B CN202210501033.9A CN202210501033A CN114827256B CN 114827256 B CN114827256 B CN 114827256B CN 202210501033 A CN202210501033 A CN 202210501033A CN 114827256 B CN114827256 B CN 114827256B
- Authority
- CN
- China
- Prior art keywords
- data
- service type
- target
- type identifier
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000003860 storage Methods 0.000 claims abstract description 77
- 230000004044 response Effects 0.000 claims description 6
- 238000007726 management method Methods 0.000 description 54
- 230000008569 process Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The application relates to a data pre-pushing method, a data downloading method and a data downloading system. The method comprises the steps that a management end obtains service type identifiers and access frequencies corresponding to data downloading requests in a preset time period; the management end responds to a pre-push request sent by the push end, and sends a pre-push list to the push end based on the service type identifier and the access frequency; the pushing end queries and acquires third party data in a pre-pushing list from the CDN network; the pushing end sends the third party data to the P2P node; and the P2P node sends the third-party data to the management end in the storage path of the P2P node. By setting the access frequency of the data downloading requests of the management end in a preset time period, when the access frequency of the data downloading requests meets the set requirement, the pre-pushing list comprising the third party data is sent to the pushing end, so that the pushing end can acquire the third party data and store the third party data to the P2P node, and the pre-pushing of the third party data to the P2P node is completed.
Description
Technical Field
The present application relates to the field of computers, and in particular, to a data pre-pushing method, a data downloading method and a system.
Background
With diversification of video coding formats, production forms and product forms, HCDNs (large-scale hybrid architecture) have the function of externally bearing data distribution, and more files in an irregular format of third party service are accessed, such as some installation packages, plug-ins, some huge screen advertisements and the like. The number of the files is large, the files are short, and a file production server can only provide one fid information, which causes pressure on pushing the files to the P2P node by the server. The file lacks information such as tvid/vid and the like, the pushing end cannot acquire video information like original query by qipu according to tvid, the video information is pre-pushed to a P2P node, and great resistance is formed for downloading data in a P2P mode to the client.
Before the push end encounters such a file, the file is directly filtered and is not pushed any more, which definitely puts pressure on the CDN bandwidth of the data distribution block, so that the P2P bandwidth is used for downloading the file as much as possible, and the CDN bandwidth pressure and bandwidth cost are reduced.
Disclosure of Invention
The application provides a data pre-pushing method, a data downloading method and a data downloading system, which are used for realizing the pre-pushing of third-party data.
In a first aspect, a data pre-pushing method is provided, including:
the management end obtains service type identifiers and access frequencies corresponding to the data downloading requests in a preset time period;
the management end responds to a pre-push request sent by a push end, and sends a pre-push list to the push end based on the service type identifier and the access frequency, wherein the pre-push list comprises third party data;
the pushing end queries and acquires third party data in the pre-pushing list from a CDN network;
the pushing end sends the third party data to a P2P node;
and the P2P node sends the third party data to the management end on a storage path of the P2P node.
Optionally, based on the service type identifier and the access frequency, sending a pre-push list to the push end includes:
searching a target service type identifier from the service type identifiers, wherein the target service type identifier is the service type identifier of the third party data;
acquiring a target access frequency corresponding to the target service type identifier from the access frequency;
and when the target access frequency is determined to be greater than a preset frequency threshold, generating the pre-push list based on the target service type identifier, and sending the pre-push list to the push terminal.
Optionally, the service type identifier corresponding to each data downloading request in the preset time period acquired by the management end is the target service type identifier;
the management end obtains the corresponding access frequency of each data downloading request in a preset time period, and the method comprises the following steps:
acquiring the marking times of the data downloading request corresponding to the target service type identifier by the management end in the preset time period, wherein the preset identifier indicates that the target data corresponding to the target service type identifier can be downloaded through a P2P node;
and calculating the access frequency of the data downloading request corresponding to the target service type identifier based on the preset time period and the marking times.
Optionally, the pushing end queries and obtains third party data in the pre-pushing list from the CDN network, including:
and the pushing end queries CDN global cache service deployed in the CDN network by adopting the target service type identifier to acquire the third-party data.
In a second aspect, a data downloading method is provided, including:
the method comprises the steps that a management end responds to a storage path query request of target data sent by a client, and a storage path of a P2P node corresponding to the target data is provided for the client; the storage path of the P2P node is obtained based on the method of the first aspect; the target data are third party data;
and the P2P node responds to a data downloading request sent by the client and provides the target data for the client.
Optionally, the managing end responds to a storage path query request of target data sent by a client, and provides a storage path of a P2P node corresponding to the target data for the client, including:
acquiring a target service type identifier of the target data from the storage path query request;
acquiring a storage path matched with the target service type identifier;
and taking the storage path matched with the target type identifier as the storage path of the P2P node corresponding to the target data, and providing the storage path matched with the target type identifier for the client.
Optionally, before providing the storage path of the P2P node corresponding to the target data to the client, the method further includes:
acquiring the priority of the target data from the storage path query request, wherein the priority indicates the emergency degree of acquiring the target data;
determining that the priority is not greater than a priority threshold.
Optionally, before the management end responds to the storage path query request of the target data sent by the client and provides the storage path of the P2P node corresponding to the target data for the client, after determining that the priority is not greater than the priority threshold, the method further includes:
and determining that the waiting timeout time corresponding to the priority is not ended.
In a third aspect, a data pre-push system is provided, including:
the system comprises a management end, a pushing end and a P2P node;
the management end is used for acquiring service type identifiers and access frequencies corresponding to the data downloading requests in a preset time period; responding to a pre-push request sent by the push terminal, and sending a pre-push list to the push terminal based on the service type identifier and the access frequency, wherein the pre-push list comprises third party data;
the pushing end is used for inquiring and acquiring third party data in the pre-pushing list from a CDN network; transmitting the third party data to the P2P node;
and the P2P node is used for sending the third party data to the management end in the storage path of the P2P node.
In a fourth aspect, there is provided a data download system comprising:
the system comprises a management end, a client and a P2P node;
the management end is used for responding to a storage path query request of target data sent by the client and providing a storage path of a P2P node corresponding to the target data for the client; the storage path of the P2P node is obtained based on the method of any one of claims 1-3; the target data are third party data;
the P2P node is used for responding to the data downloading request sent by the client and providing the target data for the client.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages: in the scheme provided by the embodiment of the application, by setting the access frequency of the data downloading request, which is counted by the management end in the preset time period, when the access frequency of the data downloading request meets the set requirement, the pre-pushing list comprising the third party data is sent to the pushing end, so that the pushing end can acquire the third party data and store the third party data to the P2P node, and the pre-pushing of the third party data to the P2P node is completed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
Fig. 1 is a schematic flow chart of a data pre-pushing method in an embodiment of the present application;
FIG. 2 is a flow chart of a data downloading method according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a data pre-pushing system in an embodiment of the present application;
FIG. 4 is a schematic diagram of a data download system according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a data processing system in an embodiment of the application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.
The term "and/or" is herein merely an association relationship describing an associated object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
The embodiment of the application provides a data pre-pushing method, as shown in fig. 1, which can comprise the following steps:
step 101, the management end obtains service type identifiers and access frequencies corresponding to the data downloading requests in a preset time period.
In application, the preset time period may be preset manually based on experience or according to actual needs, and the embodiment is not limited specifically.
In the application, the data download request carries a service type identifier (business_type), and the service type identifier indicates the service type of the data required to be requested by the data download request. After the management end obtains the data downloading request, based on the service type identifier in the data downloading request, the access times of the data downloading request are counted, and further after the preset time period is finished, the access frequency can be calculated based on the access times and the preset time period.
In one example, the service type identifier carried by the service type identifier acquired by the management end indicates that the data to be requested by the data download request is third party data, if the management end acquires the data download request for the first time, the access frequency corresponding to the service type identifier is set to 1 time, and if the management end does not acquire the data download request for the first time, the access frequency corresponding to the service type identifier is added to 1.
In this embodiment, in order to avoid that the management end directly filters such data downloading requests after obtaining the data downloading requests indicating that the requested data is the service type identifier of the third party data, the management end is configured to mark such data downloading requests and not filter such data downloading requests after receiving such data downloading requests, so as to count the access frequency of such data downloading requests. Therefore, in this embodiment, the number of access times of such data download requests may be indicated by the number of tags, so as to calculate the access frequency of such data download requests based on the number of tags.
In a specific implementation, in an optional embodiment, the number of marking times of a data downloading request corresponding to a target service type identifier by a management end is obtained in a preset time period, and the preset identifier indicates that target data corresponding to the target service type identifier can be downloaded through a P2P node; and calculating the access frequency of the data downloading request corresponding to the target service type identifier based on the preset time period and the marking times.
It should be understood that the manner of tagging such data download requests is not limited in this embodiment.
It should be understood that in this step, after the management end obtains the data download request, whether the storage path of the P2P node corresponding to the data download request is stored may be queried based on the data download request, when the storage path with the P2P node is determined, the storage path of the P2P node may be returned to the client, when it is determined that the storage path without the P2P node is not determined, if the data download request requests to download the third party data, the data download request is marked.
Step 102, the management end responds to the pre-push request sent by the push end, and sends a pre-push list to the push end based on the service type identifier and the access frequency, wherein the pre-push list comprises third-party data.
In this embodiment, in order to reduce the processing amount of pre-pushing as much as possible on the basis of implementing the pushing of the third party data, the third party data frequently requested by the client is set, and the management end performs pre-pushing to the pushing end, while the management end does not perform pre-pushing to the pushing end for the third party data not frequently requested by the client.
In a specific implementation, in an alternative embodiment, searching a target service type identifier from service type identifiers, wherein the target service type identifier is a service type identifier of third party data; acquiring a target access frequency corresponding to the target service type identifier from the access frequencies; and when the target access frequency is determined to be greater than a preset frequency threshold, generating a pre-push list based on the target service type identifier, and sending the pre-push list to the push terminal.
In application, the preset frequency threshold may be set manually based on experience or according to actual needs, which is not limited in this embodiment.
Step 103, the pushing end queries and acquires third party data in the pre-pushing list from the CDN.
In the application, CDN global cache service is deployed in the CDN network. The pushing end can adopt the service type identification of the third party data to inquire CDN global cache service deployed in the CDN network so as to acquire the third party data.
Step 104, the pushing end sends the pre-pushed data to the P2P node.
Step 105, the P2P node sends the pre-pushed data to the management end in the storage path of the P2P node.
In the scheme provided by the embodiment of the application, by setting the access frequency of the data downloading request, which is counted by the management end in the preset time period, when the access frequency of the data downloading request meets the set requirement, the pre-pushing list comprising the third party data is sent to the pushing end, so that the pushing end can acquire the third party data and store the third party data to the P2P node, and the pre-pushing of the third party data to the P2P node is completed.
Based on the same inventive concept, the present embodiment provides a data downloading method, as shown in fig. 2, which may include the following steps:
step 201, a management end responds to a storage path query request of target data sent by a client and provides a storage path of a P2P node corresponding to the target data for the client; the storage path of the P2P node is obtained based on the data pre-pushing method; the target data is third party data.
In this embodiment, the management end may search the storage path of the P2P node based on the service type of the target data.
In a specific implementation, in an alternative embodiment, a target service type identifier of target data is obtained from a storage path query request; acquiring a storage path matched with a target service type identifier; and taking the storage path matched with the target type identifier as the storage path of the P2P node corresponding to the target data, and providing the storage path matched with the target type identifier for the client.
In application, since the download rate of P2P download is low compared to CDN download, for some data that is not urgent, P2P download is used to alleviate the pressure of CDN. Therefore, in this embodiment, when the target data is non-urgent data, a storage path of the P2P node corresponding to the target data may be provided to the client.
In a specific implementation, in an optional embodiment, before providing a storage path of a P2P node corresponding to target data to a client, acquiring a priority of the target data from a storage path query request, where the priority indicates an emergency degree of acquiring the target data; the priority is determined to be not greater than the priority threshold.
In the application, the priority of the target data may be indicated by the downloading time of the target data. For example, when the downloading time of the target data carried in the path query request is stored and is far from the time when the path query request is acquired by the management end, the priority of the target data is determined to be higher, and the CDN should be preferentially adopted for downloading at the moment; when the downloading time is closer to the time when the management end obtains the path query request, the priority of the target data is determined to be lower, and at the moment, the management end can return the storage path of the P2P node to the client.
In this embodiment, in order to avoid low user experience caused by long waiting time of the client, a waiting timeout is set, and if the client still does not receive the storage path of the P2P node returned by the push terminal after the waiting timeout is over, data may be requested to the CDN network. In this case, in order to reduce the pressure of the CDN network, when the client requests data from the CDN network, the client may request a portion of the data from the CDN network, and set that no other data than the portion of the data in the data is requested from the CDN network within a preset duration. When the preset duration is over, if the storage path of the P2P node returned by the push terminal is received, other data is requested to the P2P node through the storage path, and if the P2P node returned by the push terminal is not received after the preset duration is over, other data is continuously downloaded through the CDN network.
Step 202, the P2P node provides target data to the client in response to the data download request sent by the client.
Based on the same inventive concept, this embodiment provides a data pushing system, as shown in fig. 3, which may include the following steps:
a management end 301, a push end 302 and a P2P node 303;
the management end 301 is configured to obtain a service type identifier and an access frequency corresponding to each data download request in a preset time period; in response to the pre-push request sent by the push terminal 302, sending a pre-push list to the push terminal 302 based on the service type identifier and the access frequency, wherein the pre-push list comprises third party data;
the pushing end 302 is configured to query and obtain third party data in the pre-pushing list from the CDN network; transmitting the third party data to the P2P node 303;
the P2P node 303 is configured to send the third party data to the management end 301 in a storage path of the P2P node 303.
The management end 301 is configured to:
searching a target service type identifier from service type identifiers, wherein the target service type identifier is a service type identifier of third-party data;
acquiring a target access frequency corresponding to the target service type identifier from the access frequencies;
and when the target access frequency is determined to be greater than a preset frequency threshold, generating a pre-push list based on the target service type identifier, and sending the pre-push list to the push terminal.
The service type identifier corresponding to each data downloading request in a preset time period acquired by a management end is a target service type identifier;
the management end 301 is configured to:
acquiring the marking times of a data downloading request corresponding to a target service type identifier marked by a management end by adopting a preset identifier in a preset time period, wherein the preset identifier indicates that target data corresponding to the target service type identifier can be downloaded through a P2P node;
and calculating the access frequency of the data downloading request corresponding to the target service type identifier based on the preset time period and the marking times.
The pushing end 302 is configured to:
and the pushing end adopts the target service type identifier to inquire CDN global cache service deployed in the CDN network and acquire third-party data.
Based on the same inventive concept, the present embodiment provides a data downloading system, as shown in fig. 4, which may include the steps of:
a management end 401, a client 402 and a P2P node 403;
the management end 401 is configured to provide, to the client 402, a storage path of the P2P node 403 corresponding to the target data in response to a storage path query request of the target data sent by the client 402; the storage path of the P2P node 403 is obtained based on the data pre-pushing method; the target data is third party data;
the P2P node 403 is configured to provide the target data to the client 402 in response to a data download request sent by the client 402.
The management end 401 is configured to:
acquiring a target service type identifier of target data from a storage path query request;
acquiring a storage path matched with a target service type identifier;
and taking the storage path matched with the target type identifier as the storage path of the P2P node corresponding to the target data, and providing the storage path matched with the target type identifier for the client.
The management end 401 is further configured to:
before providing a storage path of a P2P node corresponding to target data for a client, acquiring the priority of the target data from a storage path query request, wherein the priority indicates the emergency degree of acquiring the target data;
the priority is determined to be not greater than the priority threshold.
The management end 401 is further configured to:
and the management end responds to a storage path query request of the target data sent by the client, and determines that the waiting timeout time corresponding to the priority is not ended after determining that the priority is not greater than the priority threshold before providing the storage path of the P2P node corresponding to the target data for the client.
For easy understanding, the following describes the scheme of the present application from the point of view of data pre-pushing and data downloading in conjunction with a data processing system composed of a client, a management end, a pushing end and a P2P node. As shown in fig. 5, the data processing system includes:
client 501, management 502, push 503 and P2P node 504;
when the client 501 calls the hcdn to create a download task, the service party carries a business_type identifier, and when the client requests the node query from the management end 502, the client carries a value corresponding to the business_type configured at the cloud. Different service parties correspond to different values;
the management end 502 receives the identifier to mark and does not filter any more, when the file fid access frequency is reached, when the pushing end acquires a pre-pushing list from the tracker, the pushing end is informed of the fid and the service type;
the pushing end 503 tries to query the file information from the CDN global cache service according to different service types, if the file information is found, the file information is pre-pushed to the P2P node 504, and the P2P node 504 performs node reporting to the management end 502;
when the client 501 requests the file node query again, the management end 502 returns to the P2P node 504, and the client 501 downloads.
In this embodiment, considering the diversity of the third party service, some of the third party services are pre-downloaded, and the data needs to be not timely enough, so that the priority can be configured according to the service, and the downloading mode of the data can be set according to the priority. For example, like the currently accessed drama advertisement, we default to low priority, and use the P2P node to download preferentially; some real-time requirements are high, like playrkernel downloading, the possible priority is set to be medium or higher, CDN network downloading can be preferentially used, and P2P timeout waiting for CDN downloading can be dynamically configured.
In this embodiment, priority switching is also supported. For example, the low priority is set outside the initial stage of task creation, when the time of needing data is close, the task priority can be switched to the higher priority in real time, and at the moment, the task priority can be correspondingly switched to the corresponding allocation strategy, so that the CDN downloading is biased, and the data downloading speed is ensured.
In this embodiment, a wait timeout is also supported.
Because the client requests the management end for the return of the node query result to take time, the CDN can be in a downloadable state earlier than P2P, for the task with low priority, the cloud control can set the waiting timeout time1, and the waiting timeout time1 is not allocated to the CDN until the waiting timeout time1 arrives, unless the management end returns to the node without P2P;
for tasks with medium or higher priority, when the P2P is not ready, partial block data may be preferentially allocated to the CDN for downloading, and a timeout time period of time2 may be set, when the CDN is no longer allocated until time period of time2 arrives, and the CDN is allocated again unless all of the blocks allocated by the CDN have been completely downloaded by the P2P or are in a state of being unable to be allocated.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, by a wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, microwave, etc.) means from one website, computer, server, or data center to another. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape, etc.), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), etc.
It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing is only a specific embodiment of the application to enable those skilled in the art to understand or practice the application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (8)
1. The data pre-pushing method is characterized by comprising the following steps of:
the management end obtains service type identifiers and access frequencies corresponding to the data downloading requests in a preset time period;
the management end responds to a pre-push request sent by a push end, and sends a pre-push list to the push end based on the service type identifier and the access frequency, wherein the pre-push list comprises third party data;
the pushing end queries and acquires third party data in the pre-pushing list from a CDN network;
the pushing end sends the third party data to a P2P node;
the P2P node sends the third party data to the management end in a storage path of the P2P node;
wherein, based on the service type identifier and the access frequency, sending a pre-push list to the push terminal includes:
searching a target service type identifier from the service type identifiers, wherein the target service type identifier is the service type identifier of the third party data;
acquiring a target access frequency corresponding to the target service type identifier from the access frequency;
when the target access frequency is determined to be greater than a preset frequency threshold, generating the pre-push list based on the target service type identifier, and sending the pre-push list to the push terminal;
the service type identifier corresponding to each data downloading request in the preset time period acquired by the management end is the target service type identifier;
the management end obtains the corresponding access frequency of each data downloading request in a preset time period, and the method comprises the following steps:
acquiring the marking times of the data downloading request corresponding to the target service type identifier by the management end in the preset time period, wherein the preset identifier indicates that the target data corresponding to the target service type identifier can be downloaded through a P2P node;
and calculating the access frequency of the data downloading request corresponding to the target service type identifier based on the preset time period and the marking times.
2. The method of claim 1, wherein the pushing end queries and obtains third party data in the pre-push list from a CDN network, including:
and the pushing end queries CDN global cache service deployed in the CDN network by adopting the target service type identifier to acquire the third-party data.
3. A method of data download, comprising:
the method comprises the steps that a management end responds to a storage path query request of target data sent by a client, and a storage path of a P2P node corresponding to the target data is provided for the client; the storage path of the P2P node is obtained based on the method of claim 1 or 2; the target data are third party data;
and the P2P node responds to a data downloading request sent by the client and provides the target data for the client.
4. The method of claim 3, wherein the managing, in response to a storage path query request of target data sent by a client, provides a storage path of a P2P node corresponding to the target data to the client, comprising:
acquiring a target service type identifier of the target data from the storage path query request;
acquiring a storage path matched with the target service type identifier;
and taking the storage path matched with the target service type identifier as the storage path of the P2P node corresponding to the target data, and providing the storage path matched with the target service type identifier for the client.
5. The method of claim 3, further comprising, prior to providing the storage path of the P2P node corresponding to the target data to the client:
acquiring the priority of the target data from the storage path query request, wherein the priority indicates the emergency degree of acquiring the target data;
determining that the priority is not greater than a priority threshold.
6. The method according to claim 5, wherein after determining that the priority is not greater than the priority threshold before providing the storage path of the P2P node corresponding to the target data to the client in response to the storage path query request of the target data sent by the client, the method further comprises:
and determining that the waiting timeout time corresponding to the priority is not ended.
7. A data pre-push system, comprising:
the system comprises a management end, a pushing end and a P2P node;
the management end is used for acquiring service type identifiers and access frequencies corresponding to the data downloading requests in a preset time period; responding to a pre-push request sent by the push terminal, and sending a pre-push list to the push terminal based on the service type identifier and the access frequency, wherein the pre-push list comprises third party data; wherein, based on the service type identifier and the access frequency, sending a pre-push list to the push terminal includes: searching a target service type identifier from the service type identifiers, wherein the target service type identifier is the service type identifier of the third party data; acquiring a target access frequency corresponding to the target service type identifier from the access frequency; when the target access frequency is determined to be greater than a preset frequency threshold, generating the pre-push list based on the target service type identifier, and sending the pre-push list to the push terminal; the service type identifier corresponding to each data downloading request in the preset time period acquired by the management end is the target service type identifier; the management end obtains the corresponding access frequency of each data downloading request in a preset time period, and the method comprises the following steps: acquiring the marking times of the data downloading request corresponding to the target service type identifier by the management end in the preset time period, wherein the preset identifier indicates that the target data corresponding to the target service type identifier can be downloaded through a P2P node; calculating the access frequency of the data downloading request corresponding to the target service type identifier based on the preset time period and the marking times;
the pushing end is used for inquiring and acquiring third party data in the pre-pushing list from a CDN network; transmitting the third party data to the P2P node;
and the P2P node is used for sending the third party data to the management end in the storage path of the P2P node.
8. A data download system, comprising:
the system comprises a management end, a client and a P2P node;
the management end is used for responding to a storage path query request of target data sent by the client and providing a storage path of a P2P node corresponding to the target data for the client; the storage path of the P2P node is obtained based on the method of claim 1 or 2; the target data are third party data;
the P2P node is used for responding to the data downloading request sent by the client and providing the target data for the client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210501033.9A CN114827256B (en) | 2022-05-09 | 2022-05-09 | Data pre-pushing method, data downloading method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210501033.9A CN114827256B (en) | 2022-05-09 | 2022-05-09 | Data pre-pushing method, data downloading method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114827256A CN114827256A (en) | 2022-07-29 |
| CN114827256B true CN114827256B (en) | 2023-12-15 |
Family
ID=82512893
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210501033.9A Active CN114827256B (en) | 2022-05-09 | 2022-05-09 | Data pre-pushing method, data downloading method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114827256B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2237518A1 (en) * | 2009-03-30 | 2010-10-06 | Mitsubishi Electric Corporation | Pre-pushing of popular content in a network of end-user equipments |
| CN103023971A (en) * | 2012-11-15 | 2013-04-03 | 广州酷狗计算机科技有限公司 | Information pushing method and system of music sharing radio stations |
| CN103475719A (en) * | 2013-09-12 | 2013-12-25 | 北京科技大学 | Content distribution method for minimizing cross-domain flows in CDN-P2P fusion network |
| CN105830413A (en) * | 2013-10-25 | 2016-08-03 | 蜂巢流有限公司 | Aggressive prefetching |
| CN107277125A (en) * | 2017-06-13 | 2017-10-20 | 网宿科技股份有限公司 | File prefetched instruction method for pushing, device and file pre-fetching system |
| CN108574685A (en) * | 2017-03-14 | 2018-09-25 | 华为技术有限公司 | A kind of Streaming Media method for pushing, apparatus and system |
| CN110012102A (en) * | 2019-04-11 | 2019-07-12 | 湖南快乐阳光互动娱乐传媒有限公司 | P2P active seeding method and system based on hot video pre-push |
| GB201912014D0 (en) * | 2015-05-27 | 2019-10-02 | Canon Kk | Adaptive client-driven push of resourses by a server device |
| CN110620828A (en) * | 2019-10-31 | 2019-12-27 | 北京奇艺世纪科技有限公司 | File pushing method, system, device, electronic equipment and medium |
| CN112311684A (en) * | 2019-07-31 | 2021-02-02 | 上海幻电信息科技有限公司 | Burst traffic processing method, computer device and readable storage medium |
| CN114124939A (en) * | 2021-11-25 | 2022-03-01 | 北京奇艺世纪科技有限公司 | Pre-cache file processing method and device and file pre-cache system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10812580B2 (en) * | 2015-01-30 | 2020-10-20 | Akamai Technologies, Inc. | Using resource timing data for server push |
| US20170180470A1 (en) * | 2015-12-21 | 2017-06-22 | Le Holdings (Beijing) Co., Ltd. | Method and electronic device for sending CDN address |
| CN107483614B (en) * | 2017-08-31 | 2021-01-22 | 京东方科技集团股份有限公司 | Content scheduling method and communication network based on CDN (content delivery network) and P2P network |
-
2022
- 2022-05-09 CN CN202210501033.9A patent/CN114827256B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2237518A1 (en) * | 2009-03-30 | 2010-10-06 | Mitsubishi Electric Corporation | Pre-pushing of popular content in a network of end-user equipments |
| CN103023971A (en) * | 2012-11-15 | 2013-04-03 | 广州酷狗计算机科技有限公司 | Information pushing method and system of music sharing radio stations |
| CN103475719A (en) * | 2013-09-12 | 2013-12-25 | 北京科技大学 | Content distribution method for minimizing cross-domain flows in CDN-P2P fusion network |
| CN105830413A (en) * | 2013-10-25 | 2016-08-03 | 蜂巢流有限公司 | Aggressive prefetching |
| GB201912014D0 (en) * | 2015-05-27 | 2019-10-02 | Canon Kk | Adaptive client-driven push of resourses by a server device |
| CN108574685A (en) * | 2017-03-14 | 2018-09-25 | 华为技术有限公司 | A kind of Streaming Media method for pushing, apparatus and system |
| CN107277125A (en) * | 2017-06-13 | 2017-10-20 | 网宿科技股份有限公司 | File prefetched instruction method for pushing, device and file pre-fetching system |
| CN110012102A (en) * | 2019-04-11 | 2019-07-12 | 湖南快乐阳光互动娱乐传媒有限公司 | P2P active seeding method and system based on hot video pre-push |
| CN112311684A (en) * | 2019-07-31 | 2021-02-02 | 上海幻电信息科技有限公司 | Burst traffic processing method, computer device and readable storage medium |
| CN110620828A (en) * | 2019-10-31 | 2019-12-27 | 北京奇艺世纪科技有限公司 | File pushing method, system, device, electronic equipment and medium |
| CN114124939A (en) * | 2021-11-25 | 2022-03-01 | 北京奇艺世纪科技有限公司 | Pre-cache file processing method and device and file pre-cache system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114827256A (en) | 2022-07-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111200657B (en) | Method for managing resource state information and resource downloading system | |
| TWI431978B (en) | Methods, devices and systems for obtaining resources | |
| US20140165119A1 (en) | Offline download method, multimedia file download method and system thereof | |
| US8271625B2 (en) | Method and apparatus for synchronizing contents of home network devices | |
| CN107872489A (en) | A kind of file section method for uploading, device and cloud storage system | |
| CN105827694B (en) | Method and device for acquiring network resources | |
| CN110620828A (en) | File pushing method, system, device, electronic equipment and medium | |
| CN101156407A (en) | System structure and method for scheduled download service | |
| CN110049503B (en) | Method and equipment for acquiring data | |
| CN109873855A (en) | A kind of resource acquiring method and system based on block chain network | |
| CN101854343A (en) | Method for providing node information, and method and device for acquiring node information | |
| CN111597259B (en) | Data storage system, method, device, electronic equipment and storage medium | |
| CN112350873A (en) | Application service information processing method, application service calling method, device and system | |
| CA2793711C (en) | Method for communicating device management data changes | |
| CN114827256B (en) | Data pre-pushing method, data downloading method and system | |
| US12026390B2 (en) | Record information management based on self-describing attributes | |
| CN110347656B (en) | Method and device for managing requests in file storage system | |
| JP5180196B2 (en) | Method, system and device for reporting user agent profile information | |
| CN103428231B (en) | Offline download method and system | |
| CN110196842A (en) | File memory method, management method, device, server and storage medium | |
| CN103914477B (en) | A kind of data processing method and device | |
| CN113516503B (en) | Advertisement delivery region calibration method and related equipment | |
| CN116800700A (en) | Mirror image management method, system, equipment and storage medium | |
| CN109960695B (en) | Management method and device for database in cloud computing system | |
| CN111639944B (en) | Transaction broadcasting method, apparatus and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |