CN114827256A - Data pre-pushing method, data downloading method and system - Google Patents

Data pre-pushing method, data downloading method and system Download PDF

Info

Publication number
CN114827256A
CN114827256A CN202210501033.9A CN202210501033A CN114827256A CN 114827256 A CN114827256 A CN 114827256A CN 202210501033 A CN202210501033 A CN 202210501033A CN 114827256 A CN114827256 A CN 114827256A
Authority
CN
China
Prior art keywords
data
node
pushing
target
service type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210501033.9A
Other languages
Chinese (zh)
Other versions
CN114827256B (en
Inventor
年雪洁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN202210501033.9A priority Critical patent/CN114827256B/en
Publication of CN114827256A publication Critical patent/CN114827256A/en
Application granted granted Critical
Publication of CN114827256B publication Critical patent/CN114827256B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The application relates to a data pre-pushing method, a data downloading method and a data pre-pushing system. The method comprises the steps that a management terminal obtains service type identification and access frequency corresponding to each data downloading request in a preset time period; the management terminal responds to a pre-pushing request sent by the pushing terminal, and sends a pre-pushing list to the pushing terminal based on the service type identification and the access frequency; the pushing end inquires and obtains third-party data in a pre-pushing list from the CDN; the pushing end sends the third-party data to the P2P node; the P2P node sends the third party data to the management side on the storage path of the P2P node. By setting the management terminal to count the access frequency of the data downloading request in the preset time period, the method can be used for sending the pre-pushing list comprising the third-party data to the pushing terminal when the access frequency of the data downloading request meets the set requirement, so that the pushing terminal can obtain the third-party data, and the third-party data is stored in the P2P node, thereby completing the pre-pushing of the third-party data to the P2P node.

Description

Data pre-pushing method, data downloading method and system
Technical Field
The present application relates to the field of computers, and in particular, to a data pre-pushing method, a data downloading method, and a data downloading system.
Background
With the diversification of video coding formats, production forms and product forms, the role of the HCDN (large scale hybrid architecture) in external data distribution is increased, and more files of the third-party service in a very standard form are accessed, such as some installation packages, plug-ins, some huge advertisements and the like. The number of the files is large, the files are short, and the file production service side can only provide information of one fid, which causes pressure on the server side to push the files to the P2P node. Such files lack information such as tvid/vid, and a pushing end cannot acquire video information by inquiring according to tvid to qiipu originally, and pushes the video information to a P2P node in advance, so that great resistance is formed by downloading data in a P2P mode for a client.
Since the push end directly filters such files and does not push any more, which undoubtedly puts pressure on CDN bandwidth for data distribution, we want to download such files using P2P bandwidth as much as possible, thereby reducing CDN bandwidth pressure and bandwidth cost.
Disclosure of Invention
The application provides a data pre-pushing method, a data downloading method and a data pre-pushing system, which are used for pre-pushing third-party data.
In a first aspect, a data pre-push method is provided, including:
the management terminal acquires a service type identifier and an access frequency corresponding to each data downloading request in a preset time period;
the management terminal responds to a pre-pushing request sent by a pushing terminal, and sends a pre-pushing list to the pushing terminal based on the service type identification and the access frequency, wherein the pre-pushing list comprises third-party data;
the pushing end inquires and obtains third-party data in the pre-pushing list from a CDN network;
the pushing end sends the third-party data to a P2P node;
and the P2P node sends the third-party data to the management terminal on the storage path of the P2P node.
Optionally, sending a pre-push list to the push end based on the service type identifier and the access frequency, where the sending includes:
searching a target service type identifier from the service type identifiers, wherein the target service type identifier is a service type identifier of the third-party data;
acquiring a target access frequency corresponding to the target service type identifier from the access frequency;
and when the target access frequency is determined to be greater than a preset frequency threshold value, generating the pre-push list based on the target service type identifier, and sending the pre-push list to the push end.
Optionally, the service type identifier corresponding to each data downloading request within a preset time period acquired by the management terminal is the target service type identifier;
the method for acquiring the access frequency corresponding to each data downloading request in the preset time period by the management terminal comprises the following steps:
acquiring the marking times of the data downloading request corresponding to the target service type identifier marked by the management terminal by using a preset identifier in the preset time period, wherein the preset identifier indicates that the target data corresponding to the target service type identifier can be downloaded through a P2P node;
and calculating the access frequency of the data downloading request corresponding to the target service type identification based on the preset time period and the marking times.
Optionally, the querying and obtaining, by the push end, third-party data in the pre-push list from the CDN network includes:
and the pushing end queries CDN global cache services deployed in the CDN by adopting the target service type identification to acquire the third-party data.
In a second aspect, a data downloading method is provided, including:
the management terminal responds to a storage path query request of target data sent by a client terminal, and provides the storage path of a P2P node corresponding to the target data to the client terminal; the storage path of the P2P node is obtained based on the method of the first aspect; the target data is third-party data;
and the P2P node responds to the data downloading request sent by the client and provides the target data to the client.
Optionally, the method for providing, by the management side, a storage path of a P2P node corresponding to target data to a client in response to a storage path query request of the target data sent by the client includes:
acquiring a target service type identifier of the target data from the storage path query request;
acquiring a storage path matched with the target service type identifier;
and taking the storage path matched with the target type identifier as the storage path of the P2P node corresponding to the target data, and providing the storage path matched with the target type identifier for the client.
Optionally, before providing the storage path of the P2P node corresponding to the target data to the client, the method further includes:
acquiring the priority of the target data from the storage path query request, wherein the priority indicates the emergency degree of acquiring the target data;
determining that the priority is not greater than a priority threshold.
Optionally, after determining that the priority is not greater than the priority threshold before the management terminal provides the storage path of the P2P node corresponding to the target data to the client in response to the storage path query request of the target data sent by the client, the method further includes:
determining that the wait timeout time corresponding to the priority has not ended.
In a third aspect, a data pre-push system is provided, including:
a management side, a push side and a P2P node;
the management terminal is used for acquiring service type identifiers and access frequencies corresponding to the data downloading requests in a preset time period; responding to a pre-pushing request sent by the pushing end, and sending a pre-pushing list to the pushing end based on the service type identifier and the access frequency, wherein the pre-pushing list comprises third-party data;
the pushing end is used for inquiring and acquiring third-party data in the pre-pushing list from the CDN; sending the third party data to the P2P node;
the P2P node is used for sending the third party data to the management terminal on the storage path of the P2P node.
In a fourth aspect, a data download system is provided, comprising:
management side, client side and P2P node;
the management terminal is used for responding to a storage path query request of target data sent by the client terminal and providing the storage path of the P2P node corresponding to the target data to the client terminal; the storage path of the P2P node is obtained based on the method of any one of claims 1-3; the target data is third-party data;
the P2P node, configured to provide the target data to the client in response to a data download request sent by the client.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages: in the scheme provided by the embodiment of the application, the management terminal is set to count the access frequency of the data downloading request within the preset time period, so that when the access frequency of the data downloading request meets the set requirement, the pre-pushing list comprising the third-party data is sent to the pushing terminal, the third-party data can be obtained by the pushing terminal, and the third-party data is stored in the P2P node, so that the third-party data is pre-pushed to the P2P node.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a schematic flow chart of a data pre-push method in an embodiment of the present application;
FIG. 2 is a flowchart illustrating a data downloading method according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a data pre-push system in an embodiment of the present application;
FIG. 4 is a schematic structural diagram of a data downloading system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a data processing system in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
An embodiment of the present application provides a data pre-push method, as shown in fig. 1, the method may include the following steps:
step 101, a management terminal obtains a service type identifier and an access frequency corresponding to each data downloading request within a preset time period.
In application, the preset time period may be manually preset based on experience or according to actual needs, and this embodiment is not particularly limited.
In the application, the data downloading request carries a service type identifier (business _ type), and the service type identifier indicates the service type of the data required by the data downloading request. After the management terminal obtains the data downloading request, the management terminal counts the access times of the data downloading request based on the service type identifier in the data downloading request, and further calculates the access frequency based on the access times and the preset time period after the preset time period is finished.
In one example, the service type identifier carried by the service type identifier acquired by the management terminal indicates that the data to be requested by the data download request is third-party data, if the management terminal acquires the data download request for the first time, the access frequency corresponding to the service type identifier is set to 1, and if the management terminal does not acquire the data download request for the first time, the access frequency corresponding to the service type identifier is added with 1.
In this embodiment, in order to avoid that the management terminal directly filters the data downloading request after acquiring the data downloading request indicating that the requested data is the service type identifier of the third-party data, the management terminal marks the data downloading request and does not filter the data downloading request after receiving the data downloading request, so as to count the access frequency of the data downloading request. Therefore, in this embodiment, the number of times of accessing such data downloading requests may be indicated by the number of times of marking, thereby achieving calculation of the access frequency of such data downloading requests based on the number of times of marking.
In a specific implementation, in an optional embodiment, the marking times of the data downloading request corresponding to the target service type identifier marked by the management end by using the preset identifier in the preset time period are obtained, and the preset identifier indicates that the target data corresponding to the target service type identifier can be downloaded through the P2P node; and calculating the access frequency of the data downloading request corresponding to the target service type identifier based on the preset time period and the marking times.
It should be understood that the embodiment does not limit the marking manner of such data download requests.
It should be understood that, in this step, after obtaining the data download request, the management side may query whether the storage path of the data P2P node corresponding to the data download request is stored based on the data download request, when determining that the storage path has the P2P node, the management side may return the storage path of the P2P node to the client, and when determining that the storage path does not have the P2P node, if the data download request requests to download third-party data, the data download request is marked.
Step 102, the management terminal responds to a pre-push request sent by the push terminal, and sends a pre-push list to the push terminal based on the service type identifier and the access frequency, wherein the pre-push list comprises third-party data.
In this embodiment, in order to reduce the processing amount of pre-pushing as much as possible on the basis of pushing third-party data, the management side is configured to pre-push the third-party data frequently requested by the client to the pushing side, and the management side is not configured to pre-push the third-party data not frequently requested by the client to the pushing side.
In a specific implementation, in an optional embodiment, the target service type identifier is searched from the service type identifiers, and the target service type identifier is a service type identifier of the third-party data; acquiring a target access frequency corresponding to the target service type identifier from the access frequency; and when the target access frequency is determined to be greater than the preset frequency threshold, generating a pre-push list based on the target service type identifier, and sending the pre-push list to a push end.
In application, the preset frequency threshold may be set manually based on experience or according to actual needs, which is not specifically limited in this embodiment.
And 103, the pushing end inquires and obtains third-party data in the pre-pushing list from the CDN.
In the application, a CDN global cache service is deployed in a CDN network. The pushing end can query the CDN global cache service deployed in the CDN to acquire the third-party data by adopting the service type identification of the third-party data.
And step 104, the pushing end sends the pre-pushed data to the P2P node.
And step 105, the node P2P sends the pre-pushed data to the management end on the storage path of the node P2P.
In the scheme provided by the embodiment of the application, the management terminal is set to count the access frequency of the data downloading request within the preset time period, so that when the access frequency of the data downloading request meets the set requirement, the pre-pushing list comprising the third-party data is sent to the pushing terminal, the third-party data can be obtained by the pushing terminal, and the third-party data is stored in the P2P node, so that the third-party data is pre-pushed to the P2P node.
Based on the same inventive concept, the present embodiment provides a data downloading method, as shown in fig. 2, which may include the following steps:
step 201, the management terminal responds to a storage path query request of target data sent by the client terminal, and provides a storage path of a P2P node corresponding to the target data to the client terminal; the storage path of the P2P node is obtained based on the data pre-pushing method; the target data is third party data.
In this embodiment, the management end may search the storage path of the P2P node based on the service type of the target data.
In a specific implementation, in an optional embodiment, the target service type identifier of the target data is obtained from the storage path query request; acquiring a storage path matched with the target service type identifier; and taking the storage path matched with the target type identifier as the storage path of the P2P node corresponding to the target data, and providing the storage path matched with the target type identifier for the client.
In application, because the downloading rate of the P2P is lower than that of the CDN, for some data which is not urgent, in order to relieve the pressure of the CDN, the P2P is adopted for downloading. Therefore, in this embodiment, when the target data is data that is not urgent, the storage path of the P2P node corresponding to the target data may be provided to the client.
In a specific implementation, in an optional embodiment, before providing a storage path of a P2P node corresponding to target data to a client, a priority of the target data is obtained from a storage path query request, where the priority indicates an urgency of obtaining the target data; determining that the priority is not greater than a priority threshold.
In an application, the priority of the target data may be indicated by the downloading time of the target data. For example, when the downloading time of the target data carried in the storage path query request is far from the time when the management terminal acquires the path query request, it is determined that the priority of the target data is high, and at this time, the CDN should be preferentially adopted for downloading; and when the downloading time is closer to the time when the management end acquires the path query request, determining that the priority of the target data is lower, and at this time, the management end can return the storage path of the P2P node to the client.
In this embodiment, in order to avoid low user experience due to long-time waiting of the client, a waiting timeout period is set, and if the client still does not receive the storage path of the P2P node returned by the push terminal after the waiting timeout period is ended, the client may request data from the CDN network. In this case, in order to reduce the pressure of the CDN network, when the client requests data from the CDN network, the client may first request part of the data from the CDN network, and set that data other than part of the data in the data is no longer requested from the CDN network within a preset time period. After the preset duration is over, if a storage path of the P2P node returned by the push end is received, requesting other data to the P2P node through the storage path, and if the P2P node returned by the push end is still not received after the preset duration is over, continuing to download other data through the CDN network.
Step 202, the P2P node provides the target data to the client in response to the data download request sent by the client.
Based on the same inventive concept, the present embodiment provides a data pushing system, as shown in fig. 3, the system may include the following steps:
a management end 301, a push end 302 and a P2P node 303;
the management terminal 301 is configured to obtain a service type identifier and an access frequency corresponding to each data download request within a preset time period; responding to a pre-pushing request sent by the pushing end 302, and sending a pre-pushing list to the pushing end 302 based on the service type identifier and the access frequency, wherein the pre-pushing list comprises third-party data;
the pushing end 302 is configured to query and obtain third-party data in the pre-pushing list from the CDN network; sending the third party data to the P2P node 303;
the P2P node 303 is configured to send the third party data to the management node 301 through the storage path of the P2P node 303.
The management end 301 is configured to:
searching a target service type identifier from the service type identifiers, wherein the target service type identifier is a service type identifier of third-party data;
acquiring a target access frequency corresponding to the target service type identifier from the access frequency;
and when the target access frequency is determined to be greater than the preset frequency threshold, generating a pre-push list based on the target service type identifier, and sending the pre-push list to a push end.
The management terminal acquires a service type identifier corresponding to each data downloading request in a preset time period as a target service type identifier;
the management end 301 is configured to:
acquiring the marking times of a data downloading request corresponding to a target service type identifier marked by a preset identifier at a management end in a preset time period, wherein the preset identifier indicates that target data corresponding to the target service type identifier can be downloaded through a P2P node;
and calculating the access frequency of the data downloading request corresponding to the target service type identifier based on the preset time period and the marking times.
The push end 302 is configured to:
and the pushing end queries CDN global cache service deployed in the CDN by adopting the target service type identification to obtain third-party data.
Based on the same inventive concept, the present embodiment provides a data downloading system, as shown in fig. 4, which may include the following steps:
a management side 401, a client side 402 and a P2P node 403;
the management side 401 is configured to, in response to a storage path query request for target data sent by the client side 402, provide a storage path of a P2P node 403 corresponding to the target data to the client side 402; the storage path of the P2P node 403 is obtained based on the data pre-pushing method; the target data is third-party data;
P2P node 403, for providing the target data to client 402 in response to a data download request sent by client 402.
The management side 401 is configured to:
acquiring a target service type identifier of target data from the storage path query request;
acquiring a storage path matched with the target service type identifier;
and taking the storage path matched with the target type identifier as the storage path of the P2P node corresponding to the target data, and providing the storage path matched with the target type identifier for the client.
The management side 401 is further configured to:
before providing a storage path of a P2P node corresponding to target data to a client, acquiring the priority of the target data from a storage path query request, wherein the priority indicates the urgency of acquiring the target data;
determining that the priority is not greater than a priority threshold.
The management side 401 is further configured to:
and the management terminal responds to a storage path query request of target data sent by the client terminal, determines that the waiting timeout time corresponding to the priority is not over after determining that the priority is not greater than the priority threshold before providing the storage path of the P2P node corresponding to the target data to the client terminal.
For convenience of understanding, the present application is described below in connection with a data processing system composed of a client, a management side, a push side and a P2P node from the perspective of data pre-push and data download. As shown in fig. 5, the data processing system includes:
a client 501, a management end 502, a push end 503 and a P2P node 504;
when the client 501 calls hcdn to create a download task, the type of the business party identifier businetype is carried, and when the management terminal 502 requests node query, the value corresponding to the businetype configured by the cloud is taken. Different business parties correspond to different values;
the management end 502 receives the identifier for marking and does not filter any more, when the fid access frequency of the file is reached, and when the pushing end acquires a pre-pushing list from the tracker, the pushing end is informed of the fid and the service type is informed;
the pushing end 503 tries to query the CDN global cache service for the file information according to different service types, and if the file information is found, pre-pushes the file information to the P2P node 504, and the P2P node 504 reports the file information to the management end 502;
when the client 501 requests the file node query again, the administrator 502 returns to the P2P node 504, and the client 501 downloads.
In the embodiment, considering the diversity of the third-party services, some of the third-party services are pre-downloaded, and the timeliness of data needs is not strong, so that the priority can be configured according to the services, and the downloading mode of the data can be set according to the priority. For example, like currently accessed movie advertisements, we default to low priority, and preferentially use the P2P node for downloading; some real-time requirements are higher, such as the playernel download, the priority may be set to be medium or above, the CDN network download may be preferentially used, and the CDN download may be used by dynamically configuring to wait for the P2P to time out.
In this embodiment, priority switching is also supported. For example, a low priority is externally set at the initial stage of task creation, when the time for needing data is close, the task priority can be switched to a higher priority in real time, at the moment, the task priority is correspondingly switched to a corresponding distribution strategy, CDN downloading is favored, and the data downloading speed is ensured.
In this embodiment, a wait timeout is also supported.
Because the client requests the node query result to return the required time to the management end, the CDN is in a downloadable state earlier than P2P, for a task with low priority, we can set a wait timeout time1 by cloud control, and the wait timeout time1 is not allocated to the CDN until it arrives, unless the management end returns no P2P node;
for the tasks with medium or higher priority, when P2P is not ready, part of block data can be preferentially allocated to CDN download, a timeout time2 can be set, when time2 arrives, CDN allocation is not performed any more, unless a plurality of blocks allocated by the CDN are completely downloaded, and the P2P is still in an unallocated state, CDN allocation is performed again.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wirelessly (e.g., infrared, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more of the available media. The available media may be magnetic media (e.g., floppy disks, hard disks, tapes, etc.), optical media (e.g., DVDs), or semiconductor media (e.g., solid state drives), among others.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A data pre-push method, comprising:
the management terminal acquires a service type identifier and an access frequency corresponding to each data downloading request in a preset time period;
the management terminal responds to a pre-pushing request sent by a pushing terminal, and sends a pre-pushing list to the pushing terminal based on the service type identification and the access frequency, wherein the pre-pushing list comprises third-party data;
the pushing end inquires and obtains third-party data in the pre-pushing list from a CDN network;
the pushing end sends the third-party data to a P2P node;
and the P2P node sends the third-party data to the management terminal on the storage path of the P2P node.
2. The method of claim 1, wherein sending a pre-push list to the push terminal based on the service type identifier and the access frequency comprises:
searching a target service type identifier from the service type identifiers, wherein the target service type identifier is a service type identifier of the third-party data;
acquiring a target access frequency corresponding to the target service type identifier from the access frequency;
and when the target access frequency is determined to be greater than a preset frequency threshold value, generating the pre-push list based on the target service type identifier, and sending the pre-push list to the push end.
3. The method according to claim 2, wherein the service type identifier corresponding to each data download request within a preset time period acquired by the management terminal is the target service type identifier;
the method for acquiring the access frequency corresponding to each data downloading request in the preset time period by the management terminal comprises the following steps:
acquiring the marking times of the data downloading request corresponding to the target service type identifier marked by the management terminal by using a preset identifier in the preset time period, wherein the preset identifier indicates that the target data corresponding to the target service type identifier can be downloaded through a P2P node;
and calculating the access frequency of the data downloading request corresponding to the target service type identification based on the preset time period and the marking times.
4. The method of claim 2, wherein the querying and obtaining the third party data in the pre-push list by the push terminal from the CDN network comprises:
and the pushing end queries CDN global cache services deployed in the CDN by adopting the target service type identification to acquire the third-party data.
5. A method for downloading data, comprising:
the management terminal responds to a storage path query request of target data sent by a client terminal, and provides the storage path of a P2P node corresponding to the target data to the client terminal; the storage path of the P2P node is obtained based on the method of any one of claims 1-4; the target data is third-party data;
and the P2P node responds to the data downloading request sent by the client and provides the target data to the client.
6. The method as claimed in claim 5, wherein the providing, by the management side, the storage path of the P2P node corresponding to the target data to the client in response to the storage path query request of the target data sent by the client comprises:
acquiring a target service type identifier of the target data from the storage path query request;
acquiring a storage path matched with the target service type identifier;
and taking the storage path matched with the target type identifier as the storage path of the P2P node corresponding to the target data, and providing the storage path matched with the target type identifier for the client.
7. The method of claim 5, wherein before providing the storage path of the P2P node corresponding to the target data to the client, the method further comprises:
acquiring the priority of the target data from the storage path query request, wherein the priority indicates the emergency degree of acquiring the target data;
determining that the priority is not greater than a priority threshold.
8. The method as claimed in claim 7, wherein, after determining that the priority is not greater than the priority threshold before the management side provides the storage path of the P2P node corresponding to the target data to the client in response to the storage path query request of the target data sent by the client, the method further comprises:
determining that the wait timeout time corresponding to the priority has not ended.
9. A data pre-push system, comprising:
a management side, a push side and a P2P node;
the management terminal is used for acquiring service type identifiers and access frequencies corresponding to the data downloading requests in a preset time period; responding to a pre-pushing request sent by the pushing end, and sending a pre-pushing list to the pushing end based on the service type identifier and the access frequency, wherein the pre-pushing list comprises third-party data;
the pushing end is used for inquiring and acquiring third-party data in the pre-pushing list from the CDN; sending the third party data to the P2P node;
the P2P node is used for sending the third party data to the management terminal on the storage path of the P2P node.
10. A data download system, comprising:
management side, client side and P2P node;
the management terminal is used for responding to a storage path query request of target data sent by the client terminal and providing the storage path of the P2P node corresponding to the target data to the client terminal; the storage path of the P2P node is obtained based on the method of any one of claims 1-3; the target data is third-party data;
the P2P node, configured to provide the target data to the client in response to a data download request sent by the client.
CN202210501033.9A 2022-05-09 2022-05-09 Data pre-pushing method, data downloading method and system Active CN114827256B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210501033.9A CN114827256B (en) 2022-05-09 2022-05-09 Data pre-pushing method, data downloading method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210501033.9A CN114827256B (en) 2022-05-09 2022-05-09 Data pre-pushing method, data downloading method and system

Publications (2)

Publication Number Publication Date
CN114827256A true CN114827256A (en) 2022-07-29
CN114827256B CN114827256B (en) 2023-12-15

Family

ID=82512893

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210501033.9A Active CN114827256B (en) 2022-05-09 2022-05-09 Data pre-pushing method, data downloading method and system

Country Status (1)

Country Link
CN (1) CN114827256B (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2237518A1 (en) * 2009-03-30 2010-10-06 Mitsubishi Electric Corporation Pre-pushing of popular content in a network of end-user equipments
CN103023971A (en) * 2012-11-15 2013-04-03 广州酷狗计算机科技有限公司 Information pushing method and system of music sharing radio stations
CN103475719A (en) * 2013-09-12 2013-12-25 北京科技大学 Content distribution method for minimizing cross-domain flows in CDN-P2P fusion network
CN105830413A (en) * 2013-10-25 2016-08-03 蜂巢流有限公司 Aggressive prefetching
US20160226969A1 (en) * 2015-01-30 2016-08-04 Akamai Technologies, Inc. Using resource timing data for server push in multiple web page transactions
US20170180470A1 (en) * 2015-12-21 2017-06-22 Le Holdings (Beijing) Co., Ltd. Method and electronic device for sending CDN address
CN107277125A (en) * 2017-06-13 2017-10-20 网宿科技股份有限公司 File prefetched instruction method for pushing, device and file pre-fetching system
CN108574685A (en) * 2017-03-14 2018-09-25 华为技术有限公司 A kind of Streaming Media method for pushing, apparatus and system
US20190068701A1 (en) * 2017-08-31 2019-02-28 Boe Technology Group Co., Ltd. Content Scheduling Method Based on CDN and P2P Network, and Communication Network
CN110012102A (en) * 2019-04-11 2019-07-12 湖南快乐阳光互动娱乐传媒有限公司 P2P based on the push of popular video preprocessor actively does kind of a method and system
GB201912014D0 (en) * 2015-05-27 2019-10-02 Canon Kk Adaptive client-driven push of resourses by a server device
CN110620828A (en) * 2019-10-31 2019-12-27 北京奇艺世纪科技有限公司 File pushing method, system, device, electronic equipment and medium
CN112311684A (en) * 2019-07-31 2021-02-02 上海幻电信息科技有限公司 Burst traffic processing method, computer device and readable storage medium
CN114124939A (en) * 2021-11-25 2022-03-01 北京奇艺世纪科技有限公司 Pre-cache file processing method and device and file pre-cache system

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2237518A1 (en) * 2009-03-30 2010-10-06 Mitsubishi Electric Corporation Pre-pushing of popular content in a network of end-user equipments
CN103023971A (en) * 2012-11-15 2013-04-03 广州酷狗计算机科技有限公司 Information pushing method and system of music sharing radio stations
CN103475719A (en) * 2013-09-12 2013-12-25 北京科技大学 Content distribution method for minimizing cross-domain flows in CDN-P2P fusion network
CN105830413A (en) * 2013-10-25 2016-08-03 蜂巢流有限公司 Aggressive prefetching
US20160226969A1 (en) * 2015-01-30 2016-08-04 Akamai Technologies, Inc. Using resource timing data for server push in multiple web page transactions
GB201912014D0 (en) * 2015-05-27 2019-10-02 Canon Kk Adaptive client-driven push of resourses by a server device
US20170180470A1 (en) * 2015-12-21 2017-06-22 Le Holdings (Beijing) Co., Ltd. Method and electronic device for sending CDN address
CN108574685A (en) * 2017-03-14 2018-09-25 华为技术有限公司 A kind of Streaming Media method for pushing, apparatus and system
CN107277125A (en) * 2017-06-13 2017-10-20 网宿科技股份有限公司 File prefetched instruction method for pushing, device and file pre-fetching system
US20190068701A1 (en) * 2017-08-31 2019-02-28 Boe Technology Group Co., Ltd. Content Scheduling Method Based on CDN and P2P Network, and Communication Network
CN110012102A (en) * 2019-04-11 2019-07-12 湖南快乐阳光互动娱乐传媒有限公司 P2P based on the push of popular video preprocessor actively does kind of a method and system
CN112311684A (en) * 2019-07-31 2021-02-02 上海幻电信息科技有限公司 Burst traffic processing method, computer device and readable storage medium
CN110620828A (en) * 2019-10-31 2019-12-27 北京奇艺世纪科技有限公司 File pushing method, system, device, electronic equipment and medium
CN114124939A (en) * 2021-11-25 2022-03-01 北京奇艺世纪科技有限公司 Pre-cache file processing method and device and file pre-cache system

Also Published As

Publication number Publication date
CN114827256B (en) 2023-12-15

Similar Documents

Publication Publication Date Title
CN107872489B (en) File slice uploading method and device and cloud storage system
CN111200657B (en) Method for managing resource state information and resource downloading system
US7444386B2 (en) Application programming interface for provisioning services
US11463753B2 (en) Method and apparatus for downloading resources
CN101156407A (en) System structure and method for scheduled download service
CN112600693B (en) Service request processing method, system, electronic equipment and computer storage medium
CN110620828A (en) File pushing method, system, device, electronic equipment and medium
CN110719187B (en) Configuration management method, system and computer readable storage medium
EP2671165A1 (en) Asset management architecture for content delivery networks
CN111045833A (en) Interface calling method and device
EP3937523A1 (en) Retrieving a core network or access network assigned user equipment identifier
CN111597259B (en) Data storage system, method, device, electronic equipment and storage medium
CN110392119B (en) Data transmission method and base station
CN109873855A (en) A kind of resource acquiring method and system based on block chain network
US20190334968A1 (en) Bit rate reduction processing method for data file, and server
CN109446445B (en) Resource acquisition method and device
CN110049503B (en) Method and equipment for acquiring data
CN109471713B (en) Method and device for inquiring information
US20230251789A1 (en) Record information management based on self-describing attributes
CN110347656B (en) Method and device for managing requests in file storage system
CN114827256A (en) Data pre-pushing method, data downloading method and system
JP5180196B2 (en) Method, system and device for reporting user agent profile information
CN108628864B (en) Data access method and data management device
CN109120692B (en) Method and apparatus for processing requests
CN111639944B (en) Transaction broadcasting method, apparatus and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant