CN111064780A - Multitask content updating method, device, equipment and medium - Google Patents
Multitask content updating method, device, equipment and medium Download PDFInfo
- Publication number
- CN111064780A CN111064780A CN201911260104.5A CN201911260104A CN111064780A CN 111064780 A CN111064780 A CN 111064780A CN 201911260104 A CN201911260104 A CN 201911260104A CN 111064780 A CN111064780 A CN 111064780A
- Authority
- CN
- China
- Prior art keywords
- updating
- nodes
- node
- tasks
- current node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000004891 communication Methods 0.000 claims abstract description 54
- 230000005540 biological transmission Effects 0.000 claims description 110
- 230000002596 correlated effect Effects 0.000 claims description 33
- 230000004044 response Effects 0.000 claims description 24
- 238000012545 processing Methods 0.000 claims description 16
- 238000012423 maintenance Methods 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims 2
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000012935 Averaging Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5682—Policies or rules for updating, deleting or replacing the stored data
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a method and a device for updating multitask content, wherein the method comprises the following steps: the method comprises the steps that a plurality of updating tasks are received by nodes in a network, a local updating task program is called to sequentially execute the updating tasks according to the sequence of priority indexes of the updating tasks from high to low, a lower node is selected according to the communication level of the current node receiving the updating tasks and other nodes which do not execute the updating tasks, the received updating tasks are sent to the lower node, and the steps are repeated step by step until all the nodes in the network receive the updating tasks and execute the updating. The invention also has the following advantages: the problem that the speed and the efficiency of file updating cannot be achieved in the traditional CDN technology is solved. Distributed cooperation ensures that all tasks can effectively and quickly reach all nodes, and ensures the integrity of contents. The distributed computation of content and scheduling is realized, the whole network and whole area access is realized, the concurrency bottleneck is solved, and the strong expansion of the whole system is realized.
Description
The application is a divisional application of a Chinese patent application with the name of 'a content updating method and device' filed by the patent office of the intellectual property office of China in 2017, 03 month and 01, and the application number is 201710117463. X.
Technical Field
The present invention relates to the field of network data transmission, and in particular, to a method, an apparatus, a device, and a medium for updating multitask content.
Background
In the current Network environment, Content such as pictures, web pages, music, videos, and the like generally uses a Content Delivery Network (CDN) with cache nodes distributed around the world to provide faster Content access services for end users. The user may obtain the particular cached content directly from the content node in the vicinity without requesting the content back to the origin server. However, after the resources of the web site are updated, all nodes caching the part of the content also need to be updated (including deleted) in time, otherwise, the user can continue to obtain the old content, for example, once the content published by a certain news web site is wrong or tampered by a hacker, in order to avoid a more serious situation, the content of the whole network needs to be updated in time, and since the CDN often has a large number of nodes distributed in different regions, it is a great challenge to update the cached content on all the nodes in time.
In a conventional CDN cache mechanism, updating of content of a whole network is implemented based on a message queue, when content is updated, thousands of devices are managed by one central server, a center needs to confirm states of all devices and track a push condition of the devices, and retry is needed when a device fails. Through the mode of equipment tracking and failure retransmission, the system can realize the completion of the updating of the content in the whole network at one time. This approach has the following drawbacks:
1. once the network is out of condition, the conventional content updating method may cause that the server cannot obtain the update within the effective time of the task, in view of the actual condition of the current network. At the moment, the center retransmits the information after receiving the tracking feedback, and finally the efficiency is greatly reduced;
2. content updating may involve a huge number of Uniform Resource Locators (URLs) at the same time, the time for a message queue to process one URL is generally in the order of ten thousand milliseconds, and a complete update of a whole network content requires several minutes or even tens of minutes, which obviously cannot meet enterprise requirements;
3. the message queue queues the tasks only by the time sequence of the start of the tasks, and the urgency of the update of the tasks is not consistent with the time sequence of the start of the tasks, which results in unfairness of the update of the tasks.
Disclosure of Invention
In order to solve the above problems, the present invention provides a content updating method and apparatus.
The invention provides a content updating method, which is applied to a content distribution network or a non-content distribution network and comprises the following steps: and the nodes in the network receive the updating tasks, execute updating according to the updating tasks, select the lower nodes from other nodes which do not execute the updating tasks, send the received updating tasks to the lower nodes, and analogize step by step in the sequential method until all the nodes in the network receive the updating tasks and execute the updating.
The content updating method also has the following characteristics:
the selecting a lower node from other nodes which have not performed the update task includes: selecting a plurality of target nodes from other nodes which do not execute the updating task, acquiring the communication level of the current node and the target nodes, and selecting M nodes with N names before the communication level as lower nodes of the current node; wherein M and N are integers greater than zero.
The content updating method also has the following characteristics:
the selecting a plurality of target nodes from other nodes which have never executed the update task comprises one of the following modes:
selecting a plurality of nodes which are in the same operator network with the current node from other nodes which do not execute the updating task;
selecting a plurality of nodes which are in the same operator network with the current node and are smaller than a preset distance in a region from other nodes which do not execute the updating task;
and thirdly, randomly selecting a plurality of nodes from other nodes which have not performed the updating task.
The content updating method also has the following characteristics:
the obtaining the connectivity level of the current node and the target node comprises one of the following modes:
the method comprises the steps that a first mode is that the communication level of a target node is extracted from a communication level list of a current node and other nodes which are maintained in real time, and the communication level of the current node and other nodes is recorded in the communication level list; when the current node maintains the connection level list in real time, the transmission index parameters of the current node and other nodes are calculated in real time, a new connection level is determined according to the calculated transmission index parameters, and the connection level list is updated, and at least one of the transmission index parameters is as follows: the communication level control method comprises the following steps of averaging data transmission speed, transmission bandwidth and request response delay, wherein the averaging data transmission speed is positively correlated with the communication level, the transmission bandwidth is positively correlated with the communication level, and the request response delay is negatively correlated with the communication level;
in a second mode, at least one of the following transmission index parameters between the current node and the target node is calculated: average data transmission speed, transmission bandwidth and request response delay; and determining a connectivity level according to the calculated transmission index parameters, wherein the average data transmission speed is positively correlated with the connectivity level, the transmission bandwidth is positively correlated with the connectivity level, and the request response delay is negatively correlated with the connectivity level.
The content updating method also has the following characteristics:
the method further comprises the following steps: the node receiving the updating task from the server in the network, namely the primary node, identifies different updating tasks and then sends the different updating tasks to the subordinate node; and all nodes in the network detect whether the repeated updating tasks are received or not in real time according to the identification of the updating tasks, and discard redundant updating tasks when the repeated updating tasks are received.
The content updating method also has the following characteristics:
the method further comprises the following steps: and when the node receives a plurality of updating tasks within a preset time, analyzing the priority indexes of the updating tasks, and sequentially processing the updating tasks according to the priority indexes of the updating tasks from high to low.
The content updating method also has the following characteristics:
and the node sends the received updating task to the subordinate node based on a User Datagram Protocol (UDP).
The content updating method also has the following characteristics:
the method also comprises the steps that the node maintains a transmission path table in each network updating process, after the next node is determined, the identifier of the next node is added into the transmission path table to mark the node which is updated, and the transmission path table is sent to the next node.
The content updating device provided by the invention is applied to a content distribution network node or a non-content distribution network node, and comprises the following components:
the receiving module is used for receiving the updating task;
the updating module is used for executing updating according to the updating task;
the selection module is used for selecting a lower node from other nodes which do not execute the updating task;
and the sending module is used for sending the received updating task to the lower node.
The content updating device also has the following characteristics:
the selection module further comprises a target node selection unit and a lower node selection unit;
the target node selection unit is used for selecting a plurality of target nodes from other nodes which have not executed the updating task;
the lower node selection unit is used for acquiring the communication level between the current node and the target node and selecting M nodes with N names before the communication level as the lower nodes of the current node; wherein M and N are integers greater than zero.
The content updating device also has the following characteristics:
the target node selection unit is further configured to select a plurality of target nodes from other nodes that have not performed the update task using one of the following:
selecting a plurality of nodes which are in the same operator network with the current node from other nodes which do not execute the updating task;
selecting a plurality of nodes which are in the same operator network with the current node and are smaller than a preset distance in a region from other nodes which do not execute the updating task;
and thirdly, randomly selecting a plurality of nodes from other nodes which have not performed the updating task.
The content updating device also has the following characteristics:
the lower node selection unit also comprises a communication level list maintenance subunit and a selection processing subunit;
the connected level list maintenance subunit is configured to calculate at least one of the following transmission index parameters between the current node and the target node: average data transmission speed, transmission bandwidth and request response delay; determining a new connection level according to the calculated transmission index parameters, and updating a connection level list, wherein the average data transmission speed is positively correlated with the connection level, the transmission bandwidth is positively correlated with the connection level, and the request response delay is negatively correlated with the connection level;
the selection processing subunit is used for extracting the communication level of the target node from a communication level list of the current node and other nodes maintained in real time, and the communication level list records the communication levels of the current node and other nodes;
or, the lower node selection unit comprises a transmission index parameter calculation subunit and a selection processing subunit;
the transmission index parameter calculation subunit is configured to calculate at least one of the following transmission index parameters between the current node and the target node: average data transmission speed, transmission bandwidth and request response delay;
the selection processing subunit is configured to determine a connectivity level according to the calculated transmission indicator parameter, where the average data transmission speed is positively correlated with the connectivity level, the transmission bandwidth is positively correlated with the connectivity level, and the request response delay is negatively correlated with the connectivity level.
The content updating device also has the following characteristics:
the device also comprises a marking module and a detection module;
the marking module is used for identifying different updating tasks when the receiving module receives the updating tasks from the server;
the detection module is used for detecting whether repeated updating tasks are received or not in real time according to the identification of the updating tasks, and discarding redundant updating tasks when the repeated updating tasks are received.
The content updating device also has the following characteristics:
the device also comprises a resolving module;
the analysis module is used for analyzing the priority index of each updating task when the receiving module receives a plurality of updating tasks within a preset time length;
the sending module is further used for sequentially processing the updating tasks according to the priority indexes of the updating tasks from high to low.
The content updating device also has the following characteristics:
the sending module is further configured to send the received update task to the subordinate node based on a user datagram protocol UDP.
The content updating device also has the following characteristics:
the apparatus also includes a transmission path table maintenance module;
the transmission path table maintenance module is used for maintaining a transmission path table, and after the selection module determines that the lower node is reached, the identification of the lower node is added into the transmission path table to mark the node which is updated;
the sending module is further configured to send the transmission path table to the subordinate node.
The invention utilizes the intelligent optimization algorithm and the loose coupling of each node, so that the files on all the storage servers can be updated in a very short time.
The invention also has the following advantages:
the problem that the speed and the efficiency of file updating cannot be achieved in the traditional CDN technology is solved.
Distributed cooperation ensures that all tasks can effectively and quickly reach all nodes, and ensures the integrity of contents.
The distributed computation of content and scheduling is realized, the whole network and whole area access is realized, the concurrency bottleneck is solved, and the strong expansion of the whole system is realized.
The tasks are prioritized, the execution sequence can be adjusted according to needs, and the timely response of the key services is ensured.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate an embodiment of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a flow chart of a content update method in an embodiment;
fig. 2 is a block diagram of a content update apparatus in the embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The method of the present invention may be applied to content distribution networks as well as to non-content distribution networks. The device of the invention is applied to a content distribution network node or a non-content distribution network node. The apparatus of the present invention may typically be applied to peer (peer) nodes.
FIG. 1 is a flow chart of a content update method in an embodiment; the method comprises the following steps:
102, updating according to the updating task;
103, selecting a lower node from other nodes which do not execute the updating task;
and successively repeating the steps of the method until all the nodes in the network receive the updating tasks and execute the updating.
The method is described in detail below.
In step 103, selecting a lower node from the other nodes that have not executed the update task includes: selecting a plurality of target nodes from other nodes which do not execute the updating task, acquiring the communication level of the current node and the target nodes, and selecting M nodes with N names before the communication level as lower nodes of the current node; wherein M and N are integers greater than zero;
selecting a plurality of target nodes from other nodes that have not performed the update task includes one of the following ways:
selecting a plurality of nodes which are in the same operator network with the current node from other nodes which do not execute the updating task;
selecting a plurality of nodes which are in the same operator network with the current node and are smaller than a preset distance in a region from other nodes which do not execute the updating task;
selecting a plurality of nodes randomly from other nodes which do not execute the updating task;
the obtaining of the connectivity level of the current node and the target node comprises one of the following modes:
the method comprises the steps of extracting the communication level of the target node from a communication level list of a current node and other nodes maintained in real time, wherein the communication level list records the communication levels of the current node and other nodes. When the current node maintains the connection level list in real time, the transmission index parameters of the current node and other nodes are calculated in real time, a new connection level is determined according to the calculated transmission index parameters, and the connection level list is updated, and at least one of the transmission index parameters is as follows: average data transmission speed, transmission bandwidth and request response delay, wherein the average data transmission speed is positively correlated with the communication grade, the transmission bandwidth is positively correlated with the communication grade, and the request response delay is negatively correlated with the communication grade. In the first mode, the current node also exchanges the connectivity level table with other nodes periodically, and updates the connectivity level table according to the exchanged connectivity level table.
In a second mode, at least one of the following transmission index parameters between the current node and the target node is calculated: average data transmission speed, transmission bandwidth and request response delay; and determining a connectivity level according to the calculated transmission index parameters, wherein the average data transmission speed is positively correlated with the connectivity level, the transmission bandwidth is positively correlated with the connectivity level, and the request response delay is negatively correlated with the connectivity level.
The node sends the received update task based on the user datagram protocol UDP when sending it to the subordinate node in step 104.
The method also comprises the following steps: the network receives the node of the update task from the server, namely the primary node identifies different update tasks and then sends the different update tasks to the subordinate node; and all nodes of the network detect whether the repeated updating tasks are received or not in real time according to the identification of the updating tasks, and discard the redundant updating tasks when the repeated updating tasks are received.
The method also comprises the following steps: when the node receives a plurality of updating tasks within a preset time, analyzing the priority indexes of the updating tasks, and sequentially processing the updating tasks according to the priority indexes of the updating tasks from high to low.
The method also comprises the steps that the node maintains a transmission path table in each network updating process, after the next node is determined, the identification of the next node is added into the transmission path table to mark the node which is updated, and the transmission path table is sent to the next node. The transmission path table can effectively record and mark the nodes which are updated, thereby avoiding the task message from being repeatedly sent and reducing the system redundancy.
The method also comprises the following steps: and after the node executes updating according to the updating task, uploading the information of the updating task, which is updated at the node, to a database.
After receiving the update task, the node calls a local update task program to execute the update task, wherein the calling of the update task program is realized in one of the following ways:
registering a script program for executing a specific task, executing the script when the specific task arrives,
and secondly, establishing a TCP connection, constructing a client program for monitoring a specific task, and executing an updating task when the specific task is monitored.
Fig. 2 is a block diagram of a content update apparatus in the embodiment. The device comprises a receiving module, an updating module, a selecting module and a sending module.
The receiving module is used for receiving the updating task;
the updating module is used for executing updating according to the updating task;
the selection module is used for selecting a lower node from other nodes which do not execute the updating task;
the sending module is used for sending the received update task to the lower node.
Wherein,
the selection module includes a target node selection unit and a lower node selection unit.
The target node selection unit is used for selecting a plurality of target nodes from other nodes which have not executed the updating task; in particular for selecting a plurality of target nodes from other nodes that have never performed an update task, using one of the following ways:
selecting a plurality of nodes which are in the same operator network with the current node from other nodes which do not execute the updating task;
selecting a plurality of nodes which are in the same operator network with the current node and are smaller than a preset distance in a region from other nodes which do not execute the updating task;
and thirdly, randomly selecting a plurality of nodes from other nodes which have not performed the updating task.
The lower node selection unit is used for acquiring the communication level between the current node and the target node and selecting M nodes with N names before the communication level as the lower nodes of the current node; wherein M and N are integers greater than zero.
The lower node selection unit includes a connection level list maintenance subunit and a selection processing subunit. The connected level list maintenance subunit is configured to calculate at least one of the following transmission index parameters between the current node and the target node: average data transmission speed, transmission bandwidth and request response delay; determining a new connection level according to the calculated transmission index parameters, updating a connection level list, wherein the average data transmission speed is positively correlated with the connection level, the transmission bandwidth is positively correlated with the connection level, and the request response delay is negatively correlated with the connection level. The selection processing subunit is used for extracting the communication level of the target node from a communication level list of the current node and other nodes maintained in real time, and the communication level list records the communication levels of the current node and other nodes;
alternatively, the lower node selection unit includes a transmission index parameter calculation subunit and a selection processing subunit. The transmission index parameter calculation subunit is used for calculating at least one of the following transmission index parameters between the current node and the target node: average data transmission speed, transmission bandwidth, request response delay. The selection processing subunit is used for determining a connectivity level according to the calculated transmission index parameters, the average data transmission speed is positively correlated with the connectivity level, the transmission bandwidth is positively correlated with the connectivity level, and the request response delay is negatively correlated with the connectivity level.
The device also comprises a communication grade maintenance module used for maintaining the communication grade list in the first mode. The communication grade maintenance module is used for maintaining the communication grade list in real time, calculating transmission index parameters of the current node and other nodes in real time, determining the communication grade according to the calculated transmission index parameters, and transmitting at least one of the index parameters: average data transmission speed, transmission bandwidth and request response delay, wherein the average data transmission speed is positively correlated with the communication grade, the transmission bandwidth is positively correlated with the communication grade, and the request response delay is negatively correlated with the communication grade. The sending module is further configured to periodically send the connectivity level table of the node to other nodes, and the receiving module is further configured to periodically receive the connectivity level table from other nodes. And the communication level maintenance module is also used for updating the connectivity level table of the node according to the received connectivity level table of other nodes.
The device also comprises a marking module and a detection module. The marking module is used for identifying different updating tasks when the receiving module receives the updating tasks from the server. The detection module is used for detecting whether repeated updating tasks are received or not in real time according to the identification of the updating tasks, and discarding redundant updating tasks when the repeated updating tasks are received.
The device also comprises an analysis module. The analysis module is used for analyzing the priority index of each updating task when the receiving module receives a plurality of updating tasks within the preset time length. The sending module is further used for sequentially processing the updating tasks according to the priority indexes of the updating tasks from high to low.
The sending module of the device is also used for sending the received update task to the subordinate node based on a User Datagram Protocol (UDP).
The device also comprises a transmission path table maintenance module. The transmission path table maintenance module is used for maintaining a transmission path table, and after the selection module determines that the lower node is reached, the identification of the lower node is added into the transmission path table to mark the node which is updated. The sending module is further configured to send the transmission path table to the subordinate node,
the device comprises an uploading module, and the uploading module is used for uploading updated information to a database after the updating module executes updating on the updating task.
The invention utilizes the intelligent optimization algorithm and the loose coupling of each node, so that the files on all the storage servers can finish content updating in a very short time.
The invention also has the following advantages:
the problem that the speed and the efficiency of file updating cannot be achieved in the traditional CDN technology is solved.
Distributed cooperation ensures that all tasks can effectively and quickly reach all nodes, and ensures the integrity of contents.
The distributed computation of content and scheduling is realized, the whole network and whole area access is realized, the concurrency bottleneck is solved, and the strong expansion of the whole system is realized.
The tasks are prioritized, the execution sequence can be adjusted according to needs, and the timely response of the key services is ensured.
It will be understood by those skilled in the art that all or part of the steps of the above methods may be implemented by instructing the relevant hardware through a program, and the program may be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the foregoing embodiments may also be implemented by using one or more integrated circuits, and accordingly, each module/unit in the foregoing embodiments may be implemented in the form of hardware, and may also be implemented in the form of a software functional module. The present invention is not limited to any specific form of combination of hardware and software.
It is to be noted that, in this document, the terms "comprises", "comprising" or any other variation thereof are intended to cover a non-exclusive inclusion, so that an article or apparatus including a series of elements includes not only those elements but also other elements not explicitly listed or inherent to such article or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of additional like elements in the article or device comprising the element.
The above embodiments are merely to illustrate the technical solutions of the present invention and not to limit the present invention, and the present invention has been described in detail with reference to the preferred embodiments. It will be understood by those skilled in the art that various modifications and equivalent arrangements may be made without departing from the spirit and scope of the present invention and it should be understood that the present invention is to be covered by the appended claims.
Claims (14)
1. A method for multitasking content update, which is applied to a content distribution network or a non-content distribution network, and is characterized by comprising the following steps:
a node in the network receives a plurality of updating tasks, analyzes the priority index of each updating task, calls a local updating task program to sequentially execute the updating tasks according to the priority index of each updating task from high to low, and uploads the information of any updating task which is updated at the node to a database;
selecting a lower node according to the communication level of the current node receiving the plurality of updating tasks and other nodes which do not execute the updating tasks;
sending the received multiple updating tasks to a lower node, and repeating the steps in the sequence until all nodes in the network receive the multiple updating tasks and execute updating;
determining the connectivity level of the current node and other nodes according to the transmission index parameters of the current node and other nodes, where the transmission index parameters at least include one of:
average data transmission speed, transmission bandwidth and request response delay;
the average data transmission speed is positively correlated with the connection level, the transmission bandwidth is positively correlated with the connection level, and the request response delay is negatively correlated with the connection level.
2. The content update method of claim 1,
the determining the connectivity level of the current node and other nodes by the transmission index parameters of the current node and other nodes comprises one of the following modes:
the method comprises the steps that a first mode is that the communication level of a target node is extracted from a communication level list of a current node and other nodes which are maintained in real time, and the communication level of the current node and other nodes is recorded in the communication level list; when the current node maintains the connection level list in real time, calculating transmission index parameters of the current node and other nodes in real time, determining a new connection level according to the calculated transmission index parameters, and updating the connection level list;
and secondly, calculating a transmission index parameter between the current node and the target node, and determining the connectivity level according to the calculated transmission index parameter.
3. The multitask content updating method as claimed in claim 2, wherein said selecting of said target node in the second mode of determining the connectivity level of said current node with other nodes by the transmission index parameter of said current node with other nodes comprises one of the following modes:
selecting a plurality of nodes which are in the same operator network with the current node from other nodes which do not execute the updating task;
selecting a plurality of nodes which are in the same operator network with the current node and are smaller than a preset distance in a region from other nodes which do not execute the updating task;
and thirdly, randomly selecting a plurality of nodes from other nodes which have not performed the updating task.
4. The multitask content updating method according to claim 1,
the method further comprises the following steps: the network receives a plurality of nodes of the updating tasks from the server, namely, the primary nodes identify different updating tasks and then send the different updating tasks to the subordinate nodes; and all nodes in the network detect whether the repeated updating tasks are received or not in real time according to the identification of the updating tasks, and discard redundant updating tasks when the repeated updating tasks are received.
5. The multitask content updating method according to claim 1,
and the node sends the received multiple updating tasks to the subordinate node based on a User Datagram Protocol (UDP).
6. The multitask content updating method according to claim 1,
the method also comprises the steps that the node maintains a transmission path table in each network updating process, after the next node is determined, the identifier of the next node is added into the transmission path table to mark the node which is updated, and the transmission path table is sent to the next node.
7. A multitasking content updating apparatus for use in a content distribution network node or a non-content distribution network node, comprising:
a receiving module, configured to receive a plurality of update tasks;
the analysis module is used for analyzing the priority index of each updating task;
the updating module is used for calling a local updating task program to sequentially execute the updating tasks according to the priority indexes of the updating tasks from high to low according to the sequence of the priority indexes;
an uploading module: the information used for uploading any update task to the database after the update of the node is completed;
the selection module is used for selecting a lower node according to the communication level of the current node receiving the plurality of updating tasks and other nodes which do not execute the updating tasks; determining the connectivity level of the current node and other nodes according to the transmission index parameters of the current node and other nodes, where the transmission index parameters at least include one of:
average data transmission speed, transmission bandwidth and request response delay;
the average data transmission speed is positively correlated with the connectivity level, the transmission bandwidth is positively correlated with the connectivity level, and the request response delay is negatively correlated with the connectivity level;
and the sending module is used for sending the received plurality of updating tasks to the lower node.
8. The multitasking content updating device as recited in claim 7,
the selection module also comprises a communication grade list maintenance subunit and a selection processing subunit;
the communication level list maintenance subunit is used for calculating a transmission index parameter between the current node and the target node; determining a new connection level according to the calculated transmission index parameters, and updating a connection level list;
the selection processing subunit is used for extracting the communication level of the target node from a communication level list of the current node and other nodes maintained in real time, and the communication level list records the communication levels of the current node and other nodes;
or, the selection module further comprises a transmission index parameter calculation subunit and a selection processing subunit;
the transmission index parameter calculation subunit is used for calculating a transmission index parameter between the current node and the target node;
and the selection processing subunit is used for determining the connectivity grade according to the calculated transmission index parameter.
9. The multitasking content updating device according to claim 7, wherein said selecting module further includes a target node selecting unit;
the target node selection unit is used for selecting a target node from other nodes which have not executed the updating task by using one of the following modes:
selecting a plurality of nodes which are in the same operator network with the current node from other nodes which do not execute the updating task;
selecting a plurality of nodes which are in the same operator network with the current node and are smaller than a preset distance in a region from other nodes which do not execute the updating task;
and thirdly, randomly selecting a plurality of nodes from other nodes which have not performed the updating task.
10. The multitasking content updating device as recited in claim 7,
the device also comprises a marking module and a detection module;
the marking module is used for identifying different updating tasks when the receiving module receives a plurality of updating tasks from a server;
the detection module is used for detecting whether repeated updating tasks are received or not in real time according to the identification of the updating tasks, and discarding redundant updating tasks when the repeated updating tasks are received.
11. The multitasking content updating device as recited in claim 7,
the sending module is further configured to send the received plurality of update tasks based on a User Datagram Protocol (UDP) when sending the update tasks to the subordinate node.
12. The multitasking content updating device as recited in claim 7,
the apparatus also includes a transmission path table maintenance module;
the transmission path table maintenance module is used for maintaining a transmission path table, and after the selection module determines that the lower node is reached, the identification of the lower node is added into the transmission path table to mark the node which is updated; the sending module is further configured to send the transmission path table to the subordinate node.
13. A computer arrangement, characterized in that the computer arrangement comprises a processor for implementing the steps of the method according to any one of claims 1 to 6 when executing a computer program stored in a memory.
14. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911260104.5A CN111064780B (en) | 2017-03-01 | 2017-03-01 | Multitask content updating method, device, equipment and medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710117463.XA CN108540505B (en) | 2017-03-01 | 2017-03-01 | Content updating method and device |
| CN201911260104.5A CN111064780B (en) | 2017-03-01 | 2017-03-01 | Multitask content updating method, device, equipment and medium |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710117463.XA Division CN108540505B (en) | 2017-03-01 | 2017-03-01 | Content updating method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111064780A true CN111064780A (en) | 2020-04-24 |
| CN111064780B CN111064780B (en) | 2023-04-18 |
Family
ID=63488440
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911260104.5A Active CN111064780B (en) | 2017-03-01 | 2017-03-01 | Multitask content updating method, device, equipment and medium |
| CN201710117463.XA Active CN108540505B (en) | 2017-03-01 | 2017-03-01 | Content updating method and device |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710117463.XA Active CN108540505B (en) | 2017-03-01 | 2017-03-01 | Content updating method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN111064780B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113656222A (en) * | 2021-07-01 | 2021-11-16 | 中国长城科技集团股份有限公司 | Serial port connection method, serial port connection device and electronic equipment |
| CN114024984A (en) * | 2021-09-27 | 2022-02-08 | 阿里巴巴（中国）有限公司 | Resource refreshing method, device and equipment for Content Delivery Network (CDN) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109274762B (en) * | 2018-10-22 | 2021-10-29 | 杭州领智云画科技有限公司 | CDN refreshing method and system |
| CN111385316B (en) * | 2018-12-27 | 2022-06-21 | 阿里巴巴集团控股有限公司 | Resource refreshing method, access method and device |
| CN111464624A (en) * | 2020-03-30 | 2020-07-28 | 北京金山云网络技术有限公司 | Content refreshing method and device for CDN (content delivery network) and electronic equipment |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7158985B1 (en) * | 2003-04-09 | 2007-01-02 | Cisco Technology, Inc. | Method and apparatus for efficient propagation of large datasets under failure conditions |
| CN101262487A (en) * | 2008-04-25 | 2008-09-10 | 北京中企开源信息技术有限公司 | Data transmission processing method and device for point-to-point client |
| CN101931656A (en) * | 2010-09-16 | 2010-12-29 | 武汉大学 | ISP-friendly distributed service node selection and update method |
| CN102271324A (en) * | 2010-06-03 | 2011-12-07 | 中国移动通信集团公司 | scheduling information updating method, device and system |
| CN102368776A (en) * | 2011-11-25 | 2012-03-07 | 中国科学技术大学 | Optimization function module of node list in content distribution/delivery network (CDN) |
| CN102546820A (en) * | 2012-02-16 | 2012-07-04 | 华为技术有限公司 | Transmission optimization method, and mapping information storage method, device and system |
| CN102594902A (en) * | 2012-03-01 | 2012-07-18 | 浙江大学 | BitTorrent node selecting method based on node performance |
| CN102665196A (en) * | 2012-04-28 | 2012-09-12 | 清华大学 | On-line progressive program updating method for wireless sensor network |
| CN103200273A (en) * | 2013-04-19 | 2013-07-10 | 北京科技大学 | Content replica consistency maintaining method based on physical location |
| CN103581245A (en) * | 2012-07-30 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Content delivery method and system of content delivery network |
| CN103595740A (en) * | 2012-08-14 | 2014-02-19 | 中国科学院声学研究所 | A method and a system for updating a peer-to-peer network copyright content similarity graph |
| CN104348888A (en) * | 2013-08-09 | 2015-02-11 | 中国电信股份有限公司 | Content routing delivery method, content delivery network node and system |
| CN104967861A (en) * | 2015-05-27 | 2015-10-07 | 上海美琦浦悦通讯科技有限公司 | CDN video buffer system and method |
| US20160072667A1 (en) * | 2014-01-08 | 2016-03-10 | Telefonaktiebolaget L M Ericsson (Publ) | Method, node and distributed system for configuring a network of cdn caching nodes |
| US20160378454A1 (en) * | 2015-06-29 | 2016-12-29 | Verizon Patent And Licensing Inc. | Software updates using client self-reporting and a hierarchical data structure |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160180317A1 (en) * | 2013-03-11 | 2016-06-23 | Google Inc. | Offline peer-to-peer transactions |
-
2017
- 2017-03-01 CN CN201911260104.5A patent/CN111064780B/en active Active
- 2017-03-01 CN CN201710117463.XA patent/CN108540505B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7158985B1 (en) * | 2003-04-09 | 2007-01-02 | Cisco Technology, Inc. | Method and apparatus for efficient propagation of large datasets under failure conditions |
| CN101262487A (en) * | 2008-04-25 | 2008-09-10 | 北京中企开源信息技术有限公司 | Data transmission processing method and device for point-to-point client |
| CN102271324A (en) * | 2010-06-03 | 2011-12-07 | 中国移动通信集团公司 | scheduling information updating method, device and system |
| CN101931656A (en) * | 2010-09-16 | 2010-12-29 | 武汉大学 | ISP-friendly distributed service node selection and update method |
| CN102368776A (en) * | 2011-11-25 | 2012-03-07 | 中国科学技术大学 | Optimization function module of node list in content distribution/delivery network (CDN) |
| CN102546820A (en) * | 2012-02-16 | 2012-07-04 | 华为技术有限公司 | Transmission optimization method, and mapping information storage method, device and system |
| CN102594902A (en) * | 2012-03-01 | 2012-07-18 | 浙江大学 | BitTorrent node selecting method based on node performance |
| CN102665196A (en) * | 2012-04-28 | 2012-09-12 | 清华大学 | On-line progressive program updating method for wireless sensor network |
| CN103581245A (en) * | 2012-07-30 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Content delivery method and system of content delivery network |
| CN103595740A (en) * | 2012-08-14 | 2014-02-19 | 中国科学院声学研究所 | A method and a system for updating a peer-to-peer network copyright content similarity graph |
| CN103200273A (en) * | 2013-04-19 | 2013-07-10 | 北京科技大学 | Content replica consistency maintaining method based on physical location |
| CN104348888A (en) * | 2013-08-09 | 2015-02-11 | 中国电信股份有限公司 | Content routing delivery method, content delivery network node and system |
| US20160072667A1 (en) * | 2014-01-08 | 2016-03-10 | Telefonaktiebolaget L M Ericsson (Publ) | Method, node and distributed system for configuring a network of cdn caching nodes |
| CN104967861A (en) * | 2015-05-27 | 2015-10-07 | 上海美琦浦悦通讯科技有限公司 | CDN video buffer system and method |
| US20160378454A1 (en) * | 2015-06-29 | 2016-12-29 | Verizon Patent And Licensing Inc. | Software updates using client self-reporting and a hierarchical data structure |
Non-Patent Citations (2)
| Title |
|---|
| 卢良进等: "基于P2P的RSS内容分发系统研究与实现", 《杭州电子科技大学学报》 * |
| 胡立强等: "互联网业务及内容资源调度分析", 《电信技术》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113656222A (en) * | 2021-07-01 | 2021-11-16 | 中国长城科技集团股份有限公司 | Serial port connection method, serial port connection device and electronic equipment |
| CN114024984A (en) * | 2021-09-27 | 2022-02-08 | 阿里巴巴（中国）有限公司 | Resource refreshing method, device and equipment for Content Delivery Network (CDN) |
| CN114024984B (en) * | 2021-09-27 | 2024-01-05 | 阿里巴巴（中国）有限公司 | Resource refreshing method, device and equipment for Content Delivery Network (CDN) |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108540505A (en) | 2018-09-14 |
| CN108540505B (en) | 2020-04-28 |
| CN111064780B (en) | 2023-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111064780B (en) | Multitask content updating method, device, equipment and medium | |
| US10812358B2 (en) | Performance-based content delivery | |
| US10171610B2 (en) | Web caching method and system for content distribution network | |
| US20050228855A1 (en) | Acquisition system for distributed computing resources | |
| US10579595B2 (en) | Method and device for calling a distributed file system | |
| EP2528397B1 (en) | Method and apparatus for synchronization based on hypertext transfer protocol (http) | |
| CN104219316A (en) | Method and device for processing call request in distributed system | |
| JP4205323B2 (en) | Distribution system, distribution server and distribution method, distribution program | |
| CN102025595A (en) | Flow optimization method and system | |
| CN111338893A (en) | Process log processing method and device, computer equipment and storage medium | |
| CN112261172A (en) | Service addressing access method, device, system, equipment and medium | |
| CN112398797B (en) | Data transmission method, receiving device, transmitting device, medium, equipment and system | |
| CN105471700B (en) | A kind of methods, devices and systems of Message Processing | |
| CN104348661B (en) | The upload of network failure data, method of reseptance and equipment and recording method and system | |
| CN115623000A (en) | Method and device for efficiently distributing data on digital network | |
| CN111193792A (en) | Message transmission method and device, electronic equipment and storage medium | |
| CN110740355A (en) | Equipment monitoring method and device, electronic equipment and storage medium | |
| CN117499403A (en) | Computing task scheduling method and device for computing power network | |
| CN110300140B (en) | Method for updating content in cloud distribution network, refreshing client and network node | |
| CN114610689B (en) | Recording and analyzing method for request log in distributed environment | |
| CN115883657A (en) | Cloud disk service accelerated scheduling method and system | |
| CN113709232B (en) | Data packet loading method, client agent, device and storage medium | |
| CN115134618B (en) | Live stream life cycle information processing method and device and computing equipment | |
| CN112003717B (en) | Device upgrading method, network device, server, electronic device and storage medium | |
| US20090313307A1 (en) | Manipulation of network management information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |