CN113377519A - CDN-based content scheduling method - Google Patents
CDN-based content scheduling method Download PDFInfo
- Publication number
- CN113377519A CN113377519A CN202110767191.4A CN202110767191A CN113377519A CN 113377519 A CN113377519 A CN 113377519A CN 202110767191 A CN202110767191 A CN 202110767191A CN 113377519 A CN113377519 A CN 113377519A
- Authority
- CN
- China
- Prior art keywords
- access
- equipment
- content
- information
- matching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000008447 perception Effects 0.000 claims abstract description 9
- 238000005516 engineering process Methods 0.000 claims abstract description 8
- 230000008859 change Effects 0.000 claims description 50
- 230000008569 process Effects 0.000 claims description 24
- 238000012216 screening Methods 0.000 claims description 22
- 238000004458 analytical method Methods 0.000 claims description 15
- 238000007726 management method Methods 0.000 claims description 11
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 230000035945 sensitivity Effects 0.000 claims description 5
- 230000006870 function Effects 0.000 claims description 3
- 238000013507 mapping Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 description 7
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000009193 crawling Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/604—Tools and structures for managing or administering access control systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/5038—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5021—Priority
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/2141—Access rights, e.g. capability lists, access control lists, access tables, access matrices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a CDN-based content scheduling method, which comprises the following steps: step 1: acquiring a user request, analyzing the user request, and acquiring a request label and a content label; step 2: matching a first device set related to the request tag based on the CDN node, simultaneously acquiring first content of each first device in the first device set, and performing content perception on the first content and the content tag; and step 3: and based on the local content management technology, taking the equipment corresponding to the sensing result as content scheduling equipment, scheduling the corresponding second content, and sending the second content to the user side. The corresponding equipment can be conveniently and accurately acquired, content scheduling is realized, and the reliability of content scheduling is improved.
Description
Technical Field
The invention relates to the technical field of content management, in particular to a content scheduling method based on a CDN (content delivery network).
Background
The CDN is called a Content Delivery Network, i.e., a Content Delivery Network. The CDN is an intelligent virtual network constructed on the basis of the existing network, and depends on edge servers deployed in various places and functional modules of load balancing, content distribution, scheduling and the like of a central platform.
In the process of accessing by using the CDN, due to some defects of the CDN itself and the fact that generally in the process of using the CDN, a manual setting mode is adopted, and technicians log in or directly modify and set various parameters on the server to implement updating, a result of content scheduling may be affected, and a user may be relocated to a device that does not have a required content, thereby reducing scheduling reliability.
Therefore, the invention provides a content scheduling method based on the CDN.
Disclosure of Invention
The invention provides a CDN-based content scheduling method, which is used for solving the technical problem.
The invention provides a CDN-based content scheduling method, which comprises the following steps:
step 1: acquiring a user request, analyzing the user request, and acquiring a request label and a content label;
step 2: matching a first device set related to the request tag based on a CDN node, simultaneously acquiring first content of each first device in the first device set, and performing content perception on the first content and the content tag;
and step 3: and based on the local content management technology, taking the equipment corresponding to the sensing result as content scheduling equipment, scheduling corresponding second content, and sending the second content to the user side.
In one possible implementation, step 1: the method for acquiring the user request and analyzing the user request comprises the following steps of:
establishing a local content index;
establishing an association relation between the index and each corresponding device, wherein the index is related to the content name, the current content resource location, the content updating time and the content information on the corresponding device;
and storing the association relation to the CDN node.
In a possible implementation manner, step 1, after obtaining the user request, further includes:
recording all user requests received within a preset time period, determining task scheduling information corresponding to each user request, further acquiring corresponding equipment to be accessed in the CDN node, simultaneously determining the number of times of the access request to be accessed to each equipment to be accessed, and screening equipment corresponding to the maximum access number and equipment corresponding to the minimum access number;
meanwhile, in the process of accessing, the actual access times of each access request to the device to be accessed are monitored, and the actual access times include: actual successful access times and actual failed access times;
screening equipment corresponding to the maximum actual access times, equipment corresponding to the minimum actual access times, equipment corresponding to the maximum actual successful access times and equipment corresponding to the maximum actual failed access times;
performing equipment matching based on the screening result to obtain overlapped equipment and non-overlapped equipment;
extracting overlapping information corresponding to overlapping equipment, configuring overlapping attributes to the overlapping information, and simultaneously extracting equipment information of the non-overlapping equipment;
setting a first access priority to the overlay device according to the overlay attribute;
monitoring and acquiring an occupation log of each first request in a first request set before the user requests access to the overlapping equipment;
performing first analysis on the occupation log according to occupation conditions, and simultaneously performing second analysis on the occupation log according to the request attribute of each first request;
determining the current execution state of the overlapping equipment according to the first analysis result and the second analysis result;
adjusting the first access priority according to the current execution states of all the overlapped devices;
setting a second access priority to the non-overlapped equipment according to the equipment information, and setting a third access priority to the remaining equipment according to a preset access rule;
acquiring the comprehensive access priority of all the equipment to be accessed based on the adjustment result and the corresponding setting result of the non-overlapped equipment and the rest equipment;
and establishing access labels based on the comprehensive access priority, and respectively distributing the access labels to corresponding equipment for temporary storage and real-time updating.
In a possible implementation manner, the establishing of the access labels based on the comprehensive access priority and the distributing of the access labels to the corresponding devices for temporary storage respectively further includes:
determining a priority coefficient for each corresponding device with respect to the integrated access priority based on a priority mapping table;
calculating the label value of each corresponding device for establishing the access label according to the following formula;
wherein, YiA tag value representing that the ith corresponding device needs to establish an access tag; y isiA priority coefficient representing an ith corresponding device; n represents the total number of devices of each corresponding device, namely the total number of devices to be accessed; x is the number ofiRepresenting the equipment influence factor of the ith corresponding equipment, and taking the value as (0, 1); x is the number ofjRepresenting the equipment influence factor of the jth corresponding equipment, and taking the value as (0, 1); x is the number ofixjRepresenting the association coefficient of the jth corresponding equipment and the ith corresponding equipment, and taking the value as (0, 1);
carrying out grade division on the label value according to a grade division table, and calling a grade safety mode corresponding to the label grade from a safety database;
and in the process of establishing the corresponding label, carrying out safety setting on the corresponding label according to the level safety mode to obtain the corresponding access label.
In one possible implementation, step 2: in the process of matching the first device set related to the request tag based on the CDN node, the method further includes:
obtaining matching equipment according to the request label;
determining the current access service capability of each matched device;
determining first matching equipment of which the current access capability does not exceed the corresponding preset access capability, and simultaneously determining second matching equipment when the current access service capability exceeds the corresponding preset access service capability;
based on a local management technology, calling a waiting device of the second matching device within a preset range;
summarizing the second matching equipment and the corresponding waiting equipment into skipping equipment;
and constructing and obtaining a first equipment set based on the first matching equipment and the skipping equipment.
In a possible implementation manner, in the process of retrieving the waiting device within the preset range of the second matching device, the method further includes:
and distributing the corresponding content of the second matching device to the corresponding waiting device, wherein the distribution process comprises the following steps:
capturing access information of an exceeding part of the current access service capability exceeding the corresponding preset access service capability;
determining the access types of the excessive part of access information and the access parameter set corresponding to each type according to the capture result;
calculating an information comprehensive value Z of the access information of the exceeding part according to the following formula;
f(WK,L，BK,L)＝WK,L*γK,L*BK,L；
wherein K represents a general type of access type; fk1The information ratio of the access information corresponding to the k1 th access type in the excess part of the access information is shown; dk1The information weight value corresponding to the access type of the kth 1 is represented; fk1Dk1An information effective value representing that the access type of the k1 th access type corresponds to the access information; l represents the total number of the corresponding access parameters in each access type; w is aK,LRepresenting the corresponding Lth access parameter in the Kth access type; b isK,LParameter indicating corresponding L-th access parameter in K-th access typeA weight value; f (W)K,L,BK,L) Representing a standard parameter function converted based on a standard data conversion table; e is the same asK,LThe weight adjustment factor of the corresponding L standard parameter in the K access type is represented, and the value range is (0, 1); gamma rayK,LRepresents the conversion coefficient obtained by the corresponding L-th access parameter in the K-th access type based on the standard data conversion table, and is sigmaK∑LBK,L＝1；
Acquiring the storage capacity of the access information of the exceeding part, distributing first target equipment in a corresponding preset range according to the storage capacity, and screening second target equipment from the first target equipment according to the information comprehensive value Z;
and the second target equipment obtained by screening is used as waiting equipment for distributing the corresponding content.
In one possible implementation, determining the current access service capability of each matching device includes:
collecting statistical information which is accessed currently on each matching device;
determining first content change information of the matching equipment in the current accessed time period according to the statistical information;
acquiring second content change information of the matching equipment in each history stage according to history information of the matching equipment in history records;
determining a change rule of the matching equipment according to the second content change information, and meanwhile, adjusting the change rule based on the first content change information to obtain an effective change rule;
meanwhile, based on history information of the matching equipment of a history record, constructing a historical security access thread of the matching equipment, capturing sensitivity information of the matching equipment from the statistical information, determining a first security access thread of the matching equipment, capturing residual information of the matching equipment in the statistical information, determining a second security access thread of the matching equipment, and if the security values of the first security access thread and the second security access thread are both greater than or equal to the security value of the historical security access thread, keeping an effective change rule of the matching equipment, and regarding the change rule as an effective change rule and regarding the change rule as a final change rule;
otherwise, correspondingly increasing the sensitive threshold value of each requester corresponding to the matching equipment according to the smaller relation between the safety values of the first safety access thread and the second safety access thread and the safety value smaller than the historical safety access thread, and meanwhile, performing safety protection processing on the access path corresponding to each requester based on the sensitive threshold values to determine corresponding resource scheduling;
adjusting the effective change rule according to a scheduling result to obtain a final change rule;
determining an accessed access set according to the statistical information;
analyzing each access request in the access set, acquiring a requester of the access request, and determining a request authority of the requester based on a user request database, wherein the request authority comprises: user access authority and access operation authority;
acquiring a first access thread matched with the user access authority and a second access thread matched with the access operation authority, and determining the user access capability of the requester based on the matching equipment based on the first access thread and the second access thread;
and determining the current access service capability of the matching equipment according to the final change rule and the user access capability.
In one possible implementation manner, step 2, performing content perception on the first content and the content tag includes:
extracting a key set of the first content, and establishing a key label for each key information in the key set;
traversing all the content tags by the key tag, sensing the current connection degree of the key tag and each content tag, dividing the content tags according to the current connection degree, and determining the number of the content tags and the weight value of the content tags in each degree division result;
and screening the optimal equipment as the content scheduling equipment according to the determination result.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
fig. 1 is a flowchart of a content scheduling method based on a CDN in an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
The invention provides a content scheduling method based on a CDN (content delivery network), which comprises the following steps of:
step 1: acquiring a user request, analyzing the user request, and acquiring a request label and a content label;
step 2: matching a first device set related to the request tag based on a CDN node, simultaneously acquiring first content of each first device in the first device set, and performing content perception on the first content and the content tag;
and step 3: and based on the local content management technology, taking the equipment corresponding to the sensing result as content scheduling equipment, scheduling corresponding second content, and sending the second content to the user side.
In this embodiment, the local content management technology is mainly performed for one CDN node (which is configured by multiple CDN Cache devices and one SLB device). The main goal of local content management is to improve the efficiency of content services and the storage utilization of local nodes. Through local content management, scheduling based on content perception can be achieved on the CDN node, and through the scheduling based on the content perception, users can be prevented from being redirected to Cache equipment without the content, so that the load balancing efficiency is improved. The storage sharing of the content at the CDN node can be effectively realized through local content management, and the utilization rate of the storage space is improved.
In this embodiment, the user request is related to a user's requirement, and is to be able to invoke effective content for convenience, and parsing the user request means that the user request is transmitted to a pre-trained parsing model, and the user request is parsed to obtain a request tag and a content tag, and the parsing model is trained based on a historical request tag and a historical content tag.
In this embodiment, the first device set includes a plurality of first devices, and is only a device that obtains the matching request, so as to avoid loss of the related device, and the content tag refers to a plurality of tags corresponding to each first content for perception, so as to obtain one device from the plurality of first devices by filtering.
In this embodiment, the second content in the content scheduling device is scheduled, so as to implement accurate scheduling, ensure the reliability of scheduling, and avoid relocating to a device without content.
In this embodiment, the user terminal can be implemented as a mobile phone, a computer, a notebook, or the like.
The beneficial effects of the above technical scheme are: the two types of labels are obtained by analyzing the labels, and then the labels are matched through the request, and the content labels are sensed, so that the corresponding equipment can be effectively and accurately obtained, the content scheduling is realized, and the reliability of the content scheduling is improved.
The invention provides a CDN-based content scheduling method, which comprises the following steps: the method for acquiring the user request and analyzing the user request comprises the following steps of:
establishing a local content index;
establishing an association relation between the index and each corresponding device, wherein the index is related to the content name, the current content resource location, the content updating time and the content information on the corresponding device;
and storing the association relation to the CDN node.
In this embodiment, the index is for establishing a tag, and the association relationship is for crawling and setting valid information, and then scheduling is performed.
The beneficial effects of the above technical scheme are: by establishing the index, the association relationship is further established, so that the guiding accuracy of the related information of the CDN node is conveniently ensured, and a reliable basis is provided for subsequent content scheduling.
The invention provides a CDN-based content scheduling method, which comprises the following steps of 1, after obtaining a user request:
recording all user requests received within a preset time period, determining task scheduling information corresponding to each user request, further acquiring corresponding equipment to be accessed in the CDN node, simultaneously determining the number of times of the access request to be accessed to each equipment to be accessed, and screening equipment corresponding to the maximum access number and equipment corresponding to the minimum access number;
meanwhile, in the process of accessing, the actual access times of each access request to the device to be accessed are monitored, and the actual access times include: actual successful access times and actual failed access times;
screening equipment corresponding to the maximum actual access times, equipment corresponding to the minimum actual access times, equipment corresponding to the maximum actual successful access times and equipment corresponding to the maximum actual failed access times;
performing equipment matching based on the screening result to obtain overlapped equipment and non-overlapped equipment;
extracting overlapping information corresponding to overlapping equipment, configuring overlapping attributes to the overlapping information, and simultaneously extracting equipment information of the non-overlapping equipment;
setting a first access priority to the overlay device according to the overlay attribute;
monitoring and acquiring an occupation log of each first request in a first request set before the user requests access to the overlapping equipment;
performing first analysis on the occupation log according to occupation conditions, and simultaneously performing second analysis on the occupation log according to the request attribute of each first request;
determining the current execution state of the overlapping equipment according to the first analysis result and the second analysis result;
adjusting the first access priority according to the current execution states of all the overlapped devices;
setting a second access priority to the non-overlapped equipment according to the equipment information, and setting a third access priority to the remaining equipment according to a preset access rule;
acquiring the comprehensive access priority of all the equipment to be accessed based on the adjustment result and the corresponding setting result of the non-overlapped equipment and the rest equipment;
and establishing access labels based on the comprehensive access priority, and respectively distributing the access labels to corresponding equipment for temporary storage and real-time updating.
In this embodiment, the remaining devices refer to devices that have been removed from overlapping devices and non-overlapping devices in the device to be accessed, and the remaining devices are devices that do not satisfy the screening result.
In this embodiment, the overlapping device refers to a device corresponding to the maximum access time, a device corresponding to the maximum actual access time of the device corresponding to the minimum access time, a device corresponding to the minimum actual access time, a device corresponding to the maximum actual successful access time, and a device corresponding to the maximum actual failed access time, where the overlapping device exists in these devices, for example, the device corresponding to the maximum access time is a, and the device corresponding to the minimum actual access time is also a, and at this time, it is considered that a is an overlapping device; if the two items are the same, the device is regarded as an overlapped device, and if one item is not overlapped, the corresponding device to be accessed is regarded as a non-overlapped device.
In this embodiment, the overlapping information refers to the corresponding maximum access times, the minimum actual access times, and some access information in the access process, and the overlapping attribute is determined according to the corresponding overlapping information, for example, the device a includes the maximum access times and the minimum actual access times, and the corresponding overlapping attribute is the device access unreliable attribute at this time, and further, the first access priority may be set according to these results;
in this embodiment, the device information refers to attribute information provided in the non-overlapping device itself.
In this embodiment, the occupation log refers to a log obtained by occupying an overlapping device according to a previous request before a corresponding access request.
In this embodiment, the occupation condition refers to a condition divided according to the type of the occupation log, and then the first analysis is performed, and the second analysis refers to analysis of the occupation log according to the request attribute of each access request.
In this embodiment, the integrated access priority refers to prioritizing the devices to be accessed.
In this embodiment, the access tag is established so that there is an access intermediary to implement the access.
The beneficial effects of the above technical scheme are: the equipment to be accessed is conveniently distinguished by screening the overlapped equipment, the non-overlapped equipment and the residual equipment, so that the equipment priorities of different types of equipment are obtained, the comprehensive priority is conveniently obtained by adjusting the priority of the overlapped equipment, the validity of access is guaranteed, effective access is conveniently realized by establishing an access label, and finally, the scheduling reliability is indirectly improved.
The invention provides a CDN-based content scheduling method, which is used for establishing access labels based on the comprehensive access priority and respectively distributing the access labels to corresponding equipment for temporary storage, and further comprises the following steps:
determining a priority coefficient for each corresponding device with respect to the integrated access priority based on a priority mapping table;
calculating the label value of each corresponding device for establishing the access label according to the following formula;
wherein, YiA tag value representing that the ith corresponding device needs to establish an access tag; y isiA priority coefficient representing an ith corresponding device; n represents the total number of devices of each corresponding device, namely the total number of devices to be accessed; x is the number ofiRepresenting the equipment influence factor of the ith corresponding equipment, and taking the value as (0, 1); x is the number ofjRepresenting the equipment influence factor of the jth corresponding equipment, and taking the value as (0, 1); x is the number ofixjRepresenting the association coefficient of the jth corresponding equipment and the ith corresponding equipment, and taking the value as (0, 1);
carrying out grade division on the label value according to a grade division table, and calling a grade safety mode corresponding to the label grade from a safety database;
and in the process of establishing the corresponding label, carrying out safety setting on the corresponding label according to the level safety mode to obtain the corresponding access label.
The beneficial effects of the above technical scheme are: by obtaining the priority coefficient, the label value is calculated according to a formula, and the grade safety mode of each label is determined through grade division, so that the safety of the label is set, the safety of the label is ensured, the safety of access in the access process can be effectively determined, and the scheduling reliability is indirectly improved.
The invention provides a CDN-based content scheduling method, which comprises the following steps: in the process of matching the first device set related to the request tag based on the CDN node, the method further includes:
obtaining matching equipment according to the request label;
determining the current access service capability of each matched device;
determining first matching equipment of which the current access capability does not exceed the corresponding preset access capability, and simultaneously determining second matching equipment when the current access service capability exceeds the corresponding preset access service capability;
based on a local management technology, calling a waiting device of the second matching device within a preset range;
summarizing the second matching equipment and the corresponding waiting equipment into skipping equipment;
and constructing and obtaining a first equipment set based on the first matching equipment and the skipping equipment.
In the embodiment, the matching device is determined according to the access service capability, and then the waiting device in the preset range is called, so that the first device set is conveniently constructed, and a basis is provided for content scheduling.
The invention provides a content scheduling method based on a CDN, which further comprises the following steps in the process of calling a waiting device of a second matching device in a preset range:
and distributing the corresponding content of the second matching device to the corresponding waiting device, wherein the distribution process comprises the following steps:
capturing access information of an exceeding part of the current access service capability exceeding the corresponding preset access service capability;
determining the access types of the excessive part of access information and the access parameter set corresponding to each type according to the capture result;
calculating an information comprehensive value Z of the access information of the exceeding part according to the following formula;
f(WK,L，BK,L)＝WK,L*γK,L*BK,L；
wherein K represents a general type of access type; fk1The information ratio of the access information corresponding to the k1 th access type in the excess part of the access information is shown; dk1The information weight value corresponding to the access type of the kth 1 is represented; fk1Dk1An information effective value representing that the access type of the k1 th access type corresponds to the access information; l represents the total number of the corresponding access parameters in each access type; w is aK,LRepresenting the corresponding Lth access parameter in the Kth access type; b isK,LA parameter weight value representing a corresponding Lth access parameter in the Kth access type; f (W)K,L，BK，L) Representing a standard parameter function converted based on a standard data conversion table; e is the same asK，LThe weight adjustment factor of the corresponding L standard parameter in the K access type is represented, and the value range is (0, 1); gamma rayK，LRepresents the conversion coefficient obtained by the corresponding L-th access parameter in the K-th access type based on the standard data conversion table, and is sigmaK∑LBK，L＝1；
Acquiring the storage capacity of the access information of the exceeding part, distributing first target equipment in a corresponding preset range according to the storage capacity, and screening second target equipment from the first target equipment according to the information comprehensive value Z;
and the second target equipment obtained by screening is used as waiting equipment for distributing the corresponding content.
The beneficial effects of the above technical scheme are: the content distribution is carried out on the excessive access information acquisition waiting equipment, the phenomenon of congestion in the request process is avoided, and the scheduling reliability is further ensured, wherein the access type and the access parameter set are determined by capturing the relevant access information, the information comprehensive value is calculated according to a formula, and the waiting equipment is obtained by comprehensive screening through the storage capacity and the information comprehensive value, so that the effectiveness of the waiting equipment is ensured, and a basis is provided for subsequent scheduling.
The invention provides a CDN-based content scheduling method, which determines the current access service capability of each matching device and comprises the following steps:
collecting statistical information which is accessed currently on each matching device;
determining first content change information of the matching equipment in the current accessed time period according to the statistical information;
acquiring second content change information of the matching equipment in each history stage according to history information of the matching equipment in history records;
determining a change rule of the matching equipment according to the second content change information, and meanwhile, adjusting the change rule based on the first content change information to obtain an effective change rule;
meanwhile, based on history information of the matching equipment of a history record, constructing a historical security access thread of the matching equipment, capturing sensitivity information of the matching equipment from the statistical information, determining a first security access thread of the matching equipment, capturing residual information of the matching equipment in the statistical information, determining a second security access thread of the matching equipment, and if the security values of the first security access thread and the second security access thread are both greater than or equal to the security value of the historical security access thread, keeping an effective change rule of the matching equipment, and regarding the change rule as an effective change rule and regarding the change rule as a final change rule;
otherwise, correspondingly increasing the sensitive threshold value of each requester corresponding to the matching equipment according to the smaller relation between the safety values of the first safety access thread and the second safety access thread and the safety value smaller than the historical safety access thread, and meanwhile, performing safety protection processing on the access path corresponding to each requester based on the sensitive threshold values to determine corresponding resource scheduling;
adjusting the effective change rule according to a scheduling result to obtain a final change rule;
determining an accessed access set according to the statistical information;
analyzing each access request in the access set, acquiring a requester of the access request, and determining a request authority of the requester based on a user request database, wherein the request authority comprises: user access authority and access operation authority;
acquiring a first access thread matched with the user access authority and a second access thread matched with the access operation authority, and determining the user access capability of the requester based on the matching equipment based on the first access thread and the second access thread;
and determining the current access service capability of the matching equipment according to the final change rule and the user access capability.
In this embodiment, the current access statistics refer to access information of each of the plurality of access requests.
In this embodiment, since the content of each device may change in different time periods, the change rule of each device is obtained, and the change rule is adjusted according to the current first content change information.
In the embodiment, the historical safe access thread refers to a safe access thread in a historical process of accessing the matched equipment, different access threads have different safety values, and the sensitive information refers to information with potential safety hazards, which causes the access thread to be unsafe;
in this embodiment, the first security access thread mainly refers to a thread with the least security, and if the security values of the threads are all greater than the security values of the corresponding historical access security threads, the security value of the thread corresponding to the remaining information is also greater than the security value of the corresponding historical access security thread;
in this embodiment, the less than relationship means that the security value of the first security access thread is less than the security value of the corresponding historical security access thread and/or the security value of the second security access thread is less than the security value of the corresponding historical security access thread;
in this embodiment, increasing the sensitivity threshold of the requester means increasing the security of the requester in the access process, and the security protection process is for security protection, because the security is improved in the process of increasing the sensitivity threshold, and at this time, the corresponding resource scheduling may have an influence, for example, the scheduling range remains unchanged, or the scheduling range becomes smaller.
In this embodiment, the access rights of each requester for the matching device are not different, and the access rights include different access operations, and thus the corresponding access operation rights are different.
In this embodiment, the first access thread and the second access thread are used for matching access situations of users with different permissions, and further acquiring access capabilities of the users.
The beneficial effects of the above technical scheme are: by adjusting the rule, the validity of the rule is guaranteed, the access capability is convenient to determine through statistical information and the effective change rule, a basis is provided for subsequent distribution, and the scheduling reliability is indirectly improved.
The invention provides a CDN-based content scheduling method, step 2, the content perception of the first content and a content label is carried out, comprising the following steps:
extracting a key set of the first content, and establishing a key label for each key information in the key set;
traversing all the content tags by the key tag, sensing the current connection degree of the key tag and each content tag, dividing the content tags according to the current connection degree, and determining the number of the content tags and the weight value of the content tags in each degree division result;
and screening the optimal equipment as the content scheduling equipment according to the determination result.
In this embodiment, the first content includes content information required by many users, and the content information is associated with content information such as a big data platform.
In this embodiment, the current linking degree refers to a matching degree between the key tag and each content tag, and the higher the matching degree is, the higher the corresponding current linking degree is, and the value is closer to 1.
In this embodiment, the content tag is divided into degrees, for example, there are tags B1, B2, and B3, where the degrees of engagement of B1, B2, and B3 are 0.1, 0.4, and 0.3, respectively, and since 0.4 and 0.3 are one rank and 0.1 is another rank, the division results obtained at this time are that B1 is one rank and B2 and B3 are another rank.
In this embodiment, the number of tags may be determined, and the weight value is determined according to the tag attribute.
The beneficial effects of the above technical scheme are: through traversing the label, be convenient for effectively confirm current linking degree, and through carrying out the degree division, further confirm corresponding number and weighted value, can effectively filter content scheduling equipment, guarantee the rationality of screening, provide the basis for the content scheduling.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. A CDN-based content scheduling method is characterized by comprising the following steps:
step 1: acquiring a user request, analyzing the user request, and acquiring a request label and a content label;
step 2: matching a first device set related to the request tag based on a CDN node, simultaneously acquiring first content of each first device in the first device set, and performing content perception on the first content and the content tag;
and step 3: and based on the local content management technology, taking the equipment corresponding to the sensing result as content scheduling equipment, scheduling corresponding second content, and sending the second content to the user side.
2. The CDN-based content scheduling method of claim 1, wherein step 1: the method for acquiring the user request and analyzing the user request comprises the following steps of:
establishing a local content index;
establishing an association relation between the index and each corresponding device, wherein the index is related to the content name, the current content resource location, the content updating time and the content information on the corresponding device;
and storing the association relation to the CDN node.
3. The CDN-based content scheduling method of claim 1, wherein step 1, after obtaining the user request, further comprises:
recording all user requests received within a preset time period, determining task scheduling information corresponding to each user request, further acquiring corresponding equipment to be accessed in the CDN node, simultaneously determining the number of times of the access request to be accessed to each equipment to be accessed, and screening equipment corresponding to the maximum access number and equipment corresponding to the minimum access number;
meanwhile, in the process of accessing, the actual access times of each access request to the device to be accessed are monitored, and the actual access times include: actual successful access times and actual failed access times;
screening equipment corresponding to the maximum actual access times, equipment corresponding to the minimum actual access times, equipment corresponding to the maximum actual successful access times and equipment corresponding to the maximum actual failed access times;
performing equipment matching based on the screening result to obtain overlapped equipment and non-overlapped equipment;
extracting overlapping information corresponding to overlapping equipment, configuring overlapping attributes to the overlapping information, and simultaneously extracting equipment information of the non-overlapping equipment;
setting a first access priority to the overlay device according to the overlay attribute;
monitoring and acquiring an occupation log of each first request in a first request set before the user requests access to the overlapping equipment;
performing first analysis on the occupation log according to occupation conditions, and simultaneously performing second analysis on the occupation log according to the request attribute of each first request;
determining the current execution state of the overlapping equipment according to the first analysis result and the second analysis result;
adjusting the first access priority according to the current execution states of all the overlapped devices;
setting a second access priority to the non-overlapped equipment according to the equipment information, and setting a third access priority to the remaining equipment according to a preset access rule;
acquiring the comprehensive access priority of all the equipment to be accessed based on the adjustment result and the corresponding setting result of the non-overlapped equipment and the rest equipment;
and establishing access labels based on the comprehensive access priority, and respectively distributing the access labels to corresponding equipment for temporary storage and real-time updating.
4. The CDN-based content scheduling method of claim 3, wherein, based on the integrated access priority, establishing access labels, and respectively delivering the access labels to corresponding devices for temporary storage, further comprises:
determining a priority coefficient for each corresponding device with respect to the integrated access priority based on a priority mapping table;
calculating the label value of each corresponding device for establishing the access label according to the following formula;
wherein, YiA tag value representing that the ith corresponding device needs to establish an access tag; y isiA priority coefficient representing an ith corresponding device; n represents the total number of devices of each corresponding device, namely the total number of devices to be accessed; x is the number ofiRepresenting the equipment influence factor of the ith corresponding equipment, and taking the value as (0, 1); x is the number ofjRepresenting the equipment influence factor of the jth corresponding equipment, and taking the value as (0, 1); x is the number ofixjRepresenting the association coefficient of the jth corresponding equipment and the ith corresponding equipment, and taking the value as (0, 1);
carrying out grade division on the label value according to a grade division table, and calling a grade safety mode corresponding to the label grade from a safety database;
and in the process of establishing the corresponding label, carrying out safety setting on the corresponding label according to the level safety mode to obtain the corresponding access label.
5. The CDN-based content scheduling method of claim 1, wherein step 2: in the process of matching the first device set related to the request tag based on the CDN node, the method further includes:
obtaining matching equipment according to the request label;
determining the current access service capability of each matched device;
determining first matching equipment of which the current access capability does not exceed the corresponding preset access capability, and simultaneously determining second matching equipment when the current access service capability exceeds the corresponding preset access service capability;
based on a local management technology, calling a waiting device of the second matching device within a preset range;
summarizing the second matching equipment and the corresponding waiting equipment into skipping equipment;
and constructing and obtaining a first equipment set based on the first matching equipment and the skipping equipment.
6. The CDN-based content scheduling method of claim 5, wherein in the process of retrieving a waiting device within a preset range of the second matching device, the method further comprises:
and distributing the corresponding content of the second matching device to the corresponding waiting device, wherein the distribution process comprises the following steps:
capturing access information of an exceeding part of the current access service capability exceeding the corresponding preset access service capability;
determining the access types of the excessive part of access information and the access parameter set corresponding to each type according to the capture result;
calculating an information comprehensive value Z of the access information of the exceeding part according to the following formula;
f(WK,L，BK,L)＝WK,L*γK,L*BK,L；
wherein K represents a general type of access type; fk1The information ratio of the access information corresponding to the k1 th access type in the excess part of the access information is shown; dk1The information weight value corresponding to the access type of the kth 1 is represented; fk1Dk1An information effective value representing that the access type of the k1 th access type corresponds to the access information; l represents the total number of the corresponding access parameters in each access type; w is aK,LRepresenting the corresponding Lth access parameter in the Kth access type; b isK,LA parameter weight value representing a corresponding Lth access parameter in the Kth access type; f (W)K,L,BK,L) Representing a standard parameter function converted based on a standard data conversion table; e is the same asK,LThe weight adjustment factor of the corresponding L standard parameter in the K access type is represented, and the value range is (0, 1); gamma rayK,LRepresents the conversion coefficient obtained by the corresponding L-th access parameter in the K-th access type based on the standard data conversion table, and is sigmaK∑LBK,L＝1；
Acquiring the storage capacity of the access information of the exceeding part, distributing first target equipment in a corresponding preset range according to the storage capacity, and screening second target equipment from the first target equipment according to the information comprehensive value Z;
and the second target equipment obtained by screening is used as waiting equipment for distributing the corresponding content.
7. The CDN-based content scheduling method of claim 5 wherein determining a current access service capability for each matching device comprises:
collecting statistical information which is accessed currently on each matching device;
determining first content change information of the matching equipment in the current accessed time period according to the statistical information;
acquiring second content change information of the matching equipment in each history stage according to history information of the matching equipment in history records;
determining a change rule of the matching equipment according to the second content change information, and meanwhile, adjusting the change rule based on the first content change information to obtain an effective change rule;
meanwhile, based on history information of the matching equipment of a history record, constructing a historical security access thread of the matching equipment, capturing sensitivity information of the matching equipment from the statistical information, determining a first security access thread of the matching equipment, capturing residual information of the matching equipment in the statistical information, determining a second security access thread of the matching equipment, and if the security values of the first security access thread and the second security access thread are both greater than or equal to the security value of the historical security access thread, keeping an effective change rule of the matching equipment, and regarding the change rule as an effective change rule and regarding the change rule as a final change rule;
otherwise, correspondingly increasing the sensitive threshold value of each requester corresponding to the matching equipment according to the smaller relation between the safety values of the first safety access thread and the second safety access thread and the safety value smaller than the historical safety access thread, and meanwhile, performing safety protection processing on the access path corresponding to each requester based on the sensitive threshold values to determine corresponding resource scheduling;
adjusting the effective change rule according to a scheduling result to obtain a final change rule;
determining an accessed access set according to the statistical information;
analyzing each access request in the access set, acquiring a requester of the access request, and determining a request authority of the requester based on a user request database, wherein the request authority comprises: user access authority and access operation authority;
acquiring a first access thread matched with the user access authority and a second access thread matched with the access operation authority, and determining the user access capability of the requester based on the matching equipment based on the first access thread and the second access thread;
and determining the current access service capability of the matching equipment according to the final change rule and the user access capability.
8. The CDN-based content scheduling method of claim 1, wherein step 2, performing content awareness on the first content and the content tag, comprises:
extracting a key set of the first content, and establishing a key label for each key information in the key set;
traversing all the content tags by the key tag, sensing the current connection degree of the key tag and each content tag, dividing the content tags according to the current connection degree, and determining the number of the content tags and the weight value of the content tags in each degree division result;
and screening the optimal equipment as the content scheduling equipment according to the determination result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110767191.4A CN113377519B (en) | 2021-07-07 | 2021-07-07 | CDN-based content scheduling method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110767191.4A CN113377519B (en) | 2021-07-07 | 2021-07-07 | CDN-based content scheduling method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113377519A true CN113377519A (en) | 2021-09-10 |
| CN113377519B CN113377519B (en) | 2022-03-22 |
Family
ID=77581288
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110767191.4A Active CN113377519B (en) | 2021-07-07 | 2021-07-07 | CDN-based content scheduling method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113377519B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114327507A (en) * | 2021-12-20 | 2022-04-12 | 江苏云工场信息技术有限公司 | Automatic arranging method and device for CDN (content delivery network) nodes |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103457907A (en) * | 2012-05-28 | 2013-12-18 | 中国移动通信集团公司 | Method, equipment and system for multimedia content distribution |
| CN104536972A (en) * | 2014-12-03 | 2015-04-22 | 北京邮电大学 | CDN-based web page content perception system and method |
| CN105262841A (en) * | 2015-11-06 | 2016-01-20 | 浪潮软件集团有限公司 | CDN network load balancing implementation method and CDN scheduling server |
| RU2606314C1 (en) * | 2015-10-20 | 2017-01-10 | Общество с ограниченной ответственностью "Телепорт Русь" | Method and system of media content distribution in peer-to-peer data transmission network |
| US20170171344A1 (en) * | 2015-12-15 | 2017-06-15 | Le Holdings (Beijing) Co., Ltd. | Scheduling method and server for content delivery network service node |
| EP3253026A1 (en) * | 2015-07-31 | 2017-12-06 | Huawei Technologies Co., Ltd. | Cdn-based access control method and relevant device |
| US20180227137A1 (en) * | 2013-06-13 | 2018-08-09 | Pushfor, Ltd | Method and system for sharing content files using a computer system and data network |
| CN110708256A (en) * | 2019-08-26 | 2020-01-17 | 中移（杭州）信息技术有限公司 | CDN scheduling method, device, network equipment and storage medium |
-
2021
- 2021-07-07 CN CN202110767191.4A patent/CN113377519B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103457907A (en) * | 2012-05-28 | 2013-12-18 | 中国移动通信集团公司 | Method, equipment and system for multimedia content distribution |
| US20180227137A1 (en) * | 2013-06-13 | 2018-08-09 | Pushfor, Ltd | Method and system for sharing content files using a computer system and data network |
| CN104536972A (en) * | 2014-12-03 | 2015-04-22 | 北京邮电大学 | CDN-based web page content perception system and method |
| EP3253026A1 (en) * | 2015-07-31 | 2017-12-06 | Huawei Technologies Co., Ltd. | Cdn-based access control method and relevant device |
| RU2606314C1 (en) * | 2015-10-20 | 2017-01-10 | Общество с ограниченной ответственностью "Телепорт Русь" | Method and system of media content distribution in peer-to-peer data transmission network |
| CN105262841A (en) * | 2015-11-06 | 2016-01-20 | 浪潮软件集团有限公司 | CDN network load balancing implementation method and CDN scheduling server |
| US20170171344A1 (en) * | 2015-12-15 | 2017-06-15 | Le Holdings (Beijing) Co., Ltd. | Scheduling method and server for content delivery network service node |
| CN110708256A (en) * | 2019-08-26 | 2020-01-17 | 中移（杭州）信息技术有限公司 | CDN scheduling method, device, network equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| EMMMZHANG: "《CDN的关键技术（内容路由、内容分发、内容存储、内容管理）》", 《HTTPS://BLOG.CSDN.NET/HL_ZZL/ARTICLE/DETAILS/84776093》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114327507A (en) * | 2021-12-20 | 2022-04-12 | 江苏云工场信息技术有限公司 | Automatic arranging method and device for CDN (content delivery network) nodes |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113377519B (en) | 2022-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108683604B (en) | Concurrent access control method, terminal device, and medium | |
| WO2020082579A1 (en) | Risk review and approval method, device, storage medium, and server | |
| US7349340B2 (en) | System and method of monitoring e-service Quality of Service at a transaction level | |
| US20050038833A1 (en) | Managing workload by service | |
| CN110264039A (en) | A kind of generation method and equipment of working report | |
| CN111552570B (en) | Self-adaptive distribution method of data processing resources of Internet of things and cloud computing server | |
| US11777949B2 (en) | Dynamic user access control management | |
| CN113505044B (en) | Database warning method, device, equipment and storage medium | |
| CN116070249B (en) | Asset data intelligent monitoring management system and method | |
| CN113377519B (en) | CDN-based content scheduling method | |
| CN111984495A (en) | Big data monitoring method and device and storage medium | |
| CN110471912B (en) | Employee attribute information verification method and device and terminal equipment | |
| CN111338888A (en) | Data statistical method and device, electronic equipment and storage medium | |
| CN117744129A (en) | Intelligent operation and maintenance method and system based on CIM | |
| CN108805725A (en) | Risk case confirmation method, server and computer readable storage medium | |
| CN110704454B (en) | Report data acquisition system and method | |
| CN117235797A (en) | Intelligent management method, device, equipment and system for big data resource access | |
| CN107046581A (en) | A kind of monitoring method, device and the server of service operation state | |
| CN116389486A (en) | Method and system for realizing operation analysis of multiple cloud resources | |
| CN110932935A (en) | Resource control method, device, equipment and computer storage medium | |
| CN113472881B (en) | Statistical method and device for online terminal equipment | |
| CN114756376A (en) | Cross-domain multi-service resource automatic adaptation maintenance platform | |
| CN114244685A (en) | Cloud service center access exception handling system | |
| CN113949578A (en) | Automatic detection method and device for unauthorized vulnerability based on flow and computer equipment | |
| CN108038783B (en) | Position management method, system and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A CDN based Content Scheduling Method Effective date of registration: 20220929 Granted publication date: 20220322 Pledgee: WUXI BRANCH, INDUSTRIAL BANK CO.,LTD. Pledgor: JIANGSU YUNGONGCHANG INFORMATION TECHNOLOGY CO.,LTD. Registration number: Y2022320010559 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20230922 Granted publication date: 20220322 Pledgee: WUXI BRANCH, INDUSTRIAL BANK CO.,LTD. Pledgor: JIANGSU YUNGONGCHANG INFORMATION TECHNOLOGY CO.,LTD. Registration number: Y2022320010559 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A CDN based content scheduling method Effective date of registration: 20231215 Granted publication date: 20220322 Pledgee: WUXI BRANCH, INDUSTRIAL BANK CO.,LTD. Pledgor: JIANGSU YUNGONGCHANG INFORMATION TECHNOLOGY CO.,LTD. Registration number: Y2023980071397 |