CN109981487B - Data scheduling method and device, electronic equipment and readable storage medium - Google Patents
Data scheduling method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN109981487B CN109981487B CN201910237431.2A CN201910237431A CN109981487B CN 109981487 B CN109981487 B CN 109981487B CN 201910237431 A CN201910237431 A CN 201910237431A CN 109981487 B CN109981487 B CN 109981487B
- Authority
- CN
- China
- Prior art keywords
- data
- time
- terminal device
- terminal equipment
- length
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
- H04L47/62—Queue scheduling characterised by scheduling criteria
- H04L47/6215—Individual queue per QOS, rate or priority
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
- H04L47/62—Queue scheduling characterised by scheduling criteria
- H04L47/625—Queue scheduling characterised by scheduling criteria for service slots or service orders
Abstract
The embodiment of the invention provides a data scheduling method, a data scheduling device, electronic equipment and a readable storage medium, which are applied to the technical field of data processing, wherein the method comprises the following steps: respectively calculating the data queue length, the virtual queue length and the time-aware queue length of the terminal equipment in the current buffer according to a preset scheduling algorithm; if the virtual queue length is larger than the data queue length in the cache, the terminal equipment acquires data and stores the data into the cache; if the sum of the length of the data queue and the length of the time-aware queue is greater than the product of the preset control parameter and the penalty factor of the preset discarded data, the discarded data volume of the terminal equipment at the current moment is calculated, so that the terminal equipment transmits the data with the data volume equal to the distributed transmission rate in the cache to the network according to the transmission rate distributed at the current moment and the sequence of the data queue in the cache, and discards the data with the data volume equal to the discarded data volume in the cache. The invention can improve the freshness of data.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data scheduling method, an apparatus, an electronic device, and a readable storage medium.
Background
With the emergence of new services such as virtual reality, real-time video monitoring and the like, the network has an increasing demand for acquiring real-time data. To meet the above data transmission demand, a fifth generation mobile communication technology 5G having a higher communication rate is rapidly developing.
Massive access equipment under the 5G network generates a huge data transmission requirement, so that the originally tense communication capacity of an access link is more obvious. Limited by the limited access link capacity, data collected by the terminal device often needs to be queued in a data buffer queue of the terminal device and awaited transmission. Since the computational effectiveness of the data will gradually decrease with the increase of time, the data waiting transmission process causes the freshness of the data to be continuously lost, and the auxiliary effect of the freshness on the system performance improvement gradually decreases. Severely outdated data may even result in compromised system performance. In addition, due to the limited length of the data buffer queue of the terminal device, the data waiting for transmission in the buffer queue can hinder the terminal device from acquiring new data to a certain extent, and the freshness of the data is further reduced.
These factors have prompted research into efficient resource scheduling mechanisms. Generally speaking, through joint scheduling of energy, frequency spectrum and computing resources, a network can adopt some technical means to optimize network configuration, and achieve a faster data transmission rate under the condition of limited system resources, thereby achieving the purpose of improving data freshness.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art: in the prior art, only how to optimize a network scheduling mechanism to improve data transmission capacity is considered, and under the condition that network resources are reasonably configured, the freshness of data is low.
Disclosure of Invention
An object of the embodiments of the present invention is to provide a data scheduling method, an apparatus, an electronic device, and a readable storage medium, so as to improve the freshness of data. The specific technical scheme is as follows:
the embodiment of the invention provides a data scheduling method, which comprises the following steps:
calculating the length of a data queue cached by the terminal equipment at the current moment according to the transmission rate distributed by the terminal equipment at the previous moment, the length of the data queue cached by the terminal equipment at the previous moment, the discarded data volume and the collected data volume;
calculating the virtual queue length of the terminal equipment at the current moment according to the virtual queue length of the terminal equipment at the previous moment, the acquired data volume and the auxiliary variable value of the terminal equipment at the previous moment, wherein the auxiliary variable value of the previous moment is determined according to the acquired data volume of the terminal equipment at the previous moment, preset control parameters and the virtual queue length of the terminal equipment at the previous moment;
calculating the time-aware queue length of the terminal device at the current moment according to the time-aware queue length of the terminal device at the previous moment, the transmission rate allocated by the terminal device at the previous moment, the data volume discarded by the terminal device at the previous moment, a preset updating rate and the data queue length of the terminal device in a cache at the previous moment, wherein the virtual queue and the time-aware queue do not occupy the storage space of the terminal device;
if the virtual queue length of the terminal equipment at the current moment is larger than the data queue length of the terminal equipment in the buffer at the current moment, the terminal equipment acquires data and stores the data into the buffer, and the data queue length of the terminal equipment in the buffer at the next moment comprises the data length acquired at the current moment;
judging whether the sum of the length of a data queue in the cache of the terminal equipment at the current moment and the length of a time awareness queue is larger than the product of the preset control parameter and a penalty factor of preset discarded data, if so, determining the discarded data volume of the terminal equipment at the current moment according to the length of the data queue in the cache of the terminal equipment at the current moment, the transmission rate distributed by the terminal equipment at the current moment and the maximum length of data collected by the terminal equipment at the historical moment, so that the terminal equipment transmits the data with the data volume equal to the distributed transmission rate in the cache to a network according to the transmission rate distributed at the current moment and the sequence of the data queues in the cache, and discarding the data with the data volume equal to the discarded in the cache.
Optionally, the calculating, according to the transmission rate allocated by the terminal device at the previous time, the data queue length of the terminal device in the buffer at the previous time, the discarded data amount, and the collected data amount, the data queue length of the terminal device in the buffer at the current time includes:
if the length of the data queue in the cache of the terminal equipment at the previous time t-1 is Q (t-1), the transmission rate allocated to the terminal equipment at the previous time t-1 is c (t-1), and the terminal equipment loses at the previous time t-1The discarded data volume is d (t-1), and the data volume collected by the terminal equipment at the previous moment t-1 is a (t-1); according to the formula: q (t) ═ Q (t-1) -c (t-1) -d (t-1)]++ a (t-1), calculating the data queue length Q (t) of the terminal device in the current time t buffer]+Indicating that it is positive.
Optionally, the calculating the virtual queue length of the terminal device at the current time according to the virtual queue length of the terminal device at the previous time, the acquired data amount, and the auxiliary variable value at the previous time includes:
if the virtual queue length of the terminal device at the previous time t-1 is G (t-1), the auxiliary variable value of the terminal device at the previous time t-1 is gamma (t-1), according to the formula:
G(t)＝[G(t-1)-a(t-1)+γ(t-1)]+calculating the virtual queue length G (t) of the terminal equipment at the current time t;
the method for determining the auxiliary variable value gamma (t-1) of the terminal equipment at the previous moment t-1 comprises the following steps:
if the data quantity which can be collected by the terminal equipment at the previous moment t-1 is A (t-1), the preset control parameter is V,
according to the formula:
gamma (t-1) is calculated.
Optionally, the calculating the time-aware queue length of the terminal device at the current time according to the time-aware queue length of the terminal device at the previous time, the transmission rate allocated by the terminal device at the previous time, the data amount discarded by the terminal device at the previous time, a preset update rate, and the data queue length of the terminal device in the buffer of the previous time includes:
if the time-aware queue length of the terminal device at the previous time t-1 is Z (t-1), presetting an update rate as follows:
Optionally, the determining, according to the length of the data queue cached by the terminal device at the current time, the transmission rate allocated by the terminal device at the current time, and the maximum length of data acquired by the terminal device at the historical time, the amount of data discarded by the terminal device at the current time includes:
if the maximum length of the data collected by the terminal equipment at the historical moment is AmaxIf the transmission rate allocated to the terminal device at the current time t is c (t), the amount of data d (t) discarded by the terminal device at the current time t is min [ q (t) -c (t), amax]。
Optionally, after the determining whether the sum of the length of the data queue buffered by the terminal device at the current time and the length of the time-aware queue is greater than the product of the preset control parameter and a penalty factor for preset discarded data, the method further includes:
and if the sum of the length of the data queue in the buffer memory of the terminal equipment at the current moment and the length of the time awareness queue is not more than the product of the preset control parameter and the penalty factor of the preset discarded data, the terminal equipment transmits the data with the data volume equal to the distributed transmission rate in the buffer memory to the network according to the transmission rate distributed at the current moment and the sequence of the data queue in the buffer memory.
The embodiment of the invention provides a data scheduling device, which comprises:
the data queue length calculation module is used for calculating the data queue length of the terminal equipment in the current buffer according to the transmission rate distributed by the terminal equipment at the previous moment, the data queue length of the terminal equipment in the buffer at the previous moment, the discarded data volume and the collected data volume;
the virtual queue length calculation module is used for calculating the virtual queue length of the terminal equipment at the current moment according to the virtual queue length of the terminal equipment at the previous moment, the acquired data volume and the auxiliary variable value at the previous moment, wherein the auxiliary variable value at the previous moment is determined according to the acquired data volume of the terminal equipment at the previous moment, preset control parameters and the virtual queue length of the terminal equipment at the previous moment;
a time-aware queue length calculating module, configured to calculate a time-aware queue length of the terminal device at a current time according to the time-aware queue length of the terminal device at the previous time, a transmission rate allocated by the terminal device at the previous time, a data amount discarded by the terminal device at the previous time, a preset update rate, and a data queue length of the terminal device in a cache at the previous time, where the virtual queue and the time-aware queue do not occupy a storage space of the terminal device;
the data acquisition module is used for enabling the terminal equipment to acquire data and store the data into a cache if the virtual queue length of the terminal equipment at the current moment is larger than the data queue length of the terminal equipment in the cache at the current moment, wherein the data queue length of the terminal equipment in the cache at the next moment comprises the data length acquired at the current moment;
the judging module is used for judging whether the sum of the data queue length and the time awareness queue length in the current time cache of the terminal equipment is larger than the product of the preset control parameter and a penalty factor of preset discarded data;
and the data transmission and discarding module is used for determining the data volume discarded by the terminal equipment at the current moment according to the length of the data queue of the terminal equipment in the buffer at the current moment, the transmission rate distributed by the terminal equipment at the current moment and the maximum length of the data acquired by the terminal equipment at the historical moment, so that the terminal equipment transmits the data volume in the buffer, which is equal to the distributed transmission rate, to the network according to the transmission rate distributed at the current moment and the sequence of the data queue in the buffer, and discards the data volume in the buffer, which is equal to the discarded data volume.
Optionally, the data queue length calculating module,specifically, if the length of a data queue in a cache of the terminal device at a previous time t-1 is Q (t-1), the transmission rate allocated by the terminal device at the previous time t-1 is c (t-1), the data volume discarded by the terminal device at the previous time t-1 is d (t-1), and the data volume acquired by the terminal device at the previous time t-1 is a (t-1); according to the formula: q (t) ═ Q (t-1) -c (t-1) -d (t-1)]++ a (t-1), calculating the data queue length Q (t) of the terminal device in the current time t buffer]+Indicating that it is positive.
Optionally, the virtual queue length calculating module is specifically configured to, if the virtual queue length of the terminal device at a previous time t-1 is G (t-1), and an auxiliary variable value of the terminal device at the previous time t-1 is γ (t-1), according to a formula:
G(t)＝[G(t-1)-a(t-1)+γ(t-1)]+calculating the virtual queue length G (t) of the terminal equipment at the current time t;
the device further comprises:
an auxiliary variable value determining module, configured to, if the data amount that can be acquired by the terminal device at the previous time t-1 is a (t-1), preset a control parameter as V,
according to the formula:
gamma (t-1) is calculated.
Optionally, the time-aware queue length calculating module is specifically configured to, if the time-aware queue length of the terminal device at the previous time t-1 is Z (t-1), preset an update rate as follows according to a formula:
Optionally, the data transmission and discarding module includes:
a discarded data amount calculation operator module used for acquiring the maximum length of data of the terminal equipment at the historical moment if the maximum length is AmaxWhen the terminal device is at the present timeThe transmission rate allocated at time t is c (t), and the data volume d (t) discarded by the terminal device at the current time t is min [ q (t) -c (t), amax]。
Optionally, the data scheduling apparatus in the embodiment of the present invention further includes:
and the data transmission module is used for enabling the terminal equipment to transmit data with the data volume equal to the distributed transmission rate in the cache to the network according to the transmission rate distributed at the current moment and the sequence of the data queues in the cache if the sum of the data queue length and the time awareness queue length of the terminal equipment in the cache at the current moment is not more than the product of the preset control parameter and the penalty factor of the preset discarded data.
An embodiment of the present invention provides an electronic device, including: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the steps of any of the above data scheduling methods when executing the program stored in the memory.
An embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements any of the steps of the data scheduling method described above.
According to the data scheduling method, the data scheduling device, the electronic equipment and the readable storage medium, the data in the terminal equipment cache is scheduled in a mode of the data queue in the virtual queue and the time awareness queue auxiliary cache, namely, the acquisition of new data and the discarding operation of old data in the terminal equipment are optimized. Because the virtual queue and the time awareness queue do not occupy the data storage space of the terminal device, under the condition of insufficient communication transmission capacity and data storage space, the freshness of data can be improved, the effectiveness of network work is further improved, and the optimal network operation environment is ensured. Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of a data scheduling method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a data migration process in the data scheduling method according to the embodiment of the present invention;
FIG. 3 is a block diagram of a data scheduling apparatus according to an embodiment of the present invention;
fig. 4 is a block diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to solve the problem of low data freshness in a cache of a terminal device, embodiments of the present invention provide a data scheduling method, an apparatus, an electronic device, and a readable storage medium, which can improve the data freshness.
First, a data scheduling method provided in an embodiment of the present invention is described in detail below.
Referring to fig. 1, fig. 1 is a flowchart of a data scheduling method according to an embodiment of the present invention, including the following steps:
s101, calculating the length of the data queue of the terminal equipment in the buffer at the current moment according to the transmission rate distributed by the terminal equipment at the previous moment, the length of the data queue of the terminal equipment in the buffer at the previous moment, the discarded data volume and the collected data volume.
In the embodiment of the present invention, the transmission rate allocated by the terminal device is determined by the network device according to the system state information reported by the terminal device, and the system state information includes: the length of the data queue in the terminal device buffer, the channel state information of the terminal device, and the like. In practical applications, a network device may allocate transmission rates to multiple terminal devices, and system state information of different terminal devices is usually different. Therefore, the network device may allocate different transmission rates to each terminal device according to the system state information of each terminal device, and the transmission rates allocated to the terminal devices at different times are different. Since the data scheduling methods of the terminal devices are the same, a description will be given here by taking one terminal device as an example.
The length of the data queue in the terminal equipment cache refers to the length of the queue of data stored in the terminal equipment cache, and the length of the data queue in the terminal equipment cache changes along with time because the terminal equipment can collect new data at different moments, can transmit the data in the cache to a network and can discard old data in the cache.
In an implementation manner of the present invention, if the length of a data queue in a cache of a terminal device at a previous time t-1 is Q (t-1), the transmission rate allocated by the terminal device at the previous time t-1 is c (t-1), the data volume discarded by the terminal device at the previous time t-1 is d (t-1), and the data volume acquired by the terminal device at the previous time t-1 is a (t-1); according to the formula: q (t) ═ Q (t-1) -c (t-1) -d (t-1)]++ a (t-1), calculating the data queue length Q (t) of the terminal device in the current time t buffer]+Indicating that it is positive.
S102, calculating the virtual queue length of the terminal equipment at the current moment according to the virtual queue length of the terminal equipment at the previous moment, the acquired data quantity and the auxiliary variable value at the previous moment, wherein the auxiliary variable value at the previous moment is determined according to the acquired data quantity of the terminal equipment at the previous moment, preset control parameters and the virtual queue length of the terminal equipment at the previous moment.
It should be noted that the virtual queue length is not the queue length of the actual data, and does not occupy the storage space of the terminal device. For example, the virtual queue is 20M long, which does not occupy 20M of data storage space, but only has a value of 20M.
The auxiliary variable value represents a queue update value of the virtual queue, and optionally, the calculation method of the auxiliary variable value includes:
if the data quantity which can be collected by the terminal equipment at the previous moment t-1 is A (t-1), the preset control parameter is V,
according to the formula:
the auxiliary variable value gamma (t-1) is calculated.
The value of the preset control parameter V may be determined according to factors such as data processing amount in an actual application scenario, for example, the larger the data processing amount is, the larger the preset control parameter V is, and no specific limitation is made herein. The amount of the data which can be collected is less than or equal to the maximum length of the data which can be collected by the terminal device at the historical time, and the amount of the data which can be collected can be determined according to factors such as the data arrival condition in the actual application scene, and is not particularly limited herein.
In one implementation manner of the present invention, if the virtual queue length of the terminal device at the previous time t-1 is G (t-1), and the auxiliary variable value of the terminal device at the previous time t-1 is γ (t-1), according to the formula:
G(t)＝[G(t-1)-a(t-1)+γ(t-1)]+and calculating the virtual queue length G (t) of the terminal equipment at the current time t.
And S103, calculating the time-conscious queue length of the terminal device at the current moment according to the time-conscious queue length of the terminal device at the previous moment, the transmission rate allocated by the terminal device at the previous moment, the data volume discarded by the terminal device at the previous moment, the preset updating rate and the data queue length cached by the terminal device at the previous moment.
It should be noted that, like the virtual queue, the time-aware queue is not the queue length of the actual data, and does not occupy the storage space of the terminal device. The preset update rate represents the minimum update rate of the time-aware queue, and the specific value of the preset update rate can be determined according to factors such as the data arrival amount in an actual application scene, and is generally 1/2 which is the maximum length of data collected by the terminal device at the historical time.
In an implementation manner of the present invention, if the time-aware queue length of the terminal device at the previous time t-1 is Z (t-1), the preset update rate is, according to the formula:
At the initial time, that is, when t is 0, the data queue length, the virtual queue length, and the time-aware queue length in the buffer may be initialized, for example, to 0, 1, or 10M. It can be seen that the data queue length, the virtual queue length, and the time-aware queue length have a time-coupled relationship, and can be iteratively calculated according to the value of the previous time to obtain the value of the current time.
And S104, if the virtual queue length of the terminal equipment at the current moment is larger than the data queue length of the terminal equipment in the buffer at the current moment, the terminal equipment acquires data and stores the data into the buffer, and the data queue length of the terminal equipment in the buffer at the next moment comprises the data length acquired at the current moment.
Specifically, if the virtual queue length of the terminal device at the current time is greater than the data queue length of the terminal device in the cache at the current time, which indicates that the data in the cache of the terminal device at the current time is less, the terminal device may collect the data and store the data in the cache. Although the data acquired at the current moment is added to the buffer, the data acquired at the current moment is only stored in the data queue of the buffer at the next moment, that is, at the current moment, the terminal device can transmit the data before the current moment and does not transmit the data acquired at the current moment.
And S105, judging whether the sum of the data queue length and the time awareness queue length in the buffer of the terminal equipment at the current moment is greater than the product of a preset control parameter and a preset penalty factor of discarded data.
In the embodiment of the present invention, the penalty factor of the preset discarded data represents the system benefit loss caused by discarded unit data amount, and can be determined according to the data freshness requirement of the system and the data importance. If the sum of the data queue length and the time awareness queue length in the current-time cache of the terminal device is greater than the product of the preset control parameter and the penalty factor of the preset discarded data, it indicates that more data are in the current-time cache of the terminal device, and the old data in the cache can be discarded according to the preset discarding strategy, and S106 is executed.
S106, determining the data volume discarded by the terminal equipment at the current moment according to the length of the data queue in the buffer of the terminal equipment at the current moment, the transmission rate distributed by the terminal equipment at the current moment and the maximum length of the data collected by the terminal equipment at the historical moment, so that the terminal equipment transmits the data volume equal to the distributed transmission rate in the buffer to the network according to the transmission rate distributed at the current moment and the sequence of the data queue in the buffer, and discards the data volume equal to the discarded data volume in the buffer.
In an implementation manner of the invention, if the maximum length of the data collected by the terminal equipment at the historical moment is AmaxIf the transmission rate allocated by the terminal device at the current time t is c (t), the data amount d (t) discarded by the terminal device at the current time t is min [ q (t) -c (t), amax]And thus the amount of data that can be discarded in the terminal device can be determined. And then, the terminal equipment firstly transmits data according to the sequence of the data queues in the buffer, and the transmitted data volume is equal to the transmission rate distributed by the terminal equipment. After the data transmission is completed, the data in the buffer equal to the discarded data amount is discarded. And at the next moment, the steps are executed again, and the data in the cache is scheduled. The data migration process of the embodiment of the invention can be seen in fig. 2, because the embodiment of the invention considers the factors of actual network link, overhead and the like, and the data acquisition and discarding operation more conforms to the needs of actual scenes, therefore,the freshness of the data can be improved to the maximum extent, and the optimal network operation environment is ensured.
Optionally, after the embodiment S105 in fig. 1, if the sum of the length of the data queue in the buffer of the terminal device at the current time and the length of the time-aware queue is not greater than the product of the preset control parameter and the penalty factor of the preset discarded data, it indicates that the data in the buffer does not need to be discarded, so that the terminal device transmits the data in the buffer, which is equal to the allocated transmission rate, to the network according to the transmission rate allocated at the current time and the sequence of the data queue in the buffer.
According to the data scheduling method, the data in the terminal equipment cache is scheduled in a mode of assisting the data queue in the cache through the virtual queue and the time awareness queue, namely, the acquisition of new data and the discarding operation of old data in the terminal equipment are optimized. Because the virtual queue and the time awareness queue do not occupy the data storage space of the terminal device, under the condition of insufficient communication transmission capacity and data storage space, the freshness of data can be improved, the effectiveness of network work is further improved, and the optimal network operation environment is ensured.
Corresponding to the foregoing method embodiment, an embodiment of the present invention provides a data scheduling apparatus, and referring to fig. 3, fig. 3 is a structural diagram of the data scheduling apparatus according to the embodiment of the present invention, including:
a data queue length calculating module 301, configured to calculate a data queue length of the terminal device in the current buffer according to a transmission rate allocated by the terminal device at a previous time, a data queue length of the terminal device in the buffer at the previous time, a discarded data amount, and a collected data amount;
a virtual queue length calculating module 302, configured to calculate a virtual queue length of the terminal device at the current time according to the virtual queue length of the terminal device at the previous time, the acquired data amount, and an auxiliary variable value at the previous time, where the auxiliary variable value at the previous time is determined according to the acquired data amount of the terminal device at the previous time, a preset control parameter, and the virtual queue length of the terminal device at the previous time;
a time-aware queue length calculating module 303, configured to calculate a time-aware queue length of the terminal device at the current time according to the time-aware queue length of the terminal device at the previous time, a transmission rate allocated by the terminal device at the previous time, a data amount discarded by the terminal device at the previous time, a preset update rate, and a data queue length buffered by the terminal device at the previous time, where the virtual queue and the time-aware queue do not occupy a storage space of the terminal device;
the data acquisition module 304 is configured to, if the virtual queue length of the terminal device at the current time is greater than the data queue length of the terminal device in the current-time cache, enable the terminal device to acquire data and store the data in the cache, where the data queue length of the terminal device in the next-time cache includes the data length acquired at the current time;
a judging module 305, configured to judge whether a sum of a data queue length and a time-aware queue length cached by the terminal device at the current time is greater than a product of a preset control parameter and a penalty factor of preset discarded data;
and a data transmission and discarding module 306, configured to determine, when the determination result of the determining module is yes, a data amount discarded by the terminal device at the current time according to the length of the data queue in the buffer at the current time, the transmission rate allocated by the terminal device at the current time, and the maximum length of data acquired by the terminal device at the historical time, so that the terminal device transmits, according to the transmission rate allocated at the current time and according to the sequence of the data queues in the buffer, data in the buffer, which is equal to the allocated transmission rate, to the network, and discards data in the buffer, which is equal to the discarded data amount.
The data scheduling device of the embodiment of the invention schedules the data in the terminal equipment cache in a mode of assisting the data queue in the cache through the virtual queue and the time awareness queue, namely, optimizes the acquisition of new data and the discarding operation of old data in the terminal equipment. Because the virtual queue and the time awareness queue do not occupy the data storage space of the terminal device, under the condition of insufficient communication transmission capacity and data storage space, the freshness of data can be improved, the effectiveness of network work is further improved, and the optimal network operation environment is ensured.
Optionally, the data queue length calculating module is specifically configured to, if the data queue length in the cache of the terminal device at a previous time t-1 is Q (t-1), the transmission rate allocated by the terminal device at the previous time t-1 is c (t-1), the data amount discarded by the terminal device at the previous time t-1 is d (t-1), and the data amount acquired by the terminal device at the previous time t-1 is a (t-1); according to the formula: q (t) ═ Q (t-1) -c (t-1) -d (t-1)]++ a (t-1), calculating the data queue length Q (t) of the terminal device in the current time t buffer]+Indicating that it is positive.
Optionally, the virtual queue length calculating module is specifically configured to, if the virtual queue length of the terminal device at a previous time t-1 is G (t-1), and an auxiliary variable value of the terminal device at the previous time t-1 is γ (t-1), according to a formula:
G(t)＝[G(t-1)-a(t-1)+γ(t-1)]+calculating the virtual queue length G (t) of the terminal equipment at the current time t;
the data scheduling device of the embodiment of the invention further comprises:
an auxiliary variable value determining module, which is used for presetting a control parameter as V if the collectable data volume of the terminal equipment at the previous moment t-1 is A (t-1),
according to the formula:
gamma (t-1) is calculated.
Optionally, the time-aware queue length calculating module is specifically configured to, if the time-aware queue length of the terminal device at the previous time t-1 is Z (t-1), preset an update rate as follows according to a formula:
Optionally, the data transmission and discarding module includes:
a discarded data amount calculation sub-module for calculating the amount of the discarded data if the terminal device is in the historical momentMaximum length of data collected is AmaxIf the transmission rate allocated by the terminal device at the current time t is c (t), the data amount d (t) discarded by the terminal device at the current time t is min [ q (t) -c (t), amax]。
Optionally, the data scheduling apparatus in the embodiment of the present invention further includes:
and the data transmission module is used for enabling the terminal equipment to transmit data with the data volume equal to the distributed transmission rate in the cache to the network according to the transmission rate distributed at the current moment and the sequence of the data queues in the cache if the sum of the data queue length and the time awareness queue length of the terminal equipment in the cache at the current moment is not more than the product of the preset control parameter and the penalty factor of the preset discarded data.
An embodiment of the present invention further provides an electronic device, referring to fig. 4, where fig. 4 is a structural diagram of the electronic device according to the embodiment of the present invention, including: the system comprises a processor 401, a communication interface 402, a memory 403 and a communication bus 404, wherein the processor 401, the communication interface 402 and the memory 403 complete mutual communication through the communication bus 404;
a memory 403 for storing a computer program;
the processor 401 is configured to implement the steps of any of the data scheduling methods described above when executing the program stored in the memory 403.
It should be noted that the communication bus 404 mentioned in the electronic device may be a PCI (peripheral component Interconnect) bus, an EISA (Extended Industry standard architecture) bus, or the like. The communication bus 404 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 4, but this does not indicate only one bus or one type of bus.
The communication interface 402 is used for communication between the above-described electronic apparatus and other apparatuses.
The Memory 403 may include a RAM (Random Access Memory) and may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The processor 401 described above may be a general-purpose processor including: a CPU (Central Processing Unit), an NP (Network Processor), and the like; but also a DSP (Digital signal processing), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
In the electronic device according to the embodiment of the present invention, the processor executes the program stored in the memory, and schedules the data in the buffer of the terminal device in a manner of using the virtual queue and the time-aware queue to assist the data queue in the buffer, that is, optimizes the operation of acquiring new data and discarding old data in the terminal device. Because the virtual queue and the time awareness queue do not occupy the data storage space of the terminal device, under the condition of insufficient communication transmission capacity and data storage space, the freshness of data can be improved, the effectiveness of network work is further improved, and the optimal network operation environment is ensured.
The embodiment of the invention also provides a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of any data scheduling method are realized.
When the instructions stored in the computer-readable storage medium of the embodiment of the present invention run on the computer, the data in the terminal device cache is scheduled in a manner of a data queue in the virtual queue and the time-aware queue auxiliary cache, that is, the operations of acquiring new data and discarding old data in the terminal device are optimized. Because the virtual queue and the time awareness queue do not occupy the data storage space of the terminal device, under the condition of insufficient communication transmission capacity and data storage space, the freshness of data can be improved, the effectiveness of network work is further improved, and the optimal network operation environment is ensured.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the device, the electronic device and the readable storage medium embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the partial description of the method embodiments.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (8)
1. A method for scheduling data, the method comprising:
calculating the length of a data queue cached by the terminal equipment at the current moment according to the transmission rate distributed by the terminal equipment at the previous moment, the length of the data queue cached by the terminal equipment at the previous moment, the discarded data volume and the collected data volume;
calculating the virtual queue length of the terminal equipment at the current moment according to the virtual queue length of the terminal equipment at the previous moment, the acquired data volume and the auxiliary variable value of the terminal equipment at the previous moment, wherein the auxiliary variable value of the previous moment is determined according to the acquired data volume of the terminal equipment at the previous moment, preset control parameters and the virtual queue length of the terminal equipment at the previous moment;
calculating the time-aware queue length of the terminal device at the current moment according to the time-aware queue length of the terminal device at the previous moment, the transmission rate allocated by the terminal device at the previous moment, the data volume discarded by the terminal device at the previous moment, a preset updating rate and the data queue length of the terminal device in a cache at the previous moment, wherein the virtual queue and the time-aware queue do not occupy the storage space of the terminal device;
if the virtual queue length of the terminal equipment at the current moment is larger than the data queue length of the terminal equipment in the buffer at the current moment, the terminal equipment acquires data and stores the data into the buffer, and the data queue length of the terminal equipment in the buffer at the next moment comprises the data length acquired at the current moment;
judging whether the sum of the length of a data queue in the cache of the terminal equipment at the current moment and the length of a time awareness queue is greater than the product of the preset control parameter and a penalty factor of preset discarded data, if so, determining the discarded data volume of the terminal equipment at the current moment according to the length of the data queue in the cache of the terminal equipment at the current moment, the transmission rate distributed by the terminal equipment at the current moment and the maximum length of data collected by the terminal equipment at the historical moment, so that the terminal equipment transmits the data with the data volume equal to the distributed transmission rate in the cache to a network according to the transmission rate distributed at the current moment and the sequence of the data queues in the cache, and discarding the data with the data volume equal to the discarded volume in the cache; the penalty factor of the preset discarded data represents the system benefit loss caused by the discarded unit data amount;
the calculating the virtual queue length of the terminal device at the current time according to the virtual queue length of the terminal device at the previous time, the acquired data amount and the auxiliary variable value at the previous time includes:
if the virtual queue length of the terminal device at the previous time t-1 is G (t-1), the auxiliary variable value of the terminal device at the previous time t-1 is gamma (t-1), according to the formula:
G(t)＝[G(t-1)-a(t-1)+γ(t-1)]+calculating the virtual queue length G (t) of the terminal equipment at the current time t; wherein a (t-1) is the data volume acquired by the terminal equipment at the previous moment t-1; []+Indicating to take the positive value; the virtual queue length of the terminal equipment at the initial time is 0, or 1M, or 10M;
the method for determining the auxiliary variable value gamma (t-1) of the terminal equipment at the previous moment t-1 comprises the following steps:
if the data quantity which can be collected by the terminal equipment at the previous moment t-1 is A (t-1), the preset control parameter is V,
according to the formula:
calculating gamma (t-1);
the calculating the time-aware queue length of the terminal device at the current time according to the time-aware queue length of the terminal device at the previous time, the transmission rate allocated by the terminal device at the previous time, the data amount discarded by the terminal device at the previous time, a preset update rate, and the data queue length of the terminal device in the buffer at the previous time includes:
if the time-aware queue length of the terminal device at the previous time t-1 is Z (t-1), presetting an update rate as follows:
2. The data scheduling method of claim 1, wherein the calculating the length of the data queue buffered by the terminal device at the current time according to the transmission rate allocated by the terminal device at the previous time, the length of the data queue buffered by the terminal device at the previous time, the discarded data amount, and the collected data amount comprises:
if the length of a data queue in a cache of the terminal device at the previous time t-1 is Q (t-1), the transmission rate allocated to the terminal device at the previous time t-1 is c (t-1), the data volume discarded by the terminal device at the previous time t-1 is d (t-1), and the data volume acquired by the terminal device at the previous time t-1 is a (t-1); according to the formula: q (t) ═ Q (t-1) -c (t-1) -d (t-1)]++ a (t-1), calculating the data queue length Q (t) of the terminal device in the current time t buffer]+Indicating that it is positive.
3. The data scheduling method of claim 1, wherein the determining the amount of data discarded by the terminal device at the current time according to the length of the data queue buffered by the terminal device at the current time, the transmission rate allocated by the terminal device at the current time, and the maximum length of data collected by the terminal device at the historical time comprises:
if the maximum length of the data collected by the terminal equipment at the historical moment is AmaxIf the transmission rate allocated to the terminal device at the current time t is c (t), the amount of data d (t) discarded by the terminal device at the current time t is min [ q (t) -c (t), amax](ii) a And Q (t) is the length of the data queue in the buffer of the terminal equipment at the current moment t.
4. The data scheduling method according to claim 1, wherein after the determining whether the sum of the data queue length buffered by the terminal device at the current time and the time-aware queue length is greater than the product of the preset control parameter and a preset penalty factor for discarding data, the method further comprises:
and if the sum of the length of the data queue in the buffer memory of the terminal equipment at the current moment and the length of the time awareness queue is not more than the product of the preset control parameter and the penalty factor of the preset discarded data, the terminal equipment transmits the data with the data volume equal to the distributed transmission rate in the buffer memory to the network according to the transmission rate distributed at the current moment and the sequence of the data queue in the buffer memory.
5. An apparatus for scheduling data, the apparatus comprising:
the data queue length calculation module is used for calculating the data queue length of the terminal equipment in the current buffer according to the transmission rate distributed by the terminal equipment at the previous moment, the data queue length of the terminal equipment in the buffer at the previous moment, the discarded data volume and the collected data volume;
the virtual queue length calculation module is used for calculating the virtual queue length of the terminal equipment at the current moment according to the virtual queue length of the terminal equipment at the previous moment, the acquired data volume and the auxiliary variable value at the previous moment, wherein the auxiliary variable value at the previous moment is determined according to the acquired data volume of the terminal equipment at the previous moment, preset control parameters and the virtual queue length of the terminal equipment at the previous moment;
a time-aware queue length calculating module, configured to calculate a time-aware queue length of the terminal device at a current time according to the time-aware queue length of the terminal device at the previous time, a transmission rate allocated by the terminal device at the previous time, a data amount discarded by the terminal device at the previous time, a preset update rate, and a data queue length of the terminal device in a cache at the previous time, where the virtual queue and the time-aware queue do not occupy a storage space of the terminal device;
the data acquisition module is used for enabling the terminal equipment to acquire data and store the data into a cache if the virtual queue length of the terminal equipment at the current moment is larger than the data queue length of the terminal equipment in the cache at the current moment, wherein the data queue length of the terminal equipment in the cache at the next moment comprises the data length acquired at the current moment;
the judging module is used for judging whether the sum of the data queue length and the time awareness queue length in the current time cache of the terminal equipment is larger than the product of the preset control parameter and a penalty factor of preset discarded data; the penalty factor of the preset discarded data represents the system benefit loss caused by the discarded unit data amount;
the data transmission and discarding module is used for determining the data volume discarded by the terminal equipment at the current moment according to the length of the data queue of the terminal equipment in the buffer at the current moment, the transmission rate distributed by the terminal equipment at the current moment and the maximum length of data collected by the terminal equipment at the historical moment when the judgment result of the judgment module is yes, so that the terminal equipment transmits the data volume in the buffer, which is equal to the distributed transmission rate, to the network according to the transmission rate distributed at the current moment and the sequence of the data queue in the buffer, and discards the data volume in the buffer, which is equal to the discarded data volume;
the virtual queue length calculating module is specifically configured to, if the virtual queue length of the terminal device at a previous time t-1 is G (t-1), and an auxiliary variable value of the terminal device at the previous time t-1 is γ (t-1), according to a formula:
G(t)＝[G(t-1)-a(t-1)+γ(t-1)]+calculating the virtual queue length G (t) of the terminal equipment at the current time t; wherein a (t-1) is the data volume acquired by the terminal equipment at the previous moment t-1; []+Indicating to take the positive value; the virtual queue length of the terminal equipment at the initial time is 0, or 1M, or 10M;
the device further comprises:
an auxiliary variable value determining module, configured to, if the data amount that can be acquired by the terminal device at the previous time t-1 is a (t-1), preset a control parameter as V,
according to the formula:
calculating gamma (t-1);
the time-aware queue length calculating module is specifically configured to, if the time-aware queue length of the terminal device at the previous time t-1 is Z (t-1), preset an update rate as follows according to a formula:
6. The data scheduling apparatus according to claim 5, wherein the data queue length calculating module is specifically configured to, if the data queue length in the buffer of the terminal device at a previous time t-1 is Q (t-1), the transmission rate allocated to the terminal device at the previous time t-1 is c (t-1), the amount of data discarded by the terminal device at the previous time t-1 is d (t-1), and the amount of data collected by the terminal device at the previous time t-1 is a (t-1); according to the formula: q (t) ═ Q (t-1) -c (t-1) -d (t-1)]++ a (t-1), calculating the data queue length Q (t) of the terminal device in the current time t buffer]+Indicating that it is positive.
7. An electronic device, comprising: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the steps of the data scheduling method according to any one of claims 1 to 4 when executing the program stored in the memory.
8. A computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the data scheduling method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910237431.2A CN109981487B (en) | 2019-03-27 | 2019-03-27 | Data scheduling method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910237431.2A CN109981487B (en) | 2019-03-27 | 2019-03-27 | Data scheduling method and device, electronic equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109981487A CN109981487A (en) | 2019-07-05 |
| CN109981487B true CN109981487B (en) | 2020-10-27 |
Family
ID=67080912
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910237431.2A Active CN109981487B (en) | 2019-03-27 | 2019-03-27 | Data scheduling method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109981487B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114598663A (en) * | 2020-11-30 | 2022-06-07 | 深圳富桂精密工业有限公司 | Data transmission method and system |
| CN116708317A (en) * | 2022-09-27 | 2023-09-05 | 荣耀终端有限公司 | Data packet MTU adjustment method and device and terminal equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017142545A1 (en) * | 2016-02-19 | 2017-08-24 | Hewlett Packard Enterprise Development Lp | Context monitor services |
| CN109347763A (en) * | 2018-09-11 | 2019-02-15 | 北京邮电大学 | A kind of data dispatching method based on length of data queue, apparatus and system |
| CN109343797A (en) * | 2018-09-25 | 2019-02-15 | 郑州云海信息技术有限公司 | A kind of data cached transmission method, system and associated component |
| CN109362103A (en) * | 2018-10-30 | 2019-02-19 | 维沃移动通信有限公司 | A kind of data cache method and terminal device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9219693B2 (en) * | 2012-02-22 | 2015-12-22 | Marvell World Trade Ltd. | Network devices with time aware medium access controller |
| CN106254180B (en) * | 2016-08-10 | 2019-06-21 | 杭州熠芯科技有限公司 | Data transmission method and device |
| EP3451591B1 (en) * | 2017-09-01 | 2020-03-18 | Siemens Aktiengesellschaft | Method of operating a communication network in a ring topology, and such a communication network |
-
2019
- 2019-03-27 CN CN201910237431.2A patent/CN109981487B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017142545A1 (en) * | 2016-02-19 | 2017-08-24 | Hewlett Packard Enterprise Development Lp | Context monitor services |
| CN109347763A (en) * | 2018-09-11 | 2019-02-15 | 北京邮电大学 | A kind of data dispatching method based on length of data queue, apparatus and system |
| CN109343797A (en) * | 2018-09-25 | 2019-02-15 | 郑州云海信息技术有限公司 | A kind of data cached transmission method, system and associated component |
| CN109362103A (en) * | 2018-10-30 | 2019-02-19 | 维沃移动通信有限公司 | A kind of data cache method and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109981487A (en) | 2019-07-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110417650A (en) | Multilink data distribution method, device and electronic equipment | |
| CN109981487B (en) | Data scheduling method and device, electronic equipment and readable storage medium | |
| CN113141321B (en) | Data transmission method based on edge calculation and electronic equipment | |
| US20110176418A1 (en) | Adaptive traffic management via analytics based volume reduction | |
| CN108234149B (en) | Network request management method and device | |
| CN104734985A (en) | Data receiving flow control method and system | |
| WO2020026018A1 (en) | Method for downloading file, device, apparatus/terminal/ server, and storage medium | |
| CN110019386A (en) | A kind of stream data processing method and equipment | |
| CN109995664B (en) | Method, equipment and system for transmitting data stream | |
| EP2933963A1 (en) | Offload method, device and system | |
| CN110098976B (en) | Network parameter measuring method and device, computer equipment and storage medium | |
| CN111726379B (en) | Communication method and device | |
| CN112995048A (en) | Blocking control and scheduling fusion method for data center network and terminal equipment | |
| CN112491736B (en) | Congestion control method and device, electronic equipment and storage medium | |
| US20140281087A1 (en) | Moderated completion signaling | |
| CN113453285B (en) | Resource adjusting method, device and storage medium | |
| CN109428901B (en) | Message processing method and message processing device | |
| CN112230880B (en) | Data transmission control method and device, FPGA and medium | |
| CN114205310A (en) | Data transmission method and device based on time-sensitive network and electronic equipment | |
| CN109347763B (en) | Data scheduling method, device and system based on data queue length | |
| CN106330752B (en) | Method and equipment for determining receiving window in TCP flow control | |
| JP2007074218A (en) | Program, device, and method for controlling packet transmission | |
| US10601444B2 (en) | Information processing apparatus, information processing method, and recording medium storing program | |
| KR20210137472A (en) | Pipeline arithmetic unit, programmable logic controller, and execution method of pipelined processing | |
| CN113806072B (en) | Data processing method and system based on edge calculation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |