CN109413730B

CN109413730B - Power adjustment method, access controller, system and storage medium

Info

Publication number: CN109413730B
Application number: CN201811535083.9A
Authority: CN
Inventors: 林鹏岳
Original assignee: Ruijie Networks Co Ltd
Current assignee: Ruijie Networks Co Ltd
Priority date: 2018-12-14
Filing date: 2018-12-14
Publication date: 2022-03-18
Anticipated expiration: 2038-12-14
Also published as: CN109413730A

Abstract

The embodiment of the application provides a power adjustment method, an access controller, a system and a storage medium. In the embodiment of the application, a power adjustment period is set for an AP with co-frequency interference, and when the power adjustment period arrives, a target Q value corresponding to the current power of each AP is determined according to a Q value table respectively corresponding to each AP with co-frequency interference, wherein the Q value table is used for describing the corresponding relation between the power level of the AP and the power adjustment mode; and then, determining the new power of each AP according to the power adjustment mode corresponding to the target Q value corresponding to each AP, and respectively transmitting each new power to the APs, so that the APs can adjust the transmitting power of the APs to the new power. The power adjustment mode provided by the embodiment of the application can dynamically adjust the transmitting power of the AP when co-channel interference exists between the APs, thereby being beneficial to reducing the co-channel interference between the APs.

Description

Power adjustment method, access controller, system and storage medium

Technical Field

The present application relates to the field of wireless communications technologies, and in particular, to a power adjustment method, an access controller, a system, and a storage medium.

Background

With the continuous expansion of Wireless Local Area Network (WLAN) and the continuous development of WLAN technology, the traditional Access Point (AP) management mode cannot meet the user requirement. The fat AP mode needs to manage each AP one by one, and the efficiency is low; attacks and interferences existing in the whole wireless network system cannot be checked, and timely adjustment cannot be carried out, so that the network performance is influenced. Therefore, in the current wireless network construction, a thin AP management mode is widely adopted, and an Access Controller (AC) performs unified configuration management on a plurality of APs.

In the thin AP management mode, co-channel interference may exist between multiple APs. Due to the limited number of wireless channels, the conventional channel allocation method is adopted in a high-density coverage area, and the co-channel interference among a plurality of APs cannot be effectively reduced.

Disclosure of Invention

Aspects of the present disclosure provide a power adjustment method, an access controller, a system, and a storage medium for dynamically adjusting transmit power of APs in a WLAN, thereby reducing channel interference between APs.

The embodiment of the application provides a power adjustment method, which is suitable for an Access Controller (AC), and the method comprises the following steps: when the current power adjustment period is reached, determining a target Q value corresponding to the current power of a first AP according to a Q value table corresponding to the first AP and used for describing the corresponding relation between the power level and the power adjustment mode; determining the new power of the first AP according to the power adjustment mode corresponding to the target Q value; sending the new power to the first AP so that the first AP can adjust the transmitting power to the new power; wherein the first AP is any AP with co-channel interference.

An embodiment of the present application further provides an access controller, including: a memory, a processor, and a communications component; the memory is used for storing a Q value table and a computer program which describe the corresponding relation between the power level of the first AP and the power adjustment mode; the processor is coupled to the memory for executing the computer program for: when the current power adjustment period is reached, determining a target Q value corresponding to the current power of a first AP according to a Q value table corresponding to the first AP; determining the new power of the first AP according to the power adjustment mode corresponding to the target Q value; sending the new power to the first AP through the communication assembly so that the first AP can adjust the transmitting power to the new power; wherein the first AP is any AP with co-channel interference.

An embodiment of the present application further provides a power adjustment system, including: the method comprises the steps that an AC and a plurality of APs managed by the AC and having same frequency interference exist; wherein the AC is to: when the current power adjustment period is reached, determining a target Q value corresponding to the current power of a first AP according to a Q value table corresponding to the first AP and used for describing the corresponding relation between the power level and the power adjustment mode; determining the new power of the first AP according to the power adjustment mode corresponding to the target Q value; sending the new power to the first AP so that the first AP can adjust the transmitting power to the new power; the first AP is used for receiving the new power sent by the AC and adjusting the transmitting power of the first AP to the new power; wherein the first AP is any one of the plurality of APs.

Embodiments of the present application also provide a computer-readable storage medium storing computer instructions, which when executed by one or more processors, cause the one or more processors to perform the steps of the power adjustment method.

In the embodiment of the application, a power adjustment period is set for an AP with co-frequency interference, and when the power adjustment period arrives, a target Q value corresponding to the current power of each AP is determined according to a Q value table respectively corresponding to each AP with co-frequency interference, wherein the Q value table is used for describing the corresponding relation between the power level of the AP and the power adjustment mode; and then, determining the new power of each AP according to the power adjustment mode corresponding to the target Q value corresponding to each AP, and respectively transmitting each new power to the APs, so that the APs can adjust the transmitting power of the APs to the new power. The power adjustment mode provided by the embodiment of the application can dynamically adjust the transmitting power of the AP when co-channel interference exists between the APs, thereby being beneficial to reducing the co-channel interference between the APs.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:

fig. 1a is a schematic structural diagram of a power adjustment system according to an embodiment of the present disclosure;

FIGS. 1b and 1c are schematic diagrams of Q-value tables provided in embodiments of the present application;

fig. 2 is a schematic flowchart of a power adjustment method according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of an AC according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Under thin AP management mode, the existing channel allocation mode can not effectively reduce the co-channel interference between a plurality of APs, and aiming at the technical problem, the embodiment of the application provides a solution, and the basic idea is as follows: setting a power adjustment period aiming at the AP with co-frequency interference, and determining a target Q value corresponding to the current power of each AP according to a Q value table respectively corresponding to each AP with co-frequency interference when the power adjustment period is reached, wherein the Q value table is used for describing the corresponding relation between the power level of the AP and the power adjustment mode; and then, determining the new power of each AP according to the power adjustment mode corresponding to the target Q value corresponding to each AP, and respectively transmitting each new power to the APs, so that the APs can adjust the transmitting power of the APs to the new power. The power adjustment mode provided by the embodiment of the application can dynamically adjust the transmitting power of the AP when co-channel interference exists between the APs, thereby being beneficial to reducing the co-channel interference between the APs.

The technical solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.

Fig. 1a is a schematic structural diagram of a power adjustment system according to an embodiment of the present disclosure. As shown in fig. 1a, the system comprises: the method comprises the following steps that an AC10a and a plurality of APs 10b with same frequency interference exist; at least two APs 10b are managed by the AC10 a. The number and implementation of the AC and AP shown in fig. 1a are exemplary and not limiting. The plurality of units herein means at least two or more.

In this embodiment, the AC10a and at least two APs 10b managed by the AC and having co-channel interference adopt wireless connection. In this embodiment, if the AC10a and the AP 10b are communicatively connected through a mobile network, the network format of the mobile network may be any one of 2G (gsm), 2.5G (gprs), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G + (LTE +), WiMax, and the like. In addition, the AC10a may also be communicatively coupled to the AP 10b via bluetooth, WiFi, infrared, etc.

In this embodiment, a listening period may be set on a plurality of APs managed by the AC10a, and a timer or counter may be started to count the listening period. When the listening period arrives, each AP of the plurality of APs managed by the AC10a starts scanning, and when the current listening period ends, the signal strengths of other AP signals and other AP signals in the channel scanning information scanned in the current listening period are sent to the AC10 a. It should be noted that for multiple APs under the same AC management, each AP can only listen to the signals of other APs occupying the same channel and the signal strength of these APs. Therefore, other APs in the channel scanning information reported by each AP to the AC10a occupy the same channel as themselves.

Accordingly, a co-channel interference detection period may be set on AC10a and a timer or counter may be started to time the co-channel interference detection period. When the same frequency interference detection period arrives, determining which APs have the same frequency interference according to the channel scanning information reported by the managed APs received in the current same frequency interference detection period.

Optionally, in order to improve the accuracy of whether co-channel interference exists between the AC10a and multiple APs and which APs have co-channel interference detection, the co-channel interference detection period may be set equal to the listening period.

The process of power adjustment by the AC10a is the same for each of the plurality of APs that the AC10a manages. The following description will exemplarily be given by taking a first AP among a plurality of APs managed by the AC10a as an example. The first AP is any one of a plurality of APs managed by the AC10 a.

The first AP reports the channel scanning information scanned by the first AP in the current listening period to the AC10a, and the AC10a determines other APs having co-channel interference with the first AP according to the channel scanning information reported by the first AP.

Optionally, the AC10a may obtain, from the channel scanning information reported by the first AP, signal strengths of other APs occupying the same channel as the first AP, compare the obtained signal strengths of the other APs with a preset strength threshold, and determine, as the other APs having co-channel interference with the first AP, that is, determine at least two APs having co-channel interference.

Further, a power adjustment period may be set on the AC10a and a timer or counter may be started to time the power adjustment period. Optionally, in order to implement dynamic adjustment of the power of the AP with co-channel interference, the power adjustment period may be less than or equal to the co-channel interference detection period. When the power adjustment period is equal to the co-channel interference detection period, the change of the network environment of the power adjustment system can be periodically detected, and according to the change of the network environment, which APs have co-channel interference in the current co-channel interference detection period can be timely determined. When the power adjustment period is less than the same frequency interference detection period, the power adjustment can be performed for multiple times on at least two APs with same frequency interference in the same frequency interference detection period, so that the dynamic adjustment of the AP transmitting power in the current same frequency interference detection period is realized, and the same frequency interference between the APs is reduced.

Further, when the power adjustment period is smaller than the same frequency interference detection period, the duration of the same frequency interference detection period may be set to be M times of the power adjustment period, where M is a positive integer, and a specific value thereof may be flexibly set according to an actual situation, for example, M may be 2, 10, 100, 1000, and the like, which is not limited herein.

The AC10a performs the same adjustment method for the APs with co-channel interference in each power adjustment period, and now, taking the current power adjustment period as an example, performs an embodiment description on the power adjustment method for any AP with co-channel interference. For convenience of description, any AP in which co-channel interference exists is defined as the first AP described above.

In the embodiment of the present application, a Q value table for describing a correspondence relationship between the power level of the AP and the power adjustment manner may be preset in the AC10 a. Wherein, each Q value corresponds to a power grade and a power adjustment mode. The power adjustment manner in the Q-value table is used to describe which manner the power of the AP can be adjusted in the corresponding Q-value. In this embodiment, there are various setting manners of the power level and the power adjustment manner of the Q-value table. The following is an exemplary description:

embodiment 1: as shown in fig. 1b, the power levels may be set as level numbers, and each power level corresponds to a power range, where the power ranges of different power levels are different and have no cross; accordingly, the power adjustment manner may be set as to which power level the power of the AP is adjusted, for example, one level, two levels, and the like may be adjusted upwards; or adjust one level, two levels, etc. downward; or the power remains constant, etc. The number of power levels in the Q value table and the number of types of power adjustment modes can be flexibly set according to actual conditions. For example, the power level of the AP may be set to 5 levels in order from large to small or from small to large, and the power adjustment manner may be set to 3 adjustment manners such as power up by K levels, power down by K levels, or the like, but is not limited thereto, where K is a positive integer and does not exceed all the power level numbers.

Embodiment 2: as shown in fig. 1c, the power level can be set to power ranges, each power range being different and having no crossover; correspondingly, the power adjustment mode may be set to adjust the power of the AP by a specific value, that is, to set an adjusted power step; for example, it can be set to adjust the AP power up by how much power, down by how much power, or remain the same. For example, P milliwatts adjusted up, P milliwatts adjusted down, or left unchanged as shown in FIG. 1c, where P is a positive number.

Based on the Q value table, in this embodiment, when the current power adjustment period arrives, the AC10a may determine a target Q value corresponding to the current power of the first AP according to the Q value table corresponding to the first AP; determining the new power of the first AP according to the power adjustment mode corresponding to the target Q value; and then, sending the new power to the first AP so that the first AP can adjust the transmitting power to the new power. Correspondingly, the first AP adjusts the own transmission power to the new power to transmit signals.

In this embodiment, a power adjustment period is set on the AC, and for the APs managed by the AC and having co-frequency interference, when the power adjustment period arrives, target Q values corresponding to the current powers of the APs are determined according to Q value tables corresponding to the APs having co-frequency interference, respectively; and then, according to the power adjustment mode corresponding to the target Q value corresponding to each AP, determining the new power of each AP, and sending the new power to each AP with co-frequency interference, so that the APs can adjust the transmitting power of the APs to the new power, and further, when the co-frequency interference exists among the APs, the transmitting power of the APs can be dynamically adjusted, and further, the reduction of the co-frequency interference among the APs is facilitated.

Alternatively, based on the Q-value table shown in fig. 1b and fig. 1c, when the current power adjustment period arrives, the Q-value table of the first AP may be queried according to the current power of the first AP to determine the target power level to which the current power of the first AP belongs. Further, as can be seen from the Q-value tables shown in fig. 1b and 1c, each power level corresponds to a plurality of power adjustment methods, i.e., a plurality of Q-values. Considering that the Q value of the AP is used to measure the advantage of adopting a corresponding power adjustment mode under the current power level, it is common to say how well the power adjustment mode corresponding to the Q value is adopted. The larger the Q value is, the more advantageous the power adjustment mode corresponding to the Q value is, that is, the larger the Q value is, the power adjustment mode corresponding to the AP is adopted to adjust the power of the AP, and the AP is expected to obtain a larger reward R. Wherein the reward R will be described in detail below and will not be described in detail herein. Based on this, the largest Q value may be selected from among a plurality of Q values corresponding to the target power class to which the current power of the first AP belongs, as the target Q value corresponding to the current power of the first AP.

Further, if there are a plurality of maximum Q values among the Q values corresponding to the target level power of the first AP, any one of the plurality of maximum Q values may be selected as the target Q value corresponding to the current power of the first AP. And then, determining new transmitting power of the first AP, namely the new power according to the power adjustment mode corresponding to the target Q value.

It should be noted that, in order to improve the accuracy of adjusting the transmission power of APs with co-channel interference and further reduce the co-channel interference between the APs, in the embodiment of the present application, a deep learning method may be adopted to periodically update the Q value table. The deep learning method includes, but is not limited to: q-learning (Q-learning) algorithm, State-Action-rewarded-Action (SARSA) algorithm, Deep Q-Network (DQN) algorithm, Deep Deterministic Policy Gradient (DDPG) algorithm, and the like. The Q-learning algorithm is used as an example to illustrate the Q-value table updating process.

When the Q-value table of the first AP is updated by using the Q-learning algorithm, after the AC10a issues the new power to the first AP, the first AP adjusts its transmission power to the new power, and the channel parameters counted in the current power adjustment period by the first AP and other APs having co-frequency interference with the first AP are sent to the AC10a when the current power adjustment period is finished, that is, when the next power adjustment period arrives. Correspondingly, the AC10a receives the channel parameters reported by each AP, and queries the Q-value table corresponding to the current power adjustment period according to the new power of the first AP determined by the current power adjustment period, thereby determining the candidate target Q-value corresponding to the new power. The candidate target Q value corresponding to the new power of the first AP is a target Q value according to which the new power is adjusted when the next power adjustment period arrives, and is referred to as a candidate target Q value to be distinguished from the target Q value in the current power adjustment period. For a method for determining the candidate target Q value corresponding to the new power, reference may be made to the method for determining the target Q value corresponding to the current power of the first AP in the foregoing embodiment, and details are not repeated here.

Further, the AC10a may calculate an intermediate Q value according to the received channel parameter, the target Q value corresponding to the current power of the first AP, and the candidate target Q value corresponding to the new power, and replace the target Q value corresponding to the current power of the first AP in the current power cycle with the intermediate Q value in the Q value table of the first AP, so as to complete the update of the Q value table of the first AP one time.

Optionally, the channel parameters acquired by the first AP and other APs having co-channel interference with the first AP may include throughput and channel utilization, that is, the first AP and other APs having co-channel interference with the first AP may send the throughput and channel utilization counted by the first AP and other APs having co-channel interference with the first AP in the current power adjustment period to the AC10a when the current power adjustment period is ended. Optionally, the first AP may also count average throughput and average channel utilization in the current power adjustment period.

Accordingly, air interface resources of the channel are shared among the APs, and the throughput and the occupation of the channel of the AP may affect the AP with co-channel interference. Therefore, when calculating the Q value of the first AP, the AC10a cannot only consider the throughput and the channel utilization rate of the first AP itself, and also needs to comprehensively consider the throughput and the channel utilization rate of other APs having co-channel interference with the first AP, so as to reduce the co-channel interference and ensure the throughput of the entire network. Based on this, when the AC10a calculates the intermediate Q value, it may calculate the sum of respective throughputs within the current power adjustment period, which are reported by the first AP and other APs having co-channel interference with the first AP, and calculate the sum of respective channel utilization rates, which are reported by the first AP and other APs having co-channel interference with the first AP; and then, weighting the sum of the throughputs and the sum of the channel utilization rates to obtain a reward value R. The sum of the throughputs of all APs with same frequency interference and the reward value R are in a positive feedback relation; the sum of the channel utilization rates of all APs with same frequency interference is inversely proportional to the reward value R. Further, the weight of the sum of the throughputs of the APs with the same frequency interference and the sum of the channel utilization rates can be flexibly set according to the actual situation. Optionally, the contribution of throughput to reward value R is greater than the contribution of channel utilization to reward value R, i.e. the weight of the sum of throughputs is greater than the weight of the sum of channel utilization.

Optionally, when the channel parameter is the average throughput and the average channel utilization, the AC10a calculates the reward value R according to the average throughput and the average channel utilization of the first AP and other APs which have co-channel interference with the first AP in the current power adjustment period. Therefore, the method can realize the maximization of channel throughput and ensure lower channel utilization rate while reducing the co-channel interference among the APs.

Further, based on the determined target Q value corresponding to the power before the first AP is adjusted, the candidate target Q value corresponding to the power after the first AP is adjusted, and the reward value R, they may be substituted into the formula: q ' (S, a) ═ Q (S, a) + α [ R + γ × Q (S ', a) ], and further an intermediate Q value Q ' (S, a) was calculated.

Wherein Q '(S, A) represents an intermediate Q value, and S and A in Q' (S, A) represent a power level and a power adjustment mode corresponding to the intermediate Q value respectively; q (S, A) represents the target Q value, and S and A in Q (S, A) respectively represent the power level and the power adjustment mode corresponding to the target Q value; maxQ (S ', a) represents the candidate target Q value, and S ' and a in maxQ (S ', a) represent a power class and a power adjustment method corresponding to the candidate target Q value, respectively, which is the largest Q value among a plurality of Q values corresponding to the power class to which the new power of the first AP belongs; r represents the reward value; s' also indicates the power class to which the new power of the first AP belongs, and a also indicates the adjustment mode for adjusting the new power of the first AP in the next power adjustment period; alpha and gamma are constants between 0 and 1, namely alpha epsilon (0, 1); gamma belongs to (0,1), and the specific values of the gamma and the gamma can be obtained by a statistical method. Alternatively, in this embodiment, α is 0.1 and γ is 0.9.

Further, when the next power adjustment period arrives, for the AC10a, the target Q value corresponding to the current power of the first AP may be determined according to the updated Q value table, and then the power of the first AP is adjusted according to the above power adjustment process.

It should be noted that, if the current power adjustment period is the first power adjustment period, the AC10a may default to configure the multiple managed APs 10b as the maximum transmission power of the APs, and the AC10a issues the maximum transmission power to the multiple managed APs 10b, so that the APs 10b adjust their own transmission power to the maximum transmission power.

Further, the Q values in the Q value table of the first AP stored by the AC10a in the first power adjustment period may be randomly set, or all of them may be initialized to 0, which is not limited herein.

In addition to the system embodiments provided above, the present application provides a power adjustment method, which is exemplarily described below from the perspective of AC.

Fig. 2 is a schematic flowchart of a power adjustment method according to an embodiment of the present disclosure. The method is applicable to AC. As shown in fig. 2, the method includes:

201. and when the current power adjustment period is reached, determining a target Q value corresponding to the current power of the first AP according to a Q value table corresponding to the first AP and used for describing the corresponding relation between the power level and the power adjustment mode.

202. And determining the new power of the first AP according to the power adjustment mode corresponding to the target Q value.

203. And sending the new power to the first AP so that the first AP can adjust the transmitting power to the new power.

In this embodiment, the first AP is any AP managed by the AC and having co-channel interference.

In this embodiment, a listening period may be set on a plurality of APs managed by the AC, and a timer or counter is started to count the listening period. When the listening period is reached, each AP of the multiple APs managed by the AC starts scanning, and when the current listening period is ended, the signal strengths of other AP signals and other AP signals in the channel scanning information scanned in the current listening period are sent to the AC. It should be noted that for multiple APs under the same AC management, each AP can only listen to the signals of other APs occupying the same channel and the signal strength of these APs. Therefore, other APs in the channel scanning information reported by each AP to the AC occupy the same channel as the AP itself.

Accordingly, a co-channel interference detection period may be set on the AC and a timer or counter may be started to time the co-channel interference detection period. When the same frequency interference detection period arrives, determining which APs have the same frequency interference according to the channel scanning information reported by the managed APs received in the current same frequency interference detection period.

Optionally, in order to improve the accuracy of whether the AC has co-channel interference to multiple APs and which APs have co-channel interference detection, the co-channel interference detection period may be set equal to the listening period.

The process of the AC adjusting its power is the same for each of the plurality of APs that the AC manages. The following description will exemplarily be given by taking a first AP among a plurality of APs managed by an AC as an example. The first AP is any one of a plurality of APs managed by the AC.

The first AP reports the channel scanning information scanned by the first AP in the current monitoring period to the AC, and the AC determines other APs having co-channel interference with the first AP according to the channel scanning information reported by the first AP.

Optionally, before step 202, the signal strength of other APs occupying the same channel as the first AP may be obtained from the channel scanning information reported by the first AP, the obtained signal strength of the other APs is compared with a preset strength threshold, and an AP whose signal strength is greater than or equal to the preset strength threshold among the other APs is determined as another AP having co-channel interference with the first AP.

Further, in this embodiment, a power adjustment period may be set, and a timer or a counter may be started to count the power adjustment period. Optionally, in order to implement dynamic adjustment of the power of the AP with co-channel interference, the power adjustment period may be less than or equal to the co-channel interference detection period. When the power adjustment period is equal to the co-channel interference detection period, the change of the network environment of the power adjustment system can be periodically detected, and according to the change of the network environment, which APs have co-channel interference in the current co-channel interference detection period can be timely determined. When the power adjustment period is less than the same frequency interference detection period, the power adjustment can be performed for multiple times on at least two APs with same frequency interference in the same frequency interference detection period, so that the dynamic adjustment of the AP transmitting power in the current same frequency interference detection period is realized, and the same frequency interference between the APs is reduced.

The AC performs the same adjustment method for the APs with co-channel interference in each power adjustment period, and now, taking the current power adjustment period as an example, the embodiment of the power adjustment method for any AP with co-channel interference is described. For convenience of description, any AP in which co-channel interference exists is defined as the first AP described above.

In the embodiment of the present application, a Q value table for describing a correspondence between the power level of the AP and the power adjustment mode may be preset in the AC. For the description of the Q value table, reference may be made to the related contents in fig. 1b and fig. 1c in the above system embodiments, and details are not repeated here.

Based on the Q value table, in this embodiment, when the current power adjustment period arrives, a target Q value corresponding to the current power of the first AP may be determined according to the Q value table corresponding to the first AP; determining the new power of the first AP according to the power adjustment mode corresponding to the target Q value; and then, sending the new power to the first AP so that the first AP can adjust the transmitting power to the new power. Thus, in this embodiment, when co-channel interference exists between APs, the transmit power of each AP having co-channel interference can be dynamically adjusted according to the current power of the AP, which further helps to reduce the co-channel interference between APs.

Alternatively, based on the Q-value table shown in fig. 1b and fig. 1c, when the current power adjustment period arrives, the Q-value table of the first AP may be queried according to the current power of the first AP to determine the target power level to which the current power of the first AP belongs. Further, as can be seen from the Q-value tables shown in fig. 1b and 1c, each power level corresponds to a plurality of power adjustment methods, i.e., a plurality of Q-values. Considering that the Q value of the AP reflects the quality of the channel to some extent, the larger the Q value, the better the channel quality. Based on this, the largest Q value may be selected from among a plurality of Q values corresponding to the target power class to which the current power of the first AP belongs, as the target Q value corresponding to the current power of the first AP.

It should be noted that, in order to improve the accuracy of adjusting the transmission power of APs with co-channel interference and further reduce the co-channel interference between the APs, in the embodiment of the present application, a deep learning method may be adopted to periodically update the Q value table. The deep learning method includes, but is not limited to: q-learning algorithm, SARSA algorithm, DQN algorithm, DDPG algorithm, etc. The Q-learning algorithm is used as an example to illustrate the Q-value table updating process.

When the Q-learning algorithm is used to update the Q value table of the first AP, the new power is delivered to the first AP, and when the current power adjustment period ends, that is, when the next power adjustment period arrives, the first AP and other APs having co-frequency interference with the first AP receive channel parameters respectively counted in the current power adjustment period, and send the channel parameters to the AC. Correspondingly, when the current power adjustment period is finished, the AC receives the channel parameters, and after step 203, according to the new power of the first AP determined by the current power adjustment period, the Q value table corresponding to the current power adjustment period is queried, so as to determine a candidate target Q value corresponding to the new power. For a method for determining the candidate target Q value corresponding to the new power, reference may be made to the method for determining the target Q value corresponding to the current power of the first AP in the foregoing embodiment, which is not described herein again.

Further, according to the received channel parameter, the target Q value corresponding to the current power of the first AP and the candidate target Q value corresponding to the new power, an intermediate Q value is calculated, and in the Q value table of the first AP, the intermediate Q value is used to replace the target Q value corresponding to the current power of the first AP in the current power cycle, so that the update of the Q value table of the first AP is completed one time.

Optionally, the channel parameters acquired by the first AP and other APs having co-channel interference with the first AP may include throughput and channel utilization, that is, the first AP and other APs having co-channel interference with the first AP may send the throughput and channel utilization counted by the first AP and other APs having co-channel interference with the first AP in the current power adjustment period to the AC when the current power adjustment period is ended. Optionally, the first AP and other APs with co-channel interference with the first AP may also count average throughput and average channel utilization in the current power adjustment period.

Correspondingly, the air interface resources of the channel are occupied by sharing among the APs, and the throughput and the occupation of the channel of the AP can affect the AP with co-channel interference. Therefore, when calculating the Q value of the first AP, the AC10a cannot only consider the throughput and the channel utilization rate of the first AP itself, and also needs to comprehensively consider the throughput and the channel utilization rate of other APs having co-channel interference with the first AP, so as to reduce the co-channel interference and ensure the throughput of the entire network. Based on this, when the AC calculates the intermediate Q value, the sum of respective throughputs in the current power adjustment period, which are reported by the first AP and other APs with co-frequency interference with the first AP, and the sum of channel utilization rates of the first AP and other APs with co-frequency interference with the first AP are calculated; and weighting the sum of the calculated throughputs and the sum of the channel utilization rates to obtain a reward value R. The sum of the throughputs of all APs with same frequency interference and the reward value R are in a positive feedback relation; the sum of the channel utilization rates of all APs with same frequency interference is inversely proportional to the reward value R. Further, the weight of the sum of the throughputs of the APs with the same frequency interference and the sum of the channel utilization rates can be flexibly set according to the actual situation. Optionally, the contribution of throughput to reward value R is greater than the contribution of channel utilization to reward value R, i.e. the weight of the sum of throughputs is greater than the weight of the sum of channel utilization. Optionally, when the channel parameter is an average throughput and an average channel utilization rate, the AC calculates the reward value R according to the average throughput and the average channel utilization rate of the first AP and other APs which have co-channel interference with the first AP in the current power adjustment period. Therefore, the method can realize the maximization of channel throughput and ensure lower channel utilization rate while reducing the co-channel interference among the APs.

Further, based on the determined target Q value corresponding to the power before the first AP is adjusted, the candidate target Q value corresponding to the power after the first AP is adjusted, and the reward value R, they may be substituted into the formula: q ' (S, a) ═ Q (S, a) + α [ R + γ × Q (S ', a) ], and further an intermediate Q value Q ' (S, a) was calculated. Wherein α and γ are constants between 0 and 1, i.e., α ∈ (0, 1); gamma belongs to (0,1), and the specific values of the gamma and the gamma can be obtained by a statistical method. Alternatively, in this embodiment, α is 0.1 and γ is 0.9. For the explanation of other parameters in the formula, reference may be made to the above system embodiment, and details are not repeated here.

Further, when the next power adjustment period arrives, for the AC, the target Q value corresponding to the current power of the first AP may be determined according to the updated Q value table, and then the power of the first AP is adjusted according to the above power adjustment process.

It should be noted that, if the current power adjustment period is the first power adjustment period, the AC may default to configure the multiple APs managed by the AC as the maximum transmission power of the APs, that is, the AC issues the maximum transmission power to the multiple APs managed by the AC, so that the APs adjust their own transmission power to the maximum transmission power.

Further, the Q values in the Q value table of the first AP, which is stored by the AC in the first power adjustment period, may be randomly set, or all of them may be initialized to 0, which is not limited herein.

It should be noted that the execution subjects of the steps of the methods provided in the above embodiments may be the same device, or different devices may be used as the execution subjects of the methods. For example, the execution subjects of

steps

201 and 202 may be device a; for another example, the execution subject of step 201 may be device a, and the execution subject of step 202 may be device B; and so on.

In addition, in some of the flows described in the above embodiments and the drawings, a plurality of operations are included in a specific order, but it should be clearly understood that the operations may be executed out of the order presented herein or in parallel, and the sequence numbers of the operations, such as 201, 202, etc., are merely used for distinguishing different operations, and the sequence numbers do not represent any execution order per se. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel.

Accordingly, embodiments of the present application also provide a computer-readable storage medium storing computer instructions, which, when executed by one or more processors, cause the one or more processors to perform the steps of the above power adjustment method.

Fig. 3 is a schematic structural diagram of an AC according to an embodiment of the present application. As shown in fig. 3, the AC includes: a memory 30a, a processor 30b and a communication component 30 c.

The memory 30a is used for storing computer programs and can be configured to store other various data to support operations on the AC. Wherein the processor 30b may execute a computer program stored in the memory 30a to implement the corresponding control logic. The memory 30a may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Wherein the communication component 30c is configured to facilitate wired or wireless communication between the AC and other devices. The AC may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component may also be implemented based on Near Field Communication (NFC) technology, Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In the present embodiment, the processor 30b is coupled to the memory 30a for executing the above-mentioned computer program for: when the current power adjustment period is reached, determining a target Q value corresponding to the current power of the first AP according to a Q value table corresponding to the first AP; determining the new power of the first AP according to the power adjustment mode corresponding to the target Q value; the new power is sent to the first AP through the communication module 30c, so that the first AP can adjust the transmission power to the new power; the first AP is any AP with co-channel interference.

In an optional embodiment, when determining the target Q value corresponding to the current power of the first AP, the processor 30b is specifically configured to: inquiring a Q value table according to the current power of the first AP to determine the target power level of the current power of the first AP; the maximum Q value is selected from among a plurality of Q values corresponding to the target power level as a target Q value.

Further, when there are a plurality of Q values with the largest Q value among the plurality of Q values, the processor 30b is specifically configured to, when selecting the largest Q value among the plurality of Q values corresponding to the target power level as the target Q value: one of the plurality of maximum Q values is selected as a target Q value.

In another alternative embodiment, the communication component 30c is configured to: and receiving the channel parameters of the first AP in the current power adjustment period, which are reported by the first AP, when the current power adjustment period is ended.

Accordingly, after the communication component 30c issues the new power to the first AP, the processor 30b is further configured to: inquiring a Q value table according to the new power of the first AP, and determining a candidate target Q value corresponding to the new power; calculating an intermediate Q value according to channel parameters, target Q values and candidate target Q values which are reported by the first AP and other APs which have co-frequency interference with the first AP and are in a current power adjustment period respectively; the target Q value in the Q value table is replaced with the intermediate Q value.

Further, the channel parameters include throughput and channel utilization. Accordingly, the processor 30b, when calculating the intermediate Q value, is specifically configured to: calculating the sum of the throughput reported by the first AP and other APs with same frequency interference and the sum of the channel utilization rate; weighting the sum of the calculated throughputs and the sum of the calculated channel utilization rates to obtain a reward value, wherein the sum of the throughputs and the reward value are in a positive feedback relation, and the sum of the calculated channel utilization rates and the reward value are in a negative feedback relation; calculating an intermediate Q value according to the formula Q '(S, a) ═ 1- α × Q (S, a) + α [ R + γ × Q (S', a) ]; wherein Q '(S, A) represents an intermediate Q value, Q (S, A) represents a target Q value, maxQ (S', a) represents a candidate target Q value, R represents a reward value, and α ∈ [0,1 ]; gamma is belonged to [0,1 ]. The descriptions of the remaining parameters in the formula can be found in the foregoing embodiments, and are not repeated herein.

In yet another alternative embodiment, the communication component 30c is further configured to: and receiving channel scanning information reported by the first AP in the current co-channel interference detection period. Accordingly, the processor 30b is further configured to: determining other APs having co-channel interference with the first AP according to channel scanning information reported by the first AP in the current co-channel interference detection period; the same frequency interference detection period is larger than the power adjustment period.

Further, the processor 30b, when determining other APs having co-channel interference with the first AP, is specifically configured to: acquiring the signal intensity of other APs occupying the same channel in channel scanning information reported by a first AP in the current co-channel interference detection period; and determining the AP with the signal intensity larger than or equal to a preset intensity threshold value in other APs occupying the same channel as the AP as the other AP with co-channel interference with the first AP.

In some alternative embodiments, as shown in fig. 3, the AC may further include: communication component 105, power component 30d, and the like. Only some of the components are shown schematically in fig. 3, and it is not meant that the AC must include all of the components shown in fig. 3, nor that the AC can include only the components shown in fig. 3.

Wherein the power supply component 30d is configured to provide power to the various components of the AC. The power components 30d may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device in which the power component is located.

The AC provided in this embodiment is provided with a power adjustment period, and when the power adjustment period arrives, target Q values corresponding to current powers of the APs are determined according to Q value tables corresponding to the APs having co-frequency interference, respectively, for the APs having co-frequency interference managed by the AC; and then, according to the power adjustment mode corresponding to the target Q value corresponding to each AP, determining the new power of each AP, and sending the new power to each AP with co-frequency interference, so that the APs can adjust the transmitting power of the APs to the new power, and further, when the co-frequency interference exists among the APs, the transmitting power of the APs can be dynamically adjusted, and further, the reduction of the co-frequency interference among the APs is facilitated.

It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A power adjustment method applied to an access controller AC, the method comprising:

when the current power adjustment period is reached, determining a target Q value corresponding to the current power of a first AP according to a Q value table corresponding to the first AP and used for describing the corresponding relation between the power level and the power adjustment mode;

determining the new power of the first AP according to the power adjustment mode corresponding to the target Q value;

sending the new power to the first AP so that the first AP can adjust the transmitting power to the new power; wherein the first AP is any AP with co-channel interference;

wherein the method further comprises: and periodically updating the Q value table by adopting a deep learning method.

2. The method according to claim 1, wherein the determining a target Q value corresponding to the current power of the first AP according to a Q value table corresponding to the first AP and used for describing a corresponding relationship between a power level and a power adjustment manner includes:

inquiring the Q value table according to the current power of the first AP so as to determine a target power level to which the current power of the first AP belongs;

and selecting the maximum Q value from a plurality of Q values corresponding to the target power level as the target Q value.

3. The method of claim 2, wherein the selecting a maximum Q value from a plurality of Q values corresponding to the target power level as the target Q value comprises:

when there are a plurality of the maximum Q values among the plurality of Q values, one of the plurality of maximum Q values is selected as the target Q value.

4. The method of claim 2, further comprising:

when the current power adjustment period is finished, receiving the channel parameters of the first AP in the current power adjustment period, which are reported by the first AP; and

after issuing the new power to the first AP, the method further includes:

inquiring the Q value table according to the new power of the first AP, and determining a candidate target Q value corresponding to the new power;

calculating an intermediate Q value according to the channel parameters, the target Q value and the candidate target Q value in the current power adjustment period reported by the first AP and other APs having co-frequency interference with the first AP;

replacing the target Q value in the Q value table with the intermediate Q value.

5. The method of claim 4, wherein the channel parameters include throughput and channel utilization;

the calculating an intermediate Q value according to the channel parameters, the target Q value, and the candidate target Q value in the current period reported by the first AP and other APs with co-frequency interference with the first AP includes:

calculating the sum of the throughput reported by the first AP and other APs with same frequency interference and the sum of the channel utilization rate;

weighting the sum of the throughputs and the sum of the channel utilization rates to obtain a reward value, wherein the sum of the throughputs and the reward value are in a positive feedback relation, and the sum of the channel utilization rates and the reward value are in a negative feedback relation;

calculating the intermediate Q value according to the formula Q '(S, a) ═ 1- α × Q (S, a) + α [ R + γ × Q (S', a) ];

wherein Q '(S, A) represents the intermediate Q value, and S and A in Q' (S, A) represent the power level and power adjustment mode corresponding to the intermediate Q value respectively; q (S, A) represents the target Q value, and S and A in Q (S, A) respectively represent the power level and the power adjustment mode corresponding to the target Q value; maxQ (S ', a) represents the candidate target Q value, S ' and a in maxQ (S ', a) represent the power class and the power adjustment mode corresponding to the candidate target Q value, respectively, and the candidate target Q value is the largest Q value among a plurality of Q values corresponding to the power class to which the new power belongs; r represents the reward value, and is within the scope of [0,1 ]; gamma is belonged to [0,1 ].

6. The method of any one of claims 1-5, further comprising:

determining other APs having co-channel interference with the first AP according to channel scanning information reported by the first AP in the current co-channel interference detection period; the same frequency interference detection period is greater than the power adjustment period.

7. The method according to claim 6, wherein the determining, according to the channel scanning information reported by the first AP in the current co-channel interference detection period, other APs having co-channel interference with the first AP includes:

acquiring the signal intensity of other APs occupying the same channel in the channel scanning information reported by the first AP in the current co-channel interference detection period;

and determining the AP with the signal intensity larger than or equal to a preset intensity threshold value in the other APs occupying the same channel as the AP as the other AP with co-channel interference with the first AP.

8. An access controller, comprising: a memory, a processor, and a communications component; the memory is used for storing a Q value table and a computer program which describe the corresponding relation between the power level of the first AP and the power adjustment mode;

the processor is coupled to the memory for executing the computer program for:

when the current power adjustment period is reached, determining a target Q value corresponding to the current power of a first AP according to a Q value table corresponding to the first AP;

sending the new power to the first AP through the communication assembly so that the first AP can adjust the transmitting power to the new power; wherein the first AP is any AP with co-channel interference;

and periodically updating the Q value table by adopting a deep learning method.

9. A power regulation system, comprising: the method comprises the steps that an AC and a plurality of APs managed by the AC and having same frequency interference exist;

wherein the AC is to: when the current power adjustment period is reached, determining a target Q value corresponding to the current power of a first AP according to a Q value table corresponding to the first AP and used for describing the corresponding relation between the power level and the power adjustment mode;

sending the new power to the first AP so that the first AP can adjust the transmitting power to the new power;

the first AP is used for receiving the new power sent by the AC and adjusting the transmitting power of the first AP to the new power; wherein the first AP is any one of the plurality of APs;

and periodically updating the Q value table by adopting a deep learning method.

10. A computer-readable storage medium having stored thereon computer instructions, which, when executed by one or more processors, cause the one or more processors to perform the steps of the method of any one of claims 1-7.