CN117693035A - A channel aggregation method and device - Google Patents

Abstract

This application relates to the field of communication technology and discloses a channel aggregation method and device, in order to make optimal channel aggregation decisions and solve the problems of low channel aggregation throughput and large delay. The method includes: the first terminal device receives a load report, the load report includes load information of each of M channels of the network device in the t-th time period, and the M channels include 1 main channel corresponding to the first terminal device and M-1 secondary channels; input the channel environment information of the t-th time period into the channel aggregation model for processing, and obtain the t-th channel aggregation indicator value. The channel environment information of the t-th time period includes the main channel and M-1 The load information of each secondary channel in the t-th time period, the t-th channel aggregation indicator value is used to indicate the aggregation of N secondary channels among the M-1 secondary channels with the primary channel; at the t+1-th time The segment sends data packets through the primary channel and the aggregated channel of N secondary channels.

Description

A channel aggregation method and device

Technical field

The present application relates to the field of communication technology, and in particular, to a channel aggregation method and device.

Background technique

In order to cope with the shortage of spectrum resources and the increase in business traffic, channel aggregation technology has been introduced in the communication standards formulated by the Institute of Electrical and Electronics Engineers (IEEE). Specific channel aggregation technology can be based on the main channel and aggregate the main channel and the secondary channels adjacent to the main channel to support larger channel bandwidth and thereby increase the data transmission rate.

Currently, channel aggregation methods are mainly divided into two categories: static channel aggregation and dynamic channel aggregation. The main idea of static channel aggregation is: under the premise that the primary channel is idle, it is necessary to wait for all secondary channels to be idle before channel aggregation can be performed. The main idea of dynamic channel aggregation is: when the primary channel is idle, if there happens to be an idle secondary channel, the primary channel and the idle secondary channel can be aggregated.

However, when using the above channel aggregation method, when there are multiple terminal devices competing for channel resources, the collision rate of data packets sent by each terminal device will be high, and the terminal device will enter the backoff window multiple times to wait for sending data packets, resulting in low channel aggregation throughput. , the problem of large delay.

Contents of the invention

Embodiments of the present application provide a channel aggregation method and device, in order to make optimal channel aggregation decisions and solve the problems of low channel aggregation throughput and large delay.

In the first aspect, embodiments of the present application provide a channel aggregation method. The method can be executed by a first terminal device, or by a component of the first terminal device (such as a processor, a chip, or a chip system, etc.). It can also be executed by It is implemented by a logic module or software that can realize all or part of the functions of the first terminal device. The following takes the first terminal device to execute this method as an example. The method includes: the first terminal device receives a load report from the network device. The load report includes the load of each of the M channels of the network device in the t-th time period. Load information, where M channels include 1 primary channel and M-1 secondary channels corresponding to the first terminal device, M is an integer greater than or equal to 2, and t is an integer greater than or equal to 2; the first terminal device will The channel environment information of the tth time period is input to the channel aggregation model for processing, and the tth channel aggregation indication value is obtained. The channel environment information of the tth time period includes the primary channel and M-1 secondary channels. The load information of the t-th time period, and the channel state monitoring information obtained by the first terminal device performing channel state monitoring on the primary channel and M-1 secondary channels in the t-th time period, and the t-th channel aggregation indication value is used to indicate N secondary channels among the M-1 secondary channels are aggregated with the primary channel, where N is an integer greater than or equal to 0 and less than or equal to M-1; the first terminal device performs channel aggregation on the primary channel and the N secondary channels, That is, the terminal device can send data packets through the channel aggregated by the primary channel and N secondary channels in the t+1th time period, and the t+1th time period is the time period after the tth time period.

Optionally, the load report may also include the deadline for the t-th period.

Using the above method, the first terminal device can obtain accurate load information of each channel from the network device side, and combine it with the channel status monitoring information obtained from its own channel status monitoring (such as information about the first terminal device sending data packets on each channel, etc.) , based on the real-time load and channel status of the channel, using artificial intelligence (AI), that is, the prediction ability of the channel aggregation model, to make optimal channel aggregation decisions, which is beneficial to reducing the cost of the first terminal device sending data on the channel after aggregation. The collision probability of data packets sent by other terminal devices improves the transmission performance of the aggregated channel and solves the problems of low channel aggregation throughput and large delay.

In a possible design, the channel status monitoring information obtained by the first terminal device performing channel status monitoring on the primary channel and M-1 secondary channels in the t-th time period may, but is not limited to, include one or more of the following: Item: The busy and idle status of the primary channel and each of the M-1 secondary channels monitored by the first terminal device in the t-th time period in each time unit; The data packet sending status of each time unit monitored by the first terminal device on each of the primary channel and M-1 secondary channels in the segment; the data packet sending status of the first terminal device monitored in the t-th time segment The number of consecutive time units on which the first terminal device maintains the data packet sending state and the busy and idle state of the channel on the primary channel and each of the M-1 secondary channels remains unchanged at the same time.

In the above design, the first terminal device can monitor the channel status of each channel from the perspective of the busy and idle status of each channel and the status of sending data packets on each channel, which is beneficial to the real-time load and channel status based on the channel. The channel aggregation model makes optimal channel aggregation decisions, thereby improving the transmission performance of the aggregated channels.

In a possible design, the method further includes: the first terminal device determines, based on the load information of the main channel and each of the N' sub-channels in the t-1th time period, to obtain the th-th time period based on the channel aggregation model. The reward value of the t-1 channel aggregation indication value, where the t-1th channel aggregation indication value is used to indicate the aggregation of N' secondary channels among the M-1 secondary channels with the main channel; the first terminal device is based on the t-1th channel aggregation indication value. The channel environment information of the t-1th time period, the t-1th channel aggregation indication value and the set state action value function are used to determine the channel corresponding to the t-1th channel aggregation indication value based on the channel environment information of the t-1th time period. The first state action value of the aggregation mode; the first terminal device is based on the channel environment information of the t-1th time period, the 2 ^M-1 -1 candidate channel aggregation indication values corresponding to the primary channel and M-1 secondary channels, and The set state action value function determines the second state action value, in which 2 ^M-1 -1 candidate channel aggregation indication values correspond to 2 ^{M-1 -1 candidate channel aggregation of the primary channel and M-} 1 secondary channels. method, the second state action value is the maximum state action value among the state action values of the candidate channel aggregation method corresponding to 2 ^M-1 -1 candidate channel aggregation indication values based on the channel environment information of the t-1th time period. ; and the first terminal device determines the loss of the channel aggregation model based on the reward value of the first state action value, the second state action value and the t-1 channel aggregation indication value; the first terminal device determines the loss of the channel aggregation model based on the loss of the channel aggregation model. The channel aggregation model is trained and updated; where N' is the same as or different from N, and the t-1th time period is the time period before the tth time period.

In the above design, after the channel aggregation model makes a channel aggregation decision (ie, outputs a channel aggregation indication value), the first terminal device can test whether sending data packets on the aggregated channel will collide with data packets sent by other terminal devices. And based on the channel aggregation decision and the situation of sending data packets on the aggregated channel, combined with the load condition of each channel, different rewards will be given to the channel aggregation decision made by the channel aggregation model, and the channel aggregation model will be guided according to the conditions on each channel. The load conditions are learned in order to output the optimal channel aggregation decision through the channel aggregation model.

In a possible design, the method further includes: the first terminal device determines, based on the load information of the main channel and each of the N' sub-channels in the t-1th time period, to obtain the th-th time period based on the channel aggregation model. The reward value of the t-1 channel aggregation indication value, where the t-1th channel aggregation indication value is used to indicate that N' secondary channels among the M-1 secondary channels are aggregated with the main channel, N' is the same as or different from N, and the The t-1 time period is the time period before the t-th time period;

The first terminal device inputs the channel environment information of the t-th time period into the channel aggregation model for processing, and obtains the t-th channel aggregation indication value, which includes: the first terminal device inputs the channel environment information of the t-th time period, the t-th The reward value of 1 channel aggregation indication value is input to the channel aggregation model for processing, and the tth channel aggregation indication value is obtained.

Using the above method, you can also set a reward strategy to give different rewards to the channel aggregation decisions made by the channel aggregation model (i.e., the output channel aggregation indicator value), and use the reward value as the next time the channel aggregation model makes a channel decision. Influencing factors, in order to enable the channel aggregation model to make channel aggregation decisions based on user needs.

Optionally, the first terminal device determines the reward for obtaining the t-1th channel aggregation indication value based on the channel aggregation model based on the load information of each of the primary channel and N' secondary channels in the t-1th time period. Values may include the following situations. Each situation may be used in combination or independently. This application does not limit the combination of each situation:

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N' secondary channels does not collide with the data packet sent by other terminal devices, and N' is not zero, the first terminal device Determine the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model;

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N' secondary channels does not collide with the data packet sent by other terminal devices and N' is zero, the first terminal device Determine the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model;

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N' secondary channels collides with the data packet sent by other terminal devices, and N' is not zero, the first terminal device will Determine the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model;

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N' secondary channels collides with the data packet sent by other terminal devices and N' is zero, the first terminal device will Determine the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model;

In each of the above cases, R _t represents the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model, K represents the K-th sub-channel among N' sub-channels, K=1, 2,...,N' , Represents the load information of the K-th sub-channel in the t-1th time period, /> Indicates the load information of the main channel in the t-1th time period.

In the above design, after the channel aggregation model makes a channel aggregation decision (ie, outputs a channel aggregation indication value), the first terminal device can test whether sending data packets on the aggregated channel will collide with data packets sent by other terminal devices. And based on the channel aggregation decision and the situation of sending data packets on the aggregated channel, combined with the load condition of each channel, different rewards are given to the channel aggregation decision made by the channel aggregation model to guide the channel aggregation model according to each channel Learn the load conditions on the network in order to output the optimal channel aggregation decision through the channel aggregation model.

In a second aspect, embodiments of the present application provide a communication device, which has the function of implementing the method in the first aspect. The function can be implemented by hardware, or can be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions, such as an interface unit and a processing unit.

In one possible design, the device may be a chip or integrated circuit.

In one possible design, the device includes a memory and a processor. The memory is used to store instructions executed by the processor. When the instructions are executed by the processor, the device can perform the method of the first aspect.

In a possible design, the device may be a first terminal device.

In a third aspect, embodiments of the present application provide a communication device. The communication device includes an interface circuit and a processor, and the processor and the interface circuit are coupled to each other. The processor is used to implement the method of the first aspect above through logic circuits or executing instructions. The interface circuit is used to receive signals from other communication devices other than the communication device and transmit them to the processor or to send signals from the processor to other communication devices other than the communication device. It can be understood that the interface circuit may be a transceiver or a transceiver or a transceiver or an input-output interface.

Optionally, the communication device may also include a memory for storing instructions executed by the processor or input data required for the processor to run the instructions or data generated after the processor executes the instructions. The memory can be a physically separate unit, or it can be coupled to the processor, or the processor can include the memory.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium, in which computer programs or instructions are stored. When the computer programs or instructions are executed, the method of the first aspect can be implemented.

In a fifth aspect, embodiments of the present application further provide a computer program product, which includes a computer program or instructions. When the computer program or instructions are executed, the method of the first aspect can be implemented.

In a sixth aspect, embodiments of the present application further provide a chip, which is coupled to a memory and used to read and execute programs or instructions stored in the memory to implement the method of the first aspect.

For the technical effects that can be achieved from the above-mentioned second aspect to the sixth aspect, please refer to the technical effects that can be achieved from the above-mentioned first aspect, and they will not be repeated here.

Description of the drawings

Figure 1 is a schematic diagram of a communication system architecture provided by an embodiment of the present application;

Figure 2 is a schematic diagram of a fully connected neural network provided by an embodiment of the present application;

Figure 3 is a schematic diagram of a neuron calculating output according to input according to an embodiment of the present application;

Figure 4 is a schematic diagram of adjacent multi-channel aggregation provided by an embodiment of the present application;

Figure 5 is a schematic diagram of a preamble puncturing transmission provided by an embodiment of the present application;

Figure 6 is a schematic diagram of a channel aggregation method provided by an embodiment of the present application;

Figure 7 is one of the schematic diagrams of indication information of channel load information provided by an embodiment of the present application;

Figure 8 is a second schematic diagram of indication information of channel load information provided by an embodiment of the present application;

Figure 9A is a schematic diagram of the structure of a channel aggregation model provided by an embodiment of the present application;

Figure 9B is a schematic diagram of a reinforcement learning process provided by an embodiment of the present application;

Figure 10 is a schematic diagram of a communication device provided by an embodiment of the present application;

Figure 11 is a second schematic diagram of a communication device provided by an embodiment of the present application;

Figure 12 is a schematic structural diagram of a device provided by an embodiment of the present application.

Detailed ways

The technical solutions of the embodiments of the present application can be applied to various communication systems, such as: 5G systems, LTE systems, long term evolution-advanced (LTE-A) systems and other communication systems, and can also be extended to wireless security systems. Wireless fidelity (WiFi), global interoperability for microwave access (wimax), and related cellular systems such as 3GPP, as well as future communication systems such as 6G systems. Specifically, the communication system architecture applied in the embodiment of the present application may be as shown in Figure 1, including a network device and multiple terminal devices. In Figure 1, three terminal devices are taken as an example. Terminal device 1 - terminal device 3 can send data (or data packets) to the network device separately or simultaneously. It should be noted that the embodiment of the present application does not limit the number of terminal devices and network devices in the communication system shown in Figure 1 .

The above terminal equipment may also be called a terminal, user equipment (UE), mobile station (MS), mobile terminal, etc. Terminal devices can be widely used in various scenarios, such as device-to-device (D2D) communication, vehicle to everything (V2X) communication, machine-type communication (MTC), Internet of things (IoT), virtual reality, augmented reality, industrial control, autonomous driving, telemedicine, smart grid, smart furniture, smart office, smart wear, smart transportation, smart city, etc. Terminal devices can be mobile phones, tablets, computers with wireless transceiver functions, wearable devices, vehicles, drones, helicopters, airplanes, ships, robots, robotic arms, smart home devices, vehicle terminals, IoT terminals, and wearable devices , sites (station, STA) in the WiFi system, etc. The embodiments of this application do not limit the specific technology and specific equipment form used by the terminal equipment.

The network device may also be called an access network (AN) device or a radio access network (RAN) device. It can be a base station, an evolved base station (evolved NodeB, eNodeB), a transmitter and receiver point (TRP), an integrated access and backhauling (IAB) node, or a fifth generation (5th generation) , next generation NodeB (gNB) in the 5G) mobile communication system, base station in the sixth generation (6th generation, 6G) mobile communication system, base stations in other future mobile communication systems, home base station (for example, home evolved nodeB, or home nodeB, HNB), access point (AP) in WiFi system, wireless relay node, wireless backhaul node, etc.

Before introducing the embodiments of the present application, some terms used in the present application will first be explained to facilitate understanding by those skilled in the art.

1) Neural network (NN) is a machine learning technology that simulates the neural network of the human brain in order to achieve artificial intelligence. The neural network consists of at least 3 layers, an input layer, an intermediate layer (also called a hidden layer) and an output layer. Deeper neural networks may contain more hidden layers between the input and output layers. Taking the simplest neural network as an example, its internal structure and implementation will be described. See the schematic diagram of a fully connected neural network containing three layers shown in Figure 2. As shown in Figure 2, the neural network includes 3 layers, namely the input layer, the hidden layer and the output layer. Each circle in Figure 2 represents a neuron. The input layer has 3 neurons and the hidden layer has 4 Neurons, the output layer has 2 neurons, and the neurons in each layer are fully connected to the neurons in the next layer. Each connection between neurons corresponds to a weight, and these weights can be updated through training. Each neuron in the hidden layer and output layer can also correspond to a bias, and these biases can also be updated through training. Updating a neural network means updating these weights and biases. Know the structure of the neural network, that is, the number of neurons contained in each layer of the neural network and the connection relationship between the neurons, and the parameters of the neural network, that is, the weight corresponding to each connection between the neurons, each neuron By knowing the bias corresponding to the element, all the information of the neural network is known.

As can be seen from Figure 2, each neuron may have multiple input connections, and each neuron calculates an output based on the input. See Figure 3, which is a schematic diagram of a neuron calculating output based on input. As shown in Figure 3, a neuron contains 3 inputs, 1 output, and 2 calculation functions. The output calculation formula (1-1) can be expressed as:

Output = activation function (input 1 * weight 1 + input 2 * weight 2 + input 3 * weight 3 + bias) (1-1);

Among them, "*" represents the mathematical operation "multiply" or "multiply by", and the activation function can be a S-shaped function (sigmoid function), hyperbolic function, rectification function (rectification function, ReLu), etc.

Each neuron may have multiple output connections, and the output of one neuron serves as the input of the next neuron. It should be understood that the input layer only has output connections, each neuron of the input layer is the value input to the neural network, and the output value of each neuron is directly used as the input of all output connections. The output layer only has input connections, and the output is calculated using the calculation method of the above formula (1-1). Optionally, the output layer does not need to calculate the activation function, which means that the aforementioned formula (1-1) can be transformed into: output = input 1 * weight 1 + input 2 * weight 2 + input 3 * weight 3 + bias.

For example, a k-layer neural network can be expressed as:

y=fk(fk-1(…(f1(w1*x+b1)))(1-2);

Among them, x represents the input of the neural network, y represents the output of the neural network, wi represents the weight of the i-th layer neural network, bi represents the bias of the i-th layer neural network, fi represents the activation function of the i-th layer neural network, i= 1, 2,…,k.

2) Channel aggregation. In the IEEE 802.11ac standard, channel aggregation technology was introduced for the first time, allowing multiple adjacent 20MHz secondary channels (primary channel) to be combined based on a 20 MHz (mega hertz, MHz) primary channel. secondary channels) are aggregated into channels with a bandwidth of 40MHz, 80MHz or 160MHz for transmission, thereby improving transmission efficiency. Figure 4 is a schematic diagram of adjacent multi-channel aggregation. Referring to Figure 4, it can be seen that the 20MHz main channel and the 20MHz secondary channel can be aggregated into a channel with a bandwidth of 40MHz; the 40MHz main channel and the 40MHz secondary channel can be aggregated into a bandwidth It is an 80MHz channel; the 8MHz main channel and the 80MHz secondary channel can be aggregated into a channel with a bandwidth of 160MHz.

In the next-generation standard of the 802.11ac standard, the 802.11ax standard, based on technologies such as preamble puncturing, channel aggregation is allowed between non-adjacent 20MHz channels, providing more flexibility for channel aggregation It also brings more possibilities for further improving the transmission throughput rate. As shown in Figure 5, Figure 5 is a schematic diagram of preamble puncturing transmission. Among them, TX means transport, CH means channel, the bandwidth of each channel (CH1, CH2, CH3, CH4) is 20MHz, frame 1 (frame 1), frame 2 (frame 2) and frame 3 The transmission bandwidth of (frame 3) is 80MHz. Since the sub-20MHz channel (recorded as S20) is busy when transmitting frame 1, S20 is punctured, so the actual bandwidth of frame 1 is 60MHz. Similarly, the actual bandwidth of frame 2 is 60MHz, and the actual bandwidth of frame 3 is 40MHz.

3) Channel aggregation methods. Currently, channel aggregation methods are mainly divided into two categories: static channel aggregation and dynamic channel aggregation. The main idea of static channel aggregation is: under the premise that the primary channel is idle, it is necessary to wait for all secondary channels to be idle before channel aggregation can be performed. The main idea of dynamic channel aggregation is: when the primary channel is idle, if there happens to be an idle secondary channel, the primary channel and the idle secondary channel can be aggregated.

It can be seen from the above channel aggregation method that the main idea of the current channel aggregation method is to aggregate the main channel and the idle secondary channel when the main channel is idle. However, when there are multiple terminal devices competing for channel resources, the aggregated channels applied by multiple terminal devices may partially or completely overlap, the data packets sent by each terminal device may have a high collision rate, and the terminal device may enter the backoff window multiple times. Waiting for data packets to be sent leads to problems of low channel aggregation throughput and large delay.

Based on this, this application provides a channel aggregation method, which aims to make optimal channel aggregation decisions based on the real-time status of the channel and the transmission requirements of the service, using the prediction ability of artificial intelligence (AI) to improve the quality of the aggregated channel. transmission performance, solving the problems of low channel aggregation throughput and large delay. The embodiments of the present application will be described in detail below with reference to the accompanying drawings, where dotted lines in the drawings represent optional steps or components.

In addition, it should be understood that the ordinal words such as "first" and "second" mentioned in the embodiments of this application are used to distinguish multiple objects and are not used to limit the size, content, order, timing, etc. of multiple objects. Priority or importance, etc. For example, the t-th time period and the t+1-th time period do not indicate a difference in priority or importance corresponding to the two time periods.

In the embodiments of this application, the number of nouns means "singular noun or plural noun", that is, "one or more", unless otherwise specified. "At least one" means one or more, and "plurality" means two or more. "And/or" describes the relationship between associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone, where A, B can be singular or plural. The character "/" generally indicates that the related objects are in an "or" relationship. For example, A/B means: A or B. "At least one of the following" or similar expressions thereof refers to any combination of these items, including any combination of a single item (items) or a plurality of items (items). For example, at least one of a, b, or c means: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, c Can be single or multiple.

Figure 6 shows a channel aggregation method provided by an embodiment of the present application. The method includes:

S601: The first terminal device receives a load report from the network device. The load report includes the load information of each of the M channels of the network device in the t-th time period. M is an integer greater than or equal to 2, and t is greater than or equal to 2. An integer equal to 2.

In this embodiment of the present application, the network device can obtain the time period corresponding to the acquisition period for each of the M channels of the network device (such as the tth time period) load information. Among them, the load information of the channel in a certain time period (such as the t-th time period) can be represented by a load value, which represents the time when the channel is busy in the time period (that is, the time when data packets are transmitted) Ratio to the total time.

As an example: for a certain time period (such as the t-th time period), the network device can obtain through carrier sensing whether each of the M channels of the network device in the time period has a data packet in each time unit. Transmission, and determine the load information (such as load value) of each channel in this time period based on whether each channel has data packet transmission in each time unit in this time period. The time unit may be resources of different time granularities such as subframes, slots, mini-slots or symbols, and one time period may include one or more time units.

For example: a certain time period (such as the t-th time period) includes 50 time domain units, and the network device obtains through carrier sensing that channel A transmits data packets in 30 time domain units in the time period, then it can be determined The load information (such as load value) of channel A in this time period is 30/50*100%=60%. Optionally, the load value can also be quantized (scaled) to 0-255. For example, the load value of channel A in this time period is 60%, 60%*255=153, and 153 can be used to represent channel A in this time period. The load value is 60%.

For the t-th time period, after the network device obtains the load information of each of the M channels in the t-th time period, it can send a load report including the load information of each of the M channels in the t-th time period. (Load report) Send the terminal device through broadcast, multicast, etc., for example: send it through broadcast to one or more terminal devices located within the service range of the network device.

Among them, the indication information used to indicate the load information of each channel in the load report can be as shown in Figure 7, in which the channel number (channel number) field is used to indicate the number (or index) of the channel, occupying an 8-bit (octet ); The channel load field is used to indicate the load value corresponding to the channel, occupying one octet. For the load information of each of the M channels in the t-th time period, the load report generates a total of M*16 bits of overhead.

In a possible implementation, the indication information used to indicate the load information of each channel can also be as shown in Figure 8. The indication information can also include a regulatory class field and an actual measurement stop time. field. Among them, the regulatory field can indicate a type set, occupying one octet. The type set can include: operating frequency band, channel bandwidth, channel set, transmission power upper limit, set emission limits (emissions limits set), behavior limit set ( behavior limits set) and other information. For example: the value of the regulatory field is 55, and the corresponding type set indicates that the channel is in the 5 GHz frequency band, the channel bandwidth is 20MHz, and the channel numbers (or indexes) of the channels included in the channel set are 149, 153, and 157 , 161, 165, the transmission power is 1000mW, the emissions limits set is 4, and the behavior limits set is 10; the regulatory class set corresponding to the value 12 of the regulatory class field indicates that the letter is in the 2.407GHz frequency band, the channel bandwidth is 25MHz, and it belongs to the channel set Included channels have a channel number (or index) of 1-11, a transmission power of 1000mW, emissions limits sets of 4 and behaviorlimits set of 10. The actual measurement stop time field, which occupies 8 octets, is used to indicate the time to complete the load measurement. It can be used to ensure the time consistency of the load report issued to each terminal device. For example, the network device uses carrier monitoring in the tth time period. When load measurement is performed on the channel, the time to complete the load measurement is the deadline of the t-th time period.

It should be understood that the regulatory field and the actual measurement stop time field are optional, and whether there is a regulatory field and the actual measurement stop time field can be indicated by the first 2 bits of the indication information. For example: 00 means there are no these two fields, 01 means the actual measurement stop time field exists, 10 means the supervision field exists, and 11 means both the supervision field and the actual measurement stop time field exist.

In addition, it should be understood that the M channels include 1 main channel corresponding to the first terminal device and M-1 secondary channels. Among the M channels, 1 main channel corresponding to the first terminal device can be passed by the network device. A radio resource control (RRC) message or the like is directed to the first terminal device, or it can be determined by the first terminal device based on the load information of the M channels (such as selecting the channel with the smallest load value as the main channel), etc., this application There is no limit to this.

S602: The first terminal device inputs the channel environment information of the t-th time period into the channel aggregation model for processing, and obtains the t-th channel aggregation indication value.

Among them, the channel environment information in the t-th time period includes the load information of the primary channel and each of the M-1 secondary channels in the t-th time period, and the first terminal device's response to the primary channel in the t-th time period. Channel state monitoring information obtained by performing channel state monitoring with M-1 secondary channels. The channel aggregation indicator value is used to indicate the aggregation of N secondary channels among the M-1 secondary channels with the primary channel. N is greater than or equal to 0, and An integer less than or equal to M-1.

In this embodiment of the present application, the first terminal device can also perform channel status monitoring on the primary channel and M-1 secondary channels within the time period corresponding to each acquisition cycle to obtain channel status monitoring information. Taking the t-th time period as an example, the channel state monitoring information obtained by the first terminal device performing channel state monitoring on the primary channel and M-1 secondary channels in the t-th time period may include: The busy and idle status of the main channel and each of the M-1 secondary channels monitored in the time period in each time unit; the first terminal device monitored by the first terminal device in the t-th time period. The data packet transmission status of each time unit on the main channel and each of the M-1 secondary channels; the first terminal equipment monitored by the first terminal equipment in the t-th time period on the main channel and M- One or more of the number of consecutive time units that the data packet sending status and the busy and idle status of the channel on each sub-channel in a sub-channel remain unchanged at the same time.

Among them, for the busy and idle status of the primary channel and each of the M-1 secondary channels monitored by the first terminal device in the t-th time period in each time unit, you can use represents, where i=1, 2, 3,...,M, represents the i-th channel (hereinafter referred to as channel i) among the primary channel and M-1 secondary channels (a total of M channels),/> The number of elements contained in is equal to the number of time units included in the t-th time period. The value of the element is 1, which means that the busy status of channel i in the time unit corresponding to the element is busy (that is, there is transmission of data packets, possibly It is the data transmission of the first terminal device, or it may be the data packet transmission of other terminal devices). The value of the element is 0, which means that the busy status of channel i in the time unit corresponding to the element is idle (that is, there is no data packet transmission) , the value of the element is -1, which means that the first terminal device does not monitor the busy and idle status of channel i in the time unit corresponding to the element (for example, because the first terminal device sends data on other channels other than channel i in the time unit corresponding to the element) package, it is impossible to monitor the busy and idle status of channel i in the time unit corresponding to this element). For example/> It means that the busy-idle status of channel i in the first 9 time units of the t-th time period is idle, and the busy-idle status of the 10th time unit is busy.

For the data packet sending status of each time unit of the first terminal device on the main channel and each of the M-1 secondary channels monitored by the first terminal device in the t-th time period, you can use represents, where i=1, 2, 3,...,M, represents the i-th channel (hereinafter referred to as channel i) among the primary channel and M-1 secondary channels (a total of M channels),/> The number of elements contained in is equal to the number of time units included in the t-th time period. The value of the element is 1, which means that for channel i, the first terminal device has sent a data packet in the time unit corresponding to the element. The value of the element is 0 means that for channel i, the first terminal device sends no data packet in the time unit corresponding to this element. For example/> It means that the first terminal device has sent data packets on channel i in the first 3 time units and the 10th time unit of the t-th time period, but has not sent data packets on channel i in the 4th to 9th time units.

For the first terminal device monitored by the first terminal device in the t-th time period, the data packet sending status and the busy and idle status of the channel on the main channel and each of the M-1 secondary channels remain unchanged at the same time. The number of consecutive time units can be used express. with/> and/> For example, in the first time unit of the t-th time period, the first terminal device can send/> The value of is set to the initial value 0; in the second time unit of the t-th time period,/> and/> The values of the elements corresponding to the second time unit in are all the same as the values of the elements corresponding to the first time unit,/> The value +1(/> is 1); in the third time unit of the t-th time period,/> and/> The values of the elements corresponding to the third time unit in are all the same as the values of the elements corresponding to the second time unit,/> The value +1(/> is 2); in the fourth time unit of the t-th time period, there exists/> The value of the element corresponding to the fourth time unit is different from the value of the element corresponding to the third time unit,/> The value of is reset to 0; in the fifth time unit of the t-th time period, there is/> The value of the element corresponding to the fifth time unit is different from the value of the element corresponding to the fourth time unit,/> The value is reset to 0; in the sixth time unit of the t-th time period, /> and/> The values of the elements corresponding to the sixth time unit in are all the same as the values of the elements corresponding to the fifth time unit,/> The value +1(/> is 1);…;in the tenth time unit of the t-th time period,/> and/> The values of the elements corresponding to the tenth time unit in are all the same as the values of the elements corresponding to the ninth time unit,/> The value +1(/> is 5); finally we get is 5.

In this embodiment of the present application, the input of the channel aggregation model may be the channel environment information S of a certain time period (such as the t-th time period), and the output of the channel aggregation model is the channel aggregation indication value Y. Taking the t-th time period as an example, the channel environment information S _t of the t-th time period includes the load information of the main channel in the t-th time period. And the load information of M-1 sub-channels in the t-th time period/> Among them, j=1, 2, 3, ..., M-1, indicating the j-th sub-channel among the M-1 sub-channels. It may also include channel state monitoring information obtained by the first terminal device performing channel state monitoring on the main channel and M-1 secondary channels in the t-th time period, such as the above/> corresponding to the t-th time period. one or more of them. Y can be a number between 0 and 2 ^M-1 -1. Each number is mapped to a specific channel aggregation method including the main channel. For example, Y=0 means no channel aggregation, Y=1 represents the channel aggregation of the main channel and the first sub-channel among M-1 sub-channels, Y=2 represents the aggregation of the main channel and the second sub-channel among M-1 sub-channels,..., Y=M-1 represents the main channel The channel is aggregated with the M-1 sub-channel among the M-1 sub-channels. Y=M represents the aggregation of the main channel with the first sub-channel and the second sub-channel among the M-1 sub-channels, and so on.

For the parameters of each layer of neurons in the channel aggregation model (that is, the neural network corresponding to the channel aggregation model), the parameters of each layer of neurons in the channel aggregation model can be configured through random initialization. It is also possible to use multiple channel environment information samples in the sample library that have been marked with target channel aggregation indication values corresponding to the channel aggregation mode, and obtain them through training by the training device. In a possible implementation, the channel environment information corresponding to multiple time periods can be obtained by the first terminal device for multiple channel environment information samples in the sample library, and the channel environment information corresponding to each time period can be manually obtained, According to the channel environment information corresponding to the next time period in the time period, after determining a preferred channel aggregation method corresponding to the channel environment information corresponding to the time period, mark the channel environment information corresponding to the time period corresponding to the preferred channel aggregation method. Target channel aggregation indicator value. When training the channel aggregation model, the training device (such as the first terminal device or network device) can input the channel environment information samples in the sample library to the channel aggregation model, and obtain the channel aggregation indication value output by the channel aggregation model. According to the channel The channel aggregation indicator value output by the aggregation model is the target channel aggregation indicator value corresponding to the channel environment information sample. The loss function (loss function) training device can calculate the loss (loss) of the channel aggregation model. The higher the loss, the channel aggregation model is passed. The greater the difference between the output channel aggregation indicator value and the target channel aggregation indicator value, the channel aggregation model adjusts the parameters of the neurons in the channel aggregation model according to the loss. For example, if the stochastic gradient descent method is used to update the parameters of the neurons in the channel aggregation model, then the The training process of the channel aggregation model becomes the process of reducing this loss as much as possible. The channel aggregation model is continuously trained through the channel environment information samples in the sample set. When the loss is reduced to the preset range, the trained channel aggregation model can be obtained.

As an example, the structure of the channel aggregation model in the embodiment of the present application can be shown in Figure 9A, where each block in Figure 9A represents a fully connected layer, and the channel aggregation model can be composed of 7 fully connected layers, of which 7 The fully connected layer consists of 1 input layer, 5 hidden layers and 1 output layer from left to right. The activation function of each layer can be a rectification function (ReLu), and the inputs of the input layer are a certain The channel environment information S of a time period (such as the first time period), the output h1 of the input layer is the input of hidden layer 1, the output h2 of hidden layer 1 is the input of hidden layer 2, and the output h3 of hidden layer 2 is the hidden layer 3's input, the XOR operation result of the output h4 of hidden layer 3 and the output h2 of hidden layer 1 is the input of hidden layer 4, the output h5 of hidden layer 4 is the input of hidden layer 5, the output h6 of hidden layer 5 is the same as the hidden The XOR operation result of the output h4 of layer 3 is the input of the output layer, and the output of the output layer is the channel aggregation indicator value Y. The process of training the channel aggregation model is the process of continuously adjusting the parameters of the neurons in each layer of the channel aggregation model.

It should be understood that the above-mentioned training device can be a first terminal device, a network device, or other devices such as a server or a computer. When the training device is not the first terminal device, the training device can determine the channel aggregation model. The parameters of the neurons in each layer are then sent to the first terminal device.

In some implementations, as shown in Figure 9B, the channel aggregation model outputs a channel aggregation indication value (such as the t-th time period) based on the channel environment information (S _t-1 ) of a certain time period (such as the t-1th time period). 1 channel aggregation indication value), the first terminal device can also test whether sending data packets on the aggregated channel will collide with data packets sent by other terminal devices, and based on the channel aggregation method indicated by the channel aggregation indication value and Based on the situation of sending data packets on the aggregated channel, combined with the load situation of each channel in that time period, a reward value (such as R _t ) is given based on the channel aggregation indication value output by the channel aggregation model, and the reward value is also As the input of the channel aggregation model in the next time period (such as the tth time period). The channel aggregation model is guided to learn according to the load conditions on each channel, in order to output the optimal channel aggregation decision through the channel aggregation model. Optionally, the channel aggregation model can also be based on the channel environment information of a certain time period (such as the t-1th time period) and output the channel aggregation indicator value (such as the t-1th time period) as the next time period (such as the t-1th time period). t time periods) as input to the channel aggregation model.

In a possible implementation, the first terminal device can determine the reward value of the channel aggregation indication value based on the channel aggregation model in the following manner, that is, determine that the first terminal device performs the decision action (i.e., the channel aggregation indicator value) obtained based on the channel aggregation model. The reward value of the channel aggregation method corresponding to the aggregation indication value). The following explanation takes this time period as the t-th time period and the reward value of the channel aggregation indicator value obtained based on the channel aggregation model is R _t+1 as an example:

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N secondary channels does not collide with the data packet sent by other terminal devices, and N is not zero, the first terminal device shall Determine the reward value for obtaining the t-th channel aggregation indication value based on the channel aggregation model;

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N secondary channels does not collide with the data packet sent by other terminal devices and N is zero, the first terminal device shall Determine the reward value for obtaining the t-th channel aggregation indication value based on the channel aggregation model;

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N secondary channels collides with the data packet sent by other terminal devices, and N is not zero, the first terminal device will Determine the reward value for obtaining the t-th channel aggregation indication value based on the channel aggregation model;

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N secondary channels collides with the data packet sent by other terminal devices and N is zero, the first terminal device will Determine the reward value based on the channel aggregation model to obtain the t-th channel aggregation indication value.

In each of the above cases, R _t+1 represents the reward value for obtaining the t-th channel aggregation indication value based on the channel aggregation model, K represents the K-th sub-channel among N sub-channels, K=1, 2,...,N, Indicates the load information of the K-th sub-channel in the t-th time period,/> Indicates the load information of the main channel in the t-th time period.

In other implementations, the first terminal device also determines the reward value based on the channel aggregation model to obtain the t-th channel aggregation indication value based on the average load information (such as load value) of the primary channel and N secondary channels in the t-th time period. Rt ₊₁ . For example: when the first terminal device sends a data packet on the main channel and N secondary channels aggregated and collides with the data packet sent by other terminal devices, the main channel and N channels will load information in the t+1th time period. The product of the mean value (such as the load value) and -1 is used as the reward value R _t+1 ; when the first terminal device sends a data packet on the channel after the main channel and N secondary channels are aggregated, it does not occur when other terminal devices send data packets. During a collision, the average value of the load information (such as load value) of the main channel and N channels in the t+1th time period is used as the reward value R _t+1 .

The above is an example where the time period is the t-th time period and the reward value for determining the t-th channel aggregation indication value based on the channel aggregation model is R _t+1 . It can be understood that for other time periods, such as the t-th 1 time period (the t-1th time period is the time period before the tth time period), the first terminal device can also use the main channel and each of the N' sub-channels in the t-1th time period. The load information of the time period is used to determine the reward value R _t for obtaining the t-1th channel aggregation indication value based on the channel aggregation model. The t-1th channel aggregation indication value is used to indicate N' among the M-1 sub-channels. The secondary channels are aggregated with the primary channel, and N' is the same as or different from N.

For example: when the data packet sent by the first terminal device on the channel after aggregation of the main channel and N' secondary channels does not collide with the data packet sent by other terminal devices, and N' is not zero, the first terminal device will Determine the reward value based on the channel aggregation model to obtain the t-1th channel aggregation indication value.

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N' secondary channels does not collide with the data packet sent by other terminal devices and N' is zero, the first terminal device Determine the reward value based on the channel aggregation model to obtain the t-1th channel aggregation indication value.

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N' secondary channels collides with the data packet sent by other terminal devices, and N' is not zero, the first terminal device will Determine the reward value based on the channel aggregation model to obtain the t-1th channel aggregation indication value.

When the data packet sent by the first terminal device on the channel after aggregation of the primary channel and N' secondary channels collides with the data packet sent by other terminal devices and N' is zero, the first terminal device will Determine the reward value based on the channel aggregation model to obtain the t-1th channel aggregation indication value.

In each of the above cases, R _t represents the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model, K represents the K-th sub-channel among N' sub-channels, K=1, 2,...,N' , Represents the load information of the K-th sub-channel in the t-1th time period, /> Indicates the load information of the main channel in the t-1th time period.

S603: The first terminal device sends a data packet through the aggregated channel of the primary channel and N secondary channels in the t+1th time period. The t+1th time period is the time period after the tth time period.

The first terminal device inputs the channel environment information of the t-th time period into the channel aggregation model for processing. After obtaining the t-th channel aggregation indication value, it can use the M-1 sub-channels indicated by the t-th channel aggregation indication value to N secondary channels are aggregated with the primary channel, M-1 secondary channels are aggregated with the primary channel, and data packets are sent to the network device through the aggregated channels in the t+1th time period after the tth time period.

In some implementations, in order to make the channel aggregation decision (i.e., the channel aggregation indicator value) made by the channel aggregation model meet the user's expectations, the user can also pre-configure the evaluation method to make different decision actions based on various channel environment information S a ( That is, the state action value function Q of the channel aggregation method corresponding to different channel aggregation indicator value Y), for the decision action a output by the channel aggregation model based on the channel environment information S of a certain period of time (that is, the output channel aggregation indicator value Y The corresponding channel aggregation method) performs state action value evaluation to obtain a first state action value; and all possible decision actions corresponding to the channel environment information S in this time period (that is, all possible The channel aggregation method corresponding to the channel aggregation indication value Y) is evaluated respectively to obtain multiple state action values, and the maximum value is selected as the second state action value. And the loss of the channel aggregation model can be determined based on the second state action value, the first state action value, and the reward value, and the channel aggregation model can be trained and updated. For example, the stochastic gradient descent method can be used to update the neurons in the channel aggregation model based on the loss. parameter.

Taking the t-th time period as an example, the following expected squared reward value function (which can also be called a loss function) can be used to determine the loss of the channel aggregation model.

L(θ)＝E[R _t+1 +γmax _a′ Q(s _t ′,a′,θ ^* )-Q(s _t ,a _t ;θ)] ²

Among them, L() represents the expected squared reward value function, L(θ) represents the loss of the channel aggregation model, Q() represents the set state action value function, γ represents the discount factor (the value can be 0.9, etc.), θ represents The current parameters of the channel aggregation model, R _t+1, represent the reward value of the decision action a _t obtained based on the channel aggregation model (that is, the channel aggregation method corresponding to the obtained t-th channel aggregation indication value); Q(s _t ,a _t ; θ)] represents the first state action value of the decision action a _t (that is, the channel aggregation mode corresponding to the output t-th channel aggregation indication value) based on the channel environment information s _t of the t-th time period; max _a ′Q (s _t ′, a ′, θ ^* ) indicates that based on the channel environment information s _t of the t-th time period, all optional decision actions a(2 ^M-1 -1 candidate channels corresponding to the candidate channel aggregation indication values are performed respectively aggregation mode), a′ represents the decision action corresponding to the second state action value, θ ^* represents the parameters of the target channel aggregation model, that is, output the The decision action a′ (the channel aggregation indication value corresponding to a′) of the second state action value is a parameter of the channel aggregation model.

The above is an example of determining the loss of the channel aggregation model by taking the time period as the t-th time period. It can be understood that for other time periods (such as the t-1th time period), it will correspond to the t-th time period. The reward value, first state action value and second state action value of the segment are replaced with the reward value, first state action value and second state action value corresponding to the t-1th time period, and the corresponding t-th time period can be determined. The loss of the channel aggregation model in 1 time period, the channel aggregation model in t-1 time period is trained and updated.

In addition, it should be understood that the above is based on the channel aggregation model on the first terminal device side. The first terminal device processes the input channel environment information of the t-th time period based on the channel aggregation model to obtain the channel aggregation indication value. The first terminal device performs channel aggregation in the t+1th time period based on the channel aggregation mode indicated by the channel aggregation indication value as an example for explanation. In some implementations, the channel aggregation model can also be deployed on the network device. The network device side obtains the channel environment information of the first terminal device corresponding to the t-th time period and inputs it into the channel aggregation model. The input channel environment information of the t-th time period is Perform processing to obtain the channel aggregation indication value, and the network device sends the channel aggregation indication value or the channel aggregation method indicated by the channel aggregation indication value to the first terminal device, and the first terminal device determines the channel aggregation indication value or channel aggregation mode indicated by the channel aggregation indication value from the network device. Perform channel aggregation in the channel aggregation mode indicated by the channel aggregation indicator value.

It can be understood that, in order to implement the functions in the above embodiments, the first terminal device includes corresponding hardware structures and/or software modules that perform each function. Those skilled in the art should easily realize that the units and method steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is performed by hardware or computer software driving the hardware depends on the specific application scenarios and design constraints of the technical solution.

Figures 10 and 11 are schematic structural diagrams of possible communication devices provided by embodiments of the present application. These communication devices can be used to implement the functions of the first terminal device in the above method embodiments, and therefore can also achieve the beneficial effects of the above method embodiments. In a possible implementation, the communication device may be a first terminal device, or may be a module (such as a chip) applied to the first terminal device.

As shown in Figure 10, the communication device 1000 includes a processing unit 1010 and an interface unit 1020, where the interface unit 1020 may also be a transceiver unit or an input/output interface. The communication device 1000 may be used to implement the functions of the first terminal device in the above method embodiment shown in FIG. 6 .

When the communication device 1000 is used to implement the functions of the first terminal device in the method embodiment shown in Figure 6:

The interface unit 1020 is configured to receive a load report from the network device. The load report includes the load information of each of the M channels of the network device in the t-th time period, where the M channels include 1 corresponding to the first terminal device. primary channels and M-1 secondary channels, M is an integer greater than or equal to 2, t is an integer greater than or equal to 2; the processing unit 1010 is used to input the channel environment information of the tth time period into the channel aggregation model Perform processing to obtain the t-th channel aggregation indicator value. The channel environment information of the t-th time period includes the load information of the primary channel and each of the M-1 secondary channels in the t-th time period, and the load information of the t-th time period. The channel state monitoring information obtained by performing channel state monitoring on the main channel and M-1 secondary channels during the time period. The t-th channel aggregation indicator value is used to indicate the aggregation of N secondary channels among the M-1 secondary channels with the primary channel. N is an integer greater than or equal to 0 and less than or equal to M-1; and channel aggregation is performed on the primary channel and N secondary channels. Optionally, the load report also includes the deadline of the t-th period.

In a possible design, the processing unit 1010 performs channel status monitoring on the primary channel and M-1 secondary channels in the t-th time period, and the channel status monitoring information obtained includes one or more of the following: Processing unit 1010 The busy and idle status of the main channel and each of the M-1 secondary channels in each time unit monitored in the t-th time period; the communication device monitored by the processing unit 1010 in the t-th time period The data packet transmission status of each time unit on the main channel and each of the M-1 secondary channels; the communication device monitored by the processing unit 1010 in the t-th time period is on the main channel and M-1 The number of consecutive time units that the data packet sending status and the busy and idle status of the channel on each secondary channel remain unchanged at the same time.

In a possible design, the processing unit 1010 is also configured to determine, based on the load information of each of the primary channel and N' secondary channels in the t-1th time period, the t-1th time interval obtained based on the channel aggregation model. The reward value of the channel aggregation indicator value, where the t-1th channel aggregation indicator value is used to indicate the aggregation of N' secondary channels among the M-1 secondary channels with the main channel; based on the channel environment information of the t-1th time period , the t-1th channel aggregation indication value and the set state action value function determine the first state action of the channel aggregation method corresponding to the t-1th channel aggregation indication value based on the channel environment information of the t-1th time period value; based on the channel environment information of the t-1th time period, the 2 ^M-1 -1 candidate channel aggregation indication values corresponding to the primary channel and M-1 secondary channels, and the set status action value function, determine the second State action value, in which 2 ^M-1 -1 candidate channel aggregation indication values correspond to 2 ^M-1 -1 candidate channel aggregation modes of the primary channel and M-1 secondary channels, and the second state action value is based on the t-th -1 time period of channel environment information respectively performs 2 ^M-1 -1 maximum state action value among the state action values of the candidate channel aggregation mode corresponding to -1 candidate channel aggregation indication value; and based on the first state action value, the second The reward value of the state action value and the t-1 channel aggregation indicator value determines the loss of the channel aggregation model; based on the loss of the channel aggregation model, the channel aggregation model is trained and updated; where N' is the same as or different from N, and the t-th -1 time period is the time period before the tth time period.

In a possible design, the processing unit 1010 is also configured to determine the t-th time period based on the load information of each of the primary channel and N' secondary channels in the t-1th time period. The reward value of 1 channel aggregation indication value, where the t-1th channel aggregation indication value is used to indicate that N' secondary channels among the M-1 secondary channels are aggregated with the main channel, N' is the same as or different from N, and the t-th 1 time period is the time period before the t-th time period; the processing unit 1010 inputs the channel environment information of the t-th time period into the channel aggregation model for processing, and when obtaining the t-th channel aggregation indication value, it is specifically used to convert the t-th time period into the channel aggregation indicator value. The channel environment information of t time periods and the reward value of the t-1th channel aggregation indication value are input to the channel aggregation model for processing, and the tth channel aggregation indication value is obtained.

In one possible implementation, the processing unit 1010 determines to obtain the t-1th channel aggregation indication value based on the channel aggregation model based on the load information of each of the primary channel and N' secondary channels in the t-1th time period. When the reward value is used, it is specifically used: when the data packet sent by the interface unit 1020 on the channel after the aggregation of the primary channel and N' secondary channels does not collide with the data packet sent by other terminal devices, and N' is not zero, the processing unit 1010 based on Determine the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model; where R _t represents the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model, and K represents the N'th sub-channel K sub-channels, K=1, 2,...,N', Indicates the load information of the Kth sub-channel in the t-1th time period.

In another possible implementation, the processing unit 1010 determines to obtain the t-1th channel aggregation indication based on the channel aggregation model based on the load information of each of the primary channel and N' secondary channels in the t-1th time period. When the reward value of the value is used, it is specifically used: when the interface unit 1020 sends a data packet on the channel after the main channel and N' secondary channels have been aggregated, and does not collide with the data packet sent by other terminal devices, and N' is zero, the processing unit 1010 based on Determine the reward value for obtaining the t-th channel aggregation indication value based on the channel aggregation model; where R _t represents the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model, /> Indicates the load information of the main channel in the t-1th time period.

In another possible implementation, the processing unit 1010 determines to obtain the t-1th channel aggregation indication based on the channel aggregation model based on the load information of each of the primary channel and N' secondary channels in the t-1th time period. When the reward value of the value is used, it is specifically used: when the interface unit 1020 sends a data packet on the channel after the main channel and N' secondary channels are aggregated, and the data packet sent by other terminal devices collides, and N' is not zero, the processing unit 1010 based on Determine the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model; where R _t represents the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model, and K represents the N'th sub-channel K sub-channels, K=1, 2,...,N', Represents the load information of the K-th sub-channel in the t-1th time period, /> Indicates the load information of the main channel in the t-1th time period.

In another possible implementation, the processing unit 1010 determines to obtain the t-1th channel aggregation indication based on the channel aggregation model based on the load information of each of the primary channel and N' secondary channels in the t-1th time period. When the reward value of the value is used, it is specifically used: when the interface unit 1020 sends a data packet on the channel after the main channel and N' secondary channels are aggregated, and the data packet sent by other terminal devices collides, and N' is zero, the processing unit 1010 according to Determine the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model; where, R _t represents the reward value for obtaining the t-1th channel aggregation indication value based on the channel aggregation model,/> Indicates the load information of the main channel in the t-1th time period.

In a possible design, the processing unit 1010 is also configured to determine the t-th channel aggregation indication value based on the channel aggregation model based on the load information of each of the primary channel and N secondary channels in the t-th time period. reward value.

In one possible implementation, the processing unit 1010 determines the reward value of the t-th channel aggregation indication value based on the channel aggregation model based on the load information of each of the primary channel and N secondary channels in the t-th time period, Specifically used: when the data packet sent by the interface unit 1020 on the channel after aggregation of the main channel and N secondary channels does not collide with the data packet sent by other terminal devices, and N is not zero, the processing unit 1010 Determine the reward value based on the channel aggregation model to obtain the t-th channel aggregation indication value.

In another possible implementation, the processing unit 1010 determines when the reward value of the t-th channel aggregation indication value is obtained based on the channel aggregation model based on the load information of each of the primary channel and N secondary channels in the t-th time period. , specifically used for: when the data packet sent by the interface unit 1020 on the channel after aggregation of the primary channel and N secondary channels does not collide with the data packet sent by other terminal devices, and N is zero, the processing unit 1010 Determine the reward value based on the channel aggregation model to obtain the t-th channel aggregation indication value.

In another possible implementation, the processing unit 1010 determines when the reward value of the t-th channel aggregation indication value is obtained based on the channel aggregation model based on the load information of each of the primary channel and N secondary channels in the t-th time period. , specifically used for: when the data packet sent by the interface unit 1020 on the channel aggregated between the primary channel and N secondary channels collides with the data packet sent by other terminal devices, and N is not zero, the processing unit 1010 Determine the reward value based on the channel aggregation model to obtain the t-th channel aggregation indication value.

In another possible implementation, the processing unit 1010 determines when the reward value of the t-th channel aggregation indication value is obtained based on the channel aggregation model based on the load information of each of the primary channel and N secondary channels in the t-th time period. , specifically used for: when the data packet sent by the interface unit 1020 on the channel aggregated between the primary channel and N secondary channels collides with the data packet sent by other terminal devices, and N is zero, the processing unit 1010 Determine the reward value for obtaining the t-th channel aggregation indication value based on the channel aggregation model;

In the above designs, R _t+1 represents the reward value for obtaining the t-th channel aggregation indication value based on the channel aggregation model, K represents the K-th sub-channel among N sub-channels, K=1, 2,...,N, Indicates the load information of the K-th sub-channel in the t-th time period,/> Indicates the load information of the main channel in the t-th time period.

In a possible design, the processing unit 1010 is also configured to determine the channel based on the t-th time period based on the channel environment information of the t-th time period, the t-th channel aggregation indicator value and the set state action value function. Environmental information carries out the first state action value of the channel aggregation mode corresponding to the t-th channel aggregation indication value; 2 ^{M-1 -1 corresponding to the channel environment information of the t-th time period, the primary channel and the M-} 1 secondary channels The candidate channel aggregation indicator value and the set state action value function determine the second state action value, where 2 ^M-1 -1 candidate channel aggregation indicator values correspond to 2 ^M-1 of the primary channel and M-1 secondary channels. -1 candidate channel aggregation mode, the second state action value is based on the channel environment information of the tth time period, respectively, 2 ^M-1 -1 candidate channel aggregation indication values corresponding to the state action values of the candidate channel aggregation mode maximum state action value; and determine the loss of the channel aggregation model based on the first state action value, the second state action value and the reward value of the t-th channel aggregation indication value based on the channel aggregation model; based on the loss of the channel aggregation model, the channel aggregation model Aggregate models for training updates.

As shown in Figure 11, this application also provides a communication device 1100, including a processor 1110 and an interface circuit 1120. The processor 1110 and the interface circuit 1120 are coupled to each other. It can be understood that the interface circuit 1120 can be a transceiver, an input-output interface, an input interface, an output interface, a communication interface, etc. Optionally, the communication device 1100 may also include a memory 1130 for storing instructions executed by the processor 1110 or input data required for the processor 1110 to run the instructions or data generated after the processor 1110 executes the instructions. Optionally, the memory 1130 can also be integrated with the processor 1110 .

When the communication device 1100 is used to implement the method shown in Figure 6, the processor 1110 can be used to implement the functions of the above-mentioned processing unit 1010, and the interface circuit 1120 can be used to implement the functions of the above-mentioned interface unit 1020.

As shown in Figure 12, a schematic structural diagram of a device is provided according to an embodiment of the present application. The device may be a network device or a first terminal device. The device may include a processor, a transceiver and an antenna. The processor may include a Multiple processing units are obtained. Different processing units can be independent devices or integrated into one or more processors. Among them, the processor can be the nerve center and command center of the device. The processor can generate operation control signals based on the instruction opcode and timing signals to complete the operations of fetching and executing instructions. In the embodiment of the present application, the processor can execute the corresponding channel aggregation method process according to the instructions corresponding to the channel aggregation method; the transceiver and the antenna can receive signals from other devices and transmit them to the processor or send signals from the processor to Other equipment.

In addition, the device can also include a neural-network processing unit (NPU), which implements training and updating of the channel aggregation model (i.e., neural network model), and performs calculation output based on the information of the input channel aggregation model. Channel aggregation mode (or channel aggregation indication value corresponding to the channel aggregation mode). It can be understood that the NPU can include an inference module and a training module, where the training module can be used to implement training and update of the channel aggregation model (ie, neural network model). The inference module can implement calculations and output channel aggregation methods based on the information of the input channel aggregation model. In addition, the NPU may be coupled to the central processing unit, which is not limited in this application.

It can be understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or other general-purpose processor, digital signal processor (DSP), application specific integrated circuit (Application Specific Integrated Circuit). specific integrated circuit (ASIC), logic circuit, field programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. A general-purpose processor can be a microprocessor or any conventional processor.

The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. Software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory, flash memory, read-only memory, programmable read-only memory, erasable programmable read-only memory, electrically erasable programmable read-only memory In memory, register, hard disk, mobile hard disk, CD-ROM or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor such that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and storage media may be located in an ASIC. Additionally, the ASIC can be located in network equipment or terminal equipment. Of course, the processor and the storage medium can also exist as discrete components in network equipment or terminal equipment.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are executed in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, a network device, a user equipment, or other programmable device. The computer program or instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer program or instructions may be transmitted from a network device, terminal, A computer, server or data center transmits via wired or wireless means to another network device, terminal, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media, such as floppy disks, hard disks, and tapes; optical media, such as digital video optical disks; or semiconductor media, such as solid-state hard drives. The computer-readable storage medium may be volatile or nonvolatile storage media, or may include both volatile and nonvolatile types of storage media.

In the various embodiments of this application, if there is no special explanation or logical conflict, the terms and/or descriptions between different embodiments are consistent and can be referenced to each other. The technical features in different embodiments are based on their inherent Logical relationships can be combined to form new embodiments.

In addition, it should be understood that in the embodiments of this application, the word "exemplary" is used to mean an example, illustration or explanation. Any embodiment or design described herein as "example" is not intended to be construed as preferred or advantageous over other embodiments or designs. Rather, the use of the word example is intended to present a concept in a concrete way.

It can be understood that the various numerical numbers involved in the embodiments of the present application are only for convenience of description and are not used to limit the scope of the embodiments of the present application. The size of the serial numbers of the above processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic.

Claims (21)

1. A method of channel aggregation, comprising:

a first terminal device receives a load report from a network device, wherein the load report comprises load information of each channel in M channels of the network device in a t-th time period, the M channels comprise 1 main channel and M-1 secondary channels corresponding to the first terminal device, M is an integer greater than or equal to 2, and t is an integer greater than or equal to 2;

The first terminal equipment inputs channel environment information of the t-th time period into the channel aggregation model for processing to obtain a t-th channel aggregation indicated value, wherein the channel environment information of the t-th time period comprises load information of each secondary channel in the t-th time period in the main channel and the M-1 secondary channels and channel state monitoring information obtained by the first terminal equipment in the t-th time period for monitoring channel states of the main channel and the M-1 secondary channels, and the t-th channel aggregation indicated value is used for indicating N secondary channels in the M-1 secondary channels to aggregate with the main channel, and N is an integer which is more than or equal to 0 and less than or equal to M-1;

and the first terminal equipment transmits a data packet through the channel aggregated by the main channel and the N secondary channels in the t+1th time period, wherein the t+1th time period is a time period after the t time period.

2. The method of claim 1, wherein the channel state monitoring information obtained by the first terminal device performing channel state monitoring on the primary channel and the M-1 secondary channels in the t-th time period includes one or more of:

The first terminal equipment monitors the busy state of each time unit of the main channel and each secondary channel of the M-1 secondary channels in the t-th time period;

the data packet sending state of each time unit of the first terminal device on each secondary channel of the primary channel and the M-1 secondary channels, wherein the data packet sending state of each time unit of the first terminal device is monitored by the first terminal device in the t-th time period;

and the first terminal equipment monitors the number of time units of which the data packet sending state and the busy and idle state of the channel are kept unchanged and continuous on each secondary channel in the primary channel and the M-1 secondary channels in the t-th time period.

3. The method of claim 1 or 2, wherein the method further comprises:

the first terminal equipment determines a reward value of the t-1 channel aggregation indicated value based on the channel aggregation model according to the load information of each secondary channel in the t-1 time period of the main channel and N 'secondary channels, wherein the t-1 channel aggregation indicated value is used for indicating the N' secondary channels in the M-1 secondary channels to aggregate with the main channel;

The first terminal equipment determines a first state action value of a channel aggregation mode corresponding to the t-1 channel aggregation indicated value based on the channel environment information of the t-1 time period according to the channel environment information of the t-1 time period, the t-1 channel aggregation indicated value and a set state action value function;

the first terminal equipment receives the channel environment information of the t-1 time period, and 2 corresponding to the primary channel and the M-1 secondary channels according to the channel environment information of the t-1 time period ^M-1 -1 candidate channel aggregate indicator value and said set state action value function, determining a second state action value, wherein said 2 ^M-1 -1 candidate channel aggregate indicator value corresponds to 2 of the primary channel and the M-1 secondary channels ^{M -1} -1 candidate channel aggregation, wherein the second state action value is obtained by respectively performing the 2 th state actions based on the channel environment information of the t-1 th time period ^M-1 -a maximum state action value of state action values of candidate channel aggregation modes corresponding to the 1 candidate channel aggregation instruction values;

the first terminal equipment determines the loss of the channel aggregation model according to the first state action value, the second state action value and the rewarding value of the t-1 channel aggregation indicated value;

The first terminal equipment trains and updates the channel aggregation model according to the loss of the channel aggregation model;

wherein the N' is the same as or different from the N, and the t-1 th time period is a time period before the t-1 th time period.

4. The method of claim 1 or 2, wherein the method further comprises:

the first terminal equipment determines a reward value of a t-1 th channel aggregation indicated value based on the channel aggregation model according to load information of each secondary channel in the t-1 th time period of the main channel and N ' secondary channels, wherein the t-1 th channel aggregation indicated value is used for indicating that the N ' secondary channels in the M-1 secondary channels are aggregated with the main channel, N ' is the same as or different from N, and the t-1 th time period is a time period before the t-1 th time period;

the first terminal device inputs the channel environment information of the t-th time period into the channel aggregation model for processing to obtain a t-th channel aggregation indicated value, and the method comprises the following steps:

and the first terminal equipment inputs the channel environment information of the t-th time period and the rewarding value of the t-1 channel aggregation indicated value into the channel aggregation model for processing to obtain the t-th channel aggregation indicated value.

5. The method according to claim 3 or 4, wherein the first terminal device determining a prize value for the t-1 th channel aggregation indicator value based on the channel aggregation model according to load information of the primary channel and each of the N' secondary channels in the t-1 th time period, includes:

when the first terminal device does not collide with other terminal device transmitting data packets in the channel transmitting data packet aggregated by the main channel and the N 'secondary channels and the N' is not zero, the first terminal device performs the following steps Determining a reward value of the t-1 th channel aggregation indicated value based on the channel aggregation model;

wherein the R is _t Representing a prize value for deriving the t-1 th channel aggregate indicator value based on the channel aggregate model, the K representing a kth secondary channel of the N 'secondary channels, the K = 1, 2, …, N', theLoad information indicating that the kth secondary channel is in the t-1 time period.

6. The method according to claim 3 or 4, wherein the first terminal device determining a prize value for the t-1 th channel aggregation indicator value based on the channel aggregation model according to load information of the primary channel and each of the N' secondary channels in the t-1 th time period, includes:

When the first terminal device does not collide with other terminal device transmitting data packets in the channel transmitting data packet aggregated by the main channel and the N 'secondary channels and the N' is zero, the first terminal device performs the following steps Determining a reward value of the t-1 th channel aggregation indicated value based on the channel aggregation model;

wherein the R is _t A reward value representing the t-1 th channel aggregation instruction value obtained based on the channel aggregation model, theLoad information indicating the primary channel in the t-1 th time period.

7. The method according to claim 3 or 4, wherein the first terminal device determining a prize value for the t-1 th channel aggregation indicator value based on the channel aggregation model according to load information of the primary channel and each of the N' secondary channels in the t-1 th time period, includes:

when the first terminal device collides with the other terminal device transmitting data packet in the channel transmitting data packet aggregated by the main channel and the N 'secondary channels and the N' is not zero, the first terminal device performs the following steps Determining a reward value of the t-1 th channel aggregation indicated value based on the channel aggregation model;

Wherein the R is _t Representing a prize value for deriving the t-1 th channel aggregate indicator value based on the channel aggregate model, the K representing a kth secondary channel of the N 'secondary channels, the K = 1, 2, …, N', theLoad information representing said kth secondary channel in said t-1 th time period, said +.>Load information indicating the primary channel in the t-1 th time period.

8. The method according to claim 3 or 4, wherein the first terminal device determining a prize value for the t-1 th channel aggregation indicator value based on the channel aggregation model according to load information of the primary channel and each of the N' secondary channels in the t-1 th time period, includes:

when the first terminal device collides with the other terminal device transmitting data packet in the channel transmitting data packet aggregated by the main channel and the N' secondary channels, and the first terminal device transmits the data packet to the other terminal deviceWhen N' is zero, the first terminal equipment is according to the following conditionsDetermining a reward value of the t-1 th channel aggregation indicated value based on the channel aggregation model;

wherein the R is _t A reward value representing the t-1 th channel aggregation instruction value obtained based on the channel aggregation model, the Load information indicating the primary channel in the t-1 th time period.

9. The method of any of claims 1-8, wherein the load report further comprises an expiration of the t-th period.

10. A communication device, comprising an interface unit and a processing unit;

the interface unit is configured to receive a load report from a network device, where the load report includes load information of each channel in M channels of the network device in a t-th time period, where the M channels include 1 primary channel and M-1 secondary channels corresponding to the first terminal device, M is an integer greater than or equal to 2, and t is an integer greater than or equal to 2;

the processing unit is configured to input channel environment information of the t-th time period into the channel aggregation model for processing, so as to obtain a t-th channel aggregation indicated value, where the channel environment information of the t-th time period includes load information of each secondary channel in the t-th time period in the primary channel and the M-1 secondary channels, and channel state monitoring information obtained by monitoring channel states of the primary channel and the M-1 secondary channels in the t-th time period, and the t-th channel aggregation indicated value is used to indicate that N secondary channels in the M-1 secondary channels are aggregated with the primary channel, where N is an integer greater than or equal to 0 and less than or equal to the M-1; and transmitting a data packet through the channel aggregated by the primary channel and the N secondary channels in a t+1th time period, wherein the t+1th time period is a time period after the t time period.

11. The apparatus of claim 10, wherein the channel state monitoring information obtained by the processing unit channel state monitoring the primary channel and the M-1 secondary channels for the nth time period comprises one or more of:

the processing unit monitors the busy state of each time unit of each of the primary channel and the M-1 secondary channels in the t-th time period;

the processing unit monitors the data packet transmission state of each time unit of the communication device on each secondary channel of the primary channel and the M-1 secondary channels in the t-th time period;

the processing unit monitors the number of time units of which the data packet sending state and the busy state of the channel of the communication device in each secondary channel in the primary channel and the M-1 secondary channels are kept unchanged and continuous in the t time period.

12. The apparatus of claim 10 or 11, wherein the processing unit is further configured to:

determining a reward value of the t-1 th channel aggregation indicated value based on the channel aggregation model according to the load information of each secondary channel in the t-1 th time period of the primary channel and the N 'secondary channels, wherein the t-1 th channel aggregation indicated value is used for indicating the N' secondary channels in the M-1 secondary channels to aggregate with the primary channel;

Determining a first state action value of a channel aggregation mode corresponding to the t-1 th channel aggregation indicated value based on the channel environment information of the t-1 st time period according to the channel environment information of the t-1 th time period, the t-1 th channel aggregation indicated value and a set state action value function;

according to the channel environment information of the t-1 time period, the main channel corresponds to 2 of the M-1 secondary channels ^M-1 -1 candidate channel aggregate indicator value and said set state action value function, determining a second state action value, wherein said 2 ^{M -1} -1 candidate channel aggregate indicator value corresponds to 2 of the primary channel and the M-1 secondary channels ^M-1 -1 candidate channel aggregation, wherein the second state action value is obtained by respectively performing the 2 th state actions based on the channel environment information of the t-1 th time period ^M-1 -a maximum state action value of state action values of candidate channel aggregation modes corresponding to the 1 candidate channel aggregation instruction values;

determining a loss of the channel aggregation model according to the first state action value, the second state action value and the rewarding value of the t-1 channel aggregation indicated value; training and updating the channel aggregation model according to the loss of the channel aggregation model;

Wherein the N' is the same as or different from the N, and the t-1 th time period is a time period before the t-1 th time period.

13. The apparatus of claim 10 or 11, wherein the processing unit is further configured to:

determining a reward value of the t-1 th channel aggregation indicated value based on the channel aggregation model according to the load information of each secondary channel in the t-1 th time period of the primary channel and N ' secondary channels, wherein the t-1 th channel aggregation indicated value is used for indicating the N ' secondary channels in the M-1 secondary channels to aggregate with the primary channel, N ' is the same as or different from N, and the t-1 th time period is a time period before the t time period;

and inputting the channel environment information of the t-th time period into the channel aggregation model for processing, and when the t-th channel aggregation indicated value is obtained, inputting the channel environment information of the t-th time period and the rewarding value of the t-1-th channel aggregation indicated value into the channel aggregation model for processing, so as to obtain the t-th channel aggregation indicated value.

14. The apparatus according to claim 12 or 13, wherein the processing unit is configured to, when determining the prize value of the t-1 th channel aggregation indicator value based on the channel aggregation model according to the load information of the primary channel and each of the N' secondary channels in the t-1 th time period, specifically:

When the interface unit does not collide with other terminal equipment transmitting data packets in the channel transmitting data packets aggregated by the main channel and the N 'secondary channels and the N' is not zero, the processing unit processes the data packets according to the following conditions Determining a reward value of the t-1 th channel aggregation indicated value based on the channel aggregation model;

wherein the R is _t Representing a prize value for deriving the t-1 th channel aggregate indicator value based on the channel aggregate model, the K representing a kth secondary channel of the N 'secondary channels, the K = 1, 2, …, N', theLoad information indicating that the kth secondary channel is in the t-1 time period.

15. The apparatus according to claim 12 or 13, wherein the processing unit is configured to, when determining the prize value of the t-1 th channel aggregation indicator value based on the channel aggregation model according to the load information of the primary channel and each of the N' secondary channels in the t-1 th time period, specifically:

when the channel transmission data packet aggregated by the interface unit in the main channel and the N' secondary channels does not collide with other terminal equipment transmission data packets, and the interface unit receives the channel transmission data packet from the other terminal equipment When N' is zero, the processing unit is used for processing the data according to the following conditionsDetermining a reward value of the t-th channel aggregation indicated value based on the channel aggregation model;

wherein the R is _t A reward value representing the t-1 th channel aggregation instruction value obtained based on the channel aggregation model, theLoad information indicating the primary channel in the t-1 th time period.

16. The apparatus according to claim 12 or 13, wherein the processing unit is configured to, when determining the prize value of the t-1 th channel aggregation indicator value based on the channel aggregation model according to the load information of the primary channel and each of the N' secondary channels in the t-1 th time period, specifically:

when the interface unit collides with the data packets sent by other terminal equipment in the channel after the aggregation of the main channel and the N 'secondary channels and the N' is not zero, the processing unit processes the data packets according to the following conditions Determining a reward value of the t-1 th channel aggregation indicated value based on the channel aggregation model;

wherein the R is _t Representing a prize value for deriving the t-1 th channel aggregate indicator value based on the channel aggregate model, the K representing a kth secondary channel of the N 'secondary channels, the K = 1, 2, …, N', the Represents the KthLoad information of the sub-channels in said t-1 th time period, said +.>Load information indicating the primary channel in the t-1 th time period.

17. The apparatus according to claim 12 or 13, wherein the processing unit is configured to, when determining the prize value of the t-1 th channel aggregation indicator value based on the channel aggregation model according to the load information of the primary channel and each of the N' secondary channels in the t-1 th time period, specifically:

when the interface unit collides with the data packets sent by other terminal equipment and the data packets sent by the channel after the aggregation of the main channel and the N 'secondary channels and the N' is zero, the processing unit processes the data packets according to the following conditionsDetermining a reward value of the t-1 th channel aggregation indicated value based on the channel aggregation model;

wherein the R is _t A reward value representing the t-1 th channel aggregation instruction value obtained based on the channel aggregation model, theLoad information indicating the primary channel in the t-1 th time period.

18. The apparatus of any of claims 10-17, wherein the load report further comprises an expiration of the t-th period.

19. A computer program product comprising instructions which, when executed, cause the method of any one of claims 1-9 to be implemented.

20. A chip for implementing the method according to any one of claims 1-9.

21. A computer readable storage medium, characterized in that the storage medium has stored therein a computer program or instructions, which when executed, cause the method according to any of claims 1-9 to be implemented.