WO2023029751A1 - Adaptive coding and modulation method and apparatus, electronic device and storage medium - Google Patents

Adaptive coding and modulation method and apparatus, electronic device and storage medium Download PDF

Info

Publication number
WO2023029751A1
WO2023029751A1 PCT/CN2022/104761 CN2022104761W WO2023029751A1 WO 2023029751 A1 WO2023029751 A1 WO 2023029751A1 CN 2022104761 W CN2022104761 W CN 2022104761W WO 2023029751 A1 WO2023029751 A1 WO 2023029751A1
Authority
WO
WIPO (PCT)
Prior art keywords
mcs
value
user
model
machine learning
Prior art date
Application number
PCT/CN2022/104761
Other languages
French (fr)
Chinese (zh)
Inventor
林志远
林伟
刘向凤
芮华
黄河
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2023029751A1 publication Critical patent/WO2023029751A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B17/00Monitoring; Testing
    • H04B17/30Monitoring; Testing of propagation channels
    • H04B17/391Modelling the propagation channel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received

Definitions

  • the embodiments of the present application relate to the communication field, and in particular to an adaptive coding and modulation method, device, electronic equipment, and storage medium.
  • Adaptive Modulation and Coding is an adaptive coding and modulation technology used on wireless channels. It ensures the transmission quality of links by adjusting the modulation mode and coding rate of wireless link transmission.
  • the implementation principle of AMC can be simply described as: using channel-related characteristic parameters to adaptively adjust the Modulation and Coding Scheme (MCS for short).
  • AMC Since AMC is user-oriented, in the method of obtaining the MCS value, a specific formula will be used to describe the corresponding relationship between the MCS value and the characteristic parameters.
  • the characteristic parameters such as Channel Quality Indicator (Channel Quality Indicator, CQI) and the number of streams are substituted into a specific formula to calculate the MCS value.
  • CQI Channel Quality Indicator
  • the relationship between the MCS value and the characteristic parameters is different in different transmission scenarios. Still using this specific formula to calculate the MCS value cannot fit different transmission scenarios, which will lead to low accuracy of the calculated MCS.
  • An embodiment of the present application provides an adaptive coding and modulation method, including: obtaining characteristic parameters, wherein the characteristic parameters include data representing the user's transmission capability; inputting the characteristic parameters into the inner loop machine learning model to obtain MCS initial value; input the MCS initial value and the characteristic parameters into the outer loop machine learning model to obtain the MCS adjustment value corresponding to the MCS initial value; according to the adjustment value corresponding to the MCS initial value and the MCS initial value value to get the adjusted MCS value.
  • the embodiment of the present application also provides an adaptive coding and modulation device, including: a parameter acquisition module, configured to acquire a characteristic parameter, wherein the characteristic parameter includes data representing the user's transmission capability; an initial value acquisition module, which obtains the The characteristic parameters are input into the inner loop machine learning model to obtain the initial value of the MCS; the adjustment value acquisition module is used to input the initial value of the MCS and the characteristic parameters into the outer loop machine learning model to obtain the corresponding MCS initial value MCS adjustment value; an adjustment module, configured to obtain an adjusted MCS value according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
  • a parameter acquisition module configured to acquire a characteristic parameter, wherein the characteristic parameter includes data representing the user's transmission capability
  • an initial value acquisition module which obtains the The characteristic parameters are input into the inner loop machine learning model to obtain the initial value of the MCS
  • the adjustment value acquisition module is used to input the initial value of the MCS and the characteristic parameters into the outer loop machine learning model to obtain the corresponding MCS initial value MCS
  • the embodiment of the present application also provides an electronic device, at least one processor; and a memory connected in communication with the at least one processor; wherein, the memory stores instructions executable by the at least one processor, The instructions are executed by the at least one processor, so that the at least one processor can execute the above adaptive coding and modulation method.
  • the embodiment of the present application also provides a computer-readable storage medium storing a computer program, and implementing the above-mentioned adaptive coding and modulation method when the computer program is executed by a processor.
  • FIG. 1 is a flow chart of an adaptive coding and modulation method provided according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of the interaction of various functional modules in an adaptive coding and modulation method provided according to an embodiment of the present application;
  • FIG. 3 is a schematic diagram of an inner-loop machine learning model in an adaptive coding and modulation method provided according to an embodiment of the present application
  • FIG. 4 is a schematic diagram of an outer-loop machine learning model in an adaptive coding and modulation method provided according to an embodiment of the present application
  • Fig. 5 is a flow chart of an adaptive coding and modulation method for obtaining characteristic parameters according to transmission types according to an embodiment of the present application
  • FIG. 6 is a schematic diagram of an adaptive coding and modulation device provided according to an embodiment of the present application.
  • Fig. 7 is a schematic structural diagram of an electronic device provided according to an embodiment of the present application.
  • the main purpose of the embodiments of the present application is to provide an adaptive coding and modulation method, device, electronic equipment and storage medium, which can improve the accuracy of MCS selection.
  • a specific formula is used to describe the corresponding relationship between the MCS value and the characteristic parameters.
  • the characteristic parameters such as Channel Quality Indicator (CQI for short) and the number of flows, Substitute into the specific formula to calculate the MCS value.
  • CQI Channel Quality Indicator
  • the characteristic parameters can also be used as the state (state), the MCS value can be used as the behavior (action), and the spectral efficiency or throughput brought by MCS-based transmission can be used as the reward (reward) for reinforcement learning.
  • the Q value under different states and behaviors, and choose the MCS value based on the Q value. The Q value will be updated in real time with the income of each feedback.
  • this embodiment provides an adaptive coding and modulation method, which can be applied to equipment such as base stations, but is not limited thereto.
  • the adaptive coding and modulation method in this embodiment includes: obtaining characteristic parameters, wherein the characteristic parameters include The data of the user's transmission ability; input the characteristic parameters into the inner loop machine learning model to obtain the initial MCS value; input the MCS initial value and the characteristic parameters into the outer loop machine learning model to obtain the MCS initial value A corresponding MCS adjustment value; an adjusted MCS value is obtained according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
  • the MCS value obtained based on the inner-loop machine learning model and the outer-loop machine learning model in this embodiment does not require a specific calculation formula for the MCS value, so that the input of the inner-loop machine learning model and the outer-loop
  • the characteristic parameters of the machine learning model can be determined according to the transmission scenario, and can be used in different transmission scenarios, which in turn helps to improve the accuracy of the MCS.
  • this embodiment inputs the characteristic parameters including the data representing the user's transmission capability into the inner-loop machine learning model to obtain the initial value of MCS, and inputs the initial MCS value and the characteristic parameters into the outer-loop machine Learn the model to get the adjusted value of MCS. Since the value range of the MCS adjusted value is smaller than that of the initial value of the MCS, when the MCS adjusted value is used as an action for training, the outer loop machine learning model The dimension of the behavior space is low, the scale of the neural network is small, and the computational complexity of obtaining the MCS adjustment value is low, thereby improving the efficiency of adaptive coding and modulation. Computational complexity of the MCS value.
  • Step 101 acquire feature parameters, where the feature parameters include data representing the user's transmission capability.
  • the feature parameters may include: the user's transmission stream number (LayerNum), channel quality indicator (Channel Quality Indicator, referred to as CQI), CQI link calculation SINR (CQI SINR), precoding matrix indicator (Precoding Matrix Indicator, referred to as PMI), rank indication (rank indication, referred to as RI), SINR calculated by the SRS link (SRS SINR) and other data representing the strength of the transmission capability of the user, which is not limited in this embodiment.
  • CQI channel quality indicator
  • CQI SINR CQI link calculation SINR
  • PMI precoding matrix indicator
  • rank indication rank indication
  • SINR calculated by the SRS link SINR
  • Step 102 input the feature parameters into the inner loop machine learning model to obtain the initial value of MCS.
  • the inner loop means that the base station determines the modulation and coding scheme (Modulation And Coding Scheme, MCS for short) of the uplink and downlink signals of the terminal according to the channel conditions of the terminal.
  • MCS Modulation And Coding Scheme
  • the inner loop machine learning model has classification and regression functions, and the inner loop machine learning model may be: a classification neural network, a regression neural network, a decision tree, etc., and this embodiment is not limited thereto.
  • feature parameter input is based on the AI-based AMC inner loop module in Figure 2, i.e. inner loop machine learning model, uses multilayer perceptron (Multilayer Perceptron, MLP for short) to come up in this module to the classification function.
  • multilayer perceptron Multilayer Perceptron, MLP for short
  • the schematic diagram of the MLP neural network is shown in Figure 3, which includes an input layer, multiple hidden layers, and an output layer.
  • the number of input layer nodes is equal to the number of input characteristic parameters.
  • the input characteristic parameters include: the number of transmission streams (LayerNum), the SINR calculated by the CQI link (CQI SINR), the SINR calculated by the PMI, RI, and SRS links (SRS SINR), etc.
  • LayerNum the number of transmission streams
  • CQI SINR CQI link
  • SRS SINR SRS links
  • the number of hidden layers and the number of nodes in each layer of the MLP neural network can be configured, and the number of nodes in the output layer is equal to the number of different MCS values, for example, 0-27 can be configured.
  • the MLP neural network is mainly used for classification tasks: the MLP network outputs predicted values corresponding to 0-27 different MCS values, and the MCS value with the largest predicted value can be used as the initial value of the MCS.
  • Step 103 input the MCS initial value, characteristic parameters, and the value range of the MCS adjustment value into the outer loop machine learning model to obtain the MCS adjustment value corresponding to the MCS initial value.
  • the outer loop refers to the process of determining the MCS adjustment value.
  • the outer loop machine learning model can make decisions based on a series of input parameters, for example, the outer loop machine learning model is: reinforcement learning neural network.
  • the neural network in the AI-based AMC outer-loop module in Figure 2 is the outer-loop machine learning model, and the characteristic parameters can be input into the AI-based AMC outer-loop module to obtain the MCS adjustment value.
  • the outer loop machine learning model is a deep Q network (Deep Q network, DQN for short).
  • the DQN network can include multiple convolutional neural networks, fully connected networks, etc.
  • the specific network types, numbers and scales are configurable.
  • the DQN network outputs the Q function value Q(state, action) corresponding to different actions (action) in the state (state).
  • the schematic diagram of the DQN network can be referred to as shown in FIG. 4 .
  • the characteristic parameters representing the state such as LayerNum, CQI SINR, PMI, RI, SRS SINR and MCS initial value, and the MCS adjustment value representing the behavior are input into the enhanced Q network representing the outer ring of AMC (Deep Q Learning, DQN) network.
  • the MCS adjustment value may be 0, +1, -1, +2, -2, etc., representing an adjustment value adjusted on the basis of the original MCS initial value.
  • the number of possible values of the input MCS adjustment value is less than the number of possible values of the initial MCS value.
  • the ⁇ -greedy method can be used, that is, a behavior is randomly selected with probability ⁇ Output as the MCS adjustment value; the probability 1- ⁇ selects the behavior with the largest Q function value as the MCS adjustment value output.
  • the ⁇ -greedy method can avoid the selected MCS adjustment value from falling into local optimum.
  • both the MCS adjustment value and the MCS initial value can be input into the outer loop module learning module for subsequent outer loop model learning
  • the module obtains the outer ring model sample data according to the MCS adjustment value and the MCS initial value, and trains the outer ring model parameters in the outer ring machine learning model based on the outer ring model data.
  • Step 104 Obtain an adjusted MCS value according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
  • the transmission module in Figure 2 After obtaining the adjusted MCS value, the transmission module in Figure 2 performs signal transmission according to the adjusted MCS value, and then feeds back the feedback value of the transmission result, such as Ack/Nack, to the inner loop model learning module, that is, the inner loop machine learning
  • the training module of the model and the learning module of the outer ring model that is, the training module of the outer ring machine learning model.
  • the inner loop model learning module trains the inner loop model parameters in the inner loop machine learning model according to the inner loop model sample data; wherein, the inner loop model sample data includes: adjusted MCS value, A transmission result of signal transmission using the adjusted MCS value, and the characteristic parameter.
  • the inner-loop model parameters in the inner-loop machine learning model are trained through offline learning, and the computational complexity of using offline learning is lower than that of online learning. Therefore, this embodiment can further reduce the learning complexity. .
  • the inner-loop model learning module in Figure 2 needs to update the inner-loop model according to the collected samples after receiving a certain amount of sample data of the inner-loop model or reaching a certain period, that is, to update the MLP network parameters , in the training process, the data whose feedback value of the transmission result is Ack is used to generate samples.
  • An inner loop model sample data includes LayerNum, CQI SINR, PMI, RI, SRS SINR and other characteristic parameters, and the adjusted MCS corresponding to these characteristic parameters value, and the transmission result Ack, the label of this sample is the adjusted MCS value.
  • a loss function can be defined, and based on the collected sample data of the inner ring model, the parameters of the inner ring model can be updated using the gradient descent method.
  • the outer ring model parameters in the outer ring machine learning model are trained according to the outer ring model sample data; wherein, the outer ring model sample data includes: the characteristic parameters, the MCS initial value, the The MCS adjustment value, the feedback value of the transmission result.
  • the parameters of the outer loop model are trained through online learning, and the parameters of the outer loop model are updated in real time through online learning to obtain the MCS adjustment value, so that the MCS can converge faster.
  • the transmission feedback value represents the reward (Reward) of the DQN network after taking a certain behavior.
  • the transmission result is Ack
  • the feedback of the transmission result that is, the return is equal to the spectral efficiency (SE) corresponding to the MCS value;
  • the transmission result feedback is Nack, the return is 0.
  • the process of training the parameters of the outer loop model according to the sample data of the outer loop model, ⁇ the state before taking action, behavior, reward, and the state after taking action ⁇ are obtained, and added to an Experience Replay Memory (Experience Replay Memory); Randomly sample some samples from the buffer to form a small-scale training set, and update the DQN network parameters based on these samples.
  • the update method is to calculate the loss function and use the gradient descent method.
  • the parameters of the inner loop model in the inner loop machine learning model of this embodiment are trained through offline learning; the parameters of the outer loop model in the outer loop machine learning model are trained through online learning.
  • the artificial intelligence method is applied to the inner loop and the outer loop at the same time, which can not only ensure the online adjustment capability of the AMC outer loop, but also reduce the complexity of the AMC outer loop model through accurate calculation of the AMC inner loop.
  • the outer-loop model learning module and the inner-loop model learning module can also adopt different learning methods. For example, after the outer-loop model learning module converges and stabilizes the parameters of the outer-loop model, it can use an offline learning method to reduce the external The update complexity of ring model parameters.
  • the learning module of the outer ring model can be directly configured as an offline learning method, periodically updating the outer ring model parameters, or triggering the update of the outer ring model parameters, that is, the inner ring model parameters and the outer ring model parameters.
  • the learning method of model parameters can be set according to actual needs.
  • the characteristic parameters including the data representing the user's transmission capability are input into the inner-loop machine learning model to obtain the initial value of the MCS, and the initial value of the MCS and the characteristic parameters are input into the outer-loop machine learning model to obtain the adjusted value of the MCS.
  • the value range of the adjustment value is smaller than the value range of the MCS initial value. Therefore, when the value range of the MCS adjustment value is used as the state for training, the behavior space dimension of the outer loop machine learning model is low, and the scale of the neural network is small. , the computational complexity of obtaining the MCS adjustment value is low, thereby improving the efficiency of adaptive coding and modulation.
  • this embodiment trains the AMC inner-loop model parameters through offline learning, and trains the outer-loop model parameters through online learning, which can ensure The online adjustment capability of the AMC outer loop further reduces the complexity of the AMC outer loop model through the accurate calculation of the AMC inner loop. Moreover, compared with using the characteristic formula to calculate the AMC value, this embodiment calculates the AMC value through the machine learning model. value is more precise.
  • Embodiments of the present application also provide an adaptive coding and modulation method.
  • the adaptive coding and modulation method in this embodiment can be applied to a multi-user space division scenario.
  • the characteristic parameters obtained in this embodiment also include: interference capability parameters.
  • the flow chart of this embodiment can be seen as shown in Figure 5, including the following steps:
  • Step 501 detecting the transmission type.
  • Step 502 if the transmission type is single-user transmission, acquire data representing the transmission capability of the user.
  • Step 503 if the transmission type is multi-user space division transmission, then acquire data and interference capability parameters representing user transmission capabilities.
  • the interference capability parameters include: correlation parameters between interfering users in the space division user pairing combination where the user is located and the user's port, and each interfering user in the space division user pairing combination The number of transport streams interfering with the user.
  • the interference capability parameter is data that can characterize the interference between users in the empty allocation pair combination.
  • the user's inter-port correlation parameter can be the mean value or the maximum value of the inter-port correlation.
  • the MCS is often calculated based on a specific formula, that is, the MCS value is obtained by using the CQI link feedback value, the number of interfering user streams, and correlation parameters into a specific calculation formula, and the AMC outer ring maintenance is performed for a single user .
  • the AMC outer loop may not converge when changes in user pairing combinations lead to interference changes.
  • this embodiment can also comprehensively consider the user's own transmission capability and the interference capability between users, not only for single-user transmission scenarios, but also for multi-space division user transmission, so that the output of MCS value and MCS adjustment value is more accurate , in addition, this embodiment does not need to use a specific formula to calculate the inter-user interference value, this embodiment uses the inter-port correlation parameter of the user, and the transmission flow number of each interfering user in the space division user pairing combination as the input of the characteristic parameter, to realize The method is simpler, and the machine learning model can better capture the relationship between the interference between users and the MCS, making the calculated value more accurate and avoiding the interference caused by the AMC outer loop being user-oriented and not distinguishing interference. A situation where the MCS adjustment value does not converge occurs.
  • the input feature combination is constructed as follows:
  • one user in the combination is regarded as the main user, and other users are regarded as interference users, and the feature combination corresponding to the main user is constructed.
  • the space division combination is user 1, user 2, and user 3.
  • user 1 is used as the main user, and other users are used as interference users to construct a feature combination corresponding to user 1.
  • the number of transmission streams, SRS SINR, CQI SINR, PMI, RI, and the average or maximum value of the correlation between ports of the primary user 1 are selected as the data representing the user's transmission capability, that is, the above data is used as the measurement of the primary user's own transmission capability. Then, select the number of transmission streams of interfering user 2, the average or maximum value of the correlation between the ports of user 2 and user 1; finally, select the number of transmission streams of interfering user 3, the average or maximum value of the correlation between the ports of user 3 and user 1 value.
  • the above interference user parameters are used as data of the interference user interference capability. All the above parameters are arranged in a fixed order as the features of User1.
  • the features of user 2 and user 3 are respectively constructed, and the features corresponding to different users are input into the subsequent AMC inner loop and outer loop modules one by one.
  • Step 504 input the feature parameters into the inner loop machine learning model to obtain the initial value of MCS.
  • the characteristic parameter input corresponding to a certain main user represents in the multilayer perceptron (MLP, Multilayer Perceptron) neural network of AMC inner loop, the MLP neural network structure and single-user transmission
  • MLP multilayer perceptron
  • the MLP neural network structure is similar to that shown in Figure 3, except that the input characteristic parameters include the transmission capability parameters of the main user and the interference capability parameters of the interference user.
  • the MLP neural network is mainly used for classification tasks, and the MLP network outputs predicted values of different MCS values, and the MCS value with the largest predicted value can be used as the initial value of the primary user's MCS.
  • Step 505 input the initial MCS value and feature parameters into the outer-loop machine learning model to obtain the adjusted MCS value corresponding to the initial MCS value.
  • the input feature and MCS initial value representing the state, and the MCS adjustment value representing the behavior are input into the strengthened Q network (Deep Q Learning, DQN) network representing the AMC outer ring.
  • the MCS adjustment value may be 0, +1, -1, +2, -2, etc., representing an adjustment value adjusted on the basis of the original MCS initial value.
  • the DQN network structure is similar to the DQN network for single-user transmission, the difference is that the environmental parameters become environmental parameters in a multi-user scenario, including the transmission capability parameters of the primary user and the interference capability parameters of the interfering user.
  • the MCS initial value and MCS adjustment value need to be transmitted to the outer loop model learning module in Figure 2.
  • step 506 an adjusted MCS value is obtained according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
  • step 505 is substantially the same as step 103, and in order to avoid repetition in expression, details are not repeated in this embodiment.
  • the inner-ring model parameters in the inner-ring machine learning model are trained;
  • the outer ring model sample data of each user in the user pair combination trains the outer ring model parameters in the outer ring machine learning model.
  • the training method of the inner loop model parameters in this embodiment is roughly the same as the above embodiment. It is worth mentioning that since this embodiment supports multi-user space separation scenarios, feedback results from multiple space separation users will be received after each scheduling , so multiple inner-ring sample data corresponding to different main users in the space-separation user pairing combination will be generated. These inner-ring sample data will be stored by the inner-ring model learning module and wait for subsequent MLP network parameter update algorithm calls.
  • the training method of the outer ring model parameters in this embodiment is roughly the same. Since this embodiment supports multi-user space separation scenarios, this embodiment will obtain feedback results from multiple space separation users, so multiple outer ring model samples corresponding to different main users will be obtained. These samples will be put into the experience playback buffer at the same time, waiting for the subsequent call of the DQN network parameter update algorithm.
  • the model data is obtained by training the sample data of each user in the same space separation user pairing combination, which is more conducive to considering the interference factors between users, so that in the case of space separation, the MCS value can also gradually converge to the optimum, and further speed up convergence speed.
  • the transmission type is detected, different characteristic parameters are obtained for different transmission types, training is performed, and the adjusted MCS value is obtained.
  • the transmission type is detected, different characteristic parameters are obtained for different transmission types, training is performed, and the adjusted MCS value is obtained.
  • it can also only be used for single-user transmission scenarios or Only for multi-user air separation scenarios.
  • the parameters of the inner ring model are obtained by learning the successful transmission experience in history, and the initial value of the MCS is calculated through the inner ring model parameters and characteristic parameters, which can more accurately estimate the initial value of the MCS under the current environment parameters, and avoid single-user or multi-user In the case of space-division transmission, the conversion of the inner ring is inaccurate; moreover, this embodiment comprehensively considers the impact of various factors on the outer ring, such as the parameters related to the interference ability of the interfering user in a multi-user scenario to obtain the outer ring model parameters, and pass
  • the outer ring model parameters and user characteristic parameters including interference ability parameters calculate the adjustment value, which can more accurately estimate the MCS adjustment value in the current environment, and can avoid the outer ring only focusing on a single user and ignoring other dimensions, such as interference caused by users non-convergence phenomenon; in addition, the AMC outer loop of this embodiment can be adjusted online, and the AMC inner loop can be adjusted in real time, which can not only ensure the online adjustment ability of the AMC outer
  • step division of the above various methods is only for the sake of clarity of description. During implementation, it can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. ; Adding insignificant modifications or introducing insignificant designs to the algorithm or process, but not changing the core design of the algorithm and process are all within the scope of protection of this patent.
  • the embodiment of the present application also provides an adaptive coding and modulation device, as shown in FIG. 6 , including: a parameter acquisition module 601, configured to acquire characteristic parameters, wherein the characteristic parameters include data representing the user's transmission capability;
  • the initial value acquisition module 602 is used to input the characteristic parameters into the inner loop machine learning model to obtain the MCS initial value;
  • the adjustment value acquisition module 603 is used to input the MCS initial value and the characteristic parameters into the outer loop machine learning model to obtain an adjusted MCS value corresponding to the initial MCS value;
  • an adjustment module 604 configured to obtain an adjusted MCS value according to the adjusted value corresponding to the initial MCS value and the initial MCS value.
  • the parameter acquisition module 601 is further configured to detect the transmission type; wherein, the transmission type includes: single-user transmission and/or multi-user space division transmission; if the transmission type is multi-user space division transmission, then The characteristic parameter further includes: an interference capability parameter; wherein, the interference capability parameter represents data of an interference capability of an interfering user.
  • the interference capability parameters acquired by the parameter acquisition module 601 include: the correlation parameters between the ports of each interfering user in the space division user pairing combination where the user is located and the user, and the space division user pairing The number of transmit streams for each interfering user in the combination.
  • the adaptive coding and modulation device further includes a model training module, and the model training module is further used to train the inner-loop model parameters in the inner-loop machine learning model according to the inner-loop model sample data; wherein, the The inner loop model sample data includes: the adjusted MCS initial value, the feedback value of the transmission result of signal transmission using the adjusted MCS value, and the characteristic parameters; the outer loop machine learning is trained according to the outer loop model sample data Outer loop model parameters in the model; wherein, the outer loop model sample data includes: the characteristic parameters, the initial MCS value, the MCS adjustment value, and the feedback value of the transmission result.
  • the model training module is further used to train the inner loop machine according to the inner loop model sample data of each user in the space division user pairing combination where the user is located Inner-ring model parameters in the learning model; training outer-ring model parameters in the outer-ring machine learning model according to the outer-ring model sample data of each user in the space-separated user pairing combination where the user is located.
  • the inner loop machine learning model in the initial value acquisition module 602 is any of the following classification neural network, regression neural network, decision tree; the outer loop machine learning model in the adjustment value acquisition module 603 is reinforcement learning neural network network.
  • the parameters of the inner ring model in the inner ring machine learning model in the initial value acquisition module 602 are trained through offline learning; the outer ring model in the outer ring machine learning model in the adjustment value acquisition module 603 The parameters are trained by online learning.
  • this embodiment is a system embodiment corresponding to the above-mentioned method embodiment, and this embodiment can be implemented in cooperation with the above-mentioned method embodiment.
  • the relevant technical details mentioned in the foregoing method embodiments are still valid in this embodiment, and will not be repeated here in order to reduce repetition.
  • the relevant technical details mentioned in this embodiment can also be applied in the first embodiment.
  • modules involved in this embodiment are logical modules.
  • a logical unit can be a physical unit, or a part of a physical unit, or multiple physical units. Combination of units.
  • units that are not closely related to solving the technical problem proposed in the present application are not introduced in this embodiment, but this does not mean that there are no other units in this embodiment.
  • the embodiment of the present application also provides an electronic device, as shown in FIG. 7 , including at least one processor 701; and a memory 702 connected in communication with the at least one processor 701; Instructions executed by the at least one processor 701, the instructions executed by the at least one processor 701, so that the at least one processor 701 can execute the above adaptive coding and modulation method.
  • the memory and the processor are connected by a bus
  • the bus may include any number of interconnected buses and bridges, and the bus connects one or more processors and various circuits of the memory together.
  • the bus may also connect together various other circuits such as peripherals, voltage regulators, and power management circuits, all of which are well known in the art and therefore will not be further described herein.
  • the bus interface provides an interface between the bus and the transceivers.
  • a transceiver may be a single element or multiple elements, such as multiple receivers and transmitters, providing means for communicating with various other devices over a transmission medium.
  • the data processed by the processor is transmitted on the wireless medium through the antenna, further, the antenna also receives the data and transmits the data to the processor.
  • the processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interface, voltage regulation, power management, and other control functions. Instead, memory can be used to store data that the processor uses when performing operations.
  • Embodiments of the present application also provide a computer-readable storage medium storing a computer program.
  • the above method embodiments are implemented when the computer program is executed by the processor.
  • a storage medium includes several instructions to make a device ( It may be a single-chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disc, etc., which can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Electromagnetism (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

An adaptive coding and modulation method and apparatus, an electronic device, and a storage medium, the method comprising: acquiring feature parameters, wherein the feature parameters comprise data which represents user transmission capabilities (101); inputting the feature parameters into an inner loop machine learning model to obtain an MCS initial value (102); inputting the MCS initial value and the feature parameters into an outer loop machine learning model to obtain an MCS adjustment value corresponding to the MCS initial value (103); and obtaining an adjusted MCS value according to the adjustment value corresponding to the MCS initial value and the MCS initial value (104).

Description

自适应编码调制方法、装置、电子设备和存储介质Adaptive coding and modulation method, device, electronic equipment and storage medium
相关申请的交叉引用Cross References to Related Applications
本申请基于申请号为“202111014423.5”、申请日为2021年8月31日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此以引入方式并入本申请。This application is based on the Chinese patent application with the application number "202111014423.5" and the filing date is August 31, 2021, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated by reference. Apply.
技术领域technical field
本申请实施例涉及通信领域,特别涉及一种自适应编码调制方法、装置、电子设备和存储介质。The embodiments of the present application relate to the communication field, and in particular to an adaptive coding and modulation method, device, electronic equipment, and storage medium.
背景技术Background technique
自适应调制编码(Adaptive Modulation and Coding,简称AMC)是无线信道上采用的一种自适应的编码调制技术,通过调整无线链路传输的调制方式与编码速率,来确保链路的传输质量。AMC的实现原理可以简单描述为:使用信道相关的特征参数来自适应地调整调制编码方式(Modulation and Coding Scheme,简称MCS)。Adaptive Modulation and Coding (AMC) is an adaptive coding and modulation technology used on wireless channels. It ensures the transmission quality of links by adjusting the modulation mode and coding rate of wireless link transmission. The implementation principle of AMC can be simply described as: using channel-related characteristic parameters to adaptively adjust the Modulation and Coding Scheme (MCS for short).
由于AMC是面向用户的,在获取MCS值的方法中,会使用特定的公式描述MCS值和特征参数的对应关系,在计算MCS值时,将该特征参数,如信道质量指示(Channel Quality Indicator,CQI)和流数,代入特定的公式以计算出MCS值。而在不同的传输场景下MCS值和特征参数的关系是不同的,仍使用该特定的公式计算MCS值,无法贴合于不同传输场景,会导致计算出的MCS准确率低。Since AMC is user-oriented, in the method of obtaining the MCS value, a specific formula will be used to describe the corresponding relationship between the MCS value and the characteristic parameters. When calculating the MCS value, the characteristic parameters, such as Channel Quality Indicator (Channel Quality Indicator, CQI) and the number of streams are substituted into a specific formula to calculate the MCS value. However, the relationship between the MCS value and the characteristic parameters is different in different transmission scenarios. Still using this specific formula to calculate the MCS value cannot fit different transmission scenarios, which will lead to low accuracy of the calculated MCS.
发明内容Contents of the invention
本申请实施例提供了一种自适应编码调制方法,包括:获取特征参数,其中,所述特征参数中包括表征用户的传输能力的数据;将所述特征参数输入内环机器学习模型中,得到MCS初值;将所述MCS初值和所述特征参数输入外环机器学习模型中,得到所述MCS初值对应的MCS调整值;根据所述MCS初值对应的调整值和所述MCS初值得到调整后的MCS值。An embodiment of the present application provides an adaptive coding and modulation method, including: obtaining characteristic parameters, wherein the characteristic parameters include data representing the user's transmission capability; inputting the characteristic parameters into the inner loop machine learning model to obtain MCS initial value; input the MCS initial value and the characteristic parameters into the outer loop machine learning model to obtain the MCS adjustment value corresponding to the MCS initial value; according to the adjustment value corresponding to the MCS initial value and the MCS initial value value to get the adjusted MCS value.
本申请实施例还提供了一种自适应编码调制装置,包括:参数获取模块,用于获取特征参数,其中,所述特征参数中包括表征用户的传输能力的数据;初值获取模块,将所述特征参数输入内环机器学习模型中,得到MCS初值;调整值获取模块,用于将所述MCS初值和所述特征参数输入外环机器学习模型中,得到所述MCS初值对应的MCS调整值;调整模块,用于根据所述MCS初值对应的调整值和所述MCS初值得到调整后的MCS值。The embodiment of the present application also provides an adaptive coding and modulation device, including: a parameter acquisition module, configured to acquire a characteristic parameter, wherein the characteristic parameter includes data representing the user's transmission capability; an initial value acquisition module, which obtains the The characteristic parameters are input into the inner loop machine learning model to obtain the initial value of the MCS; the adjustment value acquisition module is used to input the initial value of the MCS and the characteristic parameters into the outer loop machine learning model to obtain the corresponding MCS initial value MCS adjustment value; an adjustment module, configured to obtain an adjusted MCS value according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
本申请实施例还提供了一种电子设备,至少一个处理器;以及,与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行上述的自适应编码调制方法。The embodiment of the present application also provides an electronic device, at least one processor; and a memory connected in communication with the at least one processor; wherein, the memory stores instructions executable by the at least one processor, The instructions are executed by the at least one processor, so that the at least one processor can execute the above adaptive coding and modulation method.
本申请实施例还提供了一种计算机可读存储介质,存储有计算机程序,所述计算机程序被处理器执行时实现上述的自适应编码调制方法。The embodiment of the present application also provides a computer-readable storage medium storing a computer program, and implementing the above-mentioned adaptive coding and modulation method when the computer program is executed by a processor.
附图说明Description of drawings
图1是根据本申请实施例提供的自适应编码调制方法的流程图;FIG. 1 is a flow chart of an adaptive coding and modulation method provided according to an embodiment of the present application;
图2是根据本申请实施例提供的自适应编码调制方法中各功能模块交互的示意图;FIG. 2 is a schematic diagram of the interaction of various functional modules in an adaptive coding and modulation method provided according to an embodiment of the present application;
图3是根据本申请实施例提供的自适应编码调制方法中内环机器学习模型的示意图;FIG. 3 is a schematic diagram of an inner-loop machine learning model in an adaptive coding and modulation method provided according to an embodiment of the present application;
图4是根据本申请实施例提供的自适应编码调制方法中外环机器学习模型的示意图;4 is a schematic diagram of an outer-loop machine learning model in an adaptive coding and modulation method provided according to an embodiment of the present application;
图5是根据本申请实施例提供的根据传输类型获取特征参数的自适应编码调制方法的流程图;Fig. 5 is a flow chart of an adaptive coding and modulation method for obtaining characteristic parameters according to transmission types according to an embodiment of the present application;
图6是根据本申请实施例提供的自适应编码调制装置的示意图;FIG. 6 is a schematic diagram of an adaptive coding and modulation device provided according to an embodiment of the present application;
图7是根据本申请实施例提供的电子设备的结构示意图。Fig. 7 is a schematic structural diagram of an electronic device provided according to an embodiment of the present application.
具体实施方式Detailed ways
本申请实施例的主要目的在于提出一种自适应编码调制方法、装置、电子设备和存储介质,能够提高MCS选择的准确率。The main purpose of the embodiments of the present application is to provide an adaptive coding and modulation method, device, electronic equipment and storage medium, which can improve the accuracy of MCS selection.
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合附图对本申请的各实施例进行详细的阐述。然而,本领域的普通技术人员可以理解,在本申请各实施例中,为了使读者更好地理解本申请而提出了许多技术细节。但是,即使没有这些技术细节和基于以下各实施例的种种变化和修改,也可以实现本申请所要求保护的技术方案。以下各个实施例的划分是为了描述方便,不应对本申请的具体实现方式构成任何限定,各个实施例在不矛盾的前提下可以相互结合相互引用。In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the embodiments of the present application will be described in detail below with reference to the accompanying drawings. However, those of ordinary skill in the art can understand that in each embodiment of the application, many technical details are provided for readers to better understand the application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical solution claimed in this application can also be realized. The division of the following embodiments is for the convenience of description, and should not constitute any limitation to the specific implementation of the present application, and the various embodiments can be combined and referred to each other on the premise of no contradiction.
在获取MCS值的方法中,会使用特定的公式描述MCS值和特征参数的对应关系,在计算MCS值时,将该特征参数,如信道质量指示(Channel Quality Indicator,简称CQI)和流数,代入特定的公式以计算出MCS值。In the method of obtaining the MCS value, a specific formula is used to describe the corresponding relationship between the MCS value and the characteristic parameters. When calculating the MCS value, the characteristic parameters, such as Channel Quality Indicator (CQI for short) and the number of flows, Substitute into the specific formula to calculate the MCS value.
而在不同的传输场景下,MCS值和特征参数的关系是不同的,该公式没有普适性,若仍使用该特定的公式计算MCS值,无法贴合于不同传输场景,会导致计算出的MCS准确率低。In different transmission scenarios, the relationship between the MCS value and the characteristic parameters is different. This formula is not universal. If the specific formula is still used to calculate the MCS value, it cannot be adapted to different transmission scenarios, which will lead to the calculated The accuracy of MCS is low.
在某些方案中,也可以将特征参数作为状态(state),将MCS值作为行为(action),将基于MCS进行传输而带来的频谱效率或吞吐量作为收益(reward),进行强化学习,得到不同状态和行为下的Q值,并基于Q值来选择MCS值。Q值会随每次反馈的收益进行实时更新。In some schemes, the characteristic parameters can also be used as the state (state), the MCS value can be used as the behavior (action), and the spectral efficiency or throughput brought by MCS-based transmission can be used as the reward (reward) for reinforcement learning. Get the Q value under different states and behaviors, and choose the MCS value based on the Q value. The Q value will be updated in real time with the income of each feedback.
然而,强化学习虽然能够根据反馈实时在线调整MCS值,但是MCS值的取值范围大,MCS值作为行为进行训练会致使MCS行为空间维度高,从而导致计算复杂度高,进而降低了自适应编码调制的效率。However, although reinforcement learning can adjust the MCS value online in real time according to the feedback, the value range of the MCS value is large, and the training of the MCS value as a behavior will lead to a high dimension of the MCS behavior space, resulting in high computational complexity, which in turn reduces the adaptive coding. modulation efficiency.
因此,本实施例提供一种自适应编码调制方法,可应用于基站等设备,但不限于此,本实施例的自适应编码调制方法包括:获取特征参数,其中,所述特征参数中包括表征用户的传输能力的数据;将所述特征参数输入内环机器学习模型中,得到MCS初值;将所述MCS初值和所述特征参数输入外环机器学习模型中,得到所述MCS初值对应的MCS调整值;根据所述MCS初值对应的调整值和所述MCS初值得到调整后的MCS值。Therefore, this embodiment provides an adaptive coding and modulation method, which can be applied to equipment such as base stations, but is not limited thereto. The adaptive coding and modulation method in this embodiment includes: obtaining characteristic parameters, wherein the characteristic parameters include The data of the user's transmission ability; input the characteristic parameters into the inner loop machine learning model to obtain the initial MCS value; input the MCS initial value and the characteristic parameters into the outer loop machine learning model to obtain the MCS initial value A corresponding MCS adjustment value; an adjusted MCS value is obtained according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
相较于使用特定公式计算MCS值,本实施例中的基于内环机器学习模型和外环机器学习 模型得到MCS值,无需特定的MCS值的计算公式,使得输入内环机器学习模型和外环机器学习模型的特征参数可以根据传输场景确定,能是用于不同的传输场景,进而有利于提高MCS的准确率。Compared with using a specific formula to calculate the MCS value, the MCS value obtained based on the inner-loop machine learning model and the outer-loop machine learning model in this embodiment does not require a specific calculation formula for the MCS value, so that the input of the inner-loop machine learning model and the outer-loop The characteristic parameters of the machine learning model can be determined according to the transmission scenario, and can be used in different transmission scenarios, which in turn helps to improve the accuracy of the MCS.
另外,相较于强化学习得到MCS值,本实施例将包括表征用户传输能力的数据的特征参数输入内环机器学习模型,得到MCS初值,将MCS初值和所述特征参数输入外环机器学习模型,得到MCS的调整值,由于MCS调整值的取值范围相较于MCS初值的取值范围较小,因此,MCS调整值的作为行为(action)进行训练时,外环机器学习模型的行为空间维度低,神经网络的规模小,得到MCS调整值的计算复杂度低,从而提高了自适应编码调制的效率,即本实施例在保证MCS值准确率的情况下,还尽量降低了MCS值的计算复杂度。In addition, compared with the MCS value obtained by reinforcement learning, this embodiment inputs the characteristic parameters including the data representing the user's transmission capability into the inner-loop machine learning model to obtain the initial value of MCS, and inputs the initial MCS value and the characteristic parameters into the outer-loop machine Learn the model to get the adjusted value of MCS. Since the value range of the MCS adjusted value is smaller than that of the initial value of the MCS, when the MCS adjusted value is used as an action for training, the outer loop machine learning model The dimension of the behavior space is low, the scale of the neural network is small, and the computational complexity of obtaining the MCS adjustment value is low, thereby improving the efficiency of adaptive coding and modulation. Computational complexity of the MCS value.
下面对本实施例的自适应编码调制方法的实现细节进行具体的说明,以下内容仅为方便理解提供的实现细节,并非实施本方案的必须。The implementation details of the adaptive coding and modulation method of this embodiment are described in detail below, and the following content is only implementation details provided for easy understanding, and is not necessary for implementing this solution.
步骤101,获取特征参数,其中,所述特征参数中包括表征用户的传输能力的数据。 Step 101, acquire feature parameters, where the feature parameters include data representing the user's transmission capability.
在一些实施例中,特征参数可以包括:用户的传输流数(LayerNum)、信道质量指示(Channel Quality Indicator,简称CQI)、CQI链路计算的SINR(CQI SINR)、预编码矩阵指示(Precoding Matrix Indicator,简称PMI)、秩指示(rank indication,简称RI)、SRS链路计算的SINR(SRS SINR)等表征用户的传输能力强弱的数据,本实施例不对此进行限定。In some embodiments, the feature parameters may include: the user's transmission stream number (LayerNum), channel quality indicator (Channel Quality Indicator, referred to as CQI), CQI link calculation SINR (CQI SINR), precoding matrix indicator (Precoding Matrix Indicator, referred to as PMI), rank indication (rank indication, referred to as RI), SINR calculated by the SRS link (SRS SINR) and other data representing the strength of the transmission capability of the user, which is not limited in this embodiment.
步骤102,将特征参数输入内环机器学习模型中,得到MCS初值。 Step 102, input the feature parameters into the inner loop machine learning model to obtain the initial value of MCS.
内环是指基站根据终端的信道条件确定该终端上下行信号的调制编码方式(Modulation And Coding Scheme,简称MCS)。The inner loop means that the base station determines the modulation and coding scheme (Modulation And Coding Scheme, MCS for short) of the uplink and downlink signals of the terminal according to the channel conditions of the terminal.
在一些实施例中,内环机器学习模型具有分类、回归功能,内环机器学习模型可以为:分类神经网络、回归神经网络、决策树等,本实施例不限于此。In some embodiments, the inner loop machine learning model has classification and regression functions, and the inner loop machine learning model may be: a classification neural network, a regression neural network, a decision tree, etc., and this embodiment is not limited thereto.
示例性的,参照图2所示,将特征参数输入图2中的基于AI的AMC内环模块,即内环机器学习模型,该模块中使用多层感知机(Multilayer Perceptron,简称MLP)来起到分类作用。Exemplary, with reference to shown in Figure 2, feature parameter input is based on the AI-based AMC inner loop module in Figure 2, i.e. inner loop machine learning model, uses multilayer perceptron (Multilayer Perceptron, MLP for short) to come up in this module to the classification function.
MLP神经网络示意图如图3所示,包含一个输入层,多个隐藏层,以及一个输出层。输入层节点数等于输入的特征参数的个数,如输入的特征参数包括:传输流数(LayerNum)、CQI链路计算的SINR(CQI SINR)、PMI、RI、SRS链路计算的SINR(SRS SINR)等,本实施例中MLP神经网络的隐藏层数和每层节点数可配置,输出层节点数等于不同MCS值的个数,例如可配置0~27。The schematic diagram of the MLP neural network is shown in Figure 3, which includes an input layer, multiple hidden layers, and an output layer. The number of input layer nodes is equal to the number of input characteristic parameters. For example, the input characteristic parameters include: the number of transmission streams (LayerNum), the SINR calculated by the CQI link (CQI SINR), the SINR calculated by the PMI, RI, and SRS links (SRS SINR), etc. In this embodiment, the number of hidden layers and the number of nodes in each layer of the MLP neural network can be configured, and the number of nodes in the output layer is equal to the number of different MCS values, for example, 0-27 can be configured.
在该实施例中,MLP神经网络主要用于分类任务:MLP网络输出0~27不同MCS值对应的预测值,可以将预测值最大的MCS值作为MCS初值。In this embodiment, the MLP neural network is mainly used for classification tasks: the MLP network outputs predicted values corresponding to 0-27 different MCS values, and the MCS value with the largest predicted value can be used as the initial value of the MCS.
步骤103,将MCS初值和特征参数、以及MCS调整值的取值范围输入外环机器学习模型中,得到MCS初值对应的MCS调整值。外环是指确定MCS调整值的过程。 Step 103, input the MCS initial value, characteristic parameters, and the value range of the MCS adjustment value into the outer loop machine learning model to obtain the MCS adjustment value corresponding to the MCS initial value. The outer loop refers to the process of determining the MCS adjustment value.
在一些实施例中,外环机器学习模型可以基于输入的一系列参数进行决策,如外环机器学习模型为:强化学习神经网络。图2中基于AI的AMC外环模块中的神经网络即为外环机器学习模型,可将特征参数输入基于AI的AMC外环模块得到MCS调整值。In some embodiments, the outer loop machine learning model can make decisions based on a series of input parameters, for example, the outer loop machine learning model is: reinforcement learning neural network. The neural network in the AI-based AMC outer-loop module in Figure 2 is the outer-loop machine learning model, and the characteristic parameters can be input into the AI-based AMC outer-loop module to obtain the MCS adjustment value.
示例性的,外环机器学习模型为深度Q网络(Deep Q network,简称DQN)。DQN网络可包含多个卷积神经网络、全连接网络等,具体网络种类、个数和规模可配置。DQN网络输出在该状态(state)下,不同行为(action)对应的Q函数值Q(state,action)。DQN网络示意图可参照图4所示。Exemplarily, the outer loop machine learning model is a deep Q network (Deep Q network, DQN for short). The DQN network can include multiple convolutional neural networks, fully connected networks, etc. The specific network types, numbers and scales are configurable. The DQN network outputs the Q function value Q(state, action) corresponding to different actions (action) in the state (state). The schematic diagram of the DQN network can be referred to as shown in FIG. 4 .
参照图4所示,将表征状态的特征参数,如LayerNum、CQI SINR、PMI、RI、SRS SINR和MCS初值,以及表征行为的MCS调整值,输入代表AMC外环的强化Q网络(Deep Q Learning,DQN)网络中。其中,MCS调整值可取值0,+1,-1,+2,-2等,代表在原有MCS初值基础上进行调整的调整值。输入的MCS调整值可能的取值个数小于MCS初值可能的取值个数。Referring to Figure 4, the characteristic parameters representing the state, such as LayerNum, CQI SINR, PMI, RI, SRS SINR and MCS initial value, and the MCS adjustment value representing the behavior are input into the enhanced Q network representing the outer ring of AMC (Deep Q Learning, DQN) network. Wherein, the MCS adjustment value may be 0, +1, -1, +2, -2, etc., representing an adjustment value adjusted on the basis of the original MCS initial value. The number of possible values of the input MCS adjustment value is less than the number of possible values of the initial MCS value.
在DQN网络输出不同行为,即MCS调整值0,-1,+1,-2,+2等,对应的不同Q函数值后,可以采用ε-greedy的方法,即以概率ε随机选择一个行为作为MCS调整值输出;概率1-ε选择Q函数值最大的行为作为MCS调整值输出。通过ε-greedy方法可避免选择的MCS调整值陷入局部最优的情况。After the DQN network outputs different behaviors, that is, MCS adjustment values 0, -1, +1, -2, +2, etc., and corresponding to different Q function values, the ε-greedy method can be used, that is, a behavior is randomly selected with probability ε Output as the MCS adjustment value; the probability 1-ε selects the behavior with the largest Q function value as the MCS adjustment value output. The ε-greedy method can avoid the selected MCS adjustment value from falling into local optimum.
在一些实施例中,当基于AI的AMC外环,即外环机器学习模型中得到MCS调整值后,可将MCS调整值和MCS初值均输入外环模块学习模块,以便后续外环模型学习模块根据MCS调整值和MCS初值得到外环模型样本数据,基于外环模型数据训练外环机器学习模型中的外环模型参数。In some embodiments, after the MCS adjustment value is obtained in the AI-based AMC outer loop, that is, the outer loop machine learning model, both the MCS adjustment value and the MCS initial value can be input into the outer loop module learning module for subsequent outer loop model learning The module obtains the outer ring model sample data according to the MCS adjustment value and the MCS initial value, and trains the outer ring model parameters in the outer ring machine learning model based on the outer ring model data.
步骤104,根据所述MCS初值对应的调整值和所述MCS初值得到调整后的MCS值。Step 104: Obtain an adjusted MCS value according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
在一些实施例中,将MLP网络输出的MCS初值加上DQN网络输出的MCS调整值,具体公式为MCS=min{max{MCS初值+MCS调整值,MCSmin},MCSmax};其中,MCSmax为最大MCS值,MCSmin为最小MCS值,以保证输出的MCS值不会大于MCSmax或小于MCSmin。In some embodiments, the MCS initial value output by the MLP network is added to the MCS adjustment value output by the DQN network, and the specific formula is MCS=min{max{MCS initial value+MCS adjustment value, MCSmin}, MCSmax}; where, MCSmax is the maximum MCS value, and MCSmin is the minimum MCS value to ensure that the output MCS value will not be greater than MCSmax or less than MCSmin.
在得到调整后的MCS值后,图2中的传输模块按照调整后的MCS值进行信号传输后,将传输结果的反馈值,如Ack/Nack反馈给内环模型学习模块,即内环机器学习模型的训练模块和外环模型学习模块,即外环机器学习模型的训练模块。After obtaining the adjusted MCS value, the transmission module in Figure 2 performs signal transmission according to the adjusted MCS value, and then feeds back the feedback value of the transmission result, such as Ack/Nack, to the inner loop model learning module, that is, the inner loop machine learning The training module of the model and the learning module of the outer ring model, that is, the training module of the outer ring machine learning model.
在一些实施例中,内环模型学习模块根据所内环模型样本数据训练所述内环机器学习模型中的内环模型参数;其中,所述内环模型样本数据包括:调整后的MCS值、使用所述调整后的MCS值进行信号传输的传输结果、所述特征参数。In some embodiments, the inner loop model learning module trains the inner loop model parameters in the inner loop machine learning model according to the inner loop model sample data; wherein, the inner loop model sample data includes: adjusted MCS value, A transmission result of signal transmission using the adjusted MCS value, and the characteristic parameter.
在一些实施例中,内环机器学习模型中的内环模型参数通过离线学习方式进行训练,采用离线学习方式相较于在线学习的计算复杂度低,因此,本实施例可以进一步降低学习复杂度。In some embodiments, the inner-loop model parameters in the inner-loop machine learning model are trained through offline learning, and the computational complexity of using offline learning is lower than that of online learning. Therefore, this embodiment can further reduce the learning complexity. .
示例性的,若采用离线方式更新,图2中的内环模型学习模块收到一定数量的内环模型样本数据或达到一定周期后,需要根据收集的样本更新内环模型,即更新MLP网络参数,在训练过程中,采用传输结果的反馈值为Ack的数据生成样本,一个内环模型样本数据包括LayerNum、CQI SINR、PMI、RI、SRS SINR等特征参数、这些特征参数对应的调整后的MCS值,以及传输结果Ack,该样本的标签为调整后的MCS值。Exemplarily, if the offline update is adopted, the inner-loop model learning module in Figure 2 needs to update the inner-loop model according to the collected samples after receiving a certain amount of sample data of the inner-loop model or reaching a certain period, that is, to update the MLP network parameters , in the training process, the data whose feedback value of the transmission result is Ack is used to generate samples. An inner loop model sample data includes LayerNum, CQI SINR, PMI, RI, SRS SINR and other characteristic parameters, and the adjusted MCS corresponding to these characteristic parameters value, and the transmission result Ack, the label of this sample is the adjusted MCS value.
在获取内环模型样本数据后,可以定义损失函数,基于采集的内环模型样本数据,采用梯度下降法更新内环模型参数。After obtaining the sample data of the inner ring model, a loss function can be defined, and based on the collected sample data of the inner ring model, the parameters of the inner ring model can be updated using the gradient descent method.
在一些实施例中,根据外环模型样本数据训练所述外环机器学习模型中的外环模型参数;其中,所述外环模型样本数据包括:所述特征参数、所述MCS初值、所述MCS调整值,所述传输结果的反馈值。In some embodiments, the outer ring model parameters in the outer ring machine learning model are trained according to the outer ring model sample data; wherein, the outer ring model sample data includes: the characteristic parameters, the MCS initial value, the The MCS adjustment value, the feedback value of the transmission result.
在一些实施例中,通过在线学习方式训练外环模型参数,通过在线学习,实时更新外环模型参数,得到MCS调整值,以使得MCS能够更快收敛。In some embodiments, the parameters of the outer loop model are trained through online learning, and the parameters of the outer loop model are updated in real time through online learning to obtain the MCS adjustment value, so that the MCS can converge faster.
示例性的,在收到传输结果反馈后,需要根据传输结果的反馈值实时更新外环模型参数,即更新DQN网络参数。传输反馈值代表了DQN网络在采取某种行为后的回报(Reward)。当传输结果为Ack时,传输结果的反馈,即回报等于MCS值对应的频谱效率(SE);当传输结果反馈为Nack时,回报为0。Exemplarily, after receiving the transmission result feedback, it is necessary to update the outer loop model parameters in real time according to the transmission result feedback value, that is, to update the DQN network parameters. The transmission feedback value represents the reward (Reward) of the DQN network after taking a certain behavior. When the transmission result is Ack, the feedback of the transmission result, that is, the return is equal to the spectral efficiency (SE) corresponding to the MCS value; when the transmission result feedback is Nack, the return is 0.
在训练外环模型参数的过程中,根据外环模型样本数据得到{采取行为前的状态,行为,回报,采取行为后的状态},将其加入一个经验回放缓存器(Experience Replay Memory)中;随机从缓存器中抽样部分样本,形成小规模训练集,并基于这些样本对DQN网络参数进行更新,更新方式为计算损失函数,并采用梯度下降法。In the process of training the parameters of the outer loop model, according to the sample data of the outer loop model, {the state before taking action, behavior, reward, and the state after taking action} are obtained, and added to an Experience Replay Memory (Experience Replay Memory); Randomly sample some samples from the buffer to form a small-scale training set, and update the DQN network parameters based on these samples. The update method is to calculate the loss function and use the gradient descent method.
本实施例的内环机器学习模型中的内环模型参数通过离线学习方式进行训练;外环机器学习模型中的外环模型参数通过在线学习方式进行训练。本实施例中,将人工智能方法同时应用于内环和外环,既能保障AMC外环的在线调整能力,又通过AMC内环的准确计算,降低AMC外环模型的复杂度。The parameters of the inner loop model in the inner loop machine learning model of this embodiment are trained through offline learning; the parameters of the outer loop model in the outer loop machine learning model are trained through online learning. In this embodiment, the artificial intelligence method is applied to the inner loop and the outer loop at the same time, which can not only ensure the online adjustment capability of the AMC outer loop, but also reduce the complexity of the AMC outer loop model through accurate calculation of the AMC inner loop.
在另一些实施例中,外环模型学习模块和内环模型学习模块也可以采用不同的学习方式,例如,外环模型学习模块在外环模型参数收敛稳定后,可采用离线学习方法以降低外环模型参数更新复杂度,又例如,外环模型学习模块可直接配置为离线学习方式,周期性更新外环模型参数,或者触发性的更新外环模型参数,即,内环模型参数和外环模型参数的学习方式可根据实际需求设置。In some other embodiments, the outer-loop model learning module and the inner-loop model learning module can also adopt different learning methods. For example, after the outer-loop model learning module converges and stabilizes the parameters of the outer-loop model, it can use an offline learning method to reduce the external The update complexity of ring model parameters. For example, the learning module of the outer ring model can be directly configured as an offline learning method, periodically updating the outer ring model parameters, or triggering the update of the outer ring model parameters, that is, the inner ring model parameters and the outer ring model parameters. The learning method of model parameters can be set according to actual needs.
本实施例将包括表征用户传输能力的数据的特征参数输入内环机器学习模型,得到MCS初值,将MCS初值和所述特征参数输入外环机器学习模型,得到MCS的调整值,由于MCS调整值的取值范围相较于MCS初值的取值范围较小,因此,MCS调整值的取值范围作为状态进行训练时,外环机器学习模型的行为空间维度低,神经网络的规模小,得到MCS调整值的计算复杂度低,从而提高了自适应编码调制的效率,另外,本实施例通过离线学习方式训练AMC内环模型参数,通过在线学习方式训练外环模型参数,既能保障AMC外环的在线调整能力,又通过AMC内环的准确计算,进一步降低AMC外环模型的复杂度,而且,相较于使用特征公式计算AMC值,本实施例通过机器学习模型计算得出的值更加精确。In this embodiment, the characteristic parameters including the data representing the user's transmission capability are input into the inner-loop machine learning model to obtain the initial value of the MCS, and the initial value of the MCS and the characteristic parameters are input into the outer-loop machine learning model to obtain the adjusted value of the MCS. The value range of the adjustment value is smaller than the value range of the MCS initial value. Therefore, when the value range of the MCS adjustment value is used as the state for training, the behavior space dimension of the outer loop machine learning model is low, and the scale of the neural network is small. , the computational complexity of obtaining the MCS adjustment value is low, thereby improving the efficiency of adaptive coding and modulation. In addition, this embodiment trains the AMC inner-loop model parameters through offline learning, and trains the outer-loop model parameters through online learning, which can ensure The online adjustment capability of the AMC outer loop further reduces the complexity of the AMC outer loop model through the accurate calculation of the AMC inner loop. Moreover, compared with using the characteristic formula to calculate the AMC value, this embodiment calculates the AMC value through the machine learning model. value is more precise.
本申请的实施例还提供一种自适应编码调制方法,本实施例的自适应编码调制方法可应用于多用户空分场景,本实施例获取的特征参数还包括:干扰能力参数。本实施例的流程图可参见图5所示,包括以下步骤:Embodiments of the present application also provide an adaptive coding and modulation method. The adaptive coding and modulation method in this embodiment can be applied to a multi-user space division scenario. The characteristic parameters obtained in this embodiment also include: interference capability parameters. The flow chart of this embodiment can be seen as shown in Figure 5, including the following steps:
步骤501,检测传输类型。 Step 501, detecting the transmission type.
步骤502,若传输类型为单用户传输,则获取表征用户的传输能力的数据。 Step 502, if the transmission type is single-user transmission, acquire data representing the transmission capability of the user.
步骤503,若传输类型为多用户空分传输,则获取表征用户的传输能力的数据和干扰能力参数。 Step 503, if the transmission type is multi-user space division transmission, then acquire data and interference capability parameters representing user transmission capabilities.
在一些实施例中,所述干扰能力参数包括:所述用户所在的空分用户配对组合中的各干扰用户与所述用户的端口间相关性参数,和所述空分用户配对组合中的各干扰用户的传输流数。干扰能力参数是能够表征空分配对组合中用户间干扰的数据。用户的端口间相关性参数可以为端口间相关性的均值或最大值。In some embodiments, the interference capability parameters include: correlation parameters between interfering users in the space division user pairing combination where the user is located and the user's port, and each interfering user in the space division user pairing combination The number of transport streams interfering with the user. The interference capability parameter is data that can characterize the interference between users in the empty allocation pair combination. The user's inter-port correlation parameter can be the mean value or the maximum value of the inter-port correlation.
在传统的技术方案中往往基于特定公式计算MCS,即,使用CQI链路反馈值和干扰用户流数、相关性等参数带入特定的计算公式得到MCS值,并且面向单个用户进行AMC外环维护。In the traditional technical solution, the MCS is often calculated based on a specific formula, that is, the MCS value is obtained by using the CQI link feedback value, the number of interfering user streams, and correlation parameters into a specific calculation formula, and the AMC outer ring maintenance is performed for a single user .
然而,在多用户传输的场景下,通过计算公式难以准确表示出用户间干扰,导致计算出的MCS值不准确。此外,当用户配对组合变化导致干扰变化时,AMC外环可能不收敛。However, in the scenario of multi-user transmission, it is difficult to accurately represent inter-user interference through calculation formulas, resulting in inaccurate calculated MCS values. In addition, the AMC outer loop may not converge when changes in user pairing combinations lead to interference changes.
鉴于此,本实施例还能综合考虑用户自身传输能力和用户间的干扰能力,不仅能够面向单用户传输场景,还能够面向多空分用户传输,让MCS值和MCS调整值的输出更为准确,另外,本实施例无需使用特定公式计算用户间干扰值,本实施例将用户的端口间相关性参数,和空分用户配对组合中的各干扰用户的传输流数作为特征参数的输入,实现方式更加简单,而且使用机器学习模型能够更好的捕捉用户间干扰和MCS之间的关系,使得计算出的值更加精确,避免了因AMC外环是面向用户的,不对干扰进行区分,导致的MCS调整值不收敛的情况发生。In view of this, this embodiment can also comprehensively consider the user's own transmission capability and the interference capability between users, not only for single-user transmission scenarios, but also for multi-space division user transmission, so that the output of MCS value and MCS adjustment value is more accurate , in addition, this embodiment does not need to use a specific formula to calculate the inter-user interference value, this embodiment uses the inter-port correlation parameter of the user, and the transmission flow number of each interfering user in the space division user pairing combination as the input of the characteristic parameter, to realize The method is simpler, and the machine learning model can better capture the relationship between the interference between users and the MCS, making the calculated value more accurate and avoiding the interference caused by the AMC outer loop being user-oriented and not distinguishing interference. A situation where the MCS adjustment value does not converge occurs.
示例性的,考虑到多用户空分传输,存在空分用户之间的干扰,因此选择主用户传输能力相关参数和干扰用户干扰能力相关参数。具体地,按照以下方式构造输入特征组合:Exemplarily, considering multi-user space division transmission, there is interference among space division users, so parameters related to the transmission capability of the primary user and parameters related to the interference capability of the interfering user are selected. Specifically, the input feature combination is constructed as follows:
对于给定的空分用户配对组合,逐一将组合内的某个用户作为主用户,其他用户作为干扰用户,构造主用户对应的特征组合。例如,空分组合为用户1,用户2,用户3,先将用户1作为主用户,其他用户作为干扰用户,来构造用户1对应的特征组合。For a given pairing combination of space-separated users, one user in the combination is regarded as the main user, and other users are regarded as interference users, and the feature combination corresponding to the main user is constructed. For example, the space division combination is user 1, user 2, and user 3. First, user 1 is used as the main user, and other users are used as interference users to construct a feature combination corresponding to user 1.
选择主用户1的传输流数、SRS SINR、CQI SINR、PMI、RI、端口间相关性的均值或最大值等作为表征用户传输能力的数据,即上述数据作为主用户自身传输能力的度量。然后,选择干扰用户2的传输流数、用户2与用户1端口间相关性的均值或最大值;最后,选择干扰用户3的传输流数、用户3与用户1端口间相关性的均值或最大值。上述干扰用户参数作为干扰用户干扰能力的数据。上述所有参数按固定顺序排列,作为用户1的特征。The number of transmission streams, SRS SINR, CQI SINR, PMI, RI, and the average or maximum value of the correlation between ports of the primary user 1 are selected as the data representing the user's transmission capability, that is, the above data is used as the measurement of the primary user's own transmission capability. Then, select the number of transmission streams of interfering user 2, the average or maximum value of the correlation between the ports of user 2 and user 1; finally, select the number of transmission streams of interfering user 3, the average or maximum value of the correlation between the ports of user 3 and user 1 value. The above interference user parameters are used as data of the interference user interference capability. All the above parameters are arranged in a fixed order as the features of User1.
采用同样的方法,分别构造用户2和用户3的特征,并逐一将不同用户对应的特征输入后续AMC内环和外环模块。Using the same method, the features of user 2 and user 3 are respectively constructed, and the features corresponding to different users are input into the subsequent AMC inner loop and outer loop modules one by one.
步骤504,将所述特征参数输入内环机器学习模型中,得到MCS初值。 Step 504, input the feature parameters into the inner loop machine learning model to obtain the initial value of MCS.
示例性的,若为多用户空分传输,将某个主用户对应的特征参数输入代表AMC内环的多层感知机(MLP,Multilayer Perceptron)神经网络中,MLP神经网络结构与单用户传输的MLP神经网络结构,即图3类似,不同之处在于输入的特征参数,包含主用户传输能力参数和干扰用户干扰能力参数。Illustratively, if it is multi-user space division transmission, the characteristic parameter input corresponding to a certain main user represents in the multilayer perceptron (MLP, Multilayer Perceptron) neural network of AMC inner loop, the MLP neural network structure and single-user transmission The MLP neural network structure is similar to that shown in Figure 3, except that the input characteristic parameters include the transmission capability parameters of the main user and the interference capability parameters of the interference user.
在该实施例中,MLP神经网络主要用于分类任务,MLP网络输出不同MCS值的预测值,并可以将预测值最大的MCS值作为主用户的MCS初值。In this embodiment, the MLP neural network is mainly used for classification tasks, and the MLP network outputs predicted values of different MCS values, and the MCS value with the largest predicted value can be used as the initial value of the primary user's MCS.
步骤505,将MCS初值和特征参数输入外环机器学习模型中,得到MCS初值对应的MCS调整值。 Step 505, input the initial MCS value and feature parameters into the outer-loop machine learning model to obtain the adjusted MCS value corresponding to the initial MCS value.
示例性的,若为多用户空分传输,将表征状态的输入特征和MCS初值,以及表征行为的MCS调整值,输入代表AMC外环的强化Q网络(Deep Q Learning,DQN)网络中。其中,MCS调整值可取值0,+1,-1,+2,-2等,代表了在原有MCS初值基础上进行调整的调整值。Exemplarily, if it is multi-user space division transmission, the input feature and MCS initial value representing the state, and the MCS adjustment value representing the behavior are input into the strengthened Q network (Deep Q Learning, DQN) network representing the AMC outer ring. Wherein, the MCS adjustment value may be 0, +1, -1, +2, -2, etc., representing an adjustment value adjusted on the basis of the original MCS initial value.
DQN网络结构与单用户传输的DQN网络类似,不同之处在于环境参数变成了多用户场景下的环境参数,包含主用户传输能力参数和干扰用户干扰能力参数。The DQN network structure is similar to the DQN network for single-user transmission, the difference is that the environmental parameters become environmental parameters in a multi-user scenario, including the transmission capability parameters of the primary user and the interference capability parameters of the interfering user.
在DQN网络输出不同行为(即MCS调整值0,-1,+1,-2,+2等)对应的不同Q函数值后,我们采用ε-greedy的方法:以概率ε随机选择一个行为作为MCS调整值输出;概率1-ε选择Q函数值最大的行为作为MCS调整值输出。After the DQN network outputs different Q function values corresponding to different behaviors (ie, MCS adjustment values 0, -1, +1, -2, +2, etc.), we use the ε-greedy method: randomly select a behavior with probability ε as MCS adjustment value output; the probability 1-ε selects the behavior with the largest Q function value as the MCS adjustment value output.
MCS初值和MCS调整值需要传输到图2中的外环模型学习模块。The MCS initial value and MCS adjustment value need to be transmitted to the outer loop model learning module in Figure 2.
步骤506,根据MCS初值对应的调整值和所述MCS初值得到调整后的MCS值。In step 506, an adjusted MCS value is obtained according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
本实施例中,步骤505与步骤103大致相同,为避免表达上的重复,本实施例不再赘述。In this embodiment, step 505 is substantially the same as step 103, and in order to avoid repetition in expression, details are not repeated in this embodiment.
在一些实施例中,根据所述用户所在的空分用户配对组合中各用户的内环模型样本数据,训练所述内环机器学习模型中的内环模型参数;根据所述用户所在的空分用户配对组合中各用户的外环模型样本数据训练所述外环机器学习模型中的外环模型参数。In some embodiments, according to the inner-ring model sample data of each user in the user pairing group where the user is located, the inner-ring model parameters in the inner-ring machine learning model are trained; The outer ring model sample data of each user in the user pair combination trains the outer ring model parameters in the outer ring machine learning model.
本实施例内环模型参数的训练方法与上述实施例大致相同,值得一提的是,由于本实施例支持多用户空分场景,在每次调度后会收到多个空分用户的反馈结果,因此会生成空分用户配对组合中不同主用户对应的多个内环样本数据,这些内环样本数据将被内环模型学习模块存储,等待后续MLP网络参数更新算法调用。The training method of the inner loop model parameters in this embodiment is roughly the same as the above embodiment. It is worth mentioning that since this embodiment supports multi-user space separation scenarios, feedback results from multiple space separation users will be received after each scheduling , so multiple inner-ring sample data corresponding to different main users in the space-separation user pairing combination will be generated. These inner-ring sample data will be stored by the inner-ring model learning module and wait for subsequent MLP network parameter update algorithm calls.
本实施例外环模型参数的训练方式大致相同,由于本实施例支持多用户空分场景,本实施例会得到多个空分用户的反馈结果,因此会得到不同主用户对应的多个外环模型样本数据,这些样本将同时放入经验回放缓存器中,等待后续DQN网络参数更新算法调用。The training method of the outer ring model parameters in this embodiment is roughly the same. Since this embodiment supports multi-user space separation scenarios, this embodiment will obtain feedback results from multiple space separation users, so multiple outer ring model samples corresponding to different main users will be obtained. These samples will be put into the experience playback buffer at the same time, waiting for the subsequent call of the DQN network parameter update algorithm.
通过同一空分用户配对组合中各用户的样本数据训练得到模型数据,更有利于考虑各用户之间的干扰因素,使得在空分情况下,MCS值也能逐渐收敛至最优,且进一步加快收敛速度。The model data is obtained by training the sample data of each user in the same space separation user pairing combination, which is more conducive to considering the interference factors between users, so that in the case of space separation, the MCS value can also gradually converge to the optimum, and further speed up convergence speed.
值得一提的是,本实施例中检测传输类型,针对不同的传输类型获取不同的特征参数,进行训练,得到调整后的MCS值,在实际应用过程中,也可仅针对单用户传输场景或者仅针对多用户空分场景。It is worth mentioning that in this embodiment, the transmission type is detected, different characteristic parameters are obtained for different transmission types, training is performed, and the adjusted MCS value is obtained. In the actual application process, it can also only be used for single-user transmission scenarios or Only for multi-user air separation scenarios.
本实施例通过学习历史上成功传输经验得到内环模型参数,通过内环模型参数和特征参数计算MCS初值,可以更准确的估计出当前环境参数下的MCS初值,避免单用户或多用户空分传输情况下内环折算不准确的问题;而且,本实施例的综合考虑多方面因素对外环的影响,例如多用户场景下干扰用户的干扰能力相关参数等得到外环模型参数,并通过外环模型参数和包括干扰能力参数的用户特征参数计算调整值,能够更准确的估计出当前环境下MCS调整值,可以避免外环只关注单用户而忽略其他维度,例如用户间干扰所造成的不收敛现象;另外,本实施例的AMC外环可进行在线调整,AMC内环可进行实时调整,既能保障AMC外环的在线调整能力,又通过AMC内环的准确计算降低AMC外环模型的复杂度,让AMC内外环输出更为准确。In this embodiment, the parameters of the inner ring model are obtained by learning the successful transmission experience in history, and the initial value of the MCS is calculated through the inner ring model parameters and characteristic parameters, which can more accurately estimate the initial value of the MCS under the current environment parameters, and avoid single-user or multi-user In the case of space-division transmission, the conversion of the inner ring is inaccurate; moreover, this embodiment comprehensively considers the impact of various factors on the outer ring, such as the parameters related to the interference ability of the interfering user in a multi-user scenario to obtain the outer ring model parameters, and pass The outer ring model parameters and user characteristic parameters including interference ability parameters calculate the adjustment value, which can more accurately estimate the MCS adjustment value in the current environment, and can avoid the outer ring only focusing on a single user and ignoring other dimensions, such as interference caused by users non-convergence phenomenon; in addition, the AMC outer loop of this embodiment can be adjusted online, and the AMC inner loop can be adjusted in real time, which can not only ensure the online adjustment ability of the AMC outer loop, but also reduce the AMC outer loop model through the accurate calculation of the AMC inner loop. The complexity makes the output of AMC's inner and outer rings more accurate.
上面各种方法的步骤划分,只是为了描述清楚,实现时可以合并为一个步骤或者对某些步骤进行拆分,分解为多个步骤,只要包括相同的逻辑关系,都在本专利的保护范围内;对算法中或者流程中添加无关紧要的修改或者引入无关紧要的设计,但不改变其算法和流程的核心设计都在该专利的保护范围内。The step division of the above various methods is only for the sake of clarity of description. During implementation, it can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. ; Adding insignificant modifications or introducing insignificant designs to the algorithm or process, but not changing the core design of the algorithm and process are all within the scope of protection of this patent.
本申请的实施例还提供一种自适应编码调制装置,如图6所示,包括:参数获取模块601,用于获取特征参数,其中,所述特征参数中包括表征用户的传输能力的数据;初值获取模块602,将所述特征参数输入内环机器学习模型中,得到MCS初值;调整值获取模块603,用于将所述MCS初值和所述特征参数输入外环机器学习模型中,得到所述MCS初值对应的MCS调整值;调整模块604,用于根据所述MCS初值对应的调整值和所述MCS初值得到调整后的MCS值。The embodiment of the present application also provides an adaptive coding and modulation device, as shown in FIG. 6 , including: a parameter acquisition module 601, configured to acquire characteristic parameters, wherein the characteristic parameters include data representing the user's transmission capability; The initial value acquisition module 602 is used to input the characteristic parameters into the inner loop machine learning model to obtain the MCS initial value; the adjustment value acquisition module 603 is used to input the MCS initial value and the characteristic parameters into the outer loop machine learning model to obtain an adjusted MCS value corresponding to the initial MCS value; an adjustment module 604 configured to obtain an adjusted MCS value according to the adjusted value corresponding to the initial MCS value and the initial MCS value.
在一些实施例中,参数获取模块601进一步用于检测传输类型;其中,所述传输类型包 括:单用户传输和/或多用户空分传输;若所述传输类型为多用户空分传输,则所述特征参数还包括:干扰能力参数;其中,所述干扰能力参数表征干扰用户的干扰能力的数据。In some embodiments, the parameter acquisition module 601 is further configured to detect the transmission type; wherein, the transmission type includes: single-user transmission and/or multi-user space division transmission; if the transmission type is multi-user space division transmission, then The characteristic parameter further includes: an interference capability parameter; wherein, the interference capability parameter represents data of an interference capability of an interfering user.
在一些实施例中,参数获取模块601获取的干扰能力参数包括:所述用户所在的空分用户配对组合中的各干扰用户与所述用户的端口间相关性参数,和所述空分用户配对组合中的各干扰用户的传输流数。In some embodiments, the interference capability parameters acquired by the parameter acquisition module 601 include: the correlation parameters between the ports of each interfering user in the space division user pairing combination where the user is located and the user, and the space division user pairing The number of transmit streams for each interfering user in the combination.
在一些实施例中,自适应编码调制装置还进一步包括模型训练模块,模型训练模块进一步用于根据所内环模型样本数据训练所述内环机器学习模型中的内环模型参数;其中,所述内环模型样本数据包括:调整后的MCS初值、使用所述调整后的MCS值进行信号传输的传输结果的反馈值、所述特征参数;根据外环模型样本数据训练所述外环机器学习模型中的外环模型参数;其中,所述外环模型样本数据包括:所述特征参数、所述MCS初值、所述MCS调整值,所述传输结果的反馈值。In some embodiments, the adaptive coding and modulation device further includes a model training module, and the model training module is further used to train the inner-loop model parameters in the inner-loop machine learning model according to the inner-loop model sample data; wherein, the The inner loop model sample data includes: the adjusted MCS initial value, the feedback value of the transmission result of signal transmission using the adjusted MCS value, and the characteristic parameters; the outer loop machine learning is trained according to the outer loop model sample data Outer loop model parameters in the model; wherein, the outer loop model sample data includes: the characteristic parameters, the initial MCS value, the MCS adjustment value, and the feedback value of the transmission result.
在一些实施例中,在传输类型为多用户空分传输时,模型训练模块进一步用于根据所述用户所在的空分用户配对组合中各用户的内环模型样本数据,训练所述内环机器学习模型中的内环模型参数;根据所述用户所在的空分用户配对组合中各用户的外环模型样本数据训练所述外环机器学习模型中的外环模型参数。In some embodiments, when the transmission type is multi-user space division transmission, the model training module is further used to train the inner loop machine according to the inner loop model sample data of each user in the space division user pairing combination where the user is located Inner-ring model parameters in the learning model; training outer-ring model parameters in the outer-ring machine learning model according to the outer-ring model sample data of each user in the space-separated user pairing combination where the user is located.
在一些实施例中,初值获取模块602中的内环机器学习模型为以下任一项分类神经网络、回归神经网络、决策树;调整值获取模块603中的外环机器学习模型为强化学习神经网络。In some embodiments, the inner loop machine learning model in the initial value acquisition module 602 is any of the following classification neural network, regression neural network, decision tree; the outer loop machine learning model in the adjustment value acquisition module 603 is reinforcement learning neural network network.
在一些实施例中,初值获取模块602中的内环机器学习模型中的内环模型参数通过离线学习方式进行训练;调整值获取模块603中的所述外环机器学习模型中的外环模型参数通过在线学习方式进行训练。In some embodiments, the parameters of the inner ring model in the inner ring machine learning model in the initial value acquisition module 602 are trained through offline learning; the outer ring model in the outer ring machine learning model in the adjustment value acquisition module 603 The parameters are trained by online learning.
不难发现,本实施例为与上述方法的实施例相对应的系统实施例,本实施例可与上述方法实施例互相配合实施。上述方法实施例中提到的相关技术细节在本实施例中依然有效,为了减少重复,这里不再赘述。相应地,本实施例中提到的相关技术细节也可应用在第一实施例中。It is not difficult to find that this embodiment is a system embodiment corresponding to the above-mentioned method embodiment, and this embodiment can be implemented in cooperation with the above-mentioned method embodiment. The relevant technical details mentioned in the foregoing method embodiments are still valid in this embodiment, and will not be repeated here in order to reduce repetition. Correspondingly, the relevant technical details mentioned in this embodiment can also be applied in the first embodiment.
值得一提的是,本实施例中所涉及到的各模块均为逻辑模块,在实际应用中,一个逻辑单元可以是一个物理单元,也可以是一个物理单元的一部分,还可以以多个物理单元的组合实现。此外,为了突出本申请的创新部分,本实施例中并没有将与解决本申请所提出的技术问题关系不太密切的单元引入,但这并不表明本实施例中不存在其它的单元。It is worth mentioning that all the modules involved in this embodiment are logical modules. In practical applications, a logical unit can be a physical unit, or a part of a physical unit, or multiple physical units. Combination of units. In addition, in order to highlight the innovative part of the present application, units that are not closely related to solving the technical problem proposed in the present application are not introduced in this embodiment, but this does not mean that there are no other units in this embodiment.
本申请的实施例还提供一种电子设备,如图7所示,包括至少一个处理器701;以及,与所述至少一个处理器701通信连接的存储器702;其中,所述存储器702存储有可被所述至少一个处理器701执行的指令,所述指令被所述至少一个处理器701执行,以使所述至少一个处理器701能够执行上述的自适应编码调制方法。The embodiment of the present application also provides an electronic device, as shown in FIG. 7 , including at least one processor 701; and a memory 702 connected in communication with the at least one processor 701; Instructions executed by the at least one processor 701, the instructions executed by the at least one processor 701, so that the at least one processor 701 can execute the above adaptive coding and modulation method.
其中,存储器和处理器采用总线方式连接,总线可以包括任意数量的互联的总线和桥,总线将一个或多个处理器和存储器的各种电路连接在一起。总线还可以将诸如外围设备、稳压器和功率管理电路等之类的各种其他电路连接在一起,这些都是本领域所公知的,因此,本文不再对其进行进一步描述。总线接口在总线和收发机之间提供接口。收发机可以是一个元件,也可以是多个元件,比如多个接收器和发送器,提供用于在传输介质上与各种其他装置通信的单元。经处理器处理的数据通过天线在无线介质上进行传输,进一步,天线还接收数据并将数据传送给处理器。Wherein, the memory and the processor are connected by a bus, and the bus may include any number of interconnected buses and bridges, and the bus connects one or more processors and various circuits of the memory together. The bus may also connect together various other circuits such as peripherals, voltage regulators, and power management circuits, all of which are well known in the art and therefore will not be further described herein. The bus interface provides an interface between the bus and the transceivers. A transceiver may be a single element or multiple elements, such as multiple receivers and transmitters, providing means for communicating with various other devices over a transmission medium. The data processed by the processor is transmitted on the wireless medium through the antenna, further, the antenna also receives the data and transmits the data to the processor.
处理器负责管理总线和通常的处理,还可以提供各种功能,包括定时,外围接口,电压调节、电源管理以及其他控制功能。而存储器可以被用于存储处理器在执行操作时所使用的数据。The processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interface, voltage regulation, power management, and other control functions. Instead, memory can be used to store data that the processor uses when performing operations.
本申请的实施例还提供一种计算机可读存储介质,存储有计算机程序。计算机程序被处理器执行时实现上述方法实施例。Embodiments of the present application also provide a computer-readable storage medium storing a computer program. The above method embodiments are implemented when the computer program is executed by the processor.
即,本领域技术人员可以理解,实现上述实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。That is, those skilled in the art can understand that all or part of the steps in the method of the above-mentioned embodiments can be completed by instructing related hardware through a program, the program is stored in a storage medium, and includes several instructions to make a device ( It may be a single-chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disc, etc., which can store program codes. .
本领域的普通技术人员可以理解,上述各实施例是实现本申请的具体实施例,而在实际应用中,可以在形式上和细节上对其作各种改变,而不偏离本申请的精神和范围。Those of ordinary skill in the art can understand that the above-mentioned embodiments are specific embodiments for realizing the present application, and in practical applications, various changes can be made to it in form and details without departing from the spirit and spirit of the present application. scope.

Claims (10)

  1. 一种自适应编码调制方法,包括:An adaptive coding and modulation method, comprising:
    获取特征参数,其中,所述特征参数中包括表征用户的传输能力的数据;Acquiring characteristic parameters, wherein the characteristic parameters include data representing the user's transmission capability;
    将所述特征参数输入内环机器学习模型中,得到MCS初值;The feature parameter is input into the inner loop machine learning model to obtain the initial value of MCS;
    将所述MCS初值和所述特征参数输入外环机器学习模型中,得到所述MCS初值对应的MCS调整值;Inputting the MCS initial value and the characteristic parameters into the outer loop machine learning model to obtain the MCS adjustment value corresponding to the MCS initial value;
    根据所述MCS初值对应的调整值和所述MCS初值得到调整后的MCS值。An adjusted MCS value is obtained according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
  2. 根据权利要求1所述的自适应编码调制方法,其中,所述获取特征参数之前,包括:The adaptive coding and modulation method according to claim 1, wherein, before obtaining the characteristic parameters, comprising:
    检测传输类型;其中,所述传输类型包括:单用户传输和/或多用户空分传输;Detecting a transmission type; wherein, the transmission type includes: single-user transmission and/or multi-user space division transmission;
    若所述传输类型为所述多用户空分传输,则所述获取的特征参数还包括:干扰能力参数;其中,所述干扰能力参数表征干扰用户的干扰能力的数据。If the transmission type is the multi-user space division transmission, the acquired characteristic parameter further includes: an interference capability parameter; wherein the interference capability parameter represents data of an interference capability of an interfering user.
  3. 根据权利要求2中所述的自适应编码调制方法,其中,所述干扰能力参数包括:所述用户所在的空分用户配对组合中的各干扰用户与所述用户的端口间相关性参数,和所述空分用户配对组合中的各干扰用户的传输流数。The adaptive coding and modulation method according to claim 2, wherein the interference capability parameter comprises: a correlation parameter between each interfering user in the space-division user pairing combination where the user is located and the port of the user, and The number of transmission streams of each interfering user in the space-division user pair combination.
  4. 根据权利要求2所述的自适应编码调制方法,其中,所述根据所述MCS初值对应的调整值和所述MCS初值得到调整后的MCS值之后,还包括:The adaptive coding and modulation method according to claim 2, wherein, after obtaining the adjusted MCS value according to the adjustment value corresponding to the initial MCS value and the initial MCS value, further comprising:
    根据内环模型样本数据训练所述内环机器学习模型中的内环模型参数;其中,所述内环模型样本数据包括:所述调整后的MCS值、使用所述调整后的MCS值进行信号传输的传输结果的反馈值和所述特征参数;Train the inner-ring model parameters in the inner-ring machine learning model according to the inner-ring model sample data; wherein, the inner-ring model sample data includes: the adjusted MCS value, and signal using the adjusted MCS value The feedback value of the transmitted transmission result and the characteristic parameters;
    根据外环模型样本数据训练所述外环机器学习模型中的外环模型参数;其中,所述外环模型样本数据包括:所述特征参数、所述MCS初值、所述MCS调整值和所述传输结果的反馈值。The outer ring model parameters in the outer ring machine learning model are trained according to the outer ring model sample data; wherein, the outer ring model sample data includes: the characteristic parameters, the MCS initial value, the MCS adjustment value and the set The feedback value of the above transmission result.
  5. 根据权利要求4所述的自适应编码调制方法,其中,若所述传输类型为所述多用户空分传输,则所述根据内环模型样本数据训练所述内环机器学习模型中的内环模型参数,包括:The adaptive coding and modulation method according to claim 4, wherein, if the transmission type is the multi-user space division transmission, the inner loop in the inner loop machine learning model is trained according to the inner loop model sample data Model parameters, including:
    根据所述用户所在的空分用户配对组合中各用户的内环模型样本数据,训练所述内环机器学习模型中的内环模型参数;According to the inner ring model sample data of each user in the space separation user pairing combination where the user is located, train the inner ring model parameters in the inner ring machine learning model;
    所述根据外环模型样本数据训练所述外环机器学习模型中的外环模型参数,包括:The training of the outer ring model parameters in the outer ring machine learning model according to the outer ring model sample data includes:
    根据所述用户所在的空分用户配对组合中各用户的外环模型样本数据训练所述外环机器学习模型中的外环模型参数。The outer ring model parameters in the outer ring machine learning model are trained according to the outer ring model sample data of each user in the space division user pair combination where the user is located.
  6. 根据权利要求1至5中任一项所述的自适应编码调制方法,其中,所述内环机器学习模型包括以下任一项:分类神经网络、回归神经网络、决策树;The adaptive coding and modulation method according to any one of claims 1 to 5, wherein the inner loop machine learning model comprises any of the following: a classification neural network, a regression neural network, a decision tree;
    所述外环机器学习模型包括强化学习神经网络。The outer loop machine learning model includes a reinforcement learning neural network.
  7. 根据权利要求1至6中任一项所述的自适应编码调制方法,其中,所述内环机器学习模型中的内环模型参数通过离线学习方式进行训练;所述外环机器学习模型中的外环模型参数通过在线学习方式进行训练。The adaptive coding and modulation method according to any one of claims 1 to 6, wherein, the inner loop model parameters in the inner loop machine learning model are trained by offline learning; the outer loop machine learning model parameters The parameters of the outer ring model are trained through online learning.
  8. 一种自适应编码调制装置,包括:An adaptive coding and modulation device, comprising:
    参数获取模块,用于获取特征参数,其中,所述特征参数中包括表征用户的传输能力的数据;A parameter acquisition module, configured to acquire characteristic parameters, wherein the characteristic parameters include data representing the user's transmission capability;
    初值获取模块,将所述特征参数输入内环机器学习模型中,得到MCS初值;The initial value acquisition module inputs the characteristic parameters into the inner loop machine learning model to obtain the MCS initial value;
    调整值获取模块,用于将所述MCS初值和所述特征参数输入外环机器学习模型中,得到所述MCS初值对应的MCS调整值;An adjustment value acquisition module, configured to input the MCS initial value and the characteristic parameters into the outer loop machine learning model to obtain an MCS adjustment value corresponding to the MCS initial value;
    调整模块,用于根据所述MCS初值对应的调整值和所述MCS初值得到调整后的MCS值。An adjustment module, configured to obtain an adjusted MCS value according to the adjustment value corresponding to the initial MCS value and the initial MCS value.
  9. 一种电子设备,包括:An electronic device comprising:
    至少一个处理器;以及,at least one processor; and,
    与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein,
    所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行如权利要求1至7中任一所述的自适应编码调制方法。The memory is stored with instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one processor can perform any one of claims 1 to 7 Adaptive coding and modulation method.
  10. 一种计算机可读存储介质,存储有计算机程序,所述计算机程序被处理器执行时实现权利要求1至7中任一项所述的自适应编码调制方法。A computer-readable storage medium storing a computer program, which implements the adaptive coding and modulation method according to any one of claims 1 to 7 when the computer program is executed by a processor.
PCT/CN2022/104761 2021-08-31 2022-07-08 Adaptive coding and modulation method and apparatus, electronic device and storage medium WO2023029751A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111014423.5 2021-08-31
CN202111014423.5A CN115730676A (en) 2021-08-31 2021-08-31 Adaptive code modulation method, device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2023029751A1 true WO2023029751A1 (en) 2023-03-09

Family

ID=85292050

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/104761 WO2023029751A1 (en) 2021-08-31 2022-07-08 Adaptive coding and modulation method and apparatus, electronic device and storage medium

Country Status (2)

Country Link
CN (1) CN115730676A (en)
WO (1) WO2023029751A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116800382A (en) * 2023-08-17 2023-09-22 上海朗力半导体有限公司 Index modulation method and device based on visual sensor

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102300244A (en) * 2011-07-15 2011-12-28 中兴通讯股份有限公司 Interference measuring reference information notifying method and interference measuring method and device
CN103516463A (en) * 2012-06-20 2014-01-15 中兴通讯股份有限公司 Method and base station for performing outer-ring automatic modulation and coding adjustment
CN107846266A (en) * 2016-09-18 2018-03-27 中兴通讯股份有限公司 Running time-frequency resource dispatching space division method and apparatus
US20210218483A1 (en) * 2018-09-28 2021-07-15 Intel Corporation Machine learning-based link adaptation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102300244A (en) * 2011-07-15 2011-12-28 中兴通讯股份有限公司 Interference measuring reference information notifying method and interference measuring method and device
CN103516463A (en) * 2012-06-20 2014-01-15 中兴通讯股份有限公司 Method and base station for performing outer-ring automatic modulation and coding adjustment
CN107846266A (en) * 2016-09-18 2018-03-27 中兴通讯股份有限公司 Running time-frequency resource dispatching space division method and apparatus
US20210218483A1 (en) * 2018-09-28 2021-07-15 Intel Corporation Machine learning-based link adaptation

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ELWEKEIL MOHAMED; JIANG SHIBAO; WANG TAOTAO; ZHANG SHENGLI: "Deep Convolutional Neural Networks for Link Adaptations in MIMO-OFDM Wireless Systems", IEEE WIRELESS COMMUNICATIONS LETTERS, vol. 8, no. 3, 30 June 2019 (2019-06-30), Piscataway, NJ, USA , pages 665 - 668, XP011730922, ISSN: 2162-2337, DOI: 10.1109/LWC.2018.2881978 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116800382A (en) * 2023-08-17 2023-09-22 上海朗力半导体有限公司 Index modulation method and device based on visual sensor
CN116800382B (en) * 2023-08-17 2023-11-03 上海朗力半导体有限公司 Index modulation method and device based on visual sensor

Also Published As

Publication number Publication date
CN115730676A (en) 2023-03-03

Similar Documents

Publication Publication Date Title
CN109962728B (en) Multi-node joint power control method based on deep reinforcement learning
WO2016078478A1 (en) Channel state information measurement method, channel state information acquisition method, terminal, and network device
CN107431512A (en) The system and method for extensive MIMO adaptations
WO2023029751A1 (en) Adaptive coding and modulation method and apparatus, electronic device and storage medium
Bobrov et al. Massive MIMO adaptive modulation and coding using online deep learning algorithm
WO2022073496A1 (en) Neural network information transmission method and apparatus, and communication device, and storage medium
WO2023185978A1 (en) Channel feature information reporting method, channel feature information recovery method, terminal and network side device
WO2021048594A1 (en) Methods for block error rate target selection for a communication session and related apparatus
KR102579905B1 (en) Method and device for switching transmission methods in massive mimo system
US20240056989A1 (en) Precoding and power allocation for access points in a cell-free communication system
JP2024512358A (en) Information reporting method, device, first device and second device
WO2020087260A1 (en) Method and apparatus for sinr prediction for link adaption
WO2024032606A1 (en) Information transmission method and apparatus, device, system, and storage medium
KR102518990B1 (en) Device for controlling transmission power considering imperfect channel state information
WO2024046202A1 (en) Transmission method, user equipment, network side device, and readable storage medium
WO2024041420A1 (en) Measurement feedback processing method and apparatus, and terminal and network-side device
WO2024037380A1 (en) Channel information processing methods and apparatus, communication device, and storage medium
Li et al. Artificial Intelligence Augmentation for Channel State Information in 5G and 6G
WO2024093713A1 (en) Resource configuration method and apparatus, and communication device and readable storage medium
US20230114492A1 (en) Electronic device and method for providing scheduling information based on learning in wireless communication system
WO2024078405A1 (en) Transmission methods, apparatus, communication device, and readable storage medium
WO2024041421A1 (en) Measurement feedback processing method and apparatus, terminal, and network side device
WO2024067281A1 (en) Ai model processing method and apparatus, and communication device
WO2024046140A1 (en) Feedback processing method, apparatus, storage medium, and electronic apparatus
WO2024032695A1 (en) Csi prediction processing method and apparatus, communication device, and readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22862892

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE