CN110719112B - Parameter self-adaptive RS code decoding method based on deep learning - Google Patents

Parameter self-adaptive RS code decoding method based on deep learning Download PDF

Info

Publication number
CN110719112B
CN110719112B CN201910861946.XA CN201910861946A CN110719112B CN 110719112 B CN110719112 B CN 110719112B CN 201910861946 A CN201910861946 A CN 201910861946A CN 110719112 B CN110719112 B CN 110719112B
Authority
CN
China
Prior art keywords
sequence
training
reliability
decoding
neural network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910861946.XA
Other languages
Chinese (zh)
Other versions
CN110719112A (en
Inventor
梁煜
安翔宇
张为
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin University
Original Assignee
Tianjin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin University filed Critical Tianjin University
Priority to CN201910861946.XA priority Critical patent/CN110719112B/en
Publication of CN110719112A publication Critical patent/CN110719112A/en
Application granted granted Critical
Publication of CN110719112B publication Critical patent/CN110719112B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03MCODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/03Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words
    • H03M13/05Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words using block codes, i.e. a predetermined number of check bits joined to a predetermined number of information bits
    • H03M13/13Linear codes
    • H03M13/15Cyclic codes, i.e. cyclic shifts of codewords produce other codewords, e.g. codes defined by a generator polynomial, Bose-Chaudhuri-Hocquenghem [BCH] codes
    • H03M13/151Cyclic codes, i.e. cyclic shifts of codewords produce other codewords, e.g. codes defined by a generator polynomial, Bose-Chaudhuri-Hocquenghem [BCH] codes using error location or error correction polynomials
    • H03M13/1515Reed-Solomon codes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/084Backpropagation, e.g. using gradient descent

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Algebra (AREA)
  • Pure & Applied Mathematics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Error Detection And Correction (AREA)

Abstract

The invention relates to a parameter self-adaptive RS code decoding method based on deep learning, which comprises the following steps: RS code encoding is carried out on the information sequence X, and an encoded information sequence u is obtained; performing BPSK modulation on the information sequence u to obtain a transmission sequence s; the transmission sequence passes through a Gaussian white noise channel to obtain a receiving sequence y; constructing a reliability matrix by using the receiving sequence y, and calculating to obtain a reliability sequence R; dividing the reliability sequence R into a training set and a testing set; training a neural network; aiming at the training set of R and the corresponding receiving sequence y, respectively testing by using LCC decoding algorithms with different eta values to find an eta optimal solution corresponding to the training set receiving sequence y one by one; and taking the SNR and the reliability sequence R as input, and taking the minimum eta value obtained by the test as a classification label, wherein the minimum eta value and the classification label together form a data set for training the neural network.

Description

一种基于深度学习的参数自适应RS码译码方法A Decoding Method of Parameter Adaptive RS Codes Based on Deep Learning

技术领域technical field

本发明属于信道编码中差错控制编码领域,涉及一种基于深度学习的参数自适应译码算法。The invention belongs to the field of error control coding in channel coding, and relates to a parameter adaptive decoding algorithm based on deep learning.

背景技术Background technique

差错控制是在数字通信中利用编译码技术对信道噪声引起的传输错误加以控制及纠正,以保证通信有效性和可靠性的基本方法。差错控制编码在数字通信领域应用十分广泛,具有重要的研究意义。Reed-Solomon(RS)码是差错控制编码的一种,于1960年首先由Reed和Solomon构造出来,其结构简单,译码延迟较短,结构特性丰富,可纠正随机错误和突发错误。尤其在纠正突发错误的应用中,RS码比其它差错控制编码性能更加优异。目前,RS码已广泛应用无线通信、光纤通信、磁盘及固态存储等领域,一直是产业界和学术界研究的热点。Error control is a basic method to control and correct transmission errors caused by channel noise by using codec technology in digital communication to ensure the effectiveness and reliability of communication. Error control coding is widely used in the field of digital communication and has important research significance. Reed-Solomon (RS) code is a kind of error control code, which was first constructed by Reed and Solomon in 1960. It has a simple structure, short decoding delay, rich structural features, and can correct random errors and burst errors. Especially in the application of correcting burst errors, RS codes have better performance than other error control codes. At present, RS codes have been widely used in wireless communication, optical fiber communication, magnetic disk and solid-state storage, etc., and have always been a research hotspot in the industry and academia.

根据解调器输出符号的形式,RS码的译码算法可分为两类:硬判决译码算法和软判决译码算法。其中,硬判决译码算法相对简单,且易于硬件实现,但该算法未充分利用信道软信息,译码性能有所损失。软判决译码以复杂度为代价换取译码增益的提高,主要包括KV、BGMD和LCC算法。其中,LCC算法在复杂度和计算周期上均优于前两者。同时,该算法的译码性能、复杂度与其重数分配过程的参数η密切相关。According to the form of demodulator output symbols, the decoding algorithms of RS codes can be divided into two categories: hard-decision decoding algorithms and soft-decision decoding algorithms. Among them, the hard-decision decoding algorithm is relatively simple and easy to implement in hardware, but the algorithm does not make full use of channel soft information, and the decoding performance is lost. Soft-decision decoding trades complexity for the improvement of decoding gain, mainly including KV, BGMD and LCC algorithms. Among them, the LCC algorithm is superior to the former two in terms of complexity and calculation cycle. At the same time, the decoding performance and complexity of the algorithm are closely related to the parameter η of the multiplicity allocation process.

近年来,深度学习因其强大的解决复杂任务的能力引起了全世界的关注。深度学习方法也被应用到了语音识别、计算机视觉、机器翻译等领域,为这些了领域带来了巨大革新与突破。深度学习与编码领域结合的方案取得了一些研究成果,在polar码、BCH码、LDPC码等领域展开深入研究。目前的大多研究将译码看作分类问题,使用神经网络结构(如DNN、CNN、RNN)实现完整的译码过程。此类方案存在的明显不足是,神经网络对未经学习的码字(未包含在训练集的码字)预测能力非常差,码字长度的增加带来的码字可能情况指数性爆炸增长会很大程度上影响译码器性能。除此之外,部分研究提出使用深度学习辅助传统译码算法,进行相关噪声的消除、关键参数的预测等,以提升传统算法性能。In recent years, deep learning has attracted worldwide attention due to its powerful ability to solve complex tasks. Deep learning methods have also been applied to speech recognition, computer vision, machine translation and other fields, bringing great innovations and breakthroughs to these fields. The combination of deep learning and coding has achieved some research results, and in-depth research has been carried out in the fields of polar codes, BCH codes, and LDPC codes. Most of the current research regards decoding as a classification problem, and uses neural network structures (such as DNN, CNN, RNN) to realize the complete decoding process. The obvious disadvantage of this type of scheme is that the neural network has very poor predictive ability for unlearned codewords (codewords not included in the training set), and the exponential explosion of codewords that may be brought about by the increase in codeword length will cause It greatly affects the performance of the decoder. In addition, some studies propose to use deep learning to assist traditional decoding algorithms to eliminate related noise and predict key parameters to improve the performance of traditional algorithms.

发明内容Contents of the invention

本发明的目的是提供一种可以降低复杂度并提高效率的基于深度学习的参数自适应译码方法。技术方案如下:The purpose of the present invention is to provide a parameter adaptive decoding method based on deep learning that can reduce complexity and improve efficiency. The technical solution is as follows:

一种基于深度学习的参数自适应RS码译码方法,包括下列步骤:A parameter adaptive RS code decoding method based on deep learning, comprising the following steps:

(1)对信息序列X进行RS码编码,得编码后的信息序列u。对信息序列u进行BPSK调制,得到传输序列s。传输序列通过高斯白噪声信道后得到接收序列y。再利用接收序列y构造可靠度矩阵,并计算得到可靠度序列R。将可靠度序列R分为训练集与测试集。(1) Encode the information sequence X with RS code to obtain the encoded information sequence u. Perform BPSK modulation on the information sequence u to obtain the transmission sequence s. The received sequence y is obtained after the transmitted sequence passes through the Gaussian white noise channel. Then use the received sequence y to construct a reliability matrix, and calculate the reliability sequence R. The reliability sequence R is divided into training set and test set.

(2)进行神经网络的训练。针对R的训练集与对应的接收序列y,使用不同η值的LCC译码算法分别进行测试,找到与训练集接收序列y一一对应的η最优解。以SNR和可靠度序列R为输入,以测试得到的最小η值为分类标签,两者共同形成神经网络训练的数据集。神经网络结构使用MLP结构,通过反向传播算法不断优化网络的权值w和偏置b,在足够的数据集及训练代数条件下,得到分类准确率高的神经网络,完成训练过程。(2) Carry out the training of the neural network. For the training set of R and the corresponding receiving sequence y, the LCC decoding algorithms with different η values are used to test respectively, and the optimal solution of η corresponding to the receiving sequence y of the training set is found one-to-one. Taking SNR and reliability sequence R as input, and taking the minimum η value obtained from the test as the classification label, the two together form the data set for neural network training. The neural network structure uses the MLP structure, and the weight w and bias b of the network are continuously optimized through the back propagation algorithm. Under sufficient data sets and training algebraic conditions, a neural network with high classification accuracy is obtained to complete the training process.

(3)以SNR和R的测试集输入,通过训练后的神经网络计算得η最优解。接下来,使用参数自适应后的η值进行LCC译码,得到译码后序列X′,最终完成译码。(3) Input the test set of SNR and R, and calculate the optimal solution of η through the trained neural network. Next, LCC decoding is performed using the parameter-adapted η value to obtain the decoded sequence X', and the decoding is finally completed.

附图说明Description of drawings

图1基于深度学习的参数自适应译码算法的系统框图Figure 1 System block diagram of parameter adaptive decoding algorithm based on deep learning

图2神经网络的训练过程Figure 2 The training process of the neural network

具体实施方式Detailed ways

本发明提出的基于深度学习的参数自适应译码算法,是一种使用深度学习辅助传统RS码LCC译码的算法。据分析,LCC算法中关键参数η与信道环境、可靠度信息密切相关,而η值的大小决定着LCC算法的译码性能及复杂度。求解η最优解的问题,可以看做简单的分类问题,神经网络具有的强大模式分类能力,可以简单高效地选择η最优解。通过深度学习方法实现LCC算法中关键参数η随信道环境、接收序列可靠度信息自适应变化,可以在不影响译码性能的前提下,提高译码效率。The parameter adaptive decoding algorithm based on deep learning proposed by the present invention is an algorithm that uses deep learning to assist traditional RS code LCC decoding. According to the analysis, the key parameter η in the LCC algorithm is closely related to the channel environment and reliability information, and the value of η determines the decoding performance and complexity of the LCC algorithm. The problem of solving the optimal solution of η can be regarded as a simple classification problem. The powerful pattern classification ability of the neural network can select the optimal solution of η simply and efficiently. Through the deep learning method, the key parameter η in the LCC algorithm can be adaptively changed with the channel environment and the reliability information of the received sequence, which can improve the decoding efficiency without affecting the decoding performance.

基于深度学习的参数自适应译码算法,具体包括两个阶段,训练阶段和译码阶段。The parameter adaptive decoding algorithm based on deep learning specifically includes two stages, the training stage and the decoding stage.

(1)训练阶段实现构建和训练神经网络的过程。基于监督学习,本发明构建多层感知机(MLP)神经网络结构,节点数及层数由码长决定。在训练的数据集方面,以信噪比与似然比连接作为输入,以对应的传统译码算法测试得到η最优解为分类标签。经训练及调试,得分类准确率优良的神经网络。(1) The training stage realizes the process of constructing and training the neural network. Based on supervised learning, the present invention constructs a multilayer perceptron (MLP) neural network structure, and the number of nodes and the number of layers are determined by the code length. In terms of the training data set, the signal-to-noise ratio and the likelihood ratio are connected as input, and the η optimal solution obtained by the corresponding traditional decoding algorithm test is used as the classification label. After training and debugging, a neural network with excellent classification accuracy was obtained.

(2)译码阶段将具体码字的信噪比与似然比输入训练好的神经网络,得到η最优解。后根据最优解进行传统LCC译码。(2) In the decoding stage, the signal-to-noise ratio and likelihood ratio of specific codewords are input into the trained neural network to obtain the optimal solution of η. Then perform traditional LCC decoding according to the optimal solution.

下面结合附图,对本发明的技术方案作进一步具体的说明。The technical solution of the present invention will be further specifically described below in conjunction with the accompanying drawings.

如图1所示,基于深度学习的参数自适应译码算法,具体包括以下步骤:As shown in Figure 1, the parameter adaptive decoding algorithm based on deep learning specifically includes the following steps:

(4)对信息序列X进行RS码编码,得编码后的信息序列u。为使编码后信息转化为适合在信道中传输的模式,对信息序列u进行BPSK调制,得到传输序列s。传输序列通过高斯白噪声信道(AWGN)后得到接收序列y(y=s+n,n为AWGN信道噪声)。再利用接收序列y构造可靠度矩阵,并计算得到可靠度序列R。将可靠度序列R分为训练集与测试集,两者比例9:1。(4) Encode the information sequence X with RS code to obtain the encoded information sequence u. In order to transform the coded information into a mode suitable for transmission in the channel, BPSK modulation is performed on the information sequence u to obtain the transmission sequence s. The received sequence y (y=s+n, n being AWGN channel noise) is obtained after the transmission sequence passes through the white Gaussian noise channel (AWGN). Then use the received sequence y to construct a reliability matrix, and calculate the reliability sequence R. Divide the reliability sequence R into a training set and a test set with a ratio of 9:1.

(5)如图2,进行神经网络的训练。针对R的训练集与对应的接收序列y,使用不同η值的LCC译码算法分别进行测试,找到与训练集接收序列y一一对应的η最优解(正确译码情况下的最小值)。以SNR和可靠度序列R为输入,以测试得到的最小η值为分类标签,两者共同形成神经网络训练的数据集。神经网络结构使用多层感知器(MLP)结构,通过反向传播算法不断优化网络的权值w和偏置b,在足够的数据集及训练代数条件下,得到分类准确率高的神经网络,完成训练过程。(5) As shown in Figure 2, the training of the neural network is carried out. For the training set of R and the corresponding receiving sequence y, use the LCC decoding algorithm with different η values to test separately, and find the η optimal solution corresponding to the training set receiving sequence y one-to-one (the minimum value in the case of correct decoding) . Taking SNR and reliability sequence R as input, and taking the minimum η value obtained from the test as the classification label, the two together form the data set for neural network training. The neural network structure uses a multi-layer perceptron (MLP) structure, and continuously optimizes the weight w and bias b of the network through the back propagation algorithm. Under sufficient data sets and training algebraic conditions, a neural network with high classification accuracy is obtained. Complete the training process.

(6)以SNR和R的测试集输入,通过训练后的神经网络计算得η最优解。接下来,使用参数自适应后的η值进行LCC译码,得到译码后序列X′,最终完成译码。(6) With the test set input of SNR and R, the optimal solution of η is calculated by the neural network after training. Next, LCC decoding is performed using the parameter-adapted η value to obtain the decoded sequence X', and the decoding is finally completed.

上述实施例为本发明较佳的实施方式,但本发明的实施方式并不受上述实施例的限制,其他的任何未背离本发明的精神实质与原理下所作的改变、修饰、替代、组合、简化,均应为等效的置换方式,都包含在本发明的保护范围之内。The above-mentioned embodiment is a preferred embodiment of the present invention, but the embodiment of the present invention is not limited by the above-mentioned embodiment, and any other changes, modifications, substitutions, combinations, Simplifications should be equivalent replacement methods, and all are included in the protection scope of the present invention.

Claims (1)

1. A parameter self-adaptive RS code decoding method based on deep learning comprises the following steps:
(1) RS code encoding is carried out on the information sequence X, and an encoded information sequence u is obtained; performing BPSK modulation on the information sequence u to obtain a transmission sequence s; the transmission sequence s passes through a Gaussian white noise channel to obtain a receiving sequence y; constructing a reliability matrix by using the receiving sequence y, and calculating to obtain a reliability sequence R; dividing the reliability sequence R into a training set and a testing set;
(2) Training of the neural network is performed: η is a key parameter in the LCC decoding algorithm and is closely related to channel environment and reliability information, the size of the η value determines the decoding performance and complexity of the LCC algorithm, the LCC decoding algorithms with different η values are used for respectively testing a training set and a corresponding receiving sequence y of R, and an η optimal solution corresponding to the training set receiving sequence y one by one is found, wherein the η optimal solution is the minimum value under the condition of correct decoding; taking SNR and reliability sequence R as input, and taking the minimum eta value obtained by test as a classification label, and forming a data set of neural network training together; the neural network structure uses an MLP structure, the weight w and the bias b of the network are continuously optimized through a back propagation algorithm, and the neural network with high classification accuracy is obtained under the conditions of enough data sets and training algebra, so that the training process is completed.
CN201910861946.XA 2019-09-12 2019-09-12 Parameter self-adaptive RS code decoding method based on deep learning Active CN110719112B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910861946.XA CN110719112B (en) 2019-09-12 2019-09-12 Parameter self-adaptive RS code decoding method based on deep learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910861946.XA CN110719112B (en) 2019-09-12 2019-09-12 Parameter self-adaptive RS code decoding method based on deep learning

Publications (2)

Publication Number Publication Date
CN110719112A CN110719112A (en) 2020-01-21
CN110719112B true CN110719112B (en) 2023-08-29

Family

ID=69210385

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910861946.XA Active CN110719112B (en) 2019-09-12 2019-09-12 Parameter self-adaptive RS code decoding method based on deep learning

Country Status (1)

Country Link
CN (1) CN110719112B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116155453B (en) * 2023-04-23 2023-07-07 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) Decoding method and related equipment for dynamic signal-to-noise ratio

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011032387A1 (en) * 2009-09-15 2011-03-24 中兴通讯股份有限公司 Method and device for decoding reed-solomon (rs) code
CN107241106A (en) * 2017-05-24 2017-10-10 东南大学 Polarization code decoding algorithm based on deep learning
CN109245854A (en) * 2018-08-15 2019-01-18 西安电子科技大学 A kind of end-to-end wireless communication system and method based on AI

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7519898B2 (en) * 2004-03-25 2009-04-14 Krishna Rama Narayanan Iterative decoding of linear block codes by adapting the parity check matrix

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011032387A1 (en) * 2009-09-15 2011-03-24 中兴通讯股份有限公司 Method and device for decoding reed-solomon (rs) code
CN107241106A (en) * 2017-05-24 2017-10-10 东南大学 Polarization code decoding algorithm based on deep learning
CN109245854A (en) * 2018-08-15 2019-01-18 西安电子科技大学 A kind of end-to-end wireless communication system and method based on AI

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
RS乘积码译码算法研究;李伟;周金荣;;舰船电子工程;第30卷(第4期);80-83 *

Also Published As

Publication number Publication date
CN110719112A (en) 2020-01-21

Similar Documents

Publication Publication Date Title
CN107026656B (en) CRC-assisted medium-short code length Polar code effective decoding method based on disturbance
Doan et al. Neural successive cancellation decoding of polar codes
CN110278002B (en) Polar Code Belief Propagation List Decoding Method Based on Bit Flip
CN106571831B (en) LDPC hard decision decoding method and decoder based on deep learning
Ercan et al. On error-correction performance and implementation of polar code list decoders for 5G
CN105720992A (en) Polarized code simplifying and decoding method
CN110995278A (en) Improved polar code serial elimination list bit flipping decoding method and system
CN107248866A (en) A kind of method for reducing polarization code decoding delay
CN109921803B (en) Decoding Method of High Density Linear Block Code Based on Neural Network
CN110113057B (en) Polarization code decoder utilizing deep learning
WO2021093866A1 (en) Deep learning channel decoding method based on alternating direction method of multipliers
CN110278001A (en) Partitioned Decoding Method of Polar Codes Based on Deep Learning
CN110233628A (en) The adaptive belief propagation list decoding method of polarization code
CN110730011B (en) Recursive grouping Markov superposition coding method based on partial superposition
CN110719112B (en) Parameter self-adaptive RS code decoding method based on deep learning
Raviv et al. Crc-aided learned ensembles of belief-propagation polar decoders
Tian et al. A scalable graph neural network decoder for short block codes
CN101552613B (en) Low density check code decoding method based on outer information symbol variation
CN110572166B (en) BCH code decoding method based on deep learning
CN110730009B (en) Syndrome input RS code decoding method based on deep learning
CN116760425A (en) A CRC-assisted OSD decoding method for LDPC codes
Li et al. A double-CNN BP decoder on fast fading channels using correlation information
Kargı et al. A deep learning based decoder for concatenated coding over deletion channels
Song et al. ANN based adaptive successive cancellation list decoder for polar codes
Raj et al. Design of successive cancellation list decoding of polar codes

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant