WO2013085812A1

WO2013085812A1 - Matrix based parallel implementation of maximum a posteriori probability (map) decoders

Info

Publication number: WO2013085812A1
Application number: PCT/US2012/067283
Authority: WO
Inventors: Brian FANOUS; Halldor N. Stefansson
Original assignee: The Mathworks, Inc.
Priority date: 2011-12-06
Filing date: 2012-11-30
Publication date: 2013-06-13
Also published as: US8594217B2; EP2789103A1; US9348798B2; US20130142289A1; US20140046995A1; EP2789103B1

Abstract

A MAP decoder may be implemented in parallel on the basis of a matrix based description of the MAP algorithm. In one implementation, a device may receive an input array that represents received encoded data (610) and calculate, in parallel, a series of transition matrices from the input array (620). The device may further calculate, in parallel, products of the cumulative products of the series of transition matrices and an initialization vector (630). The device may further calculate, in parallel and based on the products of the cumulative products of the series of transition matrices and the initialization vector, an output array that corresponds to a decoded version of the received encoded data in the input array (640). The caluclations may be based on the so-called scan technique/scan algorithm. The above approach may allow to implement MAP decoding in technical computing envorinments (TCE) or on GPUs.

Description

MATRIX BASED PARALLEL IMPLEMENTATION OF MAXIMUM A POSTERIORI

PROBABILITY (MAP) DECODERS

BACKGROUND

The maximum a posteriori probability (MAP) decoder, and/or variations of this decoder, is commonly used for signal processing. For instance, a MAP decoder may be used, as part of a larger decoder, such as a turbo decoder, in a wireless communication device. The turbo decoder may be used to decode data that is received over a noisy channel, such as radio interfaces for the wireless communication device.

A number of variations of the MAP decoder are known. The logarithmic version of the MAP decoder, for example, may be more feasible for practical hardware implementations. Whatever version of the MAP decoder is used, however, it can be desirable to implement the MAP decoder as efficiently as possible, with respect to available hardware constraints.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate one or more implementations described herein and, together with the description, explain these implementations. In the drawings:

Fig. 1 is a diagram of an example system in which concepts described herein may be implemented;

Fig. 2 is a diagram of an example device that may correspond to a device in Fig. 1; Fig. 3 is a diagram illustrating an example of a simplified trellis;

Fig. 4 is a diagram conceptually illustrating example components of a MAP decoder; Fig. 5 is a diagram illustrating an example of the operation of the parallel execution units of Fig. 4 using a scan technique; Fig. 6 is a flowchart illustrating an example process for the parallel implementation of a MAP decoder;

Fig. 7 is a diagram illustrating an alternative example implementation of the scan technique;

Fig. 8 is a flowchart illustrating an example process for generating a model that uses a

MAP decoder;

Fig. 9 is a diagram illustrating an example system that may use a MAP decoder; and Fig. 10 is a diagram illustrating an example implementation of a turbo decoder.

DETAILED DESCRIPTION

The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements.

Implementations described herein may relate to a parallel implementation of the MAP decoder. A number of processing units, such as hardware processing units in an electronic device, may efficiently implement a MAP decoder, such as a MAP decoder implemented as part of a turbo decoder. In one implementation, the MAP decoder may be designed and/or deployed in a technical computing environment (TCE).

To implement the MAP decoder, a scan algorithm may be used for a parallel computation of intermediate results. For example, the scan algorithm may be used to calculate products of the cumulative products of a series of transition matrices and an initialization vector. The scan algorithm, and hence the MAP decoder, may be performed by parallel processing units.

DEFINITIONS

A Technical Computing Environment(TCE) may include any hardware and/or software based logic that provides a computing environment that allows users to perform tasks related to disciplines, such as, but not limited to, mathematics, science, engineering, medicine, and business. The TCE may include text-based facilities (e.g., MATLAB® software), a graphically- based environment (e.g., Simulink® software, Stateflow® software, SimEvents™ software, etc., by The Math Works, Inc.; VisSim by Visual Solutions; Lab View® by National Instruments; etc.), or another type of environment, such as a hybrid environment that includes one or more of the above-referenced text-based environments and one or more of the above-referenced graphically- based environments.

The TCE may be integrated with or operate in conjunction with a graphical modeling environment, which may provide graphical tools for constructing models, systems, or processes. The TCE may include additional tools, such as tools designed to convert a model into an alternate representation, such as source computer code, compiled computer code, or a hardware description (e.g., a description of a circuit layout). In one implementation, the TCE may provide this ability using graphical toolboxes (e.g., toolboxes for signal processing, image processing, color manipulation, data plotting, parallel processing, etc.). In another implementation, the TCE may provide these functions as block sets. In still another implementation, the TCE may provide these functions in another way.

Models generated with the TCE may be, for example, models of a physical system, a computing system (e.g., a distributed computing system), an engineered system, an embedded system, a biological system, a chemical system, etc.

SYSTEM DESCRIPTION

Fig. 1 is diagram of an example system 100 in which concepts described herein may be implemented. System 100 may include a personal computer or workstation 110. Workstation 110 may execute a TCE 120 that presents a user with an interface that enables design, analysis, and generation of, for example, technical applications, engineered systems, and business applications. For example, TCE 120 may provide a numerical and/or symbolic computing environment that allows for matrix manipulation, plotting of functions and data, implementation of algorithms, creation of user interfaces, and/or interfacing with programs in other languages. TCE 120 may particularly include a graphical modeling component and a component to convert graphic models into other forms, such as computer source code (e.g., C++ code) or hardware descriptions (e.g., a description of an electronic circuit).

Workstation 110 may operate as a single detached computing device. Alternatively, workstation 110 may be connected to a network 130, such as a local area network (LAN) or a wide area network (WAN), such as the Internet. When workstation 110 is connected to network 130, TCE 120 may be run by multiple networked computing devices or by one or more remote computing devices. In such an implementation, TCE 120 may be executed in a distributed manner, such as by executing on multiple computing devices simultaneously. Additionally, in some implementations, TCE 120 may be executed over network 130 in a client-server relationship. For example, workstation 110 may act as a client that communicates (e.g., using a web browser) with a server that stores and potentially executes substantive elements of TCE 120.

As shown in Fig. 1, system 100 may include a remote TCE 140 (e.g., a remotely located computing device running a TCE) and/or a TCE service 160. TCE service 160 may include a server computing device that provides a TCE as a remote service. For instance, a TCE may be provided as a web service. The web service may provide access to one or more programs provided by TCE service 160.

In one implementation, models created with TCE 120 may be executed at workstation 110 to present an interface, such as a graphical interface, to a user. In some implementations, TCE 120 may generate, based on the model, code that is executable on another device, such as a target device 170. Target device 170 may include, for example, a consumer electronic device, a factory control device, an embedded device, a general computing device, a graphics processing unit or device, a field programmable gate array, an application specific integrated circuit (ASIC), or any other type of programmable device. In one implementation, target device 170 may particularly include a communication device or a semiconductor chip within a communication device, such as a wireless communication device.

Target device 170, workstation 110, and/or remote TCE 140 may include multiple, parallel processing engines. For example, workstation 110 may include a multicore processor. Similarly, target device 107 may include a multicore processor or may include parallel processing engines that may be used for signal processing tasks. As will be described in more detail below, multiple, parallel processing engines of target device 170, workstation 110, and/or remote TCE 140, may be used to efficiently implement a MAP decoder.

Although Fig. 1 shows example components of system 100, in other implementations, system 100 may contain fewer components, different components, differently arranged components, and/or additional components than those depicted in Fig. 1. Alternatively, or additionally, one or more components of system 100 may perform one or more other tasks described as being performed by one or more other components of system 100.

Fig. 2 is a diagram of an example device 200 that may correspond to workstation 110, target device 170, or a remote device running remote TCE 140 or TCE service 160. As illustrated, device 200 may include a bus 210, a processing unit 220, a main memory 230, a readonly memory (ROM) 240, a storage device 250, an input device 260, an output device 270, and/or a communication interface 280. Bus 210 may include a path that permits communication among the components of workstation 200.

Processing unit 220 may interpret and/or execute instructions. For example, processing unit 220 may include a general-purpose processor, a microprocessor, a multicore microprocessor, a data processor, a graphical processing unit (GPU), co-processors, a network processor, an application specific integrated circuit (ASICs), an application specific instruction-set processor (ASIP), a system-on-chip (SOC), a controller, a programmable logic device (PLD), a chipset, and/or a field programmable gate array (FPGA).

Memory 230 may store data and/or instructions related to the operation and use of device 200. For example, memory 230 may store data and/or instructions that may be configured to implement an implementation described herein. Memory 230 may include, for example, a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a synchronous dynamic random access memory (SDRAM), a ferroelectric random access memory (FRAM), a read only memory (ROM), a programmable read only memory (PROM), an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), and/or a flash memory.

Storage device 240 may store data and/or software related to the operation and use of device 200. For example, storage device 240 may include a hard disk (e.g., a magnetic disk, an optical disk, a magneto-optic disk, a solid state disk), a compact disc (CD), a digital versatile disc (DVD), a floppy disk, a cartridge, a magnetic tape, and/or another type of computer-readable medium, along with a corresponding drive. Memory 230 and/or storage device 240 may also include a storing device external to and/or removable from device 200, such as a Universal Serial Bus (USB) memory stick, a hard disk, etc. In an implementation, storage device 240 may store TCE 120.

Input device 250 may include a mechanism that permits an operator to input information to device 200, such as a keyboard, a mouse, a pen, a single or multi-point touch interface, an accelerometer, a gyroscope, a microphone, voice recognition and/or biometric mechanisms, etc. Output device 260 may include a mechanism that outputs information to the operator, including a display, a printer, a speaker, etc. In the case of a display, the display may be a touch screen display that acts as both an input and an output device. Input device 250 and/or output device 260 may be haptic type devices, such as joysticks or other devices based on touch.

Communication interface 270 may include any transceiver- like mechanism that enables device 200 to communicate with other devices and/or systems. For example, communication interface 270 may include mechanisms for communicating with another device or system via a network.

As will be described in detail below, device 200 may perform certain operations in response to processing unit 220 executing software instructions contained in a computer-readable medium, such as memory 230. For instance, device 200 may implement TCE 120 by executing software instructions from memory 230. A computer-readable medium may be defined as a non- transitory memory device, where the memory device may include a number of physically, possible distributed, memory devices. The software instructions may be read into memory 230 from another computer-readable medium, such as storage device 240, or from another device via communication interface 270. The software instructions contained in memory 230 may cause processing unit 220 to perform processes that will be described later. Alternatively, hardwired circuitry may be used in place of or in combination with software instructions to implement processes described herein. Thus, implementations described herein are not limited to any specific combination of hardware circuitry and software.

Although Fig. 2 shows example components of device 200, in other implementations, device 200 may contain fewer components, different components, differently arranged components, or additional components than depicted in Fig. 2. Alternatively, or additionally, one or more components of device 200 may perform one or more tasks described as being performed by one or more other components of device 200.

PARALLEL IMPLEMENTATION OF MAP DECODER

In general, a MAP decoder may be used as a common decoding solution for an error- control coding system. A MAP decoder may implement a trellis-based estimation technique in which the MAP decoder produces soft decisions relating to the state of a block of inputs. MAP decoders may be frequently used in the context of a larger decoder, such as a turbo decoder, where two or more component MAP decoders may be used, and the coding may involve iteratively feeding outputs from the MAP decoders to one another until a final decision is reached on the state of the communicated information, called the message.

Fig. 3 is a diagram illustrating an example of a simplified trellis 300. Trellis 300 may represent correspondences between codewords (i.e., an input sequence of data bits) and paths from the beginning of the trellis, shown as node 310, and the end of the trellis, shown as node 320. Trellis 300 may be considered to be a definite finite automaton with one start state and one finish state. Given a received, possibly error-corrupted codeword, error probabilities may be associated with weights on the edges(the lines between the nodes) of trellis 300. A MAP decoder is one technique for estimating the message or minimizing code symbol errors. In Fig. 3, a transmitted length N data block ut ( < k < N) and a corresponding sequence Ck of extrinsic input data, is shown. In this example, trellis 300 is illustrated as a two state, states SO and SI, trellis. In practice, trellis 300 may include additional states. In general, trellis 300 may be a sparse data structure in which not all states are connected by an edge.

Fig. 4 is a diagram conceptually illustrating example components of a MAP decoder 400. MAP decoder 400 may be implemented, for example, as a model in TCE 120 or as part of target device 170.

MAP decoder 400 may include pre-processor component 410, parallel execution units 420, and post-processing component 430. MAP decoder 400 may operate to compute the likelihood, such as the Log-Likelihood Ratio (LLR), of each bit or symbol, of an input data block, being correct. MAP decoder 400 may receive, at pre-processor component 410, a length N data block 402 and may receive extrinsic input data 404. Extrinsic input data 404 may include, for example, parity bits and/or LLR values from a previous iteration of MAP decoder 400 (or from another MAP decoder). MAP decoder 400 may output, from post-processor component 430, a length N output data block 432 and extrinsic output data 434. The extrinsic output data 434 may include, for example, updated LLR values.

The MAP decoding technique may be based on the calculation of a number of parameters, commonly called the alphas, ¾, the betas, fit, and the gammas, γ. The alphas may be computed through a forward recursion operation, the betas may be computed through a backwards recursion operation, and the gammas may include the transition probability of a channel and transition probabilities of an encoder trellis. In one implementation, the alphas and betas may be defined as: (s) = ^ y_; (s»a_fc_₁(s^') ; and

/¾0) = ∑s_'Y_j (s , s')/?_fc+1(s^')

Here, s and s 'may represent states of the decoder, and 7/ (s , s)may represent the transition probability of the channel and transition probabilities of the encoder trellis. The gammas may be defined as:

7/0» = Pr(S_fc = s, R_; |S_k--1 = s^')

where 5_fcis the state at time k and the input block and parity sequence is =

{R_lt ... , R_k, ... , fl_w}and R_t = {u_it cj.

The forward recursion, the alphas, can be modeled as products of the cumulative matrix product of several square transition matrices (one matrix per received symbol) and an initialization vector. Backwards recursion can be described as products of the right-to-left cumulative matrix product of different transition matrices and the initialization vector. For example, in a two state trellis, each recursive computation may be described in matrix form, as in:

f_c(o,o)_Yfcao (Eq. 1)

_Yfc(0,l)Y_fc( )

These formulas can be equivalently written as:

where A_k represents a column vector of the alphas and G_k represents a square matrix, which will also be referred to as transition matrices herein. The transition matrices may generally be relatively sparse. Based on the above equations, the following equation can be derived:

A_n = G„ * G_n-1 * G_n-2 * ... * Gi* Ao. From this, the forward recursion may be performed by left multiplying Ao, the initialization vector, by each element of the cumulative matrix product of {G_n, G_n-i, G_n-2, · · · ,Gi}. For example, for three symbols, the alphas may be calculated as:

A₃ = G₃ * G₂ * d* Ao,

Ax= Gx* Ao,

Consistent with aspects described herein, the products of the cumulative products of the transition matrices and the initialization vector, as included in these equations, may be efficiently calculated, in parallel, based on the scan algorithm.

The backwards recursion, the betas, can be similarly modeled as products of the cumulative matrix product of a second set of transition matrices (different than the transition matrices for the alphas) and the initialization vector. The scan algorithm may also be used to efficiently calculate, in parallel, the products of the cumulative products of the transition matrices (for the betas) and the initialization vector.

Pre -processor component 410 may receive input block 402 and extrinsic input data 404. Pre -processor component 410 initiates and controls the data flow through parallel execution units 420. In one implementation, the quantity of the parallel execution units 420 may be equal to N/2, where N is the size of input block 402.

Parallel execution units 420 may include multiple, parallel executing processors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), graphic processing units (GPUs), software threads running on a general processor, or other execution units. Parallel execution units 420 may calculate, in parallel, the transition matrices, G_n (for both the alphas and the betas); calculate, in parallel, each of the products of the cumulative products of the transition matrices and the initialization vector Ao; and convert, in parallel, the products of the cumulative products of the transition matrices and the initialization vector, for both the alphas and the betas, to an output vector. Parallel execution units 420 may perform these operations in a pipelined manner in which there is communication between different parallel execution units 420.

As previously mentioned, the calculation of the products of the cumulative products of the transition matrices and the initialization vector may be performed according to the scan algorithm. In one implementation, an initialization vector may be defined based on the particular MAP decoder being implemented. The initialization vector may be a constant value that is used in parallel execution units 420 and is illustrated as a vector. The initialization vector is illustrated as Aoin the above equations. The scan algorithm may then be implemented, by parallel execution unit 420, to calculate products of the cumulative products of the transition matrices and the initialization vector (for both the alphas and the betas).

Post-processor 430 may perform any final, serial processing of the results from parallel execution units 420, and may output block 432 and extrinsic output data 434.

Although Fig. 4 shows example components of MAP decoder 400, in other

implementations, MAP decoder 400 may contain fewer components, different components, differently arranged components, and/or additional components than those depicted in Fig. 4. Alternatively, or additionally, one or more components of MAP decoder 400 may perform one or more tasks described as being performed by one or more other components of MAP decoder 400.

Fig. 5 is a diagram illustrating an example of the operation of parallel execution units 420 in calculating, based on the scan algorithm, partial products of the cumulative products of transition matrices. The operations shown in Fig. 5 may be separately performed, in parallel, to determine the partial products of the cumulative products of transition matrices for both the alphas and the betas.

In this example, four parallel execution units are shown, labeled as parallel execution units 510, 520, 530, and 540. For this example, assume that the input array includes eight transition matrices (i.e., N = 8). The set of transition matrices includes the set: {Gg, G₇, G6, Gs, G₄, G3, G₂, Gi} . In a first pipeline stage 550 (i.e., the first step in the implementation of the scan algorithm), parallel execution unit 510 may receive the transition matrices Gi and G₂, parallel execution unit 520 may receive the transition matrices G3 and G₄, parallel execution unit 530 may receive the transition matrices G5 and G6, and parallel execution unit 540 may receive the transition matrices G₇ and Gs.

In a second stage 552 of the pipelines, parallel execution unit 510 may calculate the product of transition matrices Gi and G₂ (n(Gi .. G₂)). Simultaneously, parallel execution unit 520 may calculate the product of transition matrices G3 and G₄ (II(G₄ .. G3)); parallel execution unit 530 may calculate the product of transition matricesGs and G6 (II(G6 .. G5)); and parallel execution unit 540 may calculate the product of transition matrices G₇ and Gs (n(Gs .. G₇)).

Additionally, in the second stage of the pipelines, parallel execution unit 510 may store transition matrix Gi, parallel execution unit 530 may store transition matrix G3, parallel execution unit 530 may store transition matrix G5, and parallel execution unit 540 may store transition matrix G₇. As illustrated, each succeeding stage of the pipelines may involve one or more matrix product calculations or transfer previous matrix product calculation to a different one of the pipelines implemented by the parallel execution units.

In the final stage of the pipeline, labeled as stage 554, each of parallel execution units 510, 520, 530, and 540, may output a portion of the partial products of the transition matrices, to obtain the partial products of the transition matrices. The matrix multiplication operations, Π, illustrated in Fig. 5, may refer to operations other than standard matrix multiplication operations, depending on the version of the MAP decoder that is being implemented. For example, the original MAP decoder algorithm may be relatively computationally intensive. The Max-Log- MAP decoder technique is one known variation of the MAP decoder. In general, the Max-Log- MAP may be based on using the natural logarithm of the alphas, betas, and gammas. For the Max-Log-MAP implementation, scalar multiplication may be replaced with addition and scalar addition may be replaced with the maximum operation. With these replacements, the matrix multiplication may be performed as illustrated in Fig. 5. Other MAP decoder techniques, such as the Log-MAP may alternatively be used.

Fig. 6 is a flowchart illustrating an example process 600 for the parallel implementation of a MAP decoder. Process 600 may be performed by, for example, MAP decoder 400.

Process 600 may include receiving an input array that represents the encoded data (block 610). The input array may be a fixed length array and may include encoded data received over a noisy channel, including parity bits added during the encoding (i.e., at the transmitting end of the noisy channel). The input array may also include extrinsic input data.

Process 600 may further include calculating the transition matrices (block 620). In one implementation, the transition matrices, G, may be calculated as discussed above with reference to equation (1). The transition matrices may be calculated, in parallel, by parallel execution units 420. The transition matrices may be calculated for both the alphas and the betas.

Process 600 may further include, based on the transition matrices and using the scan algorithm, calculation of the products of the cumulative products of the transition matrices and an initialization vector (block 630). The initialization vector may be a constant valued vector that is defined based on the particular MAP decoder that is being implemented. The calculation of block 630 may be performed in parallel using the scan algorithm. In one implementation, the parallel processing may be performed, in a pipelined manner, using a quantity of processing units 420. The quantity of processing units required for a maximally parallel implementation may be, for instance, N/2, where N may represent the number of transition matrices and each processing unit may implement a pipeline having 2*log₂(N) stages. Block 630 may be performed, in parallel, for both the alphas and the betas.

Process 600 may further include generating, based on the products of the cumulative products of the transition matrices and the initialization vector, as calculated in block 630, the MAP decoder output data (block 640). The calculation of block 640 may be performed, in parallel, by parallel execution units 420. The calculation of block 640 may include forming the output based on both sets (i.e., the alpha and the beta sets) of the products of the cumulative products of the transition matrices and the initialization vector. The output data may generally correspond to a decoded version of the received encoded data, such as output block 432 and extrinsic output data 434.

In one particular example of an implementation of process 600, process 600 may be implemented on target device 170 that includes multiple, parallel, GPUs. In some

implementations, data sent to the multiple GPUs may be sent in a "batch" mode to potentially hide memory latency and increase throughput.

Fig. 7 is a diagram illustrating an alternative example implementation of the scan technique. In the implementations illustrated in Fig. 7, the cumulative products of the transition matrices may be performed as a three stage operation. As shown in Fig. 7, transition matrices 700 may be segmented into a number of independent subsegments 710-1 through 710-L (referred to collectively as "subsegments710" or individually as "subsegment 710"). The scan operation may be applied to each of subsegments 710 and the full product of each scan may be stored, illustrated as full products 720-1 through 720-L (referred to collectively as "full products720" or individually as "full product 720"). The scan operation may then again be applied to full products 720 to obtain partial products 730. Partial products 730 may then be distributed to obtain final cumulative products 740. Although not explicitly shown in Fig. 7, the initialization vector may also be multiplied as part of the operations in Fig. 7, such that the final cumulative products 740 may represent the products of the cumulative products of the transition matrices and the initialization vector. By segmenting the transition matrices into a series of groups of transition matrices, and then independently applying the scan operation to each group, as illustrated in Fig. 7, the scan operation can potentially be more efficiently and/or more quickly performed.

In the techniques shown in Fig. 7, the initialization vector may be multiplied after performing matrix by matrix multiplications or before performance of the matrix by matrix multiplications. In one implementation, the matrix by vector multiplications (e.g.,

multiplications of matrices by the initialization vector) may be preferentially performed before matrix by matrix multiplications, which may lead to a more computationally efficient process.

Fig. 8 is a flow chart illustrating an example process 800 for generating a model that uses a MAP decoder. Process 800 may be performed by, for example, workstation 110, running TCE 120.

Process 800 may include receiving a model or otherwise enabling or facilitating the creation of a model (block 810). The model may include a MAP decoder component (block 810). The MAP decoder component may implement MAP decoding using multiple parallel processing units, such as processing units 420. In one implementation, the MAP decoder component for the model may include parameters that allow a designer to specify the hardware elements that are to implement the parallel computations. The MAP decoder component may be implemented with other components to perform a larger or more complex function. For example, a turbo decoder may be implemented using multiple MAP decoder components that are connected to one another using other model components, such as interleavers.

Process 800 may further include testing the model (block 820). For example, the model may be run by TCE 120 and values for parameters in the model may be observed. In response, the user may, for example, interactively, through TCE 120, modify the operation of the model.

At some point, the user may determine that the model is ready for deployment in a target device. At this point, process 800 may further include generating code, to implement the model, on one or more target devices (block 830). For example, the user may control TCE 120 to generate compiled code for target device 170. In another possible implementation, the generated code may be code that controls programming of a hardware device, such as code that specifies the layout of an ASIC or FPGA.

Fig. 9 is a diagram illustrating an example system 900 that may use a MAP decoder. System 900 may be a communication system in which information is transmitted across a noisy channel. As shown, system 900 may include turbo encoder 910, channel 920, and turbo decoder 930.

Turbo encoder 910 may operate to encode an input information signal, to include redundant data, to make the information signal resistant to noise that may be introduced through channel 920. For example, turbo encoder 910 may include two recursive systematic convolutional (RSC) encoders that each generate parity bits that are included with the information signal when transmitted over channel 920.

Channel 920 may include a noisy channel that may tend to introduce errors into the signal output from turbo encoder 910. For example, channel 920 may be an over-the-air radio channel, optical-based channel, or other channel that may tend to introduce noise.

Turbo decoder 930 may receive the encoded signal, after it is communicated over channel 920, and may act to decode the encoded signal, to ideally obtain the original input information signal. Turbo decoder 930 may include multiple MAP decoders and one or more interleavers. A number of designs for turbo decoder 930 are known. One example of a design for a particular turbo decoder 930 is described in more detail with respect to Fig. 10.

Fig. 10 is a diagram illustrating an example implementation of a turbo decoder, such as turbo decoder 930. Turbo decoder 930 may include a pair of MAP decoders 1010 and 1030 and a pair of interleavers 1020 and 1040. Turbo decoder 930 may operate on blocks of data. MAP decoder 1010 may receive an initial block of data, including error correcting information, such as parity bits (labeled as input Z). MAP decoder 1030 may also receive the initial data, or a version of the initial block of data, and the error correcting information (labeled as input Z').

The output of MAP decoders 1010 and 1030 may be forwarded through the pair of interleavers 1020 and 1040. Interleavers 1020 and 1040 may generally operate to reorder input data. Interleavers 1020 and 1040 may be matched as interleaver/de-interleaver pairs, so that the interleaving performed by one of interleavers 1020 and 1040 can be undone by the other.

MAP decoders 1010 and 1030, and interleavers 1020 and 1040, may iteratively operate until the probabilities determined by MAP decoders 1010 and 1030, such as the LLR

probabilities, converge. The foregoing description of implementations provides illustration and description, but is not intended to be exhaustive or to limit the invention to the precise form disclosed.

Modifications and variations are possible in light of the above teachings or may be acquired from practice of the invention.

For example, while a series of acts has been described with regard to Figs. 6 and 8, the order of the acts may be modified in other implementations. Further, non-dependent acts may be performed in parallel.

Also, the term "user" has been used herein. The term "user" is intended to be broadly interpreted to include, for example, a workstation or a user of a workstation.

It will be apparent that embodiments, as described herein, may be implemented in many different forms of software, firmware, and hardware in the implementations illustrated in the figures. The actual software code or specialized control hardware used to implement embodiments described herein is not limiting of the invention. Thus, the operation and behavior of the embodiments were described without reference to the specific software code—it being understood that one would be able to design software and control hardware to implement the embodiments based on the description herein.

Further, certain portions of the invention may be implemented as "logic" that performs one or more functions. This logic may include hardware, such as an application specific integrated circuit or a field programmable gate array, software, or a combination of hardware and software.

Even though particular combinations of features are recited in the claims and/or disclosed in the specification, these combinations are not intended to limit the disclosure of the invention. In fact, many of these features may be combined in ways not specifically recited in the claims and/or disclosed in the specification. Although each dependent claim listed below may directly depend on only one other claim, the disclosure of the invention includes each dependent claim in combination with every other claim in the claim set.

No element, act, or instruction used in the present application should be construed as critical or essential to the invention unless explicitly described as such. Also, as used herein, the article "a" is intended to include one or more items. Where only one item is intended, the term "one" or similar language is used. Further, the phrase "based on" is intended to mean "based, at least in part, on" unless explicitly stated otherwise.

Claims

WHAT IS CLAIMED IS:

1. A method, implemented by at least one device, the method comprising:

receiving an input array that represents received encoded data, where the receiving is performed by the at least one device;

calculating, in parallel, a series of transition matrices from the input array, where the calculating the series of transition matrices is performed by the at least one device;

calculating, in parallel, products of the cumulative products of the series of transition matrices and an initialization vector, where the calculating the products of the cumulative products and the initialization vector is performed by the at least one device;

calculating, in parallel, based on the products of the cumulative products of the series of transition matrices and the initialization vector, an output array that corresponds to a decoded version of the received encoded data in the input array, where the calculating the output array is performed by the at least one device; and

outputting the output array.

2. The method of claim 1, where values in the transition matrices represent probabilities that relate to state transitions in a Maximum A Posteriori Probability (MAP) decoder.

3. The method of claim 2, where the calculating the series of transition matrices and the calculating the products of the cumulative products of the series of transition matrices and the initialization vector, is simultaneously performed for both alpha and beta parameters of the MAP decoder.

4. The method of claim 1, where calculating, in parallel, the products of the cumulative products of the series of transition matrices and the initialization vector includes:

using a scan technique to convert the series of transition matrices and the initialization vector into the products of the cumulative products of the series of transition matrices and the initialization vector.

5. The method of claim 4, where calculating, in parallel, the products of the cumulative products of the series of transition matrices and the initialization vector further includes:

segmenting the series of transition matrices into a plurality of sections;

independently applying, as a first scan, the scan technique to each of the plurality of sections, where a full product of the scan of each section is stored;

applying, as a second scan, the scan technique to a series of the full products of the first scan; and

distributing partial product scan results from the second scan.

6. The method of claim 5, where distributing partial product scan results from the second scan and forming the products of the cumulative products and the initialization vector includes preferentially performing matrix by vector multiplications before performing matrix by matrix multiplications.

7. The method of claim 1, where calculating, in parallel, the products of the cumulative product of the series of transition matrices and the initialization vector includes:

implementing N/2 parallel pipelines, where N represents a size of the input array, and each pipeline includes K stages, where K corresponds to 2*log₂(N).

8. The method of claim 7, where operations performed in each stage of each of the pipelines include:

matrix multiplication operations.

9. The method of claim 7, where operations performed in each stage of each of the pipelines include:

matrix multiplication operations, in which the matrix multiplication operations are performed using a Max-Log-MAP technique.

10. The method of claim 1, where outputting the output array includes:

transmitting the output array to an interleaving component.

11. The method of claim 1 , where the receiving the input array, calculating the series of transition matrices, calculating the products of the cumulative products of the series of transition matrices and the initialization vector, calculating the output array, and outputting the output array, include operations to implement a Maximum A Posteriori Probability (MAP) decoder within a turbo decoder.

12. The method of claim 1, where the received input array includes data received over a noisy transmission channel.

13. The method of claim 1, where the device includes a multiple GPU device, and where the parallel calculation of the series of transition matrices, the products of the cumulative products of the series of transition matrices and the initialization vector, and the output array, are performed by the multiple GPU device.

14. Computer-readable media comprising:

one or more instructions, which when executed by one or more processors, cause the one or more processors to receive input data that represents received encoded data;

one or more instructions, which when executed by the one or more processors, cause the one or more processors to calculate, in parallel, a series of transition matrices from the received input data;

one or more instructions, which when executed by the one or more processors, cause the one or more processors to calculate, in parallel, products of the cumulative products of the series of transition matrices and an initialization vector;

one or more instructions, which when executed by the one or more processors, cause the one or more processors to generate, based on the products of the cumulative products of the series of transition matrices and the initialization vector, output data that corresponds to a decoded version of the received data; and one or more instructions, which when executed by the one or more processors, cause the one or more processors to output the output data.

15. The computer-readable media of claim 14, where values in the transition matrices represent probabilities that relate to state transitions in a Maximum A Posteriori Probability (MAP) decoder.

16. The computer-readable media of claim 14, where the calculation of the series of transition matrices and the calculation of the products of the cumulative products of the series of transition matrices and the initialization vector, is simultaneously performed for both alpha and beta parameters of the MAP decoder.

17. The computer-readable media of claim 14, where the one or more instructions to calculate, in parallel, the products of the cumulative products of the series of transition matrices and the initialization vector, further includes:

one or more instructions to perform a scan technique to convert the series of transition matrices and the initialization vector into the products of the cumulative products of the series of transition matrices and the initialization vector.

18. The computer-readable media of claim 17, where the one or more instructions to calculate, in parallel, the products of the cumulative products of the series of transition matrices and the initialization vector further includes: one or more instructions to segment the series of transition matrices into a plurality of sections;

one or more instructions to independently apply, as a first scan, the scan technique to each of the plurality of sections, where a full product of the scan of each section is stored;

one or more instructions to apply, as a second scan, the scan technique to a series of the full products of the first scan; and

one or more instructions to distribute partial product scan results from the second scan.

19. The computer-readable media of claim 18, where distributing partial product scan results from the second scan and forming the products of the cumulative products and the initialization vector includes preferentially performing matrix by vector multiplications before performing matrix by matrix multiplications.

20. The computer-readable media of claim 14, where the parallel calculations include matrix multiplication operations.

21. The computer-readable media of claim 20, where the parallel calculations include matrix multiplication operations, in which the matrix multiplication operations are performed using a Max-Log-MAP technique.

22. A device comprising:

a first Maximum A Posteriori Probability (MAP) decoder, including:

a first plurality of parallel execution units to calculate, in parallel: a first series of transition matrices, from a first input array,

products of the cumulative products of the first series of transition matrices and a first initialization vector, and

a first output array, based on the products of the cumulative products of the first series of transition matrices and the first initialization vector;

a second MAP decoder, including:

a second plurality of parallel execution units to calculate, in parallel:

a second series of transition matrices, from a second input array, products of the cumulative products of the second series of transition matrices and a second initialization vector, and

a second output array, based on the products of the cumulative products of the second series of transition matrices and the second initialization vector; and

one or more interleavers to interleave data in the first output array and the second output array and to provide the interleaved data to the second MAP decoder and the first MAP decoder, respectively.

23. The device of claim 22, where the device implements a turbo decoder.

24. The device of claim 22, where values in the first and second series of transition matrices represent probabilities that relate to state transitions in the first and second MAP decoders, respectively.

25. The device of claim 22, where

the first plurality of parallel execution units calculates, in parallel, the products of the cumulative products of the first series of transition matrices and the first initialization vector using a scan technique, and where

the second plurality of parallel execution units calculates, in parallel, the products of the cumulative products of the second series of transition matrices and the second initialization vector using the scan technique.

26. The device of claim 25, where the first and second plurality of parallel execution units calculate the products of the cumulative products of the first and second series of transition matrices and the first and second initialization vectors, respectively, by segmenting the first and second series of transition matrices into a plurality of sections and independently applying the scan technique to each of the plurality of sections.

27. The device of claim 22, where operations performed in each of the first and second plurality of parallel execution units include:

matrix multiplication operations.

28. A method, implemented by at least one device, the method comprising:

calculating, in parallel, a series of transition matrices from the input array, where the calculating the series of transition matrices is performed by the at least one device; calculating, in parallel, cumulative products of the series of transition matrices, where the calculating the cumulative products is performed by the at least one device;

calculating, in parallel, the products of the cumulative products of the series of transition matrices and an initialization vector, where calculating the products of the cumulative products of the series of transition matrices and the initialization vector is performed by the at least one device;

calculating, based on the products of the cumulative products of the series of transition matrices and the initialization vector, an output array that corresponds to a decoded version of the received encoded data in the input array, where the calculating the output array is performed by the at least one device; and

outputting the output array.

29. Computer-readable media comprising:

one or more instructions, which when executed by one or more processors, cause the one or more processors to receive an input array that represents received encoded data;

one or more instructions, which when executed by one or more processors, cause the one or more processors to calculate, in parallel, a series of transition matrices from the input array; one or more instructions, which when executed by one or more processors, cause the one or more processors to calculate, in parallel, cumulative products of the series of transition matrices;

one or more instructions, which when executed by one or more processors, cause the one or more processors to calculate, in parallel, products of the cumulative products of the series of transition matrices and an initialization vector; one or more instructions, which when executed by one or more processors, cause the one or more processors to calculate, based on the products of the cumulative products of the series of transition matrices and the initialization vector, an output array that corresponds to a decoded version of the received encoded data in the input array; and

one or more instructions, which when executed by one or more processors, cause the one or more processors to output the output array.