US20080012740A1 - Source-aware non-uniform information transmission with minimum distortion - Google Patents

Source-aware non-uniform information transmission with minimum distortion Download PDF

Info

Publication number
US20080012740A1
US20080012740A1 US11/825,132 US82513207A US2008012740A1 US 20080012740 A1 US20080012740 A1 US 20080012740A1 US 82513207 A US82513207 A US 82513207A US 2008012740 A1 US2008012740 A1 US 2008012740A1
Authority
US
United States
Prior art keywords
constellation
analog signal
symbol
codeword
codewords
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/825,132
Inventor
Tongtong Li
Huahui Wang
Qi Ling
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Michigan State University MSU
Original Assignee
Michigan State University MSU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Michigan State University MSU filed Critical Michigan State University MSU
Priority to US11/825,132 priority Critical patent/US20080012740A1/en
Assigned to BOARD OF TRUSTEES OF MICHIGAN STATE UNIVERSITY reassignment BOARD OF TRUSTEES OF MICHIGAN STATE UNIVERSITY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LI, TONGTONG, LING, QI, WANG, HUAHUI
Publication of US20080012740A1 publication Critical patent/US20080012740A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03MCODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/25Error detection or forward error correction by signal space coding, i.e. adding redundancy in the signal constellation, e.g. Trellis Coded Modulation [TCM]
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03MCODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/35Unequal or adaptive error protection, e.g. by providing a different level of protection according to significance of source information or by adapting the coding according to the change of transmission channel characteristics
    • H03M13/356Unequal error protection [UEP]

Definitions

  • the present disclosure relates to a source-aware information transmission scheme that simultaneously minimizes bit error rate and distortion.
  • source coding and channel coding are treated independently.
  • source representation is designed disjointly from information transmission.
  • bit streams are then uniformly encoded and mapped to symbols prior to transmission.
  • Uniform bit-error-rate (BER) has been serving as one of the most commonly used performance measures.
  • BER bit-error-rate
  • the ultimate goal of the communication system is to minimize the overall input-output distortion. While BER plays the dominant role in distortion minimization, a communication system that minimizes the BER does not necessarily minimize the overall input-output distortion.
  • a method for transmitting information in a data communication system includes: receiving a codeword having a plurality of bits; mapping more significant bits of the codeword to bit locations of a symbol in a constellation with lower error probabilities, where the constellation represents a modulation scheme; modulating the symbol in accordance with the modulation scheme; and transmitting the symbol from a transmitter in the data communication system.
  • FIG. 1 is a block diagram of an exemplary digital communication system
  • FIG. 2 is a graph of a mapping of quantized values to the 16-QAM constellation
  • FIG. 3 illustrates a one-dimensional 16-AM constellation
  • FIG. 4 illustrates a method for transmitting information in a data communication system
  • FIG. 5A is a graph of an asymmetric 16-QAM constellation
  • FIG. 5B is a graph of a symmetric 16-QAM constellation with Gray codes
  • FIGS. 6A and 6B are graphs illustrating performance results for different transmission schemes using coded and uncoded systems, respectively;
  • FIG. 7A illustrates a source consisting of two Gaussian distributed random processes
  • FIG. 7B is a graph depicting normalized MSE under different SNR levels for a uniform 4-AM versus the proposed source-aware 4-AM.
  • FIG. 1 illustrates an exemplary digital communication system with analog input.
  • x k be the discrete-time analog input vector resulted from uniform sampling of a continuous signal x(t).
  • the size of P is
  • y k Q(x k ) denote the quantization value of x k
  • y k is coded into a binary sequence through an index assignment function ( ⁇ ) 14 , and is then fed into a source-aware digital channel encoder 16 and a modulator 18 , i.e., the most significant bits (MSB) and least significant bits (LSB) may be treated distinctly.
  • MSB most significant bits
  • LSB least significant bits
  • ⁇ k denote the receiver output, which is an estimate of the quantization value y k
  • the optimal quantizer satisfies the well-known nearest neighbor and centroid conditions.
  • E ⁇ n q ⁇ 0.
  • E i ⁇ P i P j , 0 ⁇ j ⁇ M-1 ⁇
  • y k P i )
  • p(x) denotes the probability that x occurs.
  • each quantizer output y k is first coded to a binary sequence then mapped to a symbol in a constellation ⁇ .
  • SNR signal-to-noise ratio
  • the optimal 1-1 mapping S:P ⁇ should satisfy the following condition: Let P i ,P j , ⁇ tilde over (P) ⁇ i , ⁇ tilde over (P) ⁇ j ⁇ P, then d(P i ,P j ) ⁇ d( ⁇ tilde over (P) ⁇ i , ⁇ tilde over (P) ⁇ j ) if and only if d(S(P i ),S(P j )) ⁇ d(S( ⁇ tilde over (P) ⁇ i ),S( ⁇ tilde over (P) ⁇ j )).
  • C1 That is, ideally, an isomorphic mapping that reserves the geometric structure should exist between the quantization codebook P and the constellation ⁇ . When the quantizer is optimal, and the constellation is Gray coded, condition (C1) ensures the equivalence between minimizing the BER and minimizing the average distortion.
  • FIG. 4 illustrates this proposed method for transmitting information in a data communication system.
  • an incoming analog signal may be sampled and quantized into discrete signal values. Each quantized signal value is then coded into a codeword formed by a binary sequence. Codewords are in turn mapped to symbols of a constellation, where the constellation represent a modulation scheme for the codewords. Simultaneous minimization of bit error rate and distortion could be through constellation-aware source index assignment.
  • the modulation symbols may be transmitted in the data communication system.
  • non-entropy coding is widely used for various sources in practice. That is, in each quantization codeword, some bits are more significant than other bits, and an error in a significant bit will result in larger distortion than that in a less significant bit.
  • This universal existence of non-uniformity in source coding calls for non-uniform information transmission, also known as unequal error protection, in which the most significant bits have lower bit error-rates than other bits.
  • Asymmetric constellations were originally developed for multiresolution (MR) broadcast in Digital HDTV.
  • the asymmetric constellations were designed to provide more protection to the more significant bits by grouping bits into clouds leading by the most significant bits, and the minimum distance between the clouds is larger than the minimum distance between symbols within a cloud as shown in FIG. 5A .
  • Gray codes are developed to minimize the bit-error-rate, in which the nearest neighbors correspond to bit groups that differ by only one position.
  • the nearest neighbors correspond to bit groups that differ by only one position.
  • Gray codes we revisit the non-uniformity in constellations with Gray codes, and introduce a non-uniform transmission scheme based on Gray-coded constellations.
  • FIG. 5B we illustrate the idea through Gray coded 16-QAM constellation shown in FIG. 5B .
  • each codeword has the form b 0 b 1 b 2 b 3 If we go through the 16 symbols in FIG. 5B , there are altogether 24 nearest neighbor bit changes, among which b 0 and b 2 each changes 4 times, and b 1 and b 3 each changes 8 times. Note that when channel probability error is sufficiently small, a bit error corresponding to each bit location b i is most likely to occur when the nearest neighbor has a different value in that specific bit location, i.e., among neighboring pairs where a change occurs.
  • the two MSBs will be mapped to b 0 and b 2 , while the two LSBs be mapped to b 1 and b 3 .
  • This mapping function is preferably performed by the channel encoder 16 shown in FIG. 1 .
  • a Grey-coded constellation is defined for the designated modulation scheme. Within the constellation, bit locations having a lower error probability are noted. The more significant bits are identified in the bit sequence received from the quantizer. Given a binary sequence from the source, the more significant bits in the binary sequence are then mapped to the bit locations having the lower error probability in the constellation. Lastly, the binary sequence is modulated in accordance with the constellation. While the above description has been provided with reference to a quadrature amplitude modulation scheme, it is readily understood that this approach is extendible to other types of the modulation schemes.
  • the proposed approach can be applied to both symmetric and asymmetric constellations.
  • each 12-bit quantization output b 0 b 1 . . . b 11 is partitioned into three 4-bit strings: b 0 b 1 b 6 b 7 , b 2 b 3 b 8 b 9 , b 4 b 5 b 10 b 11, then mapped to both symmetric and asymmetric 16-QAM constellations based on the block partitioning (BP) scheme or the proposed Gray-code based non-uniform transmission scheme.
  • BP block partitioning
  • impact of channel coding is investigated for both systematic and non-systematic coding schemes.
  • a 10-bit uniform quantizer is connected with a source-aware channel encoder, for which the first 4 MSBs are fed to a rate 1/3 convolutional (or Turbo) encoder and the rest 6 bits are fed to a rate 1/2 convolutional (or Turbo) encoder, respectively.
  • the channel coding output is then mapped to 16-QAM constellations non-uniformly based on the block partitioning approach and the proposed mapping scheme. The result is shown in FIG. 6B .
  • the Gray-code based non-uniform transmission outperforms the non-Gray coded methods (i.e., the MR method and the block partitioning based approach) with big margins when channel coding is involved.
  • the underlying arguments are: (i) channel coding may change the geometric structure of the uncoded symbols; and (ii) when SNR is reasonably high, BER of the more significant bits vanishes, and BER of the less significant bits dominates the overall distortion, and hence Gray coded constellations result in much better performance.
  • Constellation design has largely been separated from quantizer design in the past. However, we further consider joint quantizer-constellation design for minimum distortion. Following our discussions, we propose to incorporate the source information reflected in optimal quantizer design into constellation design. Note that the optimal quantizers minimize the average distortion between the original sampled values and the quantization values, when considering memoryless AWGN channels, optimal quantizers can be exploited directly for constellation design. We illustrate this idea through the following example.
  • the quantizer is optimal, that is, it satisfies the nearest neighbor rule and the centroid criterion.
  • d ij
  • P s is the average symbol power and C is a constant.

Landscapes

  • Physics & Mathematics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Digital Transmission Methods That Use Modulated Carrier Waves (AREA)

Abstract

A method is provided for transmitting information in a data communication system. The method includes: receiving a codeword having a plurality of bits; mapping more significant bits of the codeword to bit locations of a symbol in a constellation with lower error probabilities, where the constellation represents a modulation scheme; modulating the symbol in accordance with the modulation scheme; and transmitting the symbol from a transmitter in the data communication system.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit of U.S. Provisional Application No. 60/819,004, filed on Jul. 6, 2006. The disclosure of the above application is incorporated herein by reference.
  • FIELD
  • The present disclosure relates to a source-aware information transmission scheme that simultaneously minimizes bit error rate and distortion.
  • BACKGROUND
  • Given a source with rate R bits/second and a channel with capacity C bits/second, Shannon's well known channel capacity theorem, says that if R<C, then there exists a combination of source and channel coders such that the source can be communicated over the channel with fidelity arbitrarily close to perfect. This theorem essentially implies that the source coding and channel coding are fundamentally separable without loss of performance for the overall system.
  • Following the “separation principle”, in most modern communication systems, source coding and channel coding are treated independently. In other words, source representation is designed disjointly from information transmission. After A/D conversion of analog source signals, the bit streams are then uniformly encoded and mapped to symbols prior to transmission. Uniform bit-error-rate (BER) has been serving as one of the most commonly used performance measures. However, for systems with analog inputs, the ultimate goal of the communication system is to minimize the overall input-output distortion. While BER plays the dominant role in distortion minimization, a communication system that minimizes the BER does not necessarily minimize the overall input-output distortion.
  • Therefore, it is desirable to provide an information transmission scheme that can achieve simultaneous BER and distortion minimization. The statements in this section merely provide background information related to the present disclosure and may not constitute prior art.
  • SUMMARY
  • A method is provided for transmitting information in a data communication system. The method includes: receiving a codeword having a plurality of bits; mapping more significant bits of the codeword to bit locations of a symbol in a constellation with lower error probabilities, where the constellation represents a modulation scheme; modulating the symbol in accordance with the modulation scheme; and transmitting the symbol from a transmitter in the data communication system.
  • Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure.
  • DRAWINGS
  • FIG. 1 is a block diagram of an exemplary digital communication system;
  • FIG. 2 is a graph of a mapping of quantized values to the 16-QAM constellation;
  • FIG. 3 illustrates a one-dimensional 16-AM constellation;
  • FIG. 4 illustrates a method for transmitting information in a data communication system;
  • FIG. 5A is a graph of an asymmetric 16-QAM constellation;
  • FIG. 5B is a graph of a symmetric 16-QAM constellation with Gray codes;
  • FIGS. 6A and 6B are graphs illustrating performance results for different transmission schemes using coded and uncoded systems, respectively;
  • FIG. 7A illustrates a source consisting of two Gaussian distributed random processes; and
  • FIG. 7B is a graph depicting normalized MSE under different SNR levels for a uniform 4-AM versus the proposed source-aware 4-AM.
  • The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.
  • DETAILED DESCRIPTION
  • FIG. 1 illustrates an exemplary digital communication system with analog input. Let xk be the discrete-time analog input vector resulted from uniform sampling of a continuous signal x(t). xk is first fed into a quantizer (Q) 12, which is a mapping of n-dimensional Euclidean space Rn to a finite set P ⊂ Rn, given by Q:Rn→P, where P={P0, P1, . . . , PM-1} is the quantization codebook with Pi ε Rn for 0≦i≦M-1. Assume that the size of P is |P|=M=2m, where m>0 is an integer. Let yk=Q(xk) denote the quantization value of xk, yk is coded into a binary sequence through an index assignment function (π) 14, and is then fed into a source-aware digital channel encoder 16 and a modulator 18, i.e., the most significant bits (MSB) and least significant bits (LSB) may be treated distinctly. Let ŷk denote the receiver output, which is an estimate of the quantization value yk, the averaged input-output distortion is then given by
    D 0 =E{d(x k , ŷ k)},   (1)
    where d:Rn×Rn→R is a non-negative function that measures the distance between two vectors in Rn.
  • Consider the widely used mean-square distortion function d(x, y) ∥x−y∥2. In this case, the optimal quantizer satisfies the well-known nearest neighbor and centroid conditions. The overall distortion D0 can then be decomposed into two parts, namely, the distortion due to quantization noise, and the distortion due to channel noise, denoted as nq and nc, respectively. That is, x k - y ^ k = ( x k - y k ) n q + ( y k - y ^ k ) n c
    When the quantizer satisfies the centroid condition, E{nq}=0. Note that the quantization noise and the channel noise are independent, we have E{nqnc H}=E{ncnq H}=0. It then follows that D 0 = E { n q 2 } + E { n c 2 } = E { x k - y k 2 } + E { y k - y ^ k 2 } ( 2 )
    When the quantizer is optimal, the distortion due to quantization error is minimized. Minimization of Do is thus reduced to minimizing the distortion only due to the channel noise
    D=E{d(y k , ŷ k)}  (3)
    Joint source index assignment and constellation codeword design for minimum distortion is considered further.
  • First, we consider to minimize the distortion D=E{∥yk−ŷk2} through joint design of source index assignment and index mapping. Write yk as ykk+ek where yk, ŷk ε P={P0, P1, . . . PM-1}, and ek is the estimation error. For 0≦i≦M-1, define Ei={Pi Pj, 0≦j≦M-1}, it then follows that D = E { y k - y ^ k 2 } = i = 0 M - 1 j = 0 M - 1 P i - P j 2 p ( y ^ k = P j | y k = P i ) p ( y k = P i ) = i = 0 M - 1 p ( y k = P i ) e k E i e k 2 p ( e k ) .
    (4)
    Here p(x) denotes the probability that x occurs.
  • For efficient transmission, each quantizer output yk is first coded to a binary sequence then mapped to a symbol in a constellation Ω. When the signal-to-noise ratio (SNR) is reasonably high, as it is for most useful communication systems, each transmitted symbol is more likely to be mistaken for one of its neighbors than for far more distant symbols. Therefore, to minimize the distortion D, the optimal index assignment and constellation codeword design should map the neighboring quantization vectors from the quantization codebook P to neighboring symbols in constellation Ω. More specifically, the optimal 1-1 mapping S:P→Ω should satisfy the following condition:
    Let Pi,Pj,{tilde over (P)}i,{tilde over (P)}j ε P, then d(Pi,Pj)≦d({tilde over (P)}i,{tilde over (P)}j) if and only if d(S(Pi),S(Pj))≦d(S({tilde over (P)}i),S({tilde over (P)}j)).   C1
    That is, ideally, an isomorphic mapping that reserves the geometric structure should exist between the quantization codebook P and the constellation Ω. When the quantizer is optimal, and the constellation is Gray coded, condition (C1) ensures the equivalence between minimizing the BER and minimizing the average distortion.
  • Next we look at the necessary conditions for the existence of S that satisfies (C1). First, assume that the size of the constellation |Ω|=|P|=M, and then look at the case when |Ω|<|P|. Start with systems equipped with scalar quantizers and two-dimensional constellations. Consider a system with a 4-bit uniform scalar quantizer and a 16-QAM constellation as shown in FIG. 2. Since P={P0, P1, . . . P15} ⊂ R, without loss of generality, assume P0<P1< . . . <P15. As can be seen, each Pi has at most two nearest neighbors, but a symbol in a 16-QAM constellation can have as many as 4 nearest neighbors. It is then impossible to find an S:P→Ω that satisfies (C1).
  • In fact, assuming there is an S:P→Ω that satisfies (C1), then we should have d ( S ( P 0 ) , S ( P 15 ) ) = max x 1 , x 2 Ω d ( x 1 , x 2 ) , ( 5 ) d ( S ( P 0 ) , S ( P 1 ) ) = d ( S ( P 14 ) , S ( P 15 ) ) = min x 1 , x 3 Ω d ( x 1 , x 2 ) , ( 6 ) d ( S ( P 1 ) , S ( P 14 ) ) max P i , P j P { d ( S ( P i ) , S ( P j ) ) } , i , j 0 , 1 , 14 , 15 ( 7 )
    Without loss of generality, assume S(P0)=A41, S(P15)=A14, as illustrated in FIG. 2. Now consider the pair P1 and P14. For (6) to be satisfied, P1 and P14 should be mapped to the nearest neighbors of P0 and P15, respectively. Without loss of generality, assume S(P1)=A42. Since d(A42, A13)>d(A42, A24), according to (C1), we should have S(P14)=A13 However, this violates (7), since d(A42, A13)<(A11 A44) but A11, A44 will correspond to points from {Pi, i≠0, 1, 14, 15}. This implies that, to satisfy (7), P1 and P14 should be mapped to the pair AII and A44. Clearly, this violates (6). Therefore, an S that satisfies (C1) does not exist. More generally, for systems utilizing scalar quantizer with codebook P and a symmetric (two-dimensional) rectangular or square constellation Ω with |Ω|=|P|=2m,m>1, there is no 1-1 mapping S:P→Ω that satisfies (C1).
  • In contrast, for the 4-bit scalar quantizer discussed above, instead of 16-QAM, consider the one-dimensional constellation 16-AM with Gray code as shown in FIG. 3. Still denoting the constellation with Ω, clearly the 1-1 mapping S:P→Ω defined by S(Pi)=Ai, 0≦i≦15, satisfies (C1), and it minimizes the BER and the distortion D simultaneously. This one-dimensional case implies that simultaneous minimization of BER and distortion D essentially requires that there exists a 1-1 mapping S:P→Ω0 which satisfies, condition (C1), where Ω0 Ω is a real subset of Ω or Ω itself. This result provides another demonstration to the well known fact that: the essence to obtaining larger coding gain is to design codes in a subspace of signal space with higher dimensionality, as a larger minimum distance can be obtained with the same signal power. For example, two-dimensional constellation such as QAM would be a natural choice for two-dimensional vector quantizers. For multidimensional vector quantizers, multidimensional constellations would fit best. In the case when |Ω|<|P|, more than one constellation symbols are needed to represent one, quantization value. Again, the multidimensional signal constellation obtained from the Cartesian product, ΩN should be exploited.
  • FIG. 4 illustrates this proposed method for transmitting information in a data communication system. Briefly, an incoming analog signal may be sampled and quantized into discrete signal values. Each quantized signal value is then coded into a codeword formed by a binary sequence. Codewords are in turn mapped to symbols of a constellation, where the constellation represent a modulation scheme for the codewords. Simultaneous minimization of bit error rate and distortion could be through constellation-aware source index assignment. Lastly, the modulation symbols may be transmitted in the data communication system. Although reference has been made to quadrature amplitude modulation, it is readily understood that the broader aspect of this disclosure are not limited to a particular modulation scheme.
  • Due to lack of a priori statistical information of the input signal, non-entropy coding is widely used for various sources in practice. That is, in each quantization codeword, some bits are more significant than other bits, and an error in a significant bit will result in larger distortion than that in a less significant bit. This universal existence of non-uniformity in source coding calls for non-uniform information transmission, also known as unequal error protection, in which the most significant bits have lower bit error-rates than other bits. In the following, we consider source-aware non-uniform transmission design along the line of joint source index assignment and constellation design.
  • With the exception of BPSk and QPSK, non-uniformity exists in most constellations. Asymmetric constellations were originally developed for multiresolution (MR) broadcast in Digital HDTV. The asymmetric constellations were designed to provide more protection to the more significant bits by grouping bits into clouds leading by the most significant bits, and the minimum distance between the clouds is larger than the minimum distance between symbols within a cloud as shown in FIG. 5A.
  • For symmetric constellations, an unequal error protection scheme based on block partitioning is provided in “Multilevel coded modulation for unequal error protection and multistage decoding” by R. H. Morelos-Zaragoza et al., IEEE Trans. Commun., Vol 48, pp 204-213, February 2000, which is the generalization of the Ungerboeck's mapping by set partitioning. With block partitioning, the number of nearest neighbors is minimized for each bit level bi. It turns out that the resulted codeword design coincide with that of the MR scheme with d1=d2. As can be seen, constellations resulted from either block partitioning or the MR scheme may no longer be Gray-coded.
  • Gray codes are developed to minimize the bit-error-rate, in which the nearest neighbors correspond to bit groups that differ by only one position. Here, we revisit the non-uniformity in constellations with Gray codes, and introduce a non-uniform transmission scheme based on Gray-coded constellations. In the following, we illustrate the idea through Gray coded 16-QAM constellation shown in FIG. 5B.
  • In 16-QAM, each codeword has the form b0b1b2b3 If we go through the 16 symbols in FIG. 5B, there are altogether 24 nearest neighbor bit changes, among which b0 and b2 each changes 4 times, and b1 and b3 each changes 8 times. Note that when channel probability error is sufficiently small, a bit error corresponding to each bit location bi is most likely to occur when the nearest neighbor has a different value in that specific bit location, i.e., among neighboring pairs where a change occurs. Let Pe denote the error probability, then this implies that when SNR is reasonably high, P e ( b 0 ) = P e ( b 2 ) = 1 2 P e ( b 1 ) = 1 2 P e ( b 3 ) .
    Accordingly, we propose to minimize the average distortion by exploiting the inherent non-uniformity in Gray-coded constellations, that is, to map the more significant bits from the source encoder to bit locations with lower error probability in constellations with Gray codes. For example, consider a 4-bit quantizer and a 16-QAM constellation as in FIG. 5B, the two MSBs will be mapped to b0 and b2, while the two LSBs be mapped to b1 and b3. This mapping function is preferably performed by the channel encoder 16 shown in FIG. 1.
  • This proposed approach may be summarized as follows. For a non-uniform source, a Grey-coded constellation is defined for the designated modulation scheme. Within the constellation, bit locations having a lower error probability are noted. The more significant bits are identified in the bit sequence received from the quantizer. Given a binary sequence from the source, the more significant bits in the binary sequence are then mapped to the bit locations having the lower error probability in the constellation. Lastly, the binary sequence is modulated in accordance with the constellation. While the above description has been provided with reference to a quadrature amplitude modulation scheme, it is readily understood that this approach is extendible to other types of the modulation schemes.
  • The proposed approach can be applied to both symmetric and asymmetric constellations. To illustrate the performance, we compare the proposed Gray-code based non-uniform transmission scheme with the block partitioning based approaches for both coded and uncoded systems (note that the MR scheme is only for asymmetric constellations and coincides with the block partitioning based method in the asymmetric case).
  • First, the source is assumed to be analog with the amplitude uniformly distributed within [0,100], quantized using a 12-bit uniform quantizer. We consider various 16-QAM constellations, both symmetric and asymmetric. First, each 12-bit quantization output b0b1 . . . b11 is partitioned into three 4-bit strings: b0b1b6b7, b2b3b8b9, b4b5b10b11, then mapped to both symmetric and asymmetric 16-QAM constellations based on the block partitioning (BP) scheme or the proposed Gray-code based non-uniform transmission scheme. By random index assignment, we mean that no distinction is made on MSBs and LSBs, and the strings are mapped to the Gray coded constellation based on their original bit arrangements b0b1b2b3, b4b5b6b7, b8b9b10b11. The result is shown in FIG. 6A.
  • In another example, impact of channel coding is investigated for both systematic and non-systematic coding schemes. Using the same source as in the example above, a 10-bit uniform quantizer is connected with a source-aware channel encoder, for which the first 4 MSBs are fed to a rate 1/3 convolutional (or Turbo) encoder and the rest 6 bits are fed to a rate 1/2 convolutional (or Turbo) encoder, respectively. The channel coding output is then mapped to 16-QAM constellations non-uniformly based on the block partitioning approach and the proposed mapping scheme. The result is shown in FIG. 6B.
  • As demonstrated by the simulation results, while the proposed approach has comparable performance with existing unequal error protection methods for uncoded systems (i.e. when there is no channel coding), the Gray-code based non-uniform transmission outperforms the non-Gray coded methods (i.e., the MR method and the block partitioning based approach) with big margins when channel coding is involved. The underlying arguments are: (i) channel coding may change the geometric structure of the uncoded symbols; and (ii) when SNR is reasonably high, BER of the more significant bits vanishes, and BER of the less significant bits dominates the overall distortion, and hence Gray coded constellations result in much better performance.
  • Constellation design has largely been separated from quantizer design in the past. However, we further consider joint quantizer-constellation design for minimum distortion. Following our discussions, we propose to incorporate the source information reflected in optimal quantizer design into constellation design. Note that the optimal quantizers minimize the average distortion between the original sampled values and the quantization values, when considering memoryless AWGN channels, optimal quantizers can be exploited directly for constellation design. We illustrate this idea through the following example.
  • Consider a non-uniform scalar quantizer with four possible quantization values. Assuming the quantization code book is P={P1, . . . P4}, where Pi<Pi+1 for i=1, 2, 3 and each Pi occurs with probability p(Pi)=Pi for i=1, . . . , 4. Define Dij=|P-Pj|2. Along the lines of Lemma 1, we consider the design of a 4-AM constellation Ω={A1, . . . ,A 4 } and assume that the 1-1 map S:Ω→P is designed to satisfy condition (C1). We further assume that the quantizer is optimal, that is, it satisfies the nearest neighbor rule and the centroid criterion. Define dij=|Pi-Pj| for i, j=1, . . . ,4, di=|Ai-Ai+1| for i=1, 2, 3, and let Di be the average distortion corresponding to symbol Ai for i=1, . . . ,4. Consider a memoryless AWGN channel, for which the noise is zero mean and with variance σ2, then we have D 1 = d 12 2 [ Q ( d 1 2 σ ) - Q ( 2 d 1 + d 2 2 σ ) ] + d 13 2 [ Q ( 2 d 1 + d 2 2 σ ) - Q ( 2 d 1 + 2 d 2 + d 3 2 σ ) ] + d 14 2 Q ( 2 d 1 + 2 d 2 + d 3 2 σ ) D 2 = d 12 2 Q ( d 1 2 σ ) + d 23 2 [ Q ( d 2 2 σ ) - Q ( 2 d 2 + d 3 2 σ ) ] + d 24 2 Q ( 2 d 2 + d 3 2 σ ) D 3 = d 13 2 Q ( d 1 + 2 d 2 2 σ ) + d 23 2 [ Q ( d 2 2 σ ) - Q ( 2 d 2 + d 1 2 σ ) ] + d 34 2 Q ( d 3 2 σ ) D 4 = d 34 2 [ Q ( d 3 2 σ ) - Q ( d 2 + 2 d 3 2 σ ) ] + d 24 2 [ Q ( 2 d 2 + 2 d 3 2 σ ) - Q ( d 1 + 2 d 2 + 2 d 3 2 σ ) ] + d 14 2 Q ( d 1 + 2 d 2 + d 3 2 σ )
    where Q ( x ) = 1 2 π x - t 2 / 2 t .
    The overall average distortion can be written as D = i = 1 4 p i D i ( 8 )
    Define γ 1 = d 1 σ , γ 2 = d 2 d 1 , γ 3 = d 3 d 1 ,
    the problem of optimal constellation design for, minimum average distortion is reduced to finding γ1, γ2, γ3 such that D is minimized, subjected to a power constraint, that is min γ 1 , γ 2 , γ 3 D subjected to P s C ( 9 )
    where Ps is the average symbol power and C is a constant. The method used in this example can be extended directly to more general cases. We illustrate the proposed approach through an example.
  • Consider a source consists of two Gaussian distributed random processes centered at ±5 with variance σ2=(5/3)2, as shown in FIG. 7A. Using a 4-level optimal quantizer with codebook P={−6.40, −3.86, 3.69, 6.2}, normalized MSE under different SNR levels is shown in FIG. 7B for both uniform 4-AM and the proposed source-aware 4-AM.
  • From the simulation result, it can be seen that while symmetric constellations are optimal for uniformly distributed sources, asymmetric constellations reduce the average distortion significantly for sources that require non-uniform quantization. Compared with the asymmetric constellations originally designed for multiresolution broadcasting, the proposed joint quantizer-constellation design scheme generalizes the concept of non-uniform constellation design from the perspective of joint source-channel coding.
  • In this disclosure, we studied joint optimization of source index assignment and modulation design for overall input-output distortion minimizations in communication systems. Taking a joint source-channel coding perspective, distortion minimization was carried out through Gray-code based non-uniform mapping and joint quantizer-constellation design. More specifically, our contributions can be summarized as:
      • We focused on distortion minimization for any wireless systems with analog input. Our discussion on simultaneous minimization of BER and average input-output distortion provides an interface between the optimal system design for minimum distortion and the traditional system design focused on BER minimization.
      • We proposed a novel non-uniform transmission scheme based on Gray-coded constellations. This design makes it possible for simultaneous minimization of distortion and BER. At the same time, the proposed approach outperforms existing unequal error protection approaches with big margins when channel coding is involved. Channel coding is widely used in almost all communication systems. Therefore, this approach can be applied to improve the power and spectral efficiency of virtually any the digital communication systems with analog inputs, particularly for systems with tight power constraints such as wireless sensor networks and space communications.
      • We also proposed a novel method on optimal constellation design for minimum distortion, by incorporating the source information reflected in optimal quantizer design into constellation design. This scheme generalized the concept of non-uniform constellation design and is particularly attractive for systems with non-uniform sources.
  • The description in this disclosure is exemplary in nature and is not intended to limit the present disclosure, application, or uses.

Claims (24)

1. A method for transmitting information in a data communication system, comprising:
receiving a codeword having a plurality of bits;
mapping more significant bits of the codeword to bit locations of a symbol in a constellation with lower error probabilities, where the constellation represents a modulation scheme;
modulating the symbol in accordance with the modulation scheme; and
transmitting the symbol from a transmitter in the data communication system.
2. The method of claim 1 further comprises receiving an analog input signal, sampling the analog input signal to generate a plurality of sample values, and quantizing each sample value to a codeword in accordance with a quantization codebook.
3. The method of claim 1 further comprises selecting a constellation having same dimensionality as the quantization codebook.
4. The method of claim 1 wherein the symbols of the constellation are Gray coded.
5. The method of claim 1 further comprised modulating the symbol in accordance with a quadrature amplitude modulation scheme.
6. The method of claim 1 further comprises designing the constellation based in part on an attribute of the analog input signal.
7. The method of claim 1 further comprises employing a symmetric constellation when the analog input signal is symmetric.
8. The method of claim 1 further comprises employing an asymmetric constellation when the analog input signal is asymmetric.
9. The method of claim 1 further comprises designing the constellation based in part on power constraints.
10. A method for transmitting information in a data communication system, comprising:
sampling an incoming analog signal;
quantizing sample values of the analog signal into codewords in accordance with a quantization codebook;
selecting a constellation having Grey coded symbols, where the constellation represents a modulation scheme for the codewords; and
transmitting the modulated codewords.
11. The method of claim 10 further comprises selecting a constellation having same dimensionality as the quantization codebook.
12. The method of claim 10 further comprises mapping more significant bits of each codeword to bit locations of a symbol in a constellation with lower error probabilities.
13. The method of claim 10 further comprises selecting the constellation based in part on an attribute of the analog signal.
14. The method of claim 10 further comprises selecting a symmetric constellation for an analog signal having a uniformly distributed amplitude.
15. The method of claim 10 further comprises selecting an asymmetric constellation for an analog signal having a non-uniformly distributed amplitude.
16. An apparatus for transmitting data in a data communication system, comprising:
a quantizer adapted to receive an analog input signal and operable to translate each sample value of the analog signal to a codeword;
an encoder adapted to receive codewords from the quantizer and operable to map more significant bits of each codeword to bit locations of a symbol in a constellation with lower error probabilities, where the constellation represents a modulation scheme;
a modulator adapted to receive symbols from the encoder and modulate the symbols in accordance with the modulation scheme; and
a transmitter adapted to receive modulate symbols from the modulator and operable to transmit the modulated symbols through a data communication system.
17. The apparatus of claim 16 wherein the constellation has same dimensionality as a quantization codebook employed by the quantizer.
18. The apparatus of claim 16 wherein the constellation having Grey coded symbols.
19. A method for transmitting information in a data communication system, comprising:
sampling an incoming analog signal;
quantizing sample values of the analog signal into codewords in accordance with a quantization codebook;
selecting a constellation having same dimensionality as the quantization codebook and modulating the codewords in accordance with the constellation, where the constellation represents a modulation scheme for the codewords; and
transmitting the modulated codewords.
20. The method of claim 19 further comprises selecting a constellation having Gray coded symbols.
21. The method of claim 19 further comprises mapping more significant bits of each codeword to bit locations of a symbol in a constellation with lower error probabilities.
22. The method of claim 19 further comprises selecting the constellation based in part on an attribute of the analog signal.
23. The method of claim 19 further comprises selecting a symmetric constellation for an analog signal having a uniformly distributed amplitude.
24. The method of claim 19 further comprises selecting an asymmetric constellation for an analog signal having a non-uniformly distributed amplitude.
US11/825,132 2006-07-06 2007-07-03 Source-aware non-uniform information transmission with minimum distortion Abandoned US20080012740A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/825,132 US20080012740A1 (en) 2006-07-06 2007-07-03 Source-aware non-uniform information transmission with minimum distortion

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US81900406P 2006-07-06 2006-07-06
US11/825,132 US20080012740A1 (en) 2006-07-06 2007-07-03 Source-aware non-uniform information transmission with minimum distortion

Publications (1)

Publication Number Publication Date
US20080012740A1 true US20080012740A1 (en) 2008-01-17

Family

ID=38948725

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/825,132 Abandoned US20080012740A1 (en) 2006-07-06 2007-07-03 Source-aware non-uniform information transmission with minimum distortion

Country Status (1)

Country Link
US (1) US20080012740A1 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090102852A1 (en) * 2007-10-17 2009-04-23 Mahbod Eyvazkhani Method, Apparatus and Computer Program Product for Providing Improved Gray Mapping
US20090196361A1 (en) * 2008-01-31 2009-08-06 The Hong Kong University Of Science And Technology Non-binary source-to-channel symbol mappings with minimized distortion
US20110182381A1 (en) * 2010-01-25 2011-07-28 Futurewei Technologies, Inc. System and Method for Digital Communications with Unbalanced Codebooks
US20110243269A1 (en) * 2010-03-31 2011-10-06 Kabushiki Kaisha Toshiba Transmitter and receiver
US20110274201A1 (en) * 2008-10-28 2011-11-10 Shay Freundlich Device, method and system of wireless communication over an extremely high radiofrequency band
US20160218745A1 (en) * 2015-01-27 2016-07-28 Electronics And Telecommunications Research Institute Bit interleaver for low-density parity check codeword having length of 16200 and code rate of 2/15 and 16-symbol mapping, and bit interleaving method using same
US20160241269A1 (en) * 2015-02-17 2016-08-18 Electronics And Telecommunications Research Institute Bit interleaver for low-density parity check codeword having length of 16200 and code rate of 4/15 and 256-symbol mapping, and bit interleaving method using same
US20160241272A1 (en) * 2015-02-17 2016-08-18 Electronics And Telecommunications Research Institute Bit interleaver for low-density parity check codeword having length of 16200 and code rate of 3/15 and 256-symbol mapping, and bit interleaving method using same
WO2019186040A1 (en) * 2018-03-27 2019-10-03 Continental Automotive France Method for transmitting measurements performed by a sensor to a receiver
US10972215B2 (en) * 2018-03-09 2021-04-06 Nokia Solutions And Networks Oy Methods and apparatus for joint use of probabilistic signal shaping and forward error correction
US11150983B2 (en) * 2018-08-08 2021-10-19 Trw Limited Sensing apparatus
CN115134023A (en) * 2022-06-23 2022-09-30 杭州电子科技大学 Method and system for deriving average distortion theoretical value of uniformly quantized real-time communication system
CN115134027A (en) * 2022-06-23 2022-09-30 杭州电子科技大学 Method and system for deriving average distortion theoretical value of united uniform quantization and ideal channel coding
US11882316B2 (en) * 2017-10-05 2024-01-23 Cable Television Laboratories, Inc. System and methods for data compression and nonuniform quantizers

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050002464A1 (en) * 2001-09-30 2005-01-06 Tao Fan Data re-transferring method based on bit transformation
US20060245489A1 (en) * 2003-06-16 2006-11-02 Mineo Tsushima Coding apparatus, coding method, and codebook
US20070230324A1 (en) * 2004-02-13 2007-10-04 Neocific, Inc. Methods and Apparatus for Multi-Carrier Communication Systems with Adaptive Transmission and Feedback

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050002464A1 (en) * 2001-09-30 2005-01-06 Tao Fan Data re-transferring method based on bit transformation
US20060245489A1 (en) * 2003-06-16 2006-11-02 Mineo Tsushima Coding apparatus, coding method, and codebook
US20070230324A1 (en) * 2004-02-13 2007-10-04 Neocific, Inc. Methods and Apparatus for Multi-Carrier Communication Systems with Adaptive Transmission and Feedback

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090102852A1 (en) * 2007-10-17 2009-04-23 Mahbod Eyvazkhani Method, Apparatus and Computer Program Product for Providing Improved Gray Mapping
US8116386B2 (en) * 2007-10-17 2012-02-14 Mahbod Eyvazkhani Method, apparatus and computer program product for providing improved gray mapping
US8363735B2 (en) 2007-10-17 2013-01-29 Core Wireless Licensing, S.a.r.l. Method, apparatus and computer program product for providing improved gray mapping
US8917780B2 (en) 2007-10-17 2014-12-23 Core Wireless Licensing S.A.R.L. Method, apparatus and computer program product for providing improved gray mapping
US20090196361A1 (en) * 2008-01-31 2009-08-06 The Hong Kong University Of Science And Technology Non-binary source-to-channel symbol mappings with minimized distortion
US20110274201A1 (en) * 2008-10-28 2011-11-10 Shay Freundlich Device, method and system of wireless communication over an extremely high radiofrequency band
US20110182381A1 (en) * 2010-01-25 2011-07-28 Futurewei Technologies, Inc. System and Method for Digital Communications with Unbalanced Codebooks
US8325850B2 (en) * 2010-01-25 2012-12-04 Futurewei Technologies, Inc. System and method for digital communications with unbalanced codebooks
US20110243269A1 (en) * 2010-03-31 2011-10-06 Kabushiki Kaisha Toshiba Transmitter and receiver
US8891664B2 (en) * 2010-03-31 2014-11-18 Kabushiki Kaisha Toshiba Transmitter and receiver
US20160218745A1 (en) * 2015-01-27 2016-07-28 Electronics And Telecommunications Research Institute Bit interleaver for low-density parity check codeword having length of 16200 and code rate of 2/15 and 16-symbol mapping, and bit interleaving method using same
US9698829B2 (en) * 2015-01-27 2017-07-04 Electronics And Telecommunications Research Institute Bit interleaver for low-density parity check codeword having length of 16200 and code rate of 2/15 and 16-symbol mapping, and bit interleaving method using same
US20160241269A1 (en) * 2015-02-17 2016-08-18 Electronics And Telecommunications Research Institute Bit interleaver for low-density parity check codeword having length of 16200 and code rate of 4/15 and 256-symbol mapping, and bit interleaving method using same
US20160241272A1 (en) * 2015-02-17 2016-08-18 Electronics And Telecommunications Research Institute Bit interleaver for low-density parity check codeword having length of 16200 and code rate of 3/15 and 256-symbol mapping, and bit interleaving method using same
US9698826B2 (en) * 2015-02-17 2017-07-04 Electronics And Telecommunications Research Institute Bit interleaver for low-density parity check codeword having length of 16200 and code rate of 4/15 and 256-symbol mapping, and bit interleaving method using same
US9705529B2 (en) * 2015-02-17 2017-07-11 Electronics And Telecommunications Research Institute Bit interleaver for low-density parity check codeword having length of 16200 and code rate of 3/15 and 256-symbol mapping, and bit interleaving method using same
US11882316B2 (en) * 2017-10-05 2024-01-23 Cable Television Laboratories, Inc. System and methods for data compression and nonuniform quantizers
US10972215B2 (en) * 2018-03-09 2021-04-06 Nokia Solutions And Networks Oy Methods and apparatus for joint use of probabilistic signal shaping and forward error correction
WO2019186040A1 (en) * 2018-03-27 2019-10-03 Continental Automotive France Method for transmitting measurements performed by a sensor to a receiver
FR3079697A1 (en) * 2018-03-27 2019-10-04 Continental Automotive France METHOD FOR TRANSMITTING MEASUREMENTS MADE BY A SENSOR TO A RECEIVER
US11150983B2 (en) * 2018-08-08 2021-10-19 Trw Limited Sensing apparatus
CN115134023A (en) * 2022-06-23 2022-09-30 杭州电子科技大学 Method and system for deriving average distortion theoretical value of uniformly quantized real-time communication system
CN115134027A (en) * 2022-06-23 2022-09-30 杭州电子科技大学 Method and system for deriving average distortion theoretical value of united uniform quantization and ideal channel coding

Similar Documents

Publication Publication Date Title
US20080012740A1 (en) Source-aware non-uniform information transmission with minimum distortion
US11895513B2 (en) Methods of transmitting data using unequally spaced constellations that provide reduced SNR requirements as compared to equally spaced constellations
US10826619B2 (en) Methods of converting or reconverting a data signal and method and system for data transmission and/or data reception
US20210319286A1 (en) Joint source channel coding for noisy channels using neural networks
Goldsmith et al. Joint design of fixed-rate source codes and multiresolution channel codes
US5289501A (en) Coded modulation with unequal error protection for fading channels
US20210351863A1 (en) Joint source channel coding based on channel capacity using neural networks
Tung et al. DeepJSCC-Q: Constellation constrained deep joint source-channel coding
US20070019753A1 (en) Adaptive multilevel block coded modulation for OFDM systems
US20050195905A1 (en) System and method for adaptive bit loading source coding via vector quantization
US10523480B1 (en) K-bit enumerative sphere shaping of multidimensional constellations
Matsumine et al. A low-complexity probabilistic amplitude shaping with short linear block codes
Cai et al. Bandwidth expansion Shannon mapping for analog error-control coding
CN117981228A (en) System and method for multidimensional multi-level forward error correction encoding and decoding
US7388522B2 (en) Sequentially decoded low density parity coding (LDPC) forward error correction (FEC) in orthogonal frequency division modulation (OFDM) systems
Yao et al. Polar coded modulation via hybrid bit labeling
CN116667973B (en) Data transmission method, device and equipment for simulating joint source channel coding
Lu et al. Reducing signal distortion due to transmission error via multiresolution digital modulations
Gortz et al. Source-adaptive power allocation for digital modulation
Naka Performance of Probabilistic Amplitude Shaping with a single LUT Distribution Matcher
Li et al. Non-uniform information transmission for minimum distortion in wireless networks
US20240048431A1 (en) Systems and Methods for Receiving Data Transmitted Using Non-Uniform QAM 256 Constellations
Yao et al. Optimal index assignment for scalar quantizers and M-PSK via a discrete convolution-rearrangement inequality
Fuldseth et al. Combined video coding and multilevel modulation
Li et al. Source-aware nonuniform information transmission for minimum distortion

Legal Events

Date Code Title Description
AS Assignment

Owner name: BOARD OF TRUSTEES OF MICHIGAN STATE UNIVERSITY, MI

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LI, TONGTONG;WANG, HUAHUI;LING, QI;REEL/FRAME:019947/0756

Effective date: 20070925

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION