Non-Punctured Non-Systematic - Rate Turbo Codes
Non-Punctured Non-Systematic - Rate Turbo Codes
Abstract— In this paper we present non-punctured three Finite State Sequential Machines (FSSMs)) and of
non-systematic ½-rate turbo codes designed using applying puncturing over these three outputs to convert
Finite State Sequential Machines (FSSMs) that the rate of the code from 1/3 to ½ (Banerjee et al.
operate over the Finite Field GF(4). It is shown in (2005). We show in this paper that the use of FSSMs
this paper that these schemes do not show defined over the Finite Field GF ( 4 ) allows us the
convergence problems in their iterative decoding, as design of NS ½-rate turbo codes that do not need to
it happens to similar schemes defined over the apply puncturing. The structure is shown in Fig. 1, and
binary Field. Non-systematic turbo codes can be it consists on transmitting simply and alternately the
useful for the design of communication systems for corresponding redundancy outputs of two FSSMs.
which error correction and encryption are two In this paper we will show that in general, NS ½-rate
important goals. turbo codes present a slight loss in the Bit Error Rate
A relationship is found between the state (BER) performance with respect to their equivalent
transitions structure of the FSSM and the BER systematic schemes, in the waterfall region of the BER
performance (or equivalently the form of the EXIT performance curve of the turbo code. However,
chart) of the turbo code constructed using that Banerjee et al. (2005) shows that NS 1/3-rate schemes
FSSM. FSSMs defined over GF(4) with all-zero present lower floor effects in the BER performance
input responses of the form of closed cycles are the curve of turbo codes with respect to their equivalent
best options as constituent encoders of non- systematic schemes. We will concentrate our analysis
punctured non-systematic ½-rate turbo codes. A on the waterfall region of the BER performance curve
close relationship is also found between the BER of NP-NS ½-rate turbo codes defined over GF ( 4 ) .
performance and the coefficients that define the In spite of their slight loss in BER performance in the
structure of the FSSM that constitutes the turbo waterfall region, NS ½-rate turbo codes can be used in
code. schemes where not only error-control coding, but also
privacy is an important additional aim in the design of
Key words— Turbo codes. EXIT charts. Non- communications systems. The use of systematic turbo
systematic coding. Non-linear coding. codes is related to the transmission of the message
I. INTRODUCTION symbols that appear in the transmitted output, allowing
a given eavesdropper to directly read this desired
Binary non-systematic turbo codes were introduced information. This is however not strictly speaking a
by Banerjee et al. (2005). In a non-systematic turbo problem in terms of security, because systematic
code, the message symbols are not transmitted, thus information can be externally protected by applying an
only redundancy symbols appear at the output. Non- encryption algorithm over this message information. In
systematic turbo codes can be defined in any Finite a NS mode, message symbols are not present at the
Field of the form GF ( q ) , where usually q = 2 n , and n transmitted output, and this increases the levels of
is an integer, and the most common definition is done privacy with respect to the systematic mode. An
over the Finite Field GF ( 2 ) , also known as the binary application of NS ½-rate turbo codes in secure
Field. In the classic form of a turbo code (Berrou, et. al., communication is given in a previous work of the
1993) the rate of the code is controlled by applying authors (Castiñeira Moreira et al., 2006). A
puncturing, which is essentially performed by means of cryptoanalysis (brute force and differential
an output selector that transmit only determined output cryptoanalysis) is performed in that paper, for schemes
symbols. In this paper we present non-punctured non- where coefficients of the FSSMs that are constituent
systematic (NP-NS) ½-rate turbo codes defined over encoders of a turbo code are randomly varied during
GF ( 4 ) . NP-NS ½-rate turbo codes defined over the transmission. Under certain conditions, the scheme is
shown to be robust against the above described attacks.
binary Field present convergence problems in their
iterative decoding, such that for a suitable NS turbo
code defined over this Field there is a need of
generating three redundancy outputs (by means of the
use of three convolutional encoders, or equivalently
XII Reunión de Trabajo en Procesamiento de la Información y Control, 16 al 18 de octubre de 2007
II. NON-SYSEMATIC ½-RATE TURBO B. Structure of the state transitions of FSSMs over
CODES OVER GF ( 4 ) GF(4)
A. An encoder of a Non-systematic ½-rate turbo In this paper we analyse the state transitions structure
code of the 63 cases of FSSMs defined over GF ( 4 ) with
The structure of a NP-NS ½-rate turbo code defined
over GF ( 4 ) is seen in Fig. 1. The structure has a s = 2 , and g ( x ) = a0 + a1 x + a 2 x 2 , and its relationship
random interleaver of size L = 10000 . with the BER performance of the corresponding NP-NS
The encoder is constructed using FSSMs that operate ½-rate turbo code. A similar analysis is done in
(Petruzzi et al., 2007) for systematic turbo codes. The
over GF ( 4 ) , and include a polynomial g( x ) between
use of these FSSMs provides a wider range of
the two memory units of the FSSM. This polynomial is possibilities of turbo coding schemes in comparison
in general of the form: with those defined over the binary Field. This number of
possibilities increases as m and n increase.
g (x ) = a0 + a1 x + ... + a m x m (1) FSSMs under analysis show different responses to the
all-zero input, which are essentially determined by the
where m is an integer, and ai ∈ GF ( q ) , so called current state – next state representation.
FSSMs used in this paper are non-linear, and they have
i = 0 ,1,...,m . Coefficients of this polynomial define the
a non-zero output for the all-zero input.
characteristics of the FSSM and also of the turbo code For each FSSM we have analysed the response for the
constructed using this FSSM (Castiñeira Moreira et al., 16 possible initial state conditions. Responses of FSSMs
2006). An analysis of the randomness of the output under analysis can be classified into different groups.
generated by these FSSMs for the all-zero input case is FSSMs can show responses that are cycles, which can
done in (Petruzzi et al., 2006). Output randomness and be run in a closed form on not. Since this difference in
the state transition structure of the all-zero input the behaviour of the FSSM is relevant to its
response of the FSSM define the behaviour of the NS performance as a constituent encoder of a turbo code,
½-rate turbo code constructed with that FSSM. we want to differentiate these two types of cycles. A
We will consider all the possible turbo codes defined cycle that includes always a given set of states and is
over GF ( 4 ) , with s = 2 memory units, and with run starting from any of these states, will be referred to
polynomials of degree m = 2 or less, of the form as a closed cycle. The number of states that the cycle
g( x ) = a0 + a1 x + a 2 x 2 . The turbo code is always runs is the length of the cycle, and it will be denoted as
constructed using the same FSSM in both constituent LC . When the cycle is reached after a sequence of
encoders. Thus, a given NP-NS ½-rate turbo code states that do not form the cycle, showing a transient
defined over GF ( 4 ) , and with m = 2 , will be denoted behaviour, the response will be referred to as a cycle
with transients, and the number of states of the cycle,
as an (a0 a1 a 2 ) NP-NS ½-rate turbo code. (excluding the number of states of the transient), is the
Therefore, for each turbo code (Fig. 1), length of the cycle, denoted as LT . FSSMs can also
show responses without cycles, and also stationary
g 1 ( x ) = g 2 ( x ) = g ( x ) = a0 + a1 x + a 2 x 2 (2). responses, which can be given at the all-zero state, or at
c1 ( l )
other non-zero states.
u1 ( l ) QC FSSM e ( l )
1
Polar A coefficient is defined in (Petruzzi et al., 2007) that
d1 ( l ) and measures the randomness and properties of the state
binary transitions structure of FSSM and their relationship with
u2 ( l ) e 2 ( l ) format c 2 ( l )
D
the BER performance of the corresponding turbo code.
ed 1 ( l ) d2( l ) It is called the random behaviour coefficient ∆R , and its
D definition is repeated here for clarity:
g1 ( x )
ed 2 ( l )
edgf 1 ( l ) qs
1
D g2( x )
∆R =
q s Lc _ max
∑L C ( i )ηδ ( i ) (3)
edgfd 1 ( l ) i =1
edgf 2 ( l )
Interleaver D where LC ( i ) is the length of the closed cycle present at
edgfd 2 ( l )
the response for the initial condition i , ηδ ( i ) is the
Figure 1. A ½-rate NP-NS turbo code defined over delta function coefficient measured for the all-zero input
GF ( 4 ) . case for the initial condition i , which was defined in
(Petruzzi et al., 2006), and evaluates the response of the
auto correlation of the output of the FSSM for the all-
zero input, and Lc _ max is the maximum length of a
XII Reunión de Trabajo en Procesamiento de la Información y Control, 16 al 18 de octubre de 2007
closed cycle verified for the corresponding FSSM, This analysis is applied to NP-NS ½-rate turbo codes
evaluated over all the responses. If the response has designed in this paper using the proposed FSSMs under
cycles with transients, or responses without cycles for study. Some relationship is found between the EXIT
the initial condition i , then we set LC ( i ) = 1 . When chart appearance and the structure of the state
the response is a closed cycle, LC ( i ) can adopt any transitions and randomness of the output for the all-zero
input case, quantitatively indicated by the value of the
value in the set {2 ,3,4 ,6 ,15}. The addition in (3) defined random behaviour coefficient ∆R .
excludes stationary responses and all-zero outputs. On the other hand the classic BER performance analysis
This coefficient is evaluated over the 16 responses of can be also used to characterise these turbo codes. It is
the FSSM by calculating a weighted average of the found that NP-NS ½-rate turbo codes over GF ( 4 )
delta function coefficient ηδ for each response. The
have the best BER performance when they are
weight is the length of the closed cycle (if any) present constructed using FSSMs that have the highest values of
at that response. It is found that the higher is the value the random behaviour coefficient, which means that the
of the random behaviour coefficient of the FSSM, the all-zero input responses of these FSSMs are of the form
better is in general the BER performance of the NP-NS of long (in some cases the longest) closed cycles. Turbo
½ rate turbo code constructed with that FSSM. codes constructed using FSSMs with cycles with
transients perform worse than those with closed cycles.
III. EXIT CHART AND BER This can be verified in Fig. 2, where BER performances
PERFORMANCE OF NON-PUNCTURED of several NP-NS ½-rate turbo codes are shown.
NON-SYSTEMATIC TURBO CODES Simulations are done for the transmission of 250 blocks
OVER GF ( 4 ) of 10000 elements of the Finite Field GF ( 4 ) , encoded
by using in all the cases the same random interleaver of
A. BER performance analysis of non-punctured size L = 10000 , decoded using the LOG-MAP BCJR
non-systematic turbo codes over GF ( 4 ) decoder (Bahl et al., 1974), with 8 iterations.
The best schemes among those shown in Fig. 2 are the
The performance of a turbo code can be analysed by NP-NS ½-rate (α 0 α ) turbo code ( ∆R = 0.5058 )
using two well known procedures. One of them is the (
and the NP-NS ½-rate α 2 α 2 0 turbo code )
simulation of the Bit Error Rate, by depicting a curve of ( ∆R = 0.7260 ), that show high values of the random
this parameter as a function of the average bit energy-
behaviour parameter.
to-noise power spectral density ratio, E b / N 0 . Another
These schemes use FSSMs that have closed cycles of
tool for analysing the behaviour of iteratively decoded length 6 and 15 respectively. BER performances of
codes like turbo and LDPC codes has been proposed in these schemes are quite close to that corresponding to
(Ten Brink, 2001). He introduced a very useful tool that one of the best binary systematic schemes. Floor effect
is known as the Extrinsic Information Transfer (EXIT) is not present in this particular simulation for these two
chart. The EXIT chart is an especially good tool for the schemes. The simulation involves the transmission of
analysis of the waterfall region, and also illustrates the
behaviour of the code in the other two regions of the 5 x10 6 bits. Best schemes seen in Fig. 2 have presented
BER performance curve of a turbo code (Hanzo et al., no errors in this simulation, for E b / N 0 = 2 , 2.5 and
2001; Castiñeira Moreira and Farrell, 2006). It 3dB . This could indicate that the measured BER in
describes, for each value of Eb / N 0 , the relationship these cases is less than Pbe < 2 x10 −6 . We should note
between the mutual information of the a priori however that reliable values of the BER obtained by
information and the message bit information, I A , and simulation require that the number of errors present in
the mutual information of the extrinsic information and the simulated case has to be at least one hundred o
the message bit information, I E . This Extrinsic larger. This means that BER performances seen in Fig.
Information Transfer function is defined as (Ten Brink 2 are reliable only for Pbe > 10 −5 . This is however
et al., 2001): enough for our proposes, because we analyse the
waterfall region of the BER performance, typically
I E = Tr ( I A , Eb / N 0 ) (4) present in the range 10 −1 > Pbe > 10 −5 .
Similarly, an EXIT chart can also describe the mutual The comparison is done with respect to a systematic
information I A as a function of the mutual information binary turbo code considered as that with the best BER
performance possible. As mentioned earlier, NP-NS ½-
I E , which can be useful for understanding the process rate binary turbo codes present convergence problems
in which the extrinsic information of the current and show very poor BER performances, and it is not
iteration becomes the a priori information of the useful to consider them in this comparison..
following iteration (Ten Brink et al., 2001).
XII Reunión de Trabajo en Procesamiento de la Información y Control, 16 al 18 de octubre de 2007
B. EXIT chart analysis of non-punctured non- with transients, and sometimes there are no stationary
systematic turbo codes over GF ( 4 ) responses, or there is more than one stationary response.
The random behaviour coefficient of schemes of this
A strong relationship is found between the state group is always lees than ∆R < 0.3 .
transitions structure and randomness of the output of the
A strong relationship is found between the state
FSSM for the all-zero input, and the appearance of the
transitions structure and the form of the EXIT chart for
EXIT chart of the corresponding turbo code, in the case
schemes of the so called group A, for NP-NS ½-rate
of ½-rate systematic turbo codes over GF ( 4 ) in
turbo codes. However, this correspondence is not
(Petruzzi et al., 2007). clearly given for schemes of group B. Especially in the
10
0 case of group B, the form of the EXIT chart of a NP-NS
turbo code is rather defined by the values of coefficients
-1
10 a 1 and a 2 .
10
-2 NP-NS ½-rate turbo codes that belong to group A, show
slight differences in the corresponding EXIT charts.
-3 These schemes are the NP-NS ½-rate turbo codes with
Pb
10
the best BER performances, that is, those that show the
10
-4 best EXIT charts. Sub group A.1, characterised by
having FSSMs with the longest closed cycles (Length
10
-5
LC = Lmax = 15 ) have EXIT charts of the form of Fig.
3.
-6
10
0.5 1 1.5 2 2.5 3 1
Eb/No [dB]
0.9
(α α α ) NP-NS ½-rate turbo code 0.8
+ + (α α 2
)
1 NP-NS ½-rate turbo code 0.6
IE, IA
x x (α 2
0 1) NP-NS ½-rate turbo code
0.5
0.4
(1 1 0 ) NP-NS ½-rate turbo code
0.3 From:
(α α 2 0 ) NP-NS ½-rate turbo code
2
0.2 0.9 dB to
1.9 dB,
(α 0 α ) NP-NS ½-rate turbo code 0.1 step 0.2 dB
5-7 classic binary systematic ½-rate turbo code 0
0 0.2 0.4 0.6 0.8 1
IA, IE
respect to the set of schemes for which a0 = 0 ,1,α ,α 2 , group, NP-NS ½-rate turbo codes of relatively quite
good BER performances are those for which
a1 = 0 and a 2 = 1,α 2 . This indicates differences
a 0 = 0 ,1,α ,α 2 , a1 = α and a2 = α 2 and
between the corresponding trellis structures, which are
closely related to the values of coefficients a1 and a 2 . a 0 = 0 ,1,α ,α 2 , a 1 = α 2 and a 2 = 1 . One of these
0.9
The “bottleneck” region of the EXIT chart is identified
0.8
as a region in which iterations play an important roll in
the efficiency of the iterative decoding of these codes 0.7
The third sub group in group A is the sub group A.3, 0.3 From:
constituted of NP-NS ½-rate turbo codes for which 0.2 0.9 dB to
1.9 dB,
a0 = 0 ,1,α ,α 2 , a1 = 1 and a 2 = 0 . Schemes of this sub 0.1 step 0.2 dB
0
group perform worse than those of sub groups A.1 and 0 0.2 0.4 0.6 0.8 1
A.2. The BER performance of the (1 1 0 ) NP-NS ½- IA, IE
0.9 1
0.8 0.9
0.7 0.8
0.6 0.7
IE, IA
0.5 0.6
IE, IA
0.4 0.5
0.3 From: 0.4
0.2 0.9 dB to From:
0.3
1.9 dB,
0.1 0.9 dB to
step 0.2 dB 0.2
1.9 dB,
0 0.1
0 0.2 0.4 0.6 0.8 1 step 0.2 dB
IA, IE 0
0 0.2 0.4 0.6 0.8 1
IA, IE