In this section, some properties of cumulants that will be used in the subsequent chapters are reviewed. For comprehensive treatment of higher-order statistics of random variables and stationary and nonstationary signals see (Brillinger 1965, 1981), (Rosenblatt 1974), (Gardner and Spooner 1994), (Spooner and Gardner 1994), (Dandawaté and Giannakis 1994, 1995), (Boashash et al. 1995), (Napolitano 1995), (Izzo and Napolitano 1998a), (Napolitano and Tesauro 2011).
Theorem 1.4.1 If two real-valued random-variable vectors and are statistically independent, then
(1.190)
Proof: Let , and . The characteristic function of the random vector X factorizes into the product of the characteristic functions of X1 and X2. That is,
(1.191)
where the second equality is consequence of the statistical independence of the random vectors X1 and X2. Thus,
(1.192)
where the kth-order derivative of each of the two terms in the square brackets is zero since the first one depends only on , and the second one depends only on .
This result can be extended with minor changes to the case of complex-valued random-variable vectors.
As a consequence of Theorem 1.4.1, we have that if the stochastic process is asymptotically independent, that is, for every t the random variables x(t) and x(t + τ) are asymptotically (|τ|→ ∞) independent, then
(1.193)
where . In fact, if ||τ||→ ∞, then at least one τi→ ∞ and x(t + τi) becomes statistically independent of x(t).
In this section, the non-obvious result is proved that the Nth-order cumulant for complex random variables defined in (Spooner and Gardner (1994) App. A) (see also (1.209)) is zero for N ≥ 3 when the random variables are jointly complex Normal (Napolitano 2007a App. E).
Let V = [V1, ..., VN, VN+1, ..., V2N]T [XT, YT]T be the 2N-dimensional column vector of real-valued random variables obtained by the N-dimensional column vectors X [X1, ..., XN]T, and Y [Y1, ..., YN]T of real-valued random variables. It is characterized by the 2Nth-order joint probability density function (pdf)
(1.194)
Its moment generating function is the 2N-dimensional Laplace transform
with , which is analytic in the region of convergence of the integral. The mean vector of V is
(1.196)
where μX and μY are the mean vectors of X and Y, respectively. The covariance matrix is
(1.197)
where CXX and CYY are the covariance matrices of X and Y, respectively, and
(1.198)
is their cross-covariance matrix.
The 2Nth-order cumulant of the real random variables V1, ..., V2N is defined as
where ωX [ωX1, ..., ωXN]T and ωY [ωY1, ..., ωYN]T.
Let us consider, now, the N-dimensional complex-valued column vector Z = [Z1, ..., ZN]T X + jY. It is characterized by the same 2Nth-order joint pdf fV(v) of the 2N-dimensional real-valued vector V defined above.
Instead of considering the vector V, the following complex augmented-dimension vector
(1.200)
can be considered. Its mean vector and covariance matrix are given by
(1.201)
(1.202)
where
(1.203)
(1.204)
(1.205)
(1.206)
(1.207)
(1.208)
with and CZZ referred to as covariance matrix and conjugate covariance matrix, respectively.
The Nth-order cumulant of the complex random variables Z1, ..., ZN can be defined as (Spooner and Gardner 1994, App. A)
where ω [ω1, ..., ωN]T and P are the set of distinct partitions of {1, ..., N} each constituted by the subsets {μi, i = 1, ..., p}. Note that since each complex variable Zk is arbitrary, it can also be the complex conjugate of another complex variable. Such a definition turns out to be useful when applied to complex-valued stochastic processes or time series as shown in (Spooner and Gardner 1994, App. A), (Izzo and Napolitano 1998a), (Izzo and Napolitano 2002a). In particular, it is useful since it preserves the same relationship between moments and cumulants of real random variables (Leonov and Shiryaev 1959), (Brillinger 1965, 1981), (Brillinger and Rosenblatt 1967), as such a relationship is purely algebric. In addition, the characteristic function in (1.209) is an analytic function of the complex variables Xk + jYk, k = 1, ..., N. In contrast, the characteristic function in (1.199) depends separately on Xk and Yk and hence, in general, is not an analytic function of the complex variables Xk + jYk. Finally, note that, for deterministic liner time-variant systems, input/output relationships in terms of cumulants defined as in (1.209) have the same form as that in terms of moments (Napolitano 1995), (Izzo and Napolitano 2002a).
Let Z be a N-dimensional column vector of jointly complex Normal random variables. That is, V is a 2N-dimensional column vector of jointly Normal real-valued random variables:
(1.210)
that can also be written in the complex form (Picinbono 1996), (van den Bos 1995)
(1.211)
where ζ1 [zT, zH]T, which is denoted as .
The moment-generating function (1.195) of fV(v) is the 2N-dimensional Laplace transform
whose region of convergence is the whole complex space . Therefore, both characteristic functions involved in the cumulant definitions (1.199) and (1.209) can be expressed as slices of the moment-generating function ΦV(s) given in (1.212). Specifically, in (1.199) we have
(1.213)
from which it follows that is a quadratic homogeneous polynomial in the real variables ωX1, ..., ωXN, ωY1, ..., ωYN. As a consequence, we have the well-known result that jointly real-valued Normal random variables have kth-order cumulants of order k ≥ 3 equal to zero. In addition, in (1.209) we have
(1.214)
Hence, is a quadratic homogeneous polynomial in the real variables ωi. Therefore, jointly complex Normal random variables are characterized by the fact that their cumulants of order N ≥ 3 defined as in (1.209) are equal to zero.
3.16.69.199