5.7 Orthogonal Polynomials

We have already seen how polynomials can be used for data fitting and for approximating continuous functions. Since both of these problems are least squares problems, they can be simplified by selecting an orthogonal basis for the class of approximating polynomials. This leads us to the concept of orthogonal polynomials.

In this section, we study families of orthogonal polynomials associated with various inner products on C[a, b]. We will see that the polynomials in each of these classes satisfy a three-term recursion relation. This recursion relation is particularly useful in computer applications. Certain families of orthogonal polynomials have important applications in many areas of mathematics. We will refer to these polynomials as classical polynomials and examine them in more detail. In particular, the classical polynomials are solutions of certain classes of second-order linear differential equations that arise in the solution of many partial differential equations from mathematical physics.

Orthogonal Sequences

Since the proof of Theorem 5.6.1 was by induction, the Gram–Schmidt process is valid for a denumerable set. Thus, if x1,x2, is a sequence of vectors in an inner product space V and x1,x2,,xn are linearly independent for each n, then the Gram–Schmidt process may be used to form a sequence u1,u2,,, where {u1,u2,,} is an orthonormal set and

Span(x1,x2,,xn)=Span(u1,u2,,un)

for each n. In particular, from the sequence x,x,x2,,, it is possible to construct an orthonormal sequence P0(x),p1(x),.

Let P be the vector space of all polynomials and define the inner product , on P by

p,q=abp(x)q(x)w(x)dx
(1)

where w(x) is a positive continuous function. The interval can be taken as either open or closed and may be finite or infinite. If, however,

ab p(x)w(x)dx

is improper, we require that it converge for every pP.

Theorem 5.7.1

If p0,p1, is a sequence of orthogonal polynomials, then

  1. p0,,pn1 form a basis for Pn.

  2. PnPn (i.e., Pn is orthogonal to every polynomial of degree less than n).

Proof

It follows from Theorem 5.5.1 that p0,p1,,pn1 are linearly independent in Pn. Since dim dim Pn=n, these n vectors must form a basis for Pn. Let p(x) be any polynomial of degree less than n. Then

p(x)=i=0n1cipi(x)

and hence

pn,p=pn,i=0n1 cipi=i=0n1 cipn,pi=0

Therefore, pnPn.

If {p0,p1,,pn1} is an orthogonal set in Pn and

ui=(1pi) pifori=0,,n1

then {u0,,un1} is an orthonormal basis for Pn. Hence, if pPn, then

p=i=0n1p,uiui=i=0n1p,(1pi)pi(1pi)pi=i=0n1p,pipi,pipi

Similarly, if fC[a,b], then the best least squares approximation to f by the elements of Pn is given by

p=i=0n1f,pipi,pipi

where p0,p1,,pn1 are orthogonal polynomials.

Another nice feature of sequences of orthogonal polynomials is that they satisfy a three-term recursion relation.

Theorem 5.7.2

Let p0,p1, be a sequence of orthogonal polynomials. Let ai denote the lead coefficient of pi for each i, and define p1(x) to be the zero polynomial. Then

αn+1pn+1(x)=(xβn+1)pn(x)αnγnpn1(x)(n0)

where α0=γ0=1 and

αn=αn1αn,βn=pn1,xpn1pn1,pn1,γn=pn,pnpn1,pn1(n1)

Proof

Since p0,p1,,pn+1 form a basis for Pn+2, we can write

xpn(x)=k=0n+1cnkpk(x)
(2)

where

cnk=xpn,pkpk,pk
(3)

For any inner product defined by (1),

xf,g=f,xg

In particular,

xpn,pk=pn,xpk

It follows from Theorem 5.7.1 that if k<n1, then

cnk=xpn,pkpk,pk=pn,xpkpk,pk=0

Therefore, (2) simplifies to

xpn(x)=cn,n1pn1(x)+cn,npn(x)+cn,n+1pn+1(x)

This equation can be rewritten in the form

cn,n+1pn+1(x)=(xcn,n)pn(x)cn,n1pn1(x)
(4)

Comparing the lead coefficients of the polynomials on each side of (4), we see that

cn,n+1an+1=an

or

cn,n+1=anan+1=an+1
(5)

It follows from (4) that

cn,n+1pn,pn+1=pn,(xcn,n)pncn,n1pn,pn10=pn,xpncnnpn,pn

Thus,

cnn=pn,xpnpn,pn=βn+1

It follows from (3) that

pn+1,pn1cn,n1=xpn,pn1=pn,xpn1=pn,pncn1,n

and hence, by (5), we have

cn,n1=pn,pnpn1,pn1αn=γnαn

In generating a sequence of orthogonal polynomials by the recursion relation in Theorem 5.7.2, we are free to choose any nonzero lead coefficient an+1 that we want at each step. This is reasonable, since any nonzero multiple of a particular pn+1 will also be orthogonal to p0,,pn. If we were to choose our ai’s to be 1, for example, then the recursion relation would simplify to

pn+1(x)=(xβn+1)pn(x)γnpn1(x)

Classical Orthogonal Polynomials

Let us now look at some examples. Because of their importance, we will consider the classical polynomials beginning with the simplest, the Legendre polynomials.

Legendre Polynomials

The Legendre polynomials are orthogonal with respect to the inner product

p,q=11p(x)q(x)dx

Let Pn(x) denote the Legendre polynomial of degree n. If we choose the lead coefficients so that Pn(1)=1 for each n, then the recursion formula for the Legendre polynomials is

(n+1)Pn+1(x)=(2n+1)xPn(x)nPn1(x)

By the use of this formula, the sequence of Legendre polynomials is easily generated. The first five polynomials of the sequence are

P0(x)=1P1(x)=xP2(x)=12(3x21)P3(x)=12(5x33x)P4(x)=18(35x430x2+3)

Chebyshev Polynomials

The Chebyshev polynomials are orthogonal with respect to the inner product

p,q=11p(x)q(x)(1x2)1/2dx

It is customary to normalize the lead coefficients so that a0=1 and ak=2k1 for k=1,2,. The Chebyshev polynomials are denoted by Tn(x) and have the interesting property that

Tn(cosθ)=cos nθ

This property, together with the trigonometric identity

cos(n+1)θ=2 cosθ cos nθcos(n1)θ

can be used to derive the recursion relations

T1(x)=xT0(x)Tn+1(x)=2xTn(x)Tn1(x)  for n1

Jacobi Polynomials

The Legendre and Chebyshev polynomials are both special cases of the Jacobi polynomials. The Jacobi polynomials Pn(λ,μ) are orthogonal with respect to the inner

product

p,q=11p(x)q(x)(1x)λ(1+x)μ dx

where λ,μ>1.

Hermite Polynomials

The Hermite polynomials are defined on the interval (,). They are orthogonal with respect to the inner product

p,q=p(x)q(x)ex2dx

The recursion relation for Hermite polynomials is given by

Hn+1(x)=2xHn(x)2nHn1(x)

Laguerre Polynomials

The Laguerre polynomials are defined on the interval (0, ∞) and are orthogonal with respect to the inner product

p,q=0p(x)q(x)xλexdx

where λ>1. The recursion relation for the Laguerre polynomials is given by

(n+1)Ln+1(λ)(x)=(2n+λ+1x)Ln(λ)(x)(n+λ)Ln1(λ)(x)

The Chebyshev, Hermite, and Laguerre polynomials are compared in Table 5.7.1.

Table 5.7.1 Chebyshev, Hermite, and Laguerre Polynomials

Chebyshev Hermite Laguerre (λ=0)
Tn+1=2xTnTn1,n1T0=1T1=xT2=2x21T3=4x33x Hn+1=2xHn2nHn1H0=1H1=2xH2=4x22H3=8x312x (n+1)Ln+1(0)=(2n+1x)Ln(0)nLn1(0)L0(0)=1L1(0)=1xL2(0)=12x2x+2L3(0)=16x3+9x218x+6

Theorem 5.7.3

If p0,p1,p2,. . . is a sequence of orthogonal polynomials with respect to the inner product (1), then the zeros of pn(x) are all real and distinct and lie in the interval (a,b).

Proof

Let x1,. . . ,xm be the zeros of pn(x) that lie in (a,b) and for which pn(x) changes sign. Thus, pn(x) must have a factor of (xx1)ki, where ki is odd, for i=1,. . . , m. We may write

pn(x)=(xx1)k1(xx2)k2(xxm)kmq(x)

where q(x) does not change sign on (a,b) and q(xi)0 for i=1,. . . ,m. Clearly, mn. We will show that m=n. Let

r(x)=(xx1)(xx2)(xxm)

The product

pn(x)r(x)=(xx1)k1+1+(xx2)k2+1(xxm)km+1q(x)

will involve only even powers of (xxi) for each i and hence will not change sign on (a,b). Therefore,

pn,r=abpn(x)r(x)w(x) dx0

Since pn is orthogonal to all polynomials of degree less than n, it follows that deg(r(x))=mn.

Numerical integration formulas of the form (7), where the xi’s are roots of orthogonal polynomials, are called Gaussian quadrature formulas. The proof of exactness for polynomials of degree less than 2n can be found in most undergraduate numerical analysis textbooks.

Actually, it is not necessary to perform n integrations to calculate the quadrature coefficients A1,. . . ,An. They can be determined by solving an n×n linear system. Exercise 16 illustrates how this is done when the roots of the Legendre polynomial Pn are used in a quadrature rule for approximating 11f(x)dx

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.144.48.135