A.1 Existence of Solutions

The approach we employ is the method of successive approximations, which was developed by the French mathematician Emile Picard (1856–1941). This method is based on the fact that the function y(x) satisfies the initial value problem in (1) on the open interval I containing x=a if and only if it satisfies the integral equation

y(x)=b+axf(t,y(t)) dt
(4)

for all x in I. In particular, if y(x) satisfies Eq. (4), then clearly y(a)=b, and differentiation of both sides in (4)—using the fundamental theorem of calculus—yields the differential equation y(x)=f(x,y(x)).

To attempt to solve Eq. (4), we begin with the initial function

y0(x)b
(5)

and then define iteratively a sequence y1,y2,y3, of functions that we hope will converge to the solution. Specifically, we let

y1(x)=b+axf(t,y0(t))dtandy2(x)=b+axf(t,y1(t))dt.
(6)

In general, yn+1 is obtained by substitution of yn for y in the right-hand side in Eq. (4):

yn+1(x)=b+axf(t,yn(t))dt.
(7)

Suppose we know that each of these functions {yn(x)}0 is defined on some open interval (the same for each n) containing x=a and that the limit

y(x)=limnyn(x)
(8)

exists at each point of this interval. Then it will follow that

y(x)=limnyn+1(x)=limn[b+axf(t,yn(t))dt]=b+limnaxf(t,yn(t))dt
(9)
=b+axf(t,limnyn(t))dt
(10)

and, hence, that

y(x)=b+axf(t,y(t))dt,

provided that we can validate the interchange of limit operations involved in passing from (9) to (10). It is therefore reasonable to expect that, under favorable conditions, the sequence {yn(x)} defined iteratively in Eqs. (5) and (7) will converge to a solution y(x) of the integral equation in (4), and hence to a solution of the original initial value problem in (1).

Example 1

To apply the method of successive approximations to the initial value problem

dydx=y,y(0)=1,
(11)

we write Eqs. (5) and (7), thereby obtaining

y0(x)1,yn+1(x)=1+0xyn(t)dt.
(12)

The iteration formula in (12) yields

y1(x)=1+0x1 dt=1+x,y2(x)=1+0x(1+t)dt=1+x+12x2,y3(x)=1+0x(1+t+12t2)dt=1+x+12x2+16x3,

and

y4(x)=1+0x(1+t+12t2+16t3)dt=1+x+12x2+16x3+124x4.

It is clear that we are generating the sequence of partial sums of a power series solution; indeed, we immediately recognize the series as that of y(x)=ex. There is no difficulty in demonstrating that the exponential function is indeed the solution of the initial value problem in (11); moreover, a diligent student can verify (by using a proof by induction on n) that yn(x), obtained in the aforementioned manner, is indeed the nth partial sum for the Taylor series with center zero for y(x)=ex.

Example 2

To apply the method of successive approximations to the initial value problem

dydx=4xy,y(0)=3,
(13)

we write Eqs. (5) and (7) as in Example 1. Now we obtain

y0(x)3,yn+1(x)=3+0x4tyn(t)dt.
(14)

The iteration formula in (14) yields

y1(x)=3+0x(4t)(3)dt=3+6x2,y2(x)=3+0x(4t)(3+6t2)dt=3+6x2+6x4,y3(x)=3+0x(4t)(3+6t2+6t4)dt=3+6x2+6x4+4x6,

and

y4(x)=3+0x(4t)(3+6t2+6t4+4t6)dt=3+6x2+6x4+4x6+2x8.

It is again clear that we are generating partial sums of a power series solution. It is not quite so obvious what function has such a power series representation, but the initial value problem in (13) is readily solved by separation of variables:

y(x)=3exp(2x2)=3n=0(2x2)nn!=3+6x2+6x4+4x6+2x8+45x10+.

In some cases, it may be necessary to compute a much larger number of terms, either in order to identify the solution or to use a partial sum of its series with large subscript to approximate the solution accurately for x near its initial value. Fortunately, computer algebra systems such as Maple and Mathematica can perform the symbolic integrations (as opposed to numerical integrations) of the sort in Examples 1 and 2. If necessary, you could generate the first hundred terms in Example 2 in a matter of minutes.

In general, of course, we apply Picard’s method because we cannot find a solution by elementary methods. Suppose that we have produced a large number of terms of what we believe to be the correct power series expansion of the solution. We must have conditions under which the sequence {yn(x)} provided by the method of successive approximations is guaranteed in advance to converge to a solution. It is just as convenient to discuss the initial value problem

dxdt=f(x,t),x(a)=b
(15)

for a system of m first-order equations, where

x=[x1x2x3xm],f=[f1f2f3fm],andb=[b1b2b3bm].

It turns out that with the aid of this vector notation (which we introduced in Section 7.1), most results concerning a single [scalar] equation x=f(x, t) can be generalized readily to analogous results for a system of m first-order equations, as abbreviated in (15). Consequently, the effort of using vector notation is amply justified by the generality it provides.

The method of successive approximations for the system in (15) calls for us to compute the sequence {xn(t)}0 of vector-valued functions of t,

xn(t)=[x1n(t)x2n(t)x3n(t)xmn(t)],

defined iteratively by

x0(a)b,xn+1(t)=b+atf(xn(s),s)ds.
(16)

Recall that vector-valued functions are integrated componentwise.

Example 3

Consider the m-dimensional initial value problem

dxdt=Ax,x(0)=b
(17)

for a homogeneous linear system with m×m constant coefficient matrix A. The equations in (16) take the form

x0(t)=b,xn+1=b+0xAxn(s)ds.
(18)

Thus

x1(t)=b+0tAb ds=b+Abt=(I+At)b,x2(t)=b+0tA(b+Abs)ds=b+Abt+12A2bt2=(I+At+12A2t2)b,

and

x3(t)=b+0tA(b+Abs+12A2bs2)ds=(I+At+12A2t2+16A3t3)b.

We have therefore obtained the first several partial sums of the exponential series solution

x(t)=eAtb=(n=0(At)nn!)b
(19)

of (17), which was derived earlier in Section 8.1.

The key to establishing convergence in the method of successive approximations is an appropriate condition on the rate at which f(x, t) changes when x varies but t is held fixed. If R is a region in (m+1)-dimensional (x, t)-space, then the function f(x, t) is said to be Lipschitz continuous on R if there exists a constant k>0 such that

|f(x1,t)f(x2,t)|k|x1x2|
(20)

if (x1,t) and (x2,t) are points of R. Recall that the norm of an m-dimensional point or vector x is defined to be

|x|=x12+x22+x32++xm2.
(21)

Then |x1x2| is simply the Euclidean distance between the points x1 and x2.

Example 4

Let f(x,t)=x2exp(t2) sin t and let R be the strip 0x2 in the xy-plane. If (x1,t) and (x2,t) are both points of R, then

|f(x1,t)f(x2,t)|=|exp(t2) sin t||x1+x2||x1x2|4|x1x2|,

because |exp(t2) sin t|1 for all t and |x1+x2|4 if x1 and x2 are both in the interval [0, 2]. Thus f satisfies the Lipschitz condition in (20) with k=4 and is therefore Lipschitz continuous in the strip R.

Example 5

Let f(x,t)=tx on the rectangle R consisting of the points (x, t) in the xt-plane for which 0x1 and 0t1. Then, taking x1=x, x2=0, and t=1, we find that

|f(x,1)f(0,1)|=x=1x|x0|.

Because x1/2+ as x0+, we see that the Lipschitz condition in (20) cannot be satisfied by any (finite) constant k>0. Thus the function f, though obviously continuous on R, is not Lipschitz continuous on R.

Suppose, however, that the function f(x, t) has a continuous partial derivative fx(x, t) on the closed rectangle R in the xt-plane, and denote by k the maximum value of |fx(x, t)| on R. Then the mean-value theorem of differential calculus yields

|f(x1, t)f(x2, t)|=|fx(x¯,t)(x1x2)|

for some x¯ in (x1,x2), so it follows that

|f(x1, t)f(x2, t)|k|x1x2|

because |fx(x¯,t)|k. Thus a continuously differentiable function f(x, t) defined on a closed rectangle is Lipschitz continuous there. More generally, the multivariable mean value theorem of advanced calculus can be used similarly to prove that a vector-valued function f(x, t) with continuously differentiable component functions on a closed rectangular region R in (x, t)-space is Lipschitz continuous on R.

Example 6

The function f(x, t)=x2 is Lipschitz continuous on any closed [bounded] region in the xt-plane. But consider this function on the infinite strip R consisting of the points (x, t) for which 0t1 and x is arbitrary. Then

|f(x1,t)f(x2,t)|=|x12x22|=|x1+x2||x1x2|.

Because |x1+x2| can be made arbitrarily large, it follows that f is not Lipschitz continuous on the infinite strip R.

If I is an interval on the t-axis, then the set of all points (x, t) with t in I is an infinite strip or slab in (m+1)-space (as indicated in Fig. A.1). Example 6 shows that Lipschitz continuity of f(x, t) on such an infinite slab is a very strong condition. Nevertheless, the existence of a solution of the initial value problem

dxdt=f(x,t),x(a)=b
(15)

under the hypothesis of Lipschitz continuity of f in such a slab is of considerable importance.

FIGURE A.1.

An infinite slab in (m+1)-space.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.144.113.30