Many geometric notions such as angle, length, and perpendicularity in R2
Let V be a vector space over F. An inner product on V is a function that assigns, to every ordered pair of vectors x and y in V, a scalar in F, denoted 〈x, y〉
(a) 〈x+z, y〉=〈x, y〉+〈z, y〉.
(b) 〈cx, y〉=c〈x, y〉.
(c) ¯〈x, y〉=〈y, x〉
(d) If x≠0
Note that (c) reduces to 〈x, y〉=〈y, x〉
It is easily shown that if a1, a2, …, an∈F
For x=(a1, a2, …, an)
The verification that 〈⋅, ⋅〉
Thus, for x=(1+i, 4)
The inner product in Example 1 is called the standard inner product on Fn
If 〈x, y〉
Let V=C([0, 1])
Let A∈Mm×n(F)
Let
Then
Notice that if x and y are viewed as column vectors in Fn
The conjugate transpose of a matrix plays a very important role in the remainder of this chapter. In the case that A has real entries, A* is simply the transpose of A.
Let V=Mn×n(F)
Also
Now if A≠O
The inner product on Mn×n(F)
A vector space V over F endowed with a specific inner product is called an inner product space. If F=C
It is clear that if V has an inner product 〈x, y〉
Thus Examples 1, 3, and 5 also provide examples of inner product spaces. For the remainder of this chapter, Fn
are inner products on the vector space P(R). Even though the underlying vector space is the same, however, these two inner products yield two different inner product spaces. For example, the polynomials f(x)=x
A very important inner product space that resembles C([0, 1]) is the space H of continuous complex-valued functions defined on the interval [0, 2π]
The reason for the constant 1/2π
At this point, we mention a few facts about integration of complex-valued functions. First, the imaginary number i can be treated as a constant under the integration sign. Second, every complex-valued function f may be written as f=f1+if2
From these properties, as well as the assumption of continuity, it follows that H is an inner product space (see Exercise 16(a)).
Some properties that follow easily from the definition of an inner product are contained in the next theorem.
Let V be an inner product space. Then for x, y, z∈V
(a) 〈x, y+z〉=〈x, y〉+〈x, z〉.
(b) 〈x, cy〉=ˉc〈x, y〉.
(c) 〈x, 0〉=〈0, x〉=0.
(d) 〈x, x〉=0
(e) if 〈x, y〉=〈x, z〉
Proof.
(a) We have
The proofs of (b), (c), (d), and (e) are left as exercises.
The reader should observe that (a) and (b) of Theorem 6.1 show that the inner product is conjugate linear in the second component.
In order to generalize the notion of length in R3
Let V be an inner product space. For x∈V
Let V=Fn
is the Euclidean definition of length. Note that if n=1
As we might expect, the well-known properties of Euclidean length in R3
Let V be an inner product space over F. Then for all x, y∈V
(a) ||cx||=|c|⋅||x||.
(b) ||x||=0
(c) (Cauchy-Schwarz Inequality) |〈x, y〉|≤||x||⋅||y||
(d) (Triangle Inequality) ||x+y||≤||x||+||y||
We leave the proofs of (a) and (b) as exercises.
(c) If y=0
In particular, if we set
then each of ˉc〈x, y〉, c〈y, x〉
from which (c) follows.
(d) We have
where ℜ〈x, y〉 denotes the real part of the complex number 〈x, y〉. Note that we used (c) to prove (d).
The case when equality results in (c) and (d) is considered in Exercise 15.
For Fn, we may apply (c) and (d) of Theorem 6.2 to the standard inner product to obtain the following well-known inequalities:
and
The reader may recall from earlier courses that, for x and y in R3 or R2 , we have that 〈x, y〉=||x||⋅||y||cos θ, where θ (0≤θ≤π) denotes the angle between x and y. This equation implies (c) immediately since |cos θ|≤1. Notice also that nonzero vectors x and y are perpendicular if and only if cos θ=0, that is, if and only if 〈x, y〉=0.
We are now at the point where we can generalize the notion of perpendicularity to arbitrary inner product spaces.
Let V be an inner product space. Vectors x and y in V are orthogonal (or perpendicular) if 〈x, y〉=0. A subset S of V is orthogonal if any two distinct vectors in S are orthogonal. A vector x in V is a unit vector if ||x||=1. Finally, a subset S of V is orthonormal if S is orthogonal and consists entirely of unit vectors.
Note that if S={v1, v2, …}, then S is orthonormal if and only if 〈vi, vj〉=δij, where δij denotes the Kronecker delta. Also, observe that multiplying vectors by nonzero scalars does not affect their orthogonality and that if x is any nonzero vector, then (1/||x||)x is a unit vector. The process of multiplying a nonzero vector by the reciprocal of its length is called normalizing.
In F3, {(1, 1, 0), (1, −1, 1), (−1, 1, 2)} is an orthogonal set of nonzero vectors, but it is not orthonormal; however, if we normalize the vectors in the set, we obtain the orthonormal set
Our next example is of an infinite orthonormal set that is important in analysis. This set is used in later examples in this chapter.
Recall the inner product space H (defined on page 330). We introduce an important orthonormal subset S of H. For what follows, i is the imaginary number such that i2=−1. For any integer n, let fn(t)=eint, where 0≤t≤2π. (Recall that eint=cos nt+i sin nt.) Now define S={fn:n is an integer}.
Clearly S is a subset of H. Using the property that ¯eit=e−it for every real number t, we have, for m≠n,
Also,
In other words, 〈fm, fn〉=δmn.
Label the following statements as true or false.
(a) An inner product is a scalar-valued function on the set of ordered pairs of vectors.
(b) An inner product space must be over the field of real or complex numbers.
(c) An inner product is linear in both components.
(d) There is exactly one inner product on the vector space Rn.
(e) The triangle inequality only holds in finite-dimensional inner product spaces.
(f) Only square matrices have a conjugate-transpose.
(g) If x, y, and z are vectors in an inner product space such that 〈x, y〉=〈x, z〉, then y=z.
(h) If 〈x, y〉=0 for all x in an inner product space, then y=0.
Let x=(2, 1+i, i) and y=(2−i, 2, 1+2i) be vectors in C3. Compute 〈x, y〉, ||x||, ||y||, and ||x+y||. Then verify both the Cauchy-Schwarz inequality and the triangle inequality.
In C([0, 1]), let f(t)=t and g(t)=et. Compute 〈f, g〉 (as defined in Example 3), ||f||, ||g||, and ||f+g||. Then verify both the Cauchy-Schwarz inequality and the triangle inequality.
(a) Complete the proof in Example 5 that 〈⋅, ⋅〉 is an inner product (the Frobenius inner product) on Mn×n(F).
(b) Use the Frobenius inner product to compute ||A||, ||B||, and 〈A, B〉 for
In C2, show that 〈x, y〉=xAy* is an inner product, where
Compute 〈x, y〉 for x=(1−i, 2+3i) and y=(2+i, 3−2i).
Complete the proof of Theorem 6.1.
Complete the proof of Theorem 6.2.
Provide reasons why each of the following is not an inner product on the given vector spaces.
(a) 〈(a, b), (c, d)〉=ac−bd on R2
(b) 〈A, B〉=tr(A+B) on M2×2(R)
(c) 〈f(x), g(x)〉=∫10f′(t)g(t) dt on P(R), where ‘ denotes differentiation.
Let β be a basis for a finite-dimensional inner product space.
(a) Prove that if 〈x, z〉=0 for all z∈β, then x=0.
(b) Prove that if 〈x, z〉=〈y, z〉 for all z∈β, then x=y.
† Let V be an inner product space, and suppose that x and y are orthogonal vectors in V. Prove that ||x+y||2=||x||2+||y||2. Deduce the Pythagorean theorem in R2. Visit goo.gl/
Prove the parallelogram law on an inner product space V; that is, show that
What does this equation state about parallelograms in R2?
† Let {v1, v2, …, vk} be an orthogonal set in V, and let a1, a2, …, ak be scalars. Prove that
Suppose that 〈⋅, ⋅〉1 and 〈⋅, ⋅〉2 are two inner products on a vector space V. Prove that 〈⋅, ⋅〉=〈⋅, ⋅〉1+〈⋅, ⋅〉2 is another inner product on V.
Let A and B be n×n matrices, and let c be a scalar. Prove that (A+cB)*=A*+ˉcB*.
(a) Prove that if V is an inner product space, then |〈x, y〉|=||x||⋅||y|| if and only if one of the vectors x or y is a multiple of the other. Hint: If the identity holds and y≠0, let
and let z=x−ay. Prove that y and z are orthogonal and
Then apply Exercise 10 to ||x||2=||ay+z||2 to obtain ||z||=0.
(b) Derive a similar result for the equality ||x+y||=||x||+||y||, and generalize it to the case of n vectors.
(a) Show that the vector space H with 〈⋅, ⋅〉 defined on page 330 is an inner product space.
(b) Let V=C([0, 1]), and define
Is this an inner product on V?
Let T be a linear operator on an inner product space V, and suppose that ‖T(x)‖=‖x‖ for all x. Prove that T is one-to-one.
Let V be a vector space over F, where F=R or F=C, and let W be an inner product space over F with inner product 〈⋅, ⋅〉. If T:V→W is linear, prove that 〈x, y〉′=〈T(x), T(y)〉 defines an inner product on V if and only if T is one-to-one.
Let V be an inner product space. Prove that
(a) ||x±y||2=||x||2±2ℜ〈x, y〉+||y||2 for all x, y∈V, where ℜ〈x, y〉 denotes the real part of the complex number 〈x, y〉.
(b) |||x||−||y|||≤||x−y|| for all x, y∈V.
Let V be an inner product space over F. Prove the polar identities: For all x, y∈V,
(a) 〈x, y〉=14||x+y||2−14||x−y||2 if F=R;
(b) 〈x, y〉=14∑4k=1ik||x+iky||2 if F=C, where i2=−1.
Let A be an n×n matrix. Define
(a) Prove that A*1=A1, A*2=A2, and A=A1+iA2. Would it be reasonable to define A1 and A2 to be the real and imaginary parts, respectively, of the matrix A?
(b) Let A be an n×n matrix. Prove that the representation in (a) is unique. That is, prove that if A=B1+iB2, where B*1=B1 and B*2=B2, then B1=A1 and B2=A2.
Let V be a real or complex vector space (possibly infinite-dimensional), and let β be a basis for V. For x, y∈V there exist v1, v2, …, vn∈β such that
Define
(a) Prove that 〈⋅, ⋅〉 is an inner product on V and that β is an orthonormal basis for V. Thus every real or complex vector space may be regarded as an inner product space.
(b) Prove that if V=Rn or V=Cn and β is the standard ordered basis, then the inner product defined above is the standard inner product.
Let V=Fn, and let A∈Mn×n(F).
(a) Prove that 〈x, Ay〉=〈A*x, y〉 for all x, y∈V.
(b) Suppose that for some B∈Mn×n(F), we have 〈x, Ay〉=〈Bx, y〉 for all x, y∈V. Prove that B=A*.
(c) Let α be the standard ordered basis for V. For any orthonormal basis β for V, let Q be the n×n matrix whose columns are the vectors in β . Prove that Q* = Q−1.
(d) Define linear operators T and U on V by T(x)=Ax and U(x)=A*x. Show that [U]β=[T]*β for any orthonormal basis β for V.
Let V be a complex inner product space with an inner product 〈⋅, ⋅〉. Let [⋅, ⋅] be the real-valued function such that [x, y] is the real part of the complex number 〈x, y〉 for all x, y∈V. Prove that [⋅, ⋅] is an inner product for V, where V is regarded as a vector space over R. Prove, furthermore, that [x, ix]=0 for all x∈V.
Let V be a vector space over C, and suppose that [⋅, ⋅] is a real inner product on V, where V is regarded as a vector space over R, such that [x, ix]=0 for all x∈V. Let 〈⋅, ⋅〉 be the complex-valued function defined by
Prove that 〈⋅, ⋅〉 is a complex inner product on V.
The following definition is used in Exercises 26–30.
Let V be a vector space over F, where F is either R or C. Regardless of whether V is or is not an inner product space, we may still define a norm ||⋅||v as a real-valued function on V satisfying the following three conditions for all x, y∈V and a∈F:
(1) ||x||v≥0, and ||x||v=0 if and only if x=0.
(2) ||ax||v=|a|⋅||x||v.
(3) ||x+y||v≤||x||v+||y||v.
Prove that the following are norms on the given vector spaces V.
(a) V=R2;||(a, b)||v=|a|+|b| for all (a, b)∈V
(b) V=C([0, 1]);||f||v=maxt∈[0, 1]|f(t)| for all f∈V
(c) V=C([0, 1]);||f||v=∫10|f(t)| dt for all f∈V
(d) V=Mm×n(F);||A||v=maxi, j|Aij| for all A∈V
Use Exercise 11 to show that there is no inner product 〈⋅, ⋅〉 on R2 such that ||x||2V=〈x, x〉 for all x∈R2 if the norm is defined as in Exercise 26(a).
Let ||⋅||v be a norm on a vector space V, and define, for each ordered pair of vectors, the scalar d(x, y)=||x−y||v, called the distance between x and y. Prove the following results for all x, y, z∈V.
(a) d(x, y)≥0.
(b) d(x, y)=d(y, x).
(c) d(x, y)≤d(x, z)+d(z, y).
(d) d(x, x)=0 if and only if x=0.
(e) d(x, y)≠0 if x≠y.
Let ||⋅||v be a norm on a real vector space V satisfying the parallelogram law given in Exercise 11. Define
Prove that 〈⋅, ⋅〉 defines an inner product on V such that ||x||2v=〈x, x〉 for all x∈V. Hints:
(a) Prove 〈x, 2y〉=2〈x, y〉 for all x, y∈V.
(b) Prove 〈x+u, y〉=〈x, y〉+〈u, y〉 for all x, u, y∈V.
(c) Prove 〈nx, y〉=n〈x, y〉 for every positive integer n and every x, y∈V.
(d) Prove m〈1mx, y〉=〈x, y〉 for every positive integer m and every x, y∈V.
(e) Prove 〈rx, y〉=r〈x, y〉 for every rational number r and every x, y∈V.
(f) Prove |〈x, y〉|≤||x||v||y||v for every x, y∈V. Hint: Condition (3) in the definition of norm can be helpful.
(g) Prove that for every c∈R, every rational number r, and every x, y∈V,
(h) Use the fact that for any c∈R, |c−r| can be made arbitrarily small, where r varies over the set of rational numbers, to establish item (b) of the definition of inner product.
Let ||⋅||v be a norm (as defined on page 337) on a complex vector space V satisfying the parallelogram law given in Exercise 11. Prove that there is an inner product 〈⋅, ⋅〉 on V such that ||x||2v=〈x, x〉 for all x∈V. Hint: Apply Exercise 29 to V regarded as a vector space over R. Then apply Exercise 25.
18.118.37.154