Linear-Algebra-Done-Right Β· Unit 19 Β· Video 3 Β· Interactive Practice

Positive Operators: Six Equivalent Characterizations

IKey Formulas

FormulaNameWhat it says
T=Tβˆ—T = T^* and ⟨Tv,v⟩β‰₯0\langle Tv, v\rangle \ge 0 for all v∈Vv \in VPositive operator (1)Both requirements are needed over R\mathbf{R}; equality is allowed for nonzero vv
T=Tβˆ—T = T^* and every eigenvalue Ξ»β‰₯0\lambda \ge 0Eigenvalue test (2)Equivalently (3): M(T)\mathcal{M}(T) is diagonal with entries β‰₯0\ge 0 in some orthonormal basis
T=R2T = R^2 with RR positive, or with RR self-adjointSquare roots (4), (5)RR is a square root of TT when R2=TR^2 = T
⟨Rβˆ—Rv,v⟩=⟨Rv,Rv⟩=βˆ₯Rvβˆ₯2β‰₯0\langle R^*Rv, v\rangle = \langle Rv, Rv\rangle = \|Rv\|^2 \ge 0Condition (6): T=Rβˆ—RT = R^*RAny R∈L(V)R \in \mathcal{L}(V) works; RR need not be a square root of TT

Key Insight: Positive operators play the part of the nonnegative numbers: z=s2z = s^2 with sβ‰₯0s \ge 0, z=s2z = s^2 with s∈Rs \in \mathbf{R}, and z=wΛ‰wz = \bar{w}w become a positive square root, a self-adjoint square root, and T=Rβˆ—RT = R^*R.

IIThe Inequality in Every Direction

Since ⟨T(tv),tv⟩=t2⟨Tv,v⟩\langle T(tv), tv\rangle = t^2\langle Tv, v\rangle for real tt, the sign of ⟨Tv,v⟩\langle Tv, v\rangle depends only on the direction of vv.

πŸ’‘ Over R\mathbf{R}, ⟨Tv,v⟩\langle Tv, v\rangle only sees 12(T+Tβˆ—)\tfrac{1}{2}(T + T^*), so an operator that is not self-adjoint can satisfy the inequality and still fail to be positive.

IIIEigenvalues Bound ⟨Tv,v⟩\langle Tv, v\rangle

For a unit vector v=cos⁑θ e1+sin⁑θ e2v = \cos\theta\, e_1 + \sin\theta\, e_2 in an orthonormal eigenbasis, ⟨Tv,v⟩=Ξ»1cos⁑2ΞΈ+Ξ»2sin⁑2ΞΈ\langle Tv, v\rangle = \lambda_1\cos^2\theta + \lambda_2\sin^2\theta.

IVCondition (6): T=Rβˆ—RT = R^*R

The entries of Rβˆ—RR^*R are inner products of the columns of RR, and ⟨Rβˆ—Rv,v⟩=βˆ₯Rvβˆ₯2\langle R^*Rv, v\rangle = \|Rv\|^2.

VQuiz Questions

Problem 1 Β· The Eigenvalue Test

Given: T∈L(R2)T \in \mathcal{L}(\mathbf{R}^2) with M(T)=(4221)\mathcal{M}(T) = \begin{pmatrix} 4 & 2 \\ 2 & 1 \end{pmatrix} in the standard basis. Which statement is correct?

βœ… Correct! T(2,1)=(10,5)=5(2,1)T(2, 1) = (10, 5) = 5(2, 1) and T(1,βˆ’2)=(0,0)T(1, -2) = (0, 0), so the eigenvalues are 55 and 00, both β‰₯0\ge 0; together with T=Tβˆ—T = T^* this is condition (2).
❌ Positive allows equality. The definition asks for ⟨Tv,v⟩β‰₯0\langle Tv, v\rangle \ge 0, not >0\gt 0. A nonzero vv with ⟨Tv,v⟩=0\langle Tv, v\rangle = 0 is allowed, and condition (2) permits the eigenvalue 00.
❌ Those are not the eigenvalues. T(1,0)=(4,2)T(1, 0) = (4, 2) is not a multiple of (1,0)(1, 0), so 44 is not read off the diagonal here. The eigenvalues are 55 and 00, with eigenvectors (2,1)(2, 1) and (1,βˆ’2)(1, -2).
❌ The theorem makes eigenvalues enough. For a self-adjoint TT, condition (2), every eigenvalue β‰₯0\ge 0, is equivalent to positivity, so the two eigenvalues 55 and 00 settle the question.
Show solution

Self-adjoint: the matrix equals its transpose and the standard basis is orthonormal, so T=Tβˆ—T = T^*.

Eigenvalues:

T(2,1)=(8+2,β€…β€Š4+1)=5(2,1),T(1,βˆ’2)=(4βˆ’4,β€…β€Š2βˆ’2)=(0,0).T(2, 1) = (8 + 2,\; 4 + 1) = 5(2, 1), \qquad T(1, -2) = (4 - 4,\; 2 - 2) = (0, 0).

The eigenvalues are 55 and 00, both β‰₯0\ge 0, so condition (2) holds and TT is positive.

Direct check: ⟨T(x,y),(x,y)⟩=(4x+2y)x+(2x+y)y=4x2+4xy+y2=(2x+y)2β‰₯0\langle T(x, y), (x, y)\rangle = (4x + 2y)x + (2x + y)y = 4x^2 + 4xy + y^2 = (2x + y)^2 \ge 0. It equals 00 on the line spanned by (1,βˆ’2)(1, -2), which the definition allows.

Problem 2 Β· Positive Entries Are Not Enough

Given: T∈L(R2)T \in \mathcal{L}(\mathbf{R}^2) with M(T)=(1301)\mathcal{M}(T) = \begin{pmatrix} 1 & 3 \\ 0 & 1 \end{pmatrix} in the standard basis. Which statement is correct?

βœ… Correct! M(T)βˆ—=(1031)β‰ M(T)\mathcal{M}(T)^* = \begin{pmatrix} 1 & 0 \\ 3 & 1 \end{pmatrix} \ne \mathcal{M}(T), and T(1,βˆ’1)=(βˆ’2,βˆ’1)T(1, -1) = (-2, -1) gives ⟨(βˆ’2,βˆ’1),(1,βˆ’1)⟩=βˆ’2+1=βˆ’1<0\langle (-2, -1), (1, -1)\rangle = -2 + 1 = -1 \lt 0. Either failure alone rules out positivity.
❌ Condition (2) has two parts. The only eigenvalue is indeed 11, but (2) also requires T=Tβˆ—T = T^*, and M(T)βˆ—=(1031)β‰ M(T)\mathcal{M}(T)^* = \begin{pmatrix} 1 & 0 \\ 3 & 1 \end{pmatrix} \ne \mathcal{M}(T).
❌ The signs of the entries do not decide positivity. T(1,βˆ’1)=(βˆ’2,βˆ’1)T(1, -1) = (-2, -1), and ⟨(βˆ’2,βˆ’1),(1,βˆ’1)⟩=βˆ’1<0\langle (-2, -1), (1, -1)\rangle = -1 \lt 0.
❌ The inequality fails too. ⟨T(x,y),(x,y)⟩=x2+3xy+y2\langle T(x, y), (x, y)\rangle = x^2 + 3xy + y^2, which is 1βˆ’3+1=βˆ’11 - 3 + 1 = -1 at (x,y)=(1,βˆ’1)(x, y) = (1, -1).
Show solution

Self-adjointness: the standard basis is orthonormal, so M(Tβˆ—)\mathcal{M}(T^*) is the transpose (1031)β‰ M(T)\begin{pmatrix} 1 & 0 \\ 3 & 1 \end{pmatrix} \ne \mathcal{M}(T). Hence Tβ‰ Tβˆ—T \ne T^* and TT is not positive.

The inequality: T(x,y)=(x+3y,β€…β€Šy)T(x, y) = (x + 3y,\; y), so

⟨T(x,y),(x,y)⟩=(x+3y)x+y2=x2+3xy+y2.\langle T(x, y), (x, y)\rangle = (x + 3y)x + y^2 = x^2 + 3xy + y^2.

At (1,βˆ’1)(1, -1) this is 1βˆ’3+1=βˆ’1<01 - 3 + 1 = -1 \lt 0, so TT fails the second requirement as well.

The eigenvalue trap: T(x,y)=Ξ»(x,y)T(x, y) = \lambda(x, y) forces y=Ξ»yy = \lambda y and x+3y=Ξ»xx + 3y = \lambda x; if yβ‰ 0y \ne 0 then Ξ»=1\lambda = 1 and 3y=03y = 0, a contradiction, so y=0y = 0 and Ξ»=1\lambda = 1. A nonnegative eigenvalue says nothing until T=Tβˆ—T = T^* is known.

Problem 3 Β· Building Rβˆ—RR^*R

Given: R∈L(R2)R \in \mathcal{L}(\mathbf{R}^2) with M(R)=(1101)\mathcal{M}(R) = \begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix} in the standard basis, and T=Rβˆ—RT = R^*R.

What is M(T)\mathcal{M}(T)?

What is ⟨T(3,βˆ’1),(3,βˆ’1)⟩\langle T(3, -1), (3, -1)\rangle?

βœ… Correct! ⟨Tv,v⟩=βˆ₯Rvβˆ₯2=βˆ₯(2,βˆ’1)βˆ₯2=5\langle Tv, v\rangle = \|Rv\|^2 = \|(2, -1)\|^2 = 5. In general βˆ₯R(x,y)βˆ₯2=(x+y)2+y2β‰₯0\|R(x, y)\|^2 = (x + y)^2 + y^2 \ge 0, so TT is positive by condition (6), even though RR itself is not self-adjoint.
❌ That is RRβˆ—RR^*, the product in the wrong order. M(R)M(R)t=(2111)\mathcal{M}(R)\mathcal{M}(R)^{\mathrm{t}} = \begin{pmatrix} 2 & 1 \\ 1 & 1 \end{pmatrix}; T=Rβˆ—RT = R^*R puts the adjoint on the left.
❌ That is R2R^2. R2=(1201)R^2 = \begin{pmatrix} 1 & 2 \\ 0 & 1 \end{pmatrix} is not even self-adjoint; condition (6) uses Rβˆ—RR^*R, which never equals R2R^2 here.
❌ That is Rβˆ—R^* alone. M(Rβˆ—)\mathcal{M}(R^*) is the transpose (1011)\begin{pmatrix} 1 & 0 \\ 1 & 1 \end{pmatrix}; it still has to be multiplied by M(R)\mathcal{M}(R).
❌ That uses RRβˆ—RR^*. (2111)(3,βˆ’1)=(5,2)\begin{pmatrix} 2 & 1 \\ 1 & 1 \end{pmatrix}(3, -1) = (5, 2) and ⟨(5,2),(3,βˆ’1)⟩=13\langle (5, 2), (3, -1)\rangle = 13, but T=Rβˆ—RT = R^*R, so T(3,βˆ’1)=(2,1)T(3, -1) = (2, 1).
❌ That uses R2R^2. R2(3,βˆ’1)=(1,βˆ’1)R^2(3, -1) = (1, -1) gives ⟨(1,βˆ’1),(3,βˆ’1)⟩=4\langle (1, -1), (3, -1)\rangle = 4; the operator here is Rβˆ—RR^*R, with T(3,βˆ’1)=(2,1)T(3, -1) = (2, 1).
❌ That is βˆ₯vβˆ₯2=9+1\|v\|^2 = 9 + 1. It is ⟨Iv,v⟩\langle Iv, v\rangle; the question asks for ⟨Tv,v⟩=βˆ₯Rvβˆ₯2\langle Tv, v\rangle = \|Rv\|^2 with Rv=(2,βˆ’1)Rv = (2, -1).
Show solution

Step 1: the matrix. In the orthonormal standard basis M(Rβˆ—)\mathcal{M}(R^*) is the transpose of M(R)\mathcal{M}(R):

M(T)=(1011)(1101)=(1112).\mathcal{M}(T) = \begin{pmatrix} 1 & 0 \\ 1 & 1 \end{pmatrix}\begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix} = \begin{pmatrix} 1 & 1 \\ 1 & 2 \end{pmatrix}.

Each entry is an inner product of columns of M(R)\mathcal{M}(R): the columns are (1,0)(1, 0) and (1,1)(1, 1), with βˆ₯(1,0)βˆ₯2=1\|(1, 0)\|^2 = 1, ⟨(1,1),(1,0)⟩=1\langle (1, 1), (1, 0)\rangle = 1, βˆ₯(1,1)βˆ₯2=2\|(1, 1)\|^2 = 2.

Step 2: the inner product. T(3,βˆ’1)=(3βˆ’1,β€…β€Š3βˆ’2)=(2,1)T(3, -1) = (3 - 1,\; 3 - 2) = (2, 1), so

⟨T(3,βˆ’1),(3,βˆ’1)⟩=6βˆ’1=5.\langle T(3, -1), (3, -1)\rangle = 6 - 1 = 5.

Check with condition (6): R(3,βˆ’1)=(3βˆ’1,β€…β€Šβˆ’1)=(2,βˆ’1)R(3, -1) = (3 - 1,\; -1) = (2, -1) and βˆ₯(2,βˆ’1)βˆ₯2=4+1=5\|(2, -1)\|^2 = 4 + 1 = 5.

Since ⟨Tv,v⟩=βˆ₯Rvβˆ₯2β‰₯0\langle Tv, v\rangle = \|Rv\|^2 \ge 0 for every vv and Tβˆ—=(Rβˆ—R)βˆ—=Rβˆ—R=TT^* = (R^*R)^* = R^*R = T, the operator TT is positive. Note R2=(1201)β‰ TR^2 = \begin{pmatrix} 1 & 2 \\ 0 & 1 \end{pmatrix} \ne T, so RR is not a square root of TT.

Problem 4 Β· Which Condition Falls Short?

Given: TT is an operator on a finite-dimensional inner product space VV. Which statement does not guarantee that TT is positive?

βœ… Correct! On R2\mathbf{R}^2 take R(x,y)=(βˆ’y,x)R(x, y) = (-y, x). Then R2(x,y)=R(βˆ’y,x)=(βˆ’x,βˆ’y)R^2(x, y) = R(-y, x) = (-x, -y), so R2=βˆ’IR^2 = -I, and βŸ¨βˆ’Iv,v⟩=βˆ’βˆ₯vβˆ₯2<0\langle -Iv, v\rangle = -\|v\|^2 \lt 0 for vβ‰ 0v \ne 0. A square root alone guarantees nothing; the theorem needs a positive or a self-adjoint one.
❌ That is condition (6). (Rβˆ—R)βˆ—=Rβˆ—R(R^*R)^* = R^*R and ⟨Rβˆ—Rv,v⟩=⟨Rv,Rv⟩=βˆ₯Rvβˆ₯2β‰₯0\langle R^*Rv, v\rangle = \langle Rv, Rv\rangle = \|Rv\|^2 \ge 0, so it does guarantee positivity.
❌ That is condition (5). With R=Rβˆ—R = R^*, (R2)βˆ—=R2(R^2)^* = R^2 and ⟨R2v,v⟩=⟨Rv,Rβˆ—v⟩=βˆ₯Rvβˆ₯2β‰₯0\langle R^2v, v\rangle = \langle Rv, R^*v\rangle = \|Rv\|^2 \ge 0, so TT is positive.
❌ That is condition (3). A real diagonal matrix in an orthonormal basis gives T=Tβˆ—T = T^*, and for v=βˆ‘ckekv = \sum c_k e_k, ⟨Tv,v⟩=βˆ‘Ξ»k∣ck∣2β‰₯0\langle Tv, v\rangle = \sum \lambda_k |c_k|^2 \ge 0.
Show solution

Options (a), (c) and (d) are conditions (6), (5) and (3) of the theorem, each equivalent to TT being positive.

Option (b) drops the requirement on RR. The rotation R(x,y)=(βˆ’y,x)R(x, y) = (-y, x) of R2\mathbf{R}^2 by a right angle satisfies

R2(x,y)=R(βˆ’y,x)=(βˆ’x,βˆ’y),soΒ R2=βˆ’I.R^2(x, y) = R(-y, x) = (-x, -y), \qquad \text{so } R^2 = -I.

Then T=βˆ’IT = -I has a square root, yet ⟨Tv,v⟩=βˆ’βˆ₯vβˆ₯2<0\langle Tv, v\rangle = -\|v\|^2 \lt 0 for every vβ‰ 0v \ne 0, so TT is not positive. The analogy with numbers: βˆ’1=i2-1 = i^2 has a square root, just not a real or nonnegative one.

Solved: 0 / 4