Linear-Algebra-Done-Right · Unit 24 · Video 2 · Interactive Practice

Generalized Eigenvectors Span Every Complex Space

IKey Formulas

FormulaNameHypotheses
v≠0v \ne 0 and (T−λI)kv=0(T - \lambda I)^k v = 0 for some positive integer kkvv is a generalized eigenvector of TT corresponding to λ\lambdaT∈L(V)T \in \mathcal{L}(V), λ\lambda an eigenvalue of TT; k=1k = 1 gives the eigenvectors
v≠0v \ne 0 is a generalized eigenvector for λ\lambda   ⟺  (T−λI)nv=0\iff (T - \lambda I)^{n} v = 0One power is enough to testVV finite-dimensional, n=dim⁡V≥1n = \dim V \ge 1; the null spaces of the powers of T−λIT - \lambda I stop growing by the power nn
(T−λI)kv=0(T - \lambda I)^k v = 0, v≠0v \ne 0 ⇒\Rightarrow λ\lambda is an eigenvalue of TTNo new "generalized eigenvalues"T∈L(V)T \in \mathcal{L}(V), kk a positive integer; if T−λIT - \lambda I were injective, so would be its powers
VV has a basis of generalized eigenvectors of TT; proof step: V=null⁡(T−λI)n⊕range⁡(T−λI)nV = \operatorname{null}(T - \lambda I)^n \oplus \operatorname{range}(T - \lambda I)^nBasis of generalized eigenvectorsF=C\mathbf{F} = \mathbf{C}, VV finite-dimensional, n=dim⁡Vn = \dim V, λ\lambda an eigenvalue of TT; induction on nn

Key Insight: Eigenvectors can leave part of VV unspanned, but allowing powers of T−λIT - \lambda I fixes this over C\mathbf{C}: the null space of (T−λI)n(T - \lambda I)^n consists of generalized eigenvectors (plus 00), and the invariant range of (T−λI)n(T - \lambda I)^n has smaller dimension, so induction covers it.

IIApply T−λIT - \lambda I Until It Vanishes

For T(z1,z2,z3)=(4z2, 0, 5z3)T(z_1, z_2, z_3) = (4z_2,\ 0,\ 5z_3), a nonzero vv is a generalized eigenvector for λ\lambda exactly when (T−λI)3v=0(T - \lambda I)^3 v = 0.

IIISplit, Then Induct

The inductive step splits C3\mathbf{C}^3 as null⁡(T−λI)3⊕range⁡(T−λI)3\operatorname{null}(T - \lambda I)^3 \oplus \operatorname{range}(T - \lambda I)^3 and finds generalized eigenvectors in each piece.

IVOver R\mathbf{R} the First Step Can Fail

The proof needs an eigenvalue: the rotation of R2\mathbf{R}^2 has none, while N(x,y)=(y, 0)N(x, y) = (y,\ 0) has a basis of generalized eigenvectors.

VQuiz Questions

Problem 1 · Generalized but Not an Eigenvector

Given: T∈L(C3)T \in \mathcal{L}(\mathbf{C}^3) with T(z1,z2,z3)=(3z1+z2, 3z2, −2z3)T(z_1, z_2, z_3) = (3z_1 + z_2,\ 3z_2,\ -2z_3), whose matrix (31003000−2)\begin{pmatrix} 3 & 1 & 0 \\ 0 & 3 & 0 \\ 0 & 0 & -2 \end{pmatrix} is upper triangular, so its eigenvalues are 33 and −2-2. Which vector is a generalized eigenvector of TT for λ=3\lambda = 3 but not an eigenvector of TT?

✅ Correct! (T−3I)(0,1,0)=(1,0,0)≠0(T - 3I)(0, 1, 0) = (1, 0, 0) \ne 0, so it is not an eigenvector, but (T−3I)2(0,1,0)=(T−3I)(1,0,0)=0(T - 3I)^2(0, 1, 0) = (T - 3I)(1, 0, 0) = 0: a generalized eigenvector with k=2k = 2.
❌ That one is an eigenvector. (T−3I)(1,0,0)=(0,0,0)(T - 3I)(1, 0, 0) = (0, 0, 0) already at k=1k = 1, so (1,0,0)(1, 0, 0) is an eigenvector for 33; it is a generalized eigenvector, but the question excludes eigenvectors.
❌ Wrong eigenvalue. T(0,0,1)=(0,0,−2)T(0, 0, 1) = (0, 0, -2), so (0,0,1)(0, 0, 1) is an eigenvector for −2-2. For λ=3\lambda = 3, (T−3I)k(0,0,1)=(0,0,(−5)k)≠0(T - 3I)^k (0, 0, 1) = \big(0, 0, (-5)^k\big) \ne 0 for every kk.
❌ Mixing eigenvalues spoils it. (T−3I)3(0,1,1)=(0,0,−125)≠0(T - 3I)^3(0, 1, 1) = (0, 0, -125) \ne 0: the (0,0,1)(0, 0, 1) part belongs to −2-2, and no power of T−3IT - 3I removes it, so (0,1,1)(0, 1, 1) is not a generalized eigenvector for 33.
Show solution

Here (T−3I)(z1,z2,z3)=(z2, 0, −5z3)(T - 3I)(z_1, z_2, z_3) = (z_2,\ 0,\ -5z_3) and n=dim⁡C3=3n = \dim \mathbf{C}^3 = 3.

(T−3I)(1,0,0)=(0,0,0),(T−3I)(0,1,0)=(1,0,0),(T−3I)2(0,1,0)=(0,0,0)(T - 3I)(1,0,0) = (0,0,0),\qquad (T - 3I)(0,1,0) = (1,0,0),\qquad (T - 3I)^2(0,1,0) = (0,0,0) (T−3I)3(0,0,1)=(0,0,−125),(T−3I)3(0,1,1)=(0,0,−125)(T - 3I)^3(0,0,1) = (0,0,-125),\qquad (T - 3I)^3(0,1,1) = (0,0,-125)

By the power test, the generalized eigenvectors for 33 are the nonzero vectors with (T−3I)3v=0(T - 3I)^3 v = 0, that is, the nonzero (z1,z2,0)(z_1, z_2, 0). Among the options, (1,0,0)(1, 0, 0) and (0,1,0)(0, 1, 0) qualify, and only (0,1,0)(0, 1, 0) fails the eigenvector condition (T−3I)v=0(T - 3I)v = 0. Answer: (0,1,0)(0, 1, 0).

Problem 2 · Which Power Kills It?

Given: T∈L(C3)T \in \mathcal{L}(\mathbf{C}^3) with matrix (110011001)\begin{pmatrix} 1 & 1 & 0 \\ 0 & 1 & 1 \\ 0 & 0 & 1 \end{pmatrix}, so 11 is its only eigenvalue, and v=(2,−1,1)v = (2, -1, 1). Find the smallest positive integer kk with (T−I)kv=0(T - I)^k v = 0, if there is one.

✅ Correct! (T−I)2v=(1,0,0)≠0(T - I)^2 v = (1, 0, 0) \ne 0 but (T−I)3v=0(T - I)^3 v = 0, so vv is a generalized eigenvector for 11 that needs exactly the power dim⁡C3=3\dim \mathbf{C}^3 = 3.
❌ Not an eigenvector. (T−I)v=(−1,1,0)≠0(T - I)v = (-1, 1, 0) \ne 0, so k=1k = 1 fails: vv is not an eigenvector of TT.
❌ One more power. (T−I)2v=(T−I)(−1,1,0)=(1,0,0)≠0(T - I)^2 v = (T - I)(-1, 1, 0) = (1, 0, 0) \ne 0, so k=2k = 2 fails too.
❌ You stopped too early. The test power is dim⁡V=3\dim V = 3, not 22: (T−I)3v=(T−I)(1,0,0)=(0,0,0)(T - I)^3 v = (T - I)(1, 0, 0) = (0, 0, 0), so vv is a generalized eigenvector.
Show solution

T−IT - I has matrix (010001000)\begin{pmatrix} 0 & 1 & 0 \\ 0 & 0 & 1 \\ 0 & 0 & 0 \end{pmatrix}, so (T−I)(z1,z2,z3)=(z2, z3, 0)(T - I)(z_1, z_2, z_3) = (z_2,\ z_3,\ 0). Apply it one power at a time:

(T−I)(2,−1,1)=(−1,1,0),(T−I)2v=(1,0,0),(T−I)3v=(0,0,0).(T - I)(2, -1, 1) = (-1, 1, 0),\qquad (T - I)^2 v = (1, 0, 0),\qquad (T - I)^3 v = (0, 0, 0).

The first zero appears at k=3k = 3. This is the largest power the test ever needs, since n=dim⁡C3=3n = \dim \mathbf{C}^3 = 3: had (T−I)3v(T - I)^3 v been nonzero, no higher power could have sent vv to 00.

Problem 3 · Assemble the Basis

Given: T∈L(C3)T \in \mathcal{L}(\mathbf{C}^3) with matrix (21002100−1)\begin{pmatrix} 2 & 1 & 0 \\ 0 & 2 & 1 \\ 0 & 0 & -1 \end{pmatrix}, eigenvalues 22 and −1-1. Its eigenvectors are the nonzero multiples of (1,0,0)(1, 0, 0) and of (1,−3,9)(1, -3, 9). Which list is a basis of C3\mathbf{C}^3 consisting of generalized eigenvectors of TT?

✅ Correct! null⁡(T−2I)3={(z1,z2,0)}\operatorname{null}(T - 2I)^3 = \{(z_1, z_2, 0)\} supplies (1,0,0)(1, 0, 0) and (0,1,0)(0, 1, 0), the eigenvector (1,−3,9)(1, -3, 9) is a generalized eigenvector for −1-1, and the three vectors are linearly independent.
❌ The standard basis fails here. (T−2I)3(0,0,1)=(−3,9,−27)≠0(T - 2I)^3(0, 0, 1) = (-3, 9, -27) \ne 0 and (T+I)3(0,0,1)=(6,9,0)≠0(T + I)^3(0, 0, 1) = (6, 9, 0) \ne 0, so (0,0,1)(0, 0, 1) is not a generalized eigenvector for either eigenvalue.
❌ Eigenvectors alone run out. These two vectors are eigenvectors, hence generalized eigenvectors, but two vectors cannot span C3\mathbf{C}^3: this is exactly why TT is not diagonalizable.
❌ The theorem says otherwise. Over C\mathbf{C} every operator on a finite-dimensional space has a basis of generalized eigenvectors; the missing direction is supplied by (0,1,0)(0, 1, 0), which satisfies (T−2I)2(0,1,0)=0(T - 2I)^2(0, 1, 0) = 0.
Show solution

Use the power test with n=3n = 3. For λ=2\lambda = 2, (T−2I)(z)=(z2, z3, −3z3)(T - 2I)(z) = (z_2,\ z_3,\ -3z_3) and

(T−2I)3(z1,z2,z3)=z3 (−3, 9, −27),(T - 2I)^3 (z_1, z_2, z_3) = z_3\,(-3,\ 9,\ -27),

which is 00 exactly when z3=0z_3 = 0: the generalized eigenvectors for 22 are the nonzero (z1,z2,0)(z_1, z_2, 0), a plane, while the eigenvectors for 22 fill only the line through (1,0,0)(1, 0, 0).

For λ=−1\lambda = -1, (T+I)3(z1,z2,z3)=(27z1+27z2+6z3, 27z2+9z3, 0)(T + I)^3(z_1, z_2, z_3) = (27z_1 + 27z_2 + 6z_3,\ 27z_2 + 9z_3,\ 0), which vanishes exactly on the multiples of (1,−3,9)(1, -3, 9).

Take (1,0,0)(1, 0, 0) and (0,1,0)(0, 1, 0) for 22 and (1,−3,9)(1, -3, 9) for −1-1. They are linearly independent: in a(1,0,0)+b(0,1,0)+c(1,−3,9)=0a(1,0,0) + b(0,1,0) + c(1,-3,9) = 0 the third coordinate gives c=0c = 0, then a=b=0a = b = 0. Three independent vectors in C3\mathbf{C}^3 form a basis. Option (b) fails because (0,0,1)(0, 0, 1) is not a generalized eigenvector at all.

Problem 4 · Run the Inductive Step

Given: T∈L(C3)T \in \mathcal{L}(\mathbf{C}^3) with matrix (011001003)\begin{pmatrix} 0 & 1 & 1 \\ 0 & 0 & 1 \\ 0 & 0 & 3 \end{pmatrix}, so T(z1,z2,z3)=(z2+z3, z3, 3z3)T(z_1, z_2, z_3) = (z_2 + z_3,\ z_3,\ 3z_3), eigenvalues 00 and 33. Run the proof's inductive step with λ=3\lambda = 3: C3=null⁡(T−3I)3⊕range⁡(T−3I)3\mathbf{C}^3 = \operatorname{null}(T - 3I)^3 \oplus \operatorname{range}(T - 3I)^3, where null⁡(T−3I)3=span⁡((4,3,9))\operatorname{null}(T - 3I)^3 = \operatorname{span}\big((4, 3, 9)\big).

What is range (T − 3I)³?

With S = T restricted to that range, its nonzero vectors are generalized eigenvectors of T for…

✅ Correct! S(z1,z2,0)=(z2,0,0)S(z_1, z_2, 0) = (z_2, 0, 0) and S2=0S^2 = 0, so the range supplies (1,0,0)(1, 0, 0), (0,1,0)(0, 1, 0) for 00; with (4,3,9)(4, 3, 9) for 33 they form a basis of generalized eigenvectors of TT.
❌ That is the null space. span⁡((4,3,9))\operatorname{span}\big((4, 3, 9)\big) is null⁡(T−3I)3\operatorname{null}(T - 3I)^3; the range is the other summand, of dimension 3−1=23 - 1 = 2.
❌ Check the third coordinate. T−3IT - 3I sends (z1,z2,z3)(z_1, z_2, z_3) to (−3z1+z2+z3, −3z2+z3, 0)(-3z_1 + z_2 + z_3,\ -3z_2 + z_3,\ 0), so every output of (T−3I)3(T - 3I)^3 has third coordinate 00; (0,0,1)(0, 0, 1) is not in the range.
❌ Not surjective. 33 is an eigenvalue, so T−3IT - 3I is not injective and neither is (T−3I)3(T - 3I)^3; since dim⁡null⁡(T−3I)3=1\dim \operatorname{null}(T - 3I)^3 = 1, the range has dimension 22.
❌ The range carries the other eigenvalues. A generalized eigenvector for 33 lies in null⁡(T−3I)3\operatorname{null}(T - 3I)^3 by the power test, and that null space meets the range only in 00 because the sum is direct.
❌ That is what the induction is for. SS is an operator on a complex space of dimension 2<32 < 3, so the induction hypothesis gives a basis of generalized eigenvectors of SS, and these are generalized eigenvectors of TT.
❌ Those are only the eigenvectors of SS. S(0,1,0)=(1,0,0)S(0, 1, 0) = (1, 0, 0) and S2(0,1,0)=0S^2(0, 1, 0) = 0, so (0,1,0)(0, 1, 0) is a generalized eigenvector for 00 with k=2k = 2; in fact S2=0S^2 = 0 on the whole range.
Show solution

The range. (T−3I)(z1,z2,z3)=(−3z1+z2+z3, −3z2+z3, 0)(T - 3I)(z_1, z_2, z_3) = (-3z_1 + z_2 + z_3,\ -3z_2 + z_3,\ 0), and

(T−3I)3=(−272730−279000).(T - 3I)^3 = \begin{pmatrix} -27 & 27 & 3 \\ 0 & -27 & 9 \\ 0 & 0 & 0 \end{pmatrix}.

Its columns lie in {(z1,z2,0)}\{(z_1, z_2, 0)\} and the first two, (−27,0,0)(-27, 0, 0) and (27,−27,0)(27, -27, 0), span it. So range⁡(T−3I)3={(z1,z2,0)}\operatorname{range}(T - 3I)^3 = \{(z_1, z_2, 0)\}, of dimension 22, and 1+2=31 + 2 = 3 as the direct sum requires. Check the null space: (T−3I)(4,3,9)=(−12+3+9, −9+9, 0)=(0,0,0)(T - 3I)(4, 3, 9) = (-12 + 3 + 9,\ -9 + 9,\ 0) = (0, 0, 0).

The restriction. The range is invariant under TT, and S(z1,z2,0)=T(z1,z2,0)=(z2,0,0)S(z_1, z_2, 0) = T(z_1, z_2, 0) = (z_2, 0, 0). Then S2(z1,z2,0)=S(z2,0,0)=(0,0,0)S^2(z_1, z_2, 0) = S(z_2, 0, 0) = (0, 0, 0), so every nonzero vector of the range is a generalized eigenvector of SS for 00, hence of TT for 00 (since SS and TT agree on the range).

The basis. (1,0,0),(0,1,0)(1, 0, 0), (0, 1, 0) from the range and (4,3,9)(4, 3, 9) from the null space form a basis of C3\mathbf{C}^3 consisting of generalized eigenvectors of TT.

Solved: 0 / 4