Linear-Algebra-Done-Right Β· Unit 23 Β· Video 1 Β· Interactive Practice

Invertible Operators Turn Balls into Ellipsoids

IKey Formulas

FormulaNameWhere it comes from
B={v∈V:βˆ₯vβˆ₯<1}B = \{v \in V : \|v\| < 1\}The ballStrict inequality: the sphere βˆ₯vβˆ₯=1\|v\| = 1 is left out
E(s1f1,…,snfn)={v:∣⟨v,f1⟩∣2s12+β‹―+∣⟨v,fn⟩∣2sn2<1}E(s_1 f_1, \dots, s_n f_n) = \Big\{v : \dfrac{|\langle v, f_1\rangle|^2}{s_1^2} + \cdots + \dfrac{|\langle v, f_n\rangle|^2}{s_n^2} < 1\Big\}Ellipsoid with principal axes skfks_k f_kf1,…,fnf_1, \dots, f_n orthonormal basis, sk>0s_k > 0; all sk=1s_k = 1 gives BB (Parseval)
T(B)=E(s1f1,…,snfn)T(B) = E(s_1 f_1, \dots, s_n f_n)Ball to ellipsoidTT invertible with SVD Tv=βˆ‘ksk⟨v,ek⟩fkTv = \sum_k s_k \langle v, e_k\rangle f_k; key identity ⟨Tv,fk⟩=sk⟨v,ek⟩\langle Tv, f_k\rangle = s_k\langle v, e_k\rangle
T(E)=T(S(B))=(TS)(B)T(E) = T(S(B)) = (TS)(B)Ellipsoid to ellipsoidE=S(B)E = S(B) for the stretch Sv=βˆ‘ksk⟨v,fk⟩fkSv = \sum_k s_k\langle v, f_k\rangle f_k

Key Insight: TT sends eke_k to skfks_k f_k, so the orthonormal directions e1,…,ene_1, \dots, e_n of the ball land on the principal axes of the ellipsoid, each stretched by its singular value.

IIAn Ellipsoid Is a Stretched Ball

E(s1f1,s2f2)E(s_1 f_1, s_2 f_2) reaches out sks_k along fkf_k, and a point ww belongs to it exactly when the weighted sum is below 1.

IIIThe Ball Lands Exactly on the Ellipsoid

For every vv, the ellipsoid's sum at TvTv equals βˆ₯vβˆ₯2\|v\|^2, so Tv∈E(s1f1,s2f2)Tv \in E(s_1 f_1, s_2 f_2) exactly when v∈Bv \in B.

IVQuiz Questions

Problem 1 Β· Inside the Ellipsoid

Given: f1,f2f_1, f_2 the standard basis of R2\mathbf{R}^2 β€” which point lies in the ellipsoid E(3f1,f2)E(3f_1, f_2)?

βœ… Correct! 229+0.52=49+14=2536<1\tfrac{2^2}{9} + 0.5^2 = \tfrac{4}{9} + \tfrac14 = \tfrac{25}{36} < 1.
❌ On the boundary. (3,0)=3f1(3, 0) = 3f_1 gives 99+0=1\tfrac{9}{9} + 0 = 1, and the defining inequality is strict, so the tip of a principal axis is not in EE.
❌ Wrong axis. The stretch by 3 is along f1f_1 (the xx-direction): 0.529+22>1\tfrac{0.5^2}{9} + 2^2 > 1.
❌ Not quite. 49+0.64=49+1625>1\tfrac{4}{9} + 0.64 = \tfrac{4}{9} + \tfrac{16}{25} > 1: this point lies just outside.
Show solution

With f1,f2f_1, f_2 standard, ⟨(x,y),f1⟩=x\langle (x, y), f_1\rangle = x and ⟨(x,y),f2⟩=y\langle (x, y), f_2\rangle = y, so

E(3f1,f2)={(x,y):x29+y2<1}.E(3f_1, f_2) = \Big\{(x, y) : \frac{x^2}{9} + y^2 < 1\Big\}.

Test each point: (3,0)(3, 0) gives 11 (boundary, excluded); (0.5,2)(0.5, 2) gives 136+4>1\tfrac{1}{36} + 4 > 1; (2,0.5)(2, 0.5) gives 49+14=2536<1\tfrac{4}{9} + \tfrac{1}{4} = \tfrac{25}{36} < 1; (2,0.8)(2, 0.8) gives 49+1625=244225>1\tfrac{4}{9} + \tfrac{16}{25} = \tfrac{244}{225} > 1.

Only (2,0.5)(2, 0.5) lies in E(3f1,f2)E(3f_1, f_2).

Problem 2 Β· The Axes Follow the f's

Given: T∈L(R2)T \in \mathcal{L}(\mathbf{R}^2), T(x,y)=(2y,βˆ’3x)T(x, y) = (2y, -3x) β€” which inequality describes T(B)T(B)?

βœ… Correct! Te1=3f1Te_1 = 3f_1 with f1=(0,βˆ’1)f_1 = (0, -1) and Te2=2f2Te_2 = 2f_2 with f2=(1,0)f_2 = (1, 0): the ellipse reaches 2 horizontally and 3 vertically.
❌ Those are the input directions. TT stretches e1=(1,0)e_1 = (1, 0) by 3, but sends it to the vertical direction (0,βˆ’3)(0, -3). The principal axes point along the ff's, not the ee's.
❌ That is the inverse picture. Points of T(B)T(B) have ∣x∣|x| up to 2 and ∣y∣|y| up to 3, so the semi-axis lengths go in the denominators.
❌ Not quite. TT changes lengths: βˆ₯T(1,0)βˆ₯=3\|T(1, 0)\| = 3.
Show solution

Take e1=(1,0)e_1 = (1, 0), e2=(0,1)e_2 = (0, 1). Then Te1=(0,βˆ’3)=3 (0,βˆ’1)Te_1 = (0, -3) = 3\,(0, -1) and Te2=(2,0)=2 (1,0)Te_2 = (2, 0) = 2\,(1, 0). With f1=(0,βˆ’1)f_1 = (0, -1), f2=(1,0)f_2 = (1, 0) (an orthonormal basis),

Tv=3⟨v,e1⟩f1+2⟨v,e2⟩f2Tv = 3\langle v, e_1\rangle f_1 + 2\langle v, e_2\rangle f_2

is a singular value decomposition with s1=3s_1 = 3, s2=2s_2 = 2. Hence T(B)=E(3f1,2f2)T(B) = E(3f_1, 2f_2). Since ⟨(x,y),f1⟩=βˆ’y\langle (x, y), f_1\rangle = -y and ⟨(x,y),f2⟩=x\langle (x, y), f_2\rangle = x,

T(B)={(x,y):y29+x24<1}.T(B) = \Big\{(x, y) : \frac{y^2}{9} + \frac{x^2}{4} < 1\Big\}.

Problem 3 Β· The Longest Semi-Axis

Given: T∈L(R2)T \in \mathcal{L}(\mathbf{R}^2), T(x,y)=(x+2y,Β 2xβˆ’2y)T(x, y) = (x + 2y,\ 2x - 2y) β€” find the longest principal axis of the ellipse T(B)T(B).

βœ… Correct! s1=3s_1 = 3 and f1=Β±15(1,βˆ’2)f_1 = \pm\tfrac{1}{\sqrt5}(1, -2).
❌ Right length, wrong direction. (2,1)(2, 1) is an eigenvector for the eigenvalue 22, which gives the shorter axis s2=2s_2 = 2.
❌ Take the square root. 99 is an eigenvalue of Tβˆ—TT^*T; the singular value is 9=3\sqrt9 = 3.
❌ That is the shorter axis. The eigenvalue βˆ’3-3 has the larger absolute value, so the longest axis has length 33.
Show solution

The matrix A=(122βˆ’2)A = \begin{pmatrix} 1 & 2 \\ 2 & -2 \end{pmatrix} is symmetric, so Tβˆ—T=T2T^*T = T^2. Its characteristic polynomial is Ξ»2+Ξ»βˆ’6=(Ξ»βˆ’2)(Ξ»+3)\lambda^2 + \lambda - 6 = (\lambda - 2)(\lambda + 3), with eigenvectors (2,1)(2, 1) for 22 and (1,βˆ’2)(1, -2) for βˆ’3-3.

Then Tβˆ—TT^*T has eigenvalues 99 and 44 with the same eigenvectors, so s1=3s_1 = 3, e1=15(1,βˆ’2)e_1 = \tfrac{1}{\sqrt5}(1, -2), and

f1=Te1s1=βˆ’3e13=βˆ’e1.f_1 = \frac{Te_1}{s_1} = \frac{-3e_1}{3} = -e_1 .

The longest semi-axis s1f1s_1 f_1 has length 33 and lies along the line through (1,βˆ’2)(1, -2); the other has length s2=2s_2 = 2 along (2,1)(2, 1).

Problem 4 Β· Rotating an Ellipsoid Back

Given: f1=(12,12)f_1 = \big(\tfrac{1}{\sqrt2}, \tfrac{1}{\sqrt2}\big), f2=(βˆ’12,12)f_2 = \big(-\tfrac{1}{\sqrt2}, \tfrac{1}{\sqrt2}\big), E=E(2f1,f2)E = E(2f_1, f_2), and T(x,y)=(x+y2,yβˆ’x2)T(x, y) = \big(\tfrac{x + y}{\sqrt2}, \tfrac{y - x}{\sqrt2}\big) β€” which inequality describes T(E)T(E)?

βœ… Correct! TT is the rotation by βˆ’45∘-45^\circ: Tf1=(1,0)Tf_1 = (1, 0) and Tf2=(0,1)Tf_2 = (0, 1), so T(E)=E(2Tf1,Tf2)T(E) = E(2Tf_1, Tf_2) is axis-aligned.
❌ That is EE itself. TT is not the identity; it moves the axes f1,f2f_1, f_2 to Tf1,Tf2Tf_1, Tf_2.
❌ Check where f1f_1 goes. Tf1=(2/22,0)=(1,0)Tf_1 = \big(\tfrac{2/\sqrt2}{\sqrt2}, 0\big) = (1, 0), so the long axis (length 2) is horizontal.
❌ TT preserves lengths, but EE was never a ball. Its semi-axes have lengths 2 and 1, and so do those of T(E)T(E).
Show solution

Write E=S(B)E = S(B) with Sv=2⟨v,f1⟩f1+⟨v,f2⟩f2Sv = 2\langle v, f_1\rangle f_1 + \langle v, f_2\rangle f_2. Then T(E)=(TS)(B)T(E) = (TS)(B) and

(TS)v=2⟨v,f1βŸ©β€‰Tf1+⟨v,f2βŸ©β€‰Tf2.(TS)v = 2\langle v, f_1\rangle\, Tf_1 + \langle v, f_2\rangle\, Tf_2 .

Compute Tf1=(12β‹…22,0)=(1,0)Tf_1 = \big(\tfrac{1}{\sqrt2}\cdot\tfrac{2}{\sqrt2}, 0\big) = (1, 0) and Tf2=(0,12β‹…22)=(0,1)Tf_2 = \big(0, \tfrac{1}{\sqrt2}\cdot\tfrac{2}{\sqrt2}\big) = (0, 1), an orthonormal basis. So this is a singular value decomposition of TSTS with singular values 2,12, 1, and the ball theorem gives

T(E)=E(2(1,0),Β (0,1))={(x,y):x24+y2<1}.T(E) = E\big(2(1, 0),\ (0, 1)\big) = \Big\{(x, y) : \frac{x^2}{4} + y^2 < 1\Big\}.

Solved: 0 / 4