Linear-Algebra-Done-Right ยท Unit 23 ยท Video 2 ยท Interactive Practice

Boxes to Boxes: Parallelepipeds and the SVD

IKey Formulas

FormulaNameWhere it comes from
u+P(v1,โ€ฆ,vn)u + P(v_1, \dots, v_n), ย P(v1,โ€ฆ,vn)={a1v1+โ‹ฏ+anvn:akโˆˆ(0,1)}\ P(v_1, \dots, v_n) = \{a_1 v_1 + \cdots + a_n v_n : a_k \in (0, 1)\}Parallelepiped with edges v1,โ€ฆ,vnv_1, \dots, v_nv1,โ€ฆ,vnv_1, \dots, v_n a basis of VV; open interval, so the boundary is excluded
T(u+P(v1,โ€ฆ,vn))=Tu+P(Tv1,โ€ฆ,Tvn)T\big(u + P(v_1, \dots, v_n)\big) = Tu + P(Tv_1, \dots, Tv_n)Image of a parallelepipedLinearity keeps the coefficients; invertibility keeps Tv1,โ€ฆ,TvnTv_1, \dots, Tv_n a basis
u+P(r1e1,โ€ฆ,rnen)u + P(r_1 e_1, \dots, r_n e_n)Boxe1,โ€ฆ,ene_1, \dots, e_n orthonormal basis, rk>0r_k > 0 the edge lengths
T(u+P(r1e1,โ€ฆ,rnen))=Tu+P(r1s1f1,โ€ฆ,rnsnfn)T\big(u + P(r_1 e_1, \dots, r_n e_n)\big) = Tu + P(r_1 s_1 f_1, \dots, r_n s_n f_n)Boxes along the ee's stay boxesSVD of invertible TT: Tek=skfkTe_k = s_k f_k, every sk>0s_k > 0

Key Insight: A box whose edges point along the first basis e1,โ€ฆ,ene_1, \dots, e_n of a singular value decomposition comes out as a box along the second basis f1,โ€ฆ,fnf_1, \dots, f_n, with edge rkekr_k e_k becoming rkskfkr_k s_k f_k.

IISame Coefficients In, Same Coefficients Out

A point u+a1v1+a2v2u + a_1 v_1 + a_2 v_2 goes to Tu+a1Tv1+a2Tv2Tu + a_1 Tv_1 + a_2 Tv_2, with the coefficients unchanged.

IIIWhich Boxes Stay Boxes?

Under T(x,y)=(3x+3y,ย yโˆ’x)T(x, y) = (3x + 3y,\ y - x), a box keeps its right angles only when its edges lie along e1=12(1,1)e_1 = \tfrac{1}{\sqrt2}(1, 1) and e2=12(โˆ’1,1)e_2 = \tfrac{1}{\sqrt2}(-1, 1).

IVQuiz Questions

Problem 1 ยท A Point of a Parallelogram

Given: the parallelogram (1,1)+P((2,1),(0,2))(1, 1) + P\big((2, 1), (0, 2)\big) in R2\mathbf{R}^2 โ€” which point belongs to it?

โœ… Correct! (2,2.5)=(1,1)+12(2,1)+12(0,2)(2, 2.5) = (1, 1) + \tfrac12 (2, 1) + \tfrac12 (0, 2), both coefficients in (0,1)(0, 1).
โŒ On the boundary. (3,2)=(1,1)+1โ‹…(2,1)+0โ‹…(0,2)(3, 2) = (1, 1) + 1\cdot(2, 1) + 0\cdot(0, 2): the coefficients 11 and 00 are not in the open interval (0,1)(0, 1).
โŒ That is the corner uu. It needs a1=a2=0a_1 = a_2 = 0, which the open interval excludes.
โŒ Not quite. Solve (1,1)+a1(2,1)+a2(0,2)=(2,4)(1, 1) + a_1(2, 1) + a_2(0, 2) = (2, 4): a1=12a_1 = \tfrac12, a2=54>1a_2 = \tfrac54 > 1.
Show solution

A point (x,y)(x, y) is in the set when (x,y)=(1+2a1,ย 1+a1+2a2)(x, y) = (1 + 2a_1,\ 1 + a_1 + 2a_2) with a1,a2โˆˆ(0,1)a_1, a_2 \in (0, 1). Solve: a1=xโˆ’12a_1 = \tfrac{x - 1}{2}, a2=yโˆ’1โˆ’a12a_2 = \tfrac{y - 1 - a_1}{2}.

  • (3,2)(3, 2): a1=1a_1 = 1, a2=0a_2 = 0 โ€” boundary, excluded.
  • (2,4)(2, 4): a1=12a_1 = \tfrac12, a2=54a_2 = \tfrac54 โ€” outside.
  • (1,1)(1, 1): a1=a2=0a_1 = a_2 = 0 โ€” the corner, excluded.
  • (2,2.5)(2, 2.5): a1=12a_1 = \tfrac12, a2=12a_2 = \tfrac12 โ€” inside.

Problem 2 ยท A Square Under a Shear

Given: T(x,y)=(x+y,ย y)T(x, y) = (x + y,\ y) on R2\mathbf{R}^2 โ€” find the image of the box P((1,0),(0,1))P\big((1, 0), (0, 1)\big).

โœ… Correct! T(1,0)=(1,0)T(1, 0) = (1, 0) and T(0,1)=(1,1)T(0, 1) = (1, 1), and โŸจ(1,0),(1,1)โŸฉ=1โ‰ 0\langle (1, 0), (1, 1)\rangle = 1 \ne 0.
โŒ The edge (0,1)(0, 1) moves. T(0,1)=(0+1,1)=(1,1)T(0, 1) = (0 + 1, 1) = (1, 1).
โŒ Apply TT to each edge. T(1,0)=(1,0)T(1, 0) = (1, 0), not (1,1)(1, 1): the first coordinate of T(x,y)T(x, y) is x+yx + y.
โŒ The corner stays put. The corner is u=0u = 0 and T0=0T0 = 0.
Show solution

The box has corner u=0u = 0 and edges (1,0),(0,1)(1, 0), (0, 1). By T(u+P(v1,v2))=Tu+P(Tv1,Tv2)T\big(u + P(v_1, v_2)\big) = Tu + P(Tv_1, Tv_2):

T(P((1,0),(0,1)))=P((1,0),(1,1)).T\Big(P\big((1, 0), (0, 1)\big)\Big) = P\big((1, 0), (1, 1)\big).

Its edges have inner product 1โ‹…1+0โ‹…1=1โ‰ 01 \cdot 1 + 0 \cdot 1 = 1 \ne 0, so they are not orthogonal and the image is a parallelogram that is not a box.

Problem 3 ยท Edge Lengths of the Image Box

Given: T(x,y)=(3x+3y,ย yโˆ’x)T(x, y) = (3x + 3y,\ y - x), with s1=32s_1 = 3\sqrt2, s2=2s_2 = \sqrt2, e1=12(1,1)e_1 = \tfrac{1}{\sqrt2}(1, 1), e2=12(โˆ’1,1)e_2 = \tfrac{1}{\sqrt2}(-1, 1) โ€” find the edge lengths of T(P(2e1,e2))T\big(P(2e_1, e_2)\big).

โœ… Correct! r1s1=2โ‹…32=62r_1 s_1 = 2 \cdot 3\sqrt2 = 6\sqrt2 and r2s2=1โ‹…2=2r_2 s_2 = 1 \cdot \sqrt2 = \sqrt2.
โŒ Those belong to the diamond. The video's box had r1=r2=2r_1 = r_2 = \sqrt2; here r1=2r_1 = 2 and r2=1r_2 = 1.
โŒ The singular values are already square roots. Multiply rkr_k by sks_k, not by sk2s_k^2.
โŒ TT stretches the edges. The edge rkekr_k e_k becomes rkskfkr_k s_k f_k.
Show solution

The box P(2e1,e2)P(2e_1, e_2) has edges along the ee's with r1=2r_1 = 2, r2=1r_2 = 1, so

T(P(2e1,e2))=P(2s1f1,ย s2f2)=P(62โ€‰f1,ย 2โ€‰f2).T\big(P(2e_1, e_2)\big) = P(2 s_1 f_1,\ s_2 f_2) = P\big(6\sqrt2\, f_1,\ \sqrt2\, f_2\big).

Check directly: T(2e1)=2โ€‰T(1,1)=2โ€‰(6,0)=(62,0)T(2e_1) = \sqrt2\, T(1, 1) = \sqrt2\,(6, 0) = (6\sqrt2, 0) and T(e2)=12T(โˆ’1,1)=12(0,2)=(0,2)T(e_2) = \tfrac{1}{\sqrt2} T(-1, 1) = \tfrac{1}{\sqrt2}(0, 2) = (0, \sqrt2). The edges are orthogonal, with lengths 626\sqrt2 and 2\sqrt2.

Problem 4 ยท When Every Box Stays a Box

Given: T(x,y)=(xโˆ’y,ย x+y)T(x, y) = (x - y,\ x + y) on R2\mathbf{R}^2 โ€” which statement is true?

โœ… Correct! T=2ร—T = \sqrt2 \times (rotation by 45โˆ˜45^\circ), so โŸจTu,TwโŸฉ=2โŸจu,wโŸฉ\langle Tu, Tw\rangle = 2\langle u, w\rangle: right angles survive in every direction.
โŒ The theorem guarantees boxes, it does not exclude others. Here both singular values equal 2\sqrt2, so every orthonormal basis can serve as e1,e2e_1, e_2.
โŒ Axis-aligned boxes do stay boxes, but not only those. TT rotates and scales uniformly, so a tilted box stays a box too.
โŒ Boxes depend on singular values, not eigenvalues. TT indeed has no real eigenvalues, yet T(1,0)=(1,1)T(1, 0) = (1, 1) and T(0,1)=(โˆ’1,1)T(0, 1) = (-1, 1) are orthogonal.
Show solution

The matrix (1โˆ’111)\begin{pmatrix} 1 & -1 \\ 1 & 1 \end{pmatrix} gives Tโˆ—T=(2002)=2IT^*T = \begin{pmatrix} 2 & 0 \\ 0 & 2 \end{pmatrix} = 2I. So โŸจTu,TwโŸฉ=โŸจTโˆ—Tu,wโŸฉ=2โŸจu,wโŸฉ\langle Tu, Tw\rangle = \langle T^*Tu, w\rangle = 2\langle u, w\rangle for all u,wu, w.

If u+P(r1e1,r2e2)u + P(r_1 e_1, r_2 e_2) is any box, the image edges r1Te1r_1 Te_1, r2Te2r_2 Te_2 satisfy โŸจTe1,Te2โŸฉ=0\langle Te_1, Te_2\rangle = 0 and โˆฅTekโˆฅ=2\|Te_k\| = \sqrt2. So the image is the box Tu+P(2r1f1,2r2f2)Tu + P\big(\sqrt2 r_1 f_1, \sqrt2 r_2 f_2\big) with fk=Tek/2f_k = Te_k/\sqrt2, for every orthonormal basis e1,e2e_1, e_2.

Solved: 0 / 4