Linear-Algebra-Done-Right ยท Unit 7 ยท Video 1 ยท Interactive Practice

Invertible Linear Maps: Injective and Surjective

IKey Formulas

FormulaNameWhat it says
TT invertible โ€…โ€ŠโŸบโ€…โ€Šโˆƒโ€‰SโˆˆL(W,V)\iff \exists\, S \in \mathcal{L}(W, V) with ST=IST = I (on VV) and TS=ITS = I (on WW)Invertible, inverseBoth equations are required, and SS itself must be linear
S1=S1I=S1(TS2)=(S1T)S2=IS2=S2S_1 = S_1 I = S_1(TS_2) = (S_1 T)S_2 = I S_2 = S_2The inverse is uniqueUses TS2=ITS_2 = I and S1T=IS_1 T = I, one equation from each inverse; the inverse is written Tโˆ’1T^{-1}
TT invertible โ€…โ€ŠโŸบโ€…โ€Š\iff TT injective and surjectiveCharacterizationInjective: Tu=Tvโ‡’u=vTu = Tv \Rightarrow u = v; surjective: rangeโ€‰T=W\text{range}\, T = W
Tโˆ’1(w)T^{-1}(w) = the unique vโˆˆVv \in V with Tv=wTv = wBuilding the inverseSuch vv exists because TT is surjective and is unique because TT is injective; this Tโˆ’1T^{-1} is automatically linear

Key Insight: For a linear map from an infinite-dimensional space to itself, one property alone is not enough: Tp=x2pTp = x^2 p on P(R)\mathcal{P}(\mathbf{R}) is injective but not surjective, and the backward shift on Fโˆž\mathbf{F}^\infty is surjective but not injective.

IIVisualization 1 โ€” One Equation Is Not Enough

T(t)=(2t,t)T(t) = (2t, t) from R\mathbf{R} to R2\mathbf{R}^2 has many linear SS with ST=IST = I, but none with TS=ITS = I.

๐Ÿ’ก All three choices of SS satisfy ST=IST = I, so a one-sided inverse need not be unique; the uniqueness proof needs S1T=IS_1 T = I and TS2=ITS_2 = I, one equation from each side.

IIIVisualization 2 โ€” The Inverse Function Is Additive

For T(x,y)=(x+y,ย x+2y)T(x, y) = (x + y,\ x + 2y), defining S(w)S(w) as the unique vv with Tv=wTv = w already gives a linear map.

IVVisualization 3 โ€” Infinite Dimensions: One Property Alone Fails

For a linear map from an infinite-dimensional space to itself, injective alone or surjective alone does not make it invertible.

VQuiz Questions

Problem 1 ยท Find the Inverse

Given: TโˆˆL(R2)T \in \mathcal{L}(\mathbf{R}^2), T(x,y)=(2x,ย x+y)T(x, y) = (2x,\ x + y) โ€” find Tโˆ’1(x,y)T^{-1}(x, y).

โœ… Correct! T(12x,ย yโˆ’12x)=(x,ย 12x+yโˆ’12x)=(x,y)T(\tfrac12 x,\ y - \tfrac12 x) = (x,\ \tfrac12 x + y - \tfrac12 x) = (x, y), and Tโˆ’1(T(x,y))=Tโˆ’1(2x,ย x+y)=(x,y)T^{-1}(T(x, y)) = T^{-1}(2x,\ x + y) = (x, y).
โŒ Not quite. Undoing each entry separately ignores that the second entry of TT mixes both inputs: T(12x,ย y)=(x,ย 12x+y)โ‰ (x,y)T(\tfrac12 x,\ y) = (x,\ \tfrac12 x + y) \neq (x, y).
โŒ Check the sign. T(12x,ย y+12x)=(x,ย x+y)T(\tfrac12 x,\ y + \tfrac12 x) = (x,\ x + y): the xx added by TT must be subtracted, not added again.
โŒ Close. T(12x,ย yโˆ’x)=(x,ย yโˆ’12x)T(\tfrac12 x,\ y - x) = (x,\ y - \tfrac12 x). The first entry of the preimage is 12x\tfrac12 x, so that is what must be subtracted.
โŒ Not quite. Solve T(a,b)=(x,y)T(a, b) = (x, y) for aa and bb.
Show solution

Find the unique (a,b)(a, b) with T(a,b)=(x,y)T(a, b) = (x, y):

2a=x,a+b=yโŸนa=12x,b=yโˆ’12x.2a = x,\qquad a + b = y \quad\Longrightarrow\quad a = \tfrac12 x,\qquad b = y - \tfrac12 x.

So Tโˆ’1(x,y)=(12x,ย yโˆ’12x)T^{-1}(x, y) = (\tfrac12 x,\ y - \tfrac12 x). Check both equations of the definition:

T(Tโˆ’1(x,y))=(x,ย 12x+yโˆ’12x)=(x,y),T\big(T^{-1}(x, y)\big) = \big(x,\ \tfrac12 x + y - \tfrac12 x\big) = (x, y), Tโˆ’1(T(x,y))=Tโˆ’1(2x,ย x+y)=(x,ย x+yโˆ’x)=(x,y).T^{-1}\big(T(x, y)\big) = T^{-1}(2x,\ x + y) = \big(x,\ x + y - x\big) = (x, y).

Both products are the identity on R2\mathbf{R}^2, so TT is invertible with this inverse.

Problem 2 ยท Is One Equation Enough?

Given: TโˆˆL(R2,R3)T \in \mathcal{L}(\mathbf{R}^2, \mathbf{R}^3), T(x,y)=(x,ย xโˆ’y,ย y)T(x, y) = (x,\ x - y,\ y), and SโˆˆL(R3,R2)S \in \mathcal{L}(\mathbf{R}^3, \mathbf{R}^2), S(x,y,z)=(x,z)S(x, y, z) = (x, z) โ€” which statement is true?

โœ… Correct! SS undoes TT, but TT cannot undo SS: (0,1,0)โˆ‰rangeโ€‰T(0, 1, 0) \notin \text{range}\, T, so TT is not surjective and has no inverse at all.
โŒ Only one equation holds. ST(x,y)=S(x,xโˆ’y,y)=(x,y)ST(x, y) = S(x, x - y, y) = (x, y), so ST=IST = I; but TS(0,1,0)=T(0,0)=(0,0,0)โ‰ (0,1,0)TS(0, 1, 0) = T(0, 0) = (0, 0, 0) \neq (0, 1, 0).
โŒ Compute both products. ST(x,y)=S(x,xโˆ’y,y)=(x,y)ST(x, y) = S(x, x - y, y) = (x, y), while TS(x,y,z)=T(x,z)=(x,ย xโˆ’z,ย z)TS(x, y, z) = T(x, z) = (x,\ x - z,\ z).
Show solution

STST (on R2\mathbf{R}^2): ST(x,y)=S(x,ย xโˆ’y,ย y)=(x,y)ST(x, y) = S(x,\ x - y,\ y) = (x, y), so ST=IST = I.

TSTS (on R3\mathbf{R}^3): TS(x,y,z)=T(x,z)=(x,ย xโˆ’z,ย z)TS(x, y, z) = T(x, z) = (x,\ x - z,\ z). This equals (x,y,z)(x, y, z) only when y=xโˆ’zy = x - z; for example TS(0,1,0)=(0,0,0)TS(0, 1, 0) = (0, 0, 0). So TSโ‰ ITS \neq I and SS is not an inverse of TT.

No other SS works either: every output of TT has middle entry equal to the first entry minus the third, so (0,1,0)โˆ‰rangeโ€‰T(0, 1, 0) \notin \text{range}\, T. Thus TT is not surjective, and by the theorem TT is not invertible.

The definition demands both equations; ST=IST = I alone only shows that TT is injective.

Problem 3 ยท Classify Two Infinite-Dimensional Maps

Given: differentiation DโˆˆL(P(R))D \in \mathcal{L}(\mathcal{P}(\mathbf{R})), Dp=pโ€ฒDp = p', and the forward shift RโˆˆL(Fโˆž)R \in \mathcal{L}(\mathbf{F}^\infty), R(x1,x2,x3,โ€ฆโ€‰)=(0,x1,x2,โ€ฆโ€‰)R(x_1, x_2, x_3, \dots) = (0, x_1, x_2, \dots) โ€” classify each map.

Differentiation D on ๐’ซ(โ„)

Forward shift R on ๐”ฝ^โˆž

โœ… Correct! DD is surjective but not injective, RR is injective but not surjective, and neither is invertible.
โŒ Check DD. D(1)=0=D(0)D(1) = 0 = D(0), so the constant 11 lies in nullโ€‰D\text{null}\, D. Is every polynomial the derivative of some polynomial?
โŒ Check RR. If Rx=0Rx = 0 then x1=x2=โ‹ฏ=0x_1 = x_2 = \cdots = 0. Can an output of RR start with 11?
Show solution

DD is not injective: D1=0=D0D1 = 0 = D0 although 1โ‰ 01 \neq 0; equivalently nullโ€‰D\text{null}\, D contains the constants.

DD is surjective: for q=c0+c1x+โ‹ฏ+cmxmq = c_0 + c_1 x + \cdots + c_m x^m take

p=c0x+c12x2+โ‹ฏ+cmm+1xm+1,Dp=q.p = c_0 x + \tfrac{c_1}{2} x^2 + \cdots + \tfrac{c_m}{m + 1} x^{m+1}, \qquad Dp = q.

RR is injective: R(x1,x2,โ€ฆโ€‰)=(0,x1,x2,โ€ฆโ€‰)R(x_1, x_2, \dots) = (0, x_1, x_2, \dots) is the zero sequence only when every xk=0x_k = 0, so nullโ€‰R={0}\text{null}\, R = \{0\}.

RR is not surjective: every output has first entry 00, so (1,0,0,โ€ฆโ€‰)โˆ‰rangeโ€‰R(1, 0, 0, \dots) \notin \text{range}\, R.

Like the two maps in the video, each has exactly one of the two properties, so neither is invertible.

Problem 4 ยท A Left Inverse and a Right Inverse

Given: TโˆˆL(V,W)T \in \mathcal{L}(V, W) and S1,S2โˆˆL(W,V)S_1, S_2 \in \mathcal{L}(W, V) with S1T=IS_1 T = I (on VV) and TS2=IT S_2 = I (on WW); nothing else is assumed โ€” what follows?

โœ… Correct! The uniqueness chain uses exactly one equation from each map, so it applies verbatim: S1=S1(TS2)=(S1T)S2=S2S_1 = S_1(TS_2) = (S_1 T)S_2 = S_2.
โŒ Not here. Visualization 1 had many maps with ST=IST = I only because no map satisfied TS=ITS = I. Run the chain S1=S1I=S1(TS2)S_1 = S_1 I = S_1(TS_2).
โŒ Not quite. The chain S1=S1(TS2)=(S1T)S2=S2S_1 = S_1(TS_2) = (S_1 T)S_2 = S_2 never uses V=WV = W; it only needs the products to make sense.
โŒ Look at the proof again. It uses only TS2=ITS_2 = I, S1T=IS_1 T = I and associativity, never that TT is invertible.
Show solution

Repeat the uniqueness proof, using TS2=ITS_2 = I (on WW), associativity, then S1T=IS_1 T = I (on VV):

S1=S1I=S1(TS2)=(S1T)S2=IS2=S2.S_1 = S_1 I = S_1 (T S_2) = (S_1 T) S_2 = I S_2 = S_2.

Now S1S_1 satisfies both equations: S1T=IS_1 T = I by hypothesis, and TS1=TS2=IT S_1 = T S_2 = I. Since S1โˆˆL(W,V)S_1 \in \mathcal{L}(W, V), it is an inverse of TT, so TT is invertible and Tโˆ’1=S1=S2T^{-1} = S_1 = S_2.

Compare Visualization 1: there T(t)=(2t,t)T(t) = (2t, t) had several maps SS with ST=IST = I, which is possible only because no map satisfies TS=ITS = I (TT is not surjective).

Solved: 0 / 4