LINEAR-ALGEBRA ยท Unit 10 ยท Video 2 ยท Interactive Practice

One Row Reduction, Four Bases

IKey Formulas

Subspace Basis Source Dimension Lives in
Column Space C(A)C(A) Pivot columns of A (original!) rr Rm\mathbb{R}^m
Null Space N(A)N(A) Special solutions from R nโˆ’rn - r Rn\mathbb{R}^n
Row Space C(AT)C(A^T) Nonzero rows of R rr Rn\mathbb{R}^n
Left Null Space N(AT)N(A^T) Zero-row(s) of E (where EA=REA = R) mโˆ’rm - r Rm\mathbb{R}^m

Dimension Theorem: r+(nโˆ’r)=nr + (n - r) = n and r+(mโˆ’r)=mr + (m - r) = m

IIVisualization 1 โ€” Row Reduction, Step by Step

Reduce AA to its RREF one operation at a time โ€” where do the pivots land, and which columns stay free?

pivot free column zero row

๐Ÿ’ก Rows 1 and 3 of AA are identical, so one row collapses to zero: the rank is r=2r = 2, with pivots in columns 1โ€“2 and columns 3โ€“4 free.

IIIVisualization 2 โ€” Column Space Lives in AA, Not RR

Combinations of AA's pivot columns can reach (1,1,1)(1,1,1) โ€” can any combination of RR's columns do the same?

pivot columns of A

columns of R

๐Ÿ’ก Every column of RR has a zero third entry, so no combination can reach (1,1,1)(1,1,1). Row reduction preserves the row space but changes the column space โ€” which is why a basis for C(A)C(A) must be read off AA.

IVVisualization 3 โ€” Four Bases from One Reduction

Reducing AA to RR (and recording EE) hands you a basis for each fundamental subspace โ€” which part of AA, RR, or EE supplies which?

basis for the selected subspace

๐Ÿ’ก The rank r=2r = 2 fixes every dimension: r+(nโˆ’r)=nr + (n - r) = n and r+(mโˆ’r)=mr + (m - r) = m, so the four subspaces balance in two pairs.

VSummary: All Four Bases from One Computation

For A=[123111211231]A = \begin{bmatrix} 1 & 2 & 3 & 1 \\ 1 & 1 & 2 & 1 \\ 1 & 2 & 3 & 1 \end{bmatrix}, R=[101101100000]R = \begin{bmatrix} 1 & 0 & 1 & 1 \\ 0 & 1 & 1 & 0 \\ 0 & 0 & 0 & 0 \end{bmatrix}, E=[โˆ’1201โˆ’10โˆ’101]E = \begin{bmatrix} -1 & 2 & 0 \\ 1 & -1 & 0 \\ -1 & 0 & 1 \end{bmatrix} with rank r=2r = 2:

Subspace Basis Dim Source
Column Space C(A)C(A) {(1,1,1),โ€…โ€Š(2,1,2)}\{(1,1,1),\; (2,1,2)\} r=2r = 2 Pivot columns of A
Null Space N(A)N(A) {(โˆ’1,โˆ’1,1,0),โ€…โ€Š(โˆ’1,0,0,1)}\{(-1,-1,1,0),\; (-1,0,0,1)\} nโˆ’r=2n - r = 2 Special solutions from R
Row Space C(AT)C(A^T) {(1,0,1,1),โ€…โ€Š(0,1,1,0)}\{(1,0,1,1),\; (0,1,1,0)\} r=2r = 2 Nonzero rows of R
Left Null Space N(AT)N(A^T) {(โˆ’1,0,1)}\{(-1,0,1)\} mโˆ’r=1m - r = 1 Zero-row of E

Dimension check: 2+2=4=n2 + 2 = 4 = n โœ“ and 2+1=3=m2 + 1 = 3 = m โœ“

VIQuiz Questions

Question 1

When extracting the column space basis after row reduction, you identify the pivot column positions from RR. From which matrix do you then take the actual basis vectors?

โœ… Correct! R tells you which columns are pivot columns, but A provides the actual basis vectors.

โŒ Not quite. Row operations change the column space, so the vectors in R's columns differ from A's columns.

Show solution

Solution:

The column space basis must come from the original matrix A.

Row reduction tells us which columns are pivot columns (their positions), but the actual basis vectors must be taken from AA, not RR.

Why? Row operations change the column space. For example:

  • Column 1 of AA: (1,1,1)(1, 1, 1) โ€” clearly in C(A)C(A)
  • Column 1 of RR: (1,0,0)(1, 0, 0) โ€” a completely different vector

Every column of RR has 00 in the third entry, so no combination of RR's columns can produce (1,1,1)(1, 1, 1). Thus C(A)โ‰ C(R)C(A) \neq C(R).

Rule: RR identifies the positions; AA provides the vectors.

Question 2

For the 3ร—43 \times 4 matrix AA from the video with rank r=2r = 2, what is the dimension of the null space N(A)N(A)?

โœ… Correct! dim N(A) = n - r = 4 - 2 = 2. One special solution per free variable.

โŒ Not quite. Remember: null space dimension = n - r, where n is the number of columns (not rows).

Show solution

Solution:

The null space dimension formula is:

dimโกN(A)=nโˆ’r\dim N(A) = n - r

where nn is the number of columns and rr is the rank:

dimโกN(A)=4โˆ’2=2\dim N(A) = 4 - 2 = 2

The two basis vectors (special solutions) come from setting each free variable to 1 in turn:

  • x3=1,โ€‰x4=0x_3 = 1,\, x_4 = 0: back-substitute to get s1=(โˆ’1,โˆ’1,1,0)\mathbf{s}_1 = (-1, -1, 1, 0)
  • x3=0,โ€‰x4=1x_3 = 0,\, x_4 = 1: back-substitute to get s2=(โˆ’1,0,0,1)\mathbf{s}_2 = (-1, 0, 0, 1)

Each free column contributes exactly one special solution.

Question 3

True or False: Row operations preserve the row space of a matrix. That is, AA and its reduced row echelon form RR have the same row space.

โœ… Correct! Row operations are reversible linear combinations of rows, so the row space stays the same.

โŒ Not quite. Think about what each row operation does: it replaces a row with a linear combination of existing rows. And E is invertible, so the process is reversible.

Show solution

Solution: True

Row operations preserve the row space because:

  1. Each row operation replaces a row with a linear combination of existing rows, so new rows stay in the span of old rows.
  2. The elimination matrix EE is invertible (EA=REA = R, A=Eโˆ’1RA = E^{-1}R), so the process is reversible โ€” old rows can be recovered from new ones.

Since each set of rows lies in the span of the other, the row spaces are identical: C(AT)=C(RT)C(A^T) = C(R^T).

Important contrast: Row operations do not preserve the column space! This asymmetry is why we read the row space basis from RR (nonzero rows) but the column space basis from AA (pivot columns of the original).

Question 4

The elimination matrix for our example is E=[โˆ’1201โˆ’10โˆ’101]E = \begin{bmatrix} -1 & 2 & 0 \\ 1 & -1 & 0 \\ -1 & 0 & 1 \end{bmatrix}, where EA=REA = R. Which vector forms a basis for the left null space N(AT)N(A^T), and why?

โœ… Correct! The zero row of R points to the corresponding row of E, which gives the left null space basis vector.

โŒ Not quite. Which row of R is the zero row? The matching row of E is the left null space basis vector, because (that row of E) times A equals the zero row.

Show solution

Solution:

The left null space basis comes from the rows of EE that correspond to zero rows in RR.

Since EA=REA = R, each row of EE times AA gives the corresponding row of RR:

  • Row 1 of EE times AA = row 1 of RR = (1,0,1,1)โ‰ 0(1, 0, 1, 1) \neq \mathbf{0}
  • Row 2 of EE times AA = row 2 of RR = (0,1,1,0)โ‰ 0(0, 1, 1, 0) \neq \mathbf{0}
  • Row 3 of EE times AA = row 3 of RR = (0,0,0,0)=0(0, 0, 0, 0) = \mathbf{0} โœ“

So row 3 of EE, which is (โˆ’1,0,1)(-1, 0, 1), satisfies (โˆ’1,0,1)โ‹…A=0T(-1, 0, 1) \cdot A = \mathbf{0}^T.

Verification: (โˆ’1)[1231]+(0)[1121]+(1)[1231]=[0000](-1)\begin{bmatrix}1 & 2 & 3 & 1\end{bmatrix} + (0)\begin{bmatrix}1 & 1 & 2 & 1\end{bmatrix} + (1)\begin{bmatrix}1 & 2 & 3 & 1\end{bmatrix} = \begin{bmatrix}0 & 0 & 0 & 0\end{bmatrix}

Rows 1 and 3 of AA are identical, so their difference vanishes. The left null space has dimension mโˆ’r=3โˆ’2=1m - r = 3 - 2 = 1.

Solved: 0 / 4