Linear-Algebra-Done-Right ยท Unit 4 ยท Video 1 ยท Interactive Practice

Bases: Reduce a Spanning List, Extend an Independent List

IKey Formulas

FormulaNameWhat it says
v1,โ€ฆ,vnv_1, \dots, v_n linearly independent and spanโก(v1,โ€ฆ,vn)=V\operatorname{span}(v_1, \dots, v_n) = VBasis of VVThe standard basis of Fn\mathbf{F}^n, the list (1,2),(3,5)(1, 2), (3, 5) of F2\mathbf{F}^2, and 1,z,โ€ฆ,zm1, z, \dots, z^m of Pm(F)\mathcal{P}_m(\mathbf{F}) are bases
v=a1v1+โ‹ฏ+anvnv = a_1 v_1 + \cdots + a_n v_n for exactly one choice of a1,โ€ฆ,anโˆˆFa_1, \dots, a_n \in \mathbf{F}Criterion for a basisBasis โ€…โ€ŠโŸบโ€…โ€Š\iff every vโˆˆVv \in V has exactly one representation; for (1,2),(3,5)(1, 2), (3, 5): a=โˆ’5x+3ya = -5x + 3y, b=2xโˆ’yb = 2x - y
Step kk: delete vkv_k if vkโˆˆspanโก(v1,โ€ฆ,vkโˆ’1)v_k \in \operatorname{span}(v_1, \dots, v_{k-1})Reduce a spanning listWhat survives is a basis, so every finite-dimensional vector space has a basis
Reduce u1,โ€ฆ,um,w1,โ€ฆ,wnu_1, \dots, u_m, w_1, \dots, w_n; ย W=spanโก(keptย wโ€™s)\ W = \operatorname{span}(\text{kept } w\text{'s})Extend an independent listNo uku_k is deleted, and V=UโŠ•WV = U \oplus W for U=spanโก(u1,โ€ฆ,um)U = \operatorname{span}(u_1, \dots, u_m)

Key Insight: One deletion procedure does both jobs: run on a spanning list it cuts down to a basis, and run on u1,โ€ฆ,umu_1, \dots, u_m followed by a spanning list it builds u1,โ€ฆ,umu_1, \dots, u_m up to a basis.

IIVisualization 1 โ€” Reducing a Spanning List

Step kk deletes vkv_k exactly when vkโˆˆspanโก(v1,โ€ฆ,vkโˆ’1)v_k \in \operatorname{span}(v_1, \dots, v_{k-1}); the surviving list BB is a basis of the span.

IIIVisualization 2 โ€” Extending an Independent List

Reducing u1,โ€ฆ,um,w1,w2,w3u_1, \dots, u_m, w_1, w_2, w_3 keeps every uku_k and only the ww's needed to reach all of F3\mathbf{F}^3.

IVVisualization 3 โ€” Complements Are Not Unique

Every line WW through 00 other than the xx-axis UU is a complement of UU: each vv splits uniquely as u+wu + w.

VQuiz Questions

Problem 1 ยท Run the Reduction Procedure

Given: the list (0,0)(0, 0), (2,โˆ’1)(2, -1), (โˆ’4,2)(-4, 2), (1,3)(1, 3), (5,1)(5, 1) spans F2\mathbf{F}^2 โ€” find the list BB that the reduction procedure returns.

โœ… Correct! The procedure deletes (0,0)(0, 0), (โˆ’4,2)=โˆ’2(2,โˆ’1)(-4, 2) = -2(2, -1) and (5,1)=2(2,โˆ’1)+(1,3)(5, 1) = 2(2, -1) + (1, 3), leaving the basis (2,โˆ’1),(1,3)(2, -1), (1, 3).
โŒ Step 1 deletes the zero vector. At step 1 the test is against spanโก(โ€‰)={0}\operatorname{span}(\,) = \{0\}, and (0,0)โˆˆ{0}(0, 0) \in \{0\}; a list containing 00 is never linearly independent.
โŒ Step 5 also deletes. By step 5 the kept vectors (2,โˆ’1),(1,3)(2, -1), (1, 3) already reach (5,1)=2(2,โˆ’1)+(1,3)(5, 1) = 2(2, -1) + (1, 3), so (5,1)(5, 1) lies in the span of the earlier vectors.
โŒ The test looks backwards, not forwards. (2,โˆ’1)(2, -1) is tested only against (0,0)(0, 0) and is kept; it is the later vector (โˆ’4,2)=โˆ’2(2,โˆ’1)(-4, 2) = -2(2, -1) that lies in the span of the vectors before it.
Show solution

Write v1,โ€ฆ,v5v_1, \dots, v_5 for the list and test each vkv_k against spanโก(v1,โ€ฆ,vkโˆ’1)\operatorname{span}(v_1, \dots, v_{k-1}).

  • Step 1: spanโก(โ€‰)={0}\operatorname{span}(\,) = \{0\} and v1=(0,0)v_1 = (0, 0), so v1v_1 is deleted.
  • Step 2: spanโก(v1)={0}\operatorname{span}(v_1) = \{0\} and (2,โˆ’1)โ‰ 0(2, -1) \neq 0, so v2v_2 is kept.
  • Step 3: spanโก(v1,v2)={c(2,โˆ’1):cโˆˆF}\operatorname{span}(v_1, v_2) = \{c(2, -1) : c \in \mathbf{F}\} and (โˆ’4,2)=โˆ’2(2,โˆ’1)(-4, 2) = -2(2, -1), so v3v_3 is deleted.
  • Step 4: (1,3)(1, 3) is not a multiple of (2,โˆ’1)(2, -1) (a multiple c(2,โˆ’1)c(2, -1) with first coordinate 11 is (1,โˆ’12)(1, -\tfrac{1}{2})), so v4v_4 is kept.
  • Step 5: solving a(2,โˆ’1)+b(1,3)=(5,1)a(2, -1) + b(1, 3) = (5, 1) gives 2a+b=52a + b = 5, โˆ’a+3b=1-a + 3b = 1, so a=2a = 2, b=1b = 1; thus v5โˆˆspanโก(v1,โ€ฆ,v4)v_5 \in \operatorname{span}(v_1, \dots, v_4) is deleted.

So B=(2,โˆ’1),(1,3)B = (2, -1), (1, 3). It spans F2\mathbf{F}^2 because the procedure never changes the span (each (x,y)=3xโˆ’y7(2,โˆ’1)+x+2y7(1,3)(x, y) = \tfrac{3x - y}{7}(2, -1) + \tfrac{x + 2y}{7}(1, 3)), and it is linearly independent because neither vector is a scalar multiple of the other. Hence BB is a basis of F2\mathbf{F}^2.

Problem 2 ยท Three Vectors, No Multiples

Given: the list (1,0,1)(1, 0, 1), (0,1,1)(0, 1, 1), (1,1,2)(1, 1, 2) in F3\mathbf{F}^3, in which no vector is a scalar multiple of another โ€” which statement is true?

โœ… Correct! (1,1,2)=(1,0,1)+(0,1,1)(1, 1, 2) = (1, 0, 1) + (0, 1, 1), so the list is dependent, and its span equals the span of a list of length 22, too short to span F3\mathbf{F}^3.
โŒ The scalar-multiple test only works for two vectors. With three vectors, one can be a combination of the other two: (1,1,2)=(1,0,1)+(0,1,1)(1, 1, 2) = (1, 0, 1) + (0, 1, 1).
โŒ The list is linearly dependent. 1โ‹…(1,0,1)+1โ‹…(0,1,1)โˆ’1โ‹…(1,1,2)=01 \cdot (1, 0, 1) + 1 \cdot (0, 1, 1) - 1 \cdot (1, 1, 2) = 0 is a combination equal to 00 with nonzero scalars.
โŒ This list does not span F3\mathbf{F}^3. Deleting (1,1,2)(1, 1, 2) leaves the span unchanged, so the span equals spanโก((1,0,1),(0,1,1))\operatorname{span}((1, 0, 1), (0, 1, 1)); a list of length 22 cannot span F3\mathbf{F}^3, because the standard basis is a linearly independent list of length 33.
Show solution

Dependent. Run the reduction test: (1,1,2)โˆˆspanโก((1,0,1),(0,1,1))(1, 1, 2) \in \operatorname{span}((1, 0, 1), (0, 1, 1)) since (1,1,2)=(1,0,1)+(0,1,1)(1, 1, 2) = (1, 0, 1) + (0, 1, 1). Hence (1,0,1)+(0,1,1)โˆ’(1,1,2)=0(1, 0, 1) + (0, 1, 1) - (1, 1, 2) = 0, a combination equal to 00 whose scalars are not all 00.

Not spanning. By the linear dependence lemma, removing (1,1,2)(1, 1, 2) does not change the span, so the span of the list equals spanโก((1,0,1),(0,1,1))\operatorname{span}((1, 0, 1), (0, 1, 1)). The standard basis of F3\mathbf{F}^3 is linearly independent of length 33, so every list spanning F3\mathbf{F}^3 has length at least 33; a list of length 22 does not span F3\mathbf{F}^3. For instance (1,0,0)(1, 0, 0) is missed: a(1,0,1)+b(0,1,1)=(1,0,0)a(1, 0, 1) + b(0, 1, 1) = (1, 0, 0) forces a=1a = 1, b=0b = 0 and then third coordinate 1โ‰ 01 \neq 0.

The test "no vector is a multiple of another" decides independence only for lists of length two.

Problem 3 ยท The Complement the Proof Builds

Given: U={(x,y,z)โˆˆF3:x+y+z=0}U = \{(x, y, z) \in \mathbf{F}^3 : x + y + z = 0\} with basis u1=(1,โˆ’1,0)u_1 = (1, -1, 0), u2=(1,0,โˆ’1)u_2 = (1, 0, -1), and the spanning list w1=(1,1,โˆ’2)w_1 = (1, 1, -2), w2=(0,1,0)w_2 = (0, 1, 0), w3=(1,0,0)w_3 = (1, 0, 0) of F3\mathbf{F}^3 โ€” find the complement WW produced by reducing u1,u2,w1,w2,w3u_1, u_2, w_1, w_2, w_3.

โœ… Correct! w1=โˆ’u1+2u2w_1 = -u_1 + 2u_2 and w3=u1+w2w_3 = u_1 + w_2 are deleted; only w2w_2 survives, so W=spanโก((0,1,0))W = \operatorname{span}((0, 1, 0)).
โŒ w1w_1 is in UU. It is not a multiple of u1u_1 or of u2u_2, but its coordinates sum to 00: w1=โˆ’(1,โˆ’1,0)+2(1,0,โˆ’1)w_1 = -(1, -1, 0) + 2(1, 0, -1), so step 3 deletes it.
โŒ The procedure keeps the first ww that leaves the span. w2=(0,1,0)w_2 = (0, 1, 0) is tested before w3w_3 and is kept; then w3=(1,0,0)=u1+w2w_3 = (1, 0, 0) = u_1 + w_2 is deleted.
โŒ w3w_3 is already reached. Once w2w_2 is kept, w3=(1,0,0)=(1,โˆ’1,0)+(0,1,0)=u1+w2w_3 = (1, 0, 0) = (1, -1, 0) + (0, 1, 0) = u_1 + w_2 lies in the span of the earlier vectors, so step 5 deletes it.
Show solution

Steps 1 and 2 keep u1,u2u_1, u_2, since u1,u2u_1, u_2 is linearly independent.

Step 3. au1+bu2=(a+b,โˆ’a,โˆ’b)a u_1 + b u_2 = (a + b, -a, -b). Matching (1,1,โˆ’2)(1, 1, -2) gives a=โˆ’1a = -1, b=2b = 2, and indeed a+b=1a + b = 1. So w1=โˆ’u1+2u2w_1 = -u_1 + 2u_2 is deleted.

Step 4. u1,u2,w1u_1, u_2, w_1 all lie in the subspace UU, so their span is contained in UU. The coordinates of w2=(0,1,0)w_2 = (0, 1, 0) sum to 1โ‰ 01 \neq 0, so w2โˆ‰Uw_2 \notin U and w2w_2 is kept.

Step 5. u1+w2=(1,โˆ’1,0)+(0,1,0)=(1,0,0)=w3u_1 + w_2 = (1, -1, 0) + (0, 1, 0) = (1, 0, 0) = w_3, so w3w_3 is deleted.

The basis of F3\mathbf{F}^3 is u1,u2,w2u_1, u_2, w_2, and the proof sets W=spanโก(w2)=spanโก((0,1,0))W = \operatorname{span}(w_2) = \operatorname{span}((0, 1, 0)), giving F3=UโŠ•W\mathbf{F}^3 = U \oplus W.

Problem 4 ยท Two Representations

Given: v1,v2,v3v_1, v_2, v_3 spans VV, and some vโˆˆVv \in V satisfies v=a1v1+a2v2+a3v3=c1v1+c2v2+c3v3v = a_1 v_1 + a_2 v_2 + a_3 v_3 = c_1 v_1 + c_2 v_2 + c_3 v_3 with (a1,a2,a3)โ‰ (c1,c2,c3)(a_1, a_2, a_3) \neq (c_1, c_2, c_3) โ€” which conclusion is correct?

โœ… Correct! Subtracting gives a combination equal to 00 with scalars akโˆ’cka_k - c_k not all 00; adding it to any representation of any uu produces a second one.
โŒ The extra freedom transfers to every vector. If u=d1v1+d2v2+d3v3u = d_1 v_1 + d_2 v_2 + d_3 v_3, then also u=(d1+a1โˆ’c1)v1+(d2+a2โˆ’c2)v2+(d3+a3โˆ’c3)v3u = (d_1 + a_1 - c_1) v_1 + (d_2 + a_2 - c_2) v_2 + (d_3 + a_3 - c_3) v_3, a different list of scalars.
โŒ The criterion rules this out. A list is a basis exactly when every vector has only one representation; vv has two, so the list is not a basis.
โŒ Spanning is about existence. The list spans VV by hypothesis; two representations say that uniqueness, hence linear independence, fails.
Show solution

Subtracting the two representations of vv gives

0=(a1โˆ’c1)v1+(a2โˆ’c2)v2+(a3โˆ’c3)v3,0 = (a_1 - c_1) v_1 + (a_2 - c_2) v_2 + (a_3 - c_3) v_3,

and some akโˆ’ckโ‰ 0a_k - c_k \neq 0, so v1,v2,v3v_1, v_2, v_3 is linearly dependent (and not a basis, by the criterion).

Now take any uโˆˆVu \in V. The list spans VV, so u=d1v1+d2v2+d3v3u = d_1 v_1 + d_2 v_2 + d_3 v_3 for some scalars. Adding the displayed combination (which is 00) gives

u=(d1+a1โˆ’c1)v1+(d2+a2โˆ’c2)v2+(d3+a3โˆ’c3)v3,u = (d_1 + a_1 - c_1) v_1 + (d_2 + a_2 - c_2) v_2 + (d_3 + a_3 - c_3) v_3,

whose scalars differ from d1,d2,d3d_1, d_2, d_3 in slot kk. So every vector of VV has at least two representations. Example in F2\mathbf{F}^2 with (1,0),(0,1),(1,1)(1, 0), (0, 1), (1, 1): (1,1)=1โ‹…(1,1)=1โ‹…(1,0)+1โ‹…(0,1)(1, 1) = 1 \cdot (1, 1) = 1 \cdot (1, 0) + 1 \cdot (0, 1), and then every (x,y)=x(1,0)+y(0,1)=(xโˆ’1)(1,0)+(yโˆ’1)(0,1)+1โ‹…(1,1)(x, y) = x(1, 0) + y(0, 1) = (x - 1)(1, 0) + (y - 1)(0, 1) + 1 \cdot (1, 1).

Solved: 0 / 4