Linear-Algebra-Done-Right ยท Unit 3 ยท Video 2 ยท Interactive Practice

Linear Independence and the Linear Dependence Lemma

IKey Formulas

FormulaNameMeaning
a1v1+โ‹ฏ+amvm=0โ€…โ€ŠโŸนโ€…โ€Ša1=โ‹ฏ=am=0a_1v_1 + \cdots + a_mv_m = 0 \implies a_1 = \cdots = a_m = 0Linearly independentEquivalently, each vector in spanโก(v1,โ€ฆ,vm)\operatorname{span}(v_1, \dots, v_m) has only one representation; the empty list (โ€‰)(\,) is independent
a1v1+โ‹ฏ+amvm=0a_1v_1 + \cdots + a_mv_m = 0 with some akโ‰ 0a_k \neq 0Linearly dependentFor example 2(2,3,1)+3(1,โˆ’1,2)โˆ’(7,3,8)=02(2, 3, 1) + 3(1, -1, 2) - (7, 3, 8) = 0; any list containing 00 is dependent
vkโˆˆspanโก(v1,โ€ฆ,vkโˆ’1)v_k \in \operatorname{span}(v_1, \dots, v_{k-1})Linear dependence lemmaSome kโˆˆ{1,โ€ฆ,m}k \in \{1, \dots, m\} satisfies this when the list is dependent: take the largest kk with akโ‰ 0a_k \neq 0
spanโก(v1,โ€ฆ,vkโˆ’1,vk+1,โ€ฆ,vm)=spanโก(v1,โ€ฆ,vm)\operatorname{span}(v_1, \dots, v_{k-1}, v_{k+1}, \dots, v_m) = \operatorname{span}(v_1, \dots, v_m)Removal stepHolds for every kk with vkโˆˆspanโก(v1,โ€ฆ,vkโˆ’1)v_k \in \operatorname{span}(v_1, \dots, v_{k-1})

Key Insight: Subtracting two representations v=โˆ‘akvk=โˆ‘ckvkv = \sum a_kv_k = \sum c_kv_k gives 0=โˆ‘(akโˆ’ck)vk0 = \sum (a_k - c_k)v_k, so uniqueness of the representation of 00 forces uniqueness for every vector in the span.

IIUnique Coefficients in R2\mathbf{R}^2

For an independent list v1,v2v_1, v_2, each vv in the span has exactly one pair a1,a2a_1, a_2; a dependent list gives many.

IIIThe Linear Dependence Lemma, One kk at a Time

Testing k=1,2,โ€ฆk = 1, 2, \dots in turn finds the smallest kk with vkโˆˆspanโก(v1,โ€ฆ,vkโˆ’1)v_k \in \operatorname{span}(v_1, \dots, v_{k-1}).

๐Ÿ’ก Challenge: in the list (2,3,1),(1,โˆ’1,2),(7,3,c)(2, 3, 1), (1, -1, 2), (7, 3, c), find every value of cc that makes the list dependent, then predict the coefficients of v3v_3 before changing cc.

IVQuiz Questions

Problem 1 ยท Two Representations

Given: vectors v1,v2,v3โˆˆVv_1, v_2, v_3 \in V and a vector vv with v=v1+2v2+v3v = v_1 + 2v_2 + v_3 and also v=3v1+v2v = 3v_1 + v_2. Which combination equal to 00 with scalars not all zero does this produce?

โœ… Correct! Subtracting the two representations gives (1โˆ’3)v1+(2โˆ’1)v2+(1โˆ’0)v3=0(1 - 3)v_1 + (2 - 1)v_2 + (1 - 0)v_3 = 0, and the scalar โˆ’2-2 is not zero, so the list is dependent.
โŒ Not quite. Adding the two equations gives 2v2v on the left, not 00. Subtract them instead: the left side becomes vโˆ’v=0v - v = 0.
โŒ Close, but check the sign. The coefficient of v1v_1 is 1โˆ’3=โˆ’21 - 3 = -2, not 22.
โŒ Not quite. The two choices of scalars differ (1โ‰ 31 \neq 3), so representations are not unique, and a list with non-unique representations is linearly dependent.
Show solution

Subtract the second equation from the first:

0=vโˆ’v=(v1+2v2+v3)โˆ’(3v1+v2+0v3)=(1โˆ’3)v1+(2โˆ’1)v2+(1โˆ’0)v3.0 = v - v = (v_1 + 2v_2 + v_3) - (3v_1 + v_2 + 0v_3) = (1 - 3)v_1 + (2 - 1)v_2 + (1 - 0)v_3.

So โˆ’2v1+v2+v3=0-2v_1 + v_2 + v_3 = 0 with scalars โˆ’2,1,1-2, 1, 1, not all zero. The list v1,v2,v3v_1, v_2, v_3 is therefore linearly dependent: an independent list gives each vector in its span only one representation. (Multiplying by โˆ’1-1 gives the equally valid relation 2v1โˆ’v2โˆ’v3=02v_1 - v_2 - v_3 = 0.)

Problem 2 ยท Which Statement Is True?

Exactly one of these statements holds for every vector space VV. Which one?

โœ… Correct! 1v1+0v2+(โˆ’1)v1=01v_1 + 0v_2 + (-1)v_1 = 0 has the nonzero scalar 11, whatever v1v_1 and v2v_2 are.
โŒ Not quite. A list of length one is independent exactly when its vector is nonzero: 1โ‹…0=01 \cdot 0 = 0 uses the nonzero scalar 11.
โŒ Not quite. The pairwise test works only for lists of length two. In F3\mathbf{F}^3, no vector in (2,3,1),(1,โˆ’1,2),(7,3,8)(2, 3, 1), (1, -1, 2), (7, 3, 8) is a multiple of another, yet 2(2,3,1)+3(1,โˆ’1,2)โˆ’(7,3,8)=02(2, 3, 1) + 3(1, -1, 2) - (7, 3, 8) = 0.
โŒ Not quite. The true fact runs the other way: removing vectors from an independent list keeps it independent. Removing (7,3,8)(7, 3, 8) from the dependent list (2,3,1),(1,โˆ’1,2),(7,3,8)(2, 3, 1), (1, -1, 2), (7, 3, 8) leaves an independent list.
Show solution

(c) is true. The combination 1v1+0v2+(โˆ’1)v11v_1 + 0v_2 + (-1)v_1 equals 00 and its first scalar is 1โ‰ 01 \neq 0, so v1,v2,v1v_1, v_2, v_1 is dependent. Equivalently, the third vector v1v_1 is a linear combination of the others.

(a) is false: 1โ‹…0=01 \cdot 0 = 0 with scalar 1โ‰ 01 \neq 0; every list containing 00 is dependent.

(b) is false: no two of (2,3,1),(1,โˆ’1,2),(7,3,8)(2, 3, 1), (1, -1, 2), (7, 3, 8) are multiples of each other (compare first coordinates and then second coordinates), yet 2(2,3,1)+3(1,โˆ’1,2)โˆ’(7,3,8)=(0,0,0)2(2, 3, 1) + 3(1, -1, 2) - (7, 3, 8) = (0, 0, 0).

(d) is false: the same dependent list loses its dependence when (7,3,8)(7, 3, 8) is removed, since (2,3,1)(2, 3, 1) and (1,โˆ’1,2)(1, -1, 2) are not multiples of each other.

Problem 3 ยท When Is the List Dependent?

Given: the list (1,1,2),(1,โˆ’1,0),(3,1,c)(1, 1, 2), (1, -1, 0), (3, 1, c) in R3\mathbf{R}^3. Find the value of cc for which the list is linearly dependent.

โœ… Correct! (3,1,4)=2(1,1,2)+1(1,โˆ’1,0)(3, 1, 4) = 2(1, 1, 2) + 1(1, -1, 0), so 2(1,1,2)+(1,โˆ’1,0)โˆ’(3,1,4)=02(1, 1, 2) + (1, -1, 0) - (3, 1, 4) = 0.
โŒ Close, butโ€ฆ the scalars are swapped. From x+y=3x + y = 3 and xโˆ’y=1x - y = 1, the scalar on (1,1,2)(1, 1, 2) is x=2x = 2 and the scalar on (1,โˆ’1,0)(1, -1, 0) is y=1y = 1.
โŒ Not quite. The first coordinate alone does not fix the scalars: x+y=3x + y = 3 must be solved together with xโˆ’y=1x - y = 1.
โŒ Not quite. Write (3,1,c)=x(1,1,2)+y(1,โˆ’1,0)(3, 1, c) = x(1, 1, 2) + y(1, -1, 0), solve the first two coordinates for xx and yy, then read off the third.
Show solution

Suppose a1(1,1,2)+a2(1,โˆ’1,0)+a3(3,1,c)=0a_1(1, 1, 2) + a_2(1, -1, 0) + a_3(3, 1, c) = 0 with a1,a2,a3a_1, a_2, a_3 not all zero.

If a3=0a_3 = 0, the first two coordinates give a1+a2=0a_1 + a_2 = 0 and a1โˆ’a2=0a_1 - a_2 = 0; adding gives 2a1=02a_1 = 0, so a1=a2=0a_1 = a_2 = 0, a contradiction. So a3โ‰ 0a_3 \neq 0, and dividing by it writes (3,1,c)=x(1,1,2)+y(1,โˆ’1,0)(3, 1, c) = x(1, 1, 2) + y(1, -1, 0).

x+y=3,xโˆ’y=1โ€…โ€ŠโŸนโ€…โ€Š2x=4โ€…โ€ŠโŸนโ€…โ€Šx=2,ย y=1.x + y = 3, \qquad x - y = 1 \implies 2x = 4 \implies x = 2,\ y = 1.

The third coordinate is then c=2x+0y=4c = 2x + 0y = 4. Conversely, for c=4c = 4:

2(1,1,2)+1(1,โˆ’1,0)โˆ’(3,1,4)=(2+1โˆ’3,ย 2โˆ’1โˆ’1,ย 4+0โˆ’4)=(0,0,0).2(1, 1, 2) + 1(1, -1, 0) - (3, 1, 4) = (2 + 1 - 3,\ 2 - 1 - 1,\ 4 + 0 - 4) = (0, 0, 0).

So the list is dependent exactly when c=4c = 4.

Problem 4 ยท The Lemma in P(R)\mathcal{P}(\mathbf{R})

Given: the dependent list 1+z,ย 1โˆ’z,ย z,ย z21 + z,\ 1 - z,\ z,\ z^2 in P(R)\mathcal{P}(\mathbf{R}). Find the smallest kk with vkโˆˆspanโก(v1,โ€ฆ,vkโˆ’1)v_k \in \operatorname{span}(v_1, \dots, v_{k-1}), and write that vkv_k as a combination of the earlier vectors.

What is the smallest k?

How is that vector a combination of the earlier ones?

โœ… Correct! k=3k = 3 is the smallest index that works, and removing zz leaves spanโก(1+z,1โˆ’z,z2)=spanโก(1+z,1โˆ’z,z,z2)\operatorname{span}(1 + z, 1 - z, z^2) = \operatorname{span}(1 + z, 1 - z, z, z^2).
โŒ Check your k. k=1k = 1 needs 1+z=01 + z = 0, which fails since 1+z1 + z is not the zero polynomial.
โŒ Not quite. 1โˆ’z=a(1+z)1 - z = a(1 + z) would need a=1a = 1 from the constant terms and a=โˆ’1a = -1 from the zz terms.
โŒ Not quite. Every combination of 1+z,1โˆ’z,z1 + z, 1 - z, z has degree at most 11, so z2z^2 is not in their span; a smaller kk works.
โŒ Check the combination. Expand the right side: it must equal zz, with constant term 00 and zz-coefficient 11.
โŒ Close, butโ€ฆ (1+z)โˆ’(1โˆ’z)=2z(1 + z) - (1 - z) = 2z, not zz: divide both scalars by 22.
Show solution

k=1k = 1: 1+zโ‰ 01 + z \neq 0, so v1โˆ‰spanโก(โ€‰)={0}v_1 \notin \operatorname{span}(\,) = \{0\}.

k=2k = 2: if 1โˆ’z=a(1+z)1 - z = a(1 + z), comparing constant terms gives a=1a = 1 and comparing zz-coefficients gives a=โˆ’1a = -1, a contradiction.

k=3k = 3: solve z=a(1+z)+b(1โˆ’z)=(a+b)+(aโˆ’b)zz = a(1 + z) + b(1 - z) = (a + b) + (a - b)z:

a+b=0,aโˆ’b=1โ€…โ€ŠโŸนโ€…โ€Ša=12,ย b=โˆ’12.a + b = 0, \qquad a - b = 1 \implies a = \tfrac{1}{2},\ b = -\tfrac{1}{2}.

So z=12(1+z)โˆ’12(1โˆ’z)z = \tfrac{1}{2}(1 + z) - \tfrac{1}{2}(1 - z), and the smallest kk is 33. Check: 12+12zโˆ’12+12z=z\tfrac{1}{2} + \tfrac{1}{2}z - \tfrac{1}{2} + \tfrac{1}{2}z = z. By the second part of the lemma, removing zz leaves the span unchanged.

The other options expand to 2z2z, to 11, and to โˆ’z-z.

Solved: 0 / 4