Linear-Algebra-Done-Right Β· Unit 3 Β· Video 3 Β· Interactive Practice

Independent Lists Are No Longer Than Spanning Lists

IKey Formulas

StatementNameRole
u1,…,umu_1, \dots, u_m independent, w1,…,wnw_1, \dots, w_n spans VV β€…β€Šβ‡’β€…β€Šm≀n\;\Rightarrow\; m \leq nLength inequalityHolds in every finite-dimensional VV
v1,…,vmv_1, \dots, v_m dependent β‡’\Rightarrow some vk∈span⁑(v1,…,vkβˆ’1)v_k \in \operatorname{span}(v_1, \dots, v_{k-1}), and removing vkv_k keeps the spanLinear dependence lemmaChooses the ww removed at each step
B=u1,…,uk,Β thenΒ theΒ nβˆ’kΒ remainingΒ w’sB = u_1, \dots, u_k, \text{ then the } n - k \text{ remaining } w\text{'s}List after step kkSpans VV and has length nn
VV finite-dimensional, UU a subspace of VV β‡’\Rightarrow UU finite-dimensionalSubspacesProved with the length inequality

Key Insight: The lemma can never land on a uu: the uu's come first, and uk∈span⁑(u1,…,ukβˆ’1)u_k \in \operatorname{span}(u_1, \dots, u_{k-1}) would contradict their independence. So every one of the mm steps removes a different ww, and there must be at least mm of them.

IIThe Exchange, One Vector at a Time

Each step inserts one uu and removes one ww found by the lemma, so BB keeps spanning with length nn.

IIIDecided by Length Alone

Comparing a list's length with nn can rule out independence or spanning in Rn\mathbf{R}^n, but never establishes either.

IVSubspaces Are Finite-Dimensional

Choosing each uk∈Uu_k \in U outside span⁑(u1,…,ukβˆ’1)\operatorname{span}(u_1, \dots, u_{k-1}) builds an independent list, so the construction stops within nn choices.

VQuiz Questions

Problem 1 Β· Five Spanning Vectors

Given: a vector space VV is spanned by a list w1,w2,w3,w4,w5w_1, w_2, w_3, w_4, w_5. Which statement must be true?

βœ… Correct! An independent list in VV has length at most 55, so a list of 66 vectors cannot be independent.
❌ Not quite. The inequality only bounds independent lists from above; it never makes a list independent. The list w1,w1,w1,w1,w1w_1, w_1, w_1, w_1, w_1 has length 55 and is dependent.
❌ The inequality points the other way. Independent lists are at most as long as spanning lists: m≀5m \leq 5, not mβ‰₯5m \geq 5. The one-vector list w1w_1 is independent whenever w1β‰ 0w_1 \neq 0.
❌ Not quite. Appending 00 to w1,…,w5w_1, \dots, w_5 gives a spanning list of length 66; the theorem bounds the length of a spanning list only from below.
Show solution

Let u1,…,umu_1, \dots, u_m be any linearly independent list in VV. Since w1,…,w5w_1, \dots, w_5 spans VV, the length inequality gives

m≀5.m \leq 5.

A list of 66 vectors would be an independent list of length 6>56 > 5 if it were independent, so every list of 66 vectors in VV is linearly dependent. The other statements fail: w1,…,w1w_1, \dots, w_1 (five copies) is a dependent list of length 55; a single nonzero vector is an independent list of length 11; and w1,…,w5,0w_1, \dots, w_5, 0 spans VV with length 66.

Problem 2 Β· What the Lengths Alone Decide

Given: in R4\mathbf{R}^4, a list AA has 55 vectors, a list BB has 33 vectors and a list CC has 44 vectors. Nothing else is known about them. Which conclusion follows from the length inequality alone?

βœ… Correct! e1,…,e4e_1, \dots, e_4 both spans R4\mathbf{R}^4 and is independent, so independent lists have length ≀4\leq 4 and spanning lists have length β‰₯4\geq 4; a length of exactly 44 decides nothing.
❌ Not quite. Length comparisons give only negative conclusions. Five copies of e1e_1 do not span R4\mathbf{R}^4, and e1,e1,e2e_1, e_1, e_2 is not independent.
❌ Close, but length 44 is the case the theorem says nothing about. e1,e2,e3,e1+e2e_1, e_2, e_3, e_1 + e_2 has length 44 and is dependent; only a computation can decide for a list of length 44.
Show solution

The standard list e1,e2,e3,e4e_1, e_2, e_3, e_4 spans R4\mathbf{R}^4 and is linearly independent. Use it on each side of the inequality:

  • It spans R4\mathbf{R}^4, so every independent list has length ≀4\leq 4. AA has length 55, so AA is linearly dependent.
  • It is independent, so every spanning list has length β‰₯4\geq 4. BB has length 33, so BB does not span R4\mathbf{R}^4.

For CC both bounds are met with equality, and the theorem is silent: e1,e2,e3,e4e_1, e_2, e_3, e_4 is independent and spans, while e1,e2,e3,e1+e2e_1, e_2, e_3, e_1 + e_2 is dependent and does not span.

Problem 3 Β· One Exchange Step

Given: in R3\mathbf{R}^3, the list w1=(1,0,0)w_1 = (1, 0, 0), w2=(0,1,0)w_2 = (0, 1, 0), w3=(0,0,1)w_3 = (0, 0, 1), w4=(1,1,1)w_4 = (1, 1, 1) spans, and u1=(0,1,1)u_1 = (0, 1, 1). Step 1 forms u1,w1,w2,w3,w4u_1, w_1, w_2, w_3, w_4 and removes the first vector that lies in the span of the vectors before it.

Which vector is removed?

Which equation shows that it lies in the span of the vectors before it?

βœ… Correct! w3=u1βˆ’w2∈span⁑(u1,w1,w2)w_3 = u_1 - w_2 \in \operatorname{span}(u_1, w_1, w_2), and removing it leaves u1,w1,w2,w4u_1, w_1, w_2, w_4, which still spans R3\mathbf{R}^3 and has length 44.
❌ Not quite. Test the vectors in order: is w1w_1 a multiple of u1u_1? Is w2=au1+bw1w_2 = a u_1 + b w_1 possible? The third coordinate forces a=0a = 0, and then the second coordinate gives 0=10 = 1.
❌ It cannot be u1u_1. Nothing comes before u1u_1, and span⁑( )={0}\operatorname{span}(\,) = \{0\}, while u1β‰ 0u_1 \neq 0.
❌ Close. w4w_4 also lies in the span of the vectors before it, but an earlier vector already does, and the step removes the first one.
❌ Check the coordinates. Compute the right-hand side: the result must be (0,0,1)(0, 0, 1).
❌ True equation, wrong vectors. w4βˆ’w1βˆ’w2=(0,0,1)w_4 - w_1 - w_2 = (0, 0, 1), but w4w_4 comes after w3w_3; the lemma needs w3w_3 in the span of u1,w1,w2u_1, w_1, w_2.
Show solution

Check the vectors of u1,w1,w2,w3,w4u_1, w_1, w_2, w_3, w_4 in order.

  • u1β‰ 0u_1 \neq 0, so u1βˆ‰span⁑( )={0}u_1 \notin \operatorname{span}(\,) = \{0\}.
  • w1=(1,0,0)w_1 = (1, 0, 0) is not a multiple of (0,1,1)(0, 1, 1).
  • w2=a(0,1,1)+b(1,0,0)=(b,a,a)w_2 = a(0, 1, 1) + b(1, 0, 0) = (b, a, a) would need a=1a = 1 and a=0a = 0: impossible.
  • w3w_3: since u1βˆ’w2=(0,1,1)βˆ’(0,1,0)=(0,0,1)u_1 - w_2 = (0, 1, 1) - (0, 1, 0) = (0, 0, 1), we get w3=u1βˆ’w2∈span⁑(u1,w1,w2)w_3 = u_1 - w_2 \in \operatorname{span}(u_1, w_1, w_2).

So w3w_3 is removed. By the second part of the lemma the span is unchanged:

span⁑(u1,w1,w2,w4)=span⁑(u1,w1,w2,w3,w4)=R3,\operatorname{span}(u_1, w_1, w_2, w_4) = \operatorname{span}(u_1, w_1, w_2, w_3, w_4) = \mathbf{R}^3,

and the new list has length 4=n4 = n. The identity w3=w4βˆ’w1βˆ’w2w_3 = w_4 - w_1 - w_2 is true but uses w4w_4, which comes later in the list.

Problem 4 Β· A Subspace of Polynomials

Given: UU is a subspace of P4(R)\mathcal{P}_4(\mathbf{R}), the polynomials of degree at most 44, which is spanned by 1,x,x2,x3,x41, x, x^2, x^3, x^4. The construction from the video chooses a nonzero u1∈Uu_1 \in U, then each uk∈Uu_k \in U with ukβˆ‰span⁑(u1,…,ukβˆ’1)u_k \notin \operatorname{span}(u_1, \dots, u_{k-1}), until the chosen vectors span UU.

At most how many vectors can it choose?

Why is u1,…,uku_1, \dots, u_k linearly independent at every stage?

βœ… Correct! The chosen list is independent by the lemma, it lies in P4(R)\mathcal{P}_4(\mathbf{R}), which a list of length 55 spans, so at most 55 vectors are chosen and UU is finite-dimensional.
❌ Not quite. The chosen vectors form an independent list in a space spanned by 1,x,x2,x3,x41, x, x^2, x^3, x^4.
❌ Too small. When U=P4(R)U = \mathcal{P}_4(\mathbf{R}) the construction can choose 1,x,x2,x3,x41, x, x^2, x^3, x^4: five vectors.
❌ That counts steps, not choices. The construction may run up to a sixth step, but that step only checks that the five chosen vectors span UU; six chosen vectors would be an independent list of length 66 in a space spanned by 55.
❌ That is what the construction rules out. The chosen vectors are independent and lie in P4(R)\mathcal{P}_4(\mathbf{R}), so the length inequality caps them at 55, and the process must stop.
❌ Not quite. Lying in a subspace says nothing about independence: u,2uu, 2u both lie in any subspace containing uu.
❌ That is circular. The finite-dimensionality of UU is the conclusion of this argument, not an ingredient.
❌ The logic runs the other way. Independence comes first, from the lemma; the bound of 55 is then a consequence of the length inequality.
Show solution

Independence. By construction u1β‰ 0u_1 \neq 0, so u1βˆ‰span⁑( )={0}u_1 \notin \operatorname{span}(\,) = \{0\}, and each later ujβˆ‰span⁑(u1,…,ujβˆ’1)u_j \notin \operatorname{span}(u_1, \dots, u_{j-1}). If u1,…,uku_1, \dots, u_k were dependent, the linear dependence lemma would give some uj∈span⁑(u1,…,ujβˆ’1)u_j \in \operatorname{span}(u_1, \dots, u_{j-1}), which never happens. So the list is independent.

The bound. The list lies in P4(R)\mathcal{P}_4(\mathbf{R}), which is spanned by the list 1,x,x2,x3,x41, x, x^2, x^3, x^4 of length 55. By the length inequality,

k≀5.k \leq 5.

So the construction stops after at most 55 choices, at a step where U=span⁑(u1,…,uk)U = \operatorname{span}(u_1, \dots, u_k), and UU is finite-dimensional. The bound 55 is reached when U=P4(R)U = \mathcal{P}_4(\mathbf{R}), for instance with u1,…,u5=1,x,x2,x3,x4u_1, \dots, u_5 = 1, x, x^2, x^3, x^4.

Solved: 0 / 4