Linear-Algebra-Done-Right · Unit 14 · Video 1 · Interactive Practice

Inner Products: Why Complex Spaces Need a Conjugate

IKey Formulas

FormulaStatementHypotheses
⟨w,z⟩=w1z1‾+⋯+wnzn‾\langle w, z \rangle = w_1\overline{z_1} + \cdots + w_n\overline{z_n}The Euclidean inner product; on Rn\mathbf{R}^n the conjugates do nothing and it is the dot productF=R\mathbf{F} = \mathbf{R} or C\mathbf{C}; w=(w1,…,wn)w = (w_1, \ldots, w_n) and z=(z1,…,zn)z = (z_1, \ldots, z_n) in Fn\mathbf{F}^n
⟨w,z⟩=c1w1z1‾+⋯+cnwnzn‾\langle w, z \rangle = c_1 w_1\overline{z_1} + \cdots + c_n w_n\overline{z_n}A weighted inner product, with ⟨w,w⟩=c1∣w1∣2+⋯+cn∣wn∣2\langle w, w \rangle = c_1|w_1|^2 + \cdots + c_n|w_n|^2F=R\mathbf{F} = \mathbf{R} or C\mathbf{C}; weights c1,…,cn>0c_1, \ldots, c_n > 0 (with c=(1,−1)c = (1, -1), ⟨(1,1),(1,1)⟩=0\langle (1,1), (1,1) \rangle = 0)
⟨u,v⟩=⟨v,u⟩‾\langle u, v \rangle = \overline{\langle v, u \rangle}Conjugate symmetry; with u=vu = v it forces ⟨v,v⟩∈R\langle v, v \rangle \in \mathbf{R}, and on a real space it reads ⟨u,v⟩=⟨v,u⟩\langle u, v \rangle = \langle v, u \rangle⟨⋅,⋅⟩\langle \cdot, \cdot \rangle an inner product on a vector space VV over F\mathbf{F}; u,v∈Vu, v \in V
⟨u,v+w⟩=⟨u,v⟩+⟨u,w⟩\langle u, v + w \rangle = \langle u, v \rangle + \langle u, w \rangle,  ⟨u,λv⟩=λˉ⟨u,v⟩\ \langle u, \lambda v \rangle = \bar{\lambda}\langle u, v \rangleThe second slot is additive and scalars come out conjugated (the first slot gives ⟨λu,v⟩=λ⟨u,v⟩\langle \lambda u, v \rangle = \lambda\langle u, v \rangle)VV an inner product space over F\mathbf{F}; u,v,w∈Vu, v, w \in V, λ∈F\lambda \in \mathbf{F}

Key Insight: For z=(1,i)∈C2z = (1, i) \in \mathbf{C}^2, squaring and adding gives 12+i2=01^2 + i^2 = 0 although z≠0z \neq 0. Multiplying each coordinate by its conjugate gives 1⋅1‾+i⋅i‾=1+1=21 \cdot \overline{1} + i \cdot \overline{i} = 1 + 1 = 2, a positive real number, and that is why the conjugate sits in the definition.

IISquares Versus Conjugates in C²

Squaring and adding the coordinates of a nonzero z∈C2z \in \mathbf{C}^2 can give 00 or worse; z1z1‾+z2z2‾z_1\overline{z_1} + z_2\overline{z_2} never does.

IIITesting a Candidate Formula on R²

A formula on R2\mathbf{R}^2 is an inner product only if all five properties hold for every uu, vv and λ\lambda.

💡 One choice of vectors that breaks a property disproves it, but passing at one choice proves nothing: 2x1y1+x2y22x_1y_1 + x_2y_2 passes everywhere because it is linear in xx, symmetric, and ⟨x,x⟩=2x12+x22\langle x, x \rangle = 2x_1^2 + x_2^2.

IVScalars Leave the Second Slot Conjugated

Multiplying ⟨u,v⟩\langle u, v \rangle by λ\lambda rotates it one way in C\mathbf{C}; multiplying by λˉ\bar{\lambda} rotates it the opposite way.

VQuiz Questions

Problem 1 · A Weighted Inner Product on R³

Given: the inner product on R3\mathbf{R}^3 defined by ⟨x,y⟩=2x1y1+x2y2+3x3y3\langle x, y \rangle = 2x_1y_1 + x_2y_2 + 3x_3y_3, with x=(1,−2,2)x = (1, -2, 2) and y=(3,1,−1)y = (3, 1, -1). Find ⟨x,y⟩\langle x, y \rangle.

✅ Correct! 2(1)(3)+(−2)(1)+3(2)(−1)=6−2−6=−22(1)(3) + (-2)(1) + 3(2)(-1) = 6 - 2 - 6 = -2.
❌ That is the dot product. 3−2−2=−13 - 2 - 2 = -1 ignores the weights 22, 11, 33; each product xkykx_ky_k must be multiplied by its weight ckc_k.
❌ Weights in the wrong order. 3(1)(3)+(−2)(1)+2(2)(−1)=33(1)(3) + (-2)(1) + 2(2)(-1) = 3 uses the weights reversed; c1=2c_1 = 2 multiplies x1y1x_1y_1 and c3=3c_3 = 3 multiplies x3y3x_3y_3.
❌ The sign is real. Positivity constrains only ⟨v,v⟩\langle v, v \rangle; the inner product of two different vectors can be negative, and here it is −2-2.
Show solution

The weights are c1=2c_1 = 2, c2=1c_2 = 1, c3=3c_3 = 3, all positive, so this is an inner product on R3\mathbf{R}^3 (on R\mathbf{R} the conjugates do nothing). Multiply coordinate by coordinate, weight, and add:

⟨x,y⟩=2(1)(3)+(−2)(1)+3(2)(−1)=6−2−6=−2.\langle x, y \rangle = 2(1)(3) + (-2)(1) + 3(2)(-1) = 6 - 2 - 6 = -2.

A negative value is allowed: positivity says only that ⟨v,v⟩≥0\langle v, v \rangle \geq 0. For instance ⟨x,x⟩=2(1)2+(−2)2+3(2)2=2+4+12=18≥0\langle x, x \rangle = 2(1)^2 + (-2)^2 + 3(2)^2 = 2 + 4 + 12 = 18 \geq 0.

Problem 2 · Which Property Breaks?

Given: the formula ⟨x,y⟩=∣x1y1∣+∣x2y2∣\langle x, y \rangle = |x_1y_1| + |x_2y_2| on R2\mathbf{R}^2. Exactly one of the properties listed below fails for it. Which one?

✅ Correct! The absolute values swallow the sign of λ\lambda: with λ=−1\lambda = -1, u=(1,2)u = (1, 2), v=(3,−1)v = (3, -1) we get ⟨−u,v⟩=5\langle -u, v \rangle = 5 but −⟨u,v⟩=−5-\langle u, v \rangle = -5.
❌ Positivity holds. ⟨v,v⟩=∣v12∣+∣v22∣=v12+v22≥0\langle v, v \rangle = |v_1^2| + |v_2^2| = v_1^2 + v_2^2 \geq 0.
❌ Definiteness holds. v12+v22=0v_1^2 + v_2^2 = 0 forces v1=v2=0v_1 = v_2 = 0.
❌ Symmetry holds. ∣u1v1∣=∣v1u1∣|u_1v_1| = |v_1u_1| and ∣u2v2∣=∣v2u2∣|u_2v_2| = |v_2u_2|, so swapping uu and vv changes nothing; on R\mathbf{R} this is conjugate symmetry.
Show solution

Check each listed property.

Positivity and definiteness: ⟨v,v⟩=v12+v22\langle v, v \rangle = v_1^2 + v_2^2, which is ≥0\geq 0 and is 00 only for v=0v = 0. Both hold.

Symmetry: each term ∣xkyk∣|x_ky_k| is unchanged when xx and yy swap. It holds.

Homogeneity: ⟨λu,v⟩=∣λ∣ ⟨u,v⟩\langle \lambda u, v \rangle = |\lambda|\,\langle u, v \rangle, which differs from λ⟨u,v⟩\lambda\langle u, v \rangle whenever λ<0\lambda < 0 and ⟨u,v⟩≠0\langle u, v \rangle \neq 0. With u=(1,2)u = (1, 2), v=(3,−1)v = (3, -1), λ=−1\lambda = -1:

⟨−u,v⟩=∣(−1)(3)∣+∣(−2)(−1)∣=3+2=5≠−5=−⟨u,v⟩.\langle -u, v \rangle = |(-1)(3)| + |(-2)(-1)| = 3 + 2 = 5 \neq -5 = -\langle u, v \rangle.

So the formula is not an inner product. (Additivity in the first slot, which is not listed, fails too: u=(1,0)u = (1, 0), v=w=(−2,0)v = w = (-2, 0) give ⟨u+v,w⟩=2\langle u + v, w \rangle = 2 but ⟨u,w⟩+⟨v,w⟩=2+4=6\langle u, w \rangle + \langle v, w \rangle = 2 + 4 = 6.)

Problem 3 · The Euclidean Inner Product on C²

Given: C2\mathbf{C}^2 with the Euclidean inner product, u=(1+i, 2)u = (1 + i,\ 2) and v=(i, 1−i)v = (i,\ 1 - i). Find ⟨u,v⟩\langle u, v \rangle and ⟨v,u⟩\langle v, u \rangle.

What is ⟨u, v⟩?

What is ⟨v, u⟩?

✅ Correct! ⟨u,v⟩=3+i\langle u, v \rangle = 3 + i and ⟨v,u⟩=3−i=3+i‾\langle v, u \rangle = 3 - i = \overline{3 + i}, exactly as conjugate symmetry demands.
❌ Check ⟨u, v⟩. Conjugate the coordinates of the second vector: i‾=−i\overline{i} = -i and 1−i‾=1+i\overline{1 - i} = 1 + i.
❌ The conjugate is missing. (1+i)i+2(1−i)=1−i(1 + i)i + 2(1 - i) = 1 - i is the plain coordinate product; the Euclidean inner product uses wkzk‾w_k\overline{z_k}.
❌ Wrong slot conjugated. Conjugating uu instead of vv gives 1+i‾ i+2(1−i)=3−i\overline{1 + i}\,i + 2(1 - i) = 3 - i, which is ⟨v,u⟩\langle v, u \rangle. In ⟨u,v⟩\langle u, v \rangle the conjugates go on the second vector.
❌ Too many conjugates. 1+i‾ i‾+2‾ (1−i)‾=1+i\overline{1 + i}\,\overline{i} + \overline{2}\,\overline{(1 - i)} = 1 + i conjugates both vectors, which gives 1−i‾\overline{1 - i}, the conjugate of the plain coordinate product. Only the second vector's coordinates are conjugated.
❌ The conjugate is missing. i(1+i)+(1−i)(2)=1−ii(1 + i) + (1 - i)(2) = 1 - i is the plain coordinate product, which is the same in either order; ⟨v,u⟩\langle v, u \rangle conjugates the coordinates of uu.
❌ Check ⟨v, u⟩. Either compute i (1+i)‾+(1−i) 2‾i\,\overline{(1 + i)} + (1 - i)\,\overline{2}, or conjugate your answer for ⟨u,v⟩\langle u, v \rangle.
❌ Not symmetric over C. Swapping the slots conjugates the value: ⟨v,u⟩=⟨u,v⟩‾=3+i‾\langle v, u \rangle = \overline{\langle u, v \rangle} = \overline{3 + i}.
❌ Conjugate, not negate. 3+i‾=3−i\overline{3 + i} = 3 - i; only the imaginary part changes sign.
Show solution

Step 1: ⟨u, v⟩. Multiply each coordinate of uu by the conjugate of the matching coordinate of vv:

⟨u,v⟩=(1+i) i‾+2 (1−i)‾=(1+i)(−i)+2(1+i)=(1−i)+(2+2i)=3+i.\langle u, v \rangle = (1 + i)\,\overline{i} + 2\,\overline{(1 - i)} = (1 + i)(-i) + 2(1 + i) = (1 - i) + (2 + 2i) = 3 + i.

Step 2: ⟨v, u⟩. Directly:

⟨v,u⟩=i (1+i)‾+(1−i) 2‾=i(1−i)+(2−2i)=(1+i)+(2−2i)=3−i.\langle v, u \rangle = i\,\overline{(1 + i)} + (1 - i)\,\overline{2} = i(1 - i) + (2 - 2i) = (1 + i) + (2 - 2i) = 3 - i.

Check: conjugate symmetry predicts ⟨v,u⟩=⟨u,v⟩‾=3+i‾=3−i\langle v, u \rangle = \overline{\langle u, v \rangle} = \overline{3 + i} = 3 - i. ✓

Problem 4 · Scalars in Both Slots

Given: VV an inner product space over C\mathbf{C} and u,v∈Vu, v \in V with ⟨u,v⟩=2−i\langle u, v \rangle = 2 - i. Find ⟨(1+i)u, 3i v⟩\langle (1 + i)u,\ 3i\,v \rangle.

✅ Correct! (1+i) 3i‾ (2−i)=(1+i)(−3i)(2−i)=(3−3i)(2−i)=3−9i(1 + i)\,\overline{3i}\,(2 - i) = (1 + i)(-3i)(2 - i) = (3 - 3i)(2 - i) = 3 - 9i.
❌ The second-slot scalar must be conjugated. (1+i)(3i)(2−i)=−3+9i(1 + i)(3i)(2 - i) = -3 + 9i treats the inner product as linear in both slots; ⟨u,λv⟩=λˉ⟨u,v⟩\langle u, \lambda v \rangle = \bar{\lambda}\langle u, v \rangle, so 3i3i comes out as −3i-3i.
❌ That is the other convention. Conjugating the first-slot scalar instead gives (1−i)(3i)(2−i)=9+3i(1 - i)(3i)(2 - i) = 9 + 3i, the physicists' convention. Here homogeneity holds in the first slot, so 1+i1 + i comes out unchanged.
❌ Only one scalar is conjugated. (1−i)(−3i)(2−i)=−9−3i(1 - i)(-3i)(2 - i) = -9 - 3i conjugates both; a scalar leaves the first slot unchanged.
Show solution

Step 1: first slot. Homogeneity in the first slot: ⟨(1+i)u,3i v⟩=(1+i) ⟨u,3i v⟩\langle (1 + i)u, 3i\,v \rangle = (1 + i)\,\langle u, 3i\,v \rangle.

Step 2: second slot. Scalars come out conjugated: ⟨u,3i v⟩=3i‾ ⟨u,v⟩=−3i (2−i)\langle u, 3i\,v \rangle = \overline{3i}\,\langle u, v \rangle = -3i\,(2 - i).

Step 3: multiply.

(1+i)(−3i)(2−i)=(−3i−3i2)(2−i)=(3−3i)(2−i)=6−3i−6i+3i2=3−9i.(1 + i)(-3i)(2 - i) = (-3i - 3i^2)(2 - i) = (3 - 3i)(2 - i) = 6 - 3i - 6i + 3i^2 = 3 - 9i.

The derivation of Step 2 is the theorem from the video: ⟨u,λv⟩=⟨λv,u⟩‾=λ⟨v,u⟩‾=λˉ ⟨v,u⟩‾=λˉ⟨u,v⟩\langle u, \lambda v \rangle = \overline{\langle \lambda v, u \rangle} = \overline{\lambda\langle v, u \rangle} = \bar{\lambda}\,\overline{\langle v, u \rangle} = \bar{\lambda}\langle u, v \rangle.

Solved: 0 / 4