LINEAR-ALGEBRA ยท Interactive Practice โ Unit 26 ยท Video 3
| Concept | Formula | Meaning |
|---|---|---|
| Gradient zero | Locates a critical point | |
| Hessian (2D) | Matrix of second partials | |
| Minimum test | AND | is positive definite |
| Saddle test | is indefinite | |
| Eigenvalue test | All eigenvalues of | Equivalent to positive definite |
For a quadratic , the Hessian is constant:
The pivot and the determinant of the Hessian decide whether the origin is a minimum, a maximum, or a saddle.
๐ก Challenge: hold and fixed โ how large must grow before the cross term overpowers the diagonal and the bowl collapses into a saddle?
The Hessian's eigenvectors are the principal axes of the level curves; each eigenvalue's sign is the curvature along its axis.
๐ก Every entry of is positive, yet one eigenvalue is negative โ the determinant, not the sign of the entries, decides definiteness.
Question 1
Consider . The Hessian at the origin is
Is the origin a minimum, a maximum, or a saddle?
โ Correct! Pivot and , so is positive definite.
โ Not quite. Check the pivot and the determinant โ both need to be positive for a minimum.
Solution:
Apply both tests:
Both conditions are satisfied, so is positive definite. The origin is a minimum, and the surface is a bowl.
Question 2
A student claims: "The matrix must be positive definite because every entry is positive."
True or False?
โ Correct! , so is indefinite (a saddle).
โ Not quite. Compute . Is it really positive? Positive entries do not guarantee positive definiteness.
Solution:
Positive entries do not imply positive definite. Compute the determinant:
Since the determinant is negative, is indefinite โ one eigenvalue is positive, the other negative. The corresponding surface is a saddle, not a bowl.
The student is confusing entries with pivots/eigenvalues. Always check the determinant condition.
Question 3
For the function , compute the Hessian at the origin and classify the critical point.
What is the determinant of , and what type of critical point does the origin represent?
โ Correct! , so it's a saddle.
โ Not quite. Be careful with the sign: . Is the cross term big enough to flip the sign?
Solution:
Compute the second partials:
So
Determinant:
Since , is indefinite and the origin is a saddle point. The surface curves up along one eigenvector direction and down along another.
Question 4
You slice the graph of a quadratic with positive definite Hessian by the horizontal plane . What shape is the resulting curve in the -plane?
โ Correct! Positive definite โ closed, bounded level sets โ ellipses with axes along the eigenvectors of .
โ Not quite. Positive definite means the surface curves up in every direction. What kind of horizontal cross-section does a bowl have?
Solution:
A positive definite Hessian means the surface is a bowl curving upward in every direction. Slicing a bowl horizontally gives a closed curve โ specifically, an ellipse.
By contrast:
The shape of the level set is the geometric signature of the matrix.
Solved: 0 / 4